LSU, Tennessee and the Pigs (AP Poll) Man is there any question who the toughest conference is in College football.. Big 12 Please. You got OU who had to fake a punt to beat Bama UT - Hammered at home by Arkansas K-State - Marshall beat them Nebraska ? - And you are ??? A&M - Suck Va Tech hammered em and they had to have some luck to beat Utah Oh they have Baylor and Kansas... We got Vandy. Promise you Vandy beats both of them by 3 TD's The SEC from top to bottom once again without question is the most brutal conference in College football. And its great.