Uh, no. I have been watching football on Sundays with 3-4 TVs all with the NFL game package for approaching a decade now. My friends and I nearly have it down to a science. Rarely are there more than three games on at the same time that are "can't miss games." We usually bounce around between games just to avoid commercials (although occasionally they screw us by getting all the games time-outs in sync).
Current setup, main TV 65" plasma, 2 secondary HDTV projections approx 50".