Season 1 is definitely the weakest season, especially at the start. There's definitely still wacky humour in the rest of the show, but it loses the family guy cutaway gags.

I'd personally recommend giving season 2 a shot, if you still don't like it then the shows probably not for you.