Season 5 is epic, I don't know what you guys are talking about. Season 4 was a build up for 5, and 3 was total bullshit.
Season 4 wasn't a "build up for 5", both season 3 and 4 were consecutively tied together while season 5 is a whole other beast.
On a side note, the series has been degrading itself since the 3rd season. A lot of my interest for any of the characters has been diminished, and the only thing that's been keeping me around to watch it is the main story-arcs, and... because zombies.