I can relate to what you're describing. I felt the same way about Lost many years ago.
I gave up on TWD half way through the third season. The thing that tipped me was a woman (I can't even remember the names now) driving down a deserted road and crashing the car. I figured if they need to dredge the barrel that deep to create a scene (Oh, nothing's happening, let's add this car crash for no reason) I wasn't interested.
I hope the show makers come through and you are rewarded for the time invested.
RE: The Walking Dead returns tomorrow, but does anyone care?