Quit while you're behind, way behind.
While the consistency of the reffing has been sub-par, the refs have to make the call they see, its not perfect but it evens out. I think people underestimate how truly difficult the job is.
I'm also a firm believer that the game should be called the exact same from the first minute of the game to the last minute. First game of the season to game 7 of the Cup finals. That will provide a bit more consistency and maintain the integrity of the game. I'm sure a lot of people (myself included) get ticked when there's a tripping penalty called on their team in the last minute. However, say a guy on your favourite team is taking down in the last minute and no call is made, do you not find yourself screaming at the TV for a call? Remember you can;t have your cake and eat it to. (Does that saying not make any sense to anyone else? Yet they find themselves using it, facepalm).
Anyways, its not a perfect science but consistency has to be there.