What are your thoughts on "grade inflation" at colleges and universities?

I am a teaching assistant at a fairly selective university in the US. I find that the professors who I work for typically think that the students deserve higher grades than I do. I wonder if I am expecting too much. Once in a while, a student will go over my head to ask the professor’s opinion on the grade I have given.