It would be interesting to do a study of what testing actually measures. I’d want to see if there was any consistency between professors, or if relationship to the professor is a better predictor of grade.
I suppose tests can measure what you’ve memorized. But if you want to know what someone can do with knowledge, you need to get them to write about hypothetical situations, or to actually work in situations where they need that knowledge.
As you might imagine, I mistrust evaluation systems. I have no idea what they are measuring, and I don’t know if what they are measuring is relevant to what I need people to do.
There are so many pressures not to fail students. If they flunk out, the school loses revenue. If professors have integrity and refuse to change grades, administrators can change the grades administratively, and, unless the professor checks (and how likely is that?), no one will ever know.
Of course standards are different at different schools, and it’s very difficult to know how different they are. A good student from a school with a lower reputation might actually be better than a good student from a prestigious school.
Now, I would never advocate for a universal testing system. I do not believe in no student left untested. I think education is a hands-on job, and the only way to really know how well a student is doing is to work with them. How many professors want to do that? Especially at a research institution?
At least with grad students, you can get a written recommendation from a professor, so you can tell something from that, reading between the lines. What that tells you is the student’s relationship with the professor. You’d be surprised at how many students ask for references from a professor who will not give them a good one.
But, schools need to have way to show consumers what kind of product they are turning out, and grades are it. I don’t think it’s worth trying to fix grading systems, because I don’t believe it can be done.
So that leaves caveat emptor. If an employer doesn’t check their new employee carefully, and use the probation period to really see if the employee’s work is useful, then they deserve to be saddled with poorly performing people. Reputations are self-perpetuating things. It’s hard to jump from a mid-level institution to an elite institution. Going to an elite institution shows—what? That you pal around with the right people? That your parents are wealthy enough to get you a good education? That you test well on SATs?
I guess what I’m saying is that tests are, and always will be crude instruments. Personal evaluation is the most meaningful thing. I think it’s a waste of effort to try to fix the grading system. It’s a schmoo. You poke it in on one side, and it pokes out on the other. The schmoo is endlessly adaptable, and not in a way we really like.