Doesn't need to be realistic, it just has to make sense and fit in it's own context.
Morrowind's character, for instance, stuck out.
Oblivion's were just bland. It's that facegen tech, I think. The npc's in oblivion were made with it. (the same tools you get to make your own characters)
What you have to work with it just so.. ugly, though.