I'm a programmer and I can easily get an app to blue-screen via OLE function calls w/ invalid parameters, but I doubt that's your problem here. (OLE is unlikely to be used in a game.)
High resolutions tend to stress everything in your system, including the CPU, RAM, buses, etc.
Here are a few more things you might want to investigate:
Is it possible that your power supply is not up to the task? I've seen lots of weird system problems occur with flakey power supplies.
Is it possible that your CPU might be overheating, since the video card will be dumping extra heat into the case?
What about the motherboard chipset (North/South bridge chip(s) - are they overheating?
Try running with the case open while a big-ass fan blows onto the motherboard. If that fixes the problem, then you should upgrade 1 or more coolers / fans.