yeah, X never crashed on my machine before I disabled kdm. I would try to do as you suggested with kdm.
So, how to setup kdm to restart xserver every logout?
I edited /usr/share/config/kdm/kdmrc, but haven't found an option that sounds to help.
I use latest kde version.
p.s.: concluding, it's a problem of nvidia driver or of XFree?