Hmm, ok, i think i have to say "Sorry Nvidia!"
There seems to be a regression in the Xorg-Server. I downgraded from 1.9.x to 1.8.x and no more crashes..
ATM i'm cloning the xserver repo and then i'll do a bisect. With some luck i'll find the commit which breaks x..