"I am using the NVIDIA graphics drivers supplied on this site and got the X server to work by following the instructions in the readme for the source rpm's(Installed for the first kernel and then upgraded for the new kernel to work)"
I used the source rpm's and followed the readme available to install them. The version on this site is all the same i think(1.0-2960). Im probly not the person you want to ask for help but what error did you get at which stage of the install. And which way are you installing it.