All is well.. proceed
Personally I've had excellent success using the 2.6 patches from Zander, and experience fewer lockups than using official drivers on the 2.4 kernel, which is certainly due to the 2.6 kernel itself. If you have the skillset to migrate your machine, or access to help, portage or similar, to correct the issues with binutils and module configuration changes from 2.6 to 2.4 there is nothing to fear.
"..the triumph of evil is for good men to do nothing."
VIDIA video driver RPMs for Fedora
:: see yum repo at livna.org