Ok i understand better!
Perhaps you should check if the option line nvagp is added in with number "1" in the device section of XF86Config
So that nvidia driver kernel module manage the AGP too
I'm not sure technically speaking but it changes lots of things i think
Have a look at the README again, there is often a distro section explanation
For my SuSE 8.2 and same kernel and XFree86
I have just followed these approaches
Check dependencies too
Have you made upgrades of your packages or something?
What have you done since the download of driver