What does your device section in your XF86 config look like? Would you post it, please? Did you remember to remove the line that said 'load "dri"'? And you did install the GLX driver as well, right?
I've got a similar setup (GF2 instead of GF3) working with the older 3123 drivers. I was able to install the 4191 drivers, but they rotted.