Uninstall Mesa. Install nVidia's package and leave it at that. Mesa is software OpenGL and will definitely peg your CPU.
If you're using agpgart, you may also need to edit your kernel config and make sure you're using the right AGP driver (Under "character devices").
"Floating in a dream-like state, I am the emporer of a parallel universe." --Arch Enemy
My xorg.conf file