Slow 2D with the 4191 drivers is a known problem, with pretty much no solution.
nVidia replaced the RENDER extension with some proprietary something that seems to not want to work for a lot of people, that's why it's slow. If you revert back to driver 3123, that would probably help your 2D performance. And you should be using the .src.rpm regardless, because your kernel is newer than what there's support for.
On the long load times, that happens to people at random, pretty much. I don't think there's a lot you can do about it, either, unfortunately.