I'm having same kind of problems. When I used nvidia driver that was supplied with X-Free there was no delay. The problem seems to get worse with every new driver release from nvidia. The version I used before this latest 2960 only had a delay of about 10 seconds which was bearable. Now with 2960 the delay is close to a minute and this is getting very annoying. Unfortunately I don't have older driverset anymore and nvidia doesn't seem to provide it on their downloadpage either.
My card is an old TNT (Diamond Viper V550). So: For the lack of better solution, if anyone has older drivers left (I believe the version I used before was something like 2513?), please do us old TNT owners a great big favor and make them available