5336 hangs on Debian sarge (kernel 2.6.4)

[allroy]

I just installed Debian sarge, and compiled a custom 2.6.4 kernel, and installed the 5336 nvidia drivers, but when I type "startx" at the command line, rainbow colored boxes appear on the screen and my computer totally freezes and I have to hit the reset button to get it back. My XFree86.log file doesnt show any errors either, the only thing in the log that seems like it might affect it is that the "nvidia" and "glx" modules say "compiled for XFree86 4.0.2" (I think), but I have XFree86 version 4.3.0 installed. The nvidia kernel modules also loads fine, and the symlinks to all the GLcore and glx libraries all point to the right place. Could it possibly have something to do with the fact that I compiled the kernel myself, and didn't use a precompiled one? If anyone wants it my kernel ".configure" file and my "XF86Config-4" files I can post them here as well.