View Single Post
Old 07-21-11, 05:22 AM   #1
jjamulla
Registered User
 
Join Date: Jul 2011
Location: Buffalo, NY
Posts: 1
Question Ubuntu 11.04 HPC with Z68/i7-2600k Mobo and Multiple Nvidia GTX cards

Hi - I'm new here so I apologize if I'm in the wrong area.

I want to be able to install as many as 3 NVIDIA GTX (say 2 580s and a 460) cards in my Asus P8Z68-V Pro Mobo running Ubuntu 11.04, 64-bit with a i7-2600k CPU, for the purposes of running Einstein@Home.

I want to be able to use the On-board Intel Graphics for display, and the 3 cards for computation.

I think I've proved to myself that the actual physical installation is possible (size, heat, power wise now, and I can actually use the 3rd PCIe X16 slot (running at X4 though).
I bought a 1200W PS, and a special case).

I have the machine up and running currently with Ubuntu 11.04 and with BOINC running just from the CPUs, so all is well there. So far BOINC doesn't see any usable GPUs, even when I have the GTX 460 running my display. So this is a problem and I don't know why.

I finally figured out how to get a GTX 460 I already had, "working" in the 3rd X16 slot (for display only and recognized by the driver available through Ubuntu) by messing with the /etc/X11/xorg.conf file, and having Ubuntu install the driver, and then making sure the kernel module was being pulled from the right place.

First problem - The driver wouldn't initialize (nvidia from ubuntu) until I actually connected a monitor cable to the card?? Is there any way around that?
I don't want to do that, I want X/monitor output from the On-Chip Intel GPU.
And I don't know what will happen if I install the other graphics cards, will they not been seen until each of them has a monitor connected??

2nd problem - I have all the CUDA dev stuff loaded, and I can compile the GPU Compute SDK samples, but when I run them, (bandwidth test) doesn't find a CUDA enabled card (error 3 I think, didn't look it up yet). I hope this is becuase of the gcc 4.5?? (I'll try to go load gcc 4.3 or 4.4)

So - The big question is, does anyone have direct experience on how to get this sort of thing going, hopefully step by step, successfully?

I'd be very happy if someone told me what tricks to use in order to get driver up and going and recognize my GPUs without connecting monitors to them.

Is there anywhere that it's documented what the actual CAPABILITIES of the linux NVIDIA drivers are? Like what you can and can't do with them?

Any help would be greatly appreciated. Next step currently is to try to get gcc 4.3 or 4.4 loaded and see what happens then.

Thanks in Advance!
jjamulla is offline   Reply With Quote