3 Cards under Ubuntu 10.10

fnj00 · 03-19-11, 07:46 AM

Hello,

I am stumped at trying to configure my ubuntu desktop to support 3 NVidia GFX cards. My configuration is as follows:

Ubuntu 10.10 32bit with PAE Kernel
4GB DDR2
ASUS M2NBP-VM CSM Motherboard
Onboard 6150 LE enabled in bios to run alongside PCI-e card

Installed Devices:

8800 GTS 320MB pci-e
FX 5200 PCI 256MB

Currently my setup is working perfect with the 6150 and the 8800 gts with the latest driver (260.19.06) across 4 monitors. As soon as i try to enable the 3rd card and monitors in my xorg.conf with the older driver (173) the system upon reboot will only flicker all screens on/off and will not boot to X. I have attached my nvidia-debug file hoping someone will have some insight into a solution for my problems.

sandipt · 03-21-11, 07:58 AM

Quote:

Originally Posted by fnj00

Hello,

I am stumped at trying to configure my ubuntu desktop to support 3 NVidia GFX cards. My configuration is as follows:

Ubuntu 10.10 32bit with PAE Kernel
4GB DDR2
ASUS M2NBP-VM CSM Motherboard
Onboard 6150 LE enabled in bios to run alongside PCI-e card

Installed Devices:

8800 GTS 320MB pci-e
FX 5200 PCI 256MB

Currently my setup is working perfect with the 6150 and the 8800 gts with the latest driver (260.19.06) across 4 monitors. As soon as i try to enable the 3rd card and monitors in my xorg.conf with the older driver (173) the system upon reboot will only flicker all screens on/off and will not boot to X. I have attached my nvidia-debug file hoping someone will have some insight into a solution for my problems.

From logs looks like GPU is not initialized of slot PCI:4:9:0. Please try by interchanging gpu boards with different PCI-E/PCI slots.

[ 57.840] (EE) NVIDIA(4): Failed to initialize the NVIDIA graphics device PCI:4:9:0.
[ 57.840] (EE) NVIDIA(4): Please see the COMMON PROBLEMS section in the README for
[ 57.840] (EE) NVIDIA(4): additional information.
[ 57.840] (EE) NVIDIA(4): Failed to initialize the NVIDIA graphics device!
[ 57.840] (II) UnloadModule: "nvidia"
[ 57.840] (II) UnloadModule: "wfb"
[ 57.840] (II) UnloadModule: "fb"
[ 57.840] (--) Depth 24 pixmap format is 32 bpp
[ 57.844] (EE) NVIDIA(GPU-2): Failed to initialize the NVIDIA graphics device PCI:4:9:0.
[ 57.844] (EE) NVIDIA(GPU-2): Please see the COMMON PROBLEMS section in the README for
[ 57.844] (EE) NVIDIA(GPU-2): additional information.
[ 57.844] (WW) NVIDIA(GPU-2): Failed to initialize NVIDIA graphics device on GPU PCI:4:9:0!

tadawson · 03-21-11, 12:18 PM

I also could not get three cards to come online in Linux, and found that I had to add a vmalloc=XXX entry to my boot - there was simply not enough memory allocated to allow the third card to init, and this is what was found in the "COMMON PROBLEMS" section you have been referred to . . .

- Tim

towo| · 03-21-11, 02:56 PM

This will never work, since a GeForce 5xxx only works with 173xx driver.

Licaon · 03-22-11, 02:30 AM

Quote:

Originally Posted by towo|

This will never work, since a GeForce 5xxx only works with 173xx driver.

But it should work as 173.14.28 supports all the cards in question ( Onboard 6150 LE & 8800 GTS 320MB pci-e )

towo| · 03-22-11, 02:31 AM

Maybe, but

Quote:

Currently my setup is working perfect with the 6150 and the 8800 gts with the latest driver (260.19.06) across 4 monitors.

This can't work.

Licaon · 03-22-11, 02:46 AM

Quote:

Originally Posted by towo|

Maybe, but
This can't work.

True that, but:

Quote:

As soon as i try to enable the 3rd card and monitors in my xorg.conf with the older driver (173) the system upon reboot will only flicker all screens on/off and will not boot to X.

sandipt · 03-23-11, 12:35 AM

Hi all,
Internally we have filed bug 806605 to track this issue. Lets do some more experiments with different motherboards, gpus for older drivers (173) and let us know the results.

sandipt · 03-28-11, 02:58 AM

Hello all,
We have reproduced this issue in house on x86 system. This issue is not repro for x64 OS. Also after adding parameter vmalloc=256MB all 3 GPUs are initialized. See the "Kernel virtual address space exhaustion on the X86 platform" section in the README.

fnj00 · 04-01-11, 11:21 AM

Added vmalloc=256M to grub and now I get the following in my xorg.log:

[ 40.779] (II) NVIDIA(0): Unable to connect to the ACPI daemon; the ACPI daemon may not
[ 40.780] (II) NVIDIA(0): be running or the "AcpidSocketPath" X configuration option
[ 40.780] (II) NVIDIA(0): may not be set correctly. When the ACPI daemon is
[ 40.780] (II) NVIDIA(0): available, the NVIDIA X driver can use it to receive ACPI
[ 40.780] (II) NVIDIA(0): events. For details, please see the "ConnectToAcpid" and
[ 40.780] (II) NVIDIA(0): "AcpidSocketPath" X configuration options in Appendix B: X
[ 40.780] (II) NVIDIA(0): Config Options in the README.

Licaon · 04-01-11, 08:41 PM

but does it work?

fnj00 · 04-02-11, 09:12 PM

It still would not start X with the 5200 with vmalloc=256M. However I found a 6200 PCI and swapped my 8800gts for a smaller Quadro 1400 and and now have 6 working monitors with the nvidia Driver: 260.19.06

Now my only issue is high load from /usr/bin/X as soon as I load any new pages in firefox, open email with thunderbird, chat with pidgin, or move windows around between the screens. It was also this way when I was running 2 cards however has worstened since I installed the 3rd card.

This is causing some pretty heavy lag in all the applications I run. My xorg configuration and bug-report is attached to this message.

Any tips?

New system specs:

AMD x2 3800
ASUS M2NBP-VM CSM Motherboard
4GB DDR2
Geforce 6150le onboard (128MB alloc)
Geforce Quadro 1400 pcie (128MB)
Geforce 6200 PCI (256MB)

03-21-11, 12:18 PM	#3
tadawson Registered User Join Date: May 2009 Posts: 44	Re: 3 Cards under Ubuntu 10.10 I also could not get three cards to come online in Linux, and found that I had to add a vmalloc=XXX entry to my boot - there was simply not enough memory allocated to allow the third card to init, and this is what was found in the "COMMON PROBLEMS" section you have been referred to . . . - Tim

03-21-11, 02:56 PM	#4
towo\| Registered User Join Date: Feb 2007 Posts: 112	Re: 3 Cards under Ubuntu 10.10 This will never work, since a GeForce 5xxx only works with 173xx driver.

03-23-11, 12:35 AM	#8
sandipt NVIDIA Corporation Join Date: Dec 2010 Posts: 259	Re: 3 Cards under Ubuntu 10.10 Hi all, Internally we have filed bug 806605 to track this issue. Lets do some more experiments with different motherboards, gpus for older drivers (173) and let us know the results.

03-28-11, 02:58 AM	#9
sandipt NVIDIA Corporation Join Date: Dec 2010 Posts: 259	Re: 3 Cards under Ubuntu 10.10 Hello all, We have reproduced this issue in house on x86 system. This issue is not repro for x64 OS. Also after adding parameter vmalloc=256MB all 3 GPUs are initialized. See the "Kernel virtual address space exhaustion on the X86 platform" section in the README.

04-01-11, 11:21 AM	#10
fnj00 Registered User Join Date: Mar 2011 Posts: 4	Re: 3 Cards under Ubuntu 10.10 Added vmalloc=256M to grub and now I get the following in my xorg.log: [ 40.779] (II) NVIDIA(0): Unable to connect to the ACPI daemon; the ACPI daemon may not [ 40.780] (II) NVIDIA(0): be running or the "AcpidSocketPath" X configuration option [ 40.780] (II) NVIDIA(0): may not be set correctly. When the ACPI daemon is [ 40.780] (II) NVIDIA(0): available, the NVIDIA X driver can use it to receive ACPI [ 40.780] (II) NVIDIA(0): events. For details, please see the "ConnectToAcpid" and [ 40.780] (II) NVIDIA(0): "AcpidSocketPath" X configuration options in Appendix B: X [ 40.780] (II) NVIDIA(0): Config Options in the README.

04-01-11, 08:41 PM	#11
Licaon Registered User Join Date: Nov 2004 Location: Between the keyboard and the chair. Posts: 490	Re: 3 Cards under Ubuntu 10.10 but does it work?