Bug 669593

Summary:	kernel unstable with 2 pci express nvidia 8400GS video cards
Product:	[Fedora] Fedora	Reporter:	Anthony Symons <ant>
Component:	kernel	Assignee:	Kernel Maintainer List <kernel-maint>
Status:	CLOSED CANTFIX	QA Contact:	Fedora Extras Quality Assurance <extras-qa>
Severity:	high	Docs Contact:
Priority:	low
Version:	14	CC:	gansalmon, itamar, jonathan, kernel-maint, madhu.chinakonda
Target Milestone:	---
Target Release:	---
Hardware:	x86_64
OS:	Linux
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2011-08-29 20:36:09 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:

Description Anthony Symons 2011-01-14 04:53:02 UTC

Description of problem:

System unstable with two pci-express geforce 8400gs video cards.

Version-Release number of selected component (if applicable):

Linux ant.internal 2.6.35.10-74.fc14.x86_64 #1 SMP Thu Dec 23 16:04:50 UTC 2010 x86_64 x86_64 x86_64 GNU/Linux

How reproducible:

Every time booted with dual video cards, crashes within 10 mins when running 3 displays, more quickly if doing something like running firefox with graphically intensive pages. Crashes in less then 4 hours when running dual head off a single card, but with the seconds card present in the system.

Steps to Reproduce:
1. Obtain hardware with two or more pci-express slots
2. Install dual nvidia 8400gs cards
3. Install nvidia packages from freshrpms

xorg-x11-drv-nvidia-260.19.29-2.fc14.x86_64
xorg-x11-drv-nvidia-libs-260.19.29-2.fc14.x86_64
nvidia-xconfig-1.0-6.fc14.x86_64
kmod-nvidia-260.19.29-1.fc14.4.x86_64
kmod-nvidia-2.6.35.10-74.fc14.x86_64-260.19.29-1.fc14.4.x86_64
nvidia-settings-1.0-9.fc14.x86_64

4. Configure 3 displays
5. Use system, wait for crash.

Actual results:

Machine performance stutters for a few seconds, then hard lockup. No panic, no logged info, machine completely halts.

Expected results:

Stable system.

Additional info:

Ive filed this against the kernel as I dont think its an issue with the nvidia drivers, but rather kernel support for the two cards. This system was running stable on fedora 12 previously so I know it can do it. However, under fedora 12 there was a 3 or 4 minute delay during boot with the 2 video cards installed. Now with F14 the delay is gone, boot is very fast, but it is no longer stable.

Removing the 2nd video card and running 2 instead of 3 displays has made the system stable.

Its a pain to stop the system and change the hardware configuration but I can upload lspci output or any other data required with 1 or 2 cards for comparison if required.

Comment 1 Anthony Symons 2011-01-14 04:55:17 UTC

[root@ant ~]# cat /proc/cpuinfo 
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz
stepping	: 11
cpu MHz		: 1600.000
cache size	: 4096 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm lahf_lm tpr_shadow vnmi flexpriority
bogomips	: 4799.37
clflush size	: 64
cache_alignment	: 64
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz
stepping	: 11
cpu MHz		: 1600.000
cache size	: 4096 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm lahf_lm tpr_shadow vnmi flexpriority
bogomips	: 4799.31
clflush size	: 64
cache_alignment	: 64
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz
stepping	: 11
cpu MHz		: 1600.000
cache size	: 4096 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm lahf_lm tpr_shadow vnmi flexpriority
bogomips	: 4799.34
clflush size	: 64
cache_alignment	: 64
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Core(TM)2 Quad CPU    Q6600  @ 2.40GHz
stepping	: 11
cpu MHz		: 1600.000
cache size	: 4096 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm lahf_lm tpr_shadow vnmi flexpriority
bogomips	: 4799.26
clflush size	: 64
cache_alignment	: 64
address sizes	: 36 bits physical, 48 bits virtual
power management:

Current single card hardware config:

[root@ant ~]# lspci -vt
-[0000:00]-+-00.0  Intel Corporation 4 Series Chipset DRAM Controller
           +-1a.0  Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #4
           +-1a.1  Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #5
           +-1a.2  Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #6
           +-1a.7  Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #2
           +-1b.0  Intel Corporation 82801JI (ICH10 Family) HD Audio Controller
           +-1c.0-[01]----00.0  nVidia Corporation G98 [GeForce 8400 GS]
           +-1c.4-[02]----00.0  Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller
           +-1c.5-[03]----00.0  Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller
           +-1d.0  Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #1
           +-1d.1  Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #2
           +-1d.2  Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #3
           +-1d.7  Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #1
           +-1e.0-[04]--+-06.0  Texas Instruments TSB43AB23 IEEE-1394a-2000 Controller (PHY/Link)
           |            \-07.0  Integrated Technology Express, Inc. IT8213 IDE Controller
           +-1f.0  Intel Corporation 82801JIR (ICH10R) LPC Interface Controller
           +-1f.2  Intel Corporation 82801JI (ICH10 Family) 4 port SATA IDE Controller #1
           +-1f.3  Intel Corporation 82801JI (ICH10 Family) SMBus Controller
           \-1f.5  Intel Corporation 82801JI (ICH10 Family) 2 port SATA IDE Controller #2

[root@ant ~]# lspci -v
00:00.0 Host bridge: Intel Corporation 4 Series Chipset DRAM Controller (rev 03)
	Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Flags: bus master, fast devsel, latency 0
	Capabilities: [e0] Vendor Specific Information: Len=0c <?>

00:1a.0 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #4 (prog-if 00 [UHCI])
	Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Flags: bus master, medium devsel, latency 0, IRQ 16
	I/O ports at e500 [size=32]
	Capabilities: [50] PCI Advanced Features
	Kernel driver in use: uhci_hcd

00:1a.1 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #5 (prog-if 00 [UHCI])
	Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Flags: bus master, medium devsel, latency 0, IRQ 21
	I/O ports at e000 [size=32]
	Capabilities: [50] PCI Advanced Features
	Kernel driver in use: uhci_hcd

00:1a.2 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #6 (prog-if 00 [UHCI])
	Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Flags: bus master, medium devsel, latency 0, IRQ 18
	I/O ports at e100 [size=32]
	Capabilities: [50] PCI Advanced Features
	Kernel driver in use: uhci_hcd

00:1a.7 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #2 (prog-if 20 [EHCI])
	Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Flags: bus master, medium devsel, latency 0, IRQ 18
	Memory at ea305000 (32-bit, non-prefetchable) [size=1K]
	Capabilities: [50] Power Management version 2
	Kernel driver in use: ehci_hcd

00:1b.0 Audio device: Intel Corporation 82801JI (ICH10 Family) HD Audio Controller
	Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Flags: bus master, fast devsel, latency 0, IRQ 45
	Memory at ea300000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [50] Power Management version 2
	Capabilities: [60] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [70] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [100] Virtual Channel
	Capabilities: [130] Root Complex Link
	Kernel driver in use: HDA Intel
	Kernel modules: snd-hda-intel

00:1c.0 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 1 (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0
	Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
	I/O behind bridge: 0000a000-0000afff
	Memory behind bridge: e4000000-e7ffffff
	Prefetchable memory behind bridge: 00000000d0000000-00000000dfffffff
	Capabilities: [40] Express Root Port (Slot+), MSI 00
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [90] Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Capabilities: [a0] Power Management version 2
	Capabilities: [100] Virtual Channel
	Capabilities: [180] Root Complex Link
	Kernel driver in use: pcieport
	Kernel modules: shpchp

00:1c.4 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 5 (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0
	Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
	I/O behind bridge: 0000b000-0000bfff
	Memory behind bridge: e8000000-e8ffffff
	Prefetchable memory behind bridge: 00000000ea000000-00000000ea0fffff
	Capabilities: [40] Express Root Port (Slot+), MSI 00
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [90] Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Capabilities: [a0] Power Management version 2
	Capabilities: [100] Virtual Channel
	Capabilities: [180] Root Complex Link
	Kernel driver in use: pcieport
	Kernel modules: shpchp

00:1c.5 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 6 (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0
	Bus: primary=00, secondary=03, subordinate=03, sec-latency=0
	I/O behind bridge: 0000c000-0000cfff
	Memory behind bridge: e9000000-e9ffffff
	Prefetchable memory behind bridge: 00000000ea100000-00000000ea1fffff
	Capabilities: [40] Express Root Port (Slot+), MSI 00
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [90] Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Capabilities: [a0] Power Management version 2
	Capabilities: [100] Virtual Channel
	Capabilities: [180] Root Complex Link
	Kernel driver in use: pcieport
	Kernel modules: shpchp

00:1d.0 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #1 (prog-if 00 [UHCI])
	Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Flags: bus master, medium devsel, latency 0, IRQ 23
	I/O ports at e200 [size=32]
	Capabilities: [50] PCI Advanced Features
	Kernel driver in use: uhci_hcd

00:1d.1 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #2 (prog-if 00 [UHCI])
	Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Flags: bus master, medium devsel, latency 0, IRQ 19
	I/O ports at e300 [size=32]
	Capabilities: [50] PCI Advanced Features
	Kernel driver in use: uhci_hcd

00:1d.2 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #3 (prog-if 00 [UHCI])
	Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Flags: bus master, medium devsel, latency 0, IRQ 18
	I/O ports at e400 [size=32]
	Capabilities: [50] PCI Advanced Features
	Kernel driver in use: uhci_hcd

00:1d.7 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #1 (prog-if 20 [EHCI])
	Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Flags: bus master, medium devsel, latency 0, IRQ 23
	Memory at ea304000 (32-bit, non-prefetchable) [size=1K]
	Capabilities: [50] Power Management version 2
	Kernel driver in use: ehci_hcd

00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 90) (prog-if 01 [Subtractive decode])
	Flags: bus master, fast devsel, latency 0
	Bus: primary=00, secondary=04, subordinate=04, sec-latency=32
	I/O behind bridge: 0000d000-0000dfff
	Memory behind bridge: ea200000-ea2fffff
	Capabilities: [50] Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard

00:1f.0 ISA bridge: Intel Corporation 82801JIR (ICH10R) LPC Interface Controller
	Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Flags: bus master, medium devsel, latency 0
	Capabilities: [e0] Vendor Specific Information: Len=0c <?>
	Kernel modules: iTCO_wdt

00:1f.2 IDE interface: Intel Corporation 82801JI (ICH10 Family) 4 port SATA IDE Controller #1 (prog-if 8a [Master SecP PriP])
	Subsystem: Giga-byte Technology Device b002
	Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 19
	I/O ports at 01f0 [size=8]
	I/O ports at 03f4 [size=1]
	I/O ports at 0170 [size=8]
	I/O ports at 0374 [size=1]
	I/O ports at f000 [size=16]
	I/O ports at f100 [size=16]
	Capabilities: [70] Power Management version 3
	Capabilities: [b0] PCI Advanced Features
	Kernel driver in use: ata_piix
	Kernel modules: ata_generic, pata_acpi

00:1f.3 SMBus: Intel Corporation 82801JI (ICH10 Family) SMBus Controller
	Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Flags: medium devsel, IRQ 18
	Memory at ea306000 (64-bit, non-prefetchable) [size=256]
	I/O ports at 0500 [size=32]
	Kernel driver in use: i801_smbus
	Kernel modules: i2c-i801

00:1f.5 IDE interface: Intel Corporation 82801JI (ICH10 Family) 2 port SATA IDE Controller #2 (prog-if 85 [Master SecO PriO])
	Subsystem: Giga-byte Technology Device b002
	Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 19
	I/O ports at e700 [size=8]
	I/O ports at e800 [size=4]
	I/O ports at e900 [size=8]
	I/O ports at ea00 [size=4]
	I/O ports at eb00 [size=16]
	I/O ports at ec00 [size=16]
	Capabilities: [70] Power Management version 3
	Capabilities: [b0] PCI Advanced Features
	Kernel driver in use: ata_piix
	Kernel modules: ata_generic, pata_acpi

01:00.0 VGA compatible controller: nVidia Corporation G98 [GeForce 8400 GS] (rev a1) (prog-if 00 [VGA controller])
	Subsystem: Giga-byte Technology Device 34cd
	Flags: bus master, fast devsel, latency 0, IRQ 16
	Memory at e6000000 (32-bit, non-prefetchable) [size=16M]
	Memory at d0000000 (64-bit, prefetchable) [size=256M]
	Memory at e4000000 (64-bit, non-prefetchable) [size=32M]
	I/O ports at a000 [size=128]
	[virtual] Expansion ROM at e7000000 [disabled] [size=128K]
	Capabilities: [60] Power Management version 3
	Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [78] Express Endpoint, MSI 00
	Capabilities: [100] Virtual Channel
	Capabilities: [128] Power Budgeting <?>
	Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
	Kernel driver in use: nvidia
	Kernel modules: nvidia, nouveau, nvidiafb

02:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller (rev 02)
	Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Flags: bus master, fast devsel, latency 0, IRQ 43
	I/O ports at b000 [size=256]
	Memory at ea010000 (64-bit, prefetchable) [size=4K]
	Memory at ea000000 (64-bit, prefetchable) [size=64K]
	[virtual] Expansion ROM at ea020000 [disabled] [size=64K]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable+ Count=1/2 Maskable- 64bit+
	Capabilities: [70] Express Endpoint, MSI 01
	Capabilities: [b0] MSI-X: Enable- Count=2 Masked-
	Capabilities: [d0] Vital Product Data
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [140] Virtual Channel
	Capabilities: [160] Device Serial Number 12-34-56-78-12-34-56-78
	Kernel driver in use: r8169
	Kernel modules: r8169

03:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller (rev 02)
	Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Flags: bus master, fast devsel, latency 0, IRQ 44
	I/O ports at c000 [size=256]
	Memory at ea110000 (64-bit, prefetchable) [size=4K]
	Memory at ea100000 (64-bit, prefetchable) [size=64K]
	[virtual] Expansion ROM at ea120000 [disabled] [size=64K]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable+ Count=1/2 Maskable- 64bit+
	Capabilities: [70] Express Endpoint, MSI 01
	Capabilities: [b0] MSI-X: Enable- Count=2 Masked-
	Capabilities: [d0] Vital Product Data
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [140] Virtual Channel
	Capabilities: [160] Device Serial Number 12-34-56-78-12-34-56-78
	Kernel driver in use: r8169
	Kernel modules: r8169

04:06.0 FireWire (IEEE 1394): Texas Instruments TSB43AB23 IEEE-1394a-2000 Controller (PHY/Link) (prog-if 10 [OHCI])
	Subsystem: Giga-byte Technology GA-EP45-DS5 Motherboard
	Flags: bus master, medium devsel, latency 32, IRQ 18
	Memory at ea204000 (32-bit, non-prefetchable) [size=2K]
	Memory at ea200000 (32-bit, non-prefetchable) [size=16K]
	Capabilities: [44] Power Management version 2
	Kernel driver in use: firewire_ohci
	Kernel modules: firewire-ohci

04:07.0 IDE interface: Integrated Technology Express, Inc. IT8213 IDE Controller (prog-if 85 [Master SecO PriO])
	Subsystem: Giga-byte Technology Device b000
	Flags: bus master, medium devsel, latency 64, IRQ 19
	I/O ports at d000 [size=8]
	I/O ports at d100 [size=4]
	I/O ports at d200 [size=8]
	I/O ports at d300 [size=4]
	I/O ports at d400 [size=16]
	Capabilities: [80] Power Management version 2
	Kernel driver in use: pata_it8213
	Kernel modules: ata_generic, pata_acpi, pata_it8213

Comment 2 Josh Boyer 2011-08-29 20:36:09 UTC

We don't support the proprietary nvidia modules.  You should discuss any issues you have with nVidia.

Comment 3 Anthony Symons 2011-08-29 22:40:58 UTC

Thanks for the note Josh.

I had forgotten I submitted this bug. 

For the record, this issue was solved by adding irqpoll to the kernel command line.