Bug 1015905 - Kernel panic with ipv6 sit over pppoe and packet size > mtu
Summary: Kernel panic with ipv6 sit over pppoe and packet size > mtu
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Fedora
Classification: Fedora
Component: kernel
Version: 19
Hardware: x86_64
OS: Linux
unspecified
urgent
Target Milestone: ---
Assignee: Kernel Maintainer List
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2013-10-06 16:13 UTC by George Joseph
Modified: 2013-11-29 06:55 UTC (History)
8 users (show)

Fixed In Version: kernel-3.11.9-100.fc18
Clone Of:
Environment:
Last Closed: 2013-11-24 03:48:22 UTC
Type: Bug
Embargoed:


Attachments (Terms of Use)
kernel panic (5.13 KB, text/plain)
2013-10-06 16:13 UTC, George Joseph
no flags Details

Description George Joseph 2013-10-06 16:13:48 UTC
Created attachment 808582 [details]
kernel panic

Description of problem:
Intel Atom 2500CCE acting as router.
Linux blah 3.11.2-201.fc19.x86_64 #1 SMP Fri Sep 27 19:20:55 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
LAN device em0
WAN device p13p1 MTU 1500
IPv4 ISP connection using PPPOE (ppp0) via p13p1 MTU 1492
IPv6 SIT (rdhe0) over ppp0 MTU 1480
IPv6 prefix delegated for local clients.

When a local client attempts to send an IPv6 packet larger than the MTU, the kernel on the router panics.  In normal operation this shouldn't happen but a simple 'ping6 -s 1490 www.google.com' from a client will trigger the panic.
If you try this from the router itself, you get 'Packet too big: mtu=1472' but no panic suggesting this is a 'forward' issue.

Version-Release number of selected component (if applicable):
kernel-3.11.2-201.fc19.x86_64

How reproducible:
'ping6 -s 1490 www.google.com' from a client will reproduce every time.

Steps to Reproduce:
1. Set up a pppoe connection
2. Set up a 6rd SIT tunnel over the pppoe connection
3. Set up infrastructure to distribute delegated IPv6 addresses
4. From a client run 'ping6 -s 1490 www.google.com'

Actual results:
Kernel panic on router.

Expected results:
Client should receive 'Packet too big: mtu=1472' but the router's kernel should NOT panic at the attempt.

Additional info:
I thought this might have been related to trying kernel mode pppoe but the panic happens even if using the rp-pppoe daemon.

Comment 1 Michele Baldessari 2013-10-17 08:45:37 UTC
Hi George,

could you please give us the full output of "ip a" here?

Thanks,
Michele

Comment 2 George Joseph 2013-10-17 14:29:24 UTC
enp1s0 = lan
enp2s0 = wan
ppp0 = pppoe via enp2s0
rdhe0 = sit via ppp0


1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN 
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever

2: enp2s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
    link/ether 00:22:4d:9a:5d:9d brd ff:ff:ff:ff:ff:ff
    inet 192.168.101.254/24 brd 192.168.101.255 scope global enp2s0
       valid_lft forever preferred_lft forever
    inet6 fe80::222:4dff:fe9a:5d9d/64 scope link 
       valid_lft forever preferred_lft forever

3: enp1s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
    link/ether 00:22:4d:9a:5d:a1 brd ff:ff:ff:ff:ff:ff
    inet 192.168.147.1/24 brd 192.168.147.255 scope global enp1s0
       valid_lft forever preferred_lft forever
    inet6 2001:XXXX:XXXX:13d:2::1/128 scope global 
       valid_lft forever preferred_lft forever
    inet6 fe80::222:4dff:fe9a:5da1/64 scope link 
       valid_lft forever preferred_lft forever

4: sit0: <NOARP> mtu 1480 qdisc noop state DOWN 
    link/sit 0.0.0.0 brd 0.0.0.0

5: rdhe0: <POINTOPOINT,NOARP,UP,LOWER_UP> mtu 1460 qdisc noqueue state UNKNOWN 
    link/sit 65.XXX.XXX.14 peer 184.105.250.46
    inet6 2001:XXXX:XXXX:13d::2/64 scope global 
       valid_lft forever preferred_lft forever
    inet6 fe80::4166:d30e/128 scope link 
       valid_lft forever preferred_lft forever

6: ppp0: <POINTOPOINT,MULTICAST,NOARP,UP,LOWER_UP> mtu 1492 qdisc pfifo_fast state UNKNOWN qlen 3
    link/ppp 
    inet 65.XXX.XXX.14 peer 207.XXX.XXX.6/32 scope global ppp0
       valid_lft forever preferred_lft forever

Comment 3 Hrvoje 2013-11-02 20:08:01 UTC
Hi.

It seems i also did hit this bug. Or something similar - my setup is somewhat different. Machine is used as internet gateway, and it uses pppoe (kernel mode) for uplink.

Some outputs:

# uname -a
Linux x.x 3.11.6-200.fc19.x86_64 #1 SMP Fri Oct 18 22:34:18 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux

# lsmod
Module                  Size  Used by
dummy                  12960  0
pppoe                  17873  2
pppox                  13132  1 pppoe
ppp_synctty            13237  0
ppp_async              17413  0
crc_ccitt              12613  1 ppp_async
ppp_generic            32453  8 ppp_synctty,pppoe,pppox,ppp_async
slhc                   13125  1 ppp_generic
8021q                  24570  0
garp                   14047  1 8021q
stp                    12868  1 garp
mrp                    18211  1 8021q
llc                    14045  2 stp,garp
xt_policy              12582  1
nf_conntrack_ipv6      18782  15
xt_NFLOG               12537  11
nf_defrag_ipv6         34589  1 nf_conntrack_ipv6
nfnetlink_log          17827  2 xt_NFLOG
ip6t_rt                13537  3
nfnetlink              14129  2 nfnetlink_log
xt_conntrack           12760  50
iptable_mangle         12695  1
ipt_MASQUERADE         12880  1
ip6table_filter        12815  1
xt_TCPMSS              12707  4
iptable_nat            13011  1
nf_conntrack_ipv4      14808  36
nf_defrag_ipv4         12673  1 nf_conntrack_ipv4
nf_nat_ipv4            13199  1 iptable_nat
nf_nat                 25743  3 ipt_MASQUERADE,nf_nat_ipv4,iptable_nat
nf_conntrack           86430  7 ipt_MASQUERADE,nf_nat,nf_nat_ipv4,xt_conntrack,iptable_nat,nf_conntrack_ipv4,nf_conntrack_ipv6
ip6table_mangle        12700  1
ip6_tables             26808  2 ip6table_filter,ip6table_mangle
snd_hda_codec_hdmi     41117  1
snd_hda_codec_realtek    55704  1
snd_hda_intel          44075  0
w83627ehf              43040  0
hwmon_vid              12688  1 w83627ehf
x86_pkg_temp_thermal    14162  0
coretemp               13435  0
kvm_intel             138528  0
snd_hda_codec         179171  3 snd_hda_codec_realtek,snd_hda_codec_hdmi,snd_hda_intel
kvm                   421021  1 kvm_intel
e1000e                258969  0
r8169                  71677  0
mii                    13527  1 r8169
snd_hwdep              13554  1 snd_hda_codec
snd_seq                60752  0
snd_seq_device         14136  1 snd_seq
snd_pcm                98071  3 snd_hda_codec_hdmi,snd_hda_codec,snd_hda_intel
mei_me                 18421  0
iTCO_wdt               13480  1
iTCO_vendor_support    13419  1 iTCO_wdt
mei                    76745  1 mei_me
lpc_ich                21080  0
serio_raw              13413  0
shpchp                 37032  0
crc32_pclmul           13113  0
i2c_i801               18136  0
snd_page_alloc         18268  2 snd_pcm,snd_hda_intel
mfd_core               13182  1 lpc_ich
snd_timer              28698  2 snd_pcm,snd_seq
crc32c_intel           22079  0
snd                    75313  9 snd_hda_codec_realtek,snd_hwdep,snd_timer,snd_hda_codec_hdmi,snd_pcm,snd_seq,snd_hda_codec,snd_hda_intel,snd_seq_device
ghash_clmulni_intel    13259  0
microcode              23527  0
soundcore              14491  1 snd
mperf                  12607  0
usb_storage            56690  1
i915                  651904  0
video                  19104  1 i915
i2c_algo_bit           13257  1 i915
drm_kms_helper         50239  1 i915
drm                   278576  2 i915,drm_kms_helper
ata_generic            12910  0
i2c_core               34242  5 drm,i915,i2c_i801,drm_kms_helper,i2c_algo_bit
pata_acpi              13038  0

# lspci
00:00.0 Host bridge: Intel Corporation 2nd Generation Core Processor Family DRAM Controller (rev 09)
00:01.0 PCI bridge: Intel Corporation Xeon E3-1200/2nd Generation Core Processor Family PCI Express Root Port (rev 09)
00:02.0 VGA compatible controller: Intel Corporation 2nd Generation Core Processor Family Integrated Graphics Controller (rev 09)
00:16.0 Communication controller: Intel Corporation 6 Series/C200 Series Chipset Family MEI Controller #1 (rev 04)
00:16.2 IDE interface: Intel Corporation 6 Series/C200 Series Chipset Family IDE-r Controller (rev 04)
00:16.3 Serial controller: Intel Corporation 6 Series/C200 Series Chipset Family KT Controller (rev 04)
00:19.0 Ethernet controller: Intel Corporation 82579LM Gigabit Network Connection (rev 04)
00:1a.0 USB controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #2 (rev 04)
00:1b.0 Audio device: Intel Corporation 6 Series/C200 Series Chipset Family High Definition Audio Controller (rev 04)
00:1c.0 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 1 (rev b4)
00:1c.6 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 7 (rev b4)
00:1d.0 USB controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #1 (rev 04)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a4)
00:1f.0 ISA bridge: Intel Corporation Q67 Express Chipset Family LPC Controller (rev 04)
00:1f.2 SATA controller: Intel Corporation 6 Series/C200 Series Chipset Family SATA AHCI Controller (rev 04)
00:1f.3 SMBus: Intel Corporation 6 Series/C200 Series Chipset Family SMBus Controller (rev 04)
01:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 01)
03:00.0 USB controller: NEC Corporation uPD720200 USB 3.0 Host Controller (rev 03)

# lspci -vv -s 00:19.0
00:19.0 Ethernet controller: Intel Corporation 82579LM Gigabit Network Connection (rev 04)
        Subsystem: Intel Corporation Device 200f
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0
        Interrupt: pin A routed to IRQ 53
        Region 0: Memory at fe600000 (32-bit, non-prefetchable) [size=128K]
        Region 1: Memory at fe628000 (32-bit, non-prefetchable) [size=4K]
        Region 2: I/O ports at f080 [size=32]
        Capabilities: [c8] Power Management version 2
                Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
        Capabilities: [d0] MSI: Enable+ Count=1/1 Maskable- 64bit+
                Address: 00000000fee003d8  Data: 0000
        Capabilities: [e0] PCI Advanced Features
                AFCap: TP+ FLR+
                AFCtrl: FLR-
                AFStatus: TP-
        Kernel driver in use: e1000e

# ifconfig
em1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 9000
        inet 192.168.10.1  netmask 255.255.255.0  broadcast 192.168.10.255
        inet6 fe80::222:4dff:fe51:a623  prefixlen 64  scopeid 0x20<link>
        inet6 x:x:7171:2c0::1  prefixlen 64  scopeid 0x0<global>
        ether 00:22:4d:51:a6:23  txqueuelen 1000  (Ethernet)
        RX packets 41204  bytes 7393945 (7.0 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 53736  bytes 42104851 (40.1 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device interrupt 20  memory 0xfe600000-fe620000

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 0  (Local Loopback)
        RX packets 430  bytes 36918 (36.0 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 430  bytes 36918 (36.0 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

p1p1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::92f6:52ff:fe05:e59f  prefixlen 64  scopeid 0x20<link>
        ether 90:f6:52:05:e5:9f  txqueuelen 1000  (Ethernet)
        RX packets 47618  bytes 41377493 (39.4 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 35825  bytes 6684574 (6.3 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

ppp0: flags=4305<UP,POINTOPOINT,RUNNING,NOARP,MULTICAST>  mtu 1492
        inet x.x.x.x  netmask 255.255.255.255  destination x.x.x.x
        inet6 fe80::446e:1cf:269c:7a05  prefixlen 10  scopeid 0x20<link>
        inet6 x:x:7170:2c:446e:1cf:269c:7a05  prefixlen 64  scopeid 0x0<global>
        ppp  txqueuelen 3  (Point-to-Point Protocol)
        RX packets 47088  bytes 40075612 (38.2 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 35327  bytes 5882512 (5.6 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

vlan100: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::92f6:52ff:fe05:e59f  prefixlen 64  scopeid 0x20<link>
        ether 90:f6:52:05:e5:9f  txqueuelen 0  (Ethernet)
        RX packets 47618  bytes 40520369 (38.6 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 35820  bytes 6684096 (6.3 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

PPP is established over p1p1 interface, with vlan 100.

# dmesg | grep e1000e
[    6.512597] e1000e: module verification failed: signature and/or required key missing - tainting kernel
[    6.513383] e1000e: Intel(R) PRO/1000 Network Driver - 2.5.4-NAPI
[    6.513464] e1000e: Copyright(c) 1999 - 2013 Intel Corporation.
[    6.513632] e1000e 0000:00:19.0: setting latency timer to 64
[    6.513706] e1000e 0000:00:19.0: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode
[    6.513830] e1000e 0000:00:19.0: irq 53 for MSI/MSI-X
[    6.514160] e1000e 0000:00:19.0 (unregistered net_device): Reset blocked by ME
[    6.514275] e1000e 0000:00:19.0: PHY reset is blocked due to SOL/IDER session.
[    6.601422] e1000e 0000:00:19.0 eth1: (PCI Express:2.5GT/s:Width x1) 00:22:4d:51:a6:23
[    6.601525] e1000e 0000:00:19.0 eth1: Intel(R) PRO/1000 Network Connection
[    6.601644] e1000e 0000:00:19.0 eth1: MAC: 10, PHY: 11, PBA No: FFFFFF-0FF
[   11.347723] e1000e 0000:00:19.0 em1: changing MTU from 1500 to 9000
[   11.347805] e1000e 0000:00:19.0: Interrupt Throttle Rate off
[   11.484607] e1000e 0000:00:19.0: irq 53 for MSI/MSI-X
[   11.585019] e1000e 0000:00:19.0: irq 53 for MSI/MSI-X
[   11.589728] e1000e: em1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None

# ethtool em1
Settings for em1:
        Supported ports: [ TP ]
        Supported link modes:   10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
                                1000baseT/Full
        Supported pause frame use: No
        Supports auto-negotiation: Yes
        Advertised link modes:  10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
                                1000baseT/Full
        Advertised pause frame use: No
        Advertised auto-negotiation: Yes
        Speed: 1000Mb/s
        Duplex: Full
        Port: Twisted Pair
        PHYAD: 1
        Transceiver: internal
        Auto-negotiation: on
        MDI-X: on (auto)
        Supports Wake-on: pumbg
        Wake-on: g
        Current message level: 0x00000007 (7)
                               drv probe link
        Link detected: yes

Unfortunatelly, this machine do not have serial port, so i'm unable to capture panic itself - but from what i did manage to get over the screen, it seems that commes from inside of e1000e driver.

Panic happens when one of clients tries to send large packet to the internet (ie. ping6 -s 2000 www.google.com). It happens every time.

Instrestingly enough, it does not happen when using IPv4 ping!

Regards,

H.

Comment 4 Hrvoje 2013-11-03 19:36:24 UTC
Hi.

I did manage to capture "panic":

[  573.852759] ------------[ cut here ]------------
[  573.858967] kernel BUG at net/core/skbuff.c:1059!
[  573.864743] invalid opcode: 0000 [#1] SMP 
[  573.869856] Modules linked in: pppoe pppox ppp_synctty ppp_async crc_ccitt ppp_generic slhc 8021q garp stp mrp llc xt_policy xt_NFLOG nfnetlink_log nfnetlink nf_conntrack_ipv6 nf_defrag_ipv6 ip6t_rt xt_conntrack iptable_mangle ipt_MASQUERADE iptable_nat nf_conntrack_ipv4 ip6table_filter nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack xt_TCPMSS ip6table_mangle ip6_tables e1000e(OF) x86_pkg_temp_thermal kvm_intel w83627ehf hwmon_vid coretemp kvm crc32_pclmul crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_intel microcode snd_hda_codec r8169 mii snd_hwdep snd_seq snd_seq_device snd_pcm iTCO_wdt iTCO_vendor_support snd_page_alloc snd_timer snd soundcore serio_raw shpchp mei_me lpc_ich mei i2c_i801 mfd_core mperf usb_storage i915 video i2c_algo_bit drm_kms_helper drm ata_generic i2c_core pata_acpi
[  573.906875] CPU: 3 PID: 0 Comm: swapper/3 Tainted: GF          O 3.11.6-200.fc19.x86_64 #1
[  573.909619] Hardware name:                  /DQ67EP, BIOS SWQ6710H.86A.0066.2012.1105.1504 11/05/2012
[  573.911658] task: ffff880138305b80 ti: ffff880138334000 task.ti: ffff880138334000
[  573.913273] RIP: 0010:[<ffffffff8153def0>]  [<ffffffff8153def0>] pskb_expand_head+0x260/0x2a0
[  573.915167] RSP: 0018:ffff88013e3836a8  EFLAGS: 00010202
[  573.916318] RAX: 0000000000000003 RBX: ffff8800376d2900 RCX: 0000000000000020
[  573.917930] RDX: 000000000000069e RSI: 0000000000000000 RDI: ffff8800376d2900
[  573.919444] RBP: ffff88013e3836d8 R08: 00000000000000c0 R09: ffff88013667ca00
[  573.920965] R10: 000000000000ffff R11: 0000000000000002 R12: ffff88013838f000
[  573.922577] R13: 0000000000000000 R14: ffff88013838f000 R15: ffff8800376d2900
[  573.924103] FS:  0000000000000000(0000) GS:ffff88013e380000(0000) knlGS:0000000000000000
[  573.925840] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  573.927519] CR2: 00007fb14b067000 CR3: 0000000135a93000 CR4: 00000000000407e0
[  573.929034] Stack:
[  573.929519]  ffff8800376d2900 ffff8800376d2900 ffff88013838f000 00000000000005a0
[  573.931323]  ffff88013838f000 ffff8800376d2900 ffff88013e383720 ffffffff8153e290
[  573.933202]  ffff88013838f000 000005a035de089c 0000000000000000 ffff88013838f000
[  573.935001] Call Trace:
[  573.935570]  <IRQ> 
[  573.936008]  [<ffffffff8153e290>] __pskb_pull_tail+0x50/0x360
[  573.937459]  [<ffffffff8154d5bc>] dev_hard_start_xmit+0x2cc/0x560
[  573.938772]  [<ffffffff8156b3b0>] sch_direct_xmit+0xe0/0x1c0
[  573.939995]  [<ffffffff8154da49>] dev_queue_xmit+0x1f9/0x480
[  573.941218]  [<ffffffff81553af1>] neigh_direct_output+0x11/0x20
[  573.942587]  [<ffffffff815f2a58>] ip6_finish_output2+0x168/0x4b0
[  573.943880]  [<ffffffff815f51bd>] ip6_fragment+0x77d/0xa60
[  573.945065]  [<ffffffff815f28f0>] ? ip6_xmit+0x400/0x400
[  573.946229]  [<ffffffff815f5521>] ip6_finish_output+0x81/0xc0
[  573.947905]  [<ffffffff815f559e>] ip6_output+0x3e/0xb0
[  573.949042]  [<ffffffff815f44da>] ip6_forward+0x29a/0x800
[  573.950212]  [<ffffffff81601ba4>] ? ip6_route_input+0xa4/0xd0
[  573.951497]  [<ffffffff815f5610>] ? ip6_output+0xb0/0xb0
[  573.952653]  [<ffffffff815f5690>] ip6_rcv_finish+0x80/0x90
[  573.953844]  [<ffffffffa03c386e>] __ipv6_conntrack_in+0xce/0x1a0 [nf_conntrack_ipv6]
[  573.955520]  [<ffffffffa03c39c7>] ipv6_conntrack_in+0x27/0x30 [nf_conntrack_ipv6]
[  573.957218]  [<ffffffff8157a1bb>] nf_iterate+0x8b/0xa0
[  573.958335]  [<ffffffff815f5610>] ? ip6_output+0xb0/0xb0
[  573.959488]  [<ffffffff8157a244>] nf_hook_slow+0x74/0x130
[  573.960653]  [<ffffffff815f5610>] ? ip6_output+0xb0/0xb0
[  573.961898]  [<ffffffffa03ba203>] nf_ct_frag6_output+0xe3/0x100 [nf_defrag_ipv6]
[  573.963497]  [<ffffffff815f5610>] ? ip6_output+0xb0/0xb0
[  573.964646]  [<ffffffffa03b90ca>] ipv6_defrag+0xba/0x100 [nf_defrag_ipv6]
[  573.966099]  [<ffffffff815f5610>] ? ip6_output+0xb0/0xb0
[  573.967716]  [<ffffffff8157a1bb>] nf_iterate+0x8b/0xa0
[  573.968834]  [<ffffffff815f5610>] ? ip6_output+0xb0/0xb0
[  573.969984]  [<ffffffff8157a244>] nf_hook_slow+0x74/0x130
[  573.971155]  [<ffffffff815f5610>] ? ip6_output+0xb0/0xb0
[  573.972411]  [<ffffffff815f5e18>] ipv6_rcv+0x348/0x440
[  573.973529]  [<ffffffff8154b8e6>] __netif_receive_skb_core+0x646/0x820
[  573.974928]  [<ffffffff81019900>] ? flush_ptrace_hw_breakpoint+0x10/0x60
[  573.976362]  [<ffffffff8154bad8>] __netif_receive_skb+0x18/0x60
[  573.977703]  [<ffffffff8154bb53>] netif_receive_skb+0x33/0xa0
[  573.978939]  [<ffffffff8154c520>] napi_gro_receive+0x80/0xb0
[  573.980166]  [<ffffffffa032241f>] e1000_receive_skb+0x7f/0xe0 [e1000e]
[  573.981645]  [<ffffffffa03249ff>] e1000_clean_rx_irq_ps+0x4af/0x780 [e1000e]
[  573.983149]  [<ffffffffa032cd3d>] e1000e_poll+0x6d/0x310 [e1000e]
[  573.984460]  [<ffffffff813daf0c>] ? add_interrupt_randomness+0x15c/0x190
[  573.985891]  [<ffffffff8154beb9>] net_rx_action+0x149/0x240
[  573.987550]  [<ffffffff8106c427>] __do_softirq+0xf7/0x240
[  573.988721]  [<ffffffff8165875c>] call_softirq+0x1c/0x30
[  573.989873]  [<ffffffff81014695>] do_softirq+0x55/0x90
[  573.990990]  [<ffffffff8106c705>] irq_exit+0xb5/0xc0
[  573.992241]  [<ffffffff81659056>] do_IRQ+0x56/0xc0
[  573.993295]  [<ffffffff8164e9ed>] common_interrupt+0x6d/0x6d
[  573.994517]  <EOI> 
[  573.994954]  [<ffffffff815004df>] ? cpuidle_enter_state+0x4f/0xc0
[  573.996471]  [<ffffffff81500619>] cpuidle_idle_call+0xc9/0x210
[  573.997727]  [<ffffffff8101b60e>] arch_cpu_idle+0xe/0x30
[  573.998875]  [<ffffffff810b663e>] cpu_startup_entry+0xce/0x280
[  574.000131]  [<ffffffff8103ed67>] start_secondary+0x217/0x2c0
[  574.001370] Code: 44 00 00 be 9e 01 00 00 48 c7 c7 f9 ab 9e 81 89 55 d0 e8 44 93 b2 ff 8b 55 d0 e9 7b ff ff ff 41 81 cf 00 20 00 00 e9 f1 fd ff ff <0f> 0b 0f 0b 44 89 fe 48 89 df e8 d1 f8 ff ff 85 c0 74 12 4c 89 
[  574.008632] RIP  [<ffffffff8153def0>] pskb_expand_head+0x260/0x2a0
[  574.010382]  RSP <ffff88013e3836a8>
[  574.011174] ---[ end trace 3d6846dc38a4d9c7 ]---
[  574.012433] Kernel panic - not syncing: Fatal exception in interrupt

Seems like the problem is somewhere in netfilter code?

Regards,

H.

Comment 5 Michele Baldessari 2013-11-17 10:06:01 UTC
Hrvoje, George,

I've discussed this a bit upstream. Since you can reproduce it 100%, can you try the following kernel:
http://koji.fedoraproject.org/koji/buildinfo?buildID=478832

It has the following two commits:
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=9037c3579a277f3a23ba476664629fda8c35f7c4
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=6aafeef03b9d9ecf255f3a80ed85ee070260e1ae

which might be relevant here.

If you could let me know if they work or not that'd be great.

Thanks,
Michele

Comment 6 Hrvoje 2013-11-17 10:58:41 UTC
Hi.

It seems that this fixes the problem. To be precise, i'm unable to trigger panic, and it seems that neworking stack is correctly handling packet-too-big situation.

# ping6 -s 2000 x:x:fffd::2
PING x:x:fffd::2(x:x:fffd::2) 2000 data bytes
From x:x:7161:630::1 icmp_seq=1 Packet too big: mtu=1492
2008 bytes from x:x:fffd::2: icmp_seq=3 ttl=59 time=7.10 ms
2008 bytes from x:x:fffd::2: icmp_seq=4 ttl=59 time=9.20 ms
2008 bytes from x:x:fffd::2: icmp_seq=5 ttl=59 time=7.05 ms
2008 bytes from x:x:fffd::2: icmp_seq=6 ttl=59 time=7.47 ms
2008 bytes from x:x:fffd::2: icmp_seq=7 ttl=59 time=7.61 ms
2008 bytes from x:x:fffd::2: icmp_seq=8 ttl=59 time=6.72 ms
^C
--- x:x:fffd::2 ping statistics ---
8 packets transmitted, 6 received, +1 errors, 25% packet loss, time 7019ms
rtt min/avg/max/mdev = 6.725/7.529/9.200/0.806 ms
#

Dmesg:

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.13.0-0.rc0.git5.1.fc21.x86_64 (mockbuild@bkernel02) (gcc version 4.8.2 20131111 (Red Hat 4.8.2-4) (GCC) ) #1 SMP Sat Nov 16 16:09:55 UTC 2013
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.13.0-0.rc0.git5.1.fc21.x86_64 root=UUID=bd0a2380-7b31-401a-aeed-56cf79d500ed ro nomodeset rd.md=0 rd.lvm=0 rd.dm=0 vconsole.keymap=us rd.luks=0 vconsole.font=latarcyrheb-sun16 console=tty0 console=ttyS1 LANG=en_US.UTF-8
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009abff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009ac00-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000001fffffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000020000000-0x00000000201fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000020200000-0x000000003fffffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000040000000-0x00000000401fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000040200000-0x00000000bc557fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bc558000-0x00000000bc560fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bc561000-0x00000000bc5aafff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bc5ab000-0x00000000bc5b2fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bc5b3000-0x00000000bc8c4fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bc8c5000-0x00000000bc8c5fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bc8c6000-0x00000000bc8d5fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bc8d6000-0x00000000bc8f4fff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bc8f5000-0x00000000bc918fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bc919000-0x00000000bc95bfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bc95c000-0x00000000bcb7bfff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bcb7c000-0x00000000bccfffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bcd00000-0x00000000bcffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bd800000-0x00000000bf9fffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed3ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000013e5fffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI:                  /DQ67EP, BIOS SWQ6710H.86A.0066.2012.1105.1504 11/05/2012
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] e820: last_pfn = 0x13e600 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: uncachable
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-CFFFF write-protect
[    0.000000]   D0000-E7FFF uncachable
[    0.000000]   E8000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 000000000 mask F00000000 write-back
[    0.000000]   1 base 100000000 mask FC0000000 write-back
[    0.000000]   2 base 0BD800000 mask FFF800000 uncachable
[    0.000000]   3 base 0BE000000 mask FFE000000 uncachable
[    0.000000]   4 base 0C0000000 mask FC0000000 uncachable
[    0.000000]   5 base 13E600000 mask FFFE00000 uncachable
[    0.000000]   6 base 13E800000 mask FFF800000 uncachable
[    0.000000]   7 base 13F000000 mask FFF000000 uncachable
[    0.000000]   8 disabled
[    0.000000]   9 disabled
[    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
[    0.000000] e820: update [mem 0xbd800000-0xffffffff] usable ==> reserved
[    0.000000] e820: last_pfn = 0xbcd00 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fda00-0x000fda0f] mapped at [ffff8800000fda00]
[    0.000000] Scanning 1 areas for low memory corruption
[    0.000000] Base memory trampoline at [ffff880000094000] 94000 size 24576
[    0.000000] reserving inaccessible SNB gfx pages
[    0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]
[    0.000000]  [mem 0x00000000-0x000fffff] page 4k
[    0.000000] BRK [0x02d92000, 0x02d92fff] PGTABLE
[    0.000000] BRK [0x02d93000, 0x02d93fff] PGTABLE
[    0.000000] BRK [0x02d94000, 0x02d94fff] PGTABLE
[    0.000000] init_memory_mapping: [mem 0x13e400000-0x13e5fffff]
[    0.000000]  [mem 0x13e400000-0x13e5fffff] page 2M
[    0.000000] BRK [0x02d95000, 0x02d95fff] PGTABLE
[    0.000000] init_memory_mapping: [mem 0x13c000000-0x13e3fffff]
[    0.000000]  [mem 0x13c000000-0x13e3fffff] page 2M
[    0.000000] init_memory_mapping: [mem 0x100000000-0x13bffffff]
[    0.000000]  [mem 0x100000000-0x13bffffff] page 2M
[    0.000000] init_memory_mapping: [mem 0x00100000-0x1fffffff]
[    0.000000]  [mem 0x00100000-0x001fffff] page 4k
[    0.000000]  [mem 0x00200000-0x1fffffff] page 2M
[    0.000000] init_memory_mapping: [mem 0x20200000-0x3fffffff]
[    0.000000]  [mem 0x20200000-0x3fffffff] page 2M
[    0.000000] init_memory_mapping: [mem 0x40200000-0xbc557fff]
[    0.000000]  [mem 0x40200000-0xbc3fffff] page 2M
[    0.000000]  [mem 0xbc400000-0xbc557fff] page 4k
[    0.000000] BRK [0x02d96000, 0x02d96fff] PGTABLE
[    0.000000] BRK [0x02d97000, 0x02d97fff] PGTABLE
[    0.000000] init_memory_mapping: [mem 0xbc5ab000-0xbc5b2fff]
[    0.000000]  [mem 0xbc5ab000-0xbc5b2fff] page 4k
[    0.000000] init_memory_mapping: [mem 0xbc8c5000-0xbc8c5fff]
[    0.000000]  [mem 0xbc8c5000-0xbc8c5fff] page 4k
[    0.000000] init_memory_mapping: [mem 0xbcb7c000-0xbccfffff]
[    0.000000]  [mem 0xbcb7c000-0xbccfffff] page 4k
[    0.000000] RAMDISK: [mem 0x3710e000-0x3787efff]
[    0.000000] ACPI: RSDP 00000000000f0450 000024 (v02  INTEL)
[    0.000000] ACPI: XSDT 00000000bc558070 000064 (v01 INTEL  DQ67EP   01072009 AMI  00010013)
[    0.000000] ACPI: FACP 00000000bc55fb50 0000F4 (v04 INTEL  DQ67EP   01072009 AMI  00010013)
[    0.000000] ACPI: DSDT 00000000bc558168 0079E1 (v02 INTEL  DQ67EP   00000016 INTL 20051117)
[    0.000000] ACPI: FACS 00000000bc8dbf80 000040
[    0.000000] ACPI: APIC 00000000bc55fc48 000072 (v03 INTEL  DQ67EP   01072009 AMI  00010013)
[    0.000000] ACPI: TCPA 00000000bc55fcc0 000032 (v02 INTEL  DQ67EP   00000001 MSFT 01000013)
[    0.000000] ACPI: SSDT 00000000bc55fcf8 000102 (v01 INTEL  DQ67EP   00000001 MSFT 03000001)
[    0.000000] ACPI: MCFG 00000000bc55fe00 00003C (v01 INTEL  DQ67EP   01072009 MSFT 00000097)
[    0.000000] ACPI: HPET 00000000bc55fe40 000038 (v01 INTEL  DQ67EP   01072009 AMI. 00000004)
[    0.000000] ACPI: ASF! 00000000bc55fe78 0000A0 (v32 INTEL  DQ67EP   00000001 TFSM 000F4240)
[    0.000000] ACPI: DMAR 00000000bc55ff18 0000E8 (v01 INTEL  DQ67EP   00000001 INTL 00000001)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000013e5fffff]
[    0.000000] Initmem setup node 0 [mem 0x00000000-0x13e5fffff]
[    0.000000]   NODE_DATA [mem 0x13e5d5000-0x13e5fbfff]
[    0.000000]  [ffffea0000000000-ffffea0004ffffff] PMD -> [ffff880139c00000-ffff88013dbfffff] on node 0
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]
[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]
[    0.000000]   Normal   [mem 0x100000000-0x13e5fffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x00001000-0x00099fff]
[    0.000000]   node   0: [mem 0x00100000-0x1fffffff]
[    0.000000]   node   0: [mem 0x20200000-0x3fffffff]
[    0.000000]   node   0: [mem 0x40200000-0xbc557fff]
[    0.000000]   node   0: [mem 0xbc5ab000-0xbc5b2fff]
[    0.000000]   node   0: [mem 0xbc8c5000-0xbc8c5fff]
[    0.000000]   node   0: [mem 0xbcb7c000-0xbccfffff]
[    0.000000]   node   0: [mem 0x100000000-0x13e5fffff]
[    0.000000] On node 0 totalpages: 1026174
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 153 pages reserved
[    0.000000]   DMA zone: 3993 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 11980 pages used for memmap
[    0.000000]   DMA32 zone: 766693 pages, LIFO batch:31
[    0.000000]   Normal zone: 3992 pages used for memmap
[    0.000000]   Normal zone: 255488 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x04] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x06] enabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ2 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
[    0.000000] nr_irqs_gsi: 40
[    0.000000] PM: Registered nosave memory: [mem 0x0009a000-0x0009afff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009b000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x20000000-0x201fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x40000000-0x401fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbc558000-0xbc560fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbc561000-0xbc5aafff]
[    0.000000] PM: Registered nosave memory: [mem 0xbc5b3000-0xbc8c4fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbc8c6000-0xbc8d5fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbc8d6000-0xbc8f4fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbc8f5000-0xbc918fff]
[    0.000000] PM: Registered nosave memory: [mem 0xbc919000-0xbc95bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbc95c000-0xbcb7bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xbcd00000-0xbcffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbd000000-0xbd7fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbd800000-0xbf9fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xbfa00000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed3ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed40000-0xfeffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff]
[    0.000000] e820: [mem 0xbfa00000-0xfed1bfff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1
[    0.000000] PERCPU: Embedded 477 pages/cpu @ffff880139400000 s1925048 r8192 d20552 u2097152
[    0.000000] pcpu-alloc: s1925048 r8192 d20552 u2097152 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 
[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 1009985
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.13.0-0.rc0.git5.1.fc21.x86_64 root=UUID=bd0a2380-7b31-401a-aeed-56cf79d500ed ro nomodeset rd.md=0 rd.lvm=0 rd.dm=0 vconsole.keymap=us rd.luks=0 vconsole.font=latarcyrheb-sun16 console=tty0 console=ttyS1 LANG=en_US.UTF-8
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340
[    0.000000] Memory: 3926356K/4104696K available (7559K kernel code, 1562K rwdata, 3212K rodata, 3732K init, 12660K bss, 178340K reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU lockdep checking is enabled.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4.
[    0.000000] NR_IRQS:524544 nr_irqs:712 16
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] console [ttyS1] enabled
[    0.000000] Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar
[    0.000000] ... MAX_LOCKDEP_SUBCLASSES:  8
[    0.000000] ... MAX_LOCK_DEPTH:          48
[    0.000000] ... MAX_LOCKDEP_KEYS:        8191
[    0.000000] ... CLASSHASH_SIZE:          4096
[    0.000000] ... MAX_LOCKDEP_ENTRIES:     16384
[    0.000000] ... MAX_LOCKDEP_CHAINS:      32768
[    0.000000] ... CHAINHASH_SIZE:          16384
[    0.000000]  memory used by lock dependency info: 6367 kB
[    0.000000]  per task-struct memory footprint: 2688 bytes
[    0.000000] allocated 16777216 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] ODEBUG: 23 of 23 active objects replaced
[    0.000000] kmemleak: Kernel memory leak detector disabled
[    0.000000] hpet clockevent registered
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.001000] tsc: Detected 3299.843 MHz processor
[    0.000002] Calibrating delay loop (skipped), value calculated using timer frequency.. 6599.68 BogoMIPS (lpj=3299843)
[    0.000392] pid_max: default: 32768 minimum: 301
[    0.000764] Security Framework initialized
[    0.000934] SELinux:  Initializing.
[    0.001146] SELinux:  Starting in permissive mode
[    0.002054] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.003212] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
[    0.003727] Mount-cache hash table entries: 256
[    0.005304] Initializing cgroup subsys memory
[    0.005511] Initializing cgroup subsys devices
[    0.005694] Initializing cgroup subsys freezer
[    0.005876] Initializing cgroup subsys net_cls
[    0.006064] Initializing cgroup subsys blkio
[    0.006231] Initializing cgroup subsys perf_event
[    0.006537] CPU: Physical Processor ID: 0
[    0.006695] CPU: Processor Core ID: 0
[    0.006850] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[    0.007255] mce: CPU supports 9 MCE banks
[    0.007426] CPU0: Thermal monitoring enabled (TM1)
[    0.007617] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0
Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32
tlb_flushall_shift: 5
[    0.008196] Freeing SMP alternatives memory: 24K (ffffffff8212d000 - ffffffff82133000)
[    0.009765] ACPI: Core revision 20130927
[    0.089331] ACPI: All ACPI Tables successfully acquired
[    0.097180] ftrace: allocating 25820 entries in 101 pages
[    0.107273] dmar: Host address width 36
[    0.107433] dmar: DRHD base: 0x000000fed90000 flags: 0x0
[    0.107662] dmar: IOMMU 0: reg_base_addr fed90000 ver 1:0 cap c0000020e60262 ecap f0101a
[    0.107951] dmar: DRHD base: 0x000000fed91000 flags: 0x1
[    0.108616] dmar: IOMMU 1: reg_base_addr fed91000 ver 1:0 cap c9008020660262 ecap f0105a
[    0.108893] dmar: RMRR base: 0x000000bc8ac000 end: 0x000000bc8bafff
[    0.109116] dmar: RMRR base: 0x000000bd800000 end: 0x000000bf9fffff
[    0.109416] IOAPIC id 0 under DRHD base  0xfed91000 IOMMU 1
[    0.109609] HPET id 0 under DRHD base 0xfed91000
[    0.109783] HPET id 0 under DRHD base 0xfed91000
[    0.109957] HPET id 0 under DRHD base 0xfed91000
[    0.110131] HPET id 0 under DRHD base 0xfed91000
[    0.110307] HPET id 0 under DRHD base 0xfed91000
[    0.110479] HPET id 0 under DRHD base 0xfed91000
[    0.110652] HPET id 0 under DRHD base 0xfed91000
[    0.110826] HPET id 0 under DRHD base 0xfed91000
[    0.111177] Enabled IRQ remapping in x2apic mode
[    0.111353] Enabling x2apic
[    0.111487] Enabled x2apic
[    0.111642] Switched APIC routing to cluster x2apic.
[    0.112658] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.122856] smpboot: CPU0: Intel(R) Core(TM) i5-2500 CPU @ 3.30GHz (fam: 06, model: 2a, stepping: 07)
[    0.123302] TSC deadline timer enabled
[    0.123320] Performance Events: PEBS fmt1+, 16-deep LBR, SandyBridge events, full-width counters, Intel PMU driver.
[    0.123889] ... version:                3
[    0.124050] ... bit width:              48
[    0.124210] ... generic registers:      8
[    0.124378] ... value mask:             0000ffffffffffff
[    0.124566] ... max period:             0000ffffffffffff
[    0.124756] ... fixed-purpose events:   3
[    0.124915] ... event mask:             00000007000000ff
[    0.128606] x86: Booting SMP configuration:
[    0.142394] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[    0.128772] .... node  #0, CPUs:      #1 #2 #3
[    0.170090] x86: Booted up 1 node, 4 CPUs
[    0.170329] smpboot: Total of 4 processors activated (26398.74 BogoMIPS)
[    0.174592] devtmpfs: initialized
[    0.176571] PM: Registering ACPI NVS region [mem 0xbc561000-0xbc5aafff] (303104 bytes)
[    0.177058] PM: Registering ACPI NVS region [mem 0xbc8d6000-0xbc8f4fff] (126976 bytes)
[    0.177416] PM: Registering ACPI NVS region [mem 0xbc919000-0xbc95bfff] (274432 bytes)
[    0.182589] atomic64 test passed for x86-64 platform with CX8 and with SSE
[    0.182815] pinctrl core: initialized pinctrl subsystem
[    0.183252] RTC time: 10:38:17, date: 11/17/13
[    0.183806] NET: Registered protocol family 16
[    0.184743] cpuidle: using governor menu
[    0.185050] ACPI: bus type PCI registered
[    0.185211] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.185821] PCI: MMCONFIG for domain 0000 [bus 00-3f] at [mem 0xe0000000-0xe3ffffff] (base 0xe0000000)
[    0.186132] PCI: not using MMCONFIG
[    0.186285] PCI: Using configuration type 1 for base access
[    0.199154] bio: create slab <bio-0> at 0
[    0.199977] ACPI: Added _OSI(Module Device)
[    0.200143] ACPI: Added _OSI(Processor Device)
[    0.200312] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.200495] ACPI: Added _OSI(Processor Aggregator Device)
[    0.215884] ACPI: Executed 1 blocks of module-level executable AML code
[    0.298065] ACPI: SSDT 00000000bc8dac18 00038C (v01    AMI      IST 00000001 MSFT 03000001)
[    0.303147] ACPI: Dynamic OEM Table Load:
[    0.303401] ACPI: SSDT           (null) 00038C (v01    AMI      IST 00000001 MSFT 03000001)
[    0.304246] ACPI: SSDT 00000000bc8dbe18 000084 (v01    AMI      CST 00000001 MSFT 03000001)
[    0.306557] ACPI: Dynamic OEM Table Load:
[    0.306814] ACPI: SSDT           (null) 000084 (v01    AMI      CST 00000001 MSFT 03000001)
[    0.321637] ACPI: Interpreter enabled
[    0.321808] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S1_] (20130927/hwxface-580)
[    0.322222] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S2_] (20130927/hwxface-580)
[    0.322700] ACPI: (supports S0 S3 S4 S5)
[    0.322861] ACPI: Using IOAPIC for interrupt routing
[    0.323318] PCI: MMCONFIG for domain 0000 [bus 00-3f] at [mem 0xe0000000-0xe3ffffff] (base 0xe0000000)
[    0.325224] PCI: MMCONFIG at [mem 0xe0000000-0xe3ffffff] reserved in ACPI motherboard resources
[    0.334074] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.336554] ACPI: No dock devices found.
[    0.340673] [Firmware Bug]: ACPI: BIOS _OSI(Linux) query ignored
[    0.498775] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.499006] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.507060] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    0.514652] acpi PNP0A08:00: [Firmware Info]: MMCONFIG for domain 0000 [bus 00-3f] only partially covers this bridge
[    0.516886] ACPI: \_SB_.PCI0.MCH_: can't evaluate _ADR (0x5)
[    0.517293] ACPI: \_SB_.PCI0.PCH_: can't evaluate _ADR (0x5)
[    0.517530] ACPI: \_SB_.PCI0.CWDT: can't evaluate _ADR (0x5)
[    0.519709] ACPI: \_SB_.PCI0.HPET: can't evaluate _ADR (0x5)
[    0.520082] ACPI: \_SB_.PCI0.ITPM: can't evaluate _ADR (0x5)
[    0.520286] PCI host bridge to bus 0000:00
[    0.520451] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.520652] pci_bus 0000:00: root bus resource [io  0x0000-0x03af]
[    0.520865] pci_bus 0000:00: root bus resource [io  0x03e0-0x0cf7]
[    0.521077] pci_bus 0000:00: root bus resource [io  0x03b0-0x03df]
[    0.521288] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff]
[    0.521499] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]
[    0.521733] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000dffff]
[    0.521963] pci_bus 0000:00: root bus resource [mem 0xbfa00000-0xffffffff]
[    0.522211] pci 0000:00:00.0: [8086:0100] type 00 class 0x060000
[    0.523405] pci 0000:00:01.0: [8086:0101] type 01 class 0x060400
[    0.523478] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    0.524502] pci 0000:00:01.0: System wakeup disabled by ACPI
[    0.525040] pci 0000:00:02.0: [8086:0102] type 00 class 0x030000
[    0.525057] pci 0000:00:02.0: reg 0x10: [mem 0xfe000000-0xfe3fffff 64bit]
[    0.525066] pci 0000:00:02.0: reg 0x18: [mem 0xd0000000-0xdfffffff 64bit pref]
[    0.525073] pci 0000:00:02.0: reg 0x20: [io  0xf000-0xf03f]
[    0.526304] pci 0000:00:16.0: [8086:1c3a] type 00 class 0x078000
[    0.526342] pci 0000:00:16.0: reg 0x10: [mem 0xfe62a000-0xfe62a00f 64bit]
[    0.526487] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[    0.527658] pci 0000:00:16.2: [8086:1c3c] type 00 class 0x010185
[    0.527690] pci 0000:00:16.2: reg 0x10: [io  0xf130-0xf137]
[    0.527705] pci 0000:00:16.2: reg 0x14: [io  0xf120-0xf123]
[    0.527720] pci 0000:00:16.2: reg 0x18: [io  0xf110-0xf117]
[    0.527736] pci 0000:00:16.2: reg 0x1c: [io  0xf100-0xf103]
[    0.527751] pci 0000:00:16.2: reg 0x20: [io  0xf0f0-0xf0ff]
[    0.528993] pci 0000:00:16.3: [8086:1c3d] type 00 class 0x070002
[    0.529025] pci 0000:00:16.3: reg 0x10: [io  0xf0e0-0xf0e7]
[    0.529040] pci 0000:00:16.3: reg 0x14: [mem 0xfe629000-0xfe629fff]
[    0.530317] pci 0000:00:19.0: [8086:1502] type 00 class 0x020000
[    0.530353] pci 0000:00:19.0: reg 0x10: [mem 0xfe600000-0xfe61ffff]
[    0.530368] pci 0000:00:19.0: reg 0x14: [mem 0xfe628000-0xfe628fff]
[    0.530384] pci 0000:00:19.0: reg 0x18: [io  0xf080-0xf09f]
[    0.530526] pci 0000:00:19.0: PME# supported from D0 D3hot D3cold
[    0.531545] pci 0000:00:19.0: System wakeup disabled by ACPI
[    0.532052] pci 0000:00:1a.0: [8086:1c2d] type 00 class 0x0c0320
[    0.532088] pci 0000:00:1a.0: reg 0x10: [mem 0xfe627000-0xfe6273ff]
[    0.532261] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[    0.533277] pci 0000:00:1a.0: System wakeup disabled by ACPI
[    0.533785] pci 0000:00:1b.0: [8086:1c20] type 00 class 0x040300
[    0.533819] pci 0000:00:1b.0: reg 0x10: [mem 0xfe620000-0xfe623fff 64bit]
[    0.533977] pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold
[    0.535158] pci 0000:00:1c.0: [8086:1c10] type 01 class 0x060400
[    0.535327] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    0.536353] pci 0000:00:1c.0: System wakeup disabled by ACPI
[    0.536861] pci 0000:00:1c.6: [8086:1c1c] type 01 class 0x060400
[    0.537027] pci 0000:00:1c.6: PME# supported from D0 D3hot D3cold
[    0.538044] pci 0000:00:1c.6: System wakeup disabled by ACPI
[    0.538546] pci 0000:00:1d.0: [8086:1c26] type 00 class 0x0c0320
[    0.538582] pci 0000:00:1d.0: reg 0x10: [mem 0xfe626000-0xfe6263ff]
[    0.538755] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[    0.539765] pci 0000:00:1d.0: System wakeup disabled by ACPI
[    0.540266] pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401
[    0.541378] pci 0000:00:1e.0: System wakeup disabled by ACPI
[    0.541868] pci 0000:00:1f.0: [8086:1c4e] type 00 class 0x060100
[    0.543200] pci 0000:00:1f.2: [8086:1c02] type 00 class 0x010601
[    0.543239] pci 0000:00:1f.2: reg 0x10: [io  0xf0d0-0xf0d7]
[    0.543255] pci 0000:00:1f.2: reg 0x14: [io  0xf0c0-0xf0c3]
[    0.543270] pci 0000:00:1f.2: reg 0x18: [io  0xf0b0-0xf0b7]
[    0.543285] pci 0000:00:1f.2: reg 0x1c: [io  0xf0a0-0xf0a3]
[    0.543299] pci 0000:00:1f.2: reg 0x20: [io  0xf060-0xf07f]
[    0.543314] pci 0000:00:1f.2: reg 0x24: [mem 0xfe625000-0xfe6257ff]
[    0.543427] pci 0000:00:1f.2: PME# supported from D3hot
[    0.544613] pci 0000:00:1f.3: [8086:1c22] type 00 class 0x0c0500
[    0.544643] pci 0000:00:1f.3: reg 0x10: [mem 0xfe624000-0xfe6240ff 64bit]
[    0.544684] pci 0000:00:1f.3: reg 0x20: [io  0xf040-0xf05f]
[    0.546220] pci 0000:01:00.0: [10ec:8168] type 00 class 0x020000
[    0.546237] pci 0000:01:00.0: reg 0x10: [io  0xe000-0xe0ff]
[    0.546266] pci 0000:01:00.0: reg 0x18: [mem 0xfe520000-0xfe520fff 64bit]
[    0.546300] pci 0000:01:00.0: reg 0x30: [mem 0xfe500000-0xfe51ffff pref]
[    0.546390] pci 0000:01:00.0: supports D1 D2
[    0.546391] pci 0000:01:00.0: PME# supported from D1 D2 D3hot D3cold
[    0.546705] pci 0000:01:00.0: disabling ASPM on pre-1.1 PCIe device.  You can enable it with 'pcie_aspm=force'
[    0.547074] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.547259] pci 0000:00:01.0:   bridge window [io  0xe000-0xefff]
[    0.547262] pci 0000:00:01.0:   bridge window [mem 0xfe500000-0xfe5fffff]
[    0.547547] pci 0000:00:1c.0: PCI bridge to [bus 02]
[    0.548070] pci 0000:03:00.0: [1033:0194] type 00 class 0x0c0330
[    0.548109] pci 0000:03:00.0: reg 0x10: [mem 0xfe400000-0xfe401fff 64bit]
[    0.548327] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
[    0.548703] pci 0000:00:1c.6: PCI bridge to [bus 03]
[    0.548892] pci 0000:00:1c.6:   bridge window [mem 0xfe400000-0xfe4fffff]
[    0.549211] pci 0000:00:1e.0: PCI bridge to [bus 04] (subtractive decode)
[    0.549456] pci 0000:00:1e.0:   bridge window [io  0x0000-0x03af] (subtractive decode)
[    0.549462] pci 0000:00:1e.0:   bridge window [io  0x03e0-0x0cf7] (subtractive decode)
[    0.549467] pci 0000:00:1e.0:   bridge window [io  0x03b0-0x03df] (subtractive decode)
[    0.549473] pci 0000:00:1e.0:   bridge window [io  0x0d00-0xffff] (subtractive decode)
[    0.549479] pci 0000:00:1e.0:   bridge window [mem 0x000a0000-0x000bffff] (subtractive decode)
[    0.549484] pci 0000:00:1e.0:   bridge window [mem 0x000c0000-0x000dffff] (subtractive decode)
[    0.549490] pci 0000:00:1e.0:   bridge window [mem 0xbfa00000-0xffffffff] (subtractive decode)
[    0.560041] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15)
[    0.561910] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 *5 6 7 10 11 12 14 15)
[    0.563769] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 *10 11 12 14 15)
[    0.565579] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 *10 11 12 14 15)
[    0.567384] ACPI: PCI Interrupt Link [LNKE] (IRQs *3 4 5 6 7 10 11 12 14 15)
[    0.569234] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 11 12 14 15) *0
[    0.571159] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *7 10 11 12 14 15)
[    0.573012] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 10 *11 12 14 15)
[    0.574528] ACPI: Enabled 3 GPEs in block 00 to 3F
[    0.574815] ACPI: \_SB_.PCI0: notify handler is installed
[    0.574967] Found 1 acpi root devices
[    0.575715] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[    0.575999] vgaarb: loaded
[    0.576131] vgaarb: bridge control possible 0000:00:02.0
[    0.577307] SCSI subsystem initialized
[    0.577699] libata version 3.00 loaded.
[    0.577907] ACPI: bus type USB registered
[    0.578232] usbcore: registered new interface driver usbfs
[    0.578506] usbcore: registered new interface driver hub
[    0.578805] usbcore: registered new device driver usb
[    0.579472] PCI: Using ACPI for IRQ routing
[    0.582897] PCI: pci_cache_line_size set to 64 bytes
[    0.582980] e820: reserve RAM buffer [mem 0x0009ac00-0x0009ffff]
[    0.582993] e820: reserve RAM buffer [mem 0xbc558000-0xbfffffff]
[    0.583004] e820: reserve RAM buffer [mem 0xbc5b3000-0xbfffffff]
[    0.583012] e820: reserve RAM buffer [mem 0xbc8c6000-0xbfffffff]
[    0.583020] e820: reserve RAM buffer [mem 0xbcd00000-0xbfffffff]
[    0.583027] e820: reserve RAM buffer [mem 0x13e600000-0x13fffffff]
[    0.583908] NetLabel: Initializing
[    0.584058] NetLabel:  domain hash size = 128
[    0.584224] NetLabel:  protocols = UNLABELED CIPSOv4
[    0.584532] NetLabel:  unlabeled traffic allowed by default
[    0.584859] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    0.585482] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    0.587739] Switched to clocksource hpet
[    0.680029] pnp: PnP ACPI init
[    0.680263] ACPI: bus type PNP registered
[    0.682253] system 00:00: [mem 0xfed10000-0xfed19fff] has been reserved
[    0.682486] system 00:00: [mem 0xe0000000-0xe3ffffff] has been reserved
[    0.682740] system 00:00: [mem 0xfed90000-0xfed93fff] could not be reserved
[    0.682974] system 00:00: [mem 0xfed20000-0xfed3ffff] has been reserved
[    0.683203] system 00:00: [mem 0xfee00000-0xfee0ffff] has been reserved
[    0.683458] system 00:00: Plug and Play ACPI device, IDs PNP0c01 (active)
[    0.685897] system 00:01: [io  0x0290-0x029f] has been reserved
[    0.686106] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.689788] pnp 00:02: [dma 4]
[    0.689990] pnp 00:02: Plug and Play ACPI device, IDs PNP0200 (active)
[    0.690302] pnp 00:03: Plug and Play ACPI device, IDs PNP0b00 (active)
[    0.690552] pnp 00:04: Plug and Play ACPI device, IDs PNP0800 (active)
[    0.691205] system 00:05: [io  0x04d0-0x04d1] has been reserved
[    0.691414] system 00:05: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.691706] pnp 00:06: Plug and Play ACPI device, IDs PNP0c04 (active)
[    0.694826] pnp 00:07: [dma 0 disabled]
[    0.695150] pnp 00:07: Plug and Play ACPI device, IDs PNP0501 (active)
[    0.696693] pnp 00:08: Plug and Play ACPI device, IDs PNP0c31 (active)
[    0.701108] system 00:09: [io  0x0400-0x0453] could not be reserved
[    0.701332] system 00:09: [io  0x0458-0x047f] has been reserved
[    0.701545] system 00:09: [io  0x1180-0x119f] has been reserved
[    0.701772] system 00:09: [io  0x0500-0x057f] has been reserved
[    0.701986] system 00:09: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    0.702225] system 00:09: [mem 0xfec00000-0xfecfffff] could not be reserved
[    0.702464] system 00:09: [mem 0xfed08000-0xfed08fff] has been reserved
[    0.702703] system 00:09: [mem 0xff000000-0xffffffff] has been reserved
[    0.702924] system 00:09: Plug and Play ACPI device, IDs PNP0c01 (active)
[    0.703940] system 00:0a: [io  0x0454-0x0457] has been reserved
[    0.704147] system 00:0a: Plug and Play ACPI device, IDs INT3f0d PNP0c02 (active)
[    0.706170] pnp 00:0b: Plug and Play ACPI device, IDs PNP0103 (active)
[    0.709297] pnp: PnP ACPI: found 12 devices
[    0.709462] ACPI: bus type PNP unregistered
[    0.728253] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.728439] pci 0000:00:01.0:   bridge window [io  0xe000-0xefff]
[    0.728662] pci 0000:00:01.0:   bridge window [mem 0xfe500000-0xfe5fffff]
[    0.728891] pci 0000:00:1c.0: PCI bridge to [bus 02]
[    0.729094] pci 0000:00:1c.6: PCI bridge to [bus 03]
[    0.729284] pci 0000:00:1c.6:   bridge window [mem 0xfe400000-0xfe4fffff]
[    0.729524] pci 0000:00:1e.0: PCI bridge to [bus 04]
[    0.729737] pci_bus 0000:00: resource 4 [io  0x0000-0x03af]
[    0.729739] pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7]
[    0.729740] pci_bus 0000:00: resource 6 [io  0x03b0-0x03df]
[    0.729741] pci_bus 0000:00: resource 7 [io  0x0d00-0xffff]
[    0.729743] pci_bus 0000:00: resource 8 [mem 0x000a0000-0x000bffff]
[    0.729744] pci_bus 0000:00: resource 9 [mem 0x000c0000-0x000dffff]
[    0.729746] pci_bus 0000:00: resource 10 [mem 0xbfa00000-0xffffffff]
[    0.729747] pci_bus 0000:01: resource 0 [io  0xe000-0xefff]
[    0.729749] pci_bus 0000:01: resource 1 [mem 0xfe500000-0xfe5fffff]
[    0.729750] pci_bus 0000:03: resource 1 [mem 0xfe400000-0xfe4fffff]
[    0.729752] pci_bus 0000:04: resource 4 [io  0x0000-0x03af]
[    0.729753] pci_bus 0000:04: resource 5 [io  0x03e0-0x0cf7]
[    0.729755] pci_bus 0000:04: resource 6 [io  0x03b0-0x03df]
[    0.729756] pci_bus 0000:04: resource 7 [io  0x0d00-0xffff]
[    0.729757] pci_bus 0000:04: resource 8 [mem 0x000a0000-0x000bffff]
[    0.729759] pci_bus 0000:04: resource 9 [mem 0x000c0000-0x000dffff]
[    0.729760] pci_bus 0000:04: resource 10 [mem 0xbfa00000-0xffffffff]
[    0.729918] NET: Registered protocol family 2
[    0.731054] TCP established hash table entries: 32768 (order: 6, 262144 bytes)
[    0.731818] TCP bind hash table entries: 32768 (order: 9, 2621440 bytes)
[    0.733413] TCP: Hash tables configured (established 32768 bind 32768)
[    0.733710] TCP: reno registered
[    0.733927] UDP hash table entries: 2048 (order: 6, 393216 bytes)
[    0.734386] UDP-Lite hash table entries: 2048 (order: 6, 393216 bytes)
[    0.735773] NET: Registered protocol family 1
[    0.736535] pci 0000:00:02.0: BIOS left Intel GPU interrupts enabled; disabling
[    0.736828] pci 0000:00:02.0: Boot video device
[    1.089571] PCI: CLS 64 bytes, default 64
[    1.090019] Unpacking initramfs...
[    1.253751] Freeing initrd memory: 7620K (ffff88003710e000 - ffff88003787f000)
[    1.436735] DMA-API: preallocated 65536 debug entries
[    1.436937] DMA-API: debugging enabled by kernel config
[    1.437146] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    1.437363] software IO TLB [mem 0xb8558000-0xbc558000] (64MB) mapped at [ffff8800b8558000-ffff8800bc557fff]
[    1.441241] Scanning for low memory corruption every 60 seconds
[    1.441873] cryptomgr_test (39) used greatest stack depth: 6224 bytes left
[    1.445624] modprobe (47) used greatest stack depth: 5384 bytes left
[    1.448909] cryptomgr_test (44) used greatest stack depth: 5312 bytes left
[    1.449262] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[    1.451654] Initialise system trusted keyring
[    1.451992] audit: initializing netlink socket (disabled)
[    1.452248] type=2000 audit(1384684698.430:1): initialized
[    1.470832] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    1.490262] zbud: loaded
[    1.492588] VFS: Disk quotas dquot_6.5.2
[    1.492986] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.497117] msgmni has been set to 7683
[    1.497717] Key type big_key registered
[    1.497891] SELinux:  Registering netfilter hooks
[    1.500067] cryptomgr_test (70) used greatest stack depth: 5296 bytes left
[    1.501662] alg: No test for stdrng (krng)
[    1.501843] NET: Registered protocol family 38
[    1.502050] Key type asymmetric registered
[    1.502220] Asymmetric key parser 'x509' registered
[    1.502662] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
[    1.503076] io scheduler noop registered
[    1.503236] io scheduler deadline registered
[    1.503789] io scheduler cfq registered (default)
[    1.505102] list_sort_test: start testing list_sort()
[    1.510870] pcieport 0000:00:01.0: irq 42 for MSI/MSI-X
[    1.512780] pcieport 0000:00:1c.0: irq 43 for MSI/MSI-X
[    1.513187] pcieport 0000:00:1c.6: irq 44 for MSI/MSI-X
[    1.513715] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt
[    1.513965] pci 0000:01:00.0: Signaling PME through PCIe PME interrupt
[    1.514186] pcie_pme 0000:00:01.0:pcie01: service driver pcie_pme loaded
[    1.514364] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt
[    1.514595] pcie_pme 0000:00:1c.0:pcie01: service driver pcie_pme loaded
[    1.514769] pcieport 0000:00:1c.6: Signaling PME through PCIe PME interrupt
[    1.515009] pci 0000:03:00.0: Signaling PME through PCIe PME interrupt
[    1.515234] pcie_pme 0000:00:1c.6:pcie01: service driver pcie_pme loaded
[    1.515325] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    1.515690] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    1.516261] intel_idle: MWAIT substates: 0x1120
[    1.516262] intel_idle: v0.4 model 0x2A
[    1.516263] intel_idle: lapic_timer_reliable_states 0xffffffff
[    1.517809] input: Power Button as /devices/LNXSYSTM:00/device:00/PNP0C0C:00/input/input0
[    1.518142] ACPI: Power Button [PWRB]
[    1.525712] GHES: HEST is not enabled!
[    1.526179] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    1.547233] 00:07: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    1.572504] 0000:00:16.3: ttyS1 at I/O 0xf0e0 (irq = 17, base_baud = 115200) is a 16550A
[    1.584257] Non-volatile memory driver v1.3
[    1.588742] Linux agpgart interface v0.103
[    1.594182] ahci 0000:00:1f.2: version 3.0
[    1.595767] ahci 0000:00:1f.2: irq 45 for MSI/MSI-X
[    1.596060] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x2 impl SATA mode
[    1.606611] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems sxs apst 
[    1.622631] scsi0 : ahci
[    1.626657] scsi1 : ahci
[    1.630223] scsi2 : ahci
[    1.634280] scsi3 : ahci
[    1.637350] scsi4 : ahci
[    1.640943] scsi5 : ahci
[    1.644149] ata1: DUMMY
[    1.646818] ata2: SATA max UDMA/133 abar m2048@0xfe625000 port 0xfe625180 irq 45
[    1.653553] ata3: DUMMY
[    1.654186] ata4: DUMMY
[    1.655383] ata5: DUMMY
[    1.656014] ata6: DUMMY
[    1.658049] libphy: Fixed MDIO Bus: probed
[    1.659836] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.661945] ehci-pci: EHCI PCI platform driver
[    1.665363] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    1.667831] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    1.670777] ehci-pci 0000:00:1a.0: debug port 2
[    1.676665] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported
[    1.676836] ehci-pci 0000:00:1a.0: irq 16, io mem 0xfe627000
[    1.684768] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    1.686914] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[    1.688826] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.691502] usb usb1: Product: EHCI Host Controller
[    1.693538] usb usb1: Manufacturer: Linux 3.13.0-0.rc0.git5.1.fc21.x86_64 ehci_hcd
[    1.696274] usb usb1: SerialNumber: 0000:00:1a.0
[    1.699644] hub 1-0:1.0: USB hub found
[    1.700915] hub 1-0:1.0: 3 ports detected
[    1.705582] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    1.712930] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    1.715922] ehci-pci 0000:00:1d.0: debug port 2
[    1.724470] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported
[    1.724615] ehci-pci 0000:00:1d.0: irq 23, io mem 0xfe626000
[    1.732710] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    1.740895] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[    1.743020] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.746729] usb usb2: Product: EHCI Host Controller
[    1.748787] usb usb2: Manufacturer: Linux 3.13.0-0.rc0.git5.1.fc21.x86_64 ehci_hcd
[    1.752460] usb usb2: SerialNumber: 0000:00:1d.0
[    1.755516] hub 2-0:1.0: USB hub found
[    1.758133] hub 2-0:1.0: 3 ports detected
[    1.763860] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    1.776789] ohci-pci: OHCI PCI platform driver
[    1.778678] uhci_hcd: USB Universal Host Controller Interface driver
[    1.781875] xhci_hcd 0000:03:00.0: xHCI Host Controller
[    1.787991] xhci_hcd 0000:03:00.0: new USB bus registered, assigned bus number 3
[    1.790328] xhci_hcd 0000:03:00.0: irq 46 for MSI/MSI-X
[    1.790399] xhci_hcd 0000:03:00.0: irq 47 for MSI/MSI-X
[    1.790462] xhci_hcd 0000:03:00.0: irq 48 for MSI/MSI-X
[    1.790528] xhci_hcd 0000:03:00.0: irq 49 for MSI/MSI-X
[    1.790604] xhci_hcd 0000:03:00.0: irq 50 for MSI/MSI-X
[    1.791848] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
[    1.795435] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.798033] usb usb3: Product: xHCI Host Controller
[    1.800113] usb usb3: Manufacturer: Linux 3.13.0-0.rc0.git5.1.fc21.x86_64 xhci_hcd
[    1.803823] usb usb3: SerialNumber: 0000:03:00.0
[    1.807134] hub 3-0:1.0: USB hub found
[    1.808871] hub 3-0:1.0: 2 ports detected
[    1.811620] xhci_hcd 0000:03:00.0: xHCI Host Controller
[    1.814246] xhci_hcd 0000:03:00.0: new USB bus registered, assigned bus number 4
[    1.821048] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003
[    1.823048] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.827021] usb usb4: Product: xHCI Host Controller
[    1.830654] usb usb4: Manufacturer: Linux 3.13.0-0.rc0.git5.1.fc21.x86_64 xhci_hcd
[    1.853420] usb usb4: SerialNumber: 0000:03:00.0
[    1.856495] hub 4-0:1.0: USB hub found
[    1.858511] hub 4-0:1.0: 2 ports detected
[    1.864887] usbcore: registered new interface driver usbserial
[    1.867623] usbcore: registered new interface driver usbserial_generic
[    1.870002] usbserial: USB Serial support registered for generic
[    1.872542] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    1.878368] serio: i8042 KBD port at 0x60,0x64 irq 1
[    1.880162] serio: i8042 AUX port at 0x60,0x64 irq 12
[    1.882987] mousedev: PS/2 mouse device common for all mice
[    1.891493] rtc_cmos 00:03: RTC can wake from S4
[    1.895048] rtc_cmos 00:03: rtc core: registered rtc_cmos as rtc0
[    1.897993] rtc_cmos 00:03: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[    1.902598] device-mapper: uevent: version 1.0.3
[    1.906345] device-mapper: ioctl: 4.27.0-ioctl (2013-10-30) initialised: dm-devel
[    1.915405] Intel P-state driver initializing.
[    1.920082] Intel pstate controlling: cpu 0
[    1.921638] Intel pstate controlling: cpu 1
[    1.923487] Intel pstate controlling: cpu 2
[    1.925404] Intel pstate controlling: cpu 3
[    1.930174] hidraw: raw HID events driver (C) Jiri Kosina
[    1.936315] usbcore: registered new interface driver usbhid
[    1.938735] usbhid: USB HID core driver
[    1.940945] drop_monitor: Initializing network drop monitor service
[    1.943216] ip_tables: (C) 2000-2006 Netfilter Core Team
[    1.945392] TCP: cubic registered
[    1.947093] Initializing XFRM netlink socket
[    1.950286] NET: Registered protocol family 10
[    1.953730] mip6: Mobile IPv6
[    1.954575] NET: Registered protocol family 17
[    1.958743] Loading compiled-in X.509 certificates
[    1.962452] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    1.978101] Loaded X.509 cert 'Fedora kernel signing key: 3ec4db781733867229858329d9de04afdc21d484'
[    1.981116] registered taskstats version 1
[    1.990898]   Magic number: 5:947:628
[    1.992058] rtc_cmos 00:03: setting system clock to 2013-11-17 10:38:19 UTC (1384684699)
[    1.995255] PM: Hibernation image not present or could not be loaded.
[    2.007575] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    2.019572] ata2.00: ATA-7: ST3320620AS, 3.AAE, max UDMA/133
[    2.023391] ata2.00: 625142448 sectors, multi 16: LBA48 NCQ (depth 31/32)
[    2.077826] ata2.00: configured for UDMA/133
[    2.081118] scsi 1:0:0:0: Direct-Access     ATA      ST3320620AS      3.AA PQ: 0 ANSI: 5
[    2.105119] sd 1:0:0:0: [sda] 625142448 512-byte logical blocks: (320 GB/298 GiB)
[    2.105619] sd 1:0:0:0: Attached scsi generic sg0 type 0
[    2.110984] sd 1:0:0:0: [sda] Write Protect is off
[    2.112654] sd 1:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    2.112816] sd 1:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    2.125131] usb 1-1: New USB device found, idVendor=8087, idProduct=0024
[    2.127757] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    2.130612] hub 1-1:1.0: USB hub found
[    2.135853]  sda: sda1
[    2.135998] hub 1-1:1.0: 6 ports detected
[    2.140012] sd 1:0:0:0: [sda] Attached SCSI disk
[    2.144309] Freeing unused kernel memory: 3732K (ffffffff81d88000 - ffffffff8212d000)
[    2.147064] Write protecting the kernel read-only data: 12288k
[    2.150862] Freeing unused kernel memory: 620K (ffff880001765000 - ffff880001800000)
[    2.157873] Freeing unused kernel memory: 884K (ffff880001b23000 - ffff880001c00000)
[    2.178893] systemd[1]: systemd 204 running in system mode. (+PAM +LIBWRAP +AUDIT +SELINUX +IMA +SYSVINIT +LIBCRYPTSETUP +GCRYPT +ACL +XZ)
[    2.184293] systemd[1]: Running in initial RAM disk.
[    2.188675] systemd[1]: Set hostname to <habix.doma>.
[    2.209100] systemd[1]: Expecting device dev-disk-by\x2duuid-bd0a2380\x2d7b31\x2d401a\x2daeed\x2d56cf79d500ed.device...
[    2.217330] systemd[1]: Starting Timers.
[    2.225330] systemd[1]: Reached target Timers.
[    2.227077] systemd[1]: Starting udev Kernel Socket.
[    2.241710] systemd[1]: Listening on udev Kernel Socket.
[    2.243948] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    2.244012] systemd[1]: Starting udev Control Socket.
[    2.250310] systemd[1]: Listening on udev Control Socket.
[    2.251953] systemd[1]: Starting Journal Socket.
[    2.256295] systemd[1]: Listening on Journal Socket.
[    2.262789] systemd[1]: Started dracut cmdline hook.
[    2.267073] systemd[1]: Starting dracut pre-udev hook...
[    2.283437] systemd[1]: Started Load Kernel Modules.
[    2.287553] systemd[1]: Starting Sockets.
[    2.293206] systemd[1]: Reached target Sockets.
[    2.294746] systemd[1]: Starting Setup Virtual Console...
[    2.301740] systemd[1]: Starting Journal Service...
[    2.309201] systemd[1]: Started Journal Service.
[    2.311849] systemd[1]: Starting Swap.
[    2.317423] systemd-journald[107]: Vacuuming done, freed 0 bytes
[    2.325163] systemd[1]: Reached target Swap.
[    2.326747] systemd[1]: Starting Local File Systems.
[    2.353168] systemd[1]: Reached target Local File Systems.
[    2.357465] systemd[1]: Started dracut pre-udev hook.
[    2.361296] systemd[1]: Started Setup Virtual Console.
[    2.363513] systemd[1]: Starting udev Kernel Device Manager...
[    2.363817] usb 2-1: New USB device found, idVendor=8087, idProduct=0024
[    2.363818] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    2.364989] hub 2-1:1.0: USB hub found
[    2.365218] hub 2-1:1.0: 8 ports detected
[    2.384867] systemd-udevd[119]: starting version 204
[    2.439025] tsc: Refined TSC clocksource calibration: 3300.023 MHz
[    2.441922] udevadm (121) used greatest stack depth: 5256 bytes left
[    2.473980] usb 2-3: new high-speed USB device number 3 using ehci-pci
[    2.538549] [drm] Initialized drm 1.1.0 20060810
[    2.551314] ata_id (139) used greatest stack depth: 5024 bytes left
[    2.557114] scsi6 : ata_generic
[    2.559399] scsi7 : ata_generic
[    2.561956] ata7: PATA max UDMA/100 cmd 0xf130 ctl 0xf120 bmdma 0xf0f0 irq 18
[    2.564913] ata8: PATA max UDMA/100 cmd 0xf110 ctl 0xf100 bmdma 0xf0f8 irq 18
[    2.591693] usb 2-3: New USB device found, idVendor=8086, idProduct=002b
[    2.595384] usb 2-3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    2.598662] usb 2-3: Product: USBr Composite Device
[    2.600771] usb 2-3: Manufacturer: Intel
[    2.602857] usb 2-3: SerialNumber: 0001
[    2.606771] [drm:drm_pci_agp_init] *ERROR* Cannot initialize the agpgart module.
[    2.611955] input: Intel USBr Composite Device as /devices/pci0000:00/0000:00:1d.0/usb2/2-3/2-3:1.0/input/input4
[    2.616831] hid-generic 0003:8086:002B.0001: input,hidraw0: USB HID v1.10 Keyboard [Intel USBr Composite Device] on usb-0000:00:1d.0-3/input0
[    2.625851] input: Intel USBr Composite Device as /devices/pci0000:00/0000:00:1d.0/usb2/2-3/2-3:1.1/input/input5
[    2.630529] hid-generic 0003:8086:002B.0002: input,hidraw1: USB HID v1.10 Mouse [Intel USBr Composite Device] on usb-0000:00:1d.0-3/input1
[    2.737770] usb 3-2: new high-speed USB device number 2 using xhci_hcd
[    2.755793] usb 3-2: New USB device found, idVendor=0930, idProduct=6545
[    2.762418] usb 3-2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    2.765004] usb 3-2: Product: DataTraveler 2.0
[    2.770866] usb 3-2: Manufacturer: Kingston
[    2.772017] usb 3-2: SerialNumber: 001D92A5F5C45B891209007D
[    2.780379] usb-storage 3-2:1.0: USB Mass Storage device detected
[    2.797237] scsi8 : usb-storage 3-2:1.0
[    2.799220] usbcore: registered new interface driver usb-storage
[    3.440412] Switched to clocksource tsc
[    3.802149] scsi 8:0:0:0: Direct-Access     Kingston DataTraveler 2.0 PMAP PQ: 0 ANSI: 0 CCS
[    3.809193] sd 8:0:0:0: Attached scsi generic sg1 type 0
[    3.809229] sd 8:0:0:0: [sdb] 15874048 512-byte logical blocks: (8.12 GB/7.56 GiB)
[    3.809690] sd 8:0:0:0: [sdb] Write Protect is off
[    3.809692] sd 8:0:0:0: [sdb] Mode Sense: 23 00 00 00
[    3.810052] sd 8:0:0:0: [sdb] No Caching mode page found
[    3.810053] sd 8:0:0:0: [sdb] Assuming drive cache: write through
[    3.812628] sd 8:0:0:0: [sdb] No Caching mode page found
[    3.812629] sd 8:0:0:0: [sdb] Assuming drive cache: write through
[    3.815970]  sdb: sdb1
[    3.818235] sd 8:0:0:0: [sdb] No Caching mode page found
[    3.818236] sd 8:0:0:0: [sdb] Assuming drive cache: write through
[    3.818242] sd 8:0:0:0: [sdb] Attached SCSI removable disk
[    4.042611] EXT4-fs (sdb1): mounting ext2 file system using the ext4 subsystem
[    4.049323] EXT4-fs (sdb1): mounted filesystem without journal. Opts: (null)
[    4.052003] mount (174) used greatest stack depth: 4384 bytes left
[    4.141849] systemd-udevd (129) used greatest stack depth: 4320 bytes left
[    4.148883] systemd-udevd (120) used greatest stack depth: 4184 bytes left
[    4.201095] systemd-journald[107]: Received SIGTERM
[    5.261308] SELinux: 2048 avtab hash slots, 95699 rules.
[    5.708073] SELinux: 2048 avtab hash slots, 95699 rules.
[    8.843994] SELinux:  8 users, 82 roles, 4548 types, 259 bools, 1 sens, 1024 cats
[    8.843998] SELinux:  83 classes, 95699 rules
[    9.010838] SELinux:  Completing initialization.
[    9.010842] SELinux:  Setting up existing superblocks.
[    9.010947] SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts
[    9.011004] SELinux: initialized (dev rootfs, type rootfs), uses genfs_contexts
[    9.011071] SELinux: initialized (dev bdev, type bdev), uses genfs_contexts
[    9.011108] SELinux: initialized (dev proc, type proc), uses genfs_contexts
[    9.011228] SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
[    9.011323] SELinux: initialized (dev devtmpfs, type devtmpfs), uses transition SIDs
[    9.013373] SELinux: initialized (dev debugfs, type debugfs), uses genfs_contexts
[    9.019498] SELinux: initialized (dev sockfs, type sockfs), uses task SIDs
[    9.019538] SELinux: initialized (dev pipefs, type pipefs), uses task SIDs
[    9.019598] SELinux: initialized (dev anon_inodefs, type anon_inodefs), uses genfs_contexts
[    9.019637] SELinux: initialized (dev aio, type aio), not configured for labeling
[    9.019672] SELinux: initialized (dev devpts, type devpts), uses transition SIDs
[    9.019789] SELinux: initialized (dev hugetlbfs, type hugetlbfs), uses transition SIDs
[    9.019846] SELinux: initialized (dev mqueue, type mqueue), uses transition SIDs
[    9.019894] SELinux: initialized (dev selinuxfs, type selinuxfs), uses genfs_contexts
[    9.019971] SELinux: initialized (dev sysfs, type sysfs), uses genfs_contexts
[    9.022037] SELinux: initialized (dev securityfs, type securityfs), uses genfs_contexts
[    9.022051] SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
[    9.022067] SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
[    9.022256] SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
[    9.022379] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
[    9.022453] SELinux: initialized (dev pstore, type pstore), uses genfs_contexts
[    9.022468] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
[    9.022496] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
[    9.022624] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
[    9.022668] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
[    9.022686] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
[    9.022698] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
[    9.022712] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
[    9.022762] SELinux: initialized (dev cgroup, type cgroup), uses genfs_contexts
[    9.022816] SELinux: initialized (dev sdb1, type ext2), uses xattr
[    9.073301] type=1403 audit(1384684706.586:2): policy loaded auid=4294967295 ses=4294967295
[    9.101918] systemd[1]: Successfully loaded SELinux policy in 4.400935s.
[    9.276848] systemd[1]: Relabelled /dev and /run in 43.072ms.
[    9.335082] systemd-cryptse (195) used greatest stack depth: 3776 bytes left
[    9.705068] systemd-readahead[202]: Bumped block_nr parameter of 8:16 to 20480. This is a temporary hack and should be removed one day.
[    9.727259] SELinux: initialized (dev autofs, type autofs), uses genfs_contexts
[   10.274599] systemd-journald[210]: Vacuuming done, freed 0 bytes
[   10.583296] systemd-udevd[217]: starting version 204
[   10.696328] SELinux: initialized (dev configfs, type configfs), uses genfs_contexts
[   10.697850] SELinux: initialized (dev hugetlbfs, type hugetlbfs), uses transition SIDs
[   10.697905] SELinux: initialized (dev tmpfs, type tmpfs), uses transition SIDs
[   11.205746] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[   11.338216] EXT4-fs (sdb1): re-mounted. Opts: (null)
[   11.754340] microcode: CPU0 sig=0x206a7, pf=0x2, revision=0x28
[   11.764100] platform microcode: Direct firmware load failed with error -2
[   11.765957] i801_smbus 0000:00:1f.3: SMBus using PCI Interrupt
[   11.774505] platform microcode: Falling back to user helper
[   11.776479] microcode: CPU1 sig=0x206a7, pf=0x2, revision=0x28
[   11.785633] platform microcode: Direct firmware load failed with error -2
[   11.787909] platform microcode: Falling back to user helper
[   11.790280] microcode: CPU2 sig=0x206a7, pf=0x2, revision=0x28
[   11.793736] platform microcode: Direct firmware load failed with error -2
[   11.796077] platform microcode: Falling back to user helper
[   11.798390] microcode: CPU3 sig=0x206a7, pf=0x2, revision=0x28
[   11.800770] platform microcode: Direct firmware load failed with error -2
[   11.803190] platform microcode: Falling back to user helper
[   11.804983] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[   11.805003] SELinux: initialized (dev sda1, type ext4), uses xattr
[   11.814803] microcode: Microcode Update Driver: v2.00 <tigran.co.uk>, Peter Oruba
[   11.856351] systemd-journald[210]: Received request to flush runtime journal from PID 1
[   12.104297] r8169 Gigabit Ethernet driver 2.3LK-NAPI loaded
[   12.106802] r8169 0000:01:00.0: irq 51 for MSI/MSI-X
[   12.108674] r8169 0000:01:00.0 eth0: RTL8168b/8111b at 0xffffc90000676000, 90:f6:52:05:e5:9f, XID 18000000 IRQ 51
[   12.111080] r8169 0000:01:00.0 eth0: jumbo features [frames: 4080 bytes, tx checksumming: ko]
[   12.241202] systemd-journald[210]: File /var/log/journal/61d527d8390a4ff2b988e35059961b70/system.journal corrupted or uncleanly shut down, renaming and replacing.
[   12.250646] iTCO_vendor_support: vendor-support=0
[   12.267976] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.10
[   12.271853] iTCO_wdt: Found a Cougar Point TCO device (Version=2, TCOBASE=0x0460)
[   12.275867] iTCO_wdt: initialized. heartbeat=45 sec (nowayout=0)
[   13.109850] alg: No test for crc32 (crc32-pclmul)
[   13.115040] mei_me 0000:00:16.0: irq 52 for MSI/MSI-X
[   14.153710] type=1305 audit(1384684711.672:3): audit_pid=267 old=0 auid=4294967295 ses=4294967295
 subj=system_u:system_r:auditd_t:s0 res=1
[   14.353883] systemd-udevd[231]: renamed network interface eth0 to p1p1
[   14.842571] systemd-logind[334]: Watching system buttons on /dev/input/event0 (Power Button)
[   14.866800] ip6_tables: (C) 2000-2006 Netfilter Core Team
[   15.048109] w83627ehf: Found NCT6775F chip at 0x290
[   15.950025] snd_hda_intel 0000:00:1b.0: irq 53 for MSI/MSI-X
[   16.215752] e1000e: module verification failed: signature and/or  required key missing - tainting kernel
[   16.221014] e1000e: Intel(R) PRO/1000 Network Driver - 2.5.4-NAPI
[   16.222810] e1000e: Copyright(c) 1999 - 2013 Intel Corporation.
[   16.361067] ALSA sound/pci/hda/patch_realtek.c:419 SKU: Nid=0x1d sku_cfg=0x4004c601
[   16.361070] ALSA sound/pci/hda/patch_realtek.c:421 SKU: port_connectivity=0x1
[   16.361071] ALSA sound/pci/hda/patch_realtek.c:422 SKU: enable_pcbeep=0x0
[   16.361072] ALSA sound/pci/hda/patch_realtek.c:423 SKU: check_sum=0x00000004
[   16.361073] ALSA sound/pci/hda/patch_realtek.c:424 SKU: customization=0x000000c6
[   16.361074] ALSA sound/pci/hda/patch_realtek.c:425 SKU: external_amp=0x0
[   16.361076] ALSA sound/pci/hda/patch_realtek.c:426 SKU: platform_type=0x0
[   16.361077] ALSA sound/pci/hda/patch_realtek.c:427 SKU: swap=0x0
[   16.361078] ALSA sound/pci/hda/patch_realtek.c:428 SKU: override=0x1
[   16.361444] ALSA sound/pci/hda/hda_auto_parser.c:393 autoconfig: line_outs=1 (0x14/0x0/0x0/0x0/0x0) type:line
[   16.361446] ALSA sound/pci/hda/hda_auto_parser.c:397    speaker_outs=1 (0x17/0x0/0x0/0x0/0x0)
[   16.361449] ALSA sound/pci/hda/hda_auto_parser.c:401    hp_outs=1 (0x1b/0x0/0x0/0x0/0x0)
[   16.361451] ALSA sound/pci/hda/hda_auto_parser.c:402    mono: mono_out=0x0
[   16.361453] ALSA sound/pci/hda/hda_auto_parser.c:405    dig-out=0x1e/0x0
[   16.361455] ALSA sound/pci/hda/hda_auto_parser.c:406    inputs:
[   16.361460] ALSA sound/pci/hda/hda_auto_parser.c:410      Front Mic=0x19
[   16.361463] ALSA sound/pci/hda/hda_auto_parser.c:410      Rear Mic=0x18
[   16.361466] ALSA sound/pci/hda/hda_auto_parser.c:410      Line=0x1a
[   16.361469] ALSA sound/pci/hda/patch_realtek.c:491 realtek: No valid SSID, checking pincfg 0x4004c601 for NID 0x1d
[   16.361471] ALSA sound/pci/hda/patch_realtek.c:507 realtek: Enabling init ASM_ID=0xc601 CODEC_ID=10ec0888
[   16.381529] nf_conntrack version 0.5.0 (16384 buckets, 65536 max)
[   16.429259] input: HDA Intel PCH HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:1b.0/sound/card0/input11
[   16.434801] input: HDA Intel PCH Front Headphone as /devices/pci0000:00/0000:00:1b.0/sound/card0/input10
[   16.439827] input: HDA Intel PCH Line Out as /devices/pci0000:00/0000:00:1b.0/sound/card0/input9
[   16.444336] input: HDA Intel PCH Line as /devices/pci0000:00/0000:00:1b.0/sound/card0/input8
[   16.448376] input: HDA Intel PCH Rear Mic as /devices/pci0000:00/0000:00:1b.0/sound/card0/input7
[   16.452241] input: HDA Intel PCH Front Mic as /devices/pci0000:00/0000:00:1b.0/sound/card0/input6
[   16.470335] e1000e 0000:00:19.0: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode
[   16.478949] e1000e 0000:00:19.0: irq 54 for MSI/MSI-X
[   16.479850] e1000e 0000:00:19.0 (unregistered net_device): Reset blocked by ME
[   16.489339] e1000e 0000:00:19.0: PHY reset is blocked due to SOL/IDER session.
[   16.582117] e1000e 0000:00:19.0 eth0: (PCI Express:2.5GT/s:Width x1) 00:22:4d:51:a6:23
[   16.584858] e1000e 0000:00:19.0 eth0: Intel(R) PRO/1000 Network Connection
[   16.587368] e1000e 0000:00:19.0 eth0: MAC: 10, PHY: 11, PBA No: FFFFFF-0FF
[   16.608590] systemd-udevd[228]: renamed network interface eth0 to em1
[   16.909753] Netfilter messages via NETLINK v0.30.
[   19.359363] e1000e 0000:00:19.0 em1: changing MTU from 1500 to 9000
[   19.361418] e1000e 0000:00:19.0: Interrupt Throttle Rate off
[   19.543611] e1000e 0000:00:19.0: irq 54 for MSI/MSI-X
[   19.644623] e1000e 0000:00:19.0: irq 54 for MSI/MSI-X
[   19.645580] IPv6: ADDRCONF(NETDEV_UP): em1: link is not ready
[   19.651073] e1000e: em1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None
[   19.654143] IPv6: ADDRCONF(NETDEV_CHANGE): em1: link becomes ready
[   21.529806] systemd-udevd (238) used greatest stack depth: 3696 bytes left
[   22.407904] r8169 0000:01:00.0 p1p1: link down
[   22.410414] IPv6: ADDRCONF(NETDEV_UP): p1p1: link is not ready
[   23.007452] 8021q: 802.1Q VLAN Support v1.8
[   23.062758] IPv6: ADDRCONF(NETDEV_UP): vlan100: link is not ready
[   24.949207] r8169 0000:01:00.0 p1p1: link up
[   24.954489] IPv6: ADDRCONF(NETDEV_CHANGE): p1p1: link becomes ready
[   24.962013] IPv6: ADDRCONF(NETDEV_CHANGE): vlan100: link becomes ready
[   54.514369] systemd-readahe (201) used greatest stack depth: 3120 bytes left
[   83.501105] systemd-journald[210]: File /var/log/journal/61d527d8390a4ff2b988e35059961b70/user-1000.journal corrupted or uncleanly shut down, renaming and replacing.
[  112.240999] PPP generic driver version 2.4.2
[  112.272785] NET: Registered protocol family 24


Regards,

H.

Comment 7 Michele Baldessari 2013-11-17 13:54:22 UTC
Hi Hrvoje,

perfect thanks. In order to make sure that we narrow the cause, I've built a 3.11.8 fc19 kernel with the two commits mentioned in c#5 (I had to make some
changes as it would not apply cleanly). Could you please give 
it a test and confirm that the issue is still not present?

If you'll confirm then we know that the two commits (or one of them) fixes the
issue and I'll discuss with upstream if we can bring it to stable.

You can find the whole thing here:
http://acksyn.org/files/tmp/bz1015905/

Thanks,
Michele

Comment 8 George Joseph 2013-11-17 15:06:48 UTC
Hi Michele,

As a baseline, I made sure the bug was reproducable in 3.11.7-200, which it is.
I can also confirm that the problem is fixed in your 3.11.8-200 build.

Thanks for tracking this down!

Comment 9 Hrvoje 2013-11-17 18:59:11 UTC
Hi Michele.

I can also confirm that this kernel fixes issue for me. No more kernel panic, and packet-to-big is correctly returned.

Please notify us when this enters regular F19 kernel.

Thank you.

Regards,

H.

Comment 10 Michele Baldessari 2013-11-17 19:42:18 UTC
Hi Georhe and Hrvoje,

thanks for testing. Just so I can make sure which is the single patch
fixing your scenario and propose it for stable, can you please let me know
which of the two following kernels works and which one does not work?

http://acksyn.org/files/tmp/1/
and
http://acksyn.org/files/tmp/2/

Once I know which of the two patches fixes this scenario I can proceed.

Thanks again,
Michele

Comment 11 George Joseph 2013-11-18 06:12:44 UTC
Version 1 didn't fix the problem but version 2 did.

Comment 12 Michele Baldessari 2013-11-18 09:22:00 UTC
Thanks a lot George, much appreciated.

I've asked for -stable inclusion.

I'll keep you posted here once it trickles down.

Fedora kernel folks, if you want to include the 3.11.x patch before that,
I've put it here:
http://acksyn.org/files/patches/0002-netfilter-push-reasm-skb-through-instead-of-original.patch

regards,
MIchele

Comment 13 Michele Baldessari 2013-11-18 11:40:38 UTC
Discussed this more upstream and it makes more sense to have both patches in:
9037c3579a277f3a23ba476664629fda8c35f7c4 "ip6_output: fragment outgoing reassembled skb properly"
6aafeef03b9d9ecf255f3a80ed85ee070260e1ae "netfilter: push reasm skb through instead of original frag skbs"

The first one applies cleanly to 3.11.x the second one needs a bit of massaging (see c#12)

Comment 14 Josh Boyer 2013-11-18 15:51:44 UTC
Thanks Michele!  Much appreciated.  Added to git.

Comment 15 Fedora Update System 2013-11-21 14:45:44 UTC
kernel-3.11.9-300.fc20 has been submitted as an update for Fedora 20.
https://admin.fedoraproject.org/updates/kernel-3.11.9-300.fc20

Comment 16 Fedora Update System 2013-11-21 14:48:46 UTC
kernel-3.11.9-200.fc19 has been submitted as an update for Fedora 19.
https://admin.fedoraproject.org/updates/kernel-3.11.9-200.fc19

Comment 17 Fedora Update System 2013-11-21 14:54:08 UTC
kernel-3.11.9-100.fc18 has been submitted as an update for Fedora 18.
https://admin.fedoraproject.org/updates/kernel-3.11.9-100.fc18

Comment 18 Hrvoje 2013-11-23 19:38:53 UTC
Hi.

I can confirm that kernel-3.11.9-200.fc19 works for me.

Thank you.

Regards,

H.

Comment 19 Fedora Update System 2013-11-23 19:41:25 UTC
Package kernel-3.11.9-100.fc18:
* should fix your issue,
* was pushed to the Fedora 18 testing repository,
* should be available at your local mirror within two days.
Update it with:
# su -c 'yum update --enablerepo=updates-testing kernel-3.11.9-100.fc18'
as soon as you are able to, then reboot.
Please go to the following url:
https://admin.fedoraproject.org/updates/FEDORA-2013-21822/kernel-3.11.9-100.fc18
then log in and leave karma (feedback).

Comment 20 Fedora Update System 2013-11-24 03:48:22 UTC
kernel-3.11.9-200.fc19 has been pushed to the Fedora 19 stable repository.  If problems still persist, please make note of it in this bug report.

Comment 21 Fedora Update System 2013-11-24 23:47:17 UTC
kernel-3.11.9-300.fc20 has been pushed to the Fedora 20 stable repository.  If problems still persist, please make note of it in this bug report.

Comment 22 Fedora Update System 2013-11-29 06:55:09 UTC
kernel-3.11.9-100.fc18 has been pushed to the Fedora 18 stable repository.  If problems still persist, please make note of it in this bug report.


Note You need to log in before you can comment on or make changes to this bug.