1091830 – host core dump after local migration

RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.

Bug 1091830 - host core dump after local migration

Summary: host core dump after local migration

Keywords:
Status:	CLOSED CURRENTRELEASE
Alias:	None
Product:	Red Hat Enterprise Linux 7
Classification:	Red Hat
Component:	qemu-kvm
Sub Component:
Version:	7.0
Hardware:	x86_64
OS:	Linux
Priority:	high
Severity:	medium
Target Milestone:	rc
Target Release:	---
Assignee:	Juan Quintela
QA Contact:	xianwang
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2014-04-28 07:18 UTC by Jun Li
Modified:	2017-08-21 17:36 UTC (History)
CC List:	8 users (show)
Fixed In Version:
Doc Type:	Enhancement
Doc Text:
Clone Of:
Environment:
Last Closed:	2017-08-21 17:36:56 UTC
Target Upstream Version:
Embargoed:

Attachments	(Terms of Use)

Description Jun Li 2014-04-28 07:18:45 UTC

Description of problem:
boot rhel7 guest via qemu-kvm, and do some consume memory operation inside guest. And then change floppy, and do local migration. After migration, host core dump and reboot.
QE only hit this issue once. 

Version-Release number of selected component (if applicable):
qemu-kvm-rhev-1.5.3-60.el7ev.x86_64
3.10.0-121.el7.x86_64

How reproducible:
once.

Steps to Reproduce:
1.boot rhel7 guest and do some consume memory operation(such as run iozone) inside guest. 
2.change floppy.
3.do local migration.

Actual results:
host core dump and reboot automatic.
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.10.0-121.el7.x86_64 (mockbuild.eng.bos.redhat.com) (gcc version 4.8.2 20140120 (Red Hat 4.8.2-16) (GCC) ) #1 SMP Tue Apr 8 10:48:19 EDT 2014
[    0.000000] Command line: BOOT_IMAGE=/vmlinuz-3.10.0-121.el7.x86_64 root=UUID=fd2cbf41-6c1b-4845-bd95-f2b3b869c46b ro console=tty0 vconsole.keymap=us reboot=pci console=ttyS0,115200 vconsole.font=latarcyrheb-sun16 rd.lvm.lv=rhel_dell-per415-02/root rd.lvm.lv=rhel_dell-per415-02/swap biosdevname=0 crashkernel=256M LANG=en_US.UTF-8
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bf698fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bf699000-0x00000000bf6aefff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000bf6af000-0x00000000bf6cdfff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bf6ce000-0x00000000bfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000f0000000-0x00000000f3ffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fe000000-0x00000000fec8ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec94000-0x00000000feccffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fecd4000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083effffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.6 present.
[    0.000000] DMI: Dell Inc. PowerEdge R415/0YFWR8, BIOS 1.9.3 04/26/2012
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] No AGP bridge found
[    0.000000] e820: last_pfn = 0x83f000 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: uncachable
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-C7FFF write-protect
[    0.000000]   C8000-CFFFF uncachable
[    0.000000]   D0000-D3FFF write-protect
[    0.000000]   D4000-EBFFF uncachable
[    0.000000]   EC000-EFFFF write-back
[    0.000000]   F0000-FFFFF write-protect
...
[188774.829133] Out of memory: Kill process 25395 (qemu-kvm) score 62 or sacrifice child
[188774.829135] Killed process 25395 (qemu-kvm) total-vm:5130720kB, anon-rss:3142160kB, file-rss:7056kB
[188774.833076] swap_free: Bad swap offset entry 40000001920770
[188774.833077] BUG: Bad page map in process qemu-kvm  pte:80000003240ee000 pmd:345c91067
[188774.833079] addr:00007f78f9a00000 vm_flags:00100073 anon_vma:ffff880429334900 mapping:          (null) index:7f78f9a00
[188774.833081] CPU: 3 PID: 25395 Comm: qemu-kvm Not tainted 3.10.0-121.el7.x86_64 #1
[188774.833081] Hardware name: Dell Inc. PowerEdge R415/0YFWR8, BIOS 1.9.3 04/26/2012
[188774.833086]  00007f78f9a00000 000000002a625e92 ffff88080e91ba78 ffffffff815ec0ba
[188774.833088]  ffff88080e91bac0 ffffffff81167f58 80000003240ee000 00000007f78f9a00
[188774.833090]  ffff880345c91000 80000003240ee000 00007f78f9a00000 00007f78f9c00000
[188774.833091] Call Trace:
[188774.833096]  [<ffffffff815ec0ba>] dump_stack+0x19/0x1b
[188774.833100]  [<ffffffff81167f58>] print_bad_pte+0x1a8/0x240
[188774.833102]  [<ffffffff811698c0>] unmap_page_range+0x5b0/0x860
[188774.833105]  [<ffffffff81169bf1>] unmap_single_vma+0x81/0xf0
[188774.833107]  [<ffffffff8116acb9>] unmap_vmas+0x49/0x90
[188774.833109]  [<ffffffff8117396c>] exit_mmap+0xac/0x1a0
[188774.833111]  [<ffffffff811031c3>] ? __delayacct_add_tsk+0x173/0x1a0
[188774.833115]  [<ffffffff8105b187>] mmput+0x67/0xf0
[188774.833117]  [<ffffffff81063dac>] do_exit+0x28c/0xa60
[188774.833119]  [<ffffffff815ef8be>] ? schedule_timeout_killable+0x1e/0x20
[188774.833121]  [<ffffffff810645ff>] do_group_exit+0x3f/0xa0
[188774.833123]  [<ffffffff81074000>] get_signal_to_deliver+0x1d0/0x6e0
[188774.833127]  [<ffffffff81012437>] do_signal+0x57/0x600
[188774.833129]  [<ffffffff811c2e65>] ? do_vfs_ioctl+0x2e5/0x4c0
[188774.833131]  [<ffffffff8125796e>] ? file_has_perm+0xae/0xc0
[188774.833134]  [<ffffffff81012a49>] do_notify_resume+0x69/0xb0
[188774.833136]  [<ffffffff815f3cbc>] retint_signal+0x48/0x8c
[188774.833138] Disabling lock debugging due to kernel taint
[188781.001680] BUG: Bad rss-counter state mm:ffff880826d7ea40 idx:1 val:1
[188781.009483] BUG: Bad rss-counter state mm:ffff880826d7ea40 idx:2 val:-1
[188782.743839] SELinux: initialized (dev binfmt_misc, type binfmt_misc), uses genfs_contexts
[188789.533302] xor: automatically using best checksumming function:
[188789.549836]    avx       : 10104.000 MB/sec
[188789.584806] raid6: sse2x1    3992 MB/s
[188789.605782] raid6: sse2x2    7386 MB/s
[188789.626766] raid6: sse2x4    8621 MB/s
[188789.631584] raid6: using algorithm sse2x4 (8621 MB/s)
[188789.637706] raid6: using ssse3x2 recovery algorithm
[188789.699514] bio: create slab <bio-0> at 0
[188789.705296] Btrfs loaded
[188789.728566] fuse init (API version 7.22)
[188791.549192] XFS (sdf1): Mounting Filesystem
[188791.886777] XFS (sdf1): Ending clean mount
[188791.892016] SELinux: initialized (dev sdf1, type xfs), uses xattr
[188792.173365] XFS (dm-4): Mounting Filesystem
[188792.333283] XFS (dm-4): recovery required on read-only device.
[188792.340260] XFS (dm-4): write access unavailable, cannot proceed.
[188792.347465] XFS (dm-4): log mount/recovery failed: error 30
[188792.354193] XFS (dm-4): log mount failed
[188796.495895] nr_pdflush_threads exported in /proc is scheduled for removal
[188796.504017] sysctl: The scan_unevictable_pages sysctl/node-interface has been disabled for lack of a legitimate use case.  If you have one, please send an email to linux-mm.
[188828.929124] XFS (sdf1): Mounting Filesystem
[188829.232815] XFS (sdf1): Ending clean mount
[188829.238023] SELinux: initialized (dev sdf1, type xfs), uses xattr
[188829.505730] XFS (dm-4): Mounting Filesystem
[188829.537176] XFS (dm-4): recovery required on read-only device.
[188829.544072] XFS (dm-4): write access unavailable, cannot proceed.
[188829.551197] XFS (dm-4): log mount/recovery failed: error 30
[188829.557845] XFS (dm-4): log mount failed
[193584.599920] device tap0 entered promiscuous mode
[193584.605903] switch: port 2(tap0) entered forwarding state
[193584.612334] switch: port 2(tap0) entered forwarding state
[195115.485086] kvm: zapping shadow pages for mmio generation wraparound
[195865.104680] device tap0 left promiscuous mode
[195865.110142] switch: port 2(tap0) entered disabled state
[196084.887838] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196085.766659] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196087.988673] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196337.521917] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196355.184571] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196356.207197] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196356.734646] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196357.134404] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196357.565984] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196358.269224] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196358.940607] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196360.203448] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196360.698828] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196361.306271] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196361.961706] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196362.380660] qemu-kvm invoked oom-killer: gfp_mask=0x0, order=0, oom_score_adj=0
[196362.388915] qemu-kvm cpuset=/ mems_allowed=0-1
[196362.394273] CPU: 10 PID: 28042 Comm: qemu-kvm Tainted: G    B       --------------   3.10.0-121.el7.x86_64 #1
[196362.405130] Hardware name: Dell Inc. PowerEdge R415/0YFWR8, BIOS 1.9.3 04/26/2012
[196362.413579]  ffff8808222971c0 00000000aab1d46c ffff880813fc3c38 ffffffff815ec0ba
[196362.422008]  ffff880813fc3cc8 ffffffff815e772d ffff880813fc3c80 0000000000000297
[196362.430440]  ffffffff13fc3d18 fffeefff00000000 0000000000000001 0000000000000003
[196362.438887] Call Trace:
[196362.442334]  [<ffffffff815ec0ba>] dump_stack+0x19/0x1b
[196362.448475]  [<ffffffff815e772d>] dump_header+0x8e/0x214
[196362.454786]  [<ffffffff8114520e>] oom_kill_process+0x24e/0x3b0
[196362.461625]  [<ffffffff81145a36>] out_of_memory+0x4b6/0x4f0
[196362.468202]  [<ffffffff81145acb>] pagefault_out_of_memory+0x5b/0x70
[196362.475482]  [<ffffffff815e594d>] mm_fault_error+0x9e/0x185
[196362.482059]  [<ffffffff815f7bc9>] __do_page_fault+0x499/0x540
[196362.488809]  [<ffffffff810c297e>] ? do_futex+0xfe/0x5e0
[196362.495033]  [<ffffffff815f7c8a>] do_page_fault+0x1a/0x70
[196362.501416]  [<ffffffff815f3ec8>] page_fault+0x28/0x30
[196362.507507] Mem-Info:
[196362.510692] Node 0 DMA per-cpu:
[196362.514741] CPU    0: hi:    0, btch:   1 usd:   0
[196362.520546] CPU    1: hi:    0, btch:   1 usd:   0
[196362.526245] CPU    2: hi:    0, btch:   1 usd:   0
[196362.531925] CPU    3: hi:    0, btch:   1 usd:   0
[196362.537583] CPU    4: hi:    0, btch:   1 usd:   0
[196362.543220] CPU    5: hi:    0, btch:   1 usd:   0
[196362.548844] CPU    6: hi:    0, btch:   1 usd:   0
[196362.554455] CPU    7: hi:    0, btch:   1 usd:   0
[196362.560046] CPU    8: hi:    0, btch:   1 usd:   0
[196362.565658] CPU    9: hi:    0, btch:   1 usd:   0
[196362.571225] CPU   10: hi:    0, btch:   1 usd:   0
[196362.576766] CPU   11: hi:    0, btch:   1 usd:   0
[196362.582291] CPU   12: hi:    0, btch:   1 usd:   0
[196362.587787] CPU   13: hi:    0, btch:   1 usd:   0
[196362.593282] CPU   14: hi:    0, btch:   1 usd:   0
[196362.598780] CPU   15: hi:    0, btch:   1 usd:   0
[196362.604273] Node 0 DMA32 per-cpu:
[196362.608313] CPU    0: hi:  186, btch:  31 usd:   0
[196362.613836] CPU    1: hi:  186, btch:  31 usd:   0
[196362.619355] CPU    2: hi:  186, btch:  31 usd:   0
[196362.624873] CPU    3: hi:  186, btch:  31 usd:   1
[196362.630396] CPU    4: hi:  186, btch:  31 usd:   0
[196362.635918] CPU    5: hi:  186, btch:  31 usd:   0
[196362.641438] CPU    6: hi:  186, btch:  31 usd:   0
[196362.647043] CPU    7: hi:  186, btch:  31 usd:   0
[196362.652645] CPU    8: hi:  186, btch:  31 usd:   0
[196362.658242] CPU    9: hi:  186, btch:  31 usd:   0
[196362.663840] CPU   10: hi:  186, btch:  31 usd:   0
[196362.669403] CPU   11: hi:  186, btch:  31 usd:   0
[196362.674946] CPU   12: hi:  186, btch:  31 usd:   6
[196362.680446] CPU   13: hi:  186, btch:  31 usd:   0
[196362.685908] CPU   14: hi:  186, btch:  31 usd:   0
[196362.691338] CPU   15: hi:  186, btch:  31 usd:   0
[196362.696745] Node 0 Normal per-cpu:
[196362.700782] CPU    0: hi:  186, btch:  31 usd:  61
[196362.706169] CPU    1: hi:  186, btch:  31 usd:  34
[196362.711537] CPU    2: hi:  186, btch:  31 usd:  58
[196362.716908] CPU    3: hi:  186, btch:  31 usd: 164
[196362.722265] CPU    4: hi:  186, btch:  31 usd:   0
[196362.727603] CPU    5: hi:  186, btch:  31 usd:   0
[196362.732928] CPU    6: hi:  186, btch:  31 usd:  30
[196362.738231] CPU    7: hi:  186, btch:  31 usd:   0
[196362.743528] CPU    8: hi:  186, btch:  31 usd:   0
[196362.748812] CPU    9: hi:  186, btch:  31 usd:   0
[196362.754088] CPU   10: hi:  186, btch:  31 usd:  12
[196362.759340] CPU   11: hi:  186, btch:  31 usd:   1
[196362.764580] CPU   12: hi:  186, btch:  31 usd:   1
[196362.769816] CPU   13: hi:  186, btch:  31 usd:   0
[196362.775032] CPU   14: hi:  186, btch:  31 usd:   0
[196362.780209] CPU   15: hi:  186, btch:  31 usd:   0
[196362.785431] Node 1 Normal per-cpu:
[196362.789248] CPU    0: hi:  186, btch:  31 usd:   7
[196362.794448] CPU    1: hi:  186, btch:  31 usd:   2
[196362.799656] CPU    2: hi:  186, btch:  31 usd:   2
[196362.804860] CPU    3: hi:  186, btch:  31 usd:  46
[196362.810061] CPU    4: hi:  186, btch:  31 usd:   2
[196362.815274] CPU    5: hi:  186, btch:  31 usd:   0
[196362.820479] CPU    6: hi:  186, btch:  31 usd:   0
[196362.825681] CPU    7: hi:  186, btch:  31 usd:   6
[196362.830900] CPU    8: hi:  186, btch:  31 usd:  60
[196362.836106] CPU    9: hi:  186, btch:  31 usd:   0
[196362.841312] CPU   10: hi:  186, btch:  31 usd:  19
[196362.846536] CPU   11: hi:  186, btch:  31 usd:  54
[196362.851748] CPU   12: hi:  186, btch:  31 usd:  58
[196362.856943] CPU   13: hi:  186, btch:  31 usd:   0
[196362.862146] CPU   14: hi:  186, btch:  31 usd:  36
[196362.867339] CPU   15: hi:  186, btch:  31 usd:   0
[196362.872527] active_anon:785356 inactive_anon:22992 isolated_anon:32\x0a active_file:3817574 inactive_file:1845292 isolated_file:0\x0a unevictable:1100 dirty:0 writeback:0 unstable:0\x0a free:1198914 slab_reclaimable:123016 slab_unreclaimable:19797\x0a mapped:9979 shmem:4284 pagetables:3476 bounce:0\x0a free_cma:0
[196362.908675] Node 0 DMA free:15888kB min:40kB low:48kB high:60kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15988kB managed:15904kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[196362.950031] lowmem_reserve[]: 0 2637 15689 15689
[196362.955448] Node 0 DMA32 free:401040kB min:7468kB low:9332kB high:11200kB active_anon:345524kB inactive_anon:10540kB active_file:1198480kB inactive_file:525160kB unevictable:168kB isolated(anon):0kB isolated(file):0kB present:3119716kB managed:2700708kB mlocked:168kB dirty:0kB writeback:0kB mapped:4568kB shmem:1396kB slab_reclaimable:38992kB slab_unreclaimable:5296kB kernel_stack:96kB pagetables:1400kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[196363.002352] lowmem_reserve[]: 0 0 13051 13051
[196363.007723] Node 0 Normal free:2174972kB min:36968kB low:46208kB high:55452kB active_anon:1078596kB inactive_anon:44668kB active_file:6028224kB inactive_file:2801096kB unevictable:1064kB isolated(anon):0kB isolated(file):0kB present:13631488kB managed:13365168kB mlocked:1076kB dirty:0kB writeback:0kB mapped:18952kB shmem:7328kB slab_reclaimable:202788kB slab_unreclaimable:29624kB kernel_stack:2576kB pagetables:5832kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[196363.057907] lowmem_reserve[]: 0 0 0 0
[196363.062834] Node 1 Normal free:2203756kB min:45624kB low:57028kB high:68436kB active_anon:1717304kB inactive_anon:36760kB active_file:8043592kB inactive_file:4054912kB unevictable:3168kB isolated(anon):128kB isolated(file):0kB present:16760832kB managed:16494272kB mlocked:3168kB dirty:0kB writeback:0kB mapped:16396kB shmem:8412kB slab_reclaimable:250284kB slab_unreclaimable:44252kB kernel_stack:1280kB pagetables:6672kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[196363.096821] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196363.122597] lowmem_reserve[]: 0 0 0 0
[196363.127850] Node 0 DMA: 0*4kB 0*8kB 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (R) 3*4096kB (M) = 15888kB
[196363.144224] Node 0 DMA32: 591*4kB (UEM) 486*8kB (UEM) 269*16kB (UEM) 241*32kB (UEM) 218*64kB (UEM) 164*128kB (UEM) 149*256kB (UEM) 323*512kB (UEM) 141*1024kB (UM) 0*2048kB 0*4096kB = 401116kB
[196363.164817] Node 0 Normal: 1593*4kB (UEM) 1854*8kB (UEM) 1050*16kB (UEM) 3469*32kB (UEM) 3101*64kB (UEM) 1659*128kB (UEM) 1259*256kB (UEM) 1391*512kB (UEM) 567*1024kB (UEM) 0*2048kB 0*4096kB = 2174932kB
[196363.186539] Node 1 Normal: 4042*4kB (UEM) 6049*8kB (UEM) 4986*16kB (UEM) 4521*32kB (UEM) 2964*64kB (UEM) 1613*128kB (UEM) 988*256kB (UEM) 758*512kB (UEM) 857*1024kB (UM) 0*2048kB 0*4096kB = 2203760kB
[196363.208229] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[196363.218588] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[196363.228947] 5667866 total pagecache pages
[196363.234900] 3 pages in swap cache
[196363.240167] Swap cache stats: add 20, delete 17, find 5/8
[196363.247541] Free swap  = 16457696kB
[196363.253016] Total swap = 16457724kB
[196363.387325] 8384511 pages RAM
[196363.387326] 237292 pages reserved
[196363.387326] 6391997 pages shared
[196363.387327] 4244814 pages non-shared
[196363.387328] [ pid ]   uid  tgid total_vm      rss nr_ptes swapents oom_score_adj name
[196363.387360] [  900]     0   900    16090     3490      32        0             0 systemd-journal
[196363.387362] [  922]     0   922    26806     1067      23        0             0 lvmetad
[196363.387365] [  932]     0   932    10710      700      23        0         -1000 systemd-udevd
[196363.387371] [ 1323]     0  1323    12784      398      26        0         -1000 auditd
[196363.387374] [ 1350]     0  1350   113524     2324      73        0             0 NetworkManager
[196363.387376] [ 1353]    70  1353     7538      427      22        0             0 avahi-daemon
[196363.387378] [ 1354]   998  1354     1084       92       8        0             0 lsmd
[196363.387380] [ 1355]     0  1355    53064     1355      58        0             0 abrtd
[196363.387382] [ 1357]     0  1357    52445     1107      54        0             0 abrt-watch-log
[196363.387384] [ 1363]    70  1363     7507      111      19        0             0 avahi-daemon
[196363.387386] [ 1372]     0  1372     4800      307      13        0             0 irqbalance
[196363.387388] [ 1375]     0  1375    32512      556      19        0             0 smartd
[196363.387390] [ 1376]     0  1376   137501     4546      92        0             0 tuned
[196363.387392] [ 1379]     0  1379     8671      435      22        0             0 systemd-logind
[196363.387394] [ 1380]    81  1380     9253      486      19        0          -900 dbus-daemon
[196363.387396] [ 1383]   997  1383     5667      343      16        0             0 chronyd
[196363.387398] [ 1410]   999  1410   129018     2392      50        0             0 polkitd
[196363.387400] [ 1502]     0  1502    25578     3916      50        0             0 dhclient
[196363.387403] [ 1765]    32  1765     9975      313      23        0             0 rpcbind
[196363.387405] [ 1771]     0  1771    28320      186      13        0             0 rhsmcertd
[196363.387407] [ 1790]    29  1790    11639      458      27        0             0 rpc.statd
[196363.387410] [ 1835]     0  1835    20739      898      43        0         -1000 sshd
[196363.387412] [ 1850]     0  1850     1621       84       9        0             0 iprinit
[196363.387414] [ 1851]     0  1851     1621       84       9        0             0 iprupdate
[196363.387416] [ 1891]     0  1891    31583      431      18        0             0 crond
[196363.387418] [ 1895]     0  1895     6482      240      18        0             0 atd
[196363.387420] [ 1897]     0  1897     9781       79       9        0             0 iprdump
[196363.387422] [ 2319]     0  2319    23446      561      44        0             0 master
[196363.387424] [ 2324]    89  2324    23516     1038      44        0             0 qmgr
[196363.387426] [10025]     0 10025    11202      263      25        0             0 rpc.mountd
[196363.387430] [10048]     0 10048     5337      166      15        0             0 rpc.idmapd
[196363.387432] [10049]     0 10049    28571       39       8        0             0 rpc.rquotad
[196363.387433] [10101]     0 10101    54045     1869      37        0             0 rsyslogd
[196363.387435] [10191]     0 10191   134349     1858      49        0             0 STAFProc
[196363.387437] [10222]     0 10222    27501      213      14        0             0 agetty
[196363.387439] [10223]     0 10223    27500      207      11        0             0 agetty
[196363.387441] [40302]     0 40302    33920     1249      69        0             0 sshd
[196363.387442] [40306]     0 40306    29165      887      15        0             0 bash
[196363.387445] [41817]     0 41817    33953     1247      69        0             0 sshd
[196363.387447] [41821]     0 41821    29193      896      15        0             0 bash
[196363.387449] [42689]     0 42689    33953     1251      68        0             0 sshd
[196363.387451] [42693]     0 42693    29137      849      16        0             0 bash
[196363.387453] [42750]     0 42750    33953     1251      70        0             0 sshd
[196363.387454] [42754]     0 42754    29137      852      17        0             0 bash
[196363.387456] [42815]     0 42815    33920     1251      70        0             0 sshd
[196363.387458] [42819]     0 42819    29137      851      16        0             0 bash
[196363.387460] [22424]     0 22424     3458      126      12        0             0 iscsid
[196363.387462] [22425]     0 22425     4186     1121      13        0           -17 iscsid
[196363.387465] [22789]     0 22789    33953     1248      72        0             0 sshd
[196363.387467] [22793]     0 22793    29135      856      16        0             0 bash
[196363.387469] [24526]     0 24526    27562      236      13        0             0 less
[196363.387472] [24764]     0 24764    33920     1249      68        0             0 sshd
[196363.387474] [24769]     0 24769    29137      847      15        0             0 bash
[196363.387477] [27798]    89 27798    23472      978      47        0             0 pickup
[196363.387480] [27928]     0 27928  1536771   784273    1681        0             0 qemu-kvm
[196363.387482] [27940]     0 27940    11410      591      27        0             0 nc
[196363.387483] Out of memory: Kill process 27928 (qemu-kvm) score 62 or sacrifice child
[196363.387486] Killed process 27928 (qemu-kvm) total-vm:6147084kB, anon-rss:3130056kB, file-rss:7036kB
[196363.389006] swap_free: Bad swap offset entry 40000002f6a190
[196363.389008] BUG: Bad page map in process qemu-kvm  pte:80000005ed432000 pmd:28888e067
[196363.389010] addr:00007fd5f4000000 vm_flags:00200073 anon_vma:ffff880428438340 mapping:          (null) index:7fd5f4000
[196363.389012] CPU: 12 PID: 27933 Comm: qemu-kvm Tainted: G    B       --------------   3.10.0-121.el7.x86_64 #1
[196363.389013] Hardware name: Dell Inc. PowerEdge R415/0YFWR8, BIOS 1.9.3 04/26/2012
[196363.389018]  00007fd5f4000000 00000000e5a28996 ffff8802a97ffa78 ffffffff815ec0ba
[196363.389020]  ffff8802a97ffac0 ffffffff81167f58 80000005ed432000 00000007fd5f4000
[196363.389022]  ffff88028888e000 80000005ed432000 00007fd5f4000000 00007fd5f4021000
[196363.389023] Call Trace:
[196363.389033]  [<ffffffff815ec0ba>] dump_stack+0x19/0x1b
[196363.389037]  [<ffffffff81167f58>] print_bad_pte+0x1a8/0x240
[196363.389039]  [<ffffffff811698c0>] unmap_page_range+0x5b0/0x860
[196363.389042]  [<ffffffff81169bf1>] unmap_single_vma+0x81/0xf0
[196363.389044]  [<ffffffff8116acb9>] unmap_vmas+0x49/0x90
[196363.389047]  [<ffffffff8117396c>] exit_mmap+0xac/0x1a0
[196363.389051]  [<ffffffff8105b187>] mmput+0x67/0xf0
[196363.389053]  [<ffffffff81063dac>] do_exit+0x28c/0xa60
[196363.389056]  [<ffffffff815f13c5>] ? __schedule+0x2c5/0x790
[196363.389058]  [<ffffffff810645ff>] do_group_exit+0x3f/0xa0
[196363.389062]  [<ffffffff81074000>] get_signal_to_deliver+0x1d0/0x6e0
[196363.389066]  [<ffffffff81012437>] do_signal+0x57/0x600
[196363.389069]  [<ffffffff811c2e65>] ? do_vfs_ioctl+0x2e5/0x4c0
[196363.389072]  [<ffffffff8125796e>] ? file_has_perm+0xae/0xc0
[196363.389074]  [<ffffffff81012a49>] do_notify_resume+0x69/0xb0
[196363.389077]  [<ffffffff815fcad2>] int_signal+0x12/0x17
[196472.979474] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196474.014640] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196475.005729] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196475.804796] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196476.396389] fill_read_buffer: drv_attr_show+0x0/0x30 returned bad count
[196541.967901] BUG: Bad rss-counter state mm:ffff880036c18000 idx:1 val:1
[196541.977898] BUG: Bad rss-counter state mm:ffff880036c18000 idx:2 val:-1
[196548.800907] XFS (sdf1): Mounting Filesystem
[196549.109377] XFS (sdf1): Ending clean mount
[196549.114559] SELinux: initialized (dev sdf1, type xfs), uses xattr
[196549.347076] XFS (dm-4): Mounting Filesystem
[196549.378669] XFS (dm-4): Ending clean mount
[196549.383845] SELinux: initialized (dev dm-4, type xfs), uses xattr
[196549.974186] XFS (dm-4): Mounting Filesystem
[196550.089428] XFS (dm-4): Ending clean mount
[196550.094596] SELinux: initialized (dev dm-4, type xfs), uses xattr
[196550.529524] XFS (sdf1): Mounting Filesystem
[196550.831670] XFS (sdf1): Ending clean mount
[196550.836850] SELinux: initialized (dev sdf1, type xfs), uses xattr
[196622.478478] kvm [29525]: vcpu0 unhandled rdmsr: 0xc0010001
[196738.909731] sd 22:0:0:0: [sdb] Synchronizing SCSI cache
[196760.097160] scsi_debug_init: 16384 provisioning blocks
[196760.103712] scsi_debug: host protection
[196760.108621] scsi23 : scsi_debug, version 1.82 [20100324], dev_size_mb=8, opts=0x0
[196760.117448] scsi 23:0:0:0: Direct-Access     Linux    scsi_debug       0004 PQ: 0 ANSI: 5
[196760.127900] sd 23:0:0:0: Attached scsi generic sg2 type 0
[196760.128377] sd 23:0:0:0: [sdb] 16384 512-byte logical blocks: (8.38 MB/8.00 MiB)
[196760.128585] sd 23:0:0:0: [sdb] Write Protect is off
[196760.128587] sd 23:0:0:0: [sdb] Mode Sense: 73 00 10 08
[196760.130588] sd 23:0:0:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
[196760.137587]  sdb: unknown partition table
[196760.141621] sd 23:0:0:0: [sdb] Attached SCSI disk
[196829.042787] kvm [29625]: vcpu0 unhandled rdmsr: 0xc0010001
[198200.182393] sd 23:0:0:0: [sdb] Synchronizing SCSI cache
[198221.020699] scsi_debug_init: 16384 provisioning blocks
[198221.027133] scsi_debug: host protection
[198221.031955] scsi24 : scsi_debug, version 1.82 [20100324], dev_size_mb=8, opts=0x0
[198221.040774] scsi 24:0:0:0: Direct-Access     Linux    scsi_debug       0004 PQ: 0 ANSI: 5
[198221.050499] sd 24:0:0:0: Attached scsi generic sg2 type 0
[198221.050635] sd 24:0:0:0: [sdb] 16384 512-byte logical blocks: (8.38 MB/8.00 MiB)
[198221.051667] sd 24:0:0:0: [sdb] Write Protect is off
[198221.051669] sd 24:0:0:0: [sdb] Mode Sense: 73 00 10 08
[198221.053633] sd 24:0:0:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
[198221.060625]  sdb: unknown partition table
[198221.064654] sd 24:0:0:0: [sdb] Attached SCSI disk
[198310.160742] kvm [29874]: vcpu0 unhandled rdmsr: 0xc0010001
[426596.380619]  connection2:0: detected conn error (1020)
[426716.647651]  session2: session recovery timed out after 120 secs
[456444.186365] device tap0 entered promiscuous mode
[456444.192463] switch: port 2(tap0) entered forwarding state
[456444.199018] switch: port 2(tap0) entered forwarding state
[456444.222675] device tap0 left promiscuous mode
[456444.228224] switch: port 2(tap0) entered disabled state
[514100.451498] device tap0 entered promiscuous mode
[514100.457459] switch: port 2(tap0) entered forwarding state
[514100.464024] switch: port 2(tap0) entered forwarding state
[514101.031157] device tap0 left promiscuous mode
[514101.036736] switch: port 2(tap0) entered disabled state
[514237.438395] device tap0 entered promiscuous mode
[514237.444397] switch: port 2(tap0) entered forwarding state
[514237.451010] switch: port 2(tap0) entered forwarding state
[514237.817455] device tap0 left promiscuous mode
[514237.823086] switch: port 2(tap0) entered disabled state
[514247.728286] device tap0 entered promiscuous mode
[514247.734310] switch: port 2(tap0) entered forwarding state
[514247.740941] switch: port 2(tap0) entered forwarding state
[514248.120784] device tap0 left promiscuous mode
[514248.126437] switch: port 2(tap0) entered disabled state
[514264.418129] device tap0 entered promiscuous mode
[514264.424161] switch: port 2(tap0) entered forwarding state
[514264.430788] switch: port 2(tap0) entered forwarding state
[514264.786880] device tap0 left promiscuous mode
[514264.792495] switch: port 2(tap0) entered disabled state
[514306.810848] device tap0 entered promiscuous mode
[514306.816846] switch: port 2(tap0) entered forwarding state
[514306.823431] switch: port 2(tap0) entered forwarding state
[514312.363427] kvm [40386]: vcpu0 unhandled rdmsr: 0xc0010001
[516708.823394] device tap0 left promiscuous mode
[516708.828952] switch: port 2(tap0) entered disabled state
[516897.806335] device tap0 entered promiscuous mode
[516897.812255] switch: port 2(tap0) entered forwarding state
[516897.818799] switch: port 2(tap0) entered forwarding state
[516897.931023] device tap0 left promiscuous mode
[516897.936541] switch: port 2(tap0) entered disabled state
[516910.909930] device tap0 entered promiscuous mode
[516910.915862] switch: port 2(tap0) entered forwarding state
[516910.922378] switch: port 2(tap0) entered forwarding state
[516932.159403] kvm [40515]: vcpu0 unhandled rdmsr: 0xc0010001
[516938.724749] kvm: zapping shadow pages for mmio generation wraparound
[516968.926259] kvm [40515]: vcpu0 unhandled rdmsr: 0xc0010001
[518493.088251] kvm [40515]: vcpu0 unhandled rdmsr: 0xc0010001
[522374.894400] device tap0 left promiscuous mode
[522374.899931] switch: port 2(tap0) entered disabled state
[522439.785834] device tap0 entered promiscuous mode
[522439.791686] switch: port 2(tap0) entered forwarding state
[522439.798131] switch: port 2(tap0) entered forwarding state
[522446.287276] kvm [40668]: vcpu0 unhandled rdmsr: 0xc0010001
[527056.076383] device tap0 left promiscuous mode
[527056.081829] switch: port 2(tap0) entered disabled state
[527202.100201] device tap0 entered promiscuous mode
[527202.106059] switch: port 2(tap0) entered forwarding state
[527202.112514] switch: port 2(tap0) entered forwarding state
[527217.842942] kvm [41176]: vcpu0 unhandled rdmsr: 0xc0010001
[527380.268263] device tap0 left promiscuous mode
[527380.273711] switch: port 2(tap0) entered disabled state
[527496.489854] device tap0 entered promiscuous mode
[527496.495698] switch: port 2(tap0) entered forwarding state
[527496.502147] switch: port 2(tap0) entered forwarding state
[527503.910077] kvm [41254]: vcpu0 unhandled rdmsr: 0xc0010001
[527884.731749] sd 21:0:0:3: rejecting I/O to offline device
[527884.738130] Buffer I/O error on device dm-3, logical block 0
[527884.744867] sd 21:0:0:3: rejecting I/O to offline device
[527884.751216] Buffer I/O error on device dm-3, logical block 0
[527913.485755] sd 21:0:0:3: rejecting I/O to offline device
[527913.492159] Buffer I/O error on device dm-3, logical block 0
[527913.498923] sd 21:0:0:3: rejecting I/O to offline device
[527913.505310] Buffer I/O error on device dm-3, logical block 0
[527927.585890] sd 24:0:0:0: [sdb] Synchronizing SCSI cache
[527931.953563] scsi_debug_init: 2097152 provisioning blocks
[527931.960355] scsi_debug: host protection
[527931.965290] scsi25 : scsi_debug, version 1.82 [20100324], dev_size_mb=1024, opts=0x0
[527931.974373] scsi 25:0:0:0: Direct-Access     Linux    scsi_debug       0004 PQ: 0 ANSI: 5
[527931.984110] sd 25:0:0:0: Attached scsi generic sg2 type 0
[527931.984904] sd 25:0:0:0: [sdb] 2097152 512-byte logical blocks: (1.07 GB/1.00 GiB)
[527931.985894] sd 25:0:0:0: [sdb] Write Protect is off
[527931.985896] sd 25:0:0:0: [sdb] Mode Sense: 73 00 10 08
[527931.987887] sd 25:0:0:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
[527931.994886]  sdb: unknown partition table
[527931.999925] sd 25:0:0:0: [sdb] Attached SCSI disk
[527934.569531] sd 21:0:0:3: rejecting I/O to offline device
[527934.576039] Buffer I/O error on device dm-3, logical block 0
[527934.582916] sd 21:0:0:3: rejecting I/O to offline device
[527934.589396] Buffer I/O error on device dm-3, logical block 0
[528030.048854] sd 25:0:0:0: [sdb] Synchronizing SCSI cache
[528053.347023] scsi_debug_init: 2097152 provisioning blocks
[528053.353889] scsi_debug: host protection
[528053.359105] scsi26 : scsi_debug, version 1.82 [20100324], dev_size_mb=1024, opts=0x0
[528053.368318] scsi 26:0:0:0: Direct-Access     Linux    scsi_debug       0004 PQ: 0 ANSI: 5
[528053.378322] sd 26:0:0:0: [sdb] 2097152 512-byte logical blocks: (1.07 GB/1.00 GiB)
[528053.378729] sd 26:0:0:0: Attached scsi generic sg2 type 0
[528053.394305] sd 26:0:0:0: [sdb] Write Protect is off
[528053.400434] sd 26:0:0:0: [sdb] Mode Sense: 73 00 10 08
[528053.402327] sd 26:0:0:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
[528053.418318]  sdb: unknown partition table
[528053.427342] sd 26:0:0:0: [sdb] Attached SCSI disk
[528116.747812] sd 21:0:0:3: rejecting I/O to offline device
[528116.754414] Buffer I/O error on device dm-3, logical block 0
[528116.761366] sd 21:0:0:3: rejecting I/O to offline device
[528116.767939] Buffer I/O error on device dm-3, logical block 0
[528549.853666] sd 21:0:0:3: rejecting I/O to offline device
[528549.860268] Buffer I/O error on device dm-3, logical block 0
[528549.867246] sd 21:0:0:3: rejecting I/O to offline device
[528549.873841] Buffer I/O error on device dm-3, logical block 0
[529709.547926] sd 26:0:0:0: [sdb] Synchronizing SCSI cache
[529724.472691] scsi_debug_init: 16384 provisioning blocks
[529724.479460] scsi_debug: host protection
[529724.484590] scsi27 : scsi_debug, version 1.82 [20100324], dev_size_mb=8, opts=0x0
[529724.493614] scsi 27:0:0:0: Direct-Access     Linux    scsi_debug       0004 PQ: 0 ANSI: 5
[529724.503631] sd 27:0:0:0: Attached scsi generic sg2 type 0
[529724.504429] sd 27:0:0:0: [sdb] 16384 512-byte logical blocks: (8.38 MB/8.00 MiB)
[529724.505430] sd 27:0:0:0: [sdb] Write Protect is off
[529724.505432] sd 27:0:0:0: [sdb] Mode Sense: 73 00 10 08
[529724.507423] sd 27:0:0:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
[529724.514425]  sdb: unknown partition table
[529724.518454] sd 27:0:0:0: [sdb] Attached SCSI disk
[530548.655772] device tap0 left promiscuous mode
[530548.661555] switch: port 2(tap0) entered disabled state
[531625.444038] device tap0 entered promiscuous mode
[531625.450210] switch: port 2(tap0) entered forwarding state
[531625.456958] switch: port 2(tap0) entered forwarding state
[531625.979361] device tap0 left promiscuous mode
[531625.985115] switch: port 2(tap0) entered disabled state
[531639.522008] device tap0 entered promiscuous mode
[531639.528119] switch: port 2(tap0) entered forwarding state
[531639.534819] switch: port 2(tap0) entered forwarding state
[531650.705869] switch: port 2(tap0) entered disabled state
[531650.712564] device tap0 left promiscuous mode
[531650.718184] switch: port 2(tap0) entered disabled state
[531668.742496] device tap0 entered promiscuous mode
[531668.748504] switch: port 2(tap0) entered forwarding state
[531668.755152] switch: port 2(tap0) entered forwarding state
[531679.697004] switch: port 2(tap0) entered disabled state
[531679.703607] device tap0 left promiscuous mode
[531679.709185] switch: port 2(tap0) entered disabled state
[532303.353824] device tap0 entered promiscuous mode
[532303.359854] switch: port 2(tap0) entered forwarding state
[532303.366460] switch: port 2(tap0) entered forwarding state
[532312.936866] switch: port 2(tap0) entered disabled state
[532312.943404] device tap0 left promiscuous mode
[532312.948919] switch: port 2(tap0) entered disabled state
[532345.249110] device tap0 entered promiscuous mode
[532345.255060] switch: port 2(tap0) entered forwarding state
[532345.261589] switch: port 2(tap0) entered forwarding state
[532345.612613] device tap0 left promiscuous mode
[532345.618164] switch: port 2(tap0) entered disabled state
[532361.871125] device tap0 entered promiscuous mode
[532361.877037] switch: port 2(tap0) entered forwarding state
[532361.883558] switch: port 2(tap0) entered forwarding state
[532371.736806] kvm [42045]: vcpu0 unhandled rdmsr: 0xc0010001
[534060.731511] kvm: zapping shadow pages for mmio generation wraparound
[534062.622863] device tap0 left promiscuous mode
[534062.628360] switch: port 2(tap0) entered disabled state
[534100.214887] sd 27:0:0:0: [sdb] Synchronizing SCSI cache
[534116.514281] scsi_debug_init: 16384 provisioning blocks
[534116.520812] scsi_debug: host protection
[534116.525738] scsi28 : scsi_debug, version 1.82 [20100324], dev_size_mb=8, opts=0x0
[534116.534562] scsi 28:0:0:0: Direct-Access     Linux    scsi_debug       0004 PQ: 0 ANSI: 5
[534116.544323] sd 28:0:0:0: Attached scsi generic sg2 type 0
[534116.544615] sd 28:0:0:0: [sdb] 16384 512-byte logical blocks: (8.38 MB/8.00 MiB)
[534116.545490] sd 28:0:0:0: [sdb] Write Protect is off
[534116.545493] sd 28:0:0:0: [sdb] Mode Sense: 73 00 10 08
[534116.547474] sd 28:0:0:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
[534116.554483]  sdb: unknown partition table
[534116.558509] sd 28:0:0:0: [sdb] Attached SCSI disk
[534132.533041] device tap0 entered promiscuous mode
[534132.538933] switch: port 2(tap0) entered forwarding state
[534132.545422] switch: port 2(tap0) entered forwarding state
[534132.954676] device tap0 left promiscuous mode
[534132.960201] switch: port 2(tap0) entered disabled state
[534140.584559] device tap0 entered promiscuous mode
[534140.590437] switch: port 2(tap0) entered forwarding state
[534140.596930] switch: port 2(tap0) entered forwarding state
[534140.974005] device tap0 left promiscuous mode
[534140.979493] switch: port 2(tap0) entered disabled state
[534190.348171] device tap0 entered promiscuous mode
[534190.354056] switch: port 2(tap0) entered forwarding state
[534190.360563] switch: port 2(tap0) entered forwarding state
[534190.739675] device tap0 left promiscuous mode
[534190.745153] switch: port 2(tap0) entered disabled state
[534200.865999] device tap0 entered promiscuous mode
[534200.871875] switch: port 2(tap0) entered forwarding state
[534200.878392] switch: port 2(tap0) entered forwarding state
[534210.453308] kvm [42300]: vcpu0 unhandled rdmsr: 0xc0010001
[534317.519033] device tap0 left promiscuous mode
[534317.524540] switch: port 2(tap0) entered disabled state
[534326.377095] device tap0 entered promiscuous mode
[534326.382987] switch: port 2(tap0) entered forwarding state
[534326.389515] switch: port 2(tap0) entered forwarding state
[534333.299589] kvm [42341]: vcpu0 unhandled rdmsr: 0xc0010001
[535544.303439] device tap0 left promiscuous mode
[535544.308990] switch: port 2(tap0) entered disabled state
[535576.366775] device tap0 entered promiscuous mode
[535576.372717] switch: port 2(tap0) entered forwarding state
[535576.379259] switch: port 2(tap0) entered forwarding state

[535586.228208] kvm [42453]: vcpu0 unhandled rdmsr: 0xc0010001
[535941.189676] device tap0 left promiscuous mode
[535941.195247] switch: port 2(tap0) entered disabled state
[535949.575994] device tap0 entered promiscuous mode
[535949.581931] switch: port 2(tap0) entered forwarding state
[535949.588456] switch: port 2(tap0) entered forwarding state
[535959.308792] kvm [42505]: vcpu0 unhandled rdmsr: 0xc0010001
[538005.754150] kvm: zapping shadow pages for mmio generation wraparound
[538012.236707] kvm [42505]: vcpu0 unhandled rdmsr: 0xc0010001
[538134.025110] device tap0 left promiscuous mode
[538134.030672] switch: port 2(tap0) entered disabled state
[538184.518152] device tap0 entered promiscuous mode
[538184.524069] switch: port 2(tap0) entered forwarding state
[538184.530569] switch: port 2(tap0) entered forwarding state
[538185.729990] device tap0 left promiscuous mode
[538185.735465] switch: port 2(tap0) entered disabled state
[538199.444691] device tap0 entered promiscuous mode
[538199.450517] switch: port 2(tap0) entered forwarding state
[538199.456985] switch: port 2(tap0) entered forwarding state
[538199.527091] device tap0 left promiscuous mode
[538199.532555] switch: port 2(tap0) entered disabled state
[538221.918980] device tap0 entered promiscuous mode
...
[792132.611045] device tap1 entered promiscuous mode
[792132.616830] switch: port 3(tap1) entered forwarding state
[792132.623300] switch: port 3(tap1) entered forwarding state
[792133.207254] device tap1 left promiscuous mode
[792133.212765] switch: port 3(tap1) entered disabled state
[792154.312506] device tap1 entered promiscuous mode
[792154.318287] switch: port 3(tap1) entered forwarding state
[792154.324746] switch: port 3(tap1) entered forwarding state
[792186.104529] sd 21:0:0:3: rejecting I/O to offline device
[792186.110934] Buffer I/O error on device dm-3, logical block 0
[792186.117697] sd 21:0:0:3: rejecting I/O to offline device
[792186.124048] Buffer I/O error on device dm-3, logical block 0
[792355.355471] kvm: zapping shadow pages for mmio generation wraparound
[792355.364068] kvm: zapping shadow pages for mmio generation wraparound
[792366.815360] general protection fault: 0000 [#1] SMP
[792366.821439] Modules linked in: loop scsi_debug fuse btrfs zlib_deflate raid6_pq xor vfat msdos fat binfmt_misc ext4 mbcache jbd2 iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi iptable_filter ip_tables vhost_net macvtap macvlan tun sg nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache bridge stp llc kvm_amd kvm dcdbas ipmi_devintf crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ipmi_si aesni_intel bnx2 lrw ipmi_msghandler gf128mul glue_helper ablk_helper cryptd acpi_power_meter serio_raw sp5100_tco shpchp amd64_edac_mod i2c_piix4 edac_mce_amd k10temp fam15h_power edac_core pcspkr mperf nfsd auth_rpcgss nfs_acl lockd sunrpc xfs libcrc32c sd_mod crc_t10dif crct10dif_common sr_mod cdrom ata_generic pata_acpi mgag200 syscopyarea sysfillrect sysimgblt i2c_algo_bit drm_kms_helper
[792366.899105]  ttm mptsas drm ahci scsi_transport_sas libahci pata_atiixp mptscsih i2c_core libata mptbase dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scsi_debug]
[792366.915665] CPU: 14 PID: 50452 Comm: qemu-kvm Tainted: G    B       --------------   3.10.0-121.el7.x86_64 #1
[792366.926908] Hardware name: Dell Inc. PowerEdge R415/0YFWR8, BIOS 1.9.3 04/26/2012
[792366.935753] task: ffff880823f1cfa0 ti: ffff880700066000 task.ti: ffff880700066000
[792366.944608] RIP: 0010:[<ffffffff8108a919>]  [<ffffffff8108a919>] down_read_trylock+0x9/0x30
[792366.954366] RSP: 0000:ffff8807000677a0  EFLAGS: 00010202
[792366.961069] RAX: 0000000000000000 RBX: ffff880428438340 RCX: 0000000000000000
[792366.969604] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 7304290700013708
[792366.978153] RBP: ffff8807000677a0 R08: ffffea0017b50ca0 R09: ffff880425ee00d8
[792366.986701] R10: 00000000000000d8 R11: 000000000000000a R12: ffff880428438341
[792366.995246] R13: ffffea0017b50c80 R14: 7304290700013708 R15: ffffea0017b50c80
[792367.003799] FS:  00007f6c61026a40(0000) GS:ffff88083e6c0000(0000) knlGS:0000000000000000
[792367.013317] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[792367.020494] CR2: 00007f6bf1e0a010 CR3: 00000006fc46f000 CR4: 00000000000407e0
[792367.029089] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[792367.037678] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[792367.046254] Stack:
[792367.049707]  ffff8807000677d0 ffffffff81177d05 ffffea0017b50c80 0000000000000000
[792367.058610]  000000000000000b 0000000000000001 ffff880700067848 ffffffff81177f87
[792367.067544]  ffff880428d1e7c0 00000007fea037b4 ffff880700067898 0000000100000000
[792367.076474] Call Trace:
[792367.080414]  [<ffffffff81177d05>] page_lock_anon_vma_read+0x55/0x110
[792367.088269]  [<ffffffff81177f87>] page_referenced+0x1c7/0x350
[792367.095512]  [<ffffffff81155844>] shrink_active_list+0x1e4/0x3f0
[792367.103030]  [<ffffffff81155f09>] shrink_lruvec+0x4b9/0x6e0
[792367.110105]  [<ffffffff811561a6>] shrink_zone+0x76/0x1a0
[792367.116905]  [<ffffffff811566b0>] do_try_to_free_pages+0xf0/0x4e0
[792367.124481]  [<ffffffff81156b9c>] try_to_free_pages+0xfc/0x180
[792367.131815]  [<ffffffff8114b2ce>] __alloc_pages_nodemask+0x75e/0xb10
[792367.139668]  [<ffffffff8118bb4a>] alloc_pages_vma+0x9a/0x140
[792367.146823]  [<ffffffff811a06dd>] do_huge_pmd_wp_page+0x10d/0xb80
[792367.154410]  [<ffffffff8116c794>] handle_mm_fault+0x564/0xd90
[792367.161644]  [<ffffffff815f7886>] __do_page_fault+0x156/0x540
[792367.168890]  [<ffffffff814c2937>] ? SYSC_recvfrom+0x127/0x160
[792367.176126]  [<ffffffff811fb69c>] ? eventfd_read+0x4c/0x90
[792367.183091]  [<ffffffff815f7c8a>] do_page_fault+0x1a/0x70
[792367.189964]  [<ffffffff815f3ec8>] page_fault+0x28/0x30
[792367.196565] Code: 00 00 00 ba 01 00 00 00 48 89 de e8 12 fe ff ff eb ce 48 c7 c0 f2 ff ff ff eb c5 e8 d2 33 fd ff 66 90 66 66 66 66 90 55 48 89 e5 <48> 8b 07 48 89 c2 48 83 c2 01 7e 07 f0 48 0f b1 17 75 f0 48 f7
[792367.219081] RIP  [<ffffffff8108a919>] down_read_trylock+0x9/0x30
[792367.226642]  RSP <ffff8807000677a0>


Expected results:
host no core dump.

Additional info:
QE do not record the exactly command line. Only hit this issue once. 
But as this is host core dump, so file this new bz for developer to analysis.
QE will provide a link for developer to download the vmcore and vmcore-dmesg.txt.

Comment 3 Jun Li 2014-04-28 07:48:55 UTC

Please note:
  I found this issue only once by accident during my random testing. I do not remember exact steps and exact command line. Currently, what I can provides are host vmcore and vmcore-dmesg.txt. Please check whether it is useful. It's ok close this bz as not a bz in my side if the infos I provides are useless. Any further testing needed, free to update it in the bz.

Comment 9 Juan Quintela 2017-05-03 12:00:24 UTC

QE has only been able to reproduce it once, three years ago, and we have had changes all around migration and floppy support.  I propose closing it.

Comment 10 juzhang 2017-06-07 10:49:13 UTC

(In reply to Juan Quintela from comment #9)
> QE has only been able to reproduce it once, three years ago, and we have had
> changes all around migration and floppy support.  I propose closing it.

Hi Qunfang,

Could you have a look whether this bz can be reproduced in latest qemu-kvm build?

Best Regards,
Junyi

Comment 11 xianwang 2017-06-14 08:49:02 UTC

(In reply to juzhang from comment #10)
> (In reply to Juan Quintela from comment #9)
> > QE has only been able to reproduce it once, three years ago, and we have had
> > changes all around migration and floppy support.  I propose closing it.
> 
> Hi Qunfang,
> 
> Could you have a look whether this bz can be reproduced in latest qemu-kvm
> build?
> 
> Best Regards,
> Junyi

I have re-test this scenario with latest build, but I can't reproduce this issue.
Host:
3.10.0-679.el7.x86_64
qemu-kvm-rhev-2.9.0-10.el7.x86_64
seabios-1.10.2-3.el7.x86_64

Gugest:
3.10.0-679.el7.x86_64

steps:
1.Boot a guest as following qemu cli:
/usr/libexec/qemu-kvm \
    -name 'avocado-vt-vm1'  \
    -sandbox off  \
    -machine pc  \
    -nodefaults  \
    -vga std  \
    -device virtio-serial-pci,id=virtio_serial_pci0,bus=pci.0,addr=03 \
    -device qemu-xhci,id=usb1,bus=pci.0 \
    -device virtio-scsi-pci,id=virtio_scsi_pci0,bus=pci.0,addr=05 \
    -drive id=drive_image1,if=none,snapshot=off,format=qcow2,snapshot=off,file=/root/rhel74-64-virtio-scsi.qcow2 \
    -device scsi-hd,id=image1,drive=drive_image1,bus=virtio_scsi_pci0.0 \
    -device virtio-net-pci,mac=9a:7b:7c:7d:7e:72,id=id9HRc5V,vectors=4,netdev=idjlQN53,bus=pci.0,addr=10 \
    -netdev tap,id=idjlQN53,vhost=off,script=/etc/qemu-ifup,downscript=/etc/qemu-ifdown \
    -m 4G  \
    -smp 4  \
    -name debug-threads=on \
    -device usb-hub,id=hub1,port=1 \
    -device usb-mouse,id=usbmouse,port=1.1\
    -device usb-kbd,id=usbkbd,port=1.2\
    -device usb-tablet,id=usbtablet,port=1.3\
    -fda /root/virtio-win-prewhql-0.1-134_amd64.vfd \
    -vnc :1 \
    -incoming tcp:0:5801 \
    -rtc base=localtime,clock=vm,driftfix=slew  \
    -boot order=cdn,once=c,menu=off,strict=off \
    -monitor stdio \
    -enable-kvm
check the block:
(qemu) info block
drive_image1 (#block126): /root/rhel74-64-virtio-scsi.qcow2 (qcow2)
    Cache mode:       writeback

floppy0 (#block393): /root/virtio-win-prewhql-0.1-134_amd64.vfd (raw)
    Removable device: not locked, tray closed
    Cache mode:       writeback
2.Stress guest:
# stress --cpu 4 --io 4 --vm 2 --vm-bytes 128M
3.Change floppy file:
(qemu) eject floppy0
(qemu) info block
drive_image1 (#block126): /root/rhel74-64-virtio-scsi.qcow2 (qcow2)
    Cache mode:       writeback

floppy0: [not inserted]
    Removable device: not locked, tray closed
(qemu) change floppy0 /root/virtio-win-prewhql-0.1-139_amd64.vfd
(qemu) info block
drive_image1 (#block126): /root/rhel74-64-virtio-scsi.qcow2 (qcow2)
    Cache mode:       writeback

floppy0 (#block504): /root/virtio-win-prewhql-0.1-139_amd64.vfd (raw)
    Removable device: not locked, tray closed
    Cache mode:       writeback
4.Launch listening mode on the same host with "-incoming tcp:0:5801" and with the new floppy file:"-fda /root/virtio-win-prewhql-0.1-139_amd64.vfd"
5.Do local migration
(qemu) migrate -d tcp:127.0.0.1:5802

result:
migration completed and vm works well.

So, this issue is not exist for the newest build.

Note You need to log in before you can comment on or make changes to this bug.