Got from a running machine suddenly: [859069.022739] CPU 1/KVM[2867866]: segfault at 2 ip 0000560cffe03757 sp 00007f0e8babaeb0 error 4 in qemu-system-x86_64[560cffbd4000+45d000] [859069.022749] Code: 00 00 00 41 57 41 56 41 55 41 54 49 89 cc b9 a2 03 00 00 55 48 89 f5 48 8d 35 1c 35 29 00 53 48 89 fb 48 83 c7 38 48 83 ec 38 <44> 0f b7 52 02 4c 8b 7a 08 4c 89 44 24 08 4c 8d 05 b4 08 29 00 45 [859087.661975] device k1806-YcXLF left promiscuous mode # qemu-system-x86_64 --version QEMU emulator version 4.2.0 (qemu-4.2.0-2.fc31) Copyright (c) 2003-2019 Fabrice Bellard and the QEMU Project developers # virsh -V Virsh command line tool of libvirt 6.0.0 See web site at https://libvirt.org/ Compiled with support for: Hypervisors: QEMU/KVM LXC LibXL OpenVZ VMware VirtualBox ESX Hyper-V Test Networking: Remote Network Bridging Interface netcf Nwfilter VirtualPort Storage: Dir Disk Filesystem SCSI Multipath iSCSI LVM RBD Sheepdog Gluster ZFS Miscellaneous: Daemon Nodedev SELinux Secrets Debug DTrace Readline After that the partition table of the zfs volume was cleared. Any idea what this is ?
Jan 26 22:34:52 staticnode2.ip-interactive.sc audit[2867852]: ANOM_ABEND auid=4294967295 uid=107 gid=107 ses=4294967295 pid=2867852 comm=43505520312F4B564D exe="/usr/bin/qemu-system-x86_64" sig=11 res=1 Jan 26 22:34:52 staticnode2.ip-interactive.sc kernel: CPU 1/KVM[2867866]: segfault at 2 ip 0000560cffe03757 sp 00007f0e8babaeb0 error 4 in qemu-system-x86_64[560cffbd4000+45d000] Jan 26 22:34:52 staticnode2.ip-interactive.sc kernel: Code: 00 00 00 41 57 41 56 41 55 41 54 49 89 cc b9 a2 03 00 00 55 48 89 f5 48 8d 35 1c 35 29 00 53 48 89 fb 48 83 c7 38 48 83 ec 38 <44> 0f b7 52 02 4c 8b 7a 08 4c 89 44 24 08 4c 8d 05 b4 08 29 00 45 Jan 26 22:34:52 staticnode2.ip-interactive.sc systemd[1]: Created slice system-systemd\x2dcoredump.slice. Jan 26 22:34:52 staticnode2.ip-interactive.sc systemd[1]: Started Process Core Dump (PID 274969/UID 0). Jan 26 22:34:52 staticnode2.ip-interactive.sc audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-coredump@0-274969-0 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' Jan 26 22:34:52 staticnode2.ip-interactive.sc systemd-coredump[274979]: Resource limits disable core dumping for process 2867852 (qemu-system-x86). Jan 26 22:34:52 staticnode2.ip-interactive.sc systemd-coredump[274979]: Process 2867852 (qemu-system-x86) of user 107 dumped core. Jan 26 22:34:52 staticnode2.ip-interactive.sc systemd[1]: systemd-coredump: Succeeded. Jan 26 22:34:52 staticnode2.ip-interactive.sc audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-coredump@0-274969-0 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' Jan 26 22:35:10 staticnode2.ip-interactive.sc libvirtd[53074]: internal error: End of file from qemu monitor Jan 26 22:35:10 staticnode2.ip-interactive.sc audit: ANOM_PROMISCUOUS dev=k1806-YcXLF prom=0 old_prom=256 auid=4294967295 uid=107 gid=107 ses=4294967295 Jan 26 22:35:10 staticnode2.ip-interactive.sc kernel: device k1806-YcXLF left promiscuous mode Jan 26 22:35:10 staticnode2.ip-interactive.sc NetworkManager[1969]: <info> [1580074510.7006] device (k1806-YcXLF): state change: disconnected -> unmanaged (reason 'unmanaged', sys-iface-state: 'removed') Jan 26 22:35:10 staticnode2.ip-interactive.sc systemd[1]: machine-qemu\x2d91\x2dkvm1806.scope: Succeeded. Jan 26 22:35:10 staticnode2.ip-interactive.sc systemd[1]: machine-qemu\x2d91\x2dkvm1806.scope: Consumed 45min 23.398s CPU time. Jan 26 22:35:10 staticnode2.ip-interactive.sc systemd-machined[1957]: Machine qemu-91-kvm1806 terminated. Jan 26 22:35:10 staticnode2.ip-interactive.sc ovs-vsctl[298347]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=5 -- --if-exists del-port k1806-YcXLF Jan 26 22:35:10 staticnode2.ip-interactive.sc libvirtd[53074]: unable to open '/sys/fs/cgroup/machine.slice/machine-qemu\x2d91\x2dkvm1806.scope/': No such file or directory Jan 26 22:35:10 staticnode2.ip-interactive.sc libvirtd[53074]: Failed to remove cgroup for kvm1806 Jan 26 22:35:10 staticnode2.ip-interactive.sc audit[53074]: VIRT_CONTROL pid=53074 uid=0 auid=4294967295 ses=4294967295 msg='virt=kvm op=stop reason=failed vm="kvm1806" uuid=570fbe08-c0c7-4f14-87f6-79fc46b84dda vm-pid=-1 exe="/usr/sbin/libvirtd" hostname=? addr=? terminal=? res=success' Jan 26 22:37:52 staticnode2.ip-interactive.sc audit[866635]: CRYPTO_KEY_USER pid=866635 uid=0 auid=4294967295 ses=4294967295 msg='op=destroy kind=server fp=SHA256:59:1e:a1:88:67:92:d3:33:84:f4:a1:72:ef:fc:e6:be:d0:52:44:de:c0:5f:2d:23:3d:85:5f:b9:ac:62:69:05 direction=? spid=866635 suid=0 exe="/usr/sbin/sshd" hos> Jan 26 22:37:52 staticnode2.ip-interactive.sc audit[866629]: CRYPTO_SESSION pid=866629 uid=0 auid=4294967295 ses=4294967295 msg='op=start direction=from-server cipher=aes256-ctr ksize=256 mac=hmac-sha1 pfs=curve25519-sha256 spid=866635 suid=74 rport=42290 laddr=193.24.211.72 lport=22 exe="/usr/sbin/ssh> Jan 26 22:37:52 staticnode2.ip-interactive.sc audit[866629]: CRYPTO_SESSION pid=866629 uid=0 auid=4294967295 ses=4294967295 msg='op=start direction=from-client cipher=aes256-ctr ksize=256 mac=hmac-sha1 pfs=curve25519-sha256 spid=866635 suid=74
And another VM too: Jan 27 00:43:51 staticnode2.ip-interactive.sc audit[1967687]: ANOM_ABEND auid=4294967295 uid=107 gid=107 ses=4294967295 pid=1967687 comm=43505520312F4B564D exe="/usr/bin/qemu-system-x86_64" sig=11 res=1 Jan 27 00:43:51 staticnode2.ip-interactive.sc kernel: CPU 1/KVM[1967896]: segfault at 2 ip 0000559e55062757 sp 00007f19059dbeb0 error 4 in qemu-system-x86_64[559e54e33000+45d000] Jan 27 00:43:51 staticnode2.ip-interactive.sc kernel: Code: 00 00 00 41 57 41 56 41 55 41 54 49 89 cc b9 a2 03 00 00 55 48 89 f5 48 8d 35 1c 35 29 00 53 48 89 fb 48 83 c7 38 48 83 ec 38 <44> 0f b7 52 02 4c 8b 7a 08 4c 89 44 24 08 4c 8d 05 b4 08 29 00 45 Jan 27 00:43:51 staticnode2.ip-interactive.sc systemd[1]: Started Process Core Dump (PID 3789668/UID 0). Jan 27 00:43:51 staticnode2.ip-interactive.sc audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-coredump@1-3789668-0 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' Jan 27 00:43:51 staticnode2.ip-interactive.sc systemd-coredump[3789702]: Resource limits disable core dumping for process 1967687 (qemu-system-x86). Jan 27 00:43:51 staticnode2.ip-interactive.sc systemd-coredump[3789702]: Process 1967687 (qemu-system-x86) of user 107 dumped core. Jan 27 00:43:51 staticnode2.ip-interactive.sc audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-coredump@1-3789668-0 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' Jan 27 00:43:51 staticnode2.ip-interactive.sc systemd[1]: systemd-coredump: Succeeded. Jan 27 00:45:18 staticnode2.ip-interactive.sc libvirtd[53074]: internal error: End of file from qemu monitor Jan 27 00:45:18 staticnode2.ip-interactive.sc audit: ANOM_PROMISCUOUS dev=k1807-2mzLh prom=0 old_prom=256 auid=4294967295 uid=107 gid=107 ses=4294967295 Jan 27 00:45:18 staticnode2.ip-interactive.sc kernel: device k1807-2mzLh left promiscuous mode Jan 27 00:45:18 staticnode2.ip-interactive.sc NetworkManager[1969]: <info> [1580082318.7256] device (k1807-2mzLh): state change: disconnected -> unmanaged (reason 'unmanaged', sys-iface-state: 'removed') Jan 27 00:45:19 staticnode2.ip-interactive.sc systemd[1]: machine-qemu\x2d101\x2dkvm1807.scope: Succeeded. Jan 27 00:45:19 staticnode2.ip-interactive.sc systemd[1]: machine-qemu\x2d101\x2dkvm1807.scope: Consumed 15min 21.094s CPU time. Jan 27 00:45:19 staticnode2.ip-interactive.sc systemd-machined[1957]: Machine qemu-101-kvm1807 terminated. Jan 27 00:45:19 staticnode2.ip-interactive.sc ovs-vsctl[15136]: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=5 -- --if-exists del-port k1807-2mzLh Jan 27 00:45:19 staticnode2.ip-interactive.sc libvirtd[53074]: unable to open '/sys/fs/cgroup/machine.slice/machine-qemu\x2d101\x2dkvm1807.scope/': No such file or directory Jan 27 00:45:19 staticnode2.ip-interactive.sc libvirtd[53074]: Failed to remove cgroup for kvm1807 Jan 27 00:45:35 staticnode2.ip-interactive.sc audit[53074]: VIRT_CONTROL pid=53074 uid=0 auid=4294967295 ses=4294967295 msg='virt=kvm op=stop reason=failed vm="kvm1807" uuid=77ce2ccc-dd8c-44e6-8912-566a69cdb9b0 vm-pid=-1 exe="/usr/sbin/libvirtd" hostname=? addr=? terminal=? res=success' Jan 27 00:50:52 staticnode2.ip-interactive.sc systemd[1]: Starting system activity accounting tool... Jan 27 00:50:52 staticnode2.ip-interactive.sc audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=sysstat-collect comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' Jan 27 00:50:52 staticnode2.ip-interactive.sc audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=sysstat-collect comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' Jan 27 00:50:52 staticnode2.ip-interactive.sc systemd[1]: sysstat-collect.service: Succeeded. Jan 27 00:50:52 staticnode2.ip-interactive.sc systemd[1]: Started system activity accounting tool.
coredumpctl --output=/kvm-storage/sun-2020-01-26 dump 2867852 PID: 2867852 (qemu-system-x86) UID: 107 (qemu) GID: 107 (qemu) Signal: 11 (SEGV) Timestamp: Sun 2020-01-26 22:34:52 CET (14h ago) Command Line: /usr/bin/qemu-system-x86_64 -name guest=kvm1806,debug-threads=on -S -object secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/domain-91-kvm1806/master-key.aes -machine pc-q35-4.2,accel=kvm,usb=off,dump-guest-core=off -cpu IvyBridge-IBRS,ss=on,vmx=on,pcid=on,hypervisor=on,arat=on,tsc-adjust=on,umip=on,md-clear=on,stibp=on,arch-capabilities=on,ssbd=on,xsaveopt=on,pdpe1gb=on,ibpb=on,amd-ssbd=on,skip-l1dfl-vmentry=on -m 16000 -overcommit mem-lock=off -smp 4,maxcpus=32,sockets=32,cores=1,threads=1 -uuid 570fbe08-c0c7-4f14-87f6-79fc46b84dda -no-user-config -nodefaults -chardev socket,id=charmonitor,fd=101,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=utc,driftfix=slew -global kvm-pit.lost_tick_policy=delay -no-hpet -no-shutdown -global ICH9-LPC.disable_s3=1 -global ICH9-LPC.disable_s4=1 -boot strict=on -device pcie-root-port,port=0x10,chassis=1,id=pci.1,bus=pcie.0,multifunction=on,addr=0x2 -device pcie-root-port,port=0x11,chassis=2,id=pci.2,bus=pcie.0,addr=0x2.0x1 -device pcie-root-port,port=0x12,chassis=3,id=pci.3,bus=pcie.0,addr=0x2.0x2 -device pcie-root-port,port=0x13,chassis=4,id=pci.4,bus=pcie.0,addr=0x2.0x3 -device pcie-root-port,port=0x14,chassis=5,id=pci.5,bus=pcie.0,addr=0x2.0x4 -device pcie-root-port,port=0x15,chassis=6,id=pci.6,bus=pcie.0,addr=0x2.0x5 -device pcie-root-port,port=0x16,chassis=7,id=pci.7,bus=pcie.0,addr=0x2.0x6 -device qemu-xhci,p2=15,p3=15,id=usb,bus=pci.2,addr=0x0 -device virtio-serial-pci,id=virtio-serial0,bus=pci.3,addr=0x0 -blockdev {"driver":"host_device","filename":"/dev/zvol/kvm-storage/465-a054bf76-ab32-4891-9dee-67fd04db21f4","aio":"native","node-name":"libvirt-2-storage","cache":{"direct":true,"no-flush":false},"auto-read-only":true,"discard":"unmap"} -blockdev {"node-name":"libvirt-2-format","read-only":false,"cache":{"direct":true,"no-flush":false},"driver":"raw","file":"libvirt-2-storage"} -device ide-hd,bus=ide.0,drive=libvirt-2-format,id=sata0-0-0,bootindex=1,write-cache=on -device ide-cd,bus=ide.1,id=sata0-0-1 -netdev tap,fd=105,id=hostnet0,vhost=on,vhostfd=106 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=00:50:56:a4:b6:ff,bus=pci.1,addr=0x0 -chardev pty,id=charserial0 -device isa-serial,chardev=charserial0,id=serial0 -chardev socket,id=charchannel0,fd=108,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=org.qemu.guest_agent.0 -device usb-tablet,id=input0,bus=usb.0,port=1 -vnc 0.0.0.0:50,password -k en-us -device qxl-vga,id=video0,ram_size=67108864,vram_size=67108864,vram64_size_mb=0,vgamem_mb=16,max_outputs=1,bus=pcie.0,addr=0x1 -device virtio-balloon-pci,id=balloon0,bus=pci.5,addr=0x0 -object rng-random,id=objrng0,filename=/dev/urandom -device virtio-rng-pci,rng=objrng0,id=rng0,bus=pci.6,addr=0x0 -sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny -msg timestamp=on Executable: /usr/bin/qemu-system-x86_64 Control Group: /machine.slice/machine-qemu\x2d91\x2dkvm1806.scope/emulator Unit: machine-qemu\x2d91\x2dkvm1806.scope Slice: machine.slice Boot ID: 584b67c9c7fc47e99f20b962d00f2103 Machine ID: 063a2b2b773d49fdb6c3547e7bd6f343 Hostname: staticnode2.ip-interactive.sc Storage: none Message: Process 2867852 (qemu-system-x86) of user 107 dumped core. Coredump entry has no core attached (neither internally in the journal nor externally on disk).
This message is a reminder that Fedora 31 is nearing its end of life. Fedora will stop maintaining and issuing updates for Fedora 31 on 2020-11-24. It is Fedora's policy to close all bug reports from releases that are no longer maintained. At that time this bug will be closed as EOL if it remains open with a Fedora 'version' of '31'. Package Maintainer: If you wish for this bug to remain open because you plan to fix it in a currently maintained version, simply change the 'version' to a later Fedora version. Thank you for reporting this issue and we are sorry that we were not able to fix it before Fedora 31 is end of life. If you would still like to see this bug fixed and are able to reproduce it against a later version of Fedora, you are encouraged change the 'version' to a later Fedora version prior this bug is closed as described in the policy above. Although we aim to fix as many bugs as possible during every release's lifetime, sometimes those efforts are overtaken by events. Often a more recent Fedora release includes newer upstream software that fixes bugs or makes them obsolete.
Fedora 31 changed to end-of-life (EOL) status on 2020-11-24. Fedora 31 is no longer maintained, which means that it will not receive any further security or bug fix updates. As a result we are closing this bug. If you can reproduce this bug against a currently maintained version of Fedora please feel free to reopen this bug against that version. If you are unable to reopen this bug, please file a new report against the current release. If you experience problems, please add a comment to this bug. Thank you for reporting this bug and we are sorry it could not be fixed.