All upstream centos7 testing started failing with libvirt complaining --- libvirtError: internal error: process exited while connecting to monitor: qemu: could not load PC BIOS 'bios-256k.bin' --- investigation showed there are bad links to the seabios binaries --- -bash-4.2$ pwd /usr/share/qemu -bash-4.2$ ls -l bios*.bin lrwxrwxrwx. 1 root root 24 Jun 26 02:34 bios-256k.bin -> ../seabios/bios-256k.bin lrwxrwxrwx. 1 root root 19 Jun 26 02:34 bios.bin -> ../seabios/bios.bin -bash-4.2$ ls ../seabios ls: cannot access ../seabios: No such file or directory --- --- -bash-4.2$ rpm -qa |egrep "qemu|seabios" qemu-kvm-common-1.5.3-86.el7_1.2.x86_64 qemu-common-2.0.0-1.el7.5.x86_64 qemu-system-x86-2.0.0-1.el7.5.x86_64 libvirt-daemon-driver-qemu-1.2.8-16.el7_1.3.x86_64 ipxe-roms-qemu-20130517-6.gitc4bce43.el7.noarch qemu-img-1.5.3-86.el7_1.2.x86_64 --- installing seabios-bin brings these back. has a dependency gone missing? original install logs from [2] --- 2015-06-25 11:50:19.614 | ================================================================================ 2015-06-25 11:50:19.614 | Package Arch Version Repository Size 2015-06-25 11:50:19.614 | ================================================================================ 2015-06-25 11:50:19.614 | Installing: 2015-06-25 11:50:19.614 | qemu-system-x86 x86_64 2:2.0.0-1.el7.5 epel 3.4 M 2015-06-25 11:50:19.614 | Installing for dependencies: 2015-06-25 11:50:19.614 | SDL x86_64 1.2.15-11.el7 base 204 k 2015-06-25 11:50:19.614 | at-spi2-atk x86_64 2.8.1-4.el7 base 73 k 2015-06-25 11:50:19.614 | at-spi2-core x86_64 2.8.0-6.el7 base 151 k 2015-06-25 11:50:19.614 | bluez-libs x86_64 4.101-13.el7 base 90 k 2015-06-25 11:50:19.614 | brlapi x86_64 0.6.0-9.el7 base 113 k 2015-06-25 11:50:19.614 | brltty x86_64 4.5-9.el7 base 926 k 2015-06-25 11:50:19.614 | cairo-gobject x86_64 1.12.14-6.el7 base 25 k 2015-06-25 11:50:19.614 | celt051 x86_64 0.5.1.3-8.el7 base 53 k 2015-06-25 11:50:19.614 | colord-libs x86_64 1.0.4-3.el7 base 148 k 2015-06-25 11:50:19.614 | gtk3 x86_64 3.8.8-10.el7 base 3.2 M 2015-06-25 11:50:19.614 | ipxe-roms-qemu noarch 20130517-6.gitc4bce43.el7 base 559 k 2015-06-25 11:50:19.614 | libXevie x86_64 1.0.3-7.1.el7 base 18 k 2015-06-25 11:50:19.614 | libgusb x86_64 0.1.6-3.el7 base 33 k 2015-06-25 11:50:19.614 | libseccomp x86_64 2.1.1-2.el7 base 40 k 2015-06-25 11:50:19.614 | qemu-common x86_64 2:2.0.0-1.el7.5 epel 236 k 2015-06-25 11:50:19.614 | qemu-kvm-common x86_64 10:1.5.3-86.el7_1.2 updates 367 k 2015-06-25 11:50:19.614 | seavgabios-bin noarch 1.7.5-8.el7 base 31 k 2015-06-25 11:50:19.614 | sgabios-bin noarch 1:0.20110622svn-4.el7 base 7.1 k 2015-06-25 11:50:19.614 | spice-server x86_64 0.12.4-9.el7 base 378 k 2015-06-25 11:50:19.614 | usbredir x86_64 0.6-7.el7 base 44 k 2015-06-25 11:50:19.614 | vte3 x86_64 0.34.6-3.el7 base 333 k --- [1] http://logs.openstack.org/90/194090/2/check/check-tempest-dsvm-centos7/8307894/logs/screen-n-cpu.txt.gz [2] http://logs.openstack.org/90/194090/2/check/check-tempest-dsvm-centos7/8307894/logs/devstacklog.txt.gz
from a working run a little while ago; --- 2015-06-22 20:54:54.105 | ================================================================================ 2015-06-22 20:54:54.105 | Package Arch Version Repository Size 2015-06-22 20:54:54.105 | ================================================================================ 2015-06-22 20:54:54.105 | Installing: 2015-06-22 20:54:54.105 | qemu-system-x86 x86_64 2:2.0.0-1.el7.3 epel 3.4 M 2015-06-22 20:54:54.105 | Installing for dependencies: 2015-06-22 20:54:54.105 | SDL x86_64 1.2.15-11.el7 base 204 k 2015-06-22 20:54:54.105 | at-spi2-atk x86_64 2.8.1-4.el7 base 73 k 2015-06-22 20:54:54.105 | at-spi2-core x86_64 2.8.0-6.el7 base 151 k 2015-06-22 20:54:54.105 | bluez-libs x86_64 4.101-13.el7 base 90 k 2015-06-22 20:54:54.105 | brlapi x86_64 0.6.0-9.el7 base 113 k 2015-06-22 20:54:54.105 | brltty x86_64 4.5-9.el7 base 926 k 2015-06-22 20:54:54.105 | cairo-gobject x86_64 1.12.14-6.el7 base 25 k 2015-06-22 20:54:54.105 | celt051 x86_64 0.5.1.3-8.el7 base 53 k 2015-06-22 20:54:54.105 | colord-libs x86_64 1.0.4-3.el7 base 148 k 2015-06-22 20:54:54.105 | gtk3 x86_64 3.8.8-10.el7 base 3.2 M 2015-06-22 20:54:54.105 | ipxe-roms-qemu noarch 20130517-6.gitc4bce43.el7 base 559 k 2015-06-22 20:54:54.105 | libXevie x86_64 1.0.3-7.1.el7 base 18 k 2015-06-22 20:54:54.105 | libgusb x86_64 0.1.6-3.el7 base 33 k 2015-06-22 20:54:54.105 | libseccomp x86_64 2.1.1-2.el7 base 40 k 2015-06-22 20:54:54.105 | qemu-common x86_64 2:2.0.0-1.el7.3 epel 236 k 2015-06-22 20:54:54.105 | qemu-kvm-common x86_64 10:1.5.3-86.el7_1.2 updates 367 k 2015-06-22 20:54:54.105 | seavgabios-bin noarch 1.7.5-8.el7 base 31 k 2015-06-22 20:54:54.105 | sgabios-bin noarch 1:0.20110622svn-4.el7 base 7.1 k 2015-06-22 20:54:54.106 | spice-server x86_64 0.12.4-9.el7 base 378 k 2015-06-22 20:54:54.106 | usbredir x86_64 0.6-7.el7 base 44 k 2015-06-22 20:54:54.106 | vte3 x86_64 0.34.6-3.el7 base 333 k ----
ok, sorry figuring this out as I go along here. the .3 and .5 release are the same in this respect; both have the broken symlinks to the bios. I think I know what happened ... devstack recently stopped supporting file-injection and so we've stopped installing python-libguestfs the package dependency chain there was: python-libguestfs -> libvirt-daemon-kvm -> qemu-kvm -> seabios-bin thus by the time we started any vm's, we had seabios-bin package installed and the symlinks no longer dangled. So the root cause is qemu-system-x86 has those symlinks and doesn't specify a dependency to satisfy them.