Description of problem: Attempting to boot an instance with config drive will result in a failure. Creating a VM: openstack server create --image rhel-guest-image-7-6-210-x86-64-qcow2 --flavor m1.medium.huge_pages_cpu_pinning_numa_node-0 --nic net-id=0f1fec4a-7e19-4bc0-ae68-5a2ec3b3ebf3 --config-drive True VM_With_Drive +-------------------------------------+-------------------------------------------------------------------------------------+ | Field | Value | +-------------------------------------+-------------------------------------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | None | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | | OS-EXT-SRV-ATTR:instance_name | | | OS-EXT-STS:power_state | NOSTATE | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | None | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | adminPass | FMCUSWxNWNQ5 | | config_drive | True | | created | 2019-06-02T20:31:53Z | | flavor | m1.medium.huge_pages_cpu_pinning_numa_node-0 (5f9dfd5a-64d8-44fb-81f2-5454c016ee8c) | | hostId | | | id | 6c78eded-467a-4b2a-a076-065e9890b471 | | image | rhel-guest-image-7-6-210-x86-64-qcow2 (9ddac525-9f5e-44e6-b04e-3941a6015578) | | key_name | None | | name | VM_With_Drive | | progress | 0 | | project_id | 8853232491a041c0b626fe084e63e7f7 | | properties | | | security_groups | name='default' | | status | BUILD | | updated | 2019-06-02T20:31:53Z | | user_id | f98c35162e2b4cc1b22ea915b0773268 | | volumes_attached | | +-------------------------------------+-------------------------------------------------------------------------------------+ Instance will fail to spawn: openstack server show VM_With_Drive +-------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value | +-------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | None | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | | OS-EXT-SRV-ATTR:instance_name | instance-00000015 | | OS-EXT-STS:power_state | NOSTATE | | OS-EXT-STS:task_state | None | | OS-EXT-STS:vm_state | error | | OS-SRV-USG:launched_at | None | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | config_drive | True | | created | 2019-06-02T20:31:53Z | | fault | {'code': 500, 'created': '2019-06-02T20:32:09Z', 'message': 'Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 6c78eded-467a-4b2a-a076-065e9890b471.', 'details': ' File "/usr/lib/python3.6/site-packages/nova/conductor/manager.py", line 627, in build_instances\n raise exception.MaxRetriesExceeded(reason=msg)\n'} | | flavor | m1.medium.huge_pages_cpu_pinning_numa_node-0 (5f9dfd5a-64d8-44fb-81f2-5454c016ee8c) | | hostId | | | id | 6c78eded-467a-4b2a-a076-065e9890b471 | | image | rhel-guest-image-7-6-210-x86-64-qcow2 (9ddac525-9f5e-44e6-b04e-3941a6015578) | | key_name | None | | name | VM_With_Drive | | project_id | 8853232491a041c0b626fe084e63e7f7 | | properties | | | status | ERROR | | updated | 2019-06-02T20:32:09Z | | user_id | f98c35162e2b4cc1b22ea915b0773268 | | volumes_attached | | +-------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ Which will result in the following error in nova-compute.log on compute node: 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] Traceback (most recent call last): 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 2474, in _build_resources 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] yield resources 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 2235, in _build_and_run_instance 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] block_device_info=block_device_info) 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 3172, in spawn 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] destroy_disks_on_failure=True) 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 5729, in _create_domain_and_network 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] destroy_disks_on_failure) 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] self.force_reraise() 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] six.reraise(self.type_, self.value, self.tb) 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] raise value 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 5698, in _create_domain_and_network 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] post_xml_callback=post_xml_callback) 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 5626, in _create_domain 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] guest = libvirt_guest.Guest.create(xml, self._host) 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/guest.py", line 129, in create 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] encodeutils.safe_decode(xml)) 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__ 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] self.force_reraise() 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] six.reraise(self.type_, self.value, self.tb) 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] raise value 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/guest.py", line 125, in create 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] guest = host.write_instance_config(xml) 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/host.py", line 869, in write_instance_config 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] domain = self.get_connection().defineXML(xml) 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/eventlet/tpool.py", line 190, in doit 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] result = proxy_call(self._autowrap, f, *args, **kwargs) 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/eventlet/tpool.py", line 148, in proxy_call 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] rv = execute(f, *args, **kwargs) 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/eventlet/tpool.py", line 129, in execute 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] six.reraise(c, e, tb) 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] raise value 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib/python3.6/site-packages/eventlet/tpool.py", line 83, in tworker 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] rv = meth(*args, **kwargs) 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] File "/usr/lib64/python3.6/site-packages/libvirt.py", line 3752, in defineXML 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] if ret is None:raise libvirtError('virDomainDefineXML() failed', conn=self) 2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] libvirt.libvirtError: unsupported configuration: IDE controllers are unsupported for this QEMU binary or machine type Instance XML definition: <domain type="kvm"> <uuid>6c78eded-467a-4b2a-a076-065e9890b471</uuid> <name>instance-00000015</name> <memory>8388608</memory> <memoryBacking> <hugepages> <page size="1048576" nodeset="0" unit="KiB"/> </hugepages> </memoryBacking> <numatune> <memory mode="strict" nodeset="0"/> <memnode cellid="0" mode="strict" nodeset="0"/> </numatune> <vcpu>6</vcpu> <metadata> <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.0"> <nova:package version="19.0.1-0.20190528131506.498608c.el8ost"/> <nova:name>VM_With_Drive</nova:name> <nova:creationTime>2019-06-02 20:32:05</nova:creationTime> <nova:flavor name="m1.medium.huge_pages_cpu_pinning_numa_node-0"> <nova:memory>8192</nova:memory> <nova:disk>20</nova:disk> <nova:swap>0</nova:swap> <nova:ephemeral>0</nova:ephemeral> <nova:vcpus>6</nova:vcpus> </nova:flavor> <nova:owner> <nova:user uuid="f98c35162e2b4cc1b22ea915b0773268">admin</nova:user> <nova:project uuid="8853232491a041c0b626fe084e63e7f7">admin</nova:project> </nova:owner> <nova:root type="image" uuid="9ddac525-9f5e-44e6-b04e-3941a6015578"/> </nova:instance> </metadata> <sysinfo type="smbios"> <system> <entry name="manufacturer">Red Hat</entry> <entry name="product">OpenStack Compute</entry> <entry name="version">19.0.1-0.20190528131506.498608c.el8ost</entry> <entry name="serial">6c78eded-467a-4b2a-a076-065e9890b471</entry> <entry name="uuid">6c78eded-467a-4b2a-a076-065e9890b471</entry> <entry name="family">Virtual Machine</entry> </system> </sysinfo> <os> <type machine="pc-q35-rhel8.0.0">hvm</type> <boot dev="hd"/> <smbios mode="sysinfo"/> </os> <features> <acpi/> <apic/> </features> <cputune> <shares>6144</shares> <emulatorpin cpuset="0-1,20-21"/> <vcpupin vcpu="0" cpuset="10"/> <vcpupin vcpu="1" cpuset="30"/> <vcpupin vcpu="2" cpuset="16"/> <vcpupin vcpu="3" cpuset="36"/> <vcpupin vcpu="4" cpuset="34"/> <vcpupin vcpu="5" cpuset="14"/> </cputune> <clock offset="utc"> <timer name="pit" tickpolicy="delay"/> <timer name="rtc" tickpolicy="catchup"/> <timer name="hpet" present="no"/> </clock> <cpu mode="host-model" match="exact"> <topology sockets="3" cores="1" threads="2"/> <numa> <cell id="0" cpus="0-5" memory="8388608" memAccess="shared"/> </numa> </cpu> <devices> <disk type="file" device="disk"> <driver name="qemu" type="qcow2" cache="none"/> <source file="/var/lib/nova/instances/6c78eded-467a-4b2a-a076-065e9890b471/disk"/> <target bus="virtio" dev="vda"/> </disk> <disk type="file" device="cdrom"> <driver name="qemu" type="raw" cache="none"/> <source file="/var/lib/nova/instances/6c78eded-467a-4b2a-a076-065e9890b471/disk.config"/> <target bus="ide" dev="hda"/> </disk> <interface type="vhostuser"> <mac address="fa:16:3e:cf:5b:3f"/> <model type="virtio"/> <driver rx_queue_size="1024" tx_queue_size="1024"/> <source mode="server" path="/var/lib/vhost_sockets/vhu8a1c31df-9c" type="unix"/> </interface> <serial type="pty"> <log file="/var/lib/nova/instances/6c78eded-467a-4b2a-a076-065e9890b471/console.log" append="off"/> </serial> <input type="tablet" bus="usb"/> <graphics type="vnc" autoport="yes" listen="10.20.151.185"/> <video> <model type="cirrus"/> </video> <memballoon model="virtio"> <stats period="10"/> </memballoon> </devices> </domain> Creation of instance without config drive will be successful: openstack server create --image rhel-guest-image-7-6-210-x86-64-qcow2 --flavor m1.medium.huge_pages_cpu_pinning_numa_node-0 --nic net-id=0f1fec4a-7e19-4bc0-ae68-5a2ec3b3ebf3 VM_Without_Drive openstack server list +--------------------------------------+------------------+--------+-------------------------------+---------------------------------------+----------------------------------------------+ | ID | Name | Status | Networks | Image | Flavor | +--------------------------------------+------------------+--------+-------------------------------+---------------------------------------+----------------------------------------------+ | f7d7ffc8-5bb2-4baf-89f6-86e12c5dff8b | VM_Without_Drive | ACTIVE | external-network=10.35.141.84 | rhel-guest-image-7-6-210-x86-64-qcow2 | m1.medium.huge_pages_cpu_pinning_numa_node-0 | | 6c78eded-467a-4b2a-a076-065e9890b471 | VM_With_Drive | ERROR | | rhel-guest-image-7-6-210-x86-64-qcow2 | m1.medium.huge_pages_cpu_pinning_numa_node-0 | +--------------------------------------+------------------+--------+-------------------------------+---------------------------------------+----------------------------------------------+ Version-Release number of selected component (if applicable): [root@compute-0 nova]# rpm -qa | grep nova puppet-nova-14.4.1-0.20190522120356.f1a083f.el8ost.noarch python3-novaclient-13.0.0-0.20190416130354.62bf880.el8ost.noarch ()[root@compute-0 /]# rpm -qa | grep qemu qemu-kvm-block-iscsi-3.1.0-20.module+el8+2888+cdc893a8.x86_64 qemu-kvm-block-ssh-3.1.0-20.module+el8+2888+cdc893a8.x86_64 qemu-kvm-block-curl-3.1.0-20.module+el8+2888+cdc893a8.x86_64 qemu-kvm-block-gluster-3.1.0-20.module+el8+2888+cdc893a8.x86_64 ipxe-roms-qemu-20181214-1.git133f4c47.el8.noarch qemu-kvm-3.1.0-20.module+el8+2888+cdc893a8.x86_64 qemu-kvm-block-rbd-3.1.0-20.module+el8+2888+cdc893a8.x86_64 libvirt-daemon-driver-qemu-5.0.0-7.module+el8+2887+effa3c42.x86_64 qemu-kvm-core-3.1.0-20.module+el8+2888+cdc893a8.x86_64 qemu-kvm-common-3.1.0-20.module+el8+2888+cdc893a8.x86_64 qemu-img-3.1.0-20.module+el8+2888+cdc893a8.x86_64 How reproducible: Always Steps to Reproduce: 1. Spawn instance with config drive Actual results: Instance fails to spawn Expected results: Instance is created successfully Additional info: Will attach SOS report in comments.
*** This bug has been marked as a duplicate of bug 1716358 ***