Bug 1716221 - [OSP15] Fail To Spawn Guest Instance With Config Drive
Summary: [OSP15] Fail To Spawn Guest Instance With Config Drive
Keywords:
Status: CLOSED DUPLICATE of bug 1716358
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-nova
Version: 15.0 (Stein)
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: beta
: ---
Assignee: OSP DFG:Compute
QA Contact: OSP DFG:Compute
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2019-06-02 20:43 UTC by Vadim Khitrin
Modified: 2023-03-21 19:20 UTC (History)
10 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2019-06-04 07:37:37 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker OSP-23464 0 None None None 2023-03-21 19:20:30 UTC

Description Vadim Khitrin 2019-06-02 20:43:13 UTC
Description of problem:
Attempting to boot an instance with config drive will result in a failure.
Creating a VM:
openstack server create --image rhel-guest-image-7-6-210-x86-64-qcow2 --flavor m1.medium.huge_pages_cpu_pinning_numa_node-0 --nic net-id=0f1fec4a-7e19-4bc0-ae68-5a2ec3b3ebf3 --config-drive True VM_With_Drive
+-------------------------------------+-------------------------------------------------------------------------------------+
| Field                               | Value                                                                               |
+-------------------------------------+-------------------------------------------------------------------------------------+
| OS-DCF:diskConfig                   | MANUAL                                                                              |
| OS-EXT-AZ:availability_zone         |                                                                                     |
| OS-EXT-SRV-ATTR:host                | None                                                                                |
| OS-EXT-SRV-ATTR:hypervisor_hostname | None                                                                                |
| OS-EXT-SRV-ATTR:instance_name       |                                                                                     |
| OS-EXT-STS:power_state              | NOSTATE                                                                             |
| OS-EXT-STS:task_state               | scheduling                                                                          |
| OS-EXT-STS:vm_state                 | building                                                                            |
| OS-SRV-USG:launched_at              | None                                                                                |
| OS-SRV-USG:terminated_at            | None                                                                                |
| accessIPv4                          |                                                                                     |
| accessIPv6                          |                                                                                     |
| addresses                           |                                                                                     |
| adminPass                           | FMCUSWxNWNQ5                                                                        |
| config_drive                        | True                                                                                |
| created                             | 2019-06-02T20:31:53Z                                                                |
| flavor                              | m1.medium.huge_pages_cpu_pinning_numa_node-0 (5f9dfd5a-64d8-44fb-81f2-5454c016ee8c) |
| hostId                              |                                                                                     |
| id                                  | 6c78eded-467a-4b2a-a076-065e9890b471                                                |
| image                               | rhel-guest-image-7-6-210-x86-64-qcow2 (9ddac525-9f5e-44e6-b04e-3941a6015578)        |
| key_name                            | None                                                                                |
| name                                | VM_With_Drive                                                                       |
| progress                            | 0                                                                                   |
| project_id                          | 8853232491a041c0b626fe084e63e7f7                                                    |
| properties                          |                                                                                     |
| security_groups                     | name='default'                                                                      |
| status                              | BUILD                                                                               |
| updated                             | 2019-06-02T20:31:53Z                                                                |
| user_id                             | f98c35162e2b4cc1b22ea915b0773268                                                    |
| volumes_attached                    |                                                                                     |
+-------------------------------------+-------------------------------------------------------------------------------------+
Instance will fail to spawn:
openstack server show VM_With_Drive
+-------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Field                               | Value
                                                                                                   |
+-------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| OS-DCF:diskConfig                   | MANUAL
                                                                                                   |
| OS-EXT-AZ:availability_zone         |
                                                                                                   |
| OS-EXT-SRV-ATTR:host                | None
                                                                                                   |
| OS-EXT-SRV-ATTR:hypervisor_hostname | None
                                                                                                   |
| OS-EXT-SRV-ATTR:instance_name       | instance-00000015
                                                                                                   |
| OS-EXT-STS:power_state              | NOSTATE
                                                                                                   |
| OS-EXT-STS:task_state               | None
                                                                                                   |
| OS-EXT-STS:vm_state                 | error
                                                                                                   |
| OS-SRV-USG:launched_at              | None
                                                                                                   |
| OS-SRV-USG:terminated_at            | None
                                                                                                   |
| accessIPv4                          |
                                                                                                   |
| accessIPv6                          |
                                                                                                   |
| addresses                           |
                                                                                                   |
| config_drive                        | True
                                                                                                   |
| created                             | 2019-06-02T20:31:53Z
                                                                                                   |
| fault                               | {'code': 500, 'created': '2019-06-02T20:32:09Z', 'message': 'Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 6c78eded-467a-4b2a-a076-065e9890b471.', 'details': '  File "/usr/lib/python3.6/site-packages/nova/conductor/manager.py", line 627, in build_instances\n    raise exception.MaxRetriesExceeded(reason=msg)\n'} |
| flavor                              | m1.medium.huge_pages_cpu_pinning_numa_node-0 (5f9dfd5a-64d8-44fb-81f2-5454c016ee8c)
                                                                                                   |
| hostId                              |
                                                                                                   |
| id                                  | 6c78eded-467a-4b2a-a076-065e9890b471
                                                                                                   |
| image                               | rhel-guest-image-7-6-210-x86-64-qcow2 (9ddac525-9f5e-44e6-b04e-3941a6015578)
                                                                                                   |
| key_name                            | None
                                                                                                   |
| name                                | VM_With_Drive
                                                                                                   |
| project_id                          | 8853232491a041c0b626fe084e63e7f7
                                                                                                   |
| properties                          |
                                                                                                   |
| status                              | ERROR
                                                                                                   |
| updated                             | 2019-06-02T20:32:09Z
                                                                                                   |
| user_id                             | f98c35162e2b4cc1b22ea915b0773268
                                                                                                   |
| volumes_attached                    |
                                                                                                   |
+-------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
Which will result in the following error in nova-compute.log on compute node:
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] Traceback (most recent call last):
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 2474, in _build_resources
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     yield resources
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 2235, in _build_and_run_instance
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     block_device_info=block_device_info)
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 3172, in spawn
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     destroy_disks_on_failure=True)
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 5729, in _create_domain_and_network
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     destroy_disks_on_failure)
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     self.force_reraise()
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     six.reraise(self.type_, self.value, self.tb)
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     raise value
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 5698, in _create_domain_and_network
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     post_xml_callback=post_xml_callback)
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 5626, in _create_domain
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     guest = libvirt_guest.Guest.create(xml, self._host)
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/guest.py", line 129, in create
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     encodeutils.safe_decode(xml))
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     self.force_reraise()
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     six.reraise(self.type_, self.value, self.tb)
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     raise value
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/guest.py", line 125, in create
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     guest = host.write_instance_config(xml)
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/host.py", line 869, in write_instance_config
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     domain = self.get_connection().defineXML(xml)
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/eventlet/tpool.py", line 190, in doit
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     result = proxy_call(self._autowrap, f, *args, **kwargs)
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/eventlet/tpool.py", line 148, in proxy_call
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     rv = execute(f, *args, **kwargs)
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/eventlet/tpool.py", line 129, in execute
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     six.reraise(c, e, tb)
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     raise value
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib/python3.6/site-packages/eventlet/tpool.py", line 83, in tworker
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     rv = meth(*args, **kwargs)
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]   File "/usr/lib64/python3.6/site-packages/libvirt.py", line 3752, in defineXML
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471]     if ret is None:raise libvirtError('virDomainDefineXML() failed', conn=self)
2019-06-02 20:32:06.145 8 ERROR nova.compute.manager [instance: 6c78eded-467a-4b2a-a076-065e9890b471] libvirt.libvirtError: unsupported configuration: IDE controllers are unsupported for this QEMU binary or machine type

Instance XML definition:
<domain type="kvm">
  <uuid>6c78eded-467a-4b2a-a076-065e9890b471</uuid>
  <name>instance-00000015</name>
  <memory>8388608</memory>
  <memoryBacking>
    <hugepages>
      <page size="1048576" nodeset="0" unit="KiB"/>
    </hugepages>
  </memoryBacking>
  <numatune>
    <memory mode="strict" nodeset="0"/>
    <memnode cellid="0" mode="strict" nodeset="0"/>
  </numatune>
  <vcpu>6</vcpu>
  <metadata>
    <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.0">
      <nova:package version="19.0.1-0.20190528131506.498608c.el8ost"/>
      <nova:name>VM_With_Drive</nova:name>
      <nova:creationTime>2019-06-02 20:32:05</nova:creationTime>
      <nova:flavor name="m1.medium.huge_pages_cpu_pinning_numa_node-0">
        <nova:memory>8192</nova:memory>
        <nova:disk>20</nova:disk>
        <nova:swap>0</nova:swap>
        <nova:ephemeral>0</nova:ephemeral>
        <nova:vcpus>6</nova:vcpus>
      </nova:flavor>
      <nova:owner>
        <nova:user uuid="f98c35162e2b4cc1b22ea915b0773268">admin</nova:user>
        <nova:project uuid="8853232491a041c0b626fe084e63e7f7">admin</nova:project>
      </nova:owner>
      <nova:root type="image" uuid="9ddac525-9f5e-44e6-b04e-3941a6015578"/>
    </nova:instance>
  </metadata>
  <sysinfo type="smbios">
    <system>
      <entry name="manufacturer">Red Hat</entry>
      <entry name="product">OpenStack Compute</entry>
      <entry name="version">19.0.1-0.20190528131506.498608c.el8ost</entry>
      <entry name="serial">6c78eded-467a-4b2a-a076-065e9890b471</entry>
      <entry name="uuid">6c78eded-467a-4b2a-a076-065e9890b471</entry>
      <entry name="family">Virtual Machine</entry>
    </system>
  </sysinfo>
  <os>
    <type machine="pc-q35-rhel8.0.0">hvm</type>
    <boot dev="hd"/>
    <smbios mode="sysinfo"/>
  </os>
  <features>
    <acpi/>
    <apic/>
  </features>
  <cputune>
    <shares>6144</shares>
    <emulatorpin cpuset="0-1,20-21"/>
    <vcpupin vcpu="0" cpuset="10"/>
    <vcpupin vcpu="1" cpuset="30"/>
    <vcpupin vcpu="2" cpuset="16"/>
    <vcpupin vcpu="3" cpuset="36"/>
    <vcpupin vcpu="4" cpuset="34"/>
    <vcpupin vcpu="5" cpuset="14"/>
  </cputune>
  <clock offset="utc">
    <timer name="pit" tickpolicy="delay"/>
    <timer name="rtc" tickpolicy="catchup"/>
    <timer name="hpet" present="no"/>
  </clock>
  <cpu mode="host-model" match="exact">
    <topology sockets="3" cores="1" threads="2"/>
    <numa>
      <cell id="0" cpus="0-5" memory="8388608" memAccess="shared"/>
    </numa>
  </cpu>
  <devices>
    <disk type="file" device="disk">
      <driver name="qemu" type="qcow2" cache="none"/>
      <source file="/var/lib/nova/instances/6c78eded-467a-4b2a-a076-065e9890b471/disk"/>
      <target bus="virtio" dev="vda"/>
    </disk>
    <disk type="file" device="cdrom">
      <driver name="qemu" type="raw" cache="none"/>
      <source file="/var/lib/nova/instances/6c78eded-467a-4b2a-a076-065e9890b471/disk.config"/>
      <target bus="ide" dev="hda"/>
    </disk>
    <interface type="vhostuser">
      <mac address="fa:16:3e:cf:5b:3f"/>
      <model type="virtio"/>
      <driver rx_queue_size="1024" tx_queue_size="1024"/>
      <source mode="server" path="/var/lib/vhost_sockets/vhu8a1c31df-9c" type="unix"/>
    </interface>
    <serial type="pty">
      <log file="/var/lib/nova/instances/6c78eded-467a-4b2a-a076-065e9890b471/console.log" append="off"/>
    </serial>
    <input type="tablet" bus="usb"/>
    <graphics type="vnc" autoport="yes" listen="10.20.151.185"/>
    <video>
      <model type="cirrus"/>
    </video>
    <memballoon model="virtio">
      <stats period="10"/>
    </memballoon>
  </devices>
</domain>

Creation of instance without config drive will be successful:
openstack server create --image rhel-guest-image-7-6-210-x86-64-qcow2 --flavor m1.medium.huge_pages_cpu_pinning_numa_node-0 --nic net-id=0f1fec4a-7e19-4bc0-ae68-5a2ec3b3ebf3 VM_Without_Drive
openstack server list
+--------------------------------------+------------------+--------+-------------------------------+---------------------------------------+----------------------------------------------+
| ID                                   | Name             | Status | Networks                      | Image                                 | Flavor                                       |
+--------------------------------------+------------------+--------+-------------------------------+---------------------------------------+----------------------------------------------+
| f7d7ffc8-5bb2-4baf-89f6-86e12c5dff8b | VM_Without_Drive | ACTIVE | external-network=10.35.141.84 | rhel-guest-image-7-6-210-x86-64-qcow2 | m1.medium.huge_pages_cpu_pinning_numa_node-0 |
| 6c78eded-467a-4b2a-a076-065e9890b471 | VM_With_Drive    | ERROR  |                               | rhel-guest-image-7-6-210-x86-64-qcow2 | m1.medium.huge_pages_cpu_pinning_numa_node-0 |
+--------------------------------------+------------------+--------+-------------------------------+---------------------------------------+----------------------------------------------+

Version-Release number of selected component (if applicable):
[root@compute-0 nova]# rpm -qa | grep nova
puppet-nova-14.4.1-0.20190522120356.f1a083f.el8ost.noarch
python3-novaclient-13.0.0-0.20190416130354.62bf880.el8ost.noarch

()[root@compute-0 /]# rpm -qa | grep qemu
qemu-kvm-block-iscsi-3.1.0-20.module+el8+2888+cdc893a8.x86_64
qemu-kvm-block-ssh-3.1.0-20.module+el8+2888+cdc893a8.x86_64
qemu-kvm-block-curl-3.1.0-20.module+el8+2888+cdc893a8.x86_64
qemu-kvm-block-gluster-3.1.0-20.module+el8+2888+cdc893a8.x86_64
ipxe-roms-qemu-20181214-1.git133f4c47.el8.noarch
qemu-kvm-3.1.0-20.module+el8+2888+cdc893a8.x86_64
qemu-kvm-block-rbd-3.1.0-20.module+el8+2888+cdc893a8.x86_64
libvirt-daemon-driver-qemu-5.0.0-7.module+el8+2887+effa3c42.x86_64
qemu-kvm-core-3.1.0-20.module+el8+2888+cdc893a8.x86_64
qemu-kvm-common-3.1.0-20.module+el8+2888+cdc893a8.x86_64
qemu-img-3.1.0-20.module+el8+2888+cdc893a8.x86_64

How reproducible:
Always

Steps to Reproduce:
1. Spawn instance with config drive

Actual results:
Instance fails to spawn

Expected results:
Instance is created successfully

Additional info:
Will attach SOS report in comments.

Comment 6 Lee Yarwood 2019-06-04 07:37:37 UTC

*** This bug has been marked as a duplicate of bug 1716358 ***


Note You need to log in before you can comment on or make changes to this bug.