Description of problem: VM booted with nova command goes to ERROR state when testing hidden images (bz 1552591); can't run on any compute nodes Version-Release number of selected component (if applicable): [heat-admin@compute-0 ~]$ rpm -qa | grep nova python2-novaclient-11.0.0-0.20180809174649.f1005ce.el7ost.noarch puppet-nova-13.3.1-0.20181013120141.8ab435c.el7ost.noarch [heat-admin@compute-0 ~]$ How reproducible: always Steps to Reproduce: 1. glance image-create --name cirros-test3 --disk-format qcow2 --container-format bare --file ./cirros-0.3.5-x86_64-disk.img 2. nova boot --nic net-id=184a687f-4b6b-4c41-ac79-f3475989d4f7 --flavor m2.tiny --image da4ca6d6-14d2-4fb5-ba78-22f851ed6102 test-hidden-false 3. nova list Actual results: (overcloud) [stack@undercloud-0 ~]$ nova boot --nic net-id=184a687f-4b6b-4c41-ac79-f3475989d4f7 --flavor m2.tiny --image da4ca6d6-14d2-4fb5-ba78-22f851ed6102 test-hidden-false +--------------------------------------+-----------------------------------------------------+ | Property | Value | +--------------------------------------+-----------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | - | | OS-EXT-SRV-ATTR:hostname | test-hidden-false | | OS-EXT-SRV-ATTR:hypervisor_hostname | - | | OS-EXT-SRV-ATTR:instance_name | | | OS-EXT-SRV-ATTR:kernel_id | | | OS-EXT-SRV-ATTR:launch_index | 0 | | OS-EXT-SRV-ATTR:ramdisk_id | | | OS-EXT-SRV-ATTR:reservation_id | r-7ap6w3af | | OS-EXT-SRV-ATTR:root_device_name | - | | OS-EXT-SRV-ATTR:user_data | - | | OS-EXT-STS:power_state | 0 | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | buihttp://paste.openstack.org/show/732573/lding | | OS-SRV-USG:launched_at | - | | OS-SRV-USG:terminated_at | - | | accessIPv4 | | | accessIPv6 | | | adminPass | zRR57p775qSg | | config_drive | | | created | 2018-10-22T07:10:19Z | | description | - | | flavor:disk | 10 | | flavor:ephemeral | 0 | | flavor:extra_specs | {} | | flavor:original_name | m2.tiny | | flavor:ram | 1024 | | flavor:swap | 2048 | | flavor:vcpus | 1 | | hostId | | | host_status | | | id | e5dde36a-1269-45d9-a73b-15aee19efd01 | | image | cirros-test3 (da4ca6d6-14d2-4fb5-ba78-22f851ed6102) | | key_name | - | | locked | False | | metadata | {} | | name | test-hidden-false | | os-extended-volumes:volumes_attached | [] | | progress | 0 | | security_groups | default | | status | BUILD | | tags | [] | | tenant_id | 412335f180c04c24a625aabaaf266c5f | | trusted_image_certificates | - | | updated | 2018-10-22T07:10:19Z | | user_id | d3520ebb8aab41f488552ac3d8c6433f | +--------------------------------------+-----------------------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ nova list +--------------------------------------+-------------------+--------+------------+-------------+----------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+-------------------+--------+------------+-------------+----------+ | e5dde36a-1269-45d9-a73b-15aee19efd01 | test-hidden-false | BUILD | spawning | NOSTATE | | +--------------------------------------+-------------------+--------+------------+-------------+----------+ (overcloud) [stack@undercloud-0 ~]$ nova list +--------------------------------------+-------------------+--------+------------+-------------+-------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+-------------------+--------+------------+-------------+-------------------+ | e5dde36a-1269-45d9-a73b-15aee19efd01 | test-hidden-false | BUILD | spawning | NOSTATE | public=10.0.0.218 | +--------------------------------------+-------------------+--------+------------+-------------+-------------------+ (overcloud) [stack@undercloud-0 ~]$ nova list +--------------------------------------+-------------------+--------+----------------------+-------------+----------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+-------------------+--------+----------------------+-------------+----------+ | e5dde36a-1269-45d9-a73b-15aee19efd01 | test-hidden-false | BUILD | block_device_mapping | NOSTATE | | +--------------------------------------+-------------------+--------+----------------------+-------------+----------+ (overcloud) [stack@undercloud-0 ~]$ nova list +--------------------------------------+-------------------+--------+------------+-------------+----------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+-------------------+--------+------------+-------------+----------+ | e5dde36a-1269-45d9-a73b-15aee19efd01 | test-hidden-false | BUILD | spawning | NOSTATE | | +--------------------------------------+-------------------+--------+------------+-------------+----------+ (overcloud) [stack@undercloud-0 ~]$ nova list +--------------------------------------+-------------------+--------+------------+-------------+-------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+-------------------+--------+------------+-------------+-------------------+ | e5dde36a-1269-45d9-a73b-15aee19efd01 | test-hidden-false | BUILD | spawning | NOSTATE | public=10.0.0.212 | +--------------------------------------+-------------------+--------+------------+-------------+-------------------+ (overcloud) [stack@undercloud-0 ~]$ nova list +--------------------------------------+-------------------+--------+------------+-------------+----------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+-------------------+--------+------------+-------------+----------+ | e5dde36a-1269-45d9-a73b-15aee19efd01 | test-hidden-false | ERROR | - | NOSTATE | | +--------------------------------------+-------------------+--------+------------+-------------+----------+ (overcloud) [stack@undercloud-0 ~]$ Expected results: VM should boot to ACTIVE state Additional info: http://paste.openstack.org/show/732573/
I was not able to reproduce the error with the given steps, my instance booted correctly and reached ACTIVE normally. Can you include more details about your deployment? * Are you running HA? Ceph? * Any particular config you should mention? * Did you leave the setup idle over long periods of time (like a weekend)?
Hidden images seem to work as intended on my setup: 1. instances boot normally on an image --hidden false 2. instances cannot boot on an image --hidden true. Image won't appear on `openstack image list` 1. Using existing images ======================== (overcloud) [stack@undercloud-0 ~]$ glance image-list +--------------------------------------+----------------------------------+ | ID | Name | +--------------------------------------+----------------------------------+ | 460aef6d-d86e-4793-b7e9-e8b539206f4c | cirros | | a8b1fbac-c65a-490c-835d-2914362366b7 | cirros-0.3.5-x86_64-disk.img | | 32064eef-70be-4b3a-b8e1-243e1901dae9 | cirros-0.3.5-x86_64-disk.img_alt | | 71ba566d-bcf0-475b-887a-f547ed5337d0 | cirros-test3 | +--------------------------------------+----------------------------------+ 2. Boot on image --hidden false =============================== (overcloud) [stack@undercloud-0 ~]$ glance image-update 460aef6d-d86e-4793-b7e9-e8b539206f4c --hidden 'false' +------------------+----------------------------------------------------------------------------------+ | Property | Value | +------------------+----------------------------------------------------------------------------------+ | checksum | f8ab98ff5e73ebab884d80c9dc9c7290 | | container_format | bare | | created_at | 2018-10-23T07:58:01Z | | direct_url | swift+config://ref1/glance/460aef6d-d86e-4793-b7e9-e8b539206f4c | | disk_format | qcow2 | | id | 460aef6d-d86e-4793-b7e9-e8b539206f4c | | min_disk | 0 | | min_ram | 0 | | name | cirros | | os_hash_algo | sha512 | | os_hash_value | f0fd1b50420dce4ca382ccfbb528eef3a38bbeff00b54e95e3876b9bafe7ed2d6f919ca35d9046d4 | | | 37c6d2d8698b1174a335fbd66035bb3edc525d2cdb187232 | | os_hidden | False | | owner | e5b211383f70461486bf7a1142411ac8 | | protected | False | | size | 13267968 | | status | active | | tags | [] | | updated_at | 2018-10-23T07:58:03Z | | virtual_size | Not available | | visibility | shared | +------------------+----------------------------------------------------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ openstack server create --flavor m1.micro --image cirros --nic net-id=074b3b76-ee80-45bb-8be8-bb09396ae158 test-hidden-false +-------------------------------------+-------------------------------------------------+ | Field | Value | +-------------------------------------+-------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | None | | OS-EXT-SRV-ATTR:hypervisor_hostname | None | | OS-EXT-SRV-ATTR:instance_name | | | OS-EXT-STS:power_state | NOSTATE | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | None | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | | | adminPass | yQxNgV97u832 | | config_drive | | | created | 2018-10-24T13:39:43Z | | flavor | m1.micro (71df93b0-8fa7-43fd-a5d5-33971205dd2c) | | hostId | | | id | 99d532a3-5330-45cb-94d4-cb0962064a92 | | image | cirros (460aef6d-d86e-4793-b7e9-e8b539206f4c) | | key_name | None | | name | test-hidden-false | | progress | 0 | | project_id | e5b211383f70461486bf7a1142411ac8 | | properties | | | security_groups | name='default' | | status | BUILD | | updated | 2018-10-24T13:39:43Z | | user_id | a40b42e94db1401eb8419bc6daffa5e7 | | volumes_attached | | +-------------------------------------+-------------------------------------------------+ Instance boots normally ----------------------- (overcloud) [stack@undercloud-0 ~]$ openstack server show test-hidden-false | grep status | status | ACTIVE | 3. Boot instance on --hidden true image ======================================= (overcloud) [stack@undercloud-0 ~]$ glance image-update 460aef6d-d86e-4793-b7e9-e8b539206f4c --hidden 'true' +------------------+----------------------------------------------------------------------------------+ | Property | Value | +------------------+----------------------------------------------------------------------------------+ | checksum | f8ab98ff5e73ebab884d80c9dc9c7290 | | container_format | bare | | created_at | 2018-10-23T07:58:01Z | | direct_url | swift+config://ref1/glance/460aef6d-d86e-4793-b7e9-e8b539206f4c | | disk_format | qcow2 | | id | 460aef6d-d86e-4793-b7e9-e8b539206f4c | | min_disk | 0 | | min_ram | 0 | | name | cirros | | os_hash_algo | sha512 | | os_hash_value | f0fd1b50420dce4ca382ccfbb528eef3a38bbeff00b54e95e3876b9bafe7ed2d6f919ca35d9046d4 | | | 37c6d2d8698b1174a335fbd66035bb3edc525d2cdb187232 | | os_hidden | True | | owner | e5b211383f70461486bf7a1142411ac8 | | protected | False | | size | 13267968 | | status | active | | tags | [] | | updated_at | 2018-10-24T13:42:10Z | | virtual_size | Not available | | visibility | shared | +------------------+----------------------------------------------------------------------------------+ User cannot list image ----------------------- (overcloud) [stack@undercloud-0 ~]$ openstack server create --flavor m1.micro --image cirros --nic net-id=074b3b76-ee80-45bb-8be8-bb09396ae158 test-hidden-true Could not find resource cirros (overcloud) [stack@undercloud-0 ~]$ openstack image list +--------------------------------------+----------------------------------+--------+ | ID | Name | Status | +--------------------------------------+----------------------------------+--------+ | a8b1fbac-c65a-490c-835d-2914362366b7 | cirros-0.3.5-x86_64-disk.img | active | | 32064eef-70be-4b3a-b8e1-243e1901dae9 | cirros-0.3.5-x86_64-disk.img_alt | active | | 71ba566d-bcf0-475b-887a-f547ed5337d0 | cirros-test3 | active | +--------------------------------------+----------------------------------+--------+