Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1480187

Summary: Cannot remove host from aggregate if host has been deleted
Product: Red Hat OpenStack Reporter: Robin Cernin <rcernin>
Component: openstack-novaAssignee: Sahid Ferdjaoui <sferdjao>
Status: CLOSED ERRATA QA Contact: Joe H. Rahme <jhakimra>
Severity: medium Docs Contact:
Priority: medium    
Version: 8.0 (Liberty)CC: awaugama, berrange, ccollett, dasmith, eglynn, kchamart, owalsh, sbauza, sferdjao, sgordon, srevivo, vasili.namatov, vromanso
Target Milestone: zstreamKeywords: Triaged, ZStream
Target Release: 8.0 (Liberty)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-nova-12.0.6-17.el7ost Doc Type: Bug Fix
Doc Text:
Previously, removing a compute node from service before removing it from aggregate zones would cause the operation to fail. This is because it was not possible to remove the deleted host from the aggregate. With this update, when removing a host from service, the process also removes the host from all aggregates and the operation no longer fails.
Story Points: ---
Clone Of:
: 1480451 (view as bug list) Environment:
Last Closed: 2017-09-12 17:12:16 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1480451    

Description Robin Cernin 2017-08-10 11:13:33 UTC
Description of problem:

https://bugs.launchpad.net/nova/+bug/1470341 patch at https://review.openstack.org/#/c/306192/


Version-Release number of selected component (if applicable):

python-nova-12.0.4-16.el7ost.noarch
openstack-nova-conductor-12.0.4-16.el7ost.noarch
openstack-nova-compute-12.0.4-16.el7ost.noarch
openstack-nova-api-12.0.4-16.el7ost.noarch
python-novaclient-3.1.0-2.el7ost.noarch
openstack-nova-novncproxy-12.0.4-16.el7ost.noarch
openstack-nova-cert-12.0.4-16.el7ost.noarch
openstack-nova-console-12.0.4-16.el7ost.noarch
openstack-nova-common-12.0.4-16.el7ost.noarch
openstack-nova-scheduler-12.0.4-16.el7ost.noarch

Comment 3 Vasili Namatov 2017-08-10 12:28:56 UTC
We found that we don’t have compute-0 on this list, so for compute-0 it worked successfully! Means that aggregate remove works. You can check it in the past logs few days ago! We missed the correct order after first scale-in, so let’s try to do some workaround here for these specific computes into aggregate list.

Best,
Vasili

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------+
| Id | Name  | Availability Zone | Hosts                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         | Metadata                  |
+----+-------+-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------+
| 2  | zone1 | zone1             | 'overcloud-compute-10.localdomain', 'overcloud-compute-11.localdomain', 'overcloud-compute-12.localdomain', 'overcloud-compute-13.localdomain', 'overcloud-compute-14.localdomain', 'overcloud-compute-15.localdomain', 'overcloud-compute-16.localdomain', 'overcloud-compute-17.localdomain', 'overcloud-compute-18.localdomain', 'overcloud-compute-19.localdomain', 'overcloud-compute-20.localdomain', 'overcloud-compute-21.localdomain', 'overcloud-compute-22.localdomain', 'overcloud-compute-23.localdomain', 'overcloud-compute-24.localdomain', 'overcloud-compute-25.localdomain', 'overcloud-compute-26.localdomain', 'overcloud-compute-27.localdomain', 'overcloud-compute-28.localdomain', 'overcloud-compute-29.localdomain', 'overcloud-compute-30.localdomain', 'overcloud-compute-31.localdomain', 'overcloud-compute-32.localdomain', 'overcloud-compute-33.localdomain', 'overcloud-compute-34.localdomain', 'overcloud-compute-35.localdomain', 'overcloud-compute-36.localdomain', 'overcloud-compute-37.localdomain', 'overcloud-compute-38.localdomain', 'overcloud-compute-39.localdomain', 'overcloud-compute-40.localdomain', 'overcloud-compute-41.localdomain', 'overcloud-compute-42.localdomain', 'overcloud-compute-43.localdomain', 'overcloud-compute-44.localdomain', 'overcloud-compute-45.localdomain', 'overcloud-compute-46.localdomain', 'overcloud-compute-47.localdomain', 'overcloud-compute-48.localdomain', 'overcloud-compute-49.localdomain', 'overcloud-compute-50.localdomain', 'overcloud-compute-51.localdomain', 'overcloud-compute-52.localdomain', 'overcloud-compute-53.localdomain', 'overcloud-compute-54.localdomain', 'overcloud-compute-55.localdomain', 'overcloud-compute-56.localdomain', 'overcloud-compute-57.localdomain', 'overcloud-compute-58.localdomain', 'overcloud-compute-6.localdomain', 'overcloud-compute-7.localdomain', 'overcloud-compute-8.localdomain', 'overcloud-compute-9.localdomain', 'overcloud-compute-2.localdomain', 'overcloud-compute-3.localdomain', 'overcloud-compute-1.localdomain', 'overcloud-compute-4.localdomain', 'overcloud-compute-5.localdomain' | 'availability_zone=zone1' |
+----+-------+-------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------------------------+
[stack@undercloud ~]$ nova aggregate-details single_nic_ovs_compute_nodes
+----+------------------------------+-------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+
| Id | Name                         | Availability Zone | Hosts                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          | Metadata             |
+----+------------------------------+-------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+
| 5  | single_nic_ovs_compute_nodes | -                 | 'overcloud-compute-10.localdomain', 'overcloud-compute-11.localdomain', 'overcloud-compute-12.localdomain', 'overcloud-compute-13.localdomain', 'overcloud-compute-14.localdomain', 'overcloud-compute-15.localdomain', 'overcloud-compute-16.localdomain', 'overcloud-compute-17.localdomain', 'overcloud-compute-18.localdomain', 'overcloud-compute-19.localdomain', 'overcloud-compute-20.localdomain', 'overcloud-compute-21.localdomain', 'overcloud-compute-22.localdomain', 'overcloud-compute-23.localdomain', 'overcloud-compute-24.localdomain', 'overcloud-compute-25.localdomain', 'overcloud-compute-26.localdomain', 'overcloud-compute-27.localdomain', 'overcloud-compute-28.localdomain', 'overcloud-compute-29.localdomain', 'overcloud-compute-30.localdomain', 'overcloud-compute-31.localdomain', 'overcloud-compute-32.localdomain', 'overcloud-compute-33.localdomain', 'overcloud-compute-34.localdomain', 'overcloud-compute-35.localdomain', 'overcloud-compute-36.localdomain', 'overcloud-compute-37.localdomain', 'overcloud-compute-38.localdomain', 'overcloud-compute-39.localdomain', 'overcloud-compute-40.localdomain', 'overcloud-compute-41.localdomain', 'overcloud-compute-42.localdomain', 'overcloud-compute-43.localdomain', 'overcloud-compute-44.localdomain', 'overcloud-compute-45.localdomain', 'overcloud-compute-46.localdomain', 'overcloud-compute-47.localdomain', 'overcloud-compute-48.localdomain', 'overcloud-compute-49.localdomain', 'overcloud-compute-50.localdomain', 'overcloud-compute-51.localdomain', 'overcloud-compute-52.localdomain', 'overcloud-compute-53.localdomain', 'overcloud-compute-54.localdomain', 'overcloud-compute-55.localdomain', 'overcloud-compute-56.localdomain', 'overcloud-compute-57.localdomain', 'overcloud-compute-58.localdomain', 'overcloud-compute-6.localdomain', 'overcloud-compute-7.localdomain', 'overcloud-compute-8.localdomain', 'overcloud-compute-9.localdomain' | 'cpu_isolation=True' |
+----+------------------------------+-------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Comment 4 Vasili Namatov 2017-08-10 12:53:16 UTC
Hi,

PF output :-

[stack@undercloud ~]$ nova aggregate-remove-host zone1 overcloud-compute-57.localdomain --debug
DEBUG (extension:156) found extension EntryPoint.parse('v2token = keystoneauth1.loading._plugins.identity.v2:Token')
DEBUG (extension:156) found extension EntryPoint.parse('admin_token = keystoneauth1.loading._plugins.admin_token:AdminToken')
DEBUG (extension:156) found extension EntryPoint.parse('v2password = keystoneauth1.loading._plugins.identity.v2:Password')
DEBUG (extension:156) found extension EntryPoint.parse('v3password = keystoneauth1.loading._plugins.identity.v3:Password')
DEBUG (extension:156) found extension EntryPoint.parse('token = keystoneauth1.loading._plugins.identity.generic:Token')
DEBUG (extension:156) found extension EntryPoint.parse('v3token = keystoneauth1.loading._plugins.identity.v3:Token')
DEBUG (extension:156) found extension EntryPoint.parse('password = keystoneauth1.loading._plugins.identity.generic:Password')
DEBUG (session:195) REQ: curl -g -i -X GET https://10.19.25.16:13000/v2.0 -H "Accept: application/json" -H "User-Agent: keystoneauth1"
INFO (connectionpool:735) Starting new HTTPS connection (1): 10.19.25.16
DEBUG (connectionpool:383) "GET /v2.0 HTTP/1.1" 200 339
DEBUG (session:224) RESP: [200] date: Thu, 10 Aug 2017 12:43:47 GMT vary: X-Auth-Token content-length: 339 content-type: application/json x-openstack-request-id: req-01485176-601a-48b7-89f7-7307fff135fc
RESP BODY: {"version": {"status": "stable", "updated": "2014-04-17T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v2.0+json"}], "id": "v2.0", "links": [{"href": "https://10.19.25.16:13000/v2.0/", "rel": "self"}, {"href": "http://docs.openstack.org/", "type": "text/html", "rel": "describedby"}]}}

DEBUG (v2:62) Making authentication request to https://10.19.25.16:13000/v2.0/tokens
DEBUG (connectionpool:383) "POST /v2.0/tokens HTTP/1.1" 200 3781
DEBUG (session:195) REQ: curl -g -i -X GET https://10.19.25.16:13774/v2.1/557bd200400449e6aa188b0bc81a20e6 -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}75a1da70e53d92161d93b47c7e3789f673b9e8a8"
INFO (connectionpool:735) Starting new HTTPS connection (1): 10.19.25.16
DEBUG (connectionpool:383) "GET /v2.1/557bd200400449e6aa188b0bc81a20e6 HTTP/1.1" 404 52
DEBUG (session:224) RESP: [404] date: Thu, 10 Aug 2017 12:43:47 GMT content-length: 52 content-type: text/plain; charset=UTF-8 x-compute-request-id: req-a9ecca34-94e0-4400-9d63-d0051111aa6c
RESP BODY: 404 Not Found

The resource could not be found.



DEBUG (session:195) REQ: curl -g -i -X GET https://10.19.25.16:13774/v2.1/ -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}75a1da70e53d92161d93b47c7e3789f673b9e8a8"
DEBUG (connectionpool:383) "GET /v2.1/ HTTP/1.1" 200 386
DEBUG (session:224) RESP: [200] content-length: 386 x-compute-request-id: req-20d5de29-46cd-4a33-a0b5-37e8c0374478 vary: X-OpenStack-Nova-API-Version x-openstack-nova-api-version: 2.1 date: Thu, 10 Aug 2017 12:43:47 GMT content-type: application/json
RESP BODY: {"version": {"status": "CURRENT", "updated": "2013-07-23T11:33:21Z", "links": [{"href": "http://10.19.25.16:13774/v2.1/", "rel": "self"}, {"href": "http://docs.openstack.org/", "type": "text/html", "rel": "describedby"}], "min_version": "2.1", "version": "2.12", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.compute+json;version=2.1"}], "id": "v2.1"}}

DEBUG (extension:156) found extension EntryPoint.parse('v2token = keystoneauth1.loading._plugins.identity.v2:Token')
DEBUG (extension:156) found extension EntryPoint.parse('admin_token = keystoneauth1.loading._plugins.admin_token:AdminToken')
DEBUG (extension:156) found extension EntryPoint.parse('v2password = keystoneauth1.loading._plugins.identity.v2:Password')
DEBUG (extension:156) found extension EntryPoint.parse('v3password = keystoneauth1.loading._plugins.identity.v3:Password')
DEBUG (extension:156) found extension EntryPoint.parse('token = keystoneauth1.loading._plugins.identity.generic:Token')
DEBUG (extension:156) found extension EntryPoint.parse('v3token = keystoneauth1.loading._plugins.identity.v3:Token')
DEBUG (extension:156) found extension EntryPoint.parse('password = keystoneauth1.loading._plugins.identity.generic:Password')

Comment 14 errata-xmlrpc 2017-09-12 17:12:16 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:2689