Bug 1752481

Summary: SSL Everywhere: overcloud node delete caused a different node to delete in IDM
Product: Red Hat OpenStack Reporter: Harry Rybacki <hrybacki>
Component: python-novajoinAssignee: Harry Rybacki <hrybacki>
Status: CLOSED ERRATA QA Contact: Jeremy Agee <jagee>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 15.0 (Stein)CC: jschluet, pkesavar, rcritten, rmascena
Target Milestone: z2Keywords: TestOnly, Triaged, ZStream
Target Release: 15.0 (Stein)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: python-novajoin-1.1.2-0.20190912190429.b971c78.el8ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 1752485 (view as bug list) Environment:
Last Closed: 2020-03-05 12:02:22 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1727587    
Bug Blocks:    

Description Harry Rybacki 2019-09-16 12:28:45 UTC 
This bug was initially created as a copy of Bug #1729451

I am copying this bug because: 



Description of problem:

I am able to reproduce this.

$ openstack server list
+--------------------------------------+--------------+--------+----------------------+----------------+---------+
| ID                                   | Name         | Status | Networks             | Image          | Flavor  |
+--------------------------------------+--------------+--------+----------------------+----------------+---------+
| 20cc307e-3750-4734-bb04-f282a5eebc98 | controller-1 | ACTIVE | ctlplane=172.16.0.51 | overcloud-full | control |
| 2ee08272-1ac2-4bb7-94d7-813b9d133edc | ceph-3       | ACTIVE | ctlplane=172.16.0.73 | overcloud-full | ceph    |
| e9f49c4a-f7ab-4432-b86f-7cacc0831407 | compute-2    | ACTIVE | ctlplane=172.16.0.62 | overcloud-full | compute |
| a1a94cb0-a505-4162-b8eb-330f8473749d | controller-2 | ACTIVE | ctlplane=172.16.0.52 | overcloud-full | control |
| 105635ab-8aad-48da-a564-32d1afc5ec3e | ceph-2       | ACTIVE | ctlplane=172.16.0.72 | overcloud-full | ceph    |
| e916f4e7-c2e6-4ad3-8b0b-7ab3fbada04b | controller-3 | ACTIVE | ctlplane=172.16.0.53 | overcloud-full | control |
| 7c04eed0-11b9-4bad-80c1-7f0b2e68fa44 | ceph-1       | ACTIVE | ctlplane=172.16.0.71 | overcloud-full | ceph    |
| 0790e307-ab64-436a-9d1c-d8f7fa84532a | compute-1    | ACTIVE | ctlplane=172.16.0.61 | overcloud-full | compute |
+--------------------------------------+--------------+--------+----------------------+----------------+---------+

Removed compute-2 successfully.

command: overcloud node delete -> tripleoclient.v1.overcloud_node.DeleteNode (auth=True)
Using auth plugin: password
Deleting the following nodes from stack overcloud:
- e9f49c4a-f7ab-4432-b86f-7cacc0831407
Started Mistral Workflow tripleo.scale.v1.delete_node. Execution ID: 8c0add5c-7ab9-41f5-bbc3-95fb8a4471fd
Waiting for messages on queue 'tripleo' with no timeout.



END return value: None

$ openstack stack list
+--------------------------------------+------------+----------------------------------+-----------------+----------------------+----------------------+
| ID                                   | Stack Name | Project                          | Stack Status    | Creation Time        | Updated Time         |
+--------------------------------------+------------+----------------------------------+-----------------+----------------------+----------------------+
| 05f5fbba-5930-4095-9115-792fd4b0ae13 | overcloud  | 9c57467190614b43b9609f5940f4c02b | UPDATE_COMPLETE | 2019-07-12T06:35:35Z | 2019-07-12T09:26:54Z |
+--------------------------------------+------------+----------------------------------+-----------------+----------------------+----------------------+
(undercloud) [stack@undercloud ~]$ openstack server list
+--------------------------------------+--------------+--------+----------------------+----------------+---------+
| ID                                   | Name         | Status | Networks             | Image          | Flavor  |
+--------------------------------------+--------------+--------+----------------------+----------------+---------+
| 20cc307e-3750-4734-bb04-f282a5eebc98 | controller-1 | ACTIVE | ctlplane=172.16.0.51 | overcloud-full | control |
| 2ee08272-1ac2-4bb7-94d7-813b9d133edc | ceph-3       | ACTIVE | ctlplane=172.16.0.73 | overcloud-full | ceph    |
| a1a94cb0-a505-4162-b8eb-330f8473749d | controller-2 | ACTIVE | ctlplane=172.16.0.52 | overcloud-full | control |
| 105635ab-8aad-48da-a564-32d1afc5ec3e | ceph-2       | ACTIVE | ctlplane=172.16.0.72 | overcloud-full | ceph    |
| e916f4e7-c2e6-4ad3-8b0b-7ab3fbada04b | controller-3 | ACTIVE | ctlplane=172.16.0.53 | overcloud-full | control |
| 7c04eed0-11b9-4bad-80c1-7f0b2e68fa44 | ceph-1       | ACTIVE | ctlplane=172.16.0.71 | overcloud-full | ceph    |
| 0790e307-ab64-436a-9d1c-d8f7fa84532a | compute-1    | ACTIVE | ctlplane=172.16.0.61 | overcloud-full | compute |
+--------------------------------------+--------------+--------+----------------------+----------------+---------+

compute-2 is gone. See the difference in IDM.

# cat difference.txt
--- pre-delete.txt	2019-07-12 05:20:38.270030757 -0400
+++ post-delete.txt	2019-07-12 06:22:08.845030757 -0400
@@ -1,12 +1,6 @@
 ----------------
-43 hosts matched
+31 hosts matched
 ----------------
-  Host name: ceph-1.redhat.local
-  Description: IPA host for OpenStack
-  Principal name: host/ceph-1.redhat.local
-  Principal alias: host/ceph-1.redhat.local
-  SSH public key fingerprint: SHA256:ewD2/vvX/ombUi/upE9Oi9cqLiDeHVzcOcer1bq77B4 (ssh-rsa), SHA256:Wq3JrZNOrbCrO7m0+yJShJWC3JHGBgXKa9b4bNpLfI4 (ecdsa-sha2-nistp256), SHA256:BPXGBF3S3VpBYcfHPFpGJV/xFarZQnSoBeeSKrhii3o (ssh-ed25519)
-
   Host name: ceph-2.redhat.local
   Description: IPA host for OpenStack
   Principal name: host/ceph-2.redhat.local
@@ -29,54 +23,6 @@
   Principal alias: host/compute-1.redhat.local
   SSH public key fingerprint: SHA256:KQf7hN3LLthHzJVfO/McWEH31z8em9Ys3jTBgtnEY44 (ssh-rsa), SHA256:VdNdpwdEg11yyoweDZXZCfeashbZu7Gqs4iw9bvZyEE (ecdsa-sha2-nistp256), SHA256:ZPBZdABtsRuYEyj1VNSY6PoLqFAKq/DOfNZ78w+B4sM (ssh-ed25519)
 
-  Host name: compute-2.internalapi.redhat.local
-  Principal name: host/compute-2.internalapi.redhat.local
-  Principal alias: host/compute-2.internalapi.redhat.local
-
-  Host name: compute-2.redhat.local
-  Description: IPA host for OpenStack
-  Principal name: host/compute-2.redhat.local
-  Principal alias: host/compute-2.redhat.local
-  SSH public key fingerprint: SHA256:pxTIuoUTMA7S37e+aIE/6MVUvkhdUblHRtB+1/jMHtw (ssh-rsa), SHA256:9DmjvKXRBaMptFOQ964ASaMthqm2xitqVH6X/u92riM (ecdsa-sha2-nistp256), SHA256:f+zpuNDXgYpXzRGls5NicadmOem2vsVk3Iz1HfvKPEA (ssh-ed25519)
-
-  Host name: controller-1.ctlplane.redhat.local
-  Principal name: host/controller-1.ctlplane.redhat.local
-  Principal alias: host/controller-1.ctlplane.redhat.local
-
-  Host name: controller-1.external.redhat.local
-  Principal name: host/controller-1.external.redhat.local
-  Principal alias: host/controller-1.external.redhat.local
-
-  Host name: controller-1.internalapi.redhat.local
-  Principal name: host/controller-1.internalapi.redhat.local
-  Principal alias: host/controller-1.internalapi.redhat.local
-
-  Host name: controller-1.management.redhat.local
-  Principal name: host/controller-1.management.redhat.local
-  Principal alias: host/controller-1.management.redhat.local
-
-  Host name: controller-1.ocprovisioning.redhat.local
-  Principal name: host/controller-1.ocprovisioning.redhat.local
-  Principal alias: host/controller-1.ocprovisioning.redhat.local
-
-  Host name: controller-1.redhat.local
-  Description: IPA host for OpenStack
-  Principal name: host/controller-1.redhat.local
-  Principal alias: host/controller-1.redhat.local
-  SSH public key fingerprint: SHA256:lPXrfI/QFWkTHbTLCb8H9m9ordj1r6QDCEMI1domNxk (ssh-rsa), SHA256:T0Or8sil1p7E6Er1uSAHsoGcUbMCwIEdKkf+FOT/tw8 (ecdsa-sha2-nistp256), SHA256:jg2KPcLSEsRSD5hCpelBSlgXuT6r6taLHWhlVApx0As (ssh-ed25519)
-
-  Host name: controller-1.storage.redhat.local
-  Principal name: host/controller-1.storage.redhat.local
-  Principal alias: host/controller-1.storage.redhat.local
-
-  Host name: controller-1.storagemgmt.redhat.local
-  Principal name: host/controller-1.storagemgmt.redhat.local
-  Principal alias: host/controller-1.storagemgmt.redhat.local
-
-  Host name: controller-1.storagenfs.redhat.local
-  Principal name: host/controller-1.storagenfs.redhat.local
-  Principal alias: host/controller-1.storagenfs.redhat.local
-
   Host name: controller-2.ctlplane.redhat.local
   Principal name: host/controller-2.ctlplane.redhat.local
   Principal alias: host/controller-2.ctlplane.redhat.local
@@ -192,5 +138,5 @@
   Principal alias: host/undercloud.redhat.local
   SSH public key fingerprint: SHA256:jhW+5B3Wbs8Wes8rHGswx+KsZGlgdzxhC5So6J0gNfE (ssh-rsa), SHA256:06Cf884u+dFa69I5S4JiQnT9ceth9Ieg2F82f91ZgGo (ecdsa-sha2-nistp256), SHA256:KYwrcg+r9LmKTO9HeFvDmAPgSgFFSVpMsyd+XccQi7Y (ssh-ed25519)
 -----------------------------
-Number of entries returned 43
+Number of entries returned 31
 -----------------------------

The entire controller-1 and ceph-1 base entry is removed from IDM
Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:
Comment 2 Harry Rybacki 2019-09-16 13:11:20 UTC 
Upstream fixes have merged. Moving RHBZ to POST.
Comment 4 Harry Rybacki 2019-09-16 13:59:45 UTC 
Tagged python-novajoin build with fixes as OSP15 candidate. Moving RHBZ to MODIFIED.
Comment 15 Lon Hohberger 2019-10-03 13:07:48 UTC 
According to our records, this is resolved by python-novajoin-1.1.2-0.20190912190429.b971c78.el8ost. This build, or a later build, is available now.
Comment 19 Alex McLeod 2020-02-19 12:48:35 UTC 
If this bug requires doc text for errata release, please set the 'Doc Type' and provide draft text according to the template in the 'Doc Text' field. The documentation team will review, edit, and approve the text.

If this bug does not require doc text, please set the 'requires_doc_text' flag to '-'.
Comment 21 errata-xmlrpc 2020-03-05 12:02:22 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:0710