Bug 1788234

Summary:	Split Stack compute replacement jobs hang Scale Down Stage
Product:	Red Hat OpenStack	Reporter:	David Rosenfeld <drosenfe>
Component:	openstack-tripleo-common	Assignee:	Emilien Macchi <emacchi>
Status:	CLOSED ERRATA	QA Contact:	Alexander Chuzhoy <sasha>
Severity:	high	Docs Contact:
Priority:	high
Version:	16.0 (Train)	CC:	aschultz, emacchi, mburns, sclewis, shrjoshi, slinaber
Target Milestone:	rc	Keywords:	AutomationBlocker, Triaged
Target Release:	16.0 (Train on RHEL 8.1)
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	openstack-tripleo-common-11.3.3-0.20200107225621.47626e1.el8ost	Doc Type:	No Doc Update
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2020-02-06 14:44:12 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description David Rosenfeld 2020-01-06 19:06:56 UTC

Description of problem: There are seven OSP 16 Split Stack regression jobs that hang in Scale Down stage when executed. Jobs make it to scale down stage hang for over four hours before Jenkins aborts the test.


Version-Release number of selected component (if applicable): RHOS_TRUNK-16.0-RHEL-8-20200103.n.1


How reproducible: Every time one of the split stack jobs is executed ex. DFG-df-splitstack-16-virsh-3cont_2comp_3ceph-scaledown


Steps to Reproduce:
1. Execute split stack job DFG-df-splitstack-16-virsh-3cont_2comp_3ceph-scaledown in Jenkins
2.
3.

Actual results: Job hangs in scale down stage


Expected results: Job completes successfully


Additional info:

Comment 1 David Rosenfeld 2020-01-06 19:07:50 UTC

Logs to a failing test:

https://rhos-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/DFG/view/df/view/splitstack/job/DFG-df-splitstack-16-virsh-3cont_2comp_3ceph-scaledown/8/

Comment 7 David Rosenfeld 2020-01-14 13:24:51 UTC

Starting in RHOS_TRUNK-16.0-RHEL-8-20200110.n.3 split stack compute replacement jobs pass. A link to a passing job is:

https://rhos-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/DFG/view/df/view/splitstack/job/DFG-df-splitstack-16-virsh-3cont_3comp_3ceph-skip-deploy-identifier-compute-replacement/8/

Comment 10 errata-xmlrpc 2020-02-06 14:44:12 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2020:0283