Bug 2078579
| Summary: | OSP17 Timeout during overcloud deploy when using composable roles | ||
|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | David Rosenfeld <drosenfe> |
| Component: | openstack-tripleo-common | Assignee: | James Slagle <jslagle> |
| Status: | CLOSED DUPLICATE | QA Contact: | David Rosenfeld <drosenfe> |
| Severity: | high | Docs Contact: | |
| Priority: | high | ||
| Version: | 17.0 (Wallaby) | CC: | jslagle, lmiccini, mburns, ramishra, slinaber, tkajinam |
| Target Milestone: | --- | Keywords: | Triaged |
| Target Release: | --- | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2022-05-30 08:39:01 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
|
Description
David Rosenfeld
2022-04-25 17:17:12 UTC
From: http://rhos-ci-logs.lab.eng.tlv2.redhat.com/logs/rcj/DFG-df-deployment-17.0-virthost-3cont_1comp_3ceph_3db_2net_3msg-yes_UC_SSL-yes_OC_SSL-ceph-ipv4-geneve-remote_registry-RHELOSP-31897/3/undercloud-0/home/stack/overcloud_install.log.gz Deployment starts at 2022-04-22 15:43:36.078: 2022-04-22 15:43:36.078 119459 INFO tripleoclient.utils.utils [-] Running Ansible playbook with timeout 97m: /home/stack/overcloud-deploy/overcloud/config-download/overcloud/deploy_steps_playbook.yaml, Working directory: /home/stack/overcloud-deploy/overcloud/config-download, Playbook directory: /home/stack/overcloud-deploy/overcloud/config-download/overcloud[00m Stuck on this task: 2022-04-22 16:02:06.356468 | 525400f5-334d-2426-9356-00000001528b | TASK | Create containers managed by Podman for /var/lib/tripleo-config/container-startup-config/step_3 2022-04-22 17:20:38.444 119459 INFO tripleoclient.utils.utils [-] Temporary directory [ /tmp/tripleok10jk27j ] cleaned up[00m 2022-04-22 17:20:38.446 119459 ERROR tripleoclient.utils.utils [-] Ansible execution failed. playbook: /home/stack/overcloud-deploy/overcloud/config-download/overcloud/deploy_steps_playbook.yaml, Run Status: timeout, Return Code: 254, To rerun the failed command manually execute the following script: /home/stack/overcloud-deploy/overcloud/config-download/ansible-playbook-command.sh[00m Looks like the db syncs at step3 can't connect to the db from the bootstrap node (controller-2): http://rhos-ci-logs.lab.eng.tlv2.redhat.com/logs/rcj/DFG-df-deployment-17.0-virthost-3cont_1comp_3ceph_3db_2net_3msg-yes_UC_SSL-yes_OC_SSL-ceph-ipv4-geneve-remote_registry-RHELOSP-31897/3/controller-2/var/log/containers/stdouts/nova_api_db_sync.log.gz http://rhos-ci-logs.lab.eng.tlv2.redhat.com/logs/rcj/DFG-df-deployment-17.0-virthost-3cont_1comp_3ceph_3db_2net_3msg-yes_UC_SSL-yes_OC_SSL-ceph-ipv4-geneve-remote_registry-RHELOSP-31897/3/controller-2/var/log/containers/stdouts/heat_engine_db_sync.log.gz I believe the issue is that the firewall rules to allow port 3306 are not created on the controller nodes that are running HAProxy. There are no rules on controller-2: http://rhos-ci-logs.lab.eng.tlv2.redhat.com/logs/rcj/DFG-df-deployment-17.0-virthost-3cont_1comp_3ceph_3db_2net_3msg-yes_UC_SSL-yes_OC_SSL-ceph-ipv4-geneve-remote_registry-RHELOSP-31897/3/controller-2/var/log/extra/network.txt.gz The rules are however on the database nodes: http://rhos-ci-logs.lab.eng.tlv2.redhat.com/logs/rcj/DFG-df-deployment-17.0-virthost-3cont_1comp_3ceph_3db_2net_3msg-yes_UC_SSL-yes_OC_SSL-ceph-ipv4-geneve-remote_registry-RHELOSP-31897/3/database-0/var/log/extra/network.txt.gz I believe this is a known issue and there are some upstream in progress patches to fix this. *** This bug has been marked as a duplicate of bug 2074541 *** |