Bug 2184305

Summary: [OSP16.2][DCN] Update from OSP16.1 -> OSP16.2 failed during update DCN site
Product: Red Hat OpenStack Reporter: Sergey Bekkerman <sbekkerm>
Component: openstack-tripleo-heat-templatesAssignee: Sergey Bekkerman <sbekkerm>
Status: CLOSED NOTABUG QA Contact: Joe H. Rahme <jhakimra>
Severity: high Docs Contact:
Priority: medium    
Version: 16.2 (Train)CC: fdiazbra, jjoyce, jschluet, lbezdick, mburns, omcgonag, slinaber, tkajinam, tvignaud
Target Milestone: ---Keywords: Triaged
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2023-06-28 09:09:14 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Sergey Bekkerman 2023-04-04 07:57:01 UTC
Description of problem:
Update from OSP16.1 -> OSP16.2 at the Edge failed during the update DNC site. The job [1] failed with the error [2]:
2023-04-04 00:47:55 | 2023-04-04 00:47:54.263651 | 525400aa-8072-29df-1194-000000000013 |      FATAL | Set legacy facts | dcn1-computehci1-0 | error={"msg": "The task includes an option with an undefined variable. The error was: 'dict object' has no attribute 'distribution'\n\nThe error appears to be in '/var/lib/mistral/11fbc046-ff52-4223-9ed8-c19a6b2c5ee8/common_deploy_steps_playbooks.yaml': line 46, column 7, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n  tasks:\n    - name: Set legacy facts\n      ^ here\n"}
2023-04-04 00:47:55 | 2023-04-04 00:47:54.264976 | 525400aa-8072-29df-1194-000000000013 |     TIMING | Set legacy facts | dcn1-computehci1-0 | 0:04:03.528199 | 0.06s
2023-04-04 00:47:55 | 2023-04-04 00:47:54.320677 | 525400aa-8072-29df-1194-000000000013 |      FATAL | Set legacy facts | dcn1-computehci1-1 | error={"msg": "The task includes an option with an undefined variable. The error was: 'dict object' has no attribute 'distribution'\n\nThe error appears to be in '/var/lib/mistral/11fbc046-ff52-4223-9ed8-c19a6b2c5ee8/common_deploy_steps_playbooks.yaml': line 46, column 7, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n  tasks:\n    - name: Set legacy facts\n      ^ here\n"}
2023-04-04 00:47:55 | 2023-04-04 00:47:54.321254 | 525400aa-8072-29df-1194-000000000013 |     TIMING | Set legacy facts | dcn1-computehci1-1 | 0:04:03.584495 | 0.09s
2023-04-04 00:47:55 | 2023-04-04 00:47:54.322180 | 525400aa-8072-29df-1194-000000000013 |      FATAL | Set legacy facts | dcn1-computehci1-2 | error={"msg": "The task includes an option with an undefined variable. The error was: 'dict object' has no attribute 'distribution'\n\nThe error appears to be in '/var/lib/mistral/11fbc046-ff52-4223-9ed8-c19a6b2c5ee8/common_deploy_steps_playbooks.yaml': line 46, column 7, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n  tasks:\n    - name: Set legacy facts\n      ^ here\n"}
2023-04-04 00:47:55 | 2023-04-04 00:47:54.322608 | 525400aa-8072-29df-1194-000000000013 |     TIMING | Set legacy facts | dcn1-computehci1-2 | 0:04:03.585887 | 0.07s


Version-Release number of selected component (if applicable):

Update from RHOS-16.1-RHEL-8-20221206.n.1 to RHOS-16.2-RHEL-8-20230322.n.1

[1] - https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/view/QE/view/OSP16.2/job/DFG-edge-day2-16.1-rhel-virthost-3cont-4hci-2leafs-x-tls-everywhere-4hci-ovs-dmb-storage-update-to-16.2/79/
[2] - http://rhos-ci-logs.lab.eng.tlv2.redhat.com/logs/rcj/DFG-edge-day2-16.1-rhel-virthost-3cont-4hci-2leafs-x-tls-everywhere-4hci-ovs-dmb-storage-update-to-16.2/79/site-undercloud-0/home/stack/overcloud_update_run-ComputeHCI1.log.gz