Bug 1777773

Summary: [OSP13->14] Packet dropped during the Overcloud upgrade converge step.
Product: Red Hat OpenStack Reporter: Jose Luis Franco <jfrancoa>
Component: openstack-tripleo-heat-templatesAssignee: Jose Luis Franco <jfrancoa>
Status: CLOSED DUPLICATE QA Contact: Sasha Smolyak <ssmolyak>
Severity: high Docs Contact:
Priority: high    
Version: 14.0 (Rocky)CC: ccamacho, mburns
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-12-02 13:48:06 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Jose Luis Franco 2019-11-28 10:15:38 UTC 
Description of problem:

CI jobs for the upgrade from OSP13 to OSP14 are failing during the converge step. The reason is there is a package loss higher than 1%:

2019-11-20 23:39:12 | Ansible passed.
2019-11-20 23:39:12 | Overcloud configuration completed.
2019-11-20 23:39:12 | 2019-11-20 23:39:12.957 709032 WARNING tripleoclient.plugin [-] Waiting for messages on queue 'tripleo' with no timeout.[00m
2019-11-20 23:39:17 | Overcloud Endpoint: https://10.0.0.101:13000
2019-11-20 23:39:17 | Overcloud Horizon Dashboard URL: https://10.0.0.101:443/dashboard
2019-11-20 23:39:17 | Overcloud rc file: /home/stack/overcloudrc
2019-11-20 23:39:17 | Overcloud Deployed
2019-11-20 23:39:17 | 2019-11-20 23:39:17.539 709032 INFO tripleoclient.v1.overcloud_upgrade.UpgradeConvergeOvercloud [-] Completed Overcloud Upgrade Converge for stack overcloud[00m
2019-11-20 23:39:17 | 2019-11-20 23:39:17.544 709032 INFO osc_lib.shell [-] END return value: None[00m
2019-11-20 23:39:17 | [Wed Nov 20 23:39:17 EST 2019] Finished  major upgrade converge step
2019-11-20 23:39:17 | 4239 packets transmitted, 3649 received, +557 errors, 13% packet loss, time 4241819ms
2019-11-20 23:39:17 | rtt min/avg/max/mdev = 0.529/1.898/2007.207/37.150 ms, pipe 6
2019-11-20 23:39:17 | Ping loss higher than 1% detected

Log: http://cougar11.scl.lab.tlv.redhat.com/DFG-upgrades-upgrade-upgrade-13-14_director-rhel-virthost-3cont_2comp_3ceph-ipv4-vxlan-monolithic/34/undercloud-0.tar.gz?undercloud-0/home/stack/overcloud_upgrade_converge.log 

Pingtest log: http://cougar11.scl.lab.tlv.redhat.com/DFG-upgrades-upgrade-upgrade-13-14_director-rhel-virthost-3cont_2comp_3ceph-ipv4-vxlan-monolithic/34/undercloud-0.tar.gz?undercloud-0/home/stack/ping_results_201911202228.log

Job Logs: http://cougar11.scl.lab.tlv.redhat.com/DFG-upgrades-upgrade-upgrade-13-14_director-rhel-virthost-3cont_2comp_3ceph-ipv4-vxlan-monolithic/34/
Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:
Comment 1 Jose Luis Franco 2019-12-02 13:48:06 UTC 

*** This bug has been marked as a duplicate of bug 1767160 ***