Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1936542

Summary: Intermittent AMQP server unreachable errors when running tempest compute suite with TLS-E
Product: Red Hat OpenStack Reporter: James Parker <jparker>
Component: rabbitmq-serverAssignee: Peter Lemenkov <plemenko>
Status: CLOSED DUPLICATE QA Contact: pkomarov
Severity: high Docs Contact:
Priority: high    
Version: 13.0 (Queens)CC: apevec, jeckersb, lhh, lmiccini
Target Milestone: ---Keywords: Triaged, ZStream
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-06-25 08:13:34 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Comment 1 John Eckersberg 2021-03-08 19:27:55 UTC 
This is probably due to https://bugzilla.redhat.com/show_bug.cgi?id=1779407 which is not in any puddles yet because we're still trying to figure out how to do a minor update which also does a full (non-rolling) restart of rabbitmq.

That bug is very long, so to summarize:  there is a race condition in the erlang TLS code.  When the race is hit, the rabbitmq cluster will partially partition, and typically the pacemaker resource agent will notice this and restart things to get the cluster working again.  During the partition and restart you will get errors like above.  Adding additional load to the system makes the race more likely to occur, so it makes sense that reducing the tempest concurrency causes the problem to go away.
Comment 2 Luca Miccini 2021-06-25 08:13:34 UTC 
as per John's comment we are inclined to think it is related to a known issue with erlang when tls is employed. the new erlang/rabbitmq that has been made available should address this problem.

*** This bug has been marked as a duplicate of bug 1779407 ***