Bug 1115988

Summary:	qpidd produces errors in /var/log/messages when previously subscribed clients are left pointing at a rebuilt host
Product:	Red Hat Satellite	Reporter:	Roy Williams <fang64>
Component:	Other	Assignee:	satellite6-bugs <satellite6-bugs>
Status:	CLOSED WONTFIX	QA Contact:	Katello QA List <katello-qa-list>
Severity:	high	Docs Contact:
Priority:	unspecified
Version:	6.0.3	CC:	abradshaw, bbuckingham, bkearney, mhrivnak, pcfe, peter.vreman
Target Milestone:	Unspecified	Keywords:	Triaged
Target Release:	Unused
Hardware:	x86_64
OS:	Linux
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2017-08-11 12:12:38 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	1122832

Description Roy Williams 2014-07-03 13:10:41 UTC

Description of problem:
A barrage of errors occur when client machines that were registered to a hostname, for example engr-lbs.uncc.edu, then that host is rebuilt causing it to have new certificates that differ from what the clients were originally registered with to engr-lbs.uncc.edu. This will cause "pulp: kombu.transport.qpid:ERROR: connection aborted" errors to appear in rapid succession approximately every minute, and causes other issues to occur like dynflow becoming stuck at planned state.

Version-Release number of selected component (if applicable):
qpid-cpp-server 0.22-42.el6
qpid-cpp-client 0.22-42.el6
pulp 2.4.0-0.23.beta.el6sat
katello 1.5.0-26.el6sat

How reproducible:
Easily

Steps to Reproduce:
1. Install RHEL 6.5
2. Subscribe and Register host via Subscription-Manager, add Red Hat Satellite Beta Entitlement.
3. Run: yum update -y
4. Run: subscription-manager repos --enable=rhel-6-server-rpms --enable=rhel-server-rhscl-6-rpms --enable=rhel-server-6-satellite-6-beta-rpms
5. Run: yum install katello
6. Run: katello-installer
7. Run: service iptables stop
8. Register a client host or several to the satellite 6.0 beta host. I had 15 registered to mine previously, these were RHEL 7.0 GA desktops.
9. Repeat steps 1-7 on the same host, ie completely rebuilding the host.

Actual results:
You will see "pulp: kombu.transport.qpid:ERROR: connection aborted" occurring related to the total number of host that were formerly registered at the machine. Host will actually exhibit other problems once this has started like being unable to execute tasks that are created and get stuck in planned phase.

Expected results:
It shouldn't produce a barrage of "pulp: kombu.transport.qpid:ERROR: connection aborted" errors. The output should be useful instead of vague, since those errors were related to authentication failures. Katello should be able to continue executing tasks.

Additional info:

Comment 1 RHEL Program Management 2014-07-03 13:27:26 UTC

Since this issue was entered in Red Hat Bugzilla, the release flag has been
set to ? to ensure that it is properly evaluated for this release.

Comment 3 Roy Williams 2014-07-03 13:30:39 UTC

Another error that occurs post installation before things start getting crazy with the kombu.tarnsport.qpid issue.

"qpidd[46470]: 2014-07-03 09:24:55 [System] error Error reading socket: Success(0)"

Comment 4 Roy Williams 2014-07-09 20:56:31 UTC

I can temporarily resolve the issue via:
Changing the firewall to block port 5671/tcp then running: 
foreman-rake jobs:clear

This seems to let Satellite recover from the issue, as long as those host remain blocked.

Comment 5 Roy Williams 2014-07-15 14:27:50 UTC

To add the clients are registered via rhsm and goferd.

Comment 6 Peter Vreman 2015-02-23 16:03:39 UTC

I am having the same issue after rebuilding the Sat6 server. Issue still occurs with Sat6 6.0.7

# grep -c 'qpidd.*error Error reading socket.*Success' /var/log/messages
52837

Comment 7 Peter Vreman 2016-03-08 14:19:35 UTC

*** Bug 1154559 has been marked as a duplicate of this bug. ***

Comment 11 Bryan Kearney 2016-08-04 20:10:10 UTC

Moving 6.2 bugs out to sat-backlog.

Comment 13 Peter Vreman 2017-08-08 11:23:38 UTC

I think this can be closed with the fix of https://bugzilla.redhat.com/show_bug.cgi?id=1445403 that removes the need for goferd on the clients

Comment 14 Bryan Kearney 2017-08-11 12:12:38 UTC

Closing based on Peters comments in 13.