Description of problem: I was trying upgrade from sat6.1.9 -> sat6.2 snap15 on rhel7, and installer was throwing following error message in /var/log/messages: ==> /var/log/messages <== Jun 9 03:51:04 qe-sat6-upgrade-rhel7 qpidd: 2016-06-09 03:51:04 [Protocol] error Error on attach: Node not found: pulp.agent.737d5dde-2ec8-4b21-9933-3e7fa45cbf77 Jun 9 03:51:04 qe-sat6-upgrade-rhel7 qpidd[9999]: 2016-06-09 03:51:04 [Protocol] error Error on attach: Node not found: pulp.agent.737d5dde-2ec8-4b21-9933-3e7fa45cbf77 Jun 9 03:51:46 qe-sat6-upgrade-rhel7 qpidd: 2016-06-09 03:51:46 [Protocol] error Error on attach: Node not found: pulp.agent.737d5dde-2ec8-4b21-9933-3e7fa45cbf77 Jun 9 03:51:46 qe-sat6-upgrade-rhel7 qpidd[9999]: 2016-06-09 03:51:46 [Protocol] error Error on attach: Node not found: pulp.agent.737d5dde-2ec8-4b21-9933-3e7fa45cbf77 Jun 9 03:52:27 qe-sat6-upgrade-rhel7 qpidd: 2016-06-09 03:52:27 [Protocol] error Error on attach: Node not found: pulp.agent.737d5dde-2ec8-4b21-9933-3e7fa45cbf77 Jun 9 03:52:27 qe-sat6-upgrade-rhel7 qpidd[9999]: 2016-06-09 03:52:27 [Protocol] error Error on attach: Node not found: pulp.agent.737d5dde-2ec8-4b21-9933-3e7fa45cbf77 Jun 9 03:53:09 qe-sat6-upgrade-rhel7 qpidd[9999]: 2016-06-09 03:53:09 [Protocol] error Error on attach: Node not found: pulp.agent.737d5dde-2ec8-4b21-9933-3e7fa45cbf77 Jun 9 03:53:09 qe-sat6-upgrade-rhel7 qpidd: 2016-06-09 03:53:09 [Protocol] error Error on attach: Node not found: pulp.agent.737d5dde-2ec8-4b21-9933-3e7fa45cbf77 Jun 9 03:53:50 qe-sat6-upgrade-rhel7 qpidd[9999]: 2016-06-09 03:53:50 [Protocol] error Error on attach: Node not found: pulp.agent.737d5dde-2ec8-4b21-9933-3e7fa45cbf77 Version-Release number of selected component (if applicable): upgrade from sat6.1.9 -> sat6.2 snap15 on rhel7, How reproducible: Steps to Reproduce: 0 set 6.2 repo 1. yum update -y 2. satellite-installer --scenario satellite --upgrade Actual results: [Protocol] error Error on attach: Node not found: pulp.agent.737d5dde-2ec8-4b21-9933-3e7fa45cbf77 Expected results: no error message should be thrown in logs while installer is running Additional info:
Created attachment 1166208 [details] foreman-debug
Sachin, is this error from SNAP 15 or 15.1? Neither myself or Chris are seeing the error; however, we do have different data and we are running on 15.1.
@Brad: this issue is appearing on upgrade with snap15 and snap15.1 on rhel7. And I see this error consistently while upgrade and a bunch of times.
In discussing this issue with Justin and Jeff, it appears that the issue is due to the fact that the during the upgrade some of the content hosts (pulp consumers) can be deleted from the server. Unfortunately, the agent running on the client (content host) does not know that it has been deleted and it may still reach out to Satellite triggering the error to be generated in the Satellite logs. Once rhsmcertd runs on the client, it will detect that it is no longer registered and stop sending the requests to the server. This behavior exists today in Satellite 6.1 as well. Example scenario would be, client registers, goferd is running on the client and the content host is deleted from the UI.
Aside from rhsmcertd running on the client, re-registering it should also cause the error messages to stop.
@Brad: To fix this if changes are required at client end with updates to katello-agent then let's document this in release notes.
Thanks Sachin, flagging the bug for release notes.
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2016:1501
Confirmed with CEE and ENG that this case is resolved. Closing this out.