Bug 1647202

Summary: After Upgrading from Satellite 6.3 to Satellite 6.4 the gofer & katello-agent packages get installed in the satellite 6.4 server as satellite-tools-repository-6.4 gets enabled but during a fresh installation of satellite 6.4 cannot see the same scenario.
Product: Red Hat Satellite Reporter: Vikas Wariyal <vwariyal>
Component: Satellite MaintainAssignee: Anurag Patel <apatel>
Status: CLOSED WONTFIX QA Contact: Jameer Pathan <jpathan>
Severity: high Docs Contact:
Priority: medium    
Version: 6.4.0CC: apatel, aupadhye, avroy, ben.argyle, egolov, inecas, jpathan, kgaikwad, mbacovsk, mvanderw, rajukuma, redhat-bugzilla, rjarosz, smajumda
Target Milestone: UnspecifiedKeywords: Triaged, Upgrades
Target Release: Unused   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-07-09 16:56:30 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Vikas Wariyal 2018-11-06 20:59:58 UTC
Description of problem:

After Upgrading from Satellite 6.3 to Satellite 6.4 the 
gofer-2.12.1-1.el7sat.noarch & katello-agent-3.3.5-3.el7sat.noarch packages get installed in the satellite 6.4 server as satellite-tools-repository-6.4 also gets enabled but during a fresh installation of satellite 6.4 cannot see the same scenario , neither the tools repository gets enabled nor both the packages.

Version-Release number of selected component (if applicable):

satellite-6.4.0-15.el7sat.noarch
gofer-2.12.1-1.el7sat.noarch 
katello-agent-3.3.5-3.el7sat.noarch


How reproducible:

During upgrade from Satellite 6.3 -> Satellite 6.4

Steps to Reproduce:

1.Upgrade through the regular method using foreman-maintain commands from Satellite 6.3 -> 6.4.
2.Run the below commands to confirm after successful upgrade.
# rpm -qa | grep gofer 
# rpm -qa | grep katello-agent 
# yum repolist


Actual results:
#rpm -qa | grep gofer
gofer-2.12.1-1.el7sat.noarch -<<< Not required
python-gofer-2.12.1-1.el7sat.noarch
python-gofer-proton-2.12.1-1.el7sat.noarch
python-gofer-qpid-2.12.1-1.el7sat.noarch

#rpm -qa | grep katello-agent 
katello-agent-3.3.5-3.el7sat.noarch -<<< Not required

#yum repolist

rhel-7-server-satellite-tools-6.4-rpms/x86_64  -<<< Not required               
rhel-7-server-ansible-2.6-rpms/x86_64             
rhel-7-server-rpms/7Server/x86_64         
rhel-7-server-satellite-6.4-rpms/x86_64   
rhel-7-server-satellite-maintenance-6-rpms/x86_64
rhel-server-rhscl-7-rpms/7Server/x86_64          

Expected results:

#rpm -qa | grep gofer
python-gofer-2.12.1-1.el7sat.noarch
python-gofer-proton-2.12.1-1.el7sat.noarch
python-gofer-qpid-2.12.1-1.el7sat.noarch


#rpm -qa | grep katello-agent 
No output

#yum repolist
               
rhel-7-server-ansible-2.6-rpms/x86_64             
rhel-7-server-rpms/7Server/x86_64         
rhel-7-server-satellite-6.4-rpms/x86_64   
rhel-7-server-satellite-maintenance-6-rpms/x86_64
rhel-server-rhscl-7-rpms/7Server/x86_64 

Additional info:
We can understand that during upgrade the issue is happening while during fresh installation we cannot see any deviation. I have tested the same scenario on the test environment.

Comment 1 Brad Buckingham 2018-11-09 16:37:23 UTC
Vikas,

Is it possible that the 6.3 instance was a self-registered Satellite?

Comment 2 Martin Schlossarek 2018-11-09 17:00:20 UTC
Hi,

I'm the one who originally reported the bug at red hat customer portal. 

No it was not a self-registered satellite (which is not supported since 6.3).

Our satellite is registered to the RHSM network.

Comment 3 Vikas Wariyal 2018-11-09 17:31:56 UTC
Brad

No , it is not a self registered satellite.

Comment 5 Matt 2018-11-18 14:50:54 UTC
I can confirm that I am also seeing this same behavior on a system that was upgraded from Satellite 6.3 to 6.4.

In addition to what was mentioned already, the katello-host-tools package also got installed (dependency to katello-agent), which added the enabled_repos_upload yum plugin, which wasn't there before the upgrade. This causes yum to try to upload the "Enabled Repositories Report" with every yum command, which then fails every time:

Uploading Enabled Repositories Report
Loaded plugins: langpacks, product-id, subscription-manager
Loaded plugins: langpacks, product-id, subscription-manager
Loaded plugins: langpacks, product-id, subscription-manager
Loaded plugins: langpacks, product-id, subscription-manager
Loaded plugins: langpacks, product-id, subscription-manager
Loaded plugins: langpacks, product-id, subscription-manager
Loaded plugins: langpacks, product-id, subscription-manager
Unable to upload Enabled Repositories Report

(Notice also the multiple "Loaded plugins:..." lines bug per bz#1625649.)

This didn't happen before the upgrade to 6.4.

I also recently set up a new Satellite server with a clean install of 6.4 and didn't run into this issue, matching what has already been discovered to be the case.


Not sure if this is related or not, but I also noticed the Satellite server host show up as an unregistered content host on the same Satellite server itself, which wasn't there before. This Satellite server has always been registered to the RHSM network (i.e. it was *never* a self-registered Satellite).

It's almost as if maybe the 6.3->6.4 upgrade attempted to (partially) register the Satellite server to itself or to RHSM, including enabling the tools repo and installing the packages that would normally be enabled/installed on an actual registered client host...??

I can open up a separate case with Red Hat Support on this, if that would help...??

Comment 6 Martin Schlossarek 2018-11-19 09:45:29 UTC
(In reply to Matt from comment #5)
> I can confirm that I am also seeing this same behavior on a system that was
> upgraded from Satellite 6.3 to 6.4.
> 
> In addition to what was mentioned already, the katello-host-tools package
> also got installed (dependency to katello-agent), which added the
> enabled_repos_upload yum plugin, which wasn't there before the upgrade. This
> causes yum to try to upload the "Enabled Repositories Report" with every yum
> command, which then fails every time:
> 
> Uploading Enabled Repositories Report
> Loaded plugins: langpacks, product-id, subscription-manager
> Loaded plugins: langpacks, product-id, subscription-manager
> Loaded plugins: langpacks, product-id, subscription-manager
> Loaded plugins: langpacks, product-id, subscription-manager
> Loaded plugins: langpacks, product-id, subscription-manager
> Loaded plugins: langpacks, product-id, subscription-manager
> Loaded plugins: langpacks, product-id, subscription-manager
> Unable to upload Enabled Repositories Report
> 
> (Notice also the multiple "Loaded plugins:..." lines bug per bz#1625649.)
> 
> This didn't happen before the upgrade to 6.4.

I can confirm this behavior and have already mentioned it in the official Red Hat Portal case. I think this should be mentioned in the description.

Comment 13 Ben 2019-02-22 13:43:01 UTC
I just upgraded from 6.3.5 -> 6.4.2 and suffered the same installation of gofer/katello-agent/katello-host-tools on a Satellite that has never been self-registered.  

Cleaning them off fixed the multiple "Loaded plugins" lines issue, as well as the problem with foreman-maintain announcing

[...]
Check if EPEL repository enabled on system: 
| Checking for presence of EPEL repositoryUnable to upload Enabled Repositories Report
\ Checking for presence of EPEL repository                            [OK]
[...]

Comment 14 Johannes Grumböck 2019-03-21 09:18:56 UTC
I ran into the same problem as Ben in comment #13.
Also upgrade a non-self-registered Satellite from 6.3.5 -> 6.4.2 and gofer/katello-agent/katello-host-tools were installed.
Needed to do "yum remove katello-host-tools" to have a functional yum again (without upload_enabled_repos plugin).

Comment 15 Robert Jarosz 2019-04-29 15:26:51 UTC

I also have this issue on my Satellite after upgrading to 6.4.2-2.

I have followed the guidance in Red Hat Knowledge Base Solution 3703561, 
But, I still have the following output when running yum command on the satellite:
============================================================================================================
(Satellite Server OUTPUT Below)

[root@vlsrhnsat01 log]# yum repolist
Loaded plugins: enabled_repos_upload, package_upload, product-id, search-disabled-repos, subscription-manager
repo id                                           repo name                                                         status
rhel-7-server-ansible-2.6-rpms/x86_64             Red Hat Ansible Engine 2.6 RPMs for Red Hat Enterprise Linux 7 Se     21
rhel-7-server-rpms/7Server/x86_64                 Red Hat Enterprise Linux 7 Server (RPMs)                          24,120
rhel-7-server-satellite-6.4-rpms/x86_64           Red Hat Satellite 6.4 (for RHEL 7 Server) (RPMs)                     446
rhel-7-server-satellite-maintenance-6-rpms/x86_64 Red Hat Satellite Maintenance 6 (for RHEL 7 Server) (RPMs)            26
rhel-7-server-satellite-tools-6.4-rpms/x86_64     Red Hat Satellite Tools 6.4 (for RHEL 7 Server) (RPMs)                73
rhel-server-rhscl-7-rpms/7Server/x86_64           Red Hat Software Collections RPMs for Red Hat Enterprise Linux 7  10,978
repolist: 35,664
Uploading Enabled Repositories Report
Loaded plugins: product-id, subscription-manager
Loaded plugins: product-id, subscription-manager
Loaded plugins: product-id, subscription-manager
Loaded plugins: product-id, subscription-manager
Loaded plugins: product-id, subscription-manager
Loaded plugins: product-id, subscription-manager
Unable to upload Enabled Repositories Report
[root@vlsrhnsat01 log]#

Is the trailing output (i.e. "Uploading Enabled Repositories Report") expected or is it a configuration issue as suggested by the previous comment by Johannes Grumböck?

           <Comment by Johannes Grumböck>       
           "Needed to do "yum remove katello-host-tools to have a functional yum again (without upload_enabled_repos plugin)."


===================================================================================================================================================================
BTW: Our Satellite client hosts are also outputting the "Loaded plugins: product-id, subscription-manager" lines after running yum." 
(CLIENT OUTPUT BELOW)

[root@procyon ~]# yum repolist
Loaded plugins: aliases, changelog, enabled_repos_upload, kabi, package_upload, presto, product-id, refresh-packagekit,
              : search-disabled-repos, security, subscription-manager, tmprepo, verify, versionlock
Loading support for Red Hat kernel ABI
rhel-6-server-extras-rpms                                                                             | 1.8 kB     00:00
rhel-6-server-fastrack-rpms                                                                           | 1.8 kB     00:00
rhel-6-server-optional-fastrack-rpms                                                                  | 1.8 kB     00:00
rhel-6-server-optional-rpms                                                                           | 2.0 kB     00:00
rhel-6-server-rpms                                                                                    | 2.0 kB     00:00
rhel-6-server-satellite-tools-6.4-rpms                                                                | 2.1 kB     00:00
rhel-6-server-supplementary-rpms                                                                      | 2.0 kB     00:00
rhel-6-server-thirdparty-oracle-java-rpms                                                             | 2.3 kB     00:00
rhel-server-rhscl-6-rpms                                                                              | 2.0 kB     00:00
repo id                                     repo name                                                                  status
rhel-6-server-extras-rpms                   Red Hat Enterprise Linux 6 Server - Extras (RPMs)                              97
rhel-6-server-fastrack-rpms                 Red Hat Enterprise Linux 6 Server - Fastrack (RPMs)                           265
rhel-6-server-optional-fastrack-rpms        Red Hat Enterprise Linux 6 Server - Optional Fastrack (RPMs)                  119
rhel-6-server-optional-rpms                 Red Hat Enterprise Linux 6 Server - Optional (RPMs)                        11,975
rhel-6-server-rpms                          Red Hat Enterprise Linux 6 Server (RPMs)                                   20,662
rhel-6-server-satellite-tools-6.4-rpms      Red Hat Satellite Tools 6.4 (for RHEL 6 Server) (RPMs)                         18
rhel-6-server-supplementary-rpms            Red Hat Enterprise Linux 6 Server - Supplementary (RPMs)                      879
rhel-6-server-thirdparty-oracle-java-rpms   Red Hat Enterprise Linux 6 Server - Oracle Java (RPMs)                        495
rhel-server-rhscl-6-rpms                    Red Hat Software Collections RPMs for Red Hat Enterprise Linux 6 Server     9,359
repolist: 43,869
Uploading Enabled Repositories Report
Loaded plugins: kabi, presto, product-id, refresh-packagekit, subscription-
              : manager, versionlock
Loading support for Red Hat kernel ABI
Loaded plugins: kabi, presto, product-id, refresh-packagekit, subscription-
              : manager, versionlock
Loading support for Red Hat kernel ABI
Loaded plugins: kabi, presto, product-id, refresh-packagekit, subscription-
              : manager, versionlock
Loading support for Red Hat kernel ABI
Loaded plugins: kabi, presto, product-id, refresh-packagekit, subscription-
              : manager, versionlock
Loading support for Red Hat kernel ABI
Loaded plugins: kabi, presto, product-id, refresh-packagekit, subscription-
              : manager, versionlock
Loading support for Red Hat kernel ABI
Loaded plugins: kabi, presto, product-id, refresh-packagekit, subscription-
              : manager, versionlock
Loading support for Red Hat kernel ABI
Loaded plugins: kabi, presto, product-id, refresh-packagekit, subscription-
              : manager, versionlock
Loading support for Red Hat kernel ABI
Loaded plugins: kabi, presto, product-id, refresh-packagekit, subscription-
              : manager, versionlock
Loading support for Red Hat kernel ABI
Loaded plugins: kabi, presto, product-id, refresh-packagekit, subscription-
              : manager, versionlock
Loading support for Red Hat kernel ABI
[root@procyon ~]#

==============================================================================================

Comment 17 Suraj Patil 2020-07-02 06:27:17 UTC
Created redmine issue https://projects.theforeman.org/issues/30287 from this bug

Comment 21 Mike McCune 2021-06-08 21:14:45 UTC
Upon review of our valid but aging backlog the Satellite Team has concluded that this Bugzilla does not meet the criteria for a resolution in the near term, and are planning to close in a month. This message may be a repeat of a previous update and the bug is again being considered to be closed. If you have any concerns about this, please contact your Red Hat Account team.  Thank you.

Comment 23 Mike McCune 2021-07-09 16:56:30 UTC
Thank you for your interest in Satellite 6. We have evaluated this request, and while we recognize that it is a valid request, we do not expect this to be implemented in the product in the foreseeable future. This is due to other priorities for the product, and not a reflection on the request itself. We are therefore closing this out as WONTFIX. If you have any concerns about this feel free to contact your Red Hat Account Team. Thank you.