RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 2097919 - cockpit shows insights client unregistered when registered to Satellite
Summary: cockpit shows insights client unregistered when registered to Satellite
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Linux 9
Classification: Red Hat
Component: subscription-manager-cockpit
Version: 9.0
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: rc
: 9.1
Assignee: Jiri Hnidek
QA Contact: Jan Stavel
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2022-06-16 23:13 UTC by Paul Armstrong
Modified: 2022-11-15 13:17 UTC (History)
5 users (show)

Fixed In Version: subscription-manager-cockpit-2-1.el9
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2022-11-15 11:21:22 UTC
Type: Bug
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)
Screen shot of cockpit UI - not reporting (52.08 KB, image/png)
2022-06-16 23:13 UTC, Paul Armstrong 		no flags Details
View All


Links
System ID Private Priority Status Summary Last Updated
Github candlepin subscription-manager-cockpit pull 10 0 None Merged cockpit: Read files in /var/lib/insights as superuser 2022-07-28 03:47:29 UTC
Red Hat Issue Tracker RHELPLAN-125537 0 None None None 2022-06-16 23:27:47 UTC
Red Hat Product Errata RHBA-2022:8366 0 None None None 2022-11-15 11:21:29 UTC

Description Paul Armstrong 2022-06-16 23:13:39 UTC 
Created attachment 1890784 [details]
Screen shot of cockpit UI - not reporting

Description of problem:
When the system is registered to insights through Satellite at deploy time, the cockpit UI displays "not connected" even when the system is. 

Version-Release number of selected component (if applicable):
Satellite 6.10.5.1
RHEL 9.0


How reproducible:
Always

Steps to Reproduce:
1. Deploy RHEL9 system and register to satellite using ansible.
2. Enable cockpit and login
3. Subscriptions page displays Insights: not connected
4. Run sudo insights-client --test-connection

Actual results:
command line shows system is reporting through satellite - all tests succeed.
Satellite says the system is reporting
Cockpit UI says the system is not reporting

Expected results:
command line shows system is reporting through satellite - all tests succeed.
Satellite says the system is reporting
Cockpit UI says the system is reporting


Additional info:
Comment 3 Paul Armstrong 2022-06-21 14:53:20 UTC 
parmstro@rhel9devbox ~]$ sudo insights-client --status
System is registered locally via .registered file. Registered at 2022-06-20T09:42:55.348508
Insights API confirms registration.
[parmstro@rhel9devbox ~]$
Comment 4 Paul Armstrong 2022-06-21 14:55:46 UTC 
[parmstro@rhel9devbox ~]$ sudo insights-client --test-connection
GET https://sat6.parmstrong.ca:443/redhat_access/r/insights/v1/branch_info
HTTP Status: 200 OK
HTTP Response Text: {"remote_leaf":"8b174ab6-6a56-4df0-8e8b-9a82f74e985d","remote_branch":"044516dd-b7cb-4f7f-bf56-980b21700d5b","display_name":"Default Organization","hostname":"sat6.parmstrong.ca","product":{"type":"Satellite","major_version":"6","minor_version":"10"},"organization_id":1,"satellite_instance_id":"f169744e-5ede-4ec1-9b71-f10e57923e26","labels":[{"namespace":"satellite","key":"location","value":"Default Location"},{"namespace":"satellite","key":"location","value":"Default Location"},{"namespace":"satellite","key":"organization","value":"Default Organization"},{"namespace":"satellite","key":"lifecycle_environment","value":"SOE_Development"},{"namespace":"satellite","key":"content_view","value":"SOE_RHEL9"},{"namespace":"satellite","key":"activation_key","value":"bootstrap9"},{"namespace":"satellite","key":"satellite_instance_id","value":"f169744e-5ede-4ec1-9b71-f10e57923e26"},{"namespace":"satellite","key":"organization_id","value":"1"},{"namespace":"satellite_parameter","key":"ansible_roles_check_mode","value":false},{"namespace":"satellite_parameter","key":"ansible_tower_fqdn","value":"tower.parmstrong.ca"},{"namespace":"satellite_parameter","key":"cockpit_enable","value":true},{"namespace":"satellite_parameter","key":"cockpit_listen_on","value":9090},{"namespace":"satellite_parameter","key":"enable-epel","value":"false"},{"namespace":"satellite_parameter","key":"enable-puppet5","value":false},{"namespace":"satellite_parameter","key":"fips_enabled","value":false},{"namespace":"satellite_parameter","key":"freeipa_mkhomedir","value":true},{"namespace":"satellite_parameter","key":"host_registration_insights","value":true},{"namespace":"satellite_parameter","key":"host_registration_remote_execution","value":false},{"namespace":"satellite_parameter","key":"redhat_install_agent","value":false},{"namespace":"satellite_parameter","key":"redhat_install_host_tools","value":true},{"namespace":"satellite_parameter","key":"redhat_install_host_tracer_tools","value":true},{"namespace":"satellite_parameter","key":"time-zone","value":"America/Toronto"},{"namespace":"satellite_parameter","key":"remote_execution_ssh_user","value":"realm-capsule"},{"namespace":"satellite_parameter","key":"remote_execution_effective_user_method","value":"sudo"},{"namespace":"satellite_parameter","key":"remote_execution_connect_by_ip","value":false}]}
Running Connection Tests...
=== Begin Upload URL Connection Test ===
Testing: https://sat6.parmstrong.ca:443/redhat_access/r/insights/uploads/
POST https://sat6.parmstrong.ca:443/redhat_access/r/insights/uploads/
HTTP Status: 200 OK
HTTP Response Text: {"request_id":"541b4559df1542ffa74d09a7326808c4","upload":{"account_number":"5258694","org_id":"6856506"}}
Successfully connected to: https://sat6.parmstrong.ca:443/redhat_access/r/insights/uploads/
=== End Upload URL Connection Test: SUCCESS ===

=== Begin API URL Connection Test ===
Testing: https://sat6.parmstrong.ca:443/redhat_access/r/insights/
GET https://sat6.parmstrong.ca:443/redhat_access/r/insights/
HTTP Status: 200 OK
HTTP Response Text: {"status":"available"}
Successfully connected to: https://sat6.parmstrong.ca:443/redhat_access/r/insights/
=== End API URL Connection Test: SUCCESS ===

Connectivity tests completed successfully
See /var/log/insights-client/insights-client.log for more details.
[parmstro@rhel9devbox ~]$
Comment 6 Pino Toscano 2022-06-28 16:45:47 UTC 
I think this might be due to a change in insights-client that narrowed the permissions of some of its directories.
We had a change related to that in our cockpit plugin:
https://github.com/candlepin/subscription-manager-cockpit/commit/5ba07cc1be72c1fe70f32f77fe90f98195e07dc1

Since we are in the process of splitting subscription-manager-cockpit in its own source, there is no fixed version of subscription-manager-cockpit for RHEL 9.x yet.
We will test this again once we get the split build in place.

Note that most likely you will find the same issue in RHEL 8; this was already fixed in development builds of subscription-manager-cockpit for RHEL 8.7.

@Paul: if you have the possibility to test 8.6 & 8.7, that would be great -- no problem or pressure if not, we'll get to it as well :)
Comment 8 Paul Armstrong 2022-06-28 17:24:20 UTC 
Testing 8.6
I am pulling from production for my satellite so no 8.7 yet, sorry.
Comment 10 Paul Armstrong 2022-06-28 19:01:19 UTC 
Test with RHEL 8.6 client, Satellite 6.10.6, subscription-manager-cockpit 1.28.29 == success
"Connected to Insights"
Comment 11 Paul Armstrong 2022-06-28 20:14:17 UTC 
Test with RHEL 8.6 client, Satellite 6.10.6, subscription-manager-cockpit 1.28.29 == success
"Connected to Insights"
Comment 12 Paul Armstrong 2022-06-28 21:19:05 UTC 
Related issue seems to have cropped up. This may be due to the ansible role in satellite. I will open a new BZ if that is the case.
After installation, the insights-client-results.service fails to start with the error No GPG-signed egg ... this is due to a improper SELinux context to the directory /root/.gnupg.

sudo /sbin/restorecon -vr /root/.gnupg/

corrects the issue, however, starting the service fails with:

Jun 28 17:10:00 bx2097919 systemd[1]: Starting Check for insights from Red Hat Cloud Services...
Jun 28 17:10:02 bx2097919 insights-client[18445]: 2022-06-28 17:10:02,297    DEBUG insights.client.client Logging initialized
Jun 28 17:10:02 bx2097919 insights-client[18445]: 2022-06-28 17:10:02,297    DEBUG root Loaded initial egg: /var/lib/insights/last_stable.egg/insights
Jun 28 17:10:02 bx2097919 insights-client[18445]: 2022-06-28 17:10:02,297    DEBUG insights.client /usr/bin/gpg --verify --keyring /etc/insights-client/redhattools.pub.gpg /var/lib/insights/last_stable.e
gg.asc /var/lib/insights/last_stable.egg
Jun 28 17:10:02 bx2097919 insights-client[18445]: 2022-06-28 17:10:02,311    DEBUG insights.client GPG return code: 0
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,738    DEBUG insights.client.client Logging initialized
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,738    DEBUG insights.client.auto_config Trying to autoconfigure...
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,745    DEBUG rhsm.https Using standard libs to provide httplib and ssl
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,749    DEBUG insights.client.auto_config Checking if system is subscription-manager registered
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,749    DEBUG insights.client.auto_config System is subscription-manager registered
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,750    DEBUG insights.client.auto_config Found Satellite 6 Server Host: sat6.parmstrong.ca, Port: 443
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,750    DEBUG insights.client.auto_config Found CA: /etc/rhsm/ca/katello-server-ca.pem
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,751    DEBUG insights.client.auto_config Setting authmethod to CERT
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,751    DEBUG insights.client.auto_config Trying to set auto_configuration
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,751    DEBUG insights.client.auto_config Attempting to auto configure!
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,751    DEBUG insights.client.auto_config Attempting to auto configure hostname: sat6.parmstrong.ca:443/redhat_access
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,751    DEBUG insights.client.auto_config Attempting to auto configure CA cert: /etc/rhsm/ca/katello-server-ca.pem
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,751    DEBUG insights.client.auto_config Attempting to auto configure proxy: None
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,751    DEBUG insights.client.auto_config Auto-configured base_url: sat6.parmstrong.ca:443/redhat_access/r/insights
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,751    DEBUG insights.client.auto_config Verifying Connectivity
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,751    DEBUG insights.client.connection NO PROXY: None
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,857    DEBUG insights.client.connection Obtaining branch information from https://sat6.parmstrong.ca:443/redhat_access/r/insights/v1/
branch_info
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,858  NETWORK insights.client.connection GET https://sat6.parmstrong.ca:443/redhat_access/r/insights/v1/branch_info
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,861    DEBUG insights.client.auto_config HTTPSConnectionPool(host='sat6.parmstrong.ca', port=443): Max retries exceeded with url: /re
dhat_access/r/insights/v1/branch_info (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f7443d50ac8>: Failed to establish a new connection: [Errno -2] Name or servic
e not known',))
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,861    DEBUG insights.client.auto_config Failed to connect to satellite
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,862  WARNING insights.client.auto_config Could not auto configure, falling back to static config
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,862  WARNING insights.client.auto_config See /var/log/insights-client/insights-client.log for additional information
Jun 28 17:10:02 bx2097919 insights-client[18460]: 2022-06-28 17:10:02,862    DEBUG insights.client.auto_config Updated base_url: cert-api.access.redhat.com/r/insights/platform
Jun 28 17:10:02 bx2097919 insights-client[18445]: 2022-06-28 17:10:02,913    DEBUG insights.client /usr/bin/gpg --verify --keyring /etc/insights-client/redhattools.pub.gpg /var/lib/insights/last_stable.e
gg.asc /var/lib/insights/last_stable.egg
Jun 28 17:10:02 bx2097919 insights-client[18445]: 2022-06-28 17:10:02,926    DEBUG insights.client GPG return code: 0
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,354    DEBUG insights.client.client Logging initialized
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,355    DEBUG insights.client.auto_config Trying to autoconfigure...
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,361    DEBUG rhsm.https Using standard libs to provide httplib and ssl
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,365    DEBUG insights.client.auto_config Checking if system is subscription-manager registered
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,365    DEBUG insights.client.auto_config System is subscription-manager registered
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,365    DEBUG insights.client.auto_config Found Satellite 6 Server Host: sat6.parmstrong.ca, Port: 443
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,365    DEBUG insights.client.auto_config Found CA: /etc/rhsm/ca/katello-server-ca.pem
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,365    DEBUG insights.client.auto_config Setting authmethod to CERT
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,365    DEBUG insights.client.auto_config Trying to set auto_configuration
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,365    DEBUG insights.client.auto_config Attempting to auto configure!
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,365    DEBUG insights.client.auto_config Attempting to auto configure hostname: sat6.parmstrong.ca:443/redhat_access
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,366    DEBUG insights.client.auto_config Attempting to auto configure CA cert: /etc/rhsm/ca/katello-server-ca.pem
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,366    DEBUG insights.client.auto_config Attempting to auto configure proxy: None
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,366    DEBUG insights.client.auto_config Auto-configured base_url: sat6.parmstrong.ca:443/redhat_access/r/insights
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,366    DEBUG insights.client.auto_config Verifying Connectivity
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,366    DEBUG insights.client.connection NO PROXY: None
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,472    DEBUG insights.client.connection Obtaining branch information from https://sat6.parmstrong.ca:443/redhat_access/r/insights/v1/branch_info
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,473  NETWORK insights.client.connection GET https://sat6.parmstrong.ca:443/redhat_access/r/insights/v1/branch_info
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,475    DEBUG insights.client.auto_config HTTPSConnectionPool(host='sat6.parmstrong.ca', port=443): Max retries exceeded with url: /redhat_access/r/insights/v1/branch_info (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f91f65dfac8>: Failed to establish a new connection: [Errno -2] Name or service not known',))
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,475    DEBUG insights.client.auto_config Failed to connect to satellite
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,475  WARNING insights.client.auto_config Could not auto configure, falling back to static config
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,476  WARNING insights.client.auto_config See /var/log/insights-client/insights-client.log for additional information
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,476    DEBUG insights.client.auto_config Updated base_url: cert-api.access.redhat.com/r/insights/platform
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,476    DEBUG insights.client Egg update enabled
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,477    DEBUG insights.client Beginning core fetch.
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,477    DEBUG insights.client.connection NO PROXY: None
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,479  NETWORK insights.client.connection GET https://cert-api.access.redhat.com/r/insights/platform/module-update-router/v1/channel?module=insights-core
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,479    ERROR insights.client.phase.v1 Fatal error
Jun 28 17:10:03 bx2097919 insights-client[18466]: Traceback (most recent call last):
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/usr/lib/python3.6/site-packages/urllib3/connection.py", line 162, in _new_conn
Jun 28 17:10:03 bx2097919 insights-client[18466]:    (self._dns_host, self.port), self.timeout, **extra_kw)
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/usr/lib/python3.6/site-packages/urllib3/util/connection.py", line 57, in create_connection
Jun 28 17:10:03 bx2097919 insights-client[18466]:    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/usr/lib64/python3.6/socket.py", line 745, in getaddrinfo
Jun 28 17:10:03 bx2097919 insights-client[18466]:    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
Jun 28 17:10:03 bx2097919 insights-client[18466]: socket.gaierror: [Errno -2] Name or service not known
Jun 28 17:10:03 bx2097919 insights-client[18466]: During handling of the above exception, another exception occurred:
Jun 28 17:10:03 bx2097919 insights-client[18466]: Traceback (most recent call last):
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/usr/lib/python3.6/site-packages/urllib3/connectionpool.py", line 600, in urlopen
Jun 28 17:10:03 bx2097919 insights-client[18466]:    chunked=chunked)
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/usr/lib/python3.6/site-packages/urllib3/connectionpool.py", line 343, in _make_request
Jun 28 17:10:03 bx2097919 insights-client[18466]:    self._validate_conn(conn)
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/usr/lib/python3.6/site-packages/urllib3/connectionpool.py", line 839, in _validate_conn
Jun 28 17:10:03 bx2097919 insights-client[18466]:    conn.connect()
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/usr/lib/python3.6/site-packages/urllib3/connection.py", line 315, in connect
Jun 28 17:10:03 bx2097919 insights-client[18466]:    conn = self._new_conn()
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/usr/lib/python3.6/site-packages/urllib3/connection.py", line 171, in _new_conn
Jun 28 17:10:03 bx2097919 insights-client[18466]:    self, "Failed to establish a new connection: %s" % e)
Jun 28 17:10:03 bx2097919 insights-client[18466]: urllib3.exceptions.NewConnectionError: <urllib3.connection.VerifiedHTTPSConnection object at 0x7f91f66a0320>: Failed to establish a new connection: [Errno -2] Name or service not known
Jun 28 17:10:03 bx2097919 insights-client[18466]: During handling of the above exception, another exception occurred:
Jun 28 17:10:03 bx2097919 insights-client[18466]: Traceback (most recent call last):
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/usr/lib/python3.6/site-packages/requests/adapters.py", line 449, in send
Jun 28 17:10:03 bx2097919 insights-client[18466]:    timeout=timeout
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/usr/lib/python3.6/site-packages/urllib3/connectionpool.py", line 638, in urlopen
Jun 28 17:10:03 bx2097919 insights-client[18466]:    _stacktrace=sys.exc_info()[2])
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/usr/lib/python3.6/site-packages/urllib3/util/retry.py", line 399, in increment
Jun 28 17:10:03 bx2097919 insights-client[18466]:    raise MaxRetryError(_pool, url, error or ResponseError(cause))
Jun 28 17:10:03 bx2097919 insights-client[18466]: urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='cert-api.access.redhat.com', port=443): Max retries exceeded with url: /r/insights/platform/module-update-router/v1/channel?module=insights-core (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f91f66a0320>: Failed to establish a new connection: [Errno -2] Name or service not known',))
Jun 28 17:10:03 bx2097919 insights-client[18466]: During handling of the above exception, another exception occurred:
Jun 28 17:10:03 bx2097919 insights-client[18466]: Traceback (most recent call last):
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/var/lib/insights/last_stable.egg/insights/client/phase/v1.py", line 32, in _f
Jun 28 17:10:03 bx2097919 insights-client[18466]:    func(client, config)
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/var/lib/insights/last_stable.egg/insights/client/phase/v1.py", line 129, in update
Jun 28 17:10:03 bx2097919 insights-client[18466]:    client.update()
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/var/lib/insights/last_stable.egg/insights/client/__init__.py", line 258, in update
Jun 28 17:10:03 bx2097919 insights-client[18466]:    egg_paths = self.fetch()
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/var/lib/insights/last_stable.egg/insights/client/__init__.py", line 130, in fetch
Jun 28 17:10:03 bx2097919 insights-client[18466]:    egg_release = self.get_egg_url()
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/var/lib/insights/last_stable.egg/insights/client/__init__.py", line 72, in _init_connection
Jun 28 17:10:03 bx2097919 insights-client[18466]:    return func(self, *args, **kwargs)
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/var/lib/insights/last_stable.egg/insights/client/__init__.py", line 108, in get_egg_url
Jun 28 17:10:03 bx2097919 insights-client[18466]:    response = self.connection.get(url)
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/var/lib/insights/last_stable.egg/insights/client/connection.py", line 198, in get
Jun 28 17:10:03 bx2097919 insights-client[18466]:    return self._http_request(url, 'GET', **kwargs)
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/var/lib/insights/last_stable.egg/insights/client/connection.py", line 191, in _http_request
Jun 28 17:10:03 bx2097919 insights-client[18466]:    res = self.session.request(url=url, method=method, timeout=self.config.http_timeout, **kwargs)
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/usr/lib/python3.6/site-packages/requests/sessions.py", line 533, in request
Jun 28 17:10:03 bx2097919 insights-client[18466]:    resp = self.send(prep, **send_kwargs)
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/usr/lib/python3.6/site-packages/requests/sessions.py", line 646, in send
Jun 28 17:10:03 bx2097919 insights-client[18466]:    r = adapter.send(request, **kwargs)
Jun 28 17:10:03 bx2097919 insights-client[18466]:  File "/usr/lib/python3.6/site-packages/requests/adapters.py", line 516, in send
Jun 28 17:10:03 bx2097919 insights-client[18466]:    raise ConnectionError(e, request=request)
Jun 28 17:10:03 bx2097919 insights-client[18466]: requests.exceptions.ConnectionError: HTTPSConnectionPool(host='cert-api.access.redhat.com', port=443): Max retries exceeded with url: /r/insights/platform/module-update-router/v1/channel?module=insights-core (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f91f66a0320>: Failed to establish a new connection: [Errno -2] Name or service not known',))
Jun 28 17:10:03 bx2097919 insights-client[18466]: 2022-06-28 17:10:03,483    DEBUG insights.client Deleting temp directory /tmp/tmp9buayvqb.
Jun 28 17:10:03 bx2097919 insights-client[18445]: 2022-06-28 17:10:03,535    DEBUG insights_client Attempt failed.



When running in the context of the service you get the above error.

When running /usr/bin/insights-client --check-results at the command line using sudo or as root, the command succeeds.
Comment 15 Pino Toscano 2022-07-07 16:47:47 UTC 
(In reply to Paul Armstrong from comment #12)
> Related issue seems to have cropped up. This may be due to the ansible role
> in satellite. I will open a new BZ if that is the case.

I'm not sure I understand this; what would be the role of the ansible role (pun intended) in satellite?

> After installation, the insights-client-results.service fails to start with
> the error No GPG-signed egg ... this is due to a improper SELinux context to
> the directory /root/.gnupg.
> 
> sudo /sbin/restorecon -vr /root/.gnupg/

This is known bug in insights-client: bug 2077778.

Unfortunately, insights-client & SELinux is like a wack-a-mole game: adding new data collections in insights-client likely ends up using more system tools, and thus require more SELinux rules to allow this from non-command-line contexts such as cockpit.

My suggestion for now is to test the new plugin by switching SELinux at least in permissive mode.
Yeah, I know it is not pretty, however it will allow us to check whether it works regardless of the SELinux issues.

> corrects the issue, however, starting the service fails with:

I'm not expert in insights-client; what I see is the following flow of actions in insights-client:
- first, it tries to connect to the insights server on your own domain: https://sat6.parmstrong.ca/redhat_access/r/insights
- apparently it fails with "Name or service not known"
- this causes insights-client to fall back to the default Red Hat server: cert-api.access.redhat.com/r/insights
- apparently it fails too with "Name or service not known"

So unless there is a networking issue that prevents insights-client to lookup both the "sat6.parmstrong.ca" and "cert-api.access.redhat.com" domain names, the only option I see at the moment is, again, SELinux; especially that:

> When running /usr/bin/insights-client --check-results at the command line
> using sudo or as root, the command succeeds.

As I said, I'd try with SELinux not in enforcing mode.
Comment 16 Pino Toscano 2022-07-07 16:50:47 UTC 
Note for example bug 2062136, which affects insights-client: it is being fixed for RHEL 9.1.
This means that, if you test on 9.0, you will get it.
Comment 17 Paul Armstrong 2022-07-07 16:57:29 UTC 
Hi Pino,

Sorry I wasn't clear. I mean the RedHatInsights.insights-client role in Satellite that implements the configuration of Insights on a target. I use this exclusively for registering systems to insights.

I will look for SELinux issues, these should be logged.

Cheers,
Paul
Comment 18 Paul Armstrong 2022-07-19 16:18:48 UTC 
Hi Pino,

My automation cleaned up the machine that I was testing on. I am redeploying. I will let you know if I come up with any SELinux issues. Is that the info you are waiting for?
Comment 19 Pino Toscano 2022-07-19 16:26:24 UTC 
Hi Paul,

(In reply to Paul Armstrong from comment #18)
> My automation cleaned up the machine that I was testing on. I am
> redeploying. I will let you know if I come up with any SELinux issues. Is
> that the info you are waiting for?

Sort of:
1) deploy 9.0 as is, registering to Insights through Satellite
2) install the new version of subscription-manager-cockpit (see comment 7)
3) switch SELinux in Permissive mode
4) open the Cockpit web interface for the system, and check what's the result of the Insights registration

Thanks!
Comment 20 Paul Armstrong 2022-07-19 16:48:10 UTC 
Hmmm...  Latest deployment of RHEL 9 with Satellite 6.11 is showing that the system is connected to Insights.
Trying to find the build that I used when I reported the issue.
Comment 21 Paul Armstrong 2022-07-19 17:17:05 UTC 
I have redeployed 9.0
registered the system through insights
system shows connected
deployed new version of subscription-manager-cockpit (re: comment 7)
system shows connected.

SELinux in enforcing mode
Insights status in web UI: Connected to Insights

I am now unable to reproduce the issue.
\/oo\/
Comment 26 Jan Stavel 2022-07-28 16:51:58 UTC 
added ansible playbook to automate this case.
Comment 27 Jan Stavel 2022-07-28 17:03:05 UTC 
I have tested this case with RHEL-9.1.0-20220728.d.1
It works, ie. Cockpit displays 'Insights: Connected' after I register a system.
Comment 29 errata-xmlrpc 2022-11-15 11:21:22 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (subscription-manager-cockpit bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:8366
Note You need to log in before you can comment on or make changes to this bug.