Bug 1170768
| Summary: | Cronjob /etc/cron.daily/rhsmd fails sometimes with python traceback | ||
|---|---|---|---|
| Product: | Red Hat Enterprise Linux 6 | Reporter: | Devan Goodwin <dgoodwin> |
| Component: | subscription-manager | Assignee: | candlepin-bugs |
| Status: | CLOSED DUPLICATE | QA Contact: | John Sefler <jsefler> |
| Severity: | high | Docs Contact: | |
| Priority: | high | ||
| Version: | 6.6 | CC: | ahumbe, alikins, bkearney, brian, brian.murrell, crispin.bivans, dgoodwin, hmiles, jkurik, jsefler, pgervase, redhat-bugzilla, robert.scheck, skallesh, xdmoon |
| Target Milestone: | rc | Keywords: | Reopened |
| Target Release: | --- | ||
| Hardware: | All | ||
| OS: | Linux | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | Bug Fix | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | 1103824 | Environment: | |
| Last Closed: | 2015-01-13 16:10:17 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
| Bug Depends On: | 1103824 | ||
| Bug Blocks: | 1125249, 1167463, 1167464, 1170769 | ||
for the reproducer: Steps to Configure mockserver: [root@dhcp35-236 ~]# openssl req -new -key nc.key -out nc.csr -subj "/C=US/O=QA/CN=localhost" [root@dhcp35-236 ~]# openssl x509 -req -days 3650 -in nc.csr -signkey nc.key -out nc.crt Signature ok subject=/C=US/O=QA/CN=localhost Getting Private key [root@dhcp35-236 ~]# cat > 502.response <<BODY > HTTP/1.1 502 Bad Gateway > Content-Length: 590 > Connection: keep-alive > > <!DOCTYPE HTML PUBLIC -//IETF//DTD HTML 2.0//EN> > <html><head> > <title>502 Proxy Error</title> > </head><body><h1>Proxy Error</h1> > <p>The proxy server received an invalid > response from an upstream server.<br /> > The proxy server could not handle the request <em><a href=/subscription/consumers/9decaece-a2eb-42e6-8d2c-0fd541a38499/compliance>GET /subscription/consumers/9decaece-a2eb-42e6-8d2c-0fd541a38499/compliance</a></em>.<p> > Reason: <strong>Error reading from remote server</strong></p></p> > <hr> > <address>Apache Server at subscription.rhn.redhat.com Port 443</address> > </body></html> > BODY [root@dhcp35-236 ~]# [root@dhcp35-236 ~]# nc -l 8445 -k --ssl-cert nc.crt --ssl-key nc.key -e '/bin/cat 502.response' to verify server is up and running,open second terminal, [root@dhcp35-236 ~]# curl -k -v https://localhost:8445/ * About to connect() to localhost port 8445 (#0) * Trying ::1... * Connected to localhost (::1) port 8445 (#0) * Initializing NSS with certpath: sql:/etc/pki/nssdb * skipping SSL peer certificate verification * SSL connection using TLS_RSA_WITH_AES_128_CBC_SHA * Server certificate: * subject: CN=localhost,O=QA,C=US * start date: Jan 13 14:16:48 2015 GMT * expire date: Jan 10 14:16:48 2025 GMT * common name: localhost * issuer: CN=localhost,O=QA,C=US > GET / HTTP/1.1 > User-Agent: curl/7.29.0 > Host: localhost:8445 > Accept: */* > < HTTP/1.1 502 Bad Gateway < Content-Length: 590 < Connection: keep-alive < <!DOCTYPE HTML PUBLIC -//IETF//DTD HTML 2.0//EN> <html><head> <title>502 Proxy Error</title> </head><body><h1>Proxy Error</h1> <p>The proxy server received an invalid response from an upstream server.<br /> The proxy server could not handle the request <em><a href=/subscription/consumers/9decaece-a2eb-42e6-8d2c-0fd541a38499/compliance>GET /subscription/consumers/9decaece-a2eb-42e6-8d2c-0fd541a38499/compliance</a></em>.<p> Reason: <strong>Error reading from remote server</strong></p></p> <hr> <address>Apache Server at subscription.rhn.redhat.com Port 443</address> </body></html> * Connection #0 to host localhost left intact [root@dhcp35-236 ~]# Reproducer with following version of subscription-manager, [root@intel-d3c4702-01 ~]# subscription-manager version server type: Red Hat Subscription Management subscription management server: Unknown subscription management rules: Unknown subscription-manager: 1.12.14-7.el6 python-rhsm: 1.12.5-2.el6 [root@intel-d3c4702-01 ~]# subscription-manager register --username=qa --serverurl=subscription.rhn.stage.redhat.com:443/subscription --force The system with UUID 2b9e2db2-f20b-40a6-9086-ac6b459397a4 has been unregistered Password: The system has been registered with ID: c0d595dd-674c-4a90-8db7-1beed2848d3d Configure the system to communicate with mock server, #subscription-manager config --server.hostname=10.70.35.236 --server.port=8445 --server.insecure=1 [root@intel-d3c4702-01 ~]# crontab -r [root@intel-d3c4702-01 ~]# mail No mail for root [root@intel-d3c4702-01 ~]# crontab -e no crontab for root - using an empty one crontab: installing new crontab [root@intel-d3c4702-01 ~]# crontab -l * * * * * /etc/cron.daily/rhsmd [root@intel-d3c4702-01 ~]# sleep 60 You have new mail in /var/spool/mail/root [root@intel-d3c4702-01 ~]# mail Heirloom Mail version 12.4 7/29/08. Type ? for help. "/var/spool/mail/root": 1 message 1 new >N 1 Cron Daemon Tue Jan 13 09:56 57/3216 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" & Message 1: From root.eng.bos.redhat.com Tue Jan 13 09:56:02 2015 Return-Path: <root.eng.bos.redhat.com> Date: Tue, 13 Jan 2015 09:56:01 -0500 From: root.eng.bos.redhat.com (Cron Daemon) To: root.eng.bos.redhat.com Subject: Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd Content-Type: text/plain; charset=UTF-8 Auto-Submitted: auto-generated X-Cron-Env: <LANG=en_US.UTF-8> X-Cron-Env: <SHELL=/bin/sh> X-Cron-Env: <HOME=/root> X-Cron-Env: <PATH=/usr/bin:/bin> X-Cron-Env: <LOGNAME=root> X-Cron-Env: <USER=root> Status: R Traceback (most recent call last): File "/usr/libexec/rhsmd", line 265, in <module> main() File "/usr/libexec/rhsmd", line 226, in main status = check_status(force_signal) File "/usr/libexec/rhsmd", line 88, in check_status sorter = require(CERT_SORTER) File "/usr/share/rhsm/subscription_manager/injection.py", line 102, in require return FEATURES.require(feature, *args, **kwargs) File "/usr/share/rhsm/subscription_manager/injection.py", line 76, in require self.providers[feature] = provider() File "/usr/share/rhsm/subscription_manager/cert_sorter.py", line 317, in __init__ super(CertSorter, self).__init__() File "/usr/share/rhsm/subscription_manager/cert_sorter.py", line 65, in __init__ self.load() File "/usr/share/rhsm/subscription_manager/cert_sorter.py", line 111, in load self._parse_server_status() File "/usr/share/rhsm/subscription_manager/cert_sorter.py", line 130, in _parse_server_status status = self.get_compliance_status() File "/usr/share/rhsm/subscription_manager/cert_sorter.py", line 325, in get_compliance_status return status_cache.load_status(self.cp_provider.get_consumer_auth_cp(), self.identity.uuid) File "/usr/share/rhsm/subscription_manager/cache.py", line 181, in load_status self._sync_with_server(uep, uuid) File "/usr/share/rhsm/subscription_manager/cache.py", line 276, in _sync_with_server --More-- Verification after applying zstream fix for subscription-manager [root@intel-d3c4702-01 ~]# subscription-manager version server type: Red Hat Subscription Management subscription management server: Unknown subscription management rules: Unknown subscription-manager: 1.12.14-9.el6_6 python-rhsm: 1.13.8-1.el6 [root@intel-d3c4702-01 ~]# subscription-manager config --server.hostname=10.70.35.236 --server.port=8445 --server.insecure=1 [root@intel-d3c4702-01 ~]# crontab -r [root@intel-d3c4702-01 ~]# crontab -e no crontab for root - using an empty one crontab: installing new crontab [root@intel-d3c4702-01 ~]# crontab -l * * * * * /etc/cron.daily/rhsmd [root@intel-d3c4702-01 ~]# sleep 60 [root@intel-d3c4702-01 ~]# mail No mail for root [root@intel-d3c4702-01 ~]# tail -f /var/log/rhsm/rhsm.log 2015-01-13 10:14:01,543 [INFO] rhsmd @rhsmd:226 - rhsmd started 2015-01-13 10:14:01,544 [INFO] rhsmd @rhsmd:257 - logging subscription status to syslog 2015-01-13 10:14:01,628 [DEBUG] rhsmd @identity.py:131 - Loading consumer info from identity certificates. 2015-01-13 10:14:01,641 [DEBUG] rhsmd @profile.py:97 - Loading current RPM profile. 2015-01-13 10:14:01,931 [INFO] rhsmd @connection.py:659 - Using certificate authentication: key = /etc/pki/consumer/key.pem, cert = /etc/pki/consumer/cert.pem, ca = /etc/rhsm/ca/, insecure = True 2015-01-13 10:14:01,932 [INFO] rhsmd @connection.py:670 - Connection Built: host: 10.70.35.236, port: 8445, handler: /subscription 2015-01-13 10:14:01,932 [INFO] rhsmd @cache.py:138 - Checking current system info against cache: /var/lib/rhsm/cache/installed_products.json 2015-01-13 10:14:01,933 [INFO] rhsmd @cache.py:155 - No changes. 2015-01-13 10:14:01,934 [DEBUG] rhsmd @certdirectory.py:216 - Installed product IDs: ['69'] 2015-01-13 10:14:01,935 [DEBUG] rhsmd @connection.py:446 - Making request: GET /subscription/consumers/c0d595dd-674c-4a90-8db7-1beed2848d3d/compliance 2015-01-13 10:14:01,966 [DEBUG] rhsmd @connection.py:469 - Response: status=502 2015-01-13 10:14:01,967 [ERROR] rhsmd @connection.py:498 - Response: 502 2015-01-13 10:14:01,967 [ERROR] rhsmd @connection.py:499 - JSON parsing error: No JSON object could be decoded 2015-01-13 10:14:01,967 [ERROR] rhsmd @cache.py:204 - Server error attempting a GET to /subscription/consumers/c0d595dd-674c-4a90-8db7-1beed2848d3d/compliance returned status 502 2015-01-13 10:14:01,968 [WARNING] rhsmd @cache.py:210 - Unable to reach server, using cached status. 2015-01-13 10:14:01,969 [DEBUG] rhsmd @cert_sorter.py:193 - valid entitled products: [] 2015-01-13 10:14:01,970 [DEBUG] rhsmd @cert_sorter.py:194 - expired entitled products: [] 2015-01-13 10:14:01,970 [DEBUG] rhsmd @cert_sorter.py:195 - partially entitled products: [] 2015-01-13 10:14:01,970 [DEBUG] rhsmd @cert_sorter.py:196 - unentitled products: [u'69'] 2015-01-13 10:14:01,971 [DEBUG] rhsmd @cert_sorter.py:197 - future products: [] 2015-01-13 10:14:01,971 [DEBUG] rhsmd @cert_sorter.py:198 - partial stacks: [] 2015-01-13 10:14:01,971 [DEBUG] rhsmd @cert_sorter.py:199 - entitlements valid until: None 2015-01-13 10:14:01,972 [INFO] rhsmd @rhsmd:219 - rhsmd: This system is missing one or more subscriptions. Please run subscription-manager for more information. 2015-01-13 10:15:01,356 [INFO] rhsmd @rhsmd:226 - rhsmd started 2015-01-13 10:15:01,358 [INFO] rhsmd @rhsmd:257 - logging subscription status to syslog 2015-01-13 10:15:01,441 [DEBUG] rhsmd @identity.py:131 - Loading consumer info from identity certificates. 2015-01-13 10:15:01,454 [DEBUG] rhsmd @profile.py:97 - Loading current RPM profile. 2015-01-13 10:15:01,750 [INFO] rhsmd @connection.py:659 - Using certificate authentication: key = /etc/pki/consumer/key.pem, cert = /etc/pki/consumer/cert.pem, ca = /etc/rhsm/ca/, insecure = True 2015-01-13 10:15:01,751 [INFO] rhsmd @connection.py:670 - Connection Built: host: 10.70.35.236, port: 8445, handler: /subscription 2015-01-13 10:15:01,752 [INFO] rhsmd @cache.py:138 - Checking current system info against cache: /var/lib/rhsm/cache/installed_products.json 2015-01-13 10:15:01,752 [INFO] rhsmd @cache.py:155 - No changes. 2015-01-13 10:15:01,753 [DEBUG] rhsmd @certdirectory.py:216 - Installed product IDs: ['69'] 2015-01-13 10:15:01,755 [DEBUG] rhsmd @connection.py:446 - Making request: GET /subscription/consumers/c0d595dd-674c-4a90-8db7-1beed2848d3d/compliance 2015-01-13 10:15:01,863 [DEBUG] rhsmd @connection.py:469 - Response: status=502 2015-01-13 10:15:01,864 [ERROR] rhsmd @connection.py:498 - Response: 502 2015-01-13 10:15:01,864 [ERROR] rhsmd @connection.py:499 - JSON parsing error: No JSON object could be decoded 2015-01-13 10:15:01,864 [ERROR] rhsmd @cache.py:204 - Server error attempting a GET to /subscription/consumers/c0d595dd-674c-4a90-8db7-1beed2848d3d/compliance returned status 502 2015-01-13 10:15:01,865 [WARNING] rhsmd @cache.py:210 - Unable to reach server, using cached status. 2015-01-13 10:15:01,866 [DEBUG] rhsmd @cert_sorter.py:193 - valid entitled products: [] 2015-01-13 10:15:01,867 [DEBUG] rhsmd @cert_sorter.py:194 - expired entitled products: [] 2015-01-13 10:15:01,867 [DEBUG] rhsmd @cert_sorter.py:195 - partially entitled products: [] 2015-01-13 10:15:01,867 [DEBUG] rhsmd @cert_sorter.py:196 - unentitled products: [u'69'] 2015-01-13 10:15:01,868 [DEBUG] rhsmd @cert_sorter.py:197 - future products: [] 2015-01-13 10:15:01,868 [DEBUG] rhsmd @cert_sorter.py:198 - partial stacks: [] 2015-01-13 10:15:01,868 [DEBUG] rhsmd @cert_sorter.py:199 - entitlements valid until: None 2015-01-13 10:15:01,869 [INFO] rhsmd @rhsmd:219 - rhsmd: This system is missing one or more subscriptions. Please run subscription-manager for more information. *** This bug has been marked as a duplicate of bug 1171385 *** |
verified!! Reproducer: [root@intel-d3c4702-01 ~]# subscription-manager version server type: Red Hat Subscription Management subscription management server: Unknown subscription management rules: Unknown subscription-manager: 1.12.14-7.el6 python-rhsm: 1.12.5-2.el6 [root@intel-d3c4702-01 ~]# subscription-manager register --username=qa --serverurl=subscription.rhn.stage.redhat.com Password: The system has been registered with ID: 2b9e2db2-f20b-40a6-9086-ac6b459397a4 modified /usr/lib64/python2.6/httplib.py file to get index error [root@intel-d3c4702-01 ~]# crontab -e no crontab for root - using an empty one crontab: installing new crontab [root@intel-d3c4702-01 ~]# crontab -l * * * * * /etc/cron.daily/rhsmd [root@intel-d3c4702-01 ~]# sleep 60 You have new mail in /var/spool/mail/root [root@intel-d3c4702-01 ~]# mail Heirloom Mail version 12.4 7/29/08. Type ? for help. "/var/spool/mail/root": 136 messages 136 new >N 1 Cron Daemon Mon Jan 12 06:15 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 2 ABRT Daemon Mon Jan 12 06:15 75/3838 "[abrt] a crash has been detected" N 3 Cron Daemon Mon Jan 12 06:16 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 4 ABRT Daemon Mon Jan 12 06:16 75/3844 "[abrt] a crash has been detected again" N 5 Cron Daemon Mon Jan 12 06:17 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 6 ABRT Daemon Mon Jan 12 06:17 75/3844 "[abrt] a crash has been detected again" N 7 Cron Daemon Mon Jan 12 06:18 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 8 ABRT Daemon Mon Jan 12 06:18 75/3844 "[abrt] a crash has been detected again" N 9 Cron Daemon Mon Jan 12 06:19 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 10 ABRT Daemon Mon Jan 12 06:19 75/3844 "[abrt] a crash has been detected again" N 11 Cron Daemon Mon Jan 12 06:20 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 12 ABRT Daemon Mon Jan 12 06:20 75/3844 "[abrt] a crash has been detected again" N 13 Cron Daemon Mon Jan 12 06:21 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 14 ABRT Daemon Mon Jan 12 06:21 75/3844 "[abrt] a crash has been detected again" N 15 Cron Daemon Mon Jan 12 06:22 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 16 ABRT Daemon Mon Jan 12 06:22 75/3844 "[abrt] a crash has been detected again" N 17 Cron Daemon Mon Jan 12 06:23 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 18 ABRT Daemon Mon Jan 12 06:23 75/3844 "[abrt] a crash has been detected again" N 19 Cron Daemon Mon Jan 12 06:24 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 20 ABRT Daemon Mon Jan 12 06:24 75/3844 "[abrt] a crash has been detected again" N 21 Cron Daemon Mon Jan 12 06:25 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 22 ABRT Daemon Mon Jan 12 06:25 75/3844 "[abrt] a crash has been detected again" N 23 Cron Daemon Mon Jan 12 06:26 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 24 ABRT Daemon Mon Jan 12 06:26 75/3844 "[abrt] a crash has been detected again" N 25 Cron Daemon Mon Jan 12 06:27 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 26 ABRT Daemon Mon Jan 12 06:27 75/3844 "[abrt] a crash has been detected again" N 27 Cron Daemon Mon Jan 12 06:28 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 28 ABRT Daemon Mon Jan 12 06:28 75/3844 "[abrt] a crash has been detected again" N 29 Cron Daemon Mon Jan 12 06:29 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 30 ABRT Daemon Mon Jan 12 06:29 75/3844 "[abrt] a crash has been detected again" N 31 Cron Daemon Mon Jan 12 06:30 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 32 ABRT Daemon Mon Jan 12 06:30 75/3844 "[abrt] a crash has been detected again" N 33 Cron Daemon Mon Jan 12 06:31 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 34 ABRT Daemon Mon Jan 12 06:31 75/3844 "[abrt] a crash has been detected again" N 35 Cron Daemon Mon Jan 12 06:32 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 36 ABRT Daemon Mon Jan 12 06:32 75/3844 "[abrt] a crash has been detected again" N 37 Cron Daemon Mon Jan 12 06:33 57/3045 "Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd" N 38 ABRT Daemon Mon Jan 12 06:33 75/3844 "[abrt] a crash has been detected again" & Message 1: From root.eng.bos.redhat.com Mon Jan 12 06:15:02 2015 Return-Path: <root.eng.bos.redhat.com> Date: Mon, 12 Jan 2015 06:15:02 -0500 From: root.eng.bos.redhat.com (Cron Daemon) To: root.eng.bos.redhat.com Subject: Cron <root@intel-d3c4702-01> /etc/cron.daily/rhsmd Content-Type: text/plain; charset=UTF-8 Auto-Submitted: auto-generated X-Cron-Env: <LANG=en_US.UTF-8> X-Cron-Env: <SHELL=/bin/sh> X-Cron-Env: <HOME=/root> X-Cron-Env: <PATH=/usr/bin:/bin> X-Cron-Env: <LOGNAME=root> X-Cron-Env: <USER=root> Status: R Traceback (most recent call last): File "/usr/libexec/rhsmd", line 265, in <module> main() File "/usr/libexec/rhsmd", line 226, in main status = check_status(force_signal) File "/usr/libexec/rhsmd", line 88, in check_status sorter = require(CERT_SORTER) File "/usr/share/rhsm/subscription_manager/injection.py", line 102, in require return FEATURES.require(feature, *args, **kwargs) File "/usr/share/rhsm/subscription_manager/injection.py", line 76, in require self.providers[feature] = provider() File "/usr/share/rhsm/subscription_manager/cert_sorter.py", line 317, in __init__ super(CertSorter, self).__init__() File "/usr/share/rhsm/subscription_manager/cert_sorter.py", line 65, in __init__ self.load() File "/usr/share/rhsm/subscription_manager/cert_sorter.py", line 111, in load self._parse_server_status() File "/usr/share/rhsm/subscription_manager/cert_sorter.py", line 130, in _parse_server_status status = self.get_compliance_status() File "/usr/share/rhsm/subscription_manager/cert_sorter.py", line 325, in get_compliance_status return status_cache.load_status(self.cp_provider.get_consumer_auth_cp(), self.identity.uuid) File "/usr/share/rhsm/subscription_manager/cache.py", line 181, in load_status self._sync_with_server(uep, uuid) File "/usr/share/rhsm/subscription_manager/cache.py", line 276, in _sync_with_server self.server_status = uep.getCompliance(uuid) File "/usr/lib64/python2.6/site-packages/rhsm/connection.py", line 869, in getCompliance return self.conn.request_get(method) File "/usr/lib64/python2.6/site-packages/rhsm/connection.py", line 550, in request_get return self._request("GET", method) File "/usr/lib64/python2.6/site-packages/rhsm/connection.py", line 453, in _request conn.request(request_type, handler, body=body, headers=headers) File "/usr/lib64/python2.6/httplib.py", line 912, in request raise IndexError() IndexError & Verification after installing zstream fix: [root@intel-d3c4702-01 ~]# subscription-manager version server type: Red Hat Subscription Management subscription management server: Unknown subscription management rules: Unknown subscription-manager: 1.12.14-9.el6_6 python-rhsm: 1.13.8-1.el6 [root@intel-d3c4702-01 ~]# crontab -e no crontab for root - using an empty one crontab: installing new crontab [root@intel-d3c4702-01 ~]# crontab -l * * * * * /etc/cron.daily/rhsmd [root@intel-d3c4702-01 ~]# sleep 60 [root@intel-d3c4702-01 ~]# mail No mail for root [root@intel-d3c4702-01 ~]# tail -f /var/log/rhsm/rhsm.log 2015-01-12 07:53:01,891 [INFO] rhsmd @rhsmd:226 - rhsmd started 2015-01-12 07:53:01,893 [INFO] rhsmd @rhsmd:257 - logging subscription status to syslog 2015-01-12 07:53:01,976 [DEBUG] rhsmd @identity.py:131 - Loading consumer info from identity certificates. 2015-01-12 07:53:01,989 [DEBUG] rhsmd @profile.py:97 - Loading current RPM profile. 2015-01-12 07:53:02,236 [INFO] rhsmd @connection.py:679 - Using certificate authentication: key = /etc/pki/consumer/key.pem, cert = /etc/pki/consumer/cert.pem, ca = /etc/rhsm/ca/, insecure = False 2015-01-12 07:53:02,237 [INFO] rhsmd @connection.py:690 - Connection Built: host: subscription.rhn.stage.redhat.com, port: 443, handler: /subscription 2015-01-12 07:53:02,237 [INFO] rhsmd @cache.py:138 - Checking current system info against cache: /var/lib/rhsm/cache/installed_products.json 2015-01-12 07:53:02,238 [INFO] rhsmd @cache.py:155 - No changes. 2015-01-12 07:53:02,239 [DEBUG] rhsmd @certdirectory.py:216 - Installed product IDs: ['69'] 2015-01-12 07:53:02,241 [DEBUG] rhsmd @connection.py:420 - Loaded CA certificates from /etc/rhsm/ca/: redhat-uep.pem, candlepin-stage.pem 2015-01-12 07:53:02,242 [DEBUG] rhsmd @connection.py:466 - Making request: GET /subscription/consumers/2b9e2db2-f20b-40a6-9086-ac6b459397a4/compliance 2015-01-12 07:53:02,245 [ERROR] rhsmd @rhsmd:60 - Unhandled rhsmd exception caught by the logging excepthook: Traceback (most recent call last): File "/usr/libexec/rhsmd", line 303, in <module> main() File "/usr/libexec/rhsmd", line 258, in main status = check_status(force_signal) File "/usr/libexec/rhsmd", line 120, in check_status sorter = require(CERT_SORTER) File "/usr/share/rhsm/subscription_manager/injection.py", line 102, in require return FEATURES.require(feature, *args, **kwargs) File "/usr/share/rhsm/subscription_manager/injection.py", line 76, in require self.providers[feature] = provider() File "/usr/share/rhsm/subscription_manager/cert_sorter.py", line 317, in __init__ super(CertSorter, self).__init__() File "/usr/share/rhsm/subscription_manager/cert_sorter.py", line 65, in __init__ self.load() File "/usr/share/rhsm/subscription_manager/cert_sorter.py", line 111, in load self._parse_server_status() File "/usr/share/rhsm/subscription_manager/cert_sorter.py", line 130, in _parse_server_status status = self.get_compliance_status() File "/usr/share/rhsm/subscription_manager/cert_sorter.py", line 325, in get_compliance_status return status_cache.load_status(self.cp_provider.get_consumer_auth_cp(), self.identity.uuid) File "/usr/share/rhsm/subscription_manager/cache.py", line 181, in load_status self._sync_with_server(uep, uuid) File "/usr/share/rhsm/subscription_manager/cache.py", line 266, in _sync_with_server self.server_status = uep.getCompliance(uuid) File "/usr/lib64/python2.6/site-packages/rhsm/connection.py", line 889, in getCompliance return self.conn.request_get(method) File "/usr/lib64/python2.6/site-packages/rhsm/connection.py", line 570, in request_get return self._request("GET", method) File "/usr/lib64/python2.6/site-packages/rhsm/connection.py", line 473, in _request conn.request(request_type, handler, body=body, headers=headers) File "/usr/lib64/python2.6/httplib.py", line 912, in request raise IndexError() IndexError