Description of problem: After associating a repo with CDS when I check the CDS sync status, "error" is listing under "Last Result" field Version-Release number of selected component (if applicable): pulp 0.168 RHUI Tools 2.0.15 How reproducible: Always Steps to Reproduce: 1. Register a CDS using RHUI Manager 2. Associate a repo with CDS 3. display the CDS sync status Actual results: ------------------------------------------------------------------------------ -= Red Hat Update Infrastructure Management Tool =- -= CDS Synchronization Status =- Last Refreshed: 14:04:21 (updated every 5 seconds, ctrl+c to exit) cd007 ....................................................... [ UP ] Next Sync Last Sync Last Result ------------------------------------------------------------------------------ cd007 Unscheduled Never error Connected: dhcp193-131.pnq.redhat.com ------------------------------------------------------------------------------ Expected results: There should not be "error" under "Last Result". Ideally "Last Result" should be set as scheduled. Additional info: When I triggered the individual CDS repo sync with same repo, I got following message: Scheduling sync for cd007... ... sync already in progress, new schedule was not added. Please note that actually sync was not started yet. Didn't find anything in rhui.log [root@dhcp193-134 ~]# tail -f /var/log/pulp-cds/gofer.log Received initialize call Received release call Received initialize call Received release call Received initialize call ^C [root@dhcp193-134 ~]# tail -f /var/log/gofer/agent.log "method": "set_repo_auth", "auth": { "secret": "af6569fb-1506-4313-bd31-78eb87a9caf0", "uuid": "cds-dhcp193-134.pnq.redhat.com" } } 2011-04-20 12:34:17,474 [INFO][worker-0] set_repo_auth() @ cdsplugin.py:125 - Setting repo auth credentials for repo [rhel-server-6-updates-srpms-6Server-x86_64] 2011-04-20 12:34:17,476 [INFO][worker-0] _write_cert_bundle() @ repo_cert_utils.py:351 - Storing repo cert file [/etc/pki/content/rhel-server-6-updates-srpms-6Server-x86_64/consumer-rhel-server-6-updates-srpms-6Server-x86_64.ca] 2011-04-20 12:34:17,478 [INFO][worker-0] _write_cert_bundle() @ repo_cert_utils.py:351 - Storing repo cert file [/etc/pki/content/rhel-server-6-updates-srpms-6Server-x86_64/consumer-rhel-server-6-updates-srpms-6Server-x86_64.cert] 2011-04-20 12:34:17,481 [INFO][worker-0] _write_cert_bundle() @ repo_cert_utils.py:351 - Storing repo cert file [/etc/pki/content/rhel-server-6-updates-srpms-6Server-x86_64/consumer-rhel-server-6-updates-srpms-6Server-x86_64.key]
Was the CDS previously registered? Specifically I'm looking for the case where the CDS was registered, you unregistered it, then registered it again without restarting httpd. My guess is that the last sync from the first time you registered failed and was still left around in the system.
I configured a clean CDS node. Register it with rhui-manager and then associate a repo with it. But After associating a repo when I checked the sync status with "dc".. the status in "Last result" was an "error". Then I unregister this CDS and re-register it without restarting httpd. and got same error. but i was getting this error since very first registration. I'll try this again on clean setup again, will try to share more info on this.
Moving to ON_QA while QE tries it on a clean setup.
I configured a clean setup with following builds: pulp 0.171 rhui-tools 2.0.22 Still I'm getting the same issue. This time I installed everything on clean nodes ( no updates). Steps performed : =================== 1. I registered a new CDS node using rhui-manager 2. Associate two repos ( rhui1.2 (5server i386 and x86_64)) 3. Check the sync schedule, Initially it was set as scheduled 4. After Triggering individual repo sync, got 'error' Machine info: ================= dhcp193-23 -- pulp-server dhcp193-1 --CDS dhcp193-136 -- rhui-manager Please see the logs below: ================================ ------------------------------------------------------------------------------ -= Red Hat Update Infrastructure Management Tool =- -= CDS Synchronization Status =- Last Refreshed: 11:35:04 (updated every 5 seconds, ctrl+c to exit) cds001 ...................................................... [ UP ] Next Sync Last Sync Last Result ------------------------------------------------------------------------------ cds001 04-28-2011 17:34 Never scheduled Connected: dhcp193-23.pnq.redhat.com ------------------------------------------------------------------------------ ^Crhui (sync) => sc -= CDS Synchronization Status =- Last Refreshed: 11:35:16 (updated every 5 seconds, ctrl+c to exit) cds001 ...................................................... [ UP ] Next Sync Last Sync Last Result ------------------------------------------------------------------------------ cds001 04-28-2011 17:34 04-28-2011 06:05 error Connected: dhcp193-23.pnq.redhat.com ------------------------------------------------------------------------------ ^Crhui (sync) => logout [root@dhcp193-23 ~]# pulp-admin -u admin -p admin cds list +------------------------------------------+ CDS Instances +------------------------------------------+ Name dhcp193-1.pnq.redhat.com Hostname cds001 Description None Repos rhui-1.2-5Server-i386, rhui-1.2-5Server-x86_64 Last Sync 2011-04-28 06:05:13 Status: Responding Yes Last Heartbeat 2011-04-28 06:19:22 [root@dhcp193-136 rhui_certs]# tail /root/.rhui/rhui.log Command [openssl x509 -req -days 365 -in /tmp/rhui-id-tfId3O/identity.csr -CA /etc/pki/rhui/entitlement-ca.crt -CAkey /etc/pki/rhui/entitlement-ca-key.pem -set_serial 100 -out /tmp/rhui-id-tfId3O/identity.crt -extfile /tmp/rhui-id-tfId3O/identity-extensions.txt -extensions rhui] Certificate creation output Signature ok subject=/CN=Red Hat Update Infrastructure Getting CA Private Key Connecting to RHUA [dhcp193-23.pnq.redhat.com]... Successfully connected to [dhcp193-23.pnq.redhat.com] [root@dhcp193-136 rhui_certs]# [root@dhcp193-23 ~]# tail -f /var/log/pulp/pulp.log File "/usr/lib/python2.6/site-packages/gofer/messaging/stub.py", line 142, in _send any=opts.any) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 126, in send return self.__getreply(sn) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 172, in __getreply return self.__onreply(envelope) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 188, in __onreply raise RemoteException.instance(reply) PulpException: 'Error on the CDS during sync; check the server log for more information' root@dhcp193-1 ~]# tail -f /var/log/gofer/agent.log RepoError: Cannot retrieve repository metadata (repomd.xml) for repository: . Please verify its path and try again 2011-04-28 11:35:12,646 [ERROR][worker-0] __call__() @ dispatcher.py:358 - Cannot retrieve repository metadata (repomd.xml) for repository: . Please verify its path and try again Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/gofer/messaging/dispatcher.py", line 355, in __call__ retval = method(*args, **keywords) File "/usr/lib/gofer/plugins/cdsplugin.py", line 118, in sync cdslib.sync(base_url, repos) File "/usr/lib/python2.6/site-packages/pulp/cds/cdslib.py", line 110, in sync raise e RepoError: Cannot retrieve repository metadata (repomd.xml) for repository: . Please verify its path and try again ^C [root@dhcp193-1 ~]# tail -f /var/log/pulp-cds/gofer.log self.yumFetch.getRepoData() File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 140, in getRepoData for ftype in self.getRepoXmlFileTypes(): File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 125, in getRepoXmlFileTypes return self.repo.repoXML.fileTypes() File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1417, in <lambda> repoXML = property(fget=lambda self: self._getRepoXML(), File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1413, in _getRepoXML raise Errors.RepoError, msg RepoError: Cannot retrieve repository metadata (repomd.xml) for repository: . Please verify its path and try again Listing of selected repos from pulp-server: =========================================== [root@dhcp193-23 ~]# cd /var/lib/pulp/repos/content/dist/rhel/rhui/server/5Server/ [root@dhcp193-23 5Server]# ll total 8 drwxr-sr-x. 3 apache apache 4096 Apr 28 11:27 i386 drwxr-sr-x. 3 apache apache 4096 Apr 28 11:27 x86_64 [root@dhcp193-23 5Server]# cd i386/rhui/1.2/os/ [root@dhcp193-23 os]# ls grinder-0.0.57-1.el5.noarch.rpm PyYAML-3.08-4.el5.i386.rpm httpd-2.2.3-43.el5_5.3.i386.rpm repodata libyaml-0.1.2-3.el5.i386.rpm rh-cds-0.27-1.el5_5.noarch.rpm m2crypto-0.16-6.1.el5_5.1.i386.rpm rh-rhua-0.91-1.el5_5.noarch.rpm mod_python-3.3.1-12.el5.i386.rpm rh-rhua-0.95-1.el5_5.noarch.rpm python-hashlib-20081119-5.el5.i386.rpm rh-rhui-tools-0.76-1.el5_5.noarch.rpm python-pycurl-7.15.5.1-4.el5.i386.rpm rpm-build-4.4.2.3-20.el5_5.1.i386.rpm [root@dhcp193-23 os]# cd ../../../.. [root@dhcp193-23 5Server]# cd x86_64/rhui/1.2/os/ [root@dhcp193-23 os]# ls grinder-0.0.57-1.el5.noarch.rpm httpd-2.2.3-43.el5_5.3.x86_64.rpm libyaml-0.1.2-3.el5.x86_64.rpm m2crypto-0.16-6.1.el5_5.1.x86_64.rpm mod_python-3.3.1-12.el5.x86_64.rpm python-hashlib-20081119-5.el5.x86_64.rpm python-pycurl-7.15.5.1-4.el5.x86_64.rpm PyYAML-3.08-4.el5.x86_64.rpm repodata rh-cds-0.27-1.el5_5.noarch.rpm rh-rhua-0.91-1.el5_5.noarch.rpm rh-rhua-0.95-1.el5_5.noarch.rpm rh-rhui-tools-0.76-1.el5_5.noarch.rpm rpm-build-4.4.2.3-20.el5_5.1.x86_64.rpm [root@dhcp193-23 os]#
The CDS sync is failing when it tries to establish an SSL connection to the Pulp server. One way to check this is to use wget to get the repo data yourself; it's output is much more usable than grinder's generic "Cannot retrieve repository metadata (repomd.xml) for repository". Certificates used for repo authentication are stored on the CDS under /etc/pki/content/<repo id>. The wget command looks like the following: wget https://dhcp193-23.pnq.redhat.com/pulp/repos/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.2/os/repodata/repomd.xml --certificate consumer-rhui-1.2-5Server-x86_64.cert --private-key consumer-rhui-1.2-5Server-x86_64.key --ca-certificate consumer-rhui-1.2-5Server-x86_64.ca You'll have to figure out the URL you want to test yourself. It's pretty much the server name as defined in /etc/pulp/pulp.conf on the server + /pulp/repos/ + the path to what you want to retrieve. The other three values are the certificate and private key used for repo auth and the CA used to verify the server's end of the SSL connection. When I run the above command I see: Resolving dhcp193-23.pnq.redhat.com... 10.65.193.23 Connecting to dhcp193-23.pnq.redhat.com|10.65.193.23|:443... connected. ERROR: cannot verify dhcp193-23.pnq.redhat.com’s certificate, issued by “/C=--/ST=SomeState/L=SomeCity/O=SomeOrganization/OU=SomeOrganizationalUnit/CN=dhcp193-23.pnq.redhat.com/emailAddress=root.redhat.com”: Self-signed certificate encountered. The important part in this case is the "Self-signed certificate encountered" portion. On a default Apache installation (more specifically, when mod_ssl is installed), it generates a self-signed SSL certificate using the current hostname of the instance. That means there is no external CA that's used to verify the certificate. The CDS, however, is configured to use the RHUI Manager user's CA certificate (the somewhat awkwardly named "entitlement_ca" under [security]). So when the CDS attempts to sync, it's looking at the certificate sent from the server, seeing that it doesn't validate against the CA it expects, and is aborting the connection (again, the grinder traceback you see doesn't indicate any of this). This shouldn't be an issue once you have RHUI Installer as part of that is to install a new SSL certificate in your Pulp server. In the meantime, you can create and install your own certificate in Apache: - Create a new certificate signed by the same CA you've been using for entitlement certificates. The CN *must* match the hostname of the machine (the value in /etc/pulp/pulp.conf). - Edit /etc/httpd/conf.d/ssl.conf to change the the following values to point to your newly created certificate and private key: -- SSLCertificateFile -- SSLCertificateKeyFile - Restart apache Then double check the above wget command to ensure you can download the repomd.xml file. If you can't, the CDS sync will likely not work as well and there are other configuration issues in play. Changing the status to ON_QA to let you give this a shot and see how it goes.
I created my own certs and use the CN as hostname of pulp server and updated the /etc/httpd/conf.d/ssl.conf file. Then again I tried the wget command and now I'm able to fetch repomd.xml file. [root@dhcp193-1 ~]# wget https://dhcp193-23.pnq.redhat.com/pulp/repos/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.2/os/repodata/repomd.xml --certificate /etc/pki/content/rhui-1.2-5Server-x86_64/consumer-rhui-1.2-5Server-x86_64.cert --private-key /etc/pki/content/rhui-1.2-5Server-x86_64/consumer-rhui-1.2-5Server-x86_64.key --ca-certificate /root/ca.crt --2011-05-03 08:35:32-- https://dhcp193-23.pnq.redhat.com/pulp/repos/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.2/os/repodata/repomd.xml Resolving dhcp193-23.pnq.redhat.com... 10.65.193.23 Connecting to dhcp193-23.pnq.redhat.com|10.65.193.23|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 1610 (1.6K) [text/plain] Saving to: “repomd.xml” 100%[======================================================>] 1,610 --.-K/s in 0s 2011-05-03 08:35:32 (38.6 MB/s) - “repomd.xml” saved [1610/1610] [root@dhcp193-1 ~]# ls anaconda-ks.cfg ca.crt install.log install.log.syslog repomd.xml [root@dhcp193-1 ~]# However, CDS sync is still failing with same error message. This time I've updated the correct ca cert in /etc/pki/content/<rhui1.2> directory. [root@dhcp193-1 rhui-1.2-5Server-x86_64]# wget https://dhcp193-23.pnq.redhat.com/pulp/repos/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.2/os/repodata/repomd.xml --certificate consumer-rhui-1.2-5Server-x86_64.cert --private-key consumer-rhui-1.2-5Server-x86_64.key --ca-certificate consumer-rhui-1.2-5Server-x86_64.ca --2011-05-03 10:12:32-- https://dhcp193-23.pnq.redhat.com/pulp/repos/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.2/os/repodata/repomd.xml Resolving dhcp193-23.pnq.redhat.com... 10.65.193.23 Connecting to dhcp193-23.pnq.redhat.com|10.65.193.23|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 1610 (1.6K) [text/plain] Saving to: “repomd.xml” 100%[===================================================================================================================>] 1,610 --.-K/s in 0s 2011-05-03 10:12:32 (28.1 MB/s) - “repomd.xml” saved [1610/1610] [root@dhcp193-1 rhui-1.2-5Server-x86_64]# ls consumer-rhui-1.2-5Server-x86_64.ca consumer-rhui-1.2-5Server-x86_64.cert consumer-rhui-1.2-5Server-x86_64.key repomd.xml [root@dhcp193-1 rhui-1.2-5Server-x86_64]#
I generated CDS config RPM using rhui-installer. After installing config rpm, I tried to sync CDS and got similar error as stated above in comment 4. Pulp.log on RHUA server says: ========================== 2011-05-30 16:00:47,372 [INFO][Thread-125] cds_sync() @ cds.py:419 - Synchronizing CDS [dhcp193-65.pnq.redhat.com] 2011-05-30 16:00:48,170 [INFO][Thread-125] sync() @ dispatcher.py:158 - sync using timeout=(10, 7200) 2011-05-30 16:00:50,135 [ERROR][Thread-125] cds_sync() @ cds.py:458 - CDS threw an error during sync to CDS [dhcp193-65.pnq.redhat.com] Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/pulp/server/api/cds.py", line 441, in cds_sync self.dispatcher.sync(cds, repos) File "/usr/lib/python2.6/site-packages/pulp/server/cds/dispatcher.py", line 160, in sync stub.sync(repo_base_url, repos) File "/usr/lib/python2.6/site-packages/gofer/messaging/stub.py", line 71, in __call__ return self.stub._send(request, opts) File "/usr/lib/python2.6/site-packages/gofer/messaging/stub.py", line 142, in _send any=opts.any) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 126, in send return self.__getreply(sn) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 172, in __getreply return self.__onreply(envelope) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 188, in __onreply raise RemoteException.instance(reply) CdsMethodException 2011-05-30 16:00:50,505 [INFO][Thread-125] run() @ task.py:371 - Task id:e1a3eb97-8aa7-11e0-affb-525400ff61a5, method_name:cds_sync Exception: 'Error on the CDS during sync; check the server log for more information' 2011-05-30 16:00:50,512 [ERROR][Thread-125] failed() @ task.py:412 - Task id:e1a3eb97-8aa7-11e0-affb-525400ff61a5, method_name:cds_sync: Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/pulp/server/tasking/task.py", line 355, in run result = self.callable(*self.args, **self.kwargs) File "/usr/lib/python2.6/site-packages/pulp/server/api/cds.py", line 441, in cds_sync self.dispatcher.sync(cds, repos) File "/usr/lib/python2.6/site-packages/pulp/server/cds/dispatcher.py", line 160, in sync stub.sync(repo_base_url, repos) File "/usr/lib/python2.6/site-packages/gofer/messaging/stub.py", line 71, in __call__ return self.stub._send(request, opts) File "/usr/lib/python2.6/site-packages/gofer/messaging/stub.py", line 142, in _send any=opts.any) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 126, in send return self.__getreply(sn) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 172, in __getreply return self.__onreply(envelope) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 188, in __onreply raise RemoteException.instance(reply) PulpException: 'Error on the CDS during sync; check the server log for more information' gofer.log from CDS node: ========================= Received sync call [{'name': 'Red Hat Update Infrastructure 1.2 (RPMs) (5Server-i386)', 'publish': True, 'relative_path': 'content/dist/rhel/rhui/server/5Server/i386/rhui/1.2/os', 'source': {'url': 'https://cdn.redhat.com/content/dist/rhel/rhui/server/5Server/i386/rhui/1.2/os', 'type': 'remote'}, '_id': 'rhui-1.2-5Server-i386', 'arch': 'noarch', 'id': 'rhui-1.2-5Server-i386'}, {'name': 'Red Hat Update Infrastructure 1.2 (RPMs) (5Server-x86_64)', 'publish': True, 'relative_path': 'content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.2/os', 'source': {'url': 'https://cdn.redhat.com/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.2/os', 'type': 'remote'}, '_id': 'rhui-1.2-5Server-x86_64', 'arch': 'noarch', 'id': 'rhui-1.2-5Server-x86_64'}] Synchronizing repo at [https://dhcp193-79.pnq.redhat.com//pulp/repos/content/dist/rhel/rhui/server/5Server/i386/rhui/1.2/os] Synchronizing repo [Red Hat Update Infrastructure 1.2 (RPMs) (5Server-i386)] from [https://dhcp193-79.pnq.redhat.com//pulp/repos/content/dist/rhel/rhui/server/5Server/i386/rhui/1.2/os] to [/var/lib/pulp-cds/content/dist/rhel/rhui/server/5Server/i386/rhui/1.2/os] Configuring repository for authentication Error performing sync Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/pulp/cds/cdslib.py", line 106, in sync self._sync_repos(base_url, repos) File "/usr/lib/python2.6/site-packages/pulp/cds/cdslib.py", line 214, in _sync_repos fetch.fetchYumRepo(repo_path) File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 395, in fetchYumRepo self.yumFetch.getRepoData() File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 140, in getRepoData for ftype in self.getRepoXmlFileTypes(): File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 125, in getRepoXmlFileTypes return self.repo.repoXML.fileTypes() File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1417, in <lambda> repoXML = property(fget=lambda self: self._getRepoXML(), File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1413, in _getRepoXML raise Errors.RepoError, msg RepoError: Cannot retrieve repository metadata (repomd.xml) for repository: . Please verify its path and try again Also, CDS went down, when I checked the CDS sync status using rhui-manager, also heartbeat was not responding ============================================================================= ------------------------------------------------------------------------------ -= Red Hat Update Infrastructure Management Tool =- -= CDS Synchronization Status =- Last Refreshed: 16:08:10 (updated every 50 seconds, ctrl+c to exit) cds0065 ..................................................... [ DOWN ] Next Sync Last Sync Last Result ------------------------------------------------------------------------------ cds0065 05-30-2011 16:23 05-30-2011 16:00 finished Connected: dhcp193-79.pnq.redhat.com ------------------------------------------------------------------------------ [root@dhcp193-79 ~]# pulp-admin -u admin -p admin cds list +------------------------------------------+ CDS Instances +------------------------------------------+ Name cds0065 Hostname dhcp193-65.pnq.redhat.com Description None Group None Sync Schedule 2011-05-26T17:23:28+05:30/PT1H Repos rhui-1.2-5Server-i386, rhui-1.2-5Server-x86_64 Last Sync 2011-05-30 16:00:50+05:30 Status: Responding No Last Heartbeat 2011-05-30 10:33:57.477139+00:00 Apache is also configured with generated certs: [root@dhcp193-65 cds]# vim /etc/httpd/conf.d/ssl.conf [root@dhcp193-65 cds]# ll total 16 -rw-r--r--. 1 root root 1269 May 27 18:36 cds-ssl-cert.crt -rw-r--r--. 1 root root 1679 May 27 18:36 cds-ssl-key.pem -rw-r--r--. 1 root root 747 May 27 18:36 qpid-ca.crt -rw-r--r--. 1 root root 1996 May 27 18:36 qpid-client.crt [root@dhcp193-65 cds]# The "/etc/pulp/cds.conf" is also configured with correct qpid certs.
Raising the severity of this defect, since it blocking the tests.
I'm actually making some changes in that area right now. I'll finish testing and let you know of the changes.
I'm still facing the same issue with new build pulp 0.186 and rhui-tools 2.0.26. I verified CA certs om rhua and CDS server. CDS and RHUA using same CA cert specified at location /etc/pki/content. Here pulp-server-ca.crt is the same CA cert which is being used on rhua under /etc/pki/rhua/rhua-ssl-ca-cert.crt SSL certs are correctly updated in apache's ssl.conf. on CDS: ====== [root@dhcp193-65 content]# pwd /etc/pki/content [root@dhcp193-65 content]# ls -l pulp-server-ca.crt -rw-r--r--. 1 root root 1371 Jun 3 16:04 pulp-server-ca.crt [root@dhcp193-65 content]# ON RHUA: ======== [root@dhcp193-79 rhua]# pwd /etc/pki/rhua [root@dhcp193-79 rhua]# ls -l rhua-ssl-ca-cert.crt -rw-r--r--. 1 root root 1371 Jun 2 12:56 rhua-ssl-ca-cert.crt [root@dhcp193-79 rhua]# pulp.log: ========== 2011-06-03 16:04:24,368 [INFO][Thread-75] cds_sync() @ cds.py:476 - Synchronizing CDS [dhcp193-65.pnq.redhat.com] 2011-06-03 16:04:24,379 [INFO][Thread-75] sync() @ dispatcher.py:135 - sync using timeout=(10, 7200) 2011-06-03 16:04:25,605 [ERROR][Thread-75] cds_sync() @ cds.py:568 - CDS threw an error during sync to CDS [dhcp193-65.pnq.redhat.com] Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/pulp/server/api/cds.py", line 551, in cds_sync self.dispatcher.sync(cds, payload) File "/usr/lib/python2.6/site-packages/pulp/server/cds/dispatcher.py", line 138, in sync self._send(stub.sync, data) File "/usr/lib/python2.6/site-packages/pulp/server/cds/dispatcher.py", line 170, in _send result = func(*args) File "/usr/lib/python2.6/site-packages/gofer/messaging/stub.py", line 71, in __call__ return self.stub._send(request, opts) File "/usr/lib/python2.6/site-packages/gofer/messaging/stub.py", line 142, in _send any=opts.any) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 126, in send return self.__getreply(sn) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 172, in __getreply return self.__onreply(envelope) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 188, in __onreply raise RemoteException.instance(reply) CdsMethodException 2011-06-03 16:04:25,608 [INFO][Thread-75] run() @ task.py:369 - Task id:0cc65c47-8dcd-11e0-b0c5-525400ff61a5, method_name:cds_sync Exception: 'Error on the CDS during sync; check the server log for more information' 2011-06-03 16:04:25,608 [ERROR][Thread-75] failed() @ task.py:410 - Task id:0cc65c47-8dcd-11e0-b0c5-525400ff61a5, method_name:cds_sync: Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/pulp/server/tasking/task.py", line 353, in run result = self.callable(*self.args, **self.kwargs) File "/usr/lib/python2.6/site-packages/pulp/server/api/cds.py", line 551, in cds_sync self.dispatcher.sync(cds, payload) File "/usr/lib/python2.6/site-packages/pulp/server/cds/dispatcher.py", line 138, in sync self._send(stub.sync, data) File "/usr/lib/python2.6/site-packages/pulp/server/cds/dispatcher.py", line 170, in _send result = func(*args) File "/usr/lib/python2.6/site-packages/gofer/messaging/stub.py", line 71, in __call__ return self.stub._send(request, opts) File "/usr/lib/python2.6/site-packages/gofer/messaging/stub.py", line 142, in _send any=opts.any) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 126, in send return self.__getreply(sn) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 172, in __getreply return self.__onreply(envelope) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 188, in __onreply raise RemoteException.instance(reply) PulpException: 'Error on the CDS during sync; check the server log for more information' [root@dhcp193-65 content]# tail -f /var/log/pulp-cds/gofer.log for ftype in self.getRepoXmlFileTypes(): File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 125, in getRepoXmlFileTypes return self.repo.repoXML.fileTypes() File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1417, in <lambda> repoXML = property(fget=lambda self: self._getRepoXML(), File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1413, in _getRepoXML raise Errors.RepoError, msg RepoError: Cannot retrieve repository metadata (repomd.xml) for repository: . Please verify its path and try again Received group membership update; Group [None], Members [] No changes needed to be made to group memberships When I associate a custom repo ( unprotected), the cds sync ran perfectly. So seems that issue is with certs. ------------------------------------------------------------------------------ -= Red Hat Update Infrastructure Management Tool =- -= CDS Synchronization Status =- Last Refreshed: 16:18:47 (updated every 50 seconds, ctrl+c to exit) cds0065 ..................................................... [ UP ] Next Sync Last Sync Last Result ------------------------------------------------------------------------------ cds0065 06-03-2011 17:01 06-03-2011 16:04 finished Connected: dhcp193-79.pnq.redhat.com ------------------------------------------------------------------------------ /var/log/pulp-cds/gofer.log says: =================================== {'server_ca_cert': '-----BEGIN CERTIFICATE-----\nMIIDxzCCAq+gAwIBAgIJAJuTXM/3ZFXJMA0GCSqGSIb3DQEBBQUAMHoxCzAJBgNV\nBAYTAklOMQswCQYDVQQIDAJNSDENMAsGA1UEBwwEUHVuZTEPMA0GA1UECgwGUmVk\nSGF0MQ0wCwYDVQQLDARFbmdnMQ4wDAYDVQQDDAVzZ2hhaTEfMB0GCSqGSIb3DQEJ\nARYQc2doYWlAcmVkaGF0LmNvbTAeFw0xMTA1MjcxMjQxMDBaFw0xMjA1MjYxMjQx\nMDBaMHoxCzAJBgNVBAYTAklOMQswCQYDVQQIDAJNSDENMAsGA1UEBwwEUHVuZTEP\nMA0GA1UECgwGUmVkSGF0MQ0wCwYDVQQLDARFbmdnMQ4wDAYDVQQDDAVzZ2hhaTEf\nMB0GCSqGSIb3DQEJARYQc2doYWlAcmVkaGF0LmNvbTCCASIwDQYJKoZIhvcNAQEB\nBQADggEPADCCAQoCggEBAMAYu52BCT1OYfSEMRKtID1XFXKu2NWLQNWEDOnVqNtN\nQb5I8vSHNyZgvCGYwQCU8BZ0jFU2AyOPG/vZGnEm/plidUM/YUw7f74fCPxlo8qw\nySU/atI+EMeE9ZVquBEPfRJVtBrScySxe2sk88u2ke5tqcY60Z42jC/kQTMDt+tZ\nsrFbZcVIE29Iv/CQ235N2VjUDt96nhSHlnAb/s67JLZCePdAG6Xz2FBPqYNgdG2j\nI1NY+9nqCy4wi4cFxeJDqHZS0L6SdOZO7G1vb7vWC0WxLgOiaC8xD6kUAKCINKUy\nYTgs2AsIIYDRCBbKdkLeNl+HHDYIWrvGFzMZzVT4nDkCAwEAAaNQME4wHQYDVR0O\nBBYEFNpwoHJ6CZ+YdFqBB801sVmvxjV7MB8GA1UdIwQYMBaAFNpwoHJ6CZ+YdFqB\nB801sVmvxjV7MAwGA1UdEwQFMAMBAf8wDQYJKoZIhvcNAQEFBQADggEBAIQnpn8y\n7E2ISjJOJKwSY1muQuLU8ZIIRNWJorzDaKN1f5Tf9h+2hzxVbv0Nq7kCOXwAbGpI\nUfnCfiNOIMvCuFmXAiD31lle/pho1NHOWwcdX1M304Vrkf+DM4ludYMEJlW9bcF+\nuGDJY5JttLrjQllXo+FYamQHsIMSheMbTb+ihIuO4NMh7bGQeqR1bDaZ8uCs/FTz\njl0+shmxbG8XuIIlikKhzDIyoOWYgWC4n3d7mbxzmooYz2k3F3ndD6/7cuDJz9iv\nzAzEKCALPV6XYaNR3fFpxZabZPCbK1hUONGkJmE+kspWsJnM5dmLEfw/HQZVEb+W\nRDCOq2Y9sHO7sN8=\n-----END CERTIFICATE-----\n', 'group_members': None, 'repos': [{'name': 'repo102', 'publish': True, 'relative_path': 'protected/repo102', 'source': None, '_id': 'repo102', 'arch': 'noarch', 'id': 'repo102'}], 'repo_base_url': 'https://dhcp193-79.pnq.redhat.com//pulp/repos', 'repo_cert_bundles': {'repo102': None}, 'group_id': None, 'global_cert_bundle': None} Synchronizing repo at [https://dhcp193-79.pnq.redhat.com//pulp/repos/protected/repo102] Synchronizing repo [repo102] from [https://dhcp193-79.pnq.redhat.com//pulp/repos/protected/repo102] to [/var/lib/pulp-cds/protected/repo102] Successfully finished synccing [https://dhcp193-79.pnq.redhat.com//pulp/repos/protected/repo102] Received group membership update; Group [None], Members [] No changes needed to be made to group memberships
Looks like I am getting this as well. My I am not using ssl certs. [root@preethi ~]# rpm -q pulp pulp-0.0.186-1.fc14.noarch [root@pulp-cds ~]# rpm -q pulp-cds pulp-cds-0.0.186-1.fc14.noarch [root@pulp-cds ~]# [root@preethi ~]# pulp-admin repo list +------------------------------------------+ List of Available Repositories +------------------------------------------+ Id f15 Name f15 Feed URL http://download.devel.redhat.com/released/F-15/GOLD/Fedora/x86_64/os/ Feed Type remote Feed Certs CA:No Cert:No Key:No Consumer Certs CA:No Cert:No Key:No Architecture noarch Sync Schedule 2011-06-02T14:00:00-04:00/PT1H Packages 2935 Files 0 Distributions ks-f15-noarch Publish True Clones [] Groups None Filters [] Notes {} [root@preethi ~]# pulp-admin cds list +------------------------------------------+ CDS Instances +------------------------------------------+ Name pulp-cds.usersys.redhat.com Hostname pulp-cds.usersys.redhat.com Description None Group None Sync Schedule None Repos f15 Last Sync 2011-06-03 08:06:10-04:00 Status: Responding Yes Last Heartbeat 2011-06-03 12:08:09.920807+00:00 pulp.log on cds sync 2011-06-03 08:06:09,849 [INFO][Dummy-2] initialize() @ connection.py:46 - Attempting Database connection with seeds = localhost 2011-06-03 08:06:09,857 [INFO][Dummy-2] initialize() @ connection.py:51 - Database connection established with: seeds = localhost, name = pulp_database 2011-06-03 08:06:10,092 [ERROR][Dummy-2] clear_all_sync_in_progress() @ repo.py:73 - r = SON([(u'_id', u'f15'), (u'id', u'f15'), (u'sync_in_progress', False)]) 2011-06-03 08:06:10,474 [WARNING][Dummy-2] __init__() @ scheduler.py:122 - IntervalScheduler created with start time more than one interval in the past: 2011-06-02 14:00:00-04:00, 1:00:00 2011-06-03 08:06:10,474 [ERROR][Dummy-2] set_synchronizer() @ repo_sync_task.py:32 - __name__ = pulp.server.api.repo_sync_task 2011-06-03 08:06:10,474 [WARNING][Dummy-2] schedule() @ task.py:287 - Task deaf68e1-8dd9-11e0-b519-002564a85a58: _sync(f15, synchronizer=<pulp.server.api.synchronizers.YumSynchronizer object at 0x7f1fb8d55610>) missed 18 scheduled runs 2011-06-03 08:06:10,525 [INFO][Thread-5] cds_sync() @ cds.py:476 - Synchronizing CDS [pulp-cds.usersys.redhat.com] 2011-06-03 08:06:10,530 [INFO][Thread-5] sync() @ dispatcher.py:135 - sync using timeout=(10, 7200) 2011-06-03 08:06:10,738 [ERROR][Thread-5] cds_sync() @ cds.py:568 - CDS threw an error during sync to CDS [pulp-cds.usersys.redhat.com] Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/pulp/server/api/cds.py", line 551, in cds_sync self.dispatcher.sync(cds, payload) File "/usr/lib/python2.7/site-packages/pulp/server/cds/dispatcher.py", line 138, in sync self._send(stub.sync, data) File "/usr/lib/python2.7/site-packages/pulp/server/cds/dispatcher.py", line 170, in _send result = func(*args) File "/usr/lib/python2.7/site-packages/gofer/messaging/stub.py", line 71, in __call__ return self.stub._send(request, opts) File "/usr/lib/python2.7/site-packages/gofer/messaging/stub.py", line 142, in _send any=opts.any) File "/usr/lib/python2.7/site-packages/gofer/messaging/policy.py", line 126, in send return self.__getreply(sn) File "/usr/lib/python2.7/site-packages/gofer/messaging/policy.py", line 172, in __getreply return self.__onreply(envelope) File "/usr/lib/python2.7/site-packages/gofer/messaging/policy.py", line 188, in __onreply raise RemoteException.instance(reply) CdsMethodException 2011-06-03 08:06:10,760 [INFO][Thread-5] run() @ task.py:369 - Task id:deb56c57-8dd9-11e0-b540-002564a85a58, method_name:cds_sync Exception: 'Error on the CDS during sync; check the server log for more information' 2011-06-03 08:06:10,771 [ERROR][Thread-5] failed() @ task.py:410 - Task id:deb56c57-8dd9-11e0-b540-002564a85a58, method_name:cds_sync: Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/pulp/server/tasking/task.py", line 353, in run result = self.callable(*self.args, **self.kwargs) File "/usr/lib/python2.7/site-packages/pulp/server/api/cds.py", line 551, in cds_sync self.dispatcher.sync(cds, payload) File "/usr/lib/python2.7/site-packages/pulp/server/cds/dispatcher.py", line 138, in sync self._send(stub.sync, data) File "/usr/lib/python2.7/site-packages/pulp/server/cds/dispatcher.py", line 170, in _send result = func(*args) File "/usr/lib/python2.7/site-packages/gofer/messaging/stub.py", line 71, in __call__ return self.stub._send(request, opts) File "/usr/lib/python2.7/site-packages/gofer/messaging/stub.py", line 142, in _send any=opts.any) File "/usr/lib/python2.7/site-packages/gofer/messaging/policy.py", line 126, in send return self.__getreply(sn) File "/usr/lib/python2.7/site-packages/gofer/messaging/policy.py", line 172, in __getreply return self.__onreply(envelope) File "/usr/lib/python2.7/site-packages/gofer/messaging/policy.py", line 188, in __onreply raise RemoteException.instance(reply) PulpException: 'Error on the CDS during sync; check the server log for more information'
Refiled in Pulp as 710455, I think this is a grinder issue.
The cds sync works by updating the nss and curl rpms to : => nss 3.12.9-9 => curl-7.19.7-26 Will test this out for the next RHUI build.
Will be in the next build.
Dependencies of => nss 3.12.9-9 => curl-7.19.7-26 are now added to grinder rpm. The above versions are must on pulp-server and pulp-cds nodes and on rhel 6 clients, for entire RHUI to work. For further details, please refer comment 3 of Bug : 710455
I face this issue now again with the following builds. [root@domU-12-31-38-00-05-D1 pulp]# rpm -qav | grep -ie "^curl-" -ie "nss-3" -ie pulp -ie rhui nss-3.12.9-9.el6.x86_64 pulp-client-0.0.199-1.el6.noarch rh-amazon-rhui-client-1.1.18-1.el6_0.noarch pulp-common-0.0.199-1.el6.noarch rh-rhui-tools-2.0.33-1.el6.noarch curl-7.19.7-26.el6.x86_64 pulp-0.0.199-1.el6.noarch root@domU-12-31-38-00-05-D1 pulp]# rpm -qav | grep -ie gofer -ie grinder grinder-0.0.103-1.el6.noarch gofer-0.42-1.el6.noarch python-gofer-0.42-1.el6.noarch I received the same error on both of my setups(same builds) . 2011-06-30 08:41:59,903 27614:140022889645840: pulp.server.api.cds:ERROR: cds:585 CDS threw an error during sync to CDS [ip-10-90-238-218] Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/pulp/server/api/cds.py", line 568, in cds_sync self.dispatcher.sync(cds, payload) File "/usr/lib/python2.6/site-packages/pulp/server/cds/dispatcher.py", line 138, in sync self._send(stub.sync, data) File "/usr/lib/python2.6/site-packages/pulp/server/cds/dispatcher.py", line 170, in _send result = func(*args) File "/usr/lib/python2.6/site-packages/gofer/messaging/stub.py", line 71, in __call__ return self.stub._send(request, opts) File "/usr/lib/python2.6/site-packages/gofer/messaging/stub.py", line 142, in _send any=opts.any) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 121, in send return self.__getreply(sn, reader) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 173, in __getreply return self.__onreply(envelope) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 189, in __onreply raise RemoteException.instance(reply) CdsMethodException 2011-06-30 08:41:59,910 27614:140022889645840: pulp.server.tasking.task:ERROR: task:380 Task failed: Task 58ef63a3-a316-11e0-b4e4-1231380005d1: CdsApi.cds_sync(ip-10-90-238-218, ) Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/pulp/server/tasking/task.py", line 329, in run result = self.callable(*self.args, **self.kwargs) File "/usr/lib/python2.6/site-packages/pulp/server/api/cds.py", line 568, in cds_sync self.dispatcher.sync(cds, payload) File "/usr/lib/python2.6/site-packages/pulp/server/cds/dispatcher.py", line 138, in sync self._send(stub.sync, data) File "/usr/lib/python2.6/site-packages/pulp/server/cds/dispatcher.py", line 170, in _send result = func(*args) File "/usr/lib/python2.6/site-packages/gofer/messaging/stub.py", line 71, in __call__ return self.stub._send(request, opts) File "/usr/lib/python2.6/site-packages/gofer/messaging/stub.py", line 142, in _send any=opts.any) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 121, in send return self.__getreply(sn, reader) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 173, in __getreply return self.__onreply(envelope) File "/usr/lib/python2.6/site-packages/gofer/messaging/policy.py", line 189, in __onreply raise RemoteException.instance(reply) PulpException: 'Error on the CDS during sync; check the server log for more information' 2011-06-30 08:42:00,186 27614:140022889645840: pulp.server.api.cds:INFO: cds:493 Synchronizing CDS [ip-10-87-3-183] 2011-06-30 08:42:00,200 27614:140022889645840: pulp.server.cds.dispatcher:INFO: dispatcher:135 sync using timeout=(10, 7200)
What do the CDS logs show?
pulp-cds/gofer.log Synchronizing repo at [https://domU-12-31-38-00-05-D1.compute-1.internal//pulp/repos/content/dist/rhel/rhui/server-6/releases/6Server/x86_64/os] Synchronizing repo [Red Hat Enterprise Linux Server 6 Releases (RPMs) (6Server-x86_64)] from [https://domU-12-31-38-00-05-D1.compute-1.internal//pulp/repos/content/dist/rhel/rhui/server-6/releases/6Server/x86_64/os] to [/var/lib/pulp-cds/repos/content/dist/rhel/rhui/server-6/releases/6Server/x86_64/os] Configuring repository for authentication Error performing repo sync Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/pulp/cds/cdslib.py", line 156, in sync self._sync_repo(base_url, repo) File "/usr/lib/python2.6/site-packages/pulp/cds/cdslib.py", line 332, in _sync_repo fetch.fetchYumRepo(repo_path) File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 393, in fetchYumRepo self.yumFetch.getRepoData() File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 138, in getRepoData for ftype in self.getRepoXmlFileTypes(): File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 123, in getRepoXmlFileTypes return self.repo.repoXML.fileTypes() File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1417, in <lambda> repoXML = property(fget=lambda self: self._getRepoXML(), File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1413, in _getRepoXML raise Errors.RepoError, msg RepoError: Cannot retrieve repository metadata (repomd.xml) for repository: . Please verify its path and try again Received cluster membership update; Cluster [rhui-cds-cluster], Members [ip-10-90-238-218, ip-10-87-3-183] No changes needed to be made to cluster memberships 2011-06-30 08:41:57,225 [INFO][worker-0] _write_cert_bundle() @ repo_cert_utils.py:348 - Storing repo cert file [/etc/pki/content/rhel-server-6-releases-6Server-x86_64/consumer-rhel-server-6-releases-6Server-x86_64.cert] 2011-06-30 08:41:57,226 [INFO][worker-0] _sync_repo() @ cdslib.py:296 - Synchronizing repo at [https://domU-12-31-38-00-05-D1.compute-1.internal//pulp/repos/content/dist/rhel/rhui/server-6/releases/6Server/x86_64/os] 2011-06-30 08:41:57,226 [INFO][worker-0] _sync_repo() @ cdslib.py:302 - Synchronizing repo [Red Hat Enterprise Linux Server 6 Releases (RPMs) (6Server-x86_64)] from [https://domU-12-31-38-00-05-D1.compute-1.internal//pulp/repos/content/dist/rhel/rhui/server-6/releases/6Server/x86_64/os] to [/var/lib/pulp-cds/repos/content/dist/rhel/rhui/server-6/releases/6Server/x86_64/os] 2011-06-30 08:41:57,226 [DEBUG][worker-0] _sync_repo() @ cdslib.py:309 - Configuring repository for authentication 2011-06-30 08:41:57,226 [INFO][worker-0] fetchYumRepo() @ RepoFetch.py:379 - fetchYumRepo() basepath = /var/lib/pulp-cds/repos/content/dist/rhel/rhui/server-6/releases/6Server/x86_64/os 2011-06-30 08:41:57,228 [INFO][worker-0] fetchYumRepo() @ RepoFetch.py:390 - Fetching repo metadata... 2011-06-30 08:41:57,283 [ERROR][worker-0] getRepoXmlFileTypes() @ RepoFetch.py:125 - Caught exception when trying to fetch content from [https://domU-12-31-38-00-05-D1.compute-1.internal//pulp/repos/content/dist/rhel/rhui/server-6/releases/6Server/x86_64/os]: Cannot retrieve repository metadata (repomd.xml) for repository: . Please verify its path and try again 2011-06-30 08:41:57,283 [ERROR][worker-0] sync() @ cdslib.py:159 - Error performing repo sync Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/pulp/cds/cdslib.py", line 156, in sync self._sync_repo(base_url, repo) File "/usr/lib/python2.6/site-packages/pulp/cds/cdslib.py", line 332, in _sync_repo fetch.fetchYumRepo(repo_path) File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 393, in fetchYumRepo self.yumFetch.getRepoData() File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 138, in getRepoData for ftype in self.getRepoXmlFileTypes(): File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 123, in getRepoXmlFileTypes return self.repo.repoXML.fileTypes() File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1417, in <lambda> repoXML = property(fget=lambda self: self._getRepoXML(), File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1413, in _getRepoXML raise Errors.RepoError, msg RepoError: Cannot retrieve repository metadata (repomd.xml) for repository: . Please verify its path and try again 2011-06-30 08:41:57,283 [INFO][worker-0] update_cluster_membership() @ cdslib.py:214 - Received cluster membership update; Cluster [rhui-cds-cluster], Members [ip-10-90-238-218, ip-10-87-3-183] 2011-06-30 08:41:57,284 [INFO][worker-0] update_cluster_membership() @ cdslib.py:225 - No changes needed to be made to cluster memberships 2011-06-30 08:41:57,284 [ERROR][worker-0] __call__() @ dispatcher.py:359 - The following errors occurred during the CDS sync: Error synchronizing repository [rhel-server-6-releases-6Server-x86_64] Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/gofer/messaging/dispatcher.py", line 356, in __call__ retval = method(*args, **keywords) File "/usr/lib/gofer/plugins/cdsplugin.py", line 118, in sync cdslib.sync(sync_data) File "/usr/lib/python2.6/site-packages/pulp/cds/cdslib.py", line 191, in sync raise Exception('The following errors occurred during the CDS sync: ' + ', '.join(error_messages)) Exception: The following errors occurred during the CDS sync: Error synchronizing repository [rhel-server-6-releases-6Server-x86_64]
missed this above, the log after the space in above comment is from that of gofer/agent.log
Upgrade from grinder 103 to grinder 104 necessary, to solve the above issue.
moving to release pending
closing out, product released