Bug 720251

Summary: Failed to sync CDS nodes from RHUA on upgraded setup
Product: Red Hat Update Infrastructure for Cloud Providers Reporter: Sachin Ghai <sghai>
Component: CDSAssignee: Jay Dobies <jason.dobies>
Status: CLOSED NOTABUG QA Contact: wes hayutin <whayutin>
Severity: high Docs Contact:
Priority: unspecified    
Version: 2.0CC: kbidarka, sghai
Target Milestone: ---   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2011-07-12 06:35:52 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Sachin Ghai 2011-07-11 08:31:01 UTC
Description of problem:
Getting error while syncing CDS nodes with RHUA. 

Steps performed before sync :
- mod_wsgi version 3.2-5 on rhua and CDS nodes 
- Created new config rpms and installed on RHUA and cds nodes.

[root@dhcp201-167 ~]# rpm -qa | grep mod_wsgi
mod_wsgi-3.2-5.el6.x86_64
[root@dhcp201-167 ~]#


I tested the CDS sync on existing CDS nodes. Then later I registered a new CDS nodes and then sync it with rhua and got same error.


logs for /var/log/httpd/ssl_error_log:
=====================================

[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] mod_python (pid=6746, interpreter='dhcp201-111.englab.pnq.redhat.com', phase='PythonAuthenHandler', handler='pulp.repo_auth.auth_handler_framework'): Application error
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] ServerName: 'dhcp201-111.englab.pnq.redhat.com'
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] DocumentRoot: '/var/www/html'
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] URI: '/pulp/repos/content/dist/rhel/rhui/server-6/releases/6Server/x86_64/os/repodata/repomd.xml'
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] Location: None
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] Directory: '/var/www/pub/repos/'
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] Filename: '/var/www/pub/repos/content/dist/rhel/rhui/server-6/releases/6Server/x86_64/os/repodata/repomd.xml'
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] PathInfo: ''
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] Traceback (most recent call last):
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib64/python2.6/site-packages/mod_python/importer.py", line 1537, in HandlerDispatch\n    default=default_handler, arg=req, silent=hlist.silent)
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib64/python2.6/site-packages/mod_python/importer.py", line 1229, in _process_target\n    result = _execute_target(config, req, object, arg)
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib64/python2.6/site-packages/mod_python/importer.py", line 1128, in _execute_target\n    result = object(arg)
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib/python2.6/site-packages/pulp/repo_auth/auth_handler_framework.py", line 50, in authenhandler\n    code = _handle(request)
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib/python2.6/site-packages/pulp/repo_auth/auth_handler_framework.py", line 99, in _handle\n    result = f(request)
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib/python2.6/site-packages/pulp/repo_auth/oid_validation.py", line 55, in authenticate\n    cert_pem = environ["mod_ssl.var_lookup"]("SSL_CLIENT_CERT")
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] TypeError: 'mp_request' object is unsubscriptable
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] mod_python (pid=6642, interpreter='dhcp201-111.englab.pnq.redhat.com', phase='PythonAuthenHandler', handler='pulp.repo_auth.auth_handler_framework'): Application error
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] ServerName: 'dhcp201-111.englab.pnq.redhat.com'
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] DocumentRoot: '/var/www/html'
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] URI: '/pulp/repos/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.2/os/repodata/repomd.xml'
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] Location: None
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] Directory: '/var/www/pub/repos/'
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] Filename: '/var/www/pub/repos/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.2/os/repodata/repomd.xml'
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] PathInfo: ''
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] Traceback (most recent call last):
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib64/python2.6/site-packages/mod_python/importer.py", line 1537, in HandlerDispatch\n    default=default_handler, arg=req, silent=hlist.silent)
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib64/python2.6/site-packages/mod_python/importer.py", line 1229, in _process_target\n    result = _execute_target(config, req, object, arg)
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib64/python2.6/site-packages/mod_python/importer.py", line 1128, in _execute_target\n    result = object(arg)
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib/python2.6/site-packages/pulp/repo_auth/auth_handler_framework.py", line 50, in authenhandler\n    code = _handle(request)
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib/python2.6/site-packages/pulp/repo_auth/auth_handler_framework.py", line 99, in _handle\n    result = f(request)
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib/python2.6/site-packages/pulp/repo_auth/oid_validation.py", line 55, in authenticate\n    cert_pem = environ["mod_ssl.var_lookup"]("SSL_CLIENT_CERT")
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] TypeError: 'mp_request' object is unsubscriptable
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] mod_python (pid=6639, interpreter='dhcp201-111.englab.pnq.redhat.com', phase='PythonAuthenHandler', handler='pulp.repo_auth.auth_handler_framework'): Application error
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] ServerName: 'dhcp201-111.englab.pnq.redhat.com'
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] DocumentRoot: '/var/www/html'
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] URI: '/pulp/repos/content/dist/rhel/rhui/server/5Server/i386/rhui/1.2/os/repodata/repomd.xml'
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] Location: None
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] Directory: '/var/www/pub/repos/'
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] Filename: '/var/www/pub/repos/content/dist/rhel/rhui/server/5Server/i386/rhui/1.2/os/repodata/repomd.xml'
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] PathInfo: ''
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] Traceback (most recent call last):
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib64/python2.6/site-packages/mod_python/importer.py", line 1537, in HandlerDispatch\n    default=default_handler, arg=req, silent=hlist.silent)
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib64/python2.6/site-packages/mod_python/importer.py", line 1229, in _process_target\n    result = _execute_target(config, req, object, arg)
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib64/python2.6/site-packages/mod_python/importer.py", line 1128, in _execute_target\n    result = object(arg)
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib/python2.6/site-packages/pulp/repo_auth/auth_handler_framework.py", line 50, in authenhandler\n    code = _handle(request)
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib/python2.6/site-packages/pulp/repo_auth/auth_handler_framework.py", line 99, in _handle\n    result = f(request)
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167]   File "/usr/lib/python2.6/site-packages/pulp/repo_auth/oid_validation.py", line 55, in authenticate\n    cert_pem = environ["mod_ssl.var_lookup"]("SSL_CLIENT_CERT")
[Mon Jul 11 12:54:03 2011] [error] [client 10.65.201.167] TypeError: 'mp_request' object is unsubscriptable
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] mod_python (pid=6636, interpreter='dhcp201-111.englab.pnq.redhat.com', phase='PythonAuthenHandler', handler='pulp.repo_auth.auth_handler_framework'): Application error
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] ServerName: 'dhcp201-111.englab.pnq.redhat.com'
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] DocumentRoot: '/var/www/html'
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] URI: '/pulp/repos/content/dist/rhel/rhui/server/5Server/i386/rhui/1.1/os/repodata/repomd.xml'
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] Location: None
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] Directory: '/var/www/pub/repos/'
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] Filename: '/var/www/pub/repos/content/dist/rhel/rhui/server/5Server/i386/rhui/1.1/os/repodata/repomd.xml'
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] PathInfo: ''
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] Traceback (most recent call last):
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167]   File "/usr/lib64/python2.6/site-packages/mod_python/importer.py", line 1537, in HandlerDispatch\n    default=default_handler, arg=req, silent=hlist.silent)
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167]   File "/usr/lib64/python2.6/site-packages/mod_python/importer.py", line 1229, in _process_target\n    result = _execute_target(config, req, object, arg)
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167]   File "/usr/lib64/python2.6/site-packages/mod_python/importer.py", line 1128, in _execute_target\n    result = object(arg)
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167]   File "/usr/lib/python2.6/site-packages/pulp/repo_auth/auth_handler_framework.py", line 50, in authenhandler\n    code = _handle(request)
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167]   File "/usr/lib/python2.6/site-packages/pulp/repo_auth/auth_handler_framework.py", line 99, in _handle\n    result = f(request)
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167]   File "/usr/lib/python2.6/site-packages/pulp/repo_auth/oid_validation.py", line 55, in authenticate\n    cert_pem = environ["mod_ssl.var_lookup"]("SSL_CLIENT_CERT")
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] TypeError: 'mp_request' object is unsubscriptable
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] mod_python (pid=6638, interpreter='dhcp201-111.englab.pnq.redhat.com', phase='PythonAuthenHandler', handler='pulp.repo_auth.auth_handler_framework'): Application error
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] ServerName: 'dhcp201-111.englab.pnq.redhat.com'
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] DocumentRoot: '/var/www/html'
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] URI: '/pulp/repos/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.1/os/repodata/repomd.xml'
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] Location: None
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] Directory: '/var/www/pub/repos/'
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] Filename: '/var/www/pub/repos/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.1/os/repodata/repomd.xml'
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] PathInfo: ''
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] Traceback (most recent call last):
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167]   File "/usr/lib64/python2.6/site-packages/mod_python/importer.py", line 1537, in HandlerDispatch\n    default=default_handler, arg=req, silent=hlist.silent)
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167]   File "/usr/lib64/python2.6/site-packages/mod_python/importer.py", line 1229, in _process_target\n    result = _execute_target(config, req, object, arg)
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167]   File "/usr/lib64/python2.6/site-packages/mod_python/importer.py", line 1128, in _execute_target\n    result = object(arg)
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167]   File "/usr/lib/python2.6/site-packages/pulp/repo_auth/auth_handler_framework.py", line 50, in authenhandler\n    code = _handle(request)
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167]   File "/usr/lib/python2.6/site-packages/pulp/repo_auth/auth_handler_framework.py", line 99, in _handle\n    result = f(request)
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167]   File "/usr/lib/python2.6/site-packages/pulp/repo_auth/oid_validation.py", line 55, in authenticate\n    cert_pem = environ["mod_ssl.var_lookup"]("SSL_CLIENT_CERT")
[Mon Jul 11 12:54:04 2011] [error] [client 10.65.201.167] TypeError: 'mp_request' object is unsubscriptable


Version-Release number of selected component (if applicable):
rhui-tools 2.0.37
pulp 0.204

[root@dhcp201-167 ~]# rpm -qa | grep pulp
pulp-cds-0.0.204-1.el6.noarch
pulp-common-0.0.204-1.el6.noarch
[root@dhcp201-167 ~]# 



How reproducible:
always

Steps to Reproduce:
1. Upgraded the setup with new rhui build 2.0.37
2. Added new repos
3. Created new rhua config rpms and CDS rpms
3. Sync the CDS with rhua
  
Actual results:
failed to sync CDS nodes with rhua

Expected results:
Sync should work perfectly without error

Additional info:
gofer logs from CDS nodes:
===========================

[root@dhcp201-167 ~]# tail -f /var/log/pulp-cds/gofer.log 
Synchronizing repo [Red Hat Update Infrastructure 1.1 (RPMs) (5Server-x86_64)] from [https://dhcp201-111.englab.pnq.redhat.com//pulp/repos/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.1/os] to [/var/lib/pulp-cds/repos/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.1/os]
Configuring repository for authentication
Error performing repo sync
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/pulp/cds/cdslib.py", line 156, in sync
    self._sync_repo(base_url, repo)
  File "/usr/lib/python2.6/site-packages/pulp/cds/cdslib.py", line 332, in _sync_repo
    fetch.fetchYumRepo(repo_path)
  File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 393, in fetchYumRepo
    self.yumFetch.getRepoData()
  File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 138, in getRepoData
    for ftype in self.getRepoXmlFileTypes():
  File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 123, in getRepoXmlFileTypes
    return self.repo.repoXML.fileTypes()
  File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1417, in <lambda>
    repoXML = property(fget=lambda self: self._getRepoXML(),
  File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1413, in _getRepoXML
    raise Errors.RepoError, msg
RepoError: Cannot retrieve repository metadata (repomd.xml) for repository: . Please verify its path and try again
Received cluster membership update; Cluster [rhui-cds-cluster], Members [dhcp201-175.englab.pnq.redhat.com, dhcp201-133.englab.pnq.redhat.com, dhcp201-167.englab.pnq.redhat.com]
No changes needed to be made to cluster memberships
[root@dhcp201-167 ~]# 




[root@dhcp201-167 ~]# tail -f /var/log/gofer/agent.log 
2011-07-11 12:54:04,301 [INFO][worker-0] _sync_repo() @ cdslib.py:296 - Synchronizing repo at [https://dhcp201-111.englab.pnq.redhat.com//pulp/repos/content/dist/rhel/rhui/server/5Server/i386/rhui/1.1/os]
2011-07-11 12:54:04,301 [INFO][worker-0] _sync_repo() @ cdslib.py:302 - Synchronizing repo [Red Hat Update Infrastructure 1.1 (RPMs) (5Server-i386)] from [https://dhcp201-111.englab.pnq.redhat.com//pulp/repos/content/dist/rhel/rhui/server/5Server/i386/rhui/1.1/os] to [/var/lib/pulp-cds/repos/content/dist/rhel/rhui/server/5Server/i386/rhui/1.1/os]
2011-07-11 12:54:04,301 [DEBUG][worker-0] _sync_repo() @ cdslib.py:309 - Configuring repository for authentication
2011-07-11 12:54:04,302 [INFO][worker-0] fetchYumRepo() @ RepoFetch.py:379 - fetchYumRepo() basepath = /var/lib/pulp-cds/repos/content/dist/rhel/rhui/server/5Server/i386/rhui/1.1/os
2011-07-11 12:54:04,303 [INFO][worker-0] fetchYumRepo() @ RepoFetch.py:390 - Fetching repo metadata...
2011-07-11 12:54:04,655 [ERROR][worker-0] getRepoXmlFileTypes() @ RepoFetch.py:125 - Caught exception when trying to fetch content from [https://dhcp201-111.englab.pnq.redhat.com//pulp/repos/content/dist/rhel/rhui/server/5Server/i386/rhui/1.1/os]: Cannot retrieve repository metadata (repomd.xml) for repository: . Please verify its path and try again
2011-07-11 12:54:04,655 [ERROR][worker-0] sync() @ cdslib.py:159 - Error performing repo sync
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/pulp/cds/cdslib.py", line 156, in sync
    self._sync_repo(base_url, repo)
  File "/usr/lib/python2.6/site-packages/pulp/cds/cdslib.py", line 332, in _sync_repo
    fetch.fetchYumRepo(repo_path)
  File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 393, in fetchYumRepo
    self.yumFetch.getRepoData()
  File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 138, in getRepoData
    for ftype in self.getRepoXmlFileTypes():
  File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 123, in getRepoXmlFileTypes
    return self.repo.repoXML.fileTypes()
  File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1417, in <lambda>
    repoXML = property(fget=lambda self: self._getRepoXML(),
  File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1413, in _getRepoXML
    raise Errors.RepoError, msg
RepoError: Cannot retrieve repository metadata (repomd.xml) for repository: . Please verify its path and try again
2011-07-11 12:54:04,655 [INFO][worker-0] _sync_repo() @ cdslib.py:296 - Synchronizing repo at [https://dhcp201-111.englab.pnq.redhat.com//pulp/repos/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.1/os]
2011-07-11 12:54:04,656 [INFO][worker-0] _sync_repo() @ cdslib.py:302 - Synchronizing repo [Red Hat Update Infrastructure 1.1 (RPMs) (5Server-x86_64)] from [https://dhcp201-111.englab.pnq.redhat.com//pulp/repos/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.1/os] to [/var/lib/pulp-cds/repos/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.1/os]
2011-07-11 12:54:04,656 [DEBUG][worker-0] _sync_repo() @ cdslib.py:309 - Configuring repository for authentication
2011-07-11 12:54:04,656 [INFO][worker-0] fetchYumRepo() @ RepoFetch.py:379 - fetchYumRepo() basepath = /var/lib/pulp-cds/repos/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.1/os
2011-07-11 12:54:04,657 [INFO][worker-0] fetchYumRepo() @ RepoFetch.py:390 - Fetching repo metadata...
2011-07-11 12:54:04,721 [ERROR][worker-0] getRepoXmlFileTypes() @ RepoFetch.py:125 - Caught exception when trying to fetch content from [https://dhcp201-111.englab.pnq.redhat.com//pulp/repos/content/dist/rhel/rhui/server/5Server/x86_64/rhui/1.1/os]: Cannot retrieve repository metadata (repomd.xml) for repository: . Please verify its path and try again
2011-07-11 12:54:04,721 [ERROR][worker-0] sync() @ cdslib.py:159 - Error performing repo sync
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/pulp/cds/cdslib.py", line 156, in sync
    self._sync_repo(base_url, repo)
  File "/usr/lib/python2.6/site-packages/pulp/cds/cdslib.py", line 332, in _sync_repo
    fetch.fetchYumRepo(repo_path)
  File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 393, in fetchYumRepo
    self.yumFetch.getRepoData()
  File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 138, in getRepoData
    for ftype in self.getRepoXmlFileTypes():
  File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 123, in getRepoXmlFileTypes
    return self.repo.repoXML.fileTypes()
  File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1417, in <lambda>
    repoXML = property(fget=lambda self: self._getRepoXML(),
  File "/usr/lib/python2.6/site-packages/yum/yumRepo.py", line 1413, in _getRepoXML
    raise Errors.RepoError, msg
RepoError: Cannot retrieve repository metadata (repomd.xml) for repository: . Please verify its path and try again
2011-07-11 12:54:04,722 [INFO][worker-0] update_cluster_membership() @ cdslib.py:214 - Received cluster membership update; Cluster [rhui-cds-cluster], Members [dhcp201-175.englab.pnq.redhat.com, dhcp201-133.englab.pnq.redhat.com, dhcp201-167.englab.pnq.redhat.com]
2011-07-11 12:54:04,722 [INFO][worker-0] update_cluster_membership() @ cdslib.py:225 - No changes needed to be made to cluster memberships
2011-07-11 12:54:04,722 [ERROR][worker-0] __call__() @ dispatcher.py:359 - The following errors occurred during the CDS sync: Error synchronizing repository [rhui_pulp], Error synchronizing repository [rhel-server-6-updates-6Server-x86_64], Error synchronizing repository [rhel-server-6-releases-6Server-x86_64], Error synchronizing repository [rhui-1.2-5Server-x86_64], Error synchronizing repository [rhui-1.2-5Server-i386], Error synchronizing repository [rhui-1.1-5Server-i386], Error synchronizing repository [rhui-1.1-5Server-x86_64]
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/gofer/messaging/dispatcher.py", line 356, in __call__
    retval = method(*args, **keywords)
  File "/usr/lib/gofer/plugins/cdsplugin.py", line 118, in sync
    cdslib.sync(sync_data)
  File "/usr/lib/python2.6/site-packages/pulp/cds/cdslib.py", line 191, in sync
    raise Exception('The following errors occurred during the CDS sync: ' + ', '.join(error_messages))
Exception: The following errors occurred during the CDS sync: Error synchronizing repository [rhui_pulp], Error synchronizing repository [rhel-server-6-updates-6Server-x86_64], Error synchronizing repository [rhel-server-6-releases-6Server-x86_64], Error synchronizing repository [rhui-1.2-5Server-x86_64], Error synchronizing repository [rhui-1.2-5Server-i386], Error synchronizing repository [rhui-1.1-5Server-i386], Error synchronizing repository [rhui-1.1-5Server-x86_64]

Comment 1 Sachin Ghai 2011-07-12 06:35:52 UTC
I installed a fresh setup with new builds  (rhui-tools 2.0.37 and pulp 0.204)

And on fresh setup CDS sync is working fine, so closing this now.