Bug 696216

Summary: cds sync seems to be failing
Product: [Retired] Pulp Reporter: Preethi Thomas <pthomas>
Component: nodesAssignee: Jay Dobies <jason.dobies>
Status: CLOSED CURRENTRELEASE QA Contact: Preethi Thomas <pthomas>
Severity: unspecified Docs Contact:
Priority: high    
Version: unspecifiedCC: skarmark
Target Milestone: ---Keywords: Triaged
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2011-08-16 12:10:40 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 647488, 688298    
Attachments:
Description Flags
pulp.log none

Description Preethi Thomas 2011-04-13 15:14:00 UTC 
Created attachment 491802 [details]
pulp.log

Description of problem:
[root@preethi repo-auth-certs]# rpm -q pulp
pulp-0.0.162-1.fc14.noarch
[root@preethi repo-auth-certs]# rpm -q gofer
gofer-0.31-1.fc14.noarch


Looks like the cds sync is failing for me.

It may be something to do with my setup but can not confirm that.

1. I had a pulp-server and pulp-client configured with repos bound. The repo has  global_repo_auth enabled
2. Now I added a cds . CDS register and Associate a repo that was already bound.
3. I see error in the pulp.log in server as well as gofer.log in cds






In Pulp-CDS gofer.log

Received sync call
[{'name': 'f13', 'publish': True, 'relative_path': 'repos/pulp/pulp/testing/fedora-13/x86_64', 'source': {'url': 'http://repos.fedorapeople.org/repos/pulp/pulp/testing/fedora-13/x86_64/', 'type': 'yum', 'supported_types': ['yum', 'local', 'rhn']}, '_id': 'f13', 'arch': 'x86_64', 'id': 'f13'}]
Synchronizing repo at [https://preethi.usersys.redhat.com//pulp/repos/repos/pulp/pulp/testing/fedora-13/x86_64]
Synchronizing repo [f13] from [https://preethi.usersys.redhat.com//pulp/repos/repos/pulp/pulp/testing/fedora-13/x86_64] to [/var/lib/pulp-cds/repos/pulp/pulp/testing/fedora-13/x86_64]
Error performing sync
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/pulp/cds/cdslib.py", line 107, in sync
    self._sync_repos(base_url, repos)
  File "/usr/lib/python2.7/site-packages/pulp/cds/cdslib.py", line 194, in _sync_repos
    fetch.fetchYumRepo(repo_path)
  File "/usr/lib/python2.7/site-packages/grinder/RepoFetch.py", line 332, in fetchYumRepo
    self.yumFetch.getRepoData()
  File "/usr/lib/python2.7/site-packages/grinder/RepoFetch.py", line 139, in getRepoData
    for ftype in self.getRepoXmlFileTypes():
  File "/usr/lib/python2.7/site-packages/grinder/RepoFetch.py", line 124, in getRepoXmlFileTypes
    return self.repo.repoXML.fileTypes()
  File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1413, in <lambda>
    repoXML = property(fget=lambda self: self._getRepoXML(),
  File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1409, in _getRepoXML
    raise Errors.RepoError, msg
RepoError: Cannot retrieve repository metadata (repomd.xml) for repository: . Please verify its path and try again

in Pulp-server ssl_error_log

[Wed Apr 13 11:21:14 2011] [error] [client 10.16.79.211] need AuthType to note auth failure: /pulp/repos/repos/pulp/pulp/testing/fedora-13/x86_64/repodata/repomd.xml
Comment 1 Jay Dobies 2011-04-14 21:17:34 UTC 
commit	2985aeb2a86174a9049e3cbee109b252bfeff641
tree	f64b87ce63b326300bcde6463978f0db353dd61c


696216 - Use the repo auth information when synccing repos from the pulp
server.


src/pulp/cds/cdslib.py
src/pulp/repo_auth/repo_cert_utils.py 	


This was specifically when synccing protected repos. Now the CDS will properly use the repo auth certs when trying to sync them.
Comment 2 Jeff Ortel 2011-04-19 18:49:19 UTC 
build: 0.168
Comment 3 Preethi Thomas 2011-05-11 18:18:28 UTC 
verified
[root@preethi unit]# rpm -q pulp
pulp-0.0.174-1.fc14.noarch

[root@preethi unit]# pulp-admin cds sync --hostname=pulp-cds.usersys.redhat.com
Sync for CDS [pulp-cds.usersys.redhat.com] started
Use "cds status" to check on the progress

[root@preethi unit]# pulp-admin cds status --hostname=pulp-cds.usersys.redhat.com
+------------------------------------------+
                 CDS Status
+------------------------------------------+

Name                	pulp-cds.usersys.redhat.com
Hostname            	pulp-cds.usersys.redhat.com
Description         	None                     
Repos               	repos-pulp-pulp-fedora-14-x86_64, f14-update
Last Sync           	2011-05-11 15:40:23      
Status:
   Responding       	Yes                      
   Last Heartbeat   	2011-05-11 17:58:18      

+------------------------------------------+
           Most Recent Sync Tasks
+------------------------------------------+

State               	running                  
Start Time          	2011-05-11 17:47:53      
Finish Time         	In Progress              

[root@preethi unit]# pulp-admin cds status --hostname=pulp-cds.usersys.redhat.com
+------------------------------------------+
                 CDS Status
+------------------------------------------+

Name                	pulp-cds.usersys.redhat.com
Hostname            	pulp-cds.usersys.redhat.com
Description         	None                     
Repos               	repos-pulp-pulp-fedora-14-x86_64, f14-update
Last Sync           	2011-05-11 15:40:23      
Status:
   Responding       	Yes                      
   Last Heartbeat   	2011-05-11 18:07:07      

+------------------------------------------+
           Most Recent Sync Tasks
+------------------------------------------+

State               	running                  
Start Time          	2011-05-11 17:47:53      
Finish Time         	In Progress              

[root@preethi unit]# pulp-admin cds status --hostname=pulp-cds.usersys.redhat.com
+------------------------------------------+
                 CDS Status
+------------------------------------------+

Name                	pulp-cds.usersys.redhat.com
Hostname            	pulp-cds.usersys.redhat.com
Description         	None                     
Repos               	repos-pulp-pulp-fedora-14-x86_64, f14-update
Last Sync           	2011-05-11 15:40:23      
Status:
   Responding       	Yes                      
   Last Heartbeat   	2011-05-11 18:13:25      

+------------------------------------------+
           Most Recent Sync Tasks
+------------------------------------------+

State               	running                  
Start Time          	2011-05-11 17:47:53      
Finish Time         	In Progress              

[root@preethi unit]# pulp-admin cds status --hostname=pulp-cds.usersys.redhat.com
+------------------------------------------+
                 CDS Status
+------------------------------------------+

Name                	pulp-cds.usersys.redhat.com
Hostname            	pulp-cds.usersys.redhat.com
Description         	None                     
Repos               	repos-pulp-pulp-fedora-14-x86_64, f14-update
Last Sync           	2011-05-11 18:18:30      
Status:
   Responding       	Yes                      
   Last Heartbeat   	2011-05-11 18:21:39      

+------------------------------------------+
           Most Recent Sync Tasks
+------------------------------------------+

State               	finished                 
Start Time          	2011-05-11 17:47:53      
Finish Time         	2011-05-11 18:18:30
Comment 4 Preethi Thomas 2011-08-16 12:10:40 UTC 
Closing with Community Release 15

pulp-0.0.223-4.
Comment 5 Preethi Thomas 2011-08-16 12:22:33 UTC 
Closing with Community Release 15

pulp-0.0.223-4.