Bug 712521 - Pulp Assumes rpms are beside repodata directory
Summary: Pulp Assumes rpms are beside repodata directory
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Pulp
Classification: Retired
Component: z_other
Version: unspecified
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
: Sprint 25
Assignee: Pradeep Kilambi
QA Contact: Preethi Thomas
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2011-06-10 20:51 UTC by Jay Greguske
Modified: 2012-02-24 20:11 UTC (History)
2 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2012-02-24 20:11:43 UTC


Attachments (Terms of Use)

Description Jay Greguske 2011-06-10 20:51:32 UTC
Description of problem:

Pulp appears to assume that packages in a yum repo exist besides the repodata directory. If you use a yum repo produced by Koji, you'll get 404s when it tries to download the RPMs.

How reproducible:
Always

Steps to Reproduce:
1. $ pulp-admin repo create --id whatever --feed 'http://download.lab.bos.redhat.com/brewroot/repos/eso-rhel-6-build/latest/x86_64' --interval P1DT --name 'my repo'
2. $ pulp-admin repo sync --id eso-6-x86_64 -F
  
Actual results:
Sync for repository eso-6-x86_64 started
Sync: Finished
0/5001 new items downloaded
5001/5001 existing items processed

Item Details: 
Rpms: 0/5001
Warning: 5001 errors occurred
5001 Rpm Error(s):
        HTTP status code of 404 received for http://download.lab.bos.redhat.com/brewroot/repos/eso-rhel-6-build/latest/x86_64/packages/redhat-release-server/6Server/6.1.0.2.el6eso/x86_64/redhat-release-server-6Server-6.1.0.2.el6eso.x86_64.rpm
        HTTP status code of 404 received for http://download.lab.bos.redhat.com/brewroot/repos/eso-rhel-6-build/latest/x86_64/packages/incron/0.5.9/2.el6eso/x86_64/incron-0.5.9-2.el6eso.x86_64.rpm
        HTTP status code of 404 received for http://download.lab.bos.redhat.com/brewroot/repos/eso-rhel-6-build/latest/x86_64/packages/inotify-tools/3.14/1.el6eso/x86_64/inotify-tools-devel-3.14-1.el6eso.x86_64.rpm
        HTTP status code of 404 received for http://download.lab.bos.redhat.com/brewroot/repos/eso-rhel-6-build/latest/x86_64/packages/publican-openshift/0.4/3.el6eso/x86_64/publican-openshift-0.4-3.el6eso.x86_64.rpm
        HTTP status code of 404 received for http://download.lab.bos.redhat.com/brewroot/repos/eso-rhel-6-build/latest/x86_64/packages/inotify-tools/3.14/1.el6eso/x86_64/inotify-tools-3.14-1.el6eso.x86_64.rpm
        ... 4996 more error(s) occured.  See server logs for all errors.


Expected results:
Sync correctly.

Additional info:
My from-the-hip-guess is that pulp expects packages to be available at a URL created by concatenating the href attribute in the Location tags with the feed URL. It should consider the "base" attribute instead of the feed URL. If you concatenate base and href, you'll get the correct URL that the repodata is referencing.

You don't get this problem if the packages are next to the repodata directory on the filesystem because base+href produce the same URL as feed+href in that case.

Comment 1 Pradeep Kilambi 2011-07-06 17:25:02 UTC
fixed!commit f79f32bb1dd87726d82f94b2c5ed9564f5f3340b

Comment 2 Pradeep Kilambi 2011-07-06 17:29:39 UTC
fix will be in grinder-0.0.105 and higher

Comment 3 Jay Dobies 2011-07-06 19:04:37 UTC
Fixed in 0.202

Comment 4 Preethi Thomas 2011-08-17 19:38:23 UTC
verified

[root@preethi ~]# rpm -q pulp
pulp-0.0.224-1.fc14.noarch
[root@preethi ~]# 


[root@preethi ~]# pulp-admin repo create --id eso-6-x86_64 --feed=http://download.lab.bos.redhat.com/brewroot/repos/eso-rhel-6-build/latest/x86_64 --content_type=yum
Successfully created repository [ eso-6-x86_64 ]

[root@preethi ~]# pulp-admin repo sync --id=eso-6-x86_64 -F
Sync for repository eso-6-x86_64 started
Sync: Finished
4976/4976 new items downloaded
0/4976 existing items processed

Item Details: 
Rpms: 4976/4976

Comment 5 Preethi Thomas 2012-02-24 20:11:43 UTC
Pulp v1.0 is released
Closed Current Release.


Note You need to log in before you can comment on or make changes to this bug.