Bug 1093745
Summary: | Synchronization of repos from Red Hat CDN fails | ||
---|---|---|---|
Product: | [Retired] Pulp | Reporter: | pgustafs |
Component: | rpm-support | Assignee: | Chris Duryee <cduryee> |
Status: | CLOSED CURRENTRELEASE | QA Contact: | Ina Panova <ipanova> |
Severity: | high | Docs Contact: | |
Priority: | high | ||
Version: | 2.4 Beta | CC: | bmbouter, cduryee, ipanova, mhrivnak, pthomas, rbarlow |
Target Milestone: | --- | Keywords: | Triaged |
Target Release: | 2.4.0 | ||
Hardware: | x86_64 | ||
OS: | Linux | ||
Whiteboard: | |||
Fixed In Version: | Doc Type: | Bug Fix | |
Doc Text: | Story Points: | --- | |
Clone Of: | Environment: | ||
Last Closed: | 2014-08-09 06:54:29 UTC | Type: | Bug |
Regression: | --- | Mount Type: | --- |
Documentation: | --- | CRM: | |
Verified Versions: | Category: | --- | |
oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
Cloudforms Team: | --- | Target Upstream Version: | |
Embargoed: |
Description
pgustafs
2014-05-02 14:20:48 UTC
This problem occurs when the repos I'm trying to sync from CDN contains rpms that exist in repos that i have synced from another pulp(2.3) server. for example: If i first sync an cloned repo from another pulp server I can see that the rpms in that repo has below storage_path: u'repository_memberships': [u'cloned-rhel-6-server-x86_64-rhscl'] u'_storage_path': u'/var/lib/pulp/content/rpm/mariadb55/1/7.el6/x86_64/99b3c45942fe34c45fe0df7c18732dc62b107e6a/mariadb55-1-7.el6.x86_64.rpm' If i then sync an repo from CDN that contains that rpm, the storage path for the rpm is changed to: u'repository_memberships': [u'cloned-rhel-6-server-x86_64-rhscl', u'live-rhel-6-server-x86_64-rhscl'] u'_storage_path': u'/var/lib/pulp/content/rpm/mariadb55/1/7.el6/x86_64/99b3c45942fe34c45fe0df7c18732dc62b107e6a/Packages/mariadb55-1-7.el6.x86_64.rpm (Packages) is added to the storage path for the rpm but the rpm is stored in the old storage path. So the publish fails due to it looking for the rpm in an storage path where it's not exist. I can successfully sync repos from CDN that not contains rpms that exist in another repo on the pulp server. (In reply to Chris Duryee from comment #2) > https://github.com/pulp/pulp_rpm/pull/483 thanks, I have verified it in my setup and it works. The fix for this bug is included in the pulp-2.4.0-0.14.beta builds. Created and synced 2 fedora repos that have the same feed but different relative-url. In both cases publish succeeded and the storage_path is the same. # pulp-admin -u admin -p admin rpm repo create --repo-id f20 --feed http://ftp.linux.cz/pub/linux/fedora/linux/releases/20/Fedora/x86_64/os/ Successfully created repository [f20] [root@ec2-54-74-97-52 ~]# pulp-admin -u admin -p admin rpm repo sync run --repo-id f20 +----------------------------------------------------------------------+ Synchronizing Repository [f20] +----------------------------------------------------------------------+ This command may be exited via ctrl+c without affecting the request. Downloading metadata... [-] ... completed Downloading repository content... [==================================================] 100% RPMs: 4071/4071 items Delta RPMs: 0/0 items ... completed Downloading distribution files... [==================================================] 100% Distributions: 7/7 items ... completed Importing errata... [-] ... completed Importing package groups/categories... [|] ... completed Task Succeeded Initializing repo metadata [-] ... completed Publishing Distribution files [-] ... completed Publishing RPMs [==================================================] 100% 4071 of 4071 items ... completed Publishing Delta RPMs [-] ... completed Publishing Errata [-] ... completed Publishing Comps file [==================================================] 100% 124 of 124 items ... completed Publishing Metadata. [-] ... completed Closing repo metadata [-] ... completed Publishing files to web [\] ... completed Writing Listings File [-] ... completed Task Succeeded [root@ec2-54-74-97-52 ~]# ll /var/lib/pulp/content/rpm/zsh/5.0.2/6.fc20/x86_64/b4c4de02d821b7dd39ea31f81a25045995f02d26423a3c54e79fda4e66c35c54/zsh-5.0.2-6.fc20.x86_64.rpm -rw-r--r--. 1 apache apache 2471656 Jun 6 12:07 /var/lib/pulp/content/rpm/zsh/5.0.2/6.fc20/x86_64/b4c4de02d821b7dd39ea31f81a25045995f02d26423a3c54e79fda4e66c35c54/zsh-5.0.2-6.fc20.x86_64.rpm [root@ec2-54-74-97-52 ~]# pulp-admin -u admin -p admin rpm repo create --repo-id f20.1 --feed http://ftp.linux.cz/pub/linux/fedora/linux/releases/20/Fedora/x86_64/os/ --relative-url myf20 Successfully created repository [f20.1] [root@ec2-54-74-97-52 ~]# pulp-admin -u admin -p admin rpm repo sync run --repo-id f20.1 +----------------------------------------------------------------------+ Synchronizing Repository [f20.1] +----------------------------------------------------------------------+ This command may be exited via ctrl+c without affecting the request. Downloading metadata... [/] ... completed Downloading repository content... [==================================================] 100% RPMs: 0/0 items Delta RPMs: 0/0 items ... completed Downloading distribution files... [==================================================] 100% Distributions: 7/7 items ... completed Importing errata... [-] ... completed Importing package groups/categories... [|] ... completed Task Succeeded Initializing repo metadata [-] ... completed Publishing Distribution files [-] ... completed Publishing RPMs [==================================================] 100% 4071 of 4071 items ... completed Publishing Delta RPMs [-] ... completed Publishing Errata [-] ... completed Publishing Comps file [==================================================] 100% 124 of 124 items ... completed Publishing Metadata. [-] ... completed Closing repo metadata [-] ... completed Publishing files to web [\] ... completed Writing Listings File [-] ... completed Task Succeeded [root@ec2-54-74-97-52 ~]# ll /var/lib/pulp/content/rpm/zsh/5.0.2/6.fc20/x86_64/b4c4de02d821b7dd39ea31f81a25045995f02d26423a3c54e79fda4e66c35c54/zsh-5.0.2-6.fc20.x86_64.rpm -rw-r--r--. 1 apache apache 2471656 Jun 6 12:07 /var/lib/pulp/content/rpm/zsh/5.0.2/6.fc20/x86_64/b4c4de02d821b7dd39ea31f81a25045995f02d26423a3c54e79fda4e66c35c54/zsh-5.0.2-6.fc20.x86_64.rpm Tested in 2.4.0-0.19.beta Moving to Verified. Moving this back to on-qa since the bug is specifically talking about CDN syncs. And the verification seems to have been done with f20 feed Preethi, I've talked to Chris before verifying the bug and he confirmed that it does not matter whether sync is from CDN or not, anything with Packages directory would fit. But thank you for your input - really appreciated :) This has been fixed in Pulp 2.4.0-1. *** Bug 1025903 has been marked as a duplicate of this bug. *** |