Bug 1171509 - New RPMs successfully published to repository but not shown as available in yum.
Summary: New RPMs successfully published to repository but not shown as available in yum.
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Pulp
Classification: Retired
Component: rpm-support
Version: 2.5
Hardware: x86_64
OS: Linux
urgent
high
Target Milestone: ---
: 2.5.1
Assignee: Barnaby Court
QA Contact: Preethi Thomas
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2014-12-07 20:55 UTC by dan
Modified: 2014-12-22 18:05 UTC (History)
4 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2014-12-22 18:05:40 UTC
Embargoed:


Attachments (Terms of Use)
Log from jenkins for the rpm upload and repo publish (5.75 KB, text/plain)
2014-12-08 14:13 UTC, dan
no flags Details
repomd.xml (2.12 KB, text/plain)
2014-12-08 14:16 UTC, dan
no flags Details
directory listing for repodata (1.43 KB, text/plain)
2014-12-08 14:20 UTC, dan
no flags Details
another repomd.xml (2.38 KB, text/plain)
2014-12-08 15:26 UTC, dan
no flags Details

Description dan 2014-12-07 20:55:54 UTC
Description of problem:

Uploaded RPM's, successfully published repository, but not shown in yum.


Version-Release number of selected component (if applicable):

pulp-server-2.5.0-1.el6.noarch

How reproducible:

90% of the time.

Steps to Reproduce:
1. Create new RPM
2. Upload RPM to repo using pulp-admin commands
3. Publish the repo using pulp-admin commands
4. Run a `yum clean all` and a `yum list` on a client hooked up to the repo.

Actual results:

The package is not listed in the repo.

Expected results:

The new package is listed and is available for install.

Additional info:

The repomd.xml file gets updated after each upload and publish and the clients yum cache is updated each time, but the package is not shown around 90% of the time.

The scripts to automate this process was working fine for months on Version 2.4, it was when we upgraded to 2.5 when we hit intermittent issues, nothing else has changes.


Document URL: 

Section Number and Name: 

Describe the issue: 

Suggestions for improvement: 

Additional information: 


Description of problem:


Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:


Description: 

Packages to be added: 

Comps group:  

Default: 

Mandatory: 

Visible: 

Multi-lib: 

Need to be present for arches: 


Description of problem:


Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 1 Brian Bouterse 2014-12-08 13:58:58 UTC
Can you upload a copy of the repomd.xml and indicate if the RPM of interest is included? Also is there anything interesting in the Pulp server log? Does the RPM upload complete without error? The Pulp server logs should show that.

Comment 2 dan 2014-12-08 14:13:12 UTC
Created attachment 965863 [details]
Log from jenkins for the rpm upload and repo publish

Attached is the log from the jenkins job which runs pulp-admin commands to upload and publish.

Comment 3 dan 2014-12-08 14:16:20 UTC
Created attachment 965864 [details]
repomd.xml

Attached is the repomd.xml created after a successful rpm upload and publish, which was presented to yum clients who could not see the new package.

The pulp-admin commands however showed this package as contained within the repo.

Comment 4 dan 2014-12-08 14:20:38 UTC
Created attachment 965866 [details]
directory listing for repodata

Attached the dir listing for the repo in question. There are multiple .gz's in the directory and only one of each type (primary, updateinfo...) is referenced in the repomd.xml file.

Comment 5 dan 2014-12-08 15:26:00 UTC
Created attachment 965901 [details]
another repomd.xml

repomd.xml and referenced primary.xml

Comment 6 Barnaby Court 2014-12-08 16:01:38 UTC
It appears that the incremental republish in this case is not making it to the end of the file and is some of the previous entries.

Comment 7 Barnaby Court 2014-12-09 16:15:38 UTC
https://github.com/pulp/pulp/pull/1407

This fixes the item that caused the problem.  It does not fix the issue for a repository that is already in an inconsistent state.  The fix for that would be to remove an rpm from the repository and then add it back.  That will trigger a clean republish which will fix the problem going forward.

Comment 8 Barnaby Court 2014-12-09 16:50:55 UTC
The alternative to adding & removing the rpm from the repository is that as part of the upgrade to 2.5.1 the /var/lib/pulp/published/yum/ should be removed manually and all the repositories should be republished.

Comment 9 Preethi Thomas 2014-12-11 20:50:50 UTC
verified
[root@mgmt4 ~]# rpm -qa pulp-server
pulp-server-2.5.1-0.2.beta.el6.noarch
[root@mgmt4 ~]
2 cases tested

1. uploaded 1 rpm to the repo & published. checked to see the rpm is available to use
2. uploaded 2 second repo & republish and check for the rpm 

3. Continue to upload and republish to make sure that everything publishes correctly and the rpms are available for use.

Also tested a 2nd case with upgrade instructions from comment 7 & 8

Comment 10 Randy Barlow 2014-12-22 18:05:40 UTC
Fixed in 2.5.1-1.


Note You need to log in before you can comment on or make changes to this bug.