Bug 670978 - package install error off origin cloned repo
Summary: package install error off origin cloned repo
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Pulp
Classification: Retired
Component: z_other
Version: unspecified
Hardware: Unspecified
OS: Unspecified
low
medium
Target Milestone: ---
: Sprint 20
Assignee: Sayli Karmarkar
QA Contact: Preethi Thomas
URL:
Whiteboard:
Depends On:
Blocks: verified-to-close
TreeView+ depends on / blocked
 
Reported: 2011-01-19 20:14 UTC by dgao
Modified: 2015-03-23 01:10 UTC (History)
2 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2011-08-16 12:10:52 UTC
Embargoed:


Attachments (Terms of Use)

Description dgao 2011-01-19 20:14:19 UTC
Looks like the metadata of the cloned repo is correct. But the actual package did not make it to /var/lib/pulp/repo


[root@pulp-nightly ~]# pulp-admin package install --consumerid=test_consumer -n patb
Created task id: a1ee8b35-2407-11e0-a0cd-5452004fdd6d
Task is scheduled for: 2011-01-19 15:06
.
Package install failed

[root@pulp-nightly ~]# yum repolist
origin_clone_repo                origin_clone_repo                    5


[root@pulp-nightly ~]# pulp-admin repo content --id=origin_clone_repo
+------------------------------------------+
        Contents of origin_clone_repo
+------------------------------------------+

Packages in origin_clone_repo: 

feedless-1.0-1.noarch.rpm
emoticons-0.1-2.x86_64.rpm
patb-0.1-2.x86_64.rpm
origin-1.0-1.noarch.rpm
parent-1.0-1.noarch.rpm

Errata in origin_clone_repo: 

RHEA-2010:9999

Files in origin_clone_repo: 

 none


[root@pulp-nightly ~]# cat /etc/yum.repos.d/pulp.repo 
#
# Pulp Repositories
# Managed by Pulp client
#

[origin_clone_repo]
name = origin_clone_repo
baseurl = https://pulp-nightly.usersys.redhat.com/pulp/repos/origin_clone_repo
enabled = 1



[root@pulp-nightly ~]# ls /var/lib/pulp/repos/origin_clone_repo/
cachecookie  filelists.xml.gz.gz  other.xml.gz  packages  primary.xml.gz  primary.xml.gz.sqlite  repodata  repomd.xml  repomd.xml.gz  updateinfo.xml  updateinfo.xml.gz





2011-01-19 15:06:42,177 [INFO][asynctaskreplyqueue] run() @ consumer.py:65 - ready
2011-01-19 15:06:42,711 [INFO][asynctaskreplyqueue] received() @ consumer.py:159 - {asynctaskreplyqueue} received:
{
  "origin": "e5711b53-a54c-4c0c-b97c-644826d71ed7", 
  "version": "0.2", 
  "result": {
    "exval": "Traceback (most recent call last):\n\n  File \"/usr/lib/python2.6/site-packages/gofer/messaging/dispatcher.py\", line 252, in __call__\n    retval = method(*args, **keywords)\n\n  File \"/usr/lib/gofer/plugins/pulp.py\", line 157, in install\n    yb.processTransaction()\n\n  File \"/usr/lib/python2.6/site-packages/yum/__init__.py\", line 4494, in processTransaction\n    pkgs = self._downloadPackages(callback)\n\n  File \"/usr/lib/python2.6/site-packages/yum/__init__.py\", line 4529, in _downloadPackages\n    raise Errors.YumDownloadError, errstr\n\nYumDownloadError: [u'Errors were encountered while downloading packages.', 'patb-0.1-2.x86_64: failure: patb-0.1-2.x86_64.rpm from origin_clone_repo: [Errno 256] No more mirrors to try.']\n", 
    "xargs": [], 
    "xstate": {
      "value": [
        "Errors were encountered while downloading packages.", 
        "patb-0.1-2.x86_64: failure: patb-0.1-2.x86_64.rpm from origin_clone_repo: [Errno 256] No more mirrors to try."
      ]
    }, 
    "xclass": "YumDownloadError", 
    "xmodule": "yum.Errors"
  }, 
  "any": "a1ee8b35-2407-11e0-a0cd-5452004fdd6d", 
  "sn": "42a6e846-6258-4602-8b2e-5d5729ada3dd"
}
2011-01-19 15:06:42,712 [INFO][asynctaskreplyqueue] failed() @ async.py:254 - Task RMI (failed)
Failed
  sn : 42a6e846-6258-4602-8b2e-5d5729ada3dd
  origin : e5711b53-a54c-4c0c-b97c-644826d71ed7
  user data : a1ee8b35-2407-11e0-a0cd-5452004fdd6d
  exception:
['Errors were encountered while downloading packages.', 'patb-0.1-2.x86_64: failure: patb-0.1-2.x86_64.rpm from origin_clone_repo: [Errno 256] No more mirrors to try.']
2011-01-19 15:06:42,712 [ERROR][asynctaskreplyqueue] failed() @ task.py:207 - Task id:a1ee8b35-2407-11e0-a0cd-5452004fdd6d, method_name:install:
(YumDownloadError(),)

Comment 1 Sayli Karmarkar 2011-01-21 07:50:00 UTC
I was able to see this bug on pulp-nightly, but wasn't able to reproduce it again. When I checked your origin_clone_repo, it did not have any packages. I was trying to figure out how it reached that stage. Can you add the sequence of commands you tried? 

This is what I did:

1. Cloned test_repo to origin_clone_repo:

[root@pulp-nightly repos]# pulp-admin repo clone --clone_id=origin_clone_repo --id=test-repo clone_type=origin -F
Repository [test-repo] is being cloned as [origin_clone_repo]
You can safely CTRL+C this current command and it will continue
[=========================] 100% Total: 5/5 items )
Clone: Finished

[root@pulp-nightly repos]# ls origin_clone_repo/
emoticons-0.1-2.x86_64.rpm  feedless-1.0-1.noarch.rpm  origin-1.0-1.noarch.rpm  parent-1.0-1.noarch.rpm  patb-0.1-2.x86_64.rpm  repodata  updateinfo.xml


2. Bind consumer to origin_clone_repo

[root@pulp-nightly repos]# pulp-admin consumer bind --id=test_consumer --repoid=origin_clone_repo
Successfully subscribed consumer [test_consumer] to repo [origin_clone_repo]


3. Disable other repos:

[root@pulp-nightly repos]# cat /etc/yum.repos.d/pulp.repo 
#
# Pulp Repositories
# Managed by Pulp client
#

[f13test]
name = f13test
baseurl = https://pulp-nightly.usersys.redhat.com/pulp/repos/repos/pulp/pulp/fedora-13/x86_64
enabled = 0
sslverify = 0

[origin_clone_repo]
name = origin_clone_repo
baseurl = https://pulp-nightly.usersys.redhat.com/pulp/repos/origin_clone_repo
enabled = 1


4. Package install:

[root@pulp-nightly repos]# pulp-admin package install --consumerid=test_consumer -n patb
Created task id: 85813e82-2531-11e0-9f89-5452004fdd6d
Task is scheduled for: 2011-01-21 02:39
.
[[[u'patb-0.1-2.x86_64'], None]] installed on test_consumer

Comment 2 dgao 2011-01-21 15:14:45 UTC
Yea this bug in particular is difficult to reproduce by hand, but somehow can be reproduced consistently w/ the automation framework.

So the steps automation took:

- Create regular repo w/ feed and sync the repo.
- Create parent clone and origin clone of the above repo. 
- Bind consumer to the clones.
- Sync the clones and check for reported pkg counts.
- Unbind origin clone and install test pkg from parent clone. (Success)
- Uninstall test pkg, unbind parent clone and rebind origin clone.
- Install test pkg from origin clone. (Failure)

Comment 3 Sayli Karmarkar 2011-02-04 05:21:34 UTC
$ git commit -a -m "670978 - Fixed repo clone error because of incompatibility between consecutive local sync and yum sync on a repo"
[master 31c6683] 670978 - Fixed repo clone error because of incompatibility between consecutive local sync and yum sync on a repo
 1 files changed, 11 insertions(+), 3 deletions(-)

Comment 4 Jay Dobies 2011-02-04 19:24:05 UTC
Fixed in 0.135.

Comment 5 dgao 2011-02-04 21:50:41 UTC
201102041047:33.392 - FINE: ssh root.redhat.com pulp-admin package install -n origin --consumerid=test_consumer (com.redhat.qe.tools.SSHCommandRunner.run)
201102041047:35.893 - FINE: Stdout: 
Created task id: 145b4005-3076-11e0-9cd3-5452004fdd6d
Task is scheduled for: 2011-02-04 10:47
.
[[[u'origin-1.0-1.noarch'], None]] installed on test_consumer

Comment 6 Preethi Thomas 2011-08-16 12:10:52 UTC
Closing with Community Release 15

pulp-0.0.223-4.

Comment 7 Preethi Thomas 2011-08-16 12:22:38 UTC
Closing with Community Release 15

pulp-0.0.223-4.


Note You need to log in before you can comment on or make changes to this bug.