Bug 976858
| Summary: | possible race condition in syncs with shared content | ||||||
|---|---|---|---|---|---|---|---|
| Product: | [Retired] Pulp | Reporter: | Justin Sherrill <jsherril> | ||||
| Component: | rpm-support | Assignee: | Sayli Karmarkar <skarmark> | ||||
| Status: | CLOSED CURRENTRELEASE | QA Contact: | Preethi Thomas <pthomas> | ||||
| Severity: | medium | Docs Contact: | |||||
| Priority: | low | ||||||
| Version: | 2.1.1 | CC: | cperry, jconnor, jsherril, mhrivnak, omaciel, rbarlow, skarmark | ||||
| Target Milestone: | --- | Keywords: | Triaged | ||||
| Target Release: | 2.3.0 | ||||||
| Hardware: | Unspecified | ||||||
| OS: | Unspecified | ||||||
| Whiteboard: | |||||||
| Fixed In Version: | Doc Type: | Bug Fix | |||||
| Doc Text: | Story Points: | --- | |||||
| Clone Of: | |||||||
| : | 1017353 (view as bug list) | Environment: | |||||
| Last Closed: | 2013-12-09 14:31:05 UTC | Type: | Bug | ||||
| Regression: | --- | Mount Type: | --- | ||||
| Documentation: | --- | CRM: | |||||
| Verified Versions: | Category: | --- | |||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||
| Embargoed: | |||||||
| Bug Depends On: | |||||||
| Bug Blocks: | 950743, 1017353 | ||||||
| Attachments: |
|
||||||
Can you reproduce this on a clean install or at least a different system? I'm wondering if something so seemingly-unlikely could be the result of an anomaly on that system. Adding omaciel to the cc list, maybe he can try reproduce. I'm guessing its not easily reproducible. Created attachment 766709 [details]
traceback
Reproduced it today while syncing RHEL 5 and RHEL 6 RPMs for both i386 and x86_64 This is likely already fixed in the 2.2.0 beta release. Will re-visit this once 2.2.0 stable is released. Marking as low priority, as there is a high likelyhood that this issue is resolved by the new importer. Created 3 repos with the same feed and different relative-urls and synced them at the same time with more than 3000 packages. All syncs completed without errors or race condition. Seems like this is fixed in the new importer. Moving to on_qa. moving to verified
[root@ibm-x3655-04 ~]# rpm -qa pulp-server
pulp-server-2.3.0-0.14.alpha.el6.noarch
[root@ibm-x3655-04 ~]#
I created & synced 4 repos all rhel 6-2, 6-3, 6-4 and 6-3 i386 at the same time and all of the syncs finished without error
[root@ibm-x3655-04 ~]# pulp-admin repo list
+----------------------------------------------------------------------+
Repositories
+----------------------------------------------------------------------+
Id: foo
Display Name: foo
Description: None
Content Unit Counts:
Id: rhel6-2
Display Name: rhel6-2
Description: None
Content Unit Counts:
Distribution: 1
Erratum: 1048
Package Category: 10
Package Group: 202
Rpm: 7281
Yum Repo Metadata File: 1
Id: rhel6-386
Display Name: rhel6-386
Description: None
Content Unit Counts:
Distribution: 1
Erratum: 1415
Package Category: 10
Package Group: 202
Rpm: 6834
Yum Repo Metadata File: 1
Id: rhel6-3
Display Name: rhel6-3
Description: None
Content Unit Counts:
Distribution: 1
Erratum: 1476
Package Category: 10
Package Group: 202
Rpm: 8921
Yum Repo Metadata File: 1
Id: rhel6-4
Display Name: rhel6-4
Description: None
Content Unit Counts:
Distribution: 1
Erratum: 1935
Package Category: 10
Package Group: 202
Rpm: 10923
Yum Repo Metadata File: 1
[root@ibm-x3655-04 ~]#
Pulp 2.3 released. |
Description of problem: There seems to be a race condition when syncing multiple repos that all share content. This probably isn't reproducible a lot, but omachiel saw it. Version-Release number of selected component (if applicable): 2.1.2 How reproducible: Rarely Steps to Reproduce: 1. Create multiple repos that all point to the same upstream repo 2. Sync them all at once Do this enough times with new repos and one may fail Additional info: Traceback observed: 2013-06-21 08:55:40,881 pulp.plugins.conduits.mixins:ERROR: Exception from server requesting unit filename for relative path [.//netpbm-devel/10.35.58/10.el5/i386/d19e7c48d06b706bc8413779f5393833755a82c4/netpbm-devel-10.35.58-10.el5.i386.rpm] Traceback (most recent call last): File "/usr/lib/python2.6/site-packages/pulp/plugins/conduits/mixins.py", line 432, in init_unit path = content_query_manager.request_content_unit_file_path(type_id, relative_path) File "/usr/lib/python2.6/site-packages/pulp/server/managers/content/query.py", line 283, in request_content_unit_file_path os.makedirs(unit_dir) File "/usr/lib64/python2.6/os.py", line 157, in makedirs mkdir(name, mode) OSError: [Errno 17] File exists: '/var/lib/pulp/content/rpm/.//netpbm-devel/10.35.58/10.el5/i386/d19e7c48d06b706bc8413779f5393833755a82c4'