Bug 753805 - os.symlink "File Exist" error during concurrent syncs
Summary: os.symlink "File Exist" error during concurrent syncs
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Pulp
Classification: Retired
Component: user-experience
Version: unspecified
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
: ---
Assignee: Pradeep Kilambi
QA Contact: dgao
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2011-11-14 14:46 UTC by dgao
Modified: 2013-09-09 16:37 UTC (History)
1 user (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed:


Attachments (Terms of Use)

Description dgao 2011-11-14 14:46:42 UTC
Setup: 
- pulp-server w/ 15 threads per repo, 16 max_concurrent repo syncs.
- 16 concurrent syncs triggered from automation
- 8 unique repo url (so in this case, every url got 2 repos syncing)
- tests is run against 16cpus 23g ram machine

Sync failed after 28hrs of execution

   [testng] 6543/12209 new items downloaded
   [testng] 5666/12209 existing items processed
   [testng] 
   [testng] Item Details: 
   [testng] RPMs: 12206/12209
   [testng] Warning: 3 errors occurred
   [testng] 3 Rpm Error(s):
   [testng] 	{u'error_type': u"<type 'exceptions.Exception'>", u'error': u'Traceback (most recent call last):\n\n  File "/usr/lib/python2.6/site-packages/grinder/activeobject.py", line 424, in process\n    retval = method(*args, **kwargs)\n\n  File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 52, in fetchItem\n    verify_options=self.verify_options)\n\n  File "/usr/lib/python2.6/site-packages/grinder/BaseFetch.py", line 171, in fetch\n    os.symlink(relFilePath, repofilepath)\n\nOSError: [Errno 17] File exists\n', u'traceback': [u'Traceback (most recent call last):', u'  File "/usr/lib/python2.6/site-packages/grinder/ParallelFetch.py", line 295, in run', u'    result = self.fetcher.fetchItem(itemInfo)', u'  File "/usr/lib/python2.6/site-packages/grinder/activeobject.py", line 82, in __call__', u'    return self.object(self, *args, **kwargs)', u'  File "/usr/lib/python2.6/site-packages/grinder/activeobject.py", line 262, in __call__', u'    return self.__call(method, args, kwargs)', u'  File "/usr/lib/python2.6/site-packages/grinder/activeobject.py", line 238, in __call', u'    return self.__rmi(method.name, args, kwargs)', u'  File "/usr/lib/python2.6/site-packages/grinder/activeobject.py", line 136, in __rmi', u'    raise Exception(ex)', u'Exception: Traceback (most recent call last):', u'', u'  File "/usr/lib/python2.6/site-packages/grinder/activeobject.py", line 424, in process', u'    retval = method(*args, **kwargs)', u'', u'  File "/usr/lib/python2.6/site-packages/grinder/RepoFetch.py", line 52, in fetchItem', u'    verify_options=self.verify_options)', u'', u'  File "/usr/lib/python2.6/site-packages/grinder/BaseFetch.py", line 171, in fetch', u'    os.symlink(relFilePath, repofilepath)', u'', u'OSError: [Errno 17] File exists', u'']}




2011-11-11 18:33:26,638 15844:140065445005056: grinder.ProgressTracker:ERROR: ProgressTracker:207 Negative delta_bytes <-3400216.0>. download_total=<12208845.0>, downloaded=<7980085.0>, prev_remaining_bytes=<828544.0>, remaining_bytes=<4228760.0>, total_size_bytes=<12208845.0>, https://cdn.redhat.com/content/dist/rhel/rhui/server/5Server/x86_64/os/Packages/xulrunner-1.9.2.22-1.el5_7.i386.rpm
2011-11-11 18:33:26,642 15844:140065382065920: grinder.ProgressTracker:ERROR: ProgressTracker:207 Negative delta_bytes <-5265192.0>. download_total=<11610799.0>, downloaded=<2196335.0>, prev_remaining_bytes=<4149272.0>, remaining_bytes=<9414464.0>, total_size_bytes=<11610799.0>, https://cdn.redhat.com/content/dist/rhel/rhui/server/5Server/x86_64/os/Packages/xulrunner-1.9.2.23-1.el5_7.x86_64.rpm

Comment 2 Jeff Ortel 2011-11-17 03:06:38 UTC
build: 0.249

Comment 3 dgao 2011-12-02 14:33:11 UTC
Same automation test ran against the new build, no error was found. Verified.

Comment 4 Preethi Thomas 2012-02-24 20:18:02 UTC
Pulp v1.0 is released
Closed Current Release.

Comment 5 Preethi Thomas 2012-02-24 20:18:45 UTC
Pulp v1.0 is released.


Note You need to log in before you can comment on or make changes to this bug.