Bug 679475 - Paralel uploads fail
Summary: Paralel uploads fail
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Pulp
Classification: Retired
Component: z_other
Version: unspecified
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: ---
: Sprint 21
Assignee: Jeff Ortel
QA Contact: Preethi Thomas
URL:
Whiteboard:
Depends On:
Blocks: 563609 pulp-verified
TreeView+ depends on / blocked
 
Reported: 2011-02-22 16:31 UTC by Daniel Mach
Modified: 2011-08-16 14:00 UTC (History)
2 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2011-08-16 14:00:10 UTC
Embargoed:


Attachments (Terms of Use)

Description Daniel Mach 2011-02-22 16:31:24 UTC
Run following command twice in paralel:
$ pulp-admin package upload <big-rpm>

It will fail with:

* Starting Package Upload operation. See /var/log/pulp/client.log for more verbose output

* Performing Package Uploads to Pulp server
error: operation failed: Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/pulp/server/webservices/controllers/base.py", line 52, in report_error
    return method(self, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/pulp/server/webservices/controllers/services.py", line 144, in POST
    f.append(base64.b64decode(content))
  File "/usr/lib/python2.7/site-packages/pulp/server/api/upload.py", line 172, in append
    raise UploadAlreadyFinished(self.md)
UploadAlreadyFinished: (<rpm>) already finished, bad append()

Comment 1 Jeff Ortel 2011-02-23 17:55:35 UTC
Currently, we're trying to find a balance between making the upload of a specific file interruptable/resumable and tolerant of concurrent (parallel) upload attempts.  In 0.140, pulp is completely intolerant to concurrent uploads of the same file.  Basically, they stomp on each other as you notice here.  This was the first pass.

In 0.141, each upload of a specific file (unique by name and checksum) is considered a unique upload that is normalized when the uploaded file is imported.  Meaning, that if the file has already been uploaded, it is not imported and no error is raised.  However, if a user Ctrl^C out of pulp-admin, then decides to resume the upload on the same box, it will resume where it left off.

Daniel, I'd like to schedule a meeting with you ASAP to make sure we understand your upload requirements.

Comment 2 Jeff Ortel 2011-02-25 22:31:33 UTC
Build: 0.143

Comment 3 Preethi Thomas 2011-05-04 15:16:03 UTC
verified

[root@preethi ~]# rpm -q pulp
pulp-0.0.173-1.fc14.noarch


I tried parallel uploads and haven't encountered any error. So moving to verified

Comment 4 Preethi Thomas 2011-08-16 14:00:10 UTC
Closing with Community Release 15

pulp-0.0.223-4.


Note You need to log in before you can comment on or make changes to this bug.