Bug 1222091

Summary:	rgw: broken multipart upload when resending parts
Product:	[Red Hat Storage] Red Hat Ceph Storage	Reporter:	Yehuda Sadeh <yehuda>
Component:	RGW	Assignee:	ceph-eng-bugs <ceph-eng-bugs>
Status:	CLOSED ERRATA	QA Contact:	ceph-qe-bugs <ceph-qe-bugs>
Severity:	urgent	Docs Contact:
Priority:	unspecified
Version:	1.2.3	CC:	cbodley, ceph-eng-bugs, ceph-qe-bugs, flucifre, icolle, kbader, kdreyer, mbenjamin, owasserm, sweil, tmuthami
Target Milestone:	rc
Target Release:	1.2.4
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:
Clones:	1222095 (view as bug list)		Environment:
Last Closed:	2015-09-02 14:07:51 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	1222094, 1222095

Description Yehuda Sadeh 2015-05-15 18:13:19 UTC

Description of problem:

Generated object is broken when parts are getting resent.


Version-Release number of selected component (if applicable):


How reproducible:

always


Steps to Reproduce:
1. Upload multipart object
2. Resend one of the object parts
3. Complete upload

Actual results:


Object is broken, missing 512k. There is a discrepancy about object size when listing the object vs stating the object.


Expected results:

Object should contain valid data

Additional info:

Comment 2 Yehuda Sadeh 2015-06-19 16:07:20 UTC

need qa_ack

Comment 5 Yehuda Sadeh 2015-06-22 21:39:55 UTC

*** Bug 1222093 has been marked as a duplicate of this bug. ***

Comment 6 Tamil 2015-08-13 22:11:05 UTC

verified on rhel 7.1

[ubuntu@magna050 ~]$ perl s3multipart.pl 
usr is 
0.400536962392838access key is X6W7OH0G7B655X3D9OHY 
sec key is kXIQEITs6dXo0S3Qtf61hKuE8Nu510Yb9UtPtyRN 
Bucket Created: buck_2015_07_13_18_10_00 
uploading file - part 1 
10+0 records in
10+0 records out
104857600 bytes (105 MB) copied, 0.0811372 s, 1.3 GB/s
adding file to bucket buck_2015_07_13_18_10_00: 100Mb.1
upload file successful
uploading file - part 2 
10+0 records in
10+0 records out
104857600 bytes (105 MB) copied, 0.0785016 s, 1.3 GB/s
adding file to bucket buck_2015_07_13_18_10_00: 100Mb.2
upload file successful
uploading file - part 3 
10+0 records in
10+0 records out
104857600 bytes (105 MB) copied, 0.0792508 s, 1.3 GB/s
adding file to bucket buck_2015_07_13_18_10_00: 100Mb.3
upload file successful
uploading file - part 4 
10+0 records in
10+0 records out
104857600 bytes (105 MB) copied, 0.0786884 s, 1.3 GB/s
adding file to bucket buck_2015_07_13_18_10_00: 100Mb.4
upload file successful
uploading file - part 5 
10+0 records in
10+0 records out
104857600 bytes (105 MB) copied, 0.0783179 s, 1.3 GB/s
adding file to bucket buck_2015_07_13_18_10_00: 100Mb.5
upload file successful
uploading file - part 6 
10+0 records in
10+0 records out
104857600 bytes (105 MB) copied, 0.0787078 s, 1.3 GB/s
adding file to bucket buck_2015_07_13_18_10_00: 100Mb.6
upload file successful
uploading file - part 7 
10+0 records in
10+0 records out
104857600 bytes (105 MB) copied, 0.078893 s, 1.3 GB/s
adding file to bucket buck_2015_07_13_18_10_00: 100Mb.7
upload file successful
uploading file - part 8 
10+0 records in
10+0 records out
104857600 bytes (105 MB) copied, 0.0783506 s, 1.3 GB/s
adding file to bucket buck_2015_07_13_18_10_00: 100Mb.8
upload file successful
uploading file - part 9 
10+0 records in
10+0 records out
104857600 bytes (105 MB) copied, 0.0766957 s, 1.4 GB/s
adding file to bucket buck_2015_07_13_18_10_00: 100Mb.9
upload file successful
uploading file - part 10 
10+0 records in
10+0 records out
104857600 bytes (105 MB) copied, 0.0783263 s, 1.3 GB/s
adding file to bucket buck_2015_07_13_18_10_00: 100Mb.10
upload file successful
10+0 records in
10+0 records out
104857600 bytes (105 MB) copied, 0.289292 s, 362 MB/s
adding file to bucket buck_2015_07_13_18_10_00: 100Mb.1
upload file successful
10+0 records in
10+0 records out
104857600 bytes (105 MB) copied, 0.371777 s, 282 MB/s
adding file to bucket buck_2015_07_13_18_10_00: 100Mb.4
upload file successful
10+0 records in
10+0 records out
104857600 bytes (105 MB) copied, 0.289718 s, 362 MB/s
adding file to bucket buck_2015_07_13_18_10_00: 100Mb.7
upload file successful
Downloading 100Mb.1 from bucket to /tmp/downloadfile.1 
Odd number of elements in anonymous hash at /usr/local/share/perl5/Amazon/S3/Bucket.pm line 90.
Downloading 100Mb.2 from bucket to /tmp/downloadfile.2 
Odd number of elements in anonymous hash at /usr/local/share/perl5/Amazon/S3/Bucket.pm line 90.
Downloading 100Mb.3 from bucket to /tmp/downloadfile.3 
Odd number of elements in anonymous hash at /usr/local/share/perl5/Amazon/S3/Bucket.pm line 90.
Downloading 100Mb.4 from bucket to /tmp/downloadfile.4 
Odd number of elements in anonymous hash at /usr/local/share/perl5/Amazon/S3/Bucket.pm line 90.
Downloading 100Mb.5 from bucket to /tmp/downloadfile.5 
Odd number of elements in anonymous hash at /usr/local/share/perl5/Amazon/S3/Bucket.pm line 90.
Downloading 100Mb.6 from bucket to /tmp/downloadfile.6 
Odd number of elements in anonymous hash at /usr/local/share/perl5/Amazon/S3/Bucket.pm line 90.
Downloading 100Mb.7 from bucket to /tmp/downloadfile.7 
Odd number of elements in anonymous hash at /usr/local/share/perl5/Amazon/S3/Bucket.pm line 90.
Downloading 100Mb.8 from bucket to /tmp/downloadfile.8 
Odd number of elements in anonymous hash at /usr/local/share/perl5/Amazon/S3/Bucket.pm line 90.
Downloading 100Mb.9 from bucket to /tmp/downloadfile.9 
Odd number of elements in anonymous hash at /usr/local/share/perl5/Amazon/S3/Bucket.pm line 90.
Downloading 100Mb.10 from bucket to /tmp/downloadfile.10 
Odd number of elements in anonymous hash at /usr/local/share/perl5/Amazon/S3/Bucket.pm line 90.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Test case:  PASSED - checksum verification for multipart upload passed 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Comment 7 Tamil 2015-08-13 23:07:23 UTC

verified on rhel 6.7

Comment 9 errata-xmlrpc 2015-09-02 14:07:51 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHBA-2015-1703.html