1253766 – [ 0.94.1-17.el7cp] AssertionError: 403 != 200 s3tests.functional.test_s3.test_object_copy_canned_acl

Bug 1253766 - [ 0.94.1-17.el7cp] AssertionError: 403 != 200 s3tests.functional.test_s3.test_object_copy_canned_acl

Summary: [ 0.94.1-17.el7cp] AssertionError: 403 != 200 s3tests.functional.test_s3.test...

Keywords:
Status:	CLOSED ERRATA
Alias:	None
Product:	Red Hat Ceph Storage
Classification:	Red Hat Storage
Component:	RGW
Sub Component:
Version:	1.3.0
Hardware:	Unspecified
OS:	Unspecified
Priority:	unspecified
Severity:	medium
Target Milestone:	rc
Target Release:	1.3.1
Assignee:	Yehuda Sadeh
QA Contact:	ceph-qe-bugs
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2015-08-14 16:03 UTC by Vasu Kulkarni
Modified:	2022-07-09 07:35 UTC (History)
CC List:	9 users (show)
Fixed In Version:	ceph-0.94.3-1.el7cp (RHEL) ceph v0.94.3.1 (Ubuntu)
Doc Type:	Bug Fix
Doc Text:	Prior to this update, RGW would not set the correct ACLs on a new object created during a COPY operation. RGW has been updated to assign ACLs correctly during COPY operations.
Clone Of:
Environment:
Last Closed:	2015-11-23 20:21:58 UTC
Embargoed:
Dependent Products:

Attachments	(Terms of Use)

Links
System	ID	Priority	Status	Summary	Last Updated
Ceph Project Bug Tracker	12370	None	None	None	Never
Red Hat Issue Tracker	RHCEPH-3505	None	None	None	2022-02-21 18:38:45 UTC
Red Hat Product Errata	RHSA-2015:2066	normal	SHIPPED_LIVE	Moderate: Red Hat Ceph Storage 1.3.1 security, bug fix, and enhancement update	2015-11-24 02:34:55 UTC
Red Hat Product Errata	RHSA-2015:2512	normal	SHIPPED_LIVE	Moderate: Red Hat Ceph Storage 1.3.1 security, bug fix, and enhancement update	2016-02-03 03:15:52 UTC

Description Vasu Kulkarni 2015-08-14 16:03:29 UTC

Description of problem:

S3 test failed during test_object_copy_canned_acl
2015-08-13T23:10:56.210 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_escape ... ok
2015-08-13T23:10:56.211 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect ... ok
2015-08-13T23:10:56.212 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok
2015-08-13T23:10:56.213 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive ... ok
2015-08-13T23:10:56.214 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok
2015-08-13T23:10:56.214 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok
2015-08-13T23:10:56.215 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok
2015-08-13T23:10:56.220 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_choices ... ok
2015-08-13T23:10:56.221 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_null_choices ... ok
2015-08-13T23:10:56.222 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok
2015-08-13T23:10:56.223 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_null_child ... ok
2015-08-13T23:10:56.234 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_set ... ok
2015-08-13T23:10:56.235 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_header_presence ... ok
2015-08-13T23:10:56.236 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_duplicate_header ... ok
2015-08-13T23:10:56.237 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_headers ... ok
2015-08-13T23:10:56.481 INFO:teuthology.orchestra.run.magna079.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok
2015-08-13T23:10:56.724 INFO:teuthology.orchestra.run.magna079.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok
2015-08-13T23:10:56.754 INFO:teuthology.orchestra.run.magna079.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok
2015-08-13T23:10:56.957 INFO:teuthology.orchestra.run.magna079.stderr:test_realistic.TestFiles.test_random_file_valid ... ok
2015-08-13T23:10:56.966 INFO:teuthology.orchestra.run.magna079.stderr:
2015-08-13T23:10:57.004 INFO:teuthology.orchestra.run.magna079.stderr:======================================================================
2015-08-13T23:10:57.005 INFO:teuthology.orchestra.run.magna079.stderr:FAIL: s3tests.functional.test_s3.test_object_copy_canned_acl
2015-08-13T23:10:57.045 INFO:teuthology.orchestra.run.magna079.stderr:----------------------------------------------------------------------
2015-08-13T23:10:57.045 INFO:teuthology.orchestra.run.magna079.stderr:Traceback (most recent call last):
2015-08-13T23:10:57.046 INFO:teuthology.orchestra.run.magna079.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
2015-08-13T23:10:57.048 INFO:teuthology.orchestra.run.magna079.stderr:    self.test(*self.arg)
2015-08-13T23:10:57.049 INFO:teuthology.orchestra.run.magna079.stderr:  File "/home/ubuntu/cephtest/s3-tests/s3tests/functional/test_s3.py", line 4350, in test_object_copy_canned_acl
2015-08-13T23:10:57.050 INFO:teuthology.orchestra.run.magna079.stderr:    eq(res.status, 200)
2015-08-13T23:10:57.051 INFO:teuthology.orchestra.run.magna079.stderr:AssertionError: 403 != 200
2015-08-13T23:10:57.052 INFO:teuthology.orchestra.run.magna079.stderr:-------------------- >> begin captured stdout << ---------------------
2015-08-13T23:10:57.053 INFO:teuthology.orchestra.run.magna079.stderr:403 Forbidden
2015-08-13T23:10:57.054 INFO:teuthology.orchestra.run.magna079.stderr:
2015-08-13T23:10:57.055 INFO:teuthology.orchestra.run.magna079.stderr:--------------------- >> end captured stdout << ----------------------
2015-08-13T23:10:57.056 INFO:teuthology.orchestra.run.magna079.stderr:-------------------- >> begin captured logging << --------------------
2015-08-13T23:10:57.057 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: path=/test-client.0-cy8wgynfrq6wpx1-223/
2015-08-13T23:10:57.058 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: auth_path=/test-client.0-cy8wgynfrq6wpx1-223/
2015-08-13T23:10:57.059 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Method: PUT
2015-08-13T23:10:57.060 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Path: /test-client.0-cy8wgynfrq6wpx1-223/
2015-08-13T23:10:57.060 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Data:
2015-08-13T23:10:57.061 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Headers: {}
2015-08-13T23:10:57.062 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Host: magna079.ceph.redhat.com:7280
2015-08-13T23:10:57.063 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Port: 7280
2015-08-13T23:10:57.064 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Params: {}
2015-08-13T23:10:57.064 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Token: None
2015-08-13T23:10:57.065 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: StringToSign:
2015-08-13T23:10:57.066 INFO:teuthology.orchestra.run.magna079.stderr:PUT
2015-08-13T23:10:57.066 INFO:teuthology.orchestra.run.magna079.stderr:
2015-08-13T23:10:57.067 INFO:teuthology.orchestra.run.magna079.stderr:
2015-08-13T23:10:57.068 INFO:teuthology.orchestra.run.magna079.stderr:Fri, 14 Aug 2015 03:08:13 GMT
2015-08-13T23:10:57.069 INFO:teuthology.orchestra.run.magna079.stderr:/test-client.0-cy8wgynfrq6wpx1-223/
2015-08-13T23:10:57.069 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Signature:
2015-08-13T23:10:57.070 INFO:teuthology.orchestra.run.magna079.stderr:AWS XMKTVHJDVXZIPLXPABXL:/mpLrQ00tCiHLZja43e+mvem2iU=


Version-Release number of selected component (if applicable):

ceph-radosgw   x86_64   1:0.94.1-17.el7cp

How reproducible:
1/1 Run


Steps to Reproduce:
RGW S3 test

Actual results:


Expected results:


All tests should pass


Additional info:
015-08-13T23:08:06.247 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_list_buckets_invalid_auth ... ok
2015-08-13T23:08:06.286 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_list_buckets_bad_auth ... ok
2015-08-13T23:08:06.622 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_bucket_create_naming_good_starts_alpha ... ok
2015-08-13T23:08:07.080 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_bucket_create_naming_good_starts_digit ... ok
2015-08-13T23:08:07.255 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_bucket_create_naming_good_contains_period ... ok
2015-08-13T23:08:07.408 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_bucket_create_naming_good_contains_hyphen ... ok
2015-08-13T23:08:08.302 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_bucket_recreate_not_overriding ... ok
2015-08-13T23:08:09.235 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_bucket_create_special_key_names ... ok
2015-08-13T23:08:10.171 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_bucket_list_special_prefix ... ok
2015-08-13T23:08:10.675 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_object_copy_zero_size ... ok
2015-08-13T23:08:11.157 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_object_copy_same_bucket ... ok
2015-08-13T23:08:11.580 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_object_copy_to_itself ... ok
2015-08-13T23:08:12.044 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_object_copy_to_itself_with_metadata ... ok
2015-08-13T23:08:12.803 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_object_copy_diff_bucket ... ok
2015-08-13T23:08:13.617 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_object_copy_not_owned_bucket ... ok
2015-08-13T23:08:13.975 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_object_copy_canned_acl ... FAIL
2015-08-13T23:08:19.276 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_multipart_upload ... ok
2015-08-13T23:08:25.988 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_multipart_upload_multiple_sizes ... ok
2015-08-13T23:08:27.836 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_multipart_upload_size_too_small ... ok
2015-08-13T23:08:30.587 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_multipart_upload_contents ... ok
2015-08-13T23:08:32.278 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_multipart_upload_overwrite_existing_object ... ok
2015-08-13T23:08:33.593 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_abort_multipart_upload ... ok
2015-08-13T23:08:36.356 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_list_multipart_upload ... ok
2015-08-13T23:08:36.574 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_100_continue ... ok
2015-08-13T23:08:37.172 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_bucket_acls_changes_persistent ... ok
2015-08-13T23:08:41.585 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_stress_bucket_acls_changes ... ok
2015-08-13T23:08:41.975 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_set_cors ... ok
2015-08-13T23:08:45.370 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_cors_origin_response ... ok
2015-08-13T23:08:45.982 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_atomic_read_1mb ... ok
2015-08-13T23:08:46.718 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_atomic_read_4mb ... ok
2015-08-13T23:08:47.682 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_atomic_read_8mb ... ok
2015-08-13T23:08:48.221 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_atomic_write_1mb ... ok
2015-08-13T23:08:48.990 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_atomic_write_4mb ... ok
2015-08-13T23:08:50.624 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_atomic_write_8mb ... ok
2015-08-13T23:08:51.305 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_atomic_dual_write_1mb ... ok
2015-08-13T23:08:52.186 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_atomic_dual_write_4mb ... ok
2015-08-13T23:08:53.247 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_atomic_dual_write_8mb ... ok
2015-08-13T23:08:53.809 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_atomic_conditional_write_1mb ... ok
2015-08-13T23:08:54.765 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_atomic_dual_conditional_write_1mb ... ok
2015-08-13T23:08:55.648 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_atomic_write_bucket_gone ... ok
2015-08-13T23:08:55.989 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_ranged_request_response_code ... ok
2015-08-13T23:08:55.994 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.check_can_test_multiregion ... SKIP
2015-08-13T23:08:55.995 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_region_bucket_create_secondary_access_remove_master ... SKIP
2015-08-13T23:08:55.996 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_region_bucket_create_master_access_remove_secondary ... SKIP
2015-08-13T23:08:56.036 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_region_copy_object ... SKIP
2015-08-13T23:08:56.598 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_versioning_bucket_create_suspend ... ok
2015-08-13T23:09:21.592 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_versioning_obj_create_read_remove ... ok
2015-08-13T23:09:25.681 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_versioning_obj_create_read_remove_head ... ok
2015-08-13T23:09:40.501 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_versioning_obj_suspend_versions ... ok
2015-08-13T23:09:43.880 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_versioning_obj_suspend_versions_simple ... ok
2015-08-13T23:09:56.584 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_versioning_obj_create_versions_remove_all ... ok
2015-08-13T23:10:10.127 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_versioning_obj_create_overwrite_multipart ... ok
2015-08-13T23:10:14.754 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_versioning_obj_list_marker ... ok
2015-08-13T23:10:18.176 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_versioning_copy_obj_version ... ok
2015-08-13T23:10:19.781 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_versioning_multi_object_delete ... ok
2015-08-13T23:10:21.525 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_versioning_multi_object_delete_with_marker ... ok
2015-08-13T23:10:22.106 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_versioning_multi_object_delete_with_marker_create ... ok
2015-08-13T23:10:23.513 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_versioned_object_acl ... ok
2015-08-13T23:10:38.855 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_versioned_concurrent_object_create_concurrent_remove ... ok
2015-08-13T23:10:51.155 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_versioned_concurrent_object_create_and_remove ... ok
2015-08-13T23:10:53.841 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.functional.test_s3.test_non_versioned_concurrent_object_create_concurrent_remove ... ok
2015-08-13T23:10:54.589 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_load_graph ... ok
2015-08-13T23:10:54.910 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok
2015-08-13T23:10:54.950 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_node ... ok
2015-08-13T23:10:54.951 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_bad_node ... ok
2015-08-13T23:10:54.952 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok
2015-08-13T23:10:54.953 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable ... ok
2015-08-13T23:10:55.234 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok
2015-08-13T23:10:55.509 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary ... ok
2015-08-13T23:10:56.115 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok
2015-08-13T23:10:56.164 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok
2015-08-13T23:10:56.207 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok
2015-08-13T23:10:56.208 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok
2015-08-13T23:10:56.209 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok
2015-08-13T23:10:56.210 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_assemble_decision ... ok
2015-08-13T23:10:56.210 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_escape ... ok
2015-08-13T23:10:56.211 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect ... ok
2015-08-13T23:10:56.212 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok
2015-08-13T23:10:56.213 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive ... ok
2015-08-13T23:10:56.214 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok
2015-08-13T23:10:56.214 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok
2015-08-13T23:10:56.215 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok
2015-08-13T23:10:56.220 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_choices ... ok
2015-08-13T23:10:56.221 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_null_choices ... ok
2015-08-13T23:10:56.222 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok
2015-08-13T23:10:56.223 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_null_child ... ok
2015-08-13T23:10:56.234 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_set ... ok
2015-08-13T23:10:56.235 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_header_presence ... ok
2015-08-13T23:10:56.236 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_duplicate_header ... ok
2015-08-13T23:10:56.237 INFO:teuthology.orchestra.run.magna079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_headers ... ok
2015-08-13T23:10:56.481 INFO:teuthology.orchestra.run.magna079.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok
2015-08-13T23:10:56.724 INFO:teuthology.orchestra.run.magna079.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok
2015-08-13T23:10:56.754 INFO:teuthology.orchestra.run.magna079.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok
2015-08-13T23:10:56.957 INFO:teuthology.orchestra.run.magna079.stderr:test_realistic.TestFiles.test_random_file_valid ... ok
2015-08-13T23:10:56.966 INFO:teuthology.orchestra.run.magna079.stderr:
2015-08-13T23:10:57.004 INFO:teuthology.orchestra.run.magna079.stderr:======================================================================
2015-08-13T23:10:57.005 INFO:teuthology.orchestra.run.magna079.stderr:FAIL: s3tests.functional.test_s3.test_object_copy_canned_acl
2015-08-13T23:10:57.045 INFO:teuthology.orchestra.run.magna079.stderr:----------------------------------------------------------------------
2015-08-13T23:10:57.045 INFO:teuthology.orchestra.run.magna079.stderr:Traceback (most recent call last):
2015-08-13T23:10:57.046 INFO:teuthology.orchestra.run.magna079.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
2015-08-13T23:10:57.048 INFO:teuthology.orchestra.run.magna079.stderr:    self.test(*self.arg)
2015-08-13T23:10:57.049 INFO:teuthology.orchestra.run.magna079.stderr:  File "/home/ubuntu/cephtest/s3-tests/s3tests/functional/test_s3.py", line 4350, in test_object_copy_canned_acl
2015-08-13T23:10:57.050 INFO:teuthology.orchestra.run.magna079.stderr:    eq(res.status, 200)
2015-08-13T23:10:57.051 INFO:teuthology.orchestra.run.magna079.stderr:AssertionError: 403 != 200
2015-08-13T23:10:57.052 INFO:teuthology.orchestra.run.magna079.stderr:-------------------- >> begin captured stdout << ---------------------
2015-08-13T23:10:57.053 INFO:teuthology.orchestra.run.magna079.stderr:403 Forbidden
2015-08-13T23:10:57.054 INFO:teuthology.orchestra.run.magna079.stderr:
2015-08-13T23:10:57.055 INFO:teuthology.orchestra.run.magna079.stderr:--------------------- >> end captured stdout << ----------------------
2015-08-13T23:10:57.056 INFO:teuthology.orchestra.run.magna079.stderr:-------------------- >> begin captured logging << --------------------
2015-08-13T23:10:57.057 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: path=/test-client.0-cy8wgynfrq6wpx1-223/
2015-08-13T23:10:57.058 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: auth_path=/test-client.0-cy8wgynfrq6wpx1-223/
2015-08-13T23:10:57.059 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Method: PUT
2015-08-13T23:10:57.060 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Path: /test-client.0-cy8wgynfrq6wpx1-223/
2015-08-13T23:10:57.060 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Data:
2015-08-13T23:10:57.061 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Headers: {}
2015-08-13T23:10:57.062 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Host: magna079.ceph.redhat.com:7280
2015-08-13T23:10:57.063 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Port: 7280
2015-08-13T23:10:57.064 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Params: {}
2015-08-13T23:10:57.064 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Token: None
2015-08-13T23:10:57.065 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: StringToSign:
2015-08-13T23:10:57.066 INFO:teuthology.orchestra.run.magna079.stderr:PUT
2015-08-13T23:10:57.066 INFO:teuthology.orchestra.run.magna079.stderr:
2015-08-13T23:10:57.067 INFO:teuthology.orchestra.run.magna079.stderr:
2015-08-13T23:10:57.068 INFO:teuthology.orchestra.run.magna079.stderr:Fri, 14 Aug 2015 03:08:13 GMT
2015-08-13T23:10:57.069 INFO:teuthology.orchestra.run.magna079.stderr:/test-client.0-cy8wgynfrq6wpx1-223/
2015-08-13T23:10:57.069 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Signature:
2015-08-13T23:10:57.070 INFO:teuthology.orchestra.run.magna079.stderr:AWS XMKTVHJDVXZIPLXPABXL:/mpLrQ00tCiHLZja43e+mvem2iU=
2015-08-13T23:10:57.071 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Final headers: {'Date': 'Fri, 14 Aug 2015 03:08:13 GMT', 'Content-Length': '0', 'Authorization': u'AWS XMKTVHJDVXZIPLXPABXL:/mpLrQ00tCiHLZja43e+mvem2iU=', 'User-Agent': 'Boto/2.38.0 Python/2.7.5 Linux/3.10.0-229.9.1.el7.x86_64'}
2015-08-13T23:10:57.071 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Response headers: [('content-length', '0'), ('content-type', 'application/xml')]
2015-08-13T23:10:57.072 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: path=/test-client.0-cy8wgynfrq6wpx1-223/foo123bar
2015-08-13T23:10:57.113 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: auth_path=/test-client.0-cy8wgynfrq6wpx1-223/foo123bar
2015-08-13T23:10:57.153 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Method: PUT
2015-08-13T23:10:57.153 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Path: /test-client.0-cy8wgynfrq6wpx1-223/foo123bar
2015-08-13T23:10:57.154 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Data:
2015-08-13T23:10:57.156 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Headers: {'Content-Length': '3', 'Content-MD5': u'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Type': 'application/octet-stream', 'Expect': '100-Continue', 'User-Agent': 'Boto/2.38.0 Python/2.7.5 Linux/3.10.0-229.9.1.el7.x86_64'}
2015-08-13T23:10:57.156 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Host: magna079.ceph.redhat.com:7280
2015-08-13T23:10:57.157 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Port: 7280
2015-08-13T23:10:57.158 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Params: {}
2015-08-13T23:10:57.159 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Token: None
2015-08-13T23:10:57.160 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: StringToSign:
2015-08-13T23:10:57.161 INFO:teuthology.orchestra.run.magna079.stderr:PUT
2015-08-13T23:10:57.162 INFO:teuthology.orchestra.run.magna079.stderr:rL0Y20zC+Fzt72VPzMSk2A==
2015-08-13T23:10:57.162 INFO:teuthology.orchestra.run.magna079.stderr:application/octet-stream
2015-08-13T23:10:57.163 INFO:teuthology.orchestra.run.magna079.stderr:Fri, 14 Aug 2015 03:08:13 GMT
2015-08-13T23:10:57.164 INFO:teuthology.orchestra.run.magna079.stderr:/test-client.0-cy8wgynfrq6wpx1-223/foo123bar
2015-08-13T23:10:57.165 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Signature:
2015-08-13T23:10:57.166 INFO:teuthology.orchestra.run.magna079.stderr:AWS XMKTVHJDVXZIPLXPABXL:JXkHIXMQFF30PNL0yubwdaXs6ls=
2015-08-13T23:10:57.167 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Final headers: {'Content-Length': '3', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Expect': '100-Continue', 'Date': 'Fri, 14 Aug 2015 03:08:13 GMT', 'User-Agent': 'Boto/2.38.0 Python/2.7.5 Linux/3.10.0-229.9.1.el7.x86_64', 'Content-Type': 'application/octet-stream', 'Authorization': u'AWS XMKTVHJDVXZIPLXPABXL:JXkHIXMQFF30PNL0yubwdaXs6ls='}
2015-08-13T23:10:57.206 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Response headers: [('content-length', '0'), ('etag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('content-type', 'application/xml'), ('accept-ranges', 'bytes')]
2015-08-13T23:10:57.207 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: path=/test-client.0-cy8wgynfrq6wpx1-223/bar321foo
2015-08-13T23:10:57.208 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: auth_path=/test-client.0-cy8wgynfrq6wpx1-223/bar321foo
2015-08-13T23:10:57.209 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Method: PUT
2015-08-13T23:10:57.250 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Path: /test-client.0-cy8wgynfrq6wpx1-223/bar321foo
2015-08-13T23:10:57.250 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Data:
2015-08-13T23:10:57.251 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Headers: {'x-amz-storage-class': 'STANDARD', 'x-amz-acl': 'public-read', 'x-amz-copy-source': 'test-client.0-cy8wgynfrq6wpx1-223/foo123bar', 'x-amz-metadata-directive': 'COPY'}
2015-08-13T23:10:57.252 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Host: magna079.ceph.redhat.com:7280
2015-08-13T23:10:57.253 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Port: 7280
2015-08-13T23:10:57.254 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Params: {}
2015-08-13T23:10:57.255 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Token: None
2015-08-13T23:10:57.256 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: StringToSign:
2015-08-13T23:10:57.257 INFO:teuthology.orchestra.run.magna079.stderr:PUT
2015-08-13T23:10:57.258 INFO:teuthology.orchestra.run.magna079.stderr:
2015-08-13T23:10:57.259 INFO:teuthology.orchestra.run.magna079.stderr:
2015-08-13T23:10:57.259 INFO:teuthology.orchestra.run.magna079.stderr:Fri, 14 Aug 2015 03:08:13 GMT
2015-08-13T23:10:57.260 INFO:teuthology.orchestra.run.magna079.stderr:x-amz-acl:public-read
2015-08-13T23:10:57.261 INFO:teuthology.orchestra.run.magna079.stderr:x-amz-copy-source:test-client.0-cy8wgynfrq6wpx1-223/foo123bar
2015-08-13T23:10:57.262 INFO:teuthology.orchestra.run.magna079.stderr:x-amz-metadata-directive:COPY
2015-08-13T23:10:57.263 INFO:teuthology.orchestra.run.magna079.stderr:x-amz-storage-class:STANDARD
2015-08-13T23:10:57.263 INFO:teuthology.orchestra.run.magna079.stderr:/test-client.0-cy8wgynfrq6wpx1-223/bar321foo
2015-08-13T23:10:57.264 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Signature:
2015-08-13T23:10:57.265 INFO:teuthology.orchestra.run.magna079.stderr:AWS XMKTVHJDVXZIPLXPABXL:U5uYBlq629AxyOfFMbjhhIvCwVE=
2015-08-13T23:10:57.265 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Final headers: {'Content-Length': '0', 'x-amz-acl': 'public-read', 'x-amz-storage-class': 'STANDARD', 'User-Agent': 'Boto/2.38.0 Python/2.7.5 Linux/3.10.0-229.9.1.el7.x86_64', 'x-amz-copy-source': 'test-client.0-cy8wgynfrq6wpx1-223/foo123bar', 'Date': 'Fri, 14 Aug 2015 03:08:13 GMT', 'Authorization': u'AWS XMKTVHJDVXZIPLXPABXL:U5uYBlq629AxyOfFMbjhhIvCwVE=', 'x-amz-metadata-directive': 'COPY'}
2015-08-13T23:10:57.266 INFO:teuthology.orchestra.run.magna079.stderr:boto: DEBUG: Response headers: [('content-length', '135'), ('content-type', 'application/xml')]
2015-08-13T23:10:57.267 INFO:teuthology.orchestra.run.magna079.stderr:--------------------- >> end captured logging << ---------------------
2015-08-13T23:10:57.268 INFO:teuthology.orchestra.run.magna079.stderr:
2015-08-13T23:10:57.269 INFO:teuthology.orchestra.run.magna079.stderr:----------------------------------------------------------------------
2015-08-13T23:10:57.270 INFO:teuthology.orchestra.run.magna079.stderr:Ran 323 tests in 261.724s
2015-08-13T23:10:57.271 INFO:teuthology.orchestra.run.magna079.stderr:
2015-08-13T23:10:57.272 INFO:teuthology.orchestra.run.magna079.stderr:FAILED (SKIP=4, failures=1)
2015-08-13T23:10:57.274 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/vasu/ds/teuthology/teuthology/contextutil.py", line 28, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/ceph-qa-suite_rh130/tasks/s3tests.py", line 344, in run_tests
    label="s3 tests against rgw"
  File "/home/vasu/ds/teuthology/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/vasu/ds/teuthology/teuthology/orchestra/remote.py", line 156, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/vasu/ds/teuthology/teuthology/orchestra/run.py", line 378, in run
    r.wait()
  File "/home/vasu/ds/teuthology/teuthology/orchestra/run.py", line 114, in wait
    label=self.label)
CommandFailedError: Command failed (s3 tests against rgw) on magna079 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/s3-tests/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw'"
2015-08-13T23:10:57.315 INFO:tasks.s3tests:Cleaning up boto...
2015-08-13T23:10:57.356 INFO:teuthology.orchestra.run.magna079:Running: 'rm /home/ubuntu/cephtest/boto.cfg'
2015-08-13T23:10:57.405 INFO:teuthology.orchestra.run.magna079:Running: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid bar.client.0 --purge-data'
2015-08-13T23:10:58.354 INFO:teuthology.orchestra.run.magna079:Running: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data'
2015-08-13T23:11:01.654 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:01.653072 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=3145728 stripe_ofs=3145728 part_ofs=0 rule->part_size=0
2015-08-13T23:11:22.339 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.336737 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880
2015-08-13T23:11:22.340 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.336746 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880
2015-08-13T23:11:22.341 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.336750 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880
2015-08-13T23:11:22.342 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.336754 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880
2015-08-13T23:11:22.343 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.336757 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880
2015-08-13T23:11:22.344 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.336760 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=5242880
2015-08-13T23:11:22.345 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.336763 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=19922944 stripe_ofs=19922944 part_ofs=15728640 rule->part_size=5242880
2015-08-13T23:11:22.346 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.336766 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=20971520 stripe_ofs=20971520 part_ofs=20971520 rule->part_size=5242880
2015-08-13T23:11:22.347 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.336769 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=25165824 stripe_ofs=25165824 part_ofs=20971520 rule->part_size=5242880
2015-08-13T23:11:22.348 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.336772 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=26214400 stripe_ofs=26214400 part_ofs=26214400 rule->part_size=5242880
2015-08-13T23:11:22.349 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.336775 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=30408704 stripe_ofs=30408704 part_ofs=26214400 rule->part_size=5242880
2015-08-13T23:11:22.350 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.336778 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=31457280 stripe_ofs=31457280 part_ofs=31457280 rule->part_size=5242880
2015-08-13T23:11:22.524 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.523610 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880
2015-08-13T23:11:22.542 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.523619 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880
2015-08-13T23:11:22.543 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.523623 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880
2015-08-13T23:11:22.583 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.523626 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880
2015-08-13T23:11:22.906 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.904955 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880
2015-08-13T23:11:22.920 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.904963 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880
2015-08-13T23:11:22.922 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.904968 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880
2015-08-13T23:11:22.923 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.904972 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880
2015-08-13T23:11:22.924 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.904975 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880
2015-08-13T23:11:22.925 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.904979 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728
2015-08-13T23:11:22.925 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:22.904982 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728
2015-08-13T23:11:23.080 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:23.078704 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880
2015-08-13T23:11:23.081 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:23.078713 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880
2015-08-13T23:11:23.082 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:23.078717 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880
2015-08-13T23:11:23.083 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:23.078721 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880
2015-08-13T23:11:24.255 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:24.254164 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0
2015-08-13T23:11:24.912 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:24.437264 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0
2015-08-13T23:11:24.951 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:24.620618 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=4718592 stripe_ofs=4718592 part_ofs=0 rule->part_size=0
2015-08-13T23:11:24.952 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:24.620625 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0
2015-08-13T23:11:24.952 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:24.831930 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0
2015-08-13T23:11:25.230 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:25.229743 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0
2015-08-13T23:11:25.422 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:25.421493 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=4718592 stripe_ofs=4718592 part_ofs=0 rule->part_size=0
2015-08-13T23:11:25.423 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:25.421501 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0
2015-08-13T23:11:25.577 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:25.576311 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0
2015-08-13T23:11:25.724 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:25.723198 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0
2015-08-13T23:11:25.965 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:25.964886 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=4718592 stripe_ofs=4718592 part_ofs=0 rule->part_size=0
2015-08-13T23:11:25.966 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:25.964893 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0
2015-08-13T23:11:26.174 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:26.173911 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0
2015-08-13T23:11:26.363 INFO:teuthology.orchestra.run.magna079.stderr:2015-08-13 23:11:26.362361 7fdb8de2e880  0 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0
2015-08-13T23:11:54.039 INFO:tasks.s3tests:Removing s3-tests...
2015-08-13T23:11:54.040 INFO:teuthology.orchestra.run.magna079:Running: 'rm -rf /home/ubuntu/cephtest/s3-tests'
2015-08-13T23:11:54.132 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/vasu/ds/teuthology/teuthology/run_tasks.py", line 56, in run_tasks
    manager.__enter__()
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/ceph-qa-suite_rh130/tasks/s3tests.py", line 439, in task
    lambda: run_tests(ctx=ctx, config=config),
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/vasu/ds/teuthology/teuthology/contextutil.py", line 28, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/ceph-qa-suite_rh130/tasks/s3tests.py", line 344, in run_tests
    label="s3 tests against rgw"
  File "/home/vasu/ds/teuthology/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/vasu/ds/teuthology/teuthology/orchestra/remote.py", line 156, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/vasu/ds/teuthology/teuthology/orchestra/run.py", line 378, in run
    r.wait()
  File "/home/vasu/ds/teuthology/teuthology/orchestra/run.py", line 114, in wait
    label=self.label)
CommandFailedError: Command failed (s3 tests against rgw) on magna079 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/s3-tests/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw'"
2015-08-13T23:11:54.134 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/vasu/ds/teuthology/teuthology/contextutil.py", line 30, in nested
    yield vars
  File "/home/teuthworker/src/ceph-qa-suite_rh130/tasks/rgw.py", line 846, in task
    yield
  File "/home/vasu/ds/teuthology/teuthology/run_tasks.py", line 56, in run_tasks
    manager.__enter__()
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/ceph-qa-suite_rh130/tasks/s3tests.py", line 439, in task
    lambda: run_tests(ctx=ctx, config=config),
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/vasu/ds/teuthology/teuthology/contextutil.py", line 28, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/ceph-qa-suite_rh130/tasks/s3tests.py", line 344, in run_tests
    label="s3 tests against rgw"
  File "/home/vasu/ds/teuthology/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/vasu/ds/teuthology/teuthology/orchestra/remote.py", line 156, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/vasu/ds/teuthology/teuthology/orchestra/run.py", line 378, in run
    r.wait()
  File "/home/vasu/ds/teuthology/teuthology/orchestra/run.py", line 114, in wait
    label=self.label)
CommandFailedError: Command failed (s3 tests against rgw) on magna079 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/s3-tests/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw'"
2015-08-13T23:11:54.137 INFO:teuthology.misc:Shutting down rgw daemons...

Comment 2 Yehuda Sadeh 2015-09-08 17:59:34 UTC

Does it happen with the current el7 version?

Comment 3 Vasu Kulkarni 2015-09-08 18:30:10 UTC

Hi Yehuda,

This is seen on current EL7.

Comment 4 Ken Dreyer (Red Hat) 2015-09-23 03:59:44 UTC

Notes for devel: Upstream's pull request to Hammer (https://github.com/ceph/ceph/pull/6039) has three commits:

1. "rgw: fix assignment of copy obj attributes" - we had already cherry-picked this patch in downstream in order to fix bz 1234635.

2. "rgw: don't preserve acls when copying object" - this is the fix for this bug found with the s3-tests.

3. "rgw: preserve all attrs if intra-zone copy" - this fixes a regression in the first patch, above.

so only the latter two patches need to be cherry-picked downstream.

Comment 6 Vasu Kulkarni 2015-10-13 18:33:46 UTC

Verfied in 1.3.1 in Smoke run.

Comment 8 errata-xmlrpc 2015-11-23 20:21:58 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2015:2512

Comment 9 Siddharth Sharma 2015-11-23 21:53:29 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2015:2066

Note You need to log in before you can comment on or make changes to this bug.