Bug 2056562

Summary:	[IBM Z] [External Mode] - unknown error when syncing directory with s3 target
Product:	[Red Hat Storage] Red Hat OpenShift Data Foundation	Reporter:	Abdul Kandathil (IBM) <akandath>
Component:	Multi-Cloud Object Gateway	Assignee:	Nimrod Becker <nbecker>
Status:	CLOSED NOTABUG	QA Contact:	Elad <ebenahar>
Severity:	medium	Docs Contact:
Priority:	unspecified
Version:	4.9	CC:	etamir, mmuench, ocs-bugs, odf-bz-bot
Target Milestone:	---
Target Release:	---
Hardware:	s390x
OS:	Linux
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2022-03-09 09:56:03 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Abdul Kandathil (IBM) 2022-02-21 13:34:58 UTC

Description of problem (please be detailed as possible and provide log
snippets):

With the setup ODF 4.9.2 (s390x) deployed in external mode with RHCS5 (x86), an unknown error occurring when syncing local directory with s3 target directory.

-----------
12:33:19 - MainThread - ocs_ci.utility.utils - INFO - Executing command: oc -n openshift-storage rsh session-awscli-relay-pod-26e0f98c52d9434 ls -A1 /test_objects/
12:33:20 - MainThread - ocs_ci.ocs.bucket_utils - INFO - Syncing all objects and directories from /test_objects/ to s3://rgw-oc-bucket-dcfdd10fe72d43da837b1f880b
12:33:20 - MainThread - ocs_ci.utility.utils - INFO - Executing command: oc -n openshift-storage rsh session-awscli-relay-pod-26e0f98c52d9434 sh -c "AWS_CA_BUNDLE=/cert/service-ca.crt AWS_ACCESS_KEY_ID=***** AWS_SECRET_ACCESS_KEY=***** AWS_DEFAULT_REGION=us-east-1 aws s3 --endpoint=***** sync /test_objects/ s3://rgw-oc-bucket-dcfdd10fe72d43da837b1f880b"
12:33:26 - MainThread - ocs_ci.utility.utils - WARNING - Command stderr: upload failed: ../test_objects/bolder.jpg to s3://rgw-oc-bucket-dcfdd10fe72d43da837b1f880b/bolder.jpg An error occurred (InvalidRange) when calling the CreateMultipartUpload operation: Unknown
upload failed: ../test_objects/airbus.jpg to s3://rgw-oc-bucket-dcfdd10fe72d43da837b1f880b/airbus.jpg An error occurred (InvalidRange) when calling the CreateMultipartUpload operation: Unknown
upload failed: ../test_objects/canada.jpg to s3://rgw-oc-bucket-dcfdd10fe72d43da837b1f880b/canada.jpg An error occurred (InvalidRange) when calling the CreateMultipartUpload operation: Unknown
upload failed: ../test_objects/goldman.webm to s3://rgw-oc-bucket-dcfdd10fe72d43da837b1f880b/goldman.webm An error occurred (InvalidRange) when calling the CreateMultipartUpload operation: Unknown
upload failed: ../test_objects/enwik8 to s3://rgw-oc-bucket-dcfdd10fe72d43da837b1f880b/enwik8 An error occurred (InvalidRange) when calling the CreateMultipartUpload operation: Unknown
upload failed: ../test_objects/danny.webm to s3://rgw-oc-bucket-dcfdd10fe72d43da837b1f880b/danny.webm An error occurred (InvalidRange) when calling the CreateMultipartUpload operation: Unknown
upload failed: ../test_objects/apple.mp4 to s3://rgw-oc-bucket-dcfdd10fe72d43da837b1f880b/apple.mp4 An error occurred (InvalidRange) when calling the CreateMultipartUpload operation: Unknown
upload failed: ../test_objects/steve.webm to s3://rgw-oc-bucket-dcfdd10fe72d43da837b1f880b/steve.webm An error occurred (InvalidRange) when calling the CreateMultipartUpload operation: Unknown
upload failed: ../test_objects/rome.jpg to s3://rgw-oc-bucket-dcfdd10fe72d43da837b1f880b/rome.jpg An error occurred (InvalidRange) when calling the CreateMultipartUpload operation: Unknown
command terminated with exit code 1
-----------

Version of all relevant components (if applicable):
ODF 4.9.2 in external mode with RHCS 5


Does this issue impact your ability to continue to work with the product
(please explain in detail what is the user impact)?


Is there any workaround available to the best of your knowledge?


Rate from 1 - 5 the complexity of the scenario you performed that caused this
bug (1 - very simple, 5 - very complex)?


Can this issue reproducible?
yes. Executing below ocs-ci test with odf 4.9 with RHCS 5 in external mode.
"tests/manage/rgw/test_object_integrity.py::TestObjectIntegrity::test_check_object_integrity"


Can this issue reproduce from the UI?


If this is a regression, please provide more details to justify this:


Steps to Reproduce:
1. Deploy odf 4.9.2 in external mode with RHCS 5.
2. execute ocs-ci test "tests/manage/rgw/test_object_integrity.py::TestObjectIntegrity::test_check_object_integrity"
3. RHCS5 is setup on a x86 environment.


Actual results:


Expected results:


Additional info:
Must-gather logs are available in google drive : https://drive.google.com/file/d/1flmnYM-Cx5zcmbLdFqLQ9Cp0qncKlKYi/view?usp=sharing

Comment 2 Abdul Kandathil (IBM) 2022-02-21 13:53:01 UTC

Facing same error for below test as well from tier1.

tests/manage/rgw/test_bucket_deletion.py::TestBucketDeletion::test_bucket_delete_with_objects[RGW-OC]

Comment 3 Nimrod Becker 2022-03-09 09:56:03 UTC

This test is for RGW only, it is not expected to work on MCG.
See path "tests/manage/rgw/..." and also "[RGW-OC]"

Closing as not a bug.