Bug 2167335

Summary: When creating resources on the consumer clusters it failed to create pods and PVCs on one of the consumers
Product: [Red Hat Storage] Red Hat OpenShift Data Foundation Reporter: Itzhak <ikave>
Component: odf-managed-serviceAssignee: Ohad <omitrani>
Status: CLOSED CURRENTRELEASE QA Contact: Neha Berry <nberry>
Severity: high Docs Contact:
Priority: high    
Version: 4.10CC: cblum, fbalak, ocs-bugs, odf-bz-bot, rchikatw
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2023-03-14 15:27:36 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Itzhak 2023-02-06 10:32:26 UTC
Description of problem:
When creating resources on the consumer clusters, it successfully created the pods and PVCs on consumer one but failed to create them on consumer two.


Version-Release number of selected component (if applicable):
OC version: 4.10.50

OCS version:
ocs-operator 4.10.9-7

Full versions here: http://magna002.ceph.redhat.com/ocsci-jenkins/openshift-clusters/fbalak-4-pr/fbalak-4-pr_20230202T151906/multicluster/logs/test_report_1675351025.html


How reproducible:


Steps to Reproduce:
1. Create one provider with size 4 and two consumers with qe-addon(see the parameters mentioned in the run https://ocs4-jenkins-csb-odf-qe.apps.ocp-c1.prod.psi.redhat.com/job/qe-odf-multicluster/1259/rebuild/parameterized)

2. Create pods and PVCs on the two consumers(or run the test "test_create_scale_pods_and_pvcs_with_ms_consumers") 

Actual results:
It successfully created the pods and PVCs on consumer one but failed to create them on consumer two

Expected results:
It should successfully create the pods and PVCs for both consumers.

Additional info:
Jenkins job link: https://ocs4-jenkins-csb-odf-qe.apps.ocp-c1.prod.psi.redhat.com/job/qe-odf-multicluster/1259/.

Comment 1 Itzhak 2023-02-08 16:53:17 UTC
From the error here https://ocs4-jenkins-csb-odf-qe.apps.ocp-c1.prod.psi.redhat.com/job/qe-odf-multicluster/1291/testReport/tests.e2e.workloads.test_create_scale_pods_and_pvcs_using_kube_job/TestCreateScalePodsAndPvcsUsingKubeJobWithMSConsumers/test_create_scale_pods_and_pvcs_with_ms_consumers/ and what I see in the console output, the problem is because we need more capacity. If it passes on size 8 and greater, we need to reduce the number of PVCs created in the test.

Comment 2 Chris Blum 2023-02-10 10:26:07 UTC
can this be closed then as a notabug?

Comment 3 Itzhak 2023-02-13 14:48:02 UTC
Let's wait for the next tier1 test runs to be sure.

Comment 4 Itzhak 2023-02-20 09:49:53 UTC
I am closing this issue as now tier1 test runs passed successfully.

Comment 5 Ritesh Chikatwar 2023-03-14 15:27:36 UTC
closing this bug as tier 1 test cases passed, If this repro feels free to open it.