Bug 2005811

Summary: vSphere Problem Detector operator - ServerFaultCode: InvalidProperty
Product: OpenShift Container Platform Reporter: Pablo Rodriguez Guillamon <parodrig>
Component: StorageAssignee: Hemant Kumar <hekumar>
Storage sub component: Operators QA Contact: Wei Duan <wduan>
Status: CLOSED ERRATA Docs Contact:
Severity: low    
Priority: unspecified CC: aos-bugs, hekumar, jsafrane
Version: 4.7   
Target Milestone: ---   
Target Release: 4.10.0   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2022-03-10 16:11:55 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Comment 1 Hemant Kumar 2021-09-21 16:11:49 UTC
So based on logs here - it is very difficult to ascertain what exactly failed. We log sparingly in production and hence it is almost impossible to tell at this point I think.

Is customer open to running a different version of binary in a pod with more logs, to track down exact code that is throwing the error?

Comment 2 Pablo Rodriguez Guillamon 2021-09-22 08:29:25 UTC
Hi Hemant,

I'll get back to the customer asking if that would be possible and will let you know.

Comment 3 Pablo Rodriguez Guillamon 2021-09-22 11:02:58 UTC
Hi Hemant,

The customer got back to us saying they're willing to use the binary on debug mode to help us narrow down their issue.

I'll wait for further instructions from your side to do that, feel free to ask for any information needed to troubleshoot it as well.

Best regards,

Comment 4 Hemant Kumar 2021-09-23 15:09:39 UTC
Can you create following pod in openshift-cluster-storage-operator namespace:

apiVersion: "v1"
kind: "Pod"
metadata:
  name: "debug-pod"
  labels:
    name: "debug-pod"
spec:
  containers:
    -
      name: "debug-pod"
      image: "quay.io/gnufied/vsphere-problem-detector:debug-sep23"
      args:
       - start
       - --v=4
  serviceAccountName: vsphere-problem-detector-operator



And paste me output of logs? feel free to scrub out any vcenter/confidential information .

Comment 8 Pablo Rodriguez Guillamon 2021-09-27 07:03:27 UTC
Thanks for the update and your work here, Hemant.

I've updated the customer.

Comment 9 Pablo Rodriguez Guillamon 2021-09-28 12:21:07 UTC
Hi,

Customer got back to us saying their Datastore does not belong to a Datastore cluster:


>The datastores used in the Openshift installation and by the affected storageclass are not inside a datastore cluster. The entity that contains these datastores is the datacenter object of the vcenter. These DS are marked with a label that identifies which DS belong to the storage policy.
>
>Please, tell me how should I proceed to have correctly configured the storage in vmware. I have followed the official documentation and I do not see that any requirement has been breached.

Is there any log where it says the Datastore belongs to a Datastore cluster?

Thanks,

Comment 11 Pablo Rodriguez Guillamon 2021-09-30 06:40:07 UTC
Hi @HemantKumar , could you please provide us with further information where the logs said that the datastore belongs to a datastore cluster? Customer mentioned it's not part of a datastore cluster.

>The datastores used in the Openshift installation and by the affected storageclass are not inside a datastore cluster. The entity that contains these datastores is the datacenter object of the vcenter. These DS are marked with a label that identifies which DS belong to the storage policy.
>Please, tell me how should I proceed to have correctly configured the storage in vmware. I have followed the official documentation and I do not see that any requirement has been breached.

Thanks,

Comment 14 Wei Duan 2021-10-01 03:21:46 UTC
Reproduced on 4.9.0-rc.4:
I0930 08:09:26.516490       1 datastore.go:107] CheckStorageClasses: thin-copy: ServerFaultCode: InvalidProperty
I0930 08:09:26.549516       1 datastore.go:124] CheckStorageClasses checked 3 storage classes, 1 problems found
I0930 08:09:26.549546       1 operator.go:241] CheckStorageClasses failed: StorageClass thin-copy: ServerFaultCode: InvalidProperty

Verified passed on 4.10.0-0.nightly-2021-09-30-154054, it shows the message which not caused by storageclass.
I1001 03:04:22.578305       1 datastore.go:187] unable to list policy datastores: getPolicyDatastores: error listing datastores: ServerFaultCode: InvalidProperty
I1001 03:04:22.578334       1 datastore.go:124] CheckStorageClasses checked 3 storage classes, 0 problems found
I1001 03:04:22.578343       1 vsphere_check.go:217] CheckStorageClasses passed

Comment 21 errata-xmlrpc 2022-03-10 16:11:55 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: OpenShift Container Platform 4.10.3 security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:0056