Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1952144

Summary: openstack-manila-csi-controllerplugin pod stuck on ContainerCreating status
Product: OpenShift Container Platform Reporter: rlobillo
Component: StorageAssignee: Eric Duen <eduen>
Storage sub component: OpenStack CSI Drivers QA Contact: Jon Uriarte <juriarte>
Status: CLOSED DUPLICATE Docs Contact:
Severity: unspecified    
Priority: unspecified CC: aos-bugs, mfedosin
Version: 4.8   
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-04-21 15:49:19 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
must-gather
none
describe of the problematic pod
none
spec of the problematic pod none

Description rlobillo 2021-04-21 15:31:05 UTC
Created attachment 1774111 [details]
must-gather

Description of problem:

Storage cluster operator appears as not available because one of the pods of openshift-manila-csi-driver is stuck on ContainerCreating status:

Events:
  Type     Reason       Age                   From               Message
  ----     ------       ----                  ----               -------
  Normal   Scheduled    53m                   default-scheduler  Successfully assigned openshift-manila-csi-driver/openstack-manila-csi-controllerplugin-69ddc5f974-2dpbz to rlobillo-19051-875vw-master-1
  Warning  FailedMount  30m (x4 over 46m)     kubelet            Unable to attach or mount volumes: unmounted volumes=[metrics-serving-cert], unattached volumes=[socket-dir cacert manila-csi-driver-controller-sa-token-7gvwl metrics-serving-cert]: timed out waiting for the condition
  Warning  FailedMount  16m (x3 over 51m)     kubelet            Unable to attach or mount volumes: unmounted volumes=[metrics-serving-cert], unattached volumes=[manila-csi-driver-controller-sa-token-7gvwl metrics-serving-cert socket-dir cacert]: timed out waiting for the condition
  Warning  FailedMount  7m57s (x8 over 48m)   kubelet            Unable to attach or mount volumes: unmounted volumes=[metrics-serving-cert], unattached volumes=[metrics-serving-cert socket-dir cacert manila-csi-driver-controller-sa-token-7gvwl]: timed out waiting for the condition
  Warning  FailedMount  2m14s (x33 over 53m)  kubelet            MountVolume.SetUp failed for volume "metrics-serving-cert" : secret "manila-csi-driver-controller-metrics-serving-cert" not found


The mentioned secret "manila-csi-driver-controller-metrics-serving-cert" is not present on the namespace:

 oc get secrets -n openshift-manila-csi-driver
NAME                                              TYPE                                  DATA   AGE
builder-dockercfg-fvmrl                           kubernetes.io/dockercfg               1      139m
builder-token-94759                               kubernetes.io/service-account-token   4      140m
builder-token-jh9jd                               kubernetes.io/service-account-token   4      140m
csi-manila-secrets                                Opaque                                7      141m
default-dockercfg-jzkf6                           kubernetes.io/dockercfg               1      139m
default-token-2pzsd                               kubernetes.io/service-account-token   4      141m
default-token-96qz5                               kubernetes.io/service-account-token   4      139m
deployer-dockercfg-p5vg6                          kubernetes.io/dockercfg               1      139m
deployer-token-c9n8m                              kubernetes.io/service-account-token   4      140m
deployer-token-rrt5n                              kubernetes.io/service-account-token   4      140m
manila-csi-driver-controller-sa-dockercfg-ltnj8   kubernetes.io/dockercfg               1      139m
manila-csi-driver-controller-sa-token-7gvwl       kubernetes.io/service-account-token   4      141m
manila-csi-driver-controller-sa-token-hb2tt       kubernetes.io/service-account-token   4      139m
manila-csi-driver-node-sa-dockercfg-pv5dz         kubernetes.io/dockercfg               1      139m
manila-csi-driver-node-sa-token-6vlg4             kubernetes.io/service-account-token   4      141m
manila-csi-driver-node-sa-token-rjwrv             kubernetes.io/service-account-token   4      139m


Version-Release number of selected component (if applicable): 4.8.0-fc.0 on PSI.

How reproducible: Observed once.

Steps to Reproduce:
Install OCP with UPI on OSP with Manila enabled.

Actual results:
Unsuccessful installation.


Expected results:
Successful installation, all cluster operators available.
Master Log:

Additional info: must-gather, describe and spec of problematic pod attached.

Comment 1 rlobillo 2021-04-21 15:31:38 UTC
Created attachment 1774112 [details]
describe of the problematic pod

Comment 2 rlobillo 2021-04-21 15:33:04 UTC
Created attachment 1774113 [details]
spec of the problematic pod

Comment 3 rlobillo 2021-04-21 15:34:05 UTC
$ oc get pods -n openshift-manila-csi-driver
NAME                                                     READY   STATUS              RESTARTS   AGE
csi-nodeplugin-nfsplugin-d9hxq                           1/1     Running             0          140m
csi-nodeplugin-nfsplugin-pnt7h                           1/1     Running             0          141m
csi-nodeplugin-nfsplugin-vp5bj                           1/1     Running             0          128m
csi-nodeplugin-nfsplugin-x4zbv                           1/1     Running             0          141m
csi-nodeplugin-nfsplugin-zqqbw                           1/1     Running             0          130m
openstack-manila-csi-controllerplugin-69ddc5f974-2dpbz   0/6     ContainerCreating   0          53m
openstack-manila-csi-nodeplugin-5fz64                    2/2     Running             0          140m
openstack-manila-csi-nodeplugin-cnxdr                    2/2     Running             0          141m
openstack-manila-csi-nodeplugin-vb6td                    2/2     Running             0          141m
openstack-manila-csi-nodeplugin-vv7wc                    2/2     Running             0          130m
openstack-manila-csi-nodeplugin-wgxgn                    2/2     Running             0          128m

Comment 4 Mike Fedosin 2021-04-21 15:49:19 UTC

*** This bug has been marked as a duplicate of bug 1949357 ***