Bug 2187305
| Summary: | MountVolume.SetUp failed for volume while creating pvc for IBM POWER in ODF 4.13 | ||||||
|---|---|---|---|---|---|---|---|
| Product: | [Red Hat Storage] Red Hat OpenShift Data Foundation | Reporter: | Abhishek Mundada <amundada> | ||||
| Component: | ceph | Assignee: | Milind Changire <mchangir> | ||||
| ceph sub component: | CephFS | QA Contact: | Elad <ebenahar> | ||||
| Status: | CLOSED INSUFFICIENT_DATA | Docs Contact: | |||||
| Severity: | unspecified | ||||||
| Priority: | unspecified | CC: | bniver, gfarnum, mchangir, muagarwa, odf-bz-bot, sostapov | ||||
| Version: | 4.13 | Flags: | gfarnum:
needinfo?
(mchangir) mchangir: needinfo? (amundada) |
||||
| Target Milestone: | --- | ||||||
| Target Release: | --- | ||||||
| Hardware: | ppc64le | ||||||
| OS: | Linux | ||||||
| Whiteboard: | |||||||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |||||
| Doc Text: | Story Points: | --- | |||||
| Clone Of: | Environment: | ||||||
| Last Closed: | 2023-08-08 13:05:52 UTC | Type: | Bug | ||||
| Regression: | --- | Mount Type: | --- | ||||
| Documentation: | --- | CRM: | |||||
| Verified Versions: | Category: | --- | |||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||
| Embargoed: | |||||||
| Attachments: |
|
||||||
|
Description
Abhishek Mundada
2023-04-17 12:18:34 UTC
Pod is not coming up because of this reason: Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal AddedInterface 100s multus Add eth0 [10.128.2.141/23] from ovn-kubernetes Normal Pulled 98s kubelet Successfully pulled image "quay.io/ocsci/nginx:latest" in 2.151563841s (2.151575966s including waiting) Normal Pulled 95s kubelet Successfully pulled image "quay.io/ocsci/nginx:latest" in 2.203875332s (2.203889245s including waiting) Normal Pulled 79s kubelet Successfully pulled image "quay.io/ocsci/nginx:latest" in 2.199828444s (2.199842167s including waiting) Normal Pulled 64s kubelet Successfully pulled image "quay.io/ocsci/nginx:latest" in 2.187749438s (2.187763312s including waiting) Normal Pulled 47s kubelet Successfully pulled image "quay.io/ocsci/nginx:latest" in 2.099495679s (2.0995146s including waiting) Normal Pulled 32s kubelet Successfully pulled image "quay.io/ocsci/nginx:latest" in 2.164546863s (2.164561013s including waiting) Warning Failed 16s (x7 over 98s) kubelet Error: failed to resolve symlink "/var/lib/kubelet/pods/1dc77717-b3a0-424c-a249-6a4ba29052e8/volumes/kubernetes.io~csi/pvc-75aa0237-ef71-456b-a04c-cd8485bcf472/mount": lstat /var/lib/kubelet/pods/1dc77717-b3a0-424c-a249-6a4ba29052e8/volumes/kubernetes.io~csi/pvc-75aa0237-ef71-456b-a04c-cd8485bcf472/mount: permission denied Normal Pulled 16s kubelet Successfully pulled image "quay.io/ocsci/nginx:latest" in 2.240981686s (2.240997379s including waiting) Normal Pulling 2s (x8 over 100s) kubelet Pulling image "quay.io/ocsci/nginx:latest" In the worker node on which pod is scheduled : sh-5.1# ls -lrt /var/lib/kubelet/pods/1dc77717-b3a0-424c-a249-6a4ba29052e8/volumes/kubernetes.io~csi/ total 0 drwxr-x---. 3 root root 40 Apr 12 07:29 pvc-75aa0237-ef71-456b-a04c-cd8485bcf472 sh-5.1# sh-5.1# ls -lrt /var/lib/kubelet/pods/1dc77717-b3a0-424c-a249-6a4ba29052e8/volumes/kubernetes.io~csi/pvc-75aa0237-ef71-456b-a04c-cd8485bcf472/ ls: cannot access '/var/lib/kubelet/pods/1dc77717-b3a0-424c-a249-6a4ba29052e8/volumes/kubernetes.io~csi/pvc-75aa0237-ef71-456b-a04c-cd8485bcf472/mount': Permission denied total 4 d?????????? ? ? ? ? ? mount -rw-r--r--. 1 root root 378 Apr 12 07:29 vol_data.json Milind, PTAL. I think there was another BZ similar to this related to the mount path being a symbolic link. I'll try to dig that up. Feel free to include Madhu from CSI team for details. Hi Abhishek, Do we have the must-gather for this BZ and what is the exact ODF version used for testing? Link for the must-gather file : https://drive.google.com/file/d/1tFsEiWNvjXAxzPwtM8-GFyP3mwqm4DrI/view?usp=sharing ODF version : full_version=4.13.0-121 |