Bug 1953182 - [Azure disk csi driver] volume expansion failed on filesystem resizing
Summary: [Azure disk csi driver] volume expansion failed on filesystem resizing
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Storage
Version: 4.8
Hardware: Unspecified
OS: Unspecified
unspecified
medium
Target Milestone: ---
: 4.9.0
Assignee: Fabio Bertinatto
QA Contact: Qin Ping
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-04-24 13:02 UTC by Qin Ping
Modified: 2021-10-18 17:30 UTC (History)
3 users (show)

Fixed In Version:
Doc Type: No Doc Update
Doc Text:
Clone Of:
Environment:
Last Closed: 2021-10-18 17:30:14 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHSA-2021:3759 0 None None None 2021-10-18 17:30:30 UTC

Description Qin Ping 2021-04-24 13:02:26 UTC
Description of problem:
volume expansion failed on filesystem resizing

Version-Release number of selected component (if applicable):
4.8.0-0.nightly-2021-04-22-182303

How reproducible:
Always

Steps to Reproduce:
1. Create a 1Gi PVC with managed-csi storageclass
2. Create a Pod consuming it
3. Delete the Pod
4. Expand the PVC to 2Gi
5. Check the PV size is 2Gi, recreate a new pod consuming this PVC.
6. Check filesystem size

Actual results:
Pod is stuck in "ContainerCreating" status.

 Warning  FailedMount             2s                        kubelet                  Unable to attach or mount volumes: unmounted volumes=[local], unattached volumes=[local default-token-rdwqr]: timed out waiting for the condition
  Warning  FailedMount             <invalid> (x9 over 108s)  kubelet                  MountVolume.MountDevice failed while expanding volume for volume "pvc-0241ec5e-64a0-4ebc-9500-e9fa52190d19" : Expander.NodeExpand failed to expand the volume : rpc error: code = Internal desc = Could not get size of block volume at path /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-0241ec5e-64a0-4ebc-9500-e9fa52190d19/globalmount: error when getting size of block volume at path /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-0241ec5e-64a0-4ebc-9500-e9fa52190d19/globalmount: output: , err: exit status 1
 

Expected results:
Pod can expand successfully.

Master Log:

Node Log (of failed PODs):

PV Dump:

PVC Dump:

StorageClass Dump (if StorageClass used by PV/PVC):

Additional info:

Comment 1 Fabio Bertinatto 2021-05-06 09:46:25 UTC
This issue specifically has been fixed by this PR: https://github.com/openshift/azure-disk-csi-driver/pull/6.


We plan to re-enable the expansion tests for Azure as soon as we fix the remaining resizing issues. We are tracking that work in bug 1948603.

Comment 2 Qin Ping 2021-05-13 12:18:32 UTC
offline resizing is successful in: 4.8.0-0.nightly-2021-05-12-184904

Comment 5 errata-xmlrpc 2021-10-18 17:30:14 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: OpenShift Container Platform 4.9.0 bug fix and security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2021:3759


Note You need to log in before you can comment on or make changes to this bug.