Bug 1854312

Summary: 4.4: Pods with PVCs attached takes long time to start
Product: OpenShift Container Platform Reporter: Jan Safranek <jsafrane>
Component: StorageAssignee: Jan Safranek <jsafrane>
Status: CLOSED ERRATA QA Contact: Wei Duan <wduan>
Severity: high Docs Contact:
Priority: high    
Version: 4.4CC: aos-bugs, assingh, bniver, chaoyang, ebenahar, ekuric, gmeno, hchiramm, jhou, jsafrane, kramdoss, madam, mrajanna, muagarwa, ocs-bugs, piqin, ratamir, rperiyas, scuppett, sostapov, vhernand, wduan, xtian, ykaul
Target Milestone: ---Keywords: Performance, Regression, UpcomingSprint
Target Release: 4.4.z   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: 1854311 Environment:
Last Closed: 2020-08-06 19:07:59 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1854311    
Bug Blocks: 1836198, 1870193    

Comment 2 Jan Safranek 2020-07-08 08:32:53 UTC
Waiting for 4.5.z to open and 4.5.z clone to merge

Comment 9 Wei Duan 2020-07-31 11:40:49 UTC
We verified pass on 4.4.0-0.nightly-2020-07-30-212136.

We compared the attach duration with 4.4.14: 

without fix:
  first 300 volume: 7 min
  second 300 volume: 16 min
  last 30 volume: only 1 pod running after 15 min, 9 pod running after 30 min

with fix:
  first 300 volume: 6 min
  second 300 volume: 10min
  last 30 volume: 4 min



For the waiting pod:
Events:
  Type     Reason       Age                From                                                               Message
  ----     ------       ----               ----                                                               -------
  Normal   Scheduled    <unknown>          default-scheduler                                                  Successfully assigned wduan-100/mypod-1 to wduan-0731b-gxznm-worker-b-j2bsm.c.openshift-qe.internal
  Warning  FailedMount  7m57s              kubelet, wduan-0731b-gxznm-worker-b-j2bsm.c.openshift-qe.internal  Unable to attach or mount volumes: unmounted volumes=[local], unattached volumes=[default-token-kvgcp local]: timed out waiting for the condition
  Warning  FailedMount  70s (x4 over 10m)  kubelet, wduan-0731b-gxznm-worker-b-j2bsm.c.openshift-qe.internal  Unable to attach or mount volumes: unmounted volumes=[local], unattached volumes=[local default-token-kvgcp]: timed out waiting for the condition

Comment 10 Wei Duan 2020-07-31 12:07:51 UTC
Additional info:

It was verified on GCE with csi driver.

Comment 12 errata-xmlrpc 2020-08-06 19:07:59 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.4.16 bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:3237