Bug 1915397

Summary: [2.5.x] CNV Deployment fails on OpenShift 4.6.10
Product: Container Native Virtualization (CNV) Reporter: Lukas Bednar <lbednar>
Component: InstallationAssignee: Simone Tiraboschi <stirabos>
Status: CLOSED ERRATA QA Contact: Inbar Rose <irose>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 2.5.3CC: cnv-qe-bugs, dollierp, fdeutsch, lbednar, mrashish, oramraz, pehunt, pelauter, stirabos, ycui
Target Milestone: ---Keywords: TestBlocker
Target Release: 2.5.3   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: hco-bundle-registry-container-v2.5.3-92 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 1915870 (view as bug list) Environment:
Last Closed: 2021-03-15 19:29:40 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1874057    
Bug Blocks: 1915870    

Description Lukas Bednar 2021-01-12 15:29:00 UTC
Description of problem:

Deployment of CNV 2.5.2 & 2.5.3 is failing on OpenShift 4.6.10.
The following pods are failing to start: cdi-operator, virt-controller

  Warning  Failed          17s               kubelet, upg253-ltkr6-worker-0-nbcjd  Error: container create failed: time="2021-01-12T15:18:06Z" level=error msg="container_linux.go:366: starting container process caused: chdir to cwd (\"/home/cdi-operator\") set in config.json failed: permission denied"


  Warning  Failed          2s (x2 over 2s)         kubelet, upg253-ltkr6-worker-0-nbcjd  Error: container create failed: time="2021-01-12T15:19:05Z" level=error msg="container_linux.go:366: starting container process caused: chdir to cwd (\"/home/virt-controller\") set in config.json failed: permission denied"


Version-Release number of selected component (if applicable):
CNV-2.5.2, 2.5.3
OCP-4.6.10


How reproducible: 100


Steps to Reproduce:
1. Deploy CNV on OCP-4.6.10
2.
3.

Actual results: It fails to start cdi-operator and virt-controller


Expected results: CNV succeed to install.


Additional info:

Comment 4 Fabian Deutsch 2021-01-13 13:27:01 UTC
@sjenning @pehunt we are seeing this bug after moving from 4.6.9 to 4.6.10?

Does this bug ring a bell or are you aware of changes that could be causing it?

Comment 5 Fabian Deutsch 2021-01-13 14:45:23 UTC
This is a regression of the fix for bug #1874057 - this is planend to land in 4.6.11

Comment 7 Maya Rashish 2021-01-13 14:58:41 UTC
CDI pods should be fixed from virt-cdi-operator v2.5.3-5

Comment 11 Denis Ollier 2021-01-13 16:16:02 UTC
I confirm the same issue occurs with OCP 4.5.25 and CNV 2.4.6-2.

Comment 13 Lukas Bednar 2021-01-14 14:56:35 UTC
I tested it with v2.5.3-92 and v2.5.3-99, both are deployable on 4.6.10 and 4.6.11 .