Bug 2001984

Description of problem:
VM not in running state with nonroot VirtLauncher Pods with volumeMode as Filesystem and using a PVC.

Version-Release number of selected component (if applicable):
CNV-4.9.0

How reproducible:
Always

Steps to Reproduce:
1. With nonroot VirtLauncher Pods set in FeatureGates
2. with volumeMode as Filesystem ( ocs-cephfs or NFS or HPP )
3. and using the PVC in the vm spec.

Actual results:
As seen below in additional details:

a) preparing host-disks failed: chown /var/run/kubevirt-private/vmi-disks/disk1/disk.img: operation not permitted"
b) VMI is stuck in Scheduled state

Expected results:

VMI should be in Running state.
And we should be able to successfully login to the VMI.


Additional info:

Events:
  Type     Reason            Age                 From                       Message
  ----     ------            ----                ----                       -------
  Normal   SuccessfulCreate  119s                virtualmachine-controller  Created virtual machine pod virt-launcher-vm-rhel84-virtiofs-ocsfs2-9hpmz
  Warning  SyncFailed        15s (x15 over 98s)  virt-handler               server error. command SyncVMI failed: "preparing host-disks failed: chown /var/run/kubevirt-private/vmi-disks/disk1/disk.img: operation not permitted"

[kbidarka@localhost virtiofs]$ oc get vmi 
NAME                        AGE    PHASE       IP             NODENAME                           READY
vm-fedora                   27m    Running     xx.yy.zz.aa   node13.redhat.com   True
vm-rhel84-virtiofs-ocsfs2   2m8s   Scheduled                  node14.redhat.com   False

[kbidarka@localhost virtiofs]$ oc get pods
NAME                                            READY   STATUS    RESTARTS   AGE
virt-launcher-vm-fedora-r6svj                   2/2     Running   0          27m
virt-launcher-vm-rhel84-virtiofs-ocsfs2-9hpmz   1/1     Running   0          2m27s

[kbidarka@localhost virtiofs]$ oc rsh virt-launcher-vm-rhel84-virtiofs-ocsfs2-9hpmz
sh-4.4$ cd /var/run/kubevirt-private/vmi-disks/
sh-4.4$ ls
disk1
sh-4.4$ cd disk1
sh-4.4$ ls -l 
total 29726720
-rw-rw----. 1 root root 30440161280 Sep  7 13:22 disk.img
sh-4.4$ id
uid=107(qemu) gid=107(qemu) groups=107(qemu),36(kvm)