Bug 2130509 - Auto image import in failed state with data sources pointing to external manually-created PVC/DV
Summary: Auto image import in failed state with data sources pointing to external manu...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Container Native Virtualization (CNV)
Classification: Red Hat
Component: Storage
Version: 4.12.0
Hardware: Unspecified
OS: Unspecified
unspecified
medium
Target Milestone: ---
: 4.12.0
Assignee: Alexander Wels
QA Contact: Yan Du
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2022-09-28 12:11 UTC by Alex Kalenyuk
Modified: 2023-01-24 13:41 UTC (History)
5 users (show)

Fixed In Version: virt-cdi-operator v4.12.0-55, CNV v4.12.0-636
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2023-01-24 13:41:07 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github kubevirt containerized-data-importer pull 2439 0 None Merged Add cron-job sa to scc 2022-10-06 13:11:09 UTC
Github kubevirt containerized-data-importer pull 2451 0 None Merged [release-v1.55] Add cron-job sa to scc 2022-10-25 07:26:11 UTC
Red Hat Issue Tracker CNV-21540 0 None None None 2022-10-27 09:47:38 UTC
Red Hat Product Errata RHSA-2023:0408 0 None None None 2023-01-24 13:41:16 UTC

Description Alex Kalenyuk 2022-09-28 12:11:33 UTC
Description of problem:
With DV GC on by default, we observe that auto image import DataImportCrons are in failed state when it's data sources are pointing to external manually-created PVC/DV (that may have been GC'd)

Version-Release number of selected component (if applicable):
CNV v4.12.0-542

How reproducible:
100%

Steps to Reproduce:
1. Deploy CNV bundle above with opt-in for auto image import
2.
3.

Actual results:
Some are failed

Expected results:
All crons up to date

Additional info:
[cloud-user@ocp-psi-executor ~]$ oc logs -n openshift-cnv cdi-deployment-6c8f697f96-z4jpw | grep "DataVolume not found"
{"level":"info","ts":1664294347.9625425,"logger":"controller.dataimportcron-controller","msg":"DataVolume not found","name":"win2k19"}
{"level":"info","ts":1664294347.9626577,"logger":"controller.dataimportcron-controller","msg":"DataVolume not found","name":"win11"}
{"level":"info","ts":1664294347.9628775,"logger":"controller.dataimportcron-controller","msg":"DataVolume not found","name":"centos-stream8"}
{"level":"info","ts":1664294347.9629986,"logger":"controller.dataimportcron-controller","msg":"DataVolume not found","name":"win2k16"}
{"level":"info","ts":1664294347.9631097,"logger":"controller.dataimportcron-controller","msg":"DataVolume not found","name":"centos7"}
{"level":"info","ts":1664294347.9632173,"logger":"controller.dataimportcron-controller","msg":"DataVolume not found","name":"fedora"}
{"level":"info","ts":1664294347.9633288,"logger":"controller.dataimportcron-controller","msg":"DataVolume not found","name":"rhel6"}
{"level":"info","ts":1664294347.9634616,"logger":"controller.dataimportcron-controller","msg":"DataVolume not found","name":"win2k12r2"}
{"level":"info","ts":1664294347.963603,"logger":"controller.dataimportcron-controller","msg":"DataVolume not found","name":"win10"}
{"level":"info","ts":1664294347.9637187,"logger":"controller.dataimportcron-controller","msg":"DataVolume not found","name":"centos-stream9"}
{"level":"info","ts":1664294347.9638362,"logger":"controller.dataimportcron-controller","msg":"DataVolume not found","name":"rhel7"}
[cloud-user@ocp-psi-executor ~]$ oc get dv -A 
NAMESPACE                            NAME                 PHASE       PROGRESS   RESTARTS   AGE
openshift-virtualization-os-images   rhel8-65e567156c9c   Succeeded   100.0%                22h
openshift-virtualization-os-images   rhel9-3b04a4ec7d05   Succeeded   100.0%                22h
[cloud-user@ocp-psi-executor ~]$ oc get dic -A
NAMESPACE                            NAME                        AGE
openshift-virtualization-os-images   centos-7-image-cron         22h
openshift-virtualization-os-images   centos-stream8-image-cron   22h
openshift-virtualization-os-images   centos-stream9-image-cron   22h
openshift-virtualization-os-images   fedora-image-cron           22h
openshift-virtualization-os-images   rhel8-image-cron            22h
openshift-virtualization-os-images   rhel9-image-cron            22h
[cloud-user@ocp-psi-executor ~]$ oc get dic -A -o yaml | grep "type: UpToDate" -B 1
      status: "False"
      type: UpToDate
--
      status: "False"
      type: UpToDate
--
      status: "False"
      type: UpToDate
--
      status: "False"
      type: UpToDate
--
      status: "True"
      type: UpToDate
--
      status: "True"
      type: UpToDate

Comment 1 Felix Matouschek 2022-09-29 09:46:00 UTC
The issue probably lies in the PSA of the cdi-source-update-poller, see [1].
Without digests added to the DICs their status will not be updated to reflect the succeeded import.

[1] https://github.com/kubevirt/containerized-data-importer/issues/2437

Comment 6 Yan Du 2022-10-27 09:25:19 UTC
Test on CNV v4.12.0-638, issue has been fixed

$ oc get dv
NAMESPACE                            NAME                          PHASE       PROGRESS   RESTARTS   AGE
openshift-virtualization-os-images   centos-stream8-2f16c067b974   Succeeded   100.0%                4h28m
openshift-virtualization-os-images   centos-stream9-202a14120f91   Succeeded   100.0%                4h28m
openshift-virtualization-os-images   centos7-680e9b4e0fba          Succeeded   100.0%                4h28m
openshift-virtualization-os-images   fedora-29b80ef738f9           Succeeded   100.0%                4h28m
openshift-virtualization-os-images   rhel8-904667801ad2            Succeeded   100.0%                4h28m
openshift-virtualization-os-images   rhel9-3b04a4ec7d05            Succeeded   100.0%                4h28m

Comment 10 errata-xmlrpc 2023-01-24 13:41:07 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Important: OpenShift Virtualization 4.12.0 Images security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2023:0408


Note You need to log in before you can comment on or make changes to this bug.