Bug 2027752

Summary: No ability to upgrade from 4.9.0->4.9.1
Product: Container Native Virtualization (CNV) Reporter: Debarati Basu-Nag <dbasunag>
Component: InstallationAssignee: Simone Tiraboschi <stirabos>
Status: CLOSED ERRATA QA Contact: Debarati Basu-Nag <dbasunag>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 4.9.1CC: cnv-qe-bugs, stirabos
Target Milestone: ---   
Target Release: 4.9.1   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: hco-bundle-registry-container-v4.9.1-52 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-12-13 19:59:22 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Debarati Basu-Nag 2021-11-30 15:00:50 UTC
Description of problem: HCO is not upgrading to 4.9.1. 


Version-Release number of selected component (if applicable):
CNV-4.9.1 (staging image)

How reproducible:
Saw once

Steps to Reproduce:
1. Run upgrade test
2.
3.

Actual results:
CSV got upgraded
===============
[cnv-qe-jenkins@dollierp-cnv49-v455r-executor ~]$ kubectl get csv -A
NAMESPACE                              NAME                                        DISPLAY                       VERSION              REPLACES                                  PHASE
openshift-cnv                          kubevirt-hyperconverged-operator.v4.9.1     OpenShift Virtualization      4.9.1                kubevirt-hyperconverged-operator.v4.9.0   Succeeded
================

HCO is still pointing to 4.9.0
================
    - name: operator
      version: v4.9.0
kind: List
================

HCO operator shows error: 
========================
{"level":"info","ts":1638279959.713528,"logger":"controller_hyperconverged","msg":"Start upgrading from version v4.9.0 to version v4.9.1","Request.Namespace":"openshift-cnv","Request.Name":"kubevirt-hyperconverged"}
{"level":"error","ts":1638279959.7136793,"logger":"controller_hyperconverged","msg":"Can't open the upgradeChanges yaml file","Request.Namespace":"openshift-cnv","Request.Name":"kubevirt-hyperconverged","file name":"./upgradePatches.json","error":"open ./upgradePatches.json: no such file or directory","stacktrace":"github.com/kubevirt/hyperconverged-cluster-operator/pkg/controller/hyperconverged.validateUpgradePatches\n\t/remote-source/app/pkg/controller/hyperconverged/upgradePatches.go:68\ngithub.com/kubevirt/hyperconverged-cluster-operator/pkg/controller/hyperconverged.(*ReconcileHyperConverged).doReconcile\n\t/remote-source/app/pkg/controller/hyperconverged/hyperconverged_controller.go:324\ngithub.com/kubevirt/hyperconverged-cluster-operator/pkg/controller/hyperconverged.(*ReconcileHyperConverged).Reconcile\n\t/remote-source/app/pkg/controller/hyperconverged/hyperconverged_controller.go:235\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/remote-source/app/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:298\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/remote-source/app/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/remote-source/app/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214"}
{"level":"error","ts":1638279959.713858,"logger":"controller-runtime.manager.controller.hyperconverged-controller","msg":"Reconciler error","name":"hco-controlled-cr-3def0781-909a-4028-b2a2-aa5920448aa1","namespace":"openshift-cnv","error":"open ./upgradePatches.json: no such file or directory","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/remote-source/app/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:253\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/remote-source/app/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:214"}

===========================
Details: http://pastebin.test.redhat.com/1011987

Expected results:
HCO should be pointing to 4.9.1

Additional info:

Comment 2 Debarati Basu-Nag 2021-12-09 19:57:47 UTC
This has been verified via multiple upgrade automation runs: https://main-jenkins-csb-cnvqe.apps.ocp-c1.prod.psi.redhat.com/job/cnv-tests-runner/1844/testReport/

Marking as verified.

Comment 8 errata-xmlrpc 2021-12-13 19:59:22 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Virtualization 4.9.1 Images), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:5091