Bug 1836792
| Summary: | [CNV deployment] kubevirt components are missing | ||
|---|---|---|---|
| Product: | Container Native Virtualization (CNV) | Reporter: | Tareq Alayan <talayan> |
| Component: | Installation | Assignee: | Simone Tiraboschi <stirabos> |
| Status: | CLOSED ERRATA | QA Contact: | Tareq Alayan <talayan> |
| Severity: | urgent | Docs Contact: | |
| Priority: | urgent | ||
| Version: | 2.4.0 | CC: | chhu, cnv-qe-bugs, dbelenky, fdeutsch, ipinto, lbednar, ncredi, smaitra, stirabos |
| Target Milestone: | --- | Keywords: | AutomationBlocker, Regression, TestBlocker, TestBlockerForLayeredProduct |
| Target Release: | 2.4.0 | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | hco-bundle-registry:v2.3.0-226 | Doc Type: | If docs needed, set a value |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2020-07-28 19:10:07 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
I don't see any condition on KubeVirt CR:
[cloud-user@ocp-psi-executor ~]$ oc get KubeVirt -n openshift-cnv kubevirt-kubevirt-hyperconverged -o yaml
apiVersion: kubevirt.io/v1alpha3
kind: KubeVirt
metadata:
creationTimestamp: "2020-05-17T23:03:42Z"
generation: 1
labels:
app: kubevirt-hyperconverged
managedFields:
- apiVersion: kubevirt.io/v1alpha3
fieldsType: FieldsV1
fieldsV1:
f:metadata:
f:labels:
.: {}
f:app: {}
f:ownerReferences: {}
f:spec:
.: {}
f:uninstallStrategy: {}
f:status: {}
manager: hyperconverged-cluster-operator
operation: Update
time: "2020-05-17T23:03:42Z"
name: kubevirt-kubevirt-hyperconverged
namespace: openshift-cnv
ownerReferences:
- apiVersion: hco.kubevirt.io/v1alpha1
blockOwnerDeletion: true
controller: true
kind: HyperConverged
name: kubevirt-hyperconverged
uid: e3092978-9d3e-413c-aa80-350940fae424
resourceVersion: "49931"
selfLink: /apis/kubevirt.io/v1alpha3/namespaces/openshift-cnv/kubevirts/kubevirt-kubevirt-hyperconverged
uid: 3ea59e05-0bb8-4eab-8bea-d97172c18241
spec:
uninstallStrategy: BlockUninstallIfWorkloadsExist
status: {}
It appeared that we were running an older build of HCO. virt-operator still failing using hco registry-proxy.engineering.redhat.com/rh-osbs/container-native-virtualization-hco-bundle-registry:v2.3.0-223 ``` E0518 14:17:04.227260 1 reflector.go:123] kubevirt.io/kubevirt/pkg/controller/virtinformers.go:234: Failed to list *v1.Secret: secrets is forbidden: User "system:serviceaccount:openshift-cnv:kubevirt-operator" cannot list resource "secrets" in API group "" in the namespace "openshift-cnv" ``` Yes, with a fresher HCO build we identified a missing permission on virt-operator side. We already have a pending PR here:https://github.com/kubevirt/kubevirt/pull/3438 but then we will need a rebuild of virt-operator and hco-bundle-registry I still see virt-operator failing with registry-proxy.engineering.redhat.com/rh-osbs/container-native-virtualization-hco-bundle-registry:v2.3.0-225 ``` E0519 07:07:22.051535 1 reflector.go:123] kubevirt.io/kubevirt/pkg/controller/virtinformers.go:234: Failed to list *v1.Secret: secrets is forbidden: User "system:serviceaccount:openshift-cnv:kubevirt-operator" cannot list resource "secrets" in API group "" in the namespace "openshift-cnv" ``` Yes, PR 3443 is still open upstream on branch release-0.29. The error that Lukas mentioned should be fixed by https://github.com/kubevirt/kubevirt/pull/3443. It is a separate issue. Do we need a new bug for it? kubevirt component are missing tested with:
oc get -nopenshift-cnv csv -o=jsonpath='{.items[0].metadata.annotations.createdAt}'
2020-05-18 21:38:40
oc get pod hco-operator-6fb6d4df99-2wxkv -nopenshift-cnv --output=jsonpath='{.spec.containers[0].image}'
registry-proxy.engineering.redhat.com/rh-osbs/container-native-virtualization-hyperconverged-cluster-operator@sha256:9cef522eb0ab22824e7023f917489df84413fe0e7238d46023b3cecd19e554d7
I don't see this issue anymore with registry-proxy.engineering.redhat.com/rh-osbs/container-native-virtualization-hco-bundle-registry:v2.3.0-226 Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHSA-2020:3194 |
Description of problem: kubevirt components are missing: virt-controller, virt-handler, virt-operator, virt-api Version-Release number of selected component (if applicable): oc get -nopenshift-cnv csv -o=jsonpath='{.items[0].metadata.annotations.createdAt}' 2020-05-17 13:42:33 oc get pod hco-operator-58df5b7b86-rtlck -nopenshift-cnv --output=jsonpath='{.spec.containers[0].image}' registry-proxy.engineering.redhat.com/rh-osbs/container-native-virtualization-hyperconverged-cluster-operator@sha256:65732aee62207c4b72e3ba188413a1e733d54c0cb22635abb42a83c7 How reproducible: always Steps to Reproduce: 1. deploy cnv 2. 3. Actual results: kubevirt component are missing Expected results: Additional info: