Bug 1836792 - [CNV deployment] kubevirt components are missing
Summary: [CNV deployment] kubevirt components are missing
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Container Native Virtualization (CNV)
Classification: Red Hat
Component: Installation
Version: 2.4.0
Hardware: Unspecified
OS: Unspecified
urgent
urgent
Target Milestone: ---
: 2.4.0
Assignee: Simone Tiraboschi
QA Contact: Tareq Alayan
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-05-18 07:33 UTC by Tareq Alayan
Modified: 2020-07-28 19:10 UTC (History)
9 users (show)

Fixed In Version: hco-bundle-registry:v2.3.0-226
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-07-28 19:10:07 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github kubevirt kubevirt pull 3438 0 None closed Add missing roles to csv-generator 2020-08-21 15:28:13 UTC
Github kubevirt kubevirt pull 3443 0 None closed [release-0.29] Add missing roles to csv-generator 2020-08-21 15:28:13 UTC
Red Hat Product Errata RHSA-2020:3194 0 None None None 2020-07-28 19:10:18 UTC

Description Tareq Alayan 2020-05-18 07:33:00 UTC
Description of problem:
kubevirt components are missing: 
virt-controller, virt-handler, virt-operator, virt-api

Version-Release number of selected component (if applicable):
oc get -nopenshift-cnv csv -o=jsonpath='{.items[0].metadata.annotations.createdAt}'
2020-05-17 13:42:33
oc get pod hco-operator-58df5b7b86-rtlck -nopenshift-cnv --output=jsonpath='{.spec.containers[0].image}'
registry-proxy.engineering.redhat.com/rh-osbs/container-native-virtualization-hyperconverged-cluster-operator@sha256:65732aee62207c4b72e3ba188413a1e733d54c0cb22635abb42a83c7

How reproducible:
always

Steps to Reproduce:
1. deploy cnv
2.
3.

Actual results:
kubevirt component are missing

Expected results:


Additional info:

Comment 3 Simone Tiraboschi 2020-05-18 09:06:16 UTC
I don't see any condition on KubeVirt CR:

[cloud-user@ocp-psi-executor ~]$ oc get KubeVirt -n openshift-cnv   kubevirt-kubevirt-hyperconverged -o yaml
apiVersion: kubevirt.io/v1alpha3
kind: KubeVirt
metadata:
  creationTimestamp: "2020-05-17T23:03:42Z"
  generation: 1
  labels:
    app: kubevirt-hyperconverged
  managedFields:
  - apiVersion: kubevirt.io/v1alpha3
    fieldsType: FieldsV1
    fieldsV1:
      f:metadata:
        f:labels:
          .: {}
          f:app: {}
        f:ownerReferences: {}
      f:spec:
        .: {}
        f:uninstallStrategy: {}
      f:status: {}
    manager: hyperconverged-cluster-operator
    operation: Update
    time: "2020-05-17T23:03:42Z"
  name: kubevirt-kubevirt-hyperconverged
  namespace: openshift-cnv
  ownerReferences:
  - apiVersion: hco.kubevirt.io/v1alpha1
    blockOwnerDeletion: true
    controller: true
    kind: HyperConverged
    name: kubevirt-hyperconverged
    uid: e3092978-9d3e-413c-aa80-350940fae424
  resourceVersion: "49931"
  selfLink: /apis/kubevirt.io/v1alpha3/namespaces/openshift-cnv/kubevirts/kubevirt-kubevirt-hyperconverged
  uid: 3ea59e05-0bb8-4eab-8bea-d97172c18241
spec:
  uninstallStrategy: BlockUninstallIfWorkloadsExist
status: {}

Comment 4 Simone Tiraboschi 2020-05-18 11:38:00 UTC
It appeared that we were running an older build of HCO.

Comment 5 Lukas Bednar 2020-05-18 14:23:38 UTC
virt-operator still failing
using hco registry-proxy.engineering.redhat.com/rh-osbs/container-native-virtualization-hco-bundle-registry:v2.3.0-223

```
E0518 14:17:04.227260       1 reflector.go:123] kubevirt.io/kubevirt/pkg/controller/virtinformers.go:234: Failed to list *v1.Secret: secrets is forbidden: User "system:serviceaccount:openshift-cnv:kubevirt-operator" cannot list resource "secrets" in API group "" in the namespace "openshift-cnv"
```

Comment 6 Simone Tiraboschi 2020-05-18 14:26:07 UTC
Yes, with a fresher HCO build we identified a missing permission on virt-operator side.
We already have a pending PR here:https://github.com/kubevirt/kubevirt/pull/3438
but then we will need a rebuild of virt-operator and hco-bundle-registry

Comment 7 Lukas Bednar 2020-05-19 07:09:03 UTC
I still see virt-operator failing with registry-proxy.engineering.redhat.com/rh-osbs/container-native-virtualization-hco-bundle-registry:v2.3.0-225

```
E0519 07:07:22.051535       1 reflector.go:123] kubevirt.io/kubevirt/pkg/controller/virtinformers.go:234: Failed to list *v1.Secret: secrets is forbidden: User "system:serviceaccount:openshift-cnv:kubevirt-operator" cannot list resource "secrets" in API group "" in the namespace "openshift-cnv"
```

Comment 8 Simone Tiraboschi 2020-05-19 08:04:14 UTC
Yes, PR 3443 is still open upstream on branch release-0.29.

Comment 9 Daniel Belenky 2020-05-19 09:43:57 UTC
The error that Lukas mentioned should be fixed by https://github.com/kubevirt/kubevirt/pull/3443.
It is a separate issue. Do we need a new bug for it?

Comment 10 Tareq Alayan 2020-05-20 12:25:02 UTC
kubevirt component are missing tested with:

oc get -nopenshift-cnv csv -o=jsonpath='{.items[0].metadata.annotations.createdAt}'
2020-05-18 21:38:40

oc get pod hco-operator-6fb6d4df99-2wxkv -nopenshift-cnv --output=jsonpath='{.spec.containers[0].image}'
registry-proxy.engineering.redhat.com/rh-osbs/container-native-virtualization-hyperconverged-cluster-operator@sha256:9cef522eb0ab22824e7023f917489df84413fe0e7238d46023b3cecd19e554d7

Comment 11 Lukas Bednar 2020-05-20 12:35:56 UTC
I don't see this issue anymore with registry-proxy.engineering.redhat.com/rh-osbs/container-native-virtualization-hco-bundle-registry:v2.3.0-226

Comment 14 errata-xmlrpc 2020-07-28 19:10:07 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2020:3194


Note You need to log in before you can comment on or make changes to this bug.