Bug 1945703 - "Guest OS Info" availability in VMI describe is flaky
Summary: "Guest OS Info" availability in VMI describe is flaky
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Container Native Virtualization (CNV)
Classification: Red Hat
Component: Virtualization
Version: 2.6.1
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: ---
: 2.6.6
Assignee: Antonio Cardace
QA Contact: Israel Pinto
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-04-01 17:03 UTC by Ruth Netser
Modified: 2021-08-10 17:34 UTC (History)
7 users (show)

Fixed In Version: virt-operator-container-v2.6.6-3 hco-bundle-registry-container-v2.6.6-24
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2021-08-10 17:33:37 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
virt-launcher log (27.06 KB, text/plain)
2021-04-01 17:07 UTC, Ruth Netser
no flags Details
virt-handler log (1.03 MB, text/plain)
2021-04-01 17:08 UTC, Ruth Netser
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Github kubevirt kubevirt pull 5560 0 None closed virt-launcher, Fix flaky VMI report (random missing Guest Agent data) 2021-05-14 12:06:25 UTC
Github kubevirt kubevirt pull 5655 0 None open [release-0.36] virt-launcher, Fix flaky VMI report 2021-06-10 13:53:44 UTC
Red Hat Product Errata RHSA-2021:3119 0 None None None 2021-08-10 17:34:27 UTC

Description Ruth Netser 2021-04-01 17:03:14 UTC
Description of problem:
VMI describe - "Guest OS Info" availability is flaky.
(setting to high as this affects automation)

Version-Release number of selected component (if applicable):
OCP 4.7.4, CNV 2.6.1

How reproducible:


Steps to Reproduce:
1. Create Rhel 8.2 VM from template
2. Check VMI describe "Guest OS Info"


Actual results:
Data is sometimes available and sometimes is not (nothing is actively executed in the VM).
Inforamtion is available via virtctl.

===============================
  Guest OS Info:
    Id:              rhel
    Kernel Release:  4.18.0-193.35.1.el8_2.x86_64
    Kernel Version:  #1 SMP Tue Nov 24 05:22:39 EST 2020
    Name:            Red Hat Enterprise Linux
    Pretty Name:     Red Hat Enterprise Linux 8.2 (Ootpa)
    Version:         8.2
    Version Id:      8.2
  Interfaces:
    Interface Name:  eth0
    Ip Address:      10.129.2.255
    Ip Addresses:
      10.129.2.255
    Mac:             02:33:01:00:00:09
    Name:            default
  Migration Method:  BlockMigration
  Node Name:         ruty-2-5-5-p-gbdmn-worker-0-zrts4
  Phase:             Running
  Qos Class:         Burstable
  Volume Status:
    Name:    cloudinitdisk
    Target:  vdb
    Name:    rhel-8-2-1617295444-2900226
    Target:  vda
Events:
  Type    Reason            Age                From                       Message
  ----    ------            ----               ----                       -------
  Normal  SuccessfulCreate  114s               virtualmachine-controller  Created virtual machine pod virt-launcher-rhel-8-2-1617295444-2900226-d6z5p
===============================
  Guest OS Info:
  Interfaces:
    Interface Name:  eth0
    Ip Address:      10.129.2.255
    Ip Addresses:
      10.129.2.255
    Mac:             02:33:01:00:00:09
    Name:            default
  Migration Method:  BlockMigration
  Node Name:         ruty-2-5-5-p-gbdmn-worker-0-zrts4
  Phase:             Running
  Qos Class:         Burstable
  Volume Status:
    Name:    cloudinitdisk
    Target:  vdb
    Name:    rhel-8-2-1617295444-2900226
    Target:  vda
Events:
  Type    Reason            Age                  From                       Message
  ----    ------            ----                 ----                       -------
  Normal  SuccessfulCreate  5m19s                virtualmachine-controller  Created virtual machine pod virt-launcher-rhel-8-2-1617295444-2900226-d6z5p
===============================
  Guest OS Info:
    Id:              rhel
    Kernel Release:  4.18.0-193.35.1.el8_2.x86_64
    Kernel Version:  #1 SMP Tue Nov 24 05:22:39 EST 2020
    Name:            Red Hat Enterprise Linux
    Pretty Name:     Red Hat Enterprise Linux 8.2 (Ootpa)
    Version:         8.2
    Version Id:      8.2
  Interfaces:
    Interface Name:  eth0
    Ip Address:      10.129.2.255
    Ip Addresses:
      10.129.2.255
    Mac:             02:33:01:00:00:09
    Name:            default
  Migration Method:  BlockMigration
  Node Name:         ruty-2-5-5-p-gbdmn-worker-0-zrts4
  Phase:             Running
  Qos Class:         Burstable
  Volume Status:
    Name:    cloudinitdisk
    Target:  vdb
    Name:    rhel-8-2-1617295444-2900226
    Target:  vda
Events:
  Type    Reason            Age                     From                       Message
  ----    ------            ----                    ----                       -------
  Normal  SuccessfulCreate  9m24s                   virtualmachine-controller  Created virtual machine pod virt-launcher-rhel-8-2-1617295444-2900226-d6z5p

===============================

$ virtctl guestosinfo -n ssp-supported-os-common-templates-rhel-test-rhel-os-support rhel-8-2-1617295444-2900226
{
  "guestAgentVersion": "2.12.0",
  "hostname": "localhost",
  "os": {
    "name": "Red Hat Enterprise Linux",
    "kernelRelease": "4.18.0-193.35.1.el8_2.x86_64",
    "version": "8.2 (Ootpa)",
    "prettyName": "Red Hat Enterprise Linux 8.2 (Ootpa)",
    "versionId": "8.2",
    "kernelVersion": "#1 SMP Tue Nov 24 05:22:39 EST 2020",
    "machine": "x86_64",
    "id": "rhel"
  },
  "timezone": "UTC, 0",
  "fsInfo": {
    "disks": [
      {
        "diskName": "vda2",
        "mountPoint": "/boot/efi",
        "fileSystemType": "vfat",
        "usedBytes": 0,
        "totalBytes": 0
      },
      {
        "diskName": "vda3",
        "mountPoint": "/",
        "fileSystemType": "xfs",
        "usedBytes": 0,
        "totalBytes": 0
      }
    ]
  }
}

Expected results:
Inforamtion should be always available.

Additional info:
VM spec:
apiVersion: kubevirt.io/v1alpha3
kind: VirtualMachine
metadata:
  annotations:
    vm.kubevirt.io/flavor: tiny
    vm.kubevirt.io/os: rhel8
    vm.kubevirt.io/validations: "[\n  {\n    \"name\": \"minimal-required-memory\"\
      ,\n    \"path\": \"jsonpath::.spec.domain.resources.requests.memory\",\n   \
      \ \"rule\": \"integer\",\n    \"message\": \"This VM requires more memory.\"\
      ,\n    \"min\": 1610612736\n  }\n]\n"
    vm.kubevirt.io/workload: server
  labels:
    app: rhel-8-2-1617295444-2900226
    vm.kubevirt.io/template: rhel8-server-tiny
    vm.kubevirt.io/template.namespace: openshift
    vm.kubevirt.io/template.revision: '1'
    vm.kubevirt.io/template.version: v0.13.2
  name: rhel-8-2-1617295444-2900226
spec:
  dataVolumeTemplates:
  - apiVersion: cdi.kubevirt.io/v1beta1
    kind: DataVolume
    metadata:
      name: rhel-8-2-1617295444-2900226
    spec:
      pvc:
        accessModes:
        - ReadWriteOnce
        resources:
          requests:
            storage: 30Gi
        storageClassName: hostpath-provisioner
        volumeMode: Filesystem
      source:
        pvc:
          name: rhel-8-2
          namespace: openshift-virtualization-os-images
  running: false
  template:
    metadata:
      labels:
        kubevirt.io/domain: rhel-8-2-1617295444-2900226
        kubevirt.io/size: tiny
        kubevirt.io/vm: rhel-8-2-1617295444-2900226
    spec:
      domain:
        cpu:
          cores: 1
          model: Broadwell-IBRS
          sockets: 1
          threads: 1
        devices:
          disks:
          - disk:
              bus: virtio
            name: rhel-8-2-1617295444-2900226
          - disk:
              bus: virtio
            name: cloudinitdisk
          interfaces:
          - masquerade: {}
            name: default
          networkInterfaceMultiqueue: true
          rng: {}
        machine:
          type: pc-q35-rhel8.3.0
        resources:
          requests:
            memory: 1.5Gi
      networks:
      - name: default
        pod: {}
      terminationGracePeriodSeconds: 180
      volumes:
      - dataVolume:
          name: rhel-8-2-1617295444-2900226
        name: rhel-8-2-1617295444-2900226
      - cloudInitNoCloud:
          userData: '#cloud-config

            user: cloud-user

            password: redhat

            chpasswd: { expire: False }'
        name: cloudinitdisk


===============================
$ oc describe vmi -n ssp-supported-os-common-templates-rhel-test-rhel-os-support rhel-8-2-1617295444-2900226
Name:         rhel-8-2-1617295444-2900226
Namespace:    ssp-supported-os-common-templates-rhel-test-rhel-os-support
Labels:       kubevirt.io/domain=rhel-8-2-1617295444-2900226
              kubevirt.io/nodeName=ruty-2-5-5-p-gbdmn-worker-0-zrts4
              kubevirt.io/size=tiny
              kubevirt.io/vm=rhel-8-2-1617295444-2900226
Annotations:  kubevirt.io/latest-observed-api-version: v1alpha3
              kubevirt.io/storage-observed-api-version: v1alpha3
API Version:  kubevirt.io/v1alpha3
Kind:         VirtualMachineInstance
Metadata:
  Creation Timestamp:  2021-04-01T16:44:06Z
  Finalizers:
    foregroundDeleteVirtualMachine
  Generation:  14
  Managed Fields:
    API Version:  kubevirt.io/v1alpha3
    Fields Type:  FieldsV1
    fieldsV1:
      f:metadata:
        f:annotations:
          .:
          f:kubevirt.io/latest-observed-api-version:
          f:kubevirt.io/storage-observed-api-version:
        f:labels:
          .:
          f:kubevirt.io/domain:
          f:kubevirt.io/nodeName:
          f:kubevirt.io/size:
          f:kubevirt.io/vm:
        f:ownerReferences:
      f:spec:
        .:
        f:domain:
          .:
          f:cpu:
            .:
            f:cores:
            f:model:
            f:sockets:
            f:threads:
          f:devices:
            .:
            f:disks:
            f:interfaces:
            f:networkInterfaceMultiqueue:
            f:rng:
          f:firmware:
            .:
            f:uuid:
          f:machine:
            .:
            f:type:
          f:resources:
            .:
            f:requests:
              .:
              f:memory:
        f:networks:
        f:terminationGracePeriodSeconds:
        f:volumes:
      f:status:
        .:
        f:activePods:
          .:
          f:56f3a14e-4f26-4457-90d6-d0788fed9c39:
        f:guestOSInfo:
        f:nodeName:
        f:qosClass:
    Manager:      virt-controller
    Operation:    Update
    Time:         2021-04-01T16:45:09Z
    API Version:  kubevirt.io/v1alpha3
    Fields Type:  FieldsV1
    fieldsV1:
      f:status:
        f:conditions:
        f:guestOSInfo:
          f:id:
          f:kernelRelease:
          f:kernelVersion:
          f:name:
          f:prettyName:
          f:version:
          f:versionId:
        f:interfaces:
        f:migrationMethod:
        f:phase:
        f:volumeStatus:
    Manager:    virt-handler
    Operation:  Update
    Time:       2021-04-01T16:45:58Z
  Owner References:
    API Version:           kubevirt.io/v1alpha3
    Block Owner Deletion:  true
    Controller:            true
    Kind:                  VirtualMachine
    Name:                  rhel-8-2-1617295444-2900226
    UID:                   27bfadf0-aa33-4856-b75d-73de05a056a5
  Resource Version:        3239454
  Self Link:               /apis/kubevirt.io/v1alpha3/namespaces/ssp-supported-os-common-templates-rhel-test-rhel-os-support/virtualmachineinstances/rhel-8-2-1617295444-2900226
  UID:                     572ae522-a328-4a47-a98c-9692fd976d99
Spec:
  Domain:
    Cpu:
      Cores:    1
      Model:    Broadwell-IBRS
      Sockets:  1
      Threads:  1
    Devices:
      Disks:
        Disk:
          Bus:  virtio
        Name:   rhel-8-2-1617295444-2900226
        Disk:
          Bus:  virtio
        Name:   cloudinitdisk
      Interfaces:
        Mac Address:  02:33:01:00:00:09
        Masquerade:
        Name:                        default
      Network Interface Multiqueue:  true
      Rng:
    Features:
      Acpi:
        Enabled:  true
    Firmware:
      Uuid:  f31566eb-2cb3-5e02-83e0-c75371342d71
    Machine:
      Type:  pc-q35-rhel8.3.0
    Resources:
      Requests:
        Cpu:     100m
        Memory:  1536Mi
  Networks:
    Name:  default
    Pod:
  Termination Grace Period Seconds:  180
  Volumes:
    Data Volume:
      Name:  rhel-8-2-1617295444-2900226
    Name:    rhel-8-2-1617295444-2900226
    Cloud Init No Cloud:
      User Data:  #cloud-config
user: cloud-user
password: redhat
chpasswd: { expire: False }
    Name:  cloudinitdisk
Status:
  Active Pods:
    56f3a14e-4f26-4457-90d6-d0788fed9c39:  ruty-2-5-5-p-gbdmn-worker-0-zrts4
  Conditions:
    Last Probe Time:       <nil>
    Last Transition Time:  <nil>
    Message:               cannot migrate VMI: PVC rhel-8-2-1617295444-2900226 is not shared, live migration requires that all PVCs must be shared (using ReadWriteMany access mode)
    Reason:                DisksNotLiveMigratable
    Status:                False
    Type:                  LiveMigratable
    Last Probe Time:       <nil>
    Last Transition Time:  2021-04-01T16:45:06Z
    Status:                True
    Type:                  Ready
    Last Probe Time:       2021-04-01T16:45:58Z
    Last Transition Time:  <nil>
    Status:                True
    Type:                  AgentConnected
  Guest OS Info:
    Id:              rhel
    Kernel Release:  4.18.0-193.35.1.el8_2.x86_64
    Kernel Version:  #1 SMP Tue Nov 24 05:22:39 EST 2020
    Name:            Red Hat Enterprise Linux
    Pretty Name:     Red Hat Enterprise Linux 8.2 (Ootpa)
    Version:         8.2
    Version Id:      8.2
  Interfaces:
    Interface Name:  eth0
    Ip Address:      10.129.2.255
    Ip Addresses:
      10.129.2.255
    Mac:             02:33:01:00:00:09
    Name:            default
  Migration Method:  BlockMigration
  Node Name:         ruty-2-5-5-p-gbdmn-worker-0-zrts4
  Phase:             Running
  Qos Class:         Burstable
  Volume Status:
    Name:    cloudinitdisk
    Target:  vdb
    Name:    rhel-8-2-1617295444-2900226
    Target:  vda
Events:
  Type    Reason            Age                From                       Message
  ----    ------            ----               ----                       -------
  Normal  SuccessfulCreate  114s               virtualmachine-controller  Created virtual machine pod virt-launcher-rhel-8-2-1617295444-2900226-d6z5p
  Normal  SuccessfulDelete  114s               virtualmachine-controller  Deleted temporary pod virt-launcher-rhel-8-2-1617295444-2900226-d6z5p
  Normal  SuccessfulCreate  58s                virtualmachine-controller  Created virtual machine pod virt-launcher-rhel-8-2-1617295444-2900226-4nmbh
  Normal  Started           52s                virt-handler               VirtualMachineInstance started.
  Normal  Created           3s (x10 over 52s)  virt-handler               VirtualMachineInstance defined.


===============================
$ oc describe vmi -n ssp-supported-os-common-templates-rhel-test-rhel-os-support rhel-8-2-1617295444-2900226
Name:         rhel-8-2-1617295444-2900226
Namespace:    ssp-supported-os-common-templates-rhel-test-rhel-os-support
Labels:       kubevirt.io/domain=rhel-8-2-1617295444-2900226
              kubevirt.io/nodeName=ruty-2-5-5-p-gbdmn-worker-0-zrts4
              kubevirt.io/size=tiny
              kubevirt.io/vm=rhel-8-2-1617295444-2900226
Annotations:  kubevirt.io/latest-observed-api-version: v1alpha3
              kubevirt.io/storage-observed-api-version: v1alpha3
API Version:  kubevirt.io/v1alpha3
Kind:         VirtualMachineInstance
Metadata:
  Creation Timestamp:  2021-04-01T16:44:06Z
  Finalizers:
    foregroundDeleteVirtualMachine
  Generation:  15
  Managed Fields:
    API Version:  kubevirt.io/v1alpha3
    Fields Type:  FieldsV1
    fieldsV1:
      f:metadata:
        f:annotations:
          .:
          f:kubevirt.io/latest-observed-api-version:
          f:kubevirt.io/storage-observed-api-version:
        f:labels:
          .:
          f:kubevirt.io/domain:
          f:kubevirt.io/nodeName:
          f:kubevirt.io/size:
          f:kubevirt.io/vm:
        f:ownerReferences:
      f:spec:
        .:
        f:domain:
          .:
          f:cpu:
            .:
            f:cores:
            f:model:
            f:sockets:
            f:threads:
          f:devices:
            .:
            f:disks:
            f:interfaces:
            f:networkInterfaceMultiqueue:
            f:rng:
          f:firmware:
            .:
            f:uuid:
          f:machine:
            .:
            f:type:
          f:resources:
            .:
            f:requests:
              .:
              f:memory:
        f:networks:
        f:terminationGracePeriodSeconds:
        f:volumes:
      f:status:
        .:
        f:activePods:
          .:
          f:56f3a14e-4f26-4457-90d6-d0788fed9c39:
        f:guestOSInfo:
        f:nodeName:
        f:qosClass:
    Manager:      virt-controller
    Operation:    Update
    Time:         2021-04-01T16:45:09Z
    API Version:  kubevirt.io/v1alpha3
    Fields Type:  FieldsV1
    fieldsV1:
      f:status:
        f:conditions:
        f:interfaces:
        f:migrationMethod:
        f:phase:
        f:volumeStatus:
    Manager:    virt-handler
    Operation:  Update
    Time:       2021-04-01T16:45:58Z
  Owner References:
    API Version:           kubevirt.io/v1alpha3
    Block Owner Deletion:  true
    Controller:            true
    Kind:                  VirtualMachine
    Name:                  rhel-8-2-1617295444-2900226
    UID:                   27bfadf0-aa33-4856-b75d-73de05a056a5
  Resource Version:        3242002
  Self Link:               /apis/kubevirt.io/v1alpha3/namespaces/ssp-supported-os-common-templates-rhel-test-rhel-os-support/virtualmachineinstances/rhel-8-2-1617295444-2900226
  UID:                     572ae522-a328-4a47-a98c-9692fd976d99
Spec:
  Domain:
    Cpu:
      Cores:    1
      Model:    Broadwell-IBRS
      Sockets:  1
      Threads:  1
    Devices:
      Disks:
        Disk:
          Bus:  virtio
        Name:   rhel-8-2-1617295444-2900226
        Disk:
          Bus:  virtio
        Name:   cloudinitdisk
      Interfaces:
        Mac Address:  02:33:01:00:00:09
        Masquerade:
        Name:                        default
      Network Interface Multiqueue:  true
      Rng:
    Features:
      Acpi:
        Enabled:  true
    Firmware:
      Uuid:  f31566eb-2cb3-5e02-83e0-c75371342d71
    Machine:
      Type:  pc-q35-rhel8.3.0
    Resources:
      Requests:
        Cpu:     100m
        Memory:  1536Mi
  Networks:
    Name:  default
    Pod:
  Termination Grace Period Seconds:  180
  Volumes:
    Data Volume:
      Name:  rhel-8-2-1617295444-2900226
    Name:    rhel-8-2-1617295444-2900226
    Cloud Init No Cloud:
      User Data:  #cloud-config
user: cloud-user
password: redhat
chpasswd: { expire: False }
    Name:  cloudinitdisk
Status:
  Active Pods:
    56f3a14e-4f26-4457-90d6-d0788fed9c39:  ruty-2-5-5-p-gbdmn-worker-0-zrts4
  Conditions:
    Last Probe Time:       <nil>
    Last Transition Time:  <nil>
    Message:               cannot migrate VMI: PVC rhel-8-2-1617295444-2900226 is not shared, live migration requires that all PVCs must be shared (using ReadWriteMany access mode)
    Reason:                DisksNotLiveMigratable
    Status:                False
    Type:                  LiveMigratable
    Last Probe Time:       <nil>
    Last Transition Time:  2021-04-01T16:45:06Z
    Status:                True
    Type:                  Ready
    Last Probe Time:       2021-04-01T16:45:58Z
    Last Transition Time:  <nil>
    Status:                True
    Type:                  AgentConnected
  Guest OS Info:
  Interfaces:
    Interface Name:  eth0
    Ip Address:      10.129.2.255
    Ip Addresses:
      10.129.2.255
    Mac:             02:33:01:00:00:09
    Name:            default
  Migration Method:  BlockMigration
  Node Name:         ruty-2-5-5-p-gbdmn-worker-0-zrts4
  Phase:             Running
  Qos Class:         Burstable
  Volume Status:
    Name:    cloudinitdisk
    Target:  vdb
    Name:    rhel-8-2-1617295444-2900226
    Target:  vda
Events:
  Type    Reason            Age                  From                       Message
  ----    ------            ----                 ----                       -------
  Normal  SuccessfulCreate  5m19s                virtualmachine-controller  Created virtual machine pod virt-launcher-rhel-8-2-1617295444-2900226-d6z5p
  Normal  SuccessfulDelete  5m19s                virtualmachine-controller  Deleted temporary pod virt-launcher-rhel-8-2-1617295444-2900226-d6z5p
  Normal  SuccessfulCreate  4m23s                virtualmachine-controller  Created virtual machine pod virt-launcher-rhel-8-2-1617295444-2900226-4nmbh
  Normal  Started           4m17s                virt-handler               VirtualMachineInstance started.
  Normal  Created           2s (x13 over 4m17s)  virt-handler               VirtualMachineInstance defined.


===============================

$ oc describe vmi -n ssp-supported-os-common-templates-rhel-test-rhel-os-support rhel-8-2-1617295444-2900226
Name:         rhel-8-2-1617295444-2900226
Namespace:    ssp-supported-os-common-templates-rhel-test-rhel-os-support
Labels:       kubevirt.io/domain=rhel-8-2-1617295444-2900226
              kubevirt.io/nodeName=ruty-2-5-5-p-gbdmn-worker-0-zrts4
              kubevirt.io/size=tiny
              kubevirt.io/vm=rhel-8-2-1617295444-2900226
Annotations:  kubevirt.io/latest-observed-api-version: v1alpha3
              kubevirt.io/storage-observed-api-version: v1alpha3
API Version:  kubevirt.io/v1alpha3
Kind:         VirtualMachineInstance
Metadata:
  Creation Timestamp:  2021-04-01T16:44:06Z
  Finalizers:
    foregroundDeleteVirtualMachine
  Generation:  16
  Managed Fields:
    API Version:  kubevirt.io/v1alpha3
    Fields Type:  FieldsV1
    fieldsV1:
      f:metadata:
        f:annotations:
          .:
          f:kubevirt.io/latest-observed-api-version:
          f:kubevirt.io/storage-observed-api-version:
        f:labels:
          .:
          f:kubevirt.io/domain:
          f:kubevirt.io/nodeName:
          f:kubevirt.io/size:
          f:kubevirt.io/vm:
        f:ownerReferences:
      f:spec:
        .:
        f:domain:
          .:
          f:cpu:
            .:
            f:cores:
            f:model:
            f:sockets:
            f:threads:
          f:devices:
            .:
            f:disks:
            f:interfaces:
            f:networkInterfaceMultiqueue:
            f:rng:
          f:firmware:
            .:
            f:uuid:
          f:machine:
            .:
            f:type:
          f:resources:
            .:
            f:requests:
              .:
              f:memory:
        f:networks:
        f:terminationGracePeriodSeconds:
        f:volumes:
      f:status:
        .:
        f:activePods:
          .:
          f:56f3a14e-4f26-4457-90d6-d0788fed9c39:
        f:guestOSInfo:
        f:nodeName:
        f:qosClass:
    Manager:      virt-controller
    Operation:    Update
    Time:         2021-04-01T16:45:09Z
    API Version:  kubevirt.io/v1alpha3
    Fields Type:  FieldsV1
    fieldsV1:
      f:status:
        f:conditions:
        f:guestOSInfo:
          f:id:
          f:kernelRelease:
          f:kernelVersion:
          f:name:
          f:prettyName:
          f:version:
          f:versionId:
        f:interfaces:
        f:migrationMethod:
        f:phase:
        f:volumeStatus:
    Manager:    virt-handler
    Operation:  Update
    Time:       2021-04-01T16:50:48Z
  Owner References:
    API Version:           kubevirt.io/v1alpha3
    Block Owner Deletion:  true
    Controller:            true
    Kind:                  VirtualMachine
    Name:                  rhel-8-2-1617295444-2900226
    UID:                   27bfadf0-aa33-4856-b75d-73de05a056a5
  Resource Version:        3242957
  Self Link:               /apis/kubevirt.io/v1alpha3/namespaces/ssp-supported-os-common-templates-rhel-test-rhel-os-support/virtualmachineinstances/rhel-8-2-1617295444-2900226
  UID:                     572ae522-a328-4a47-a98c-9692fd976d99
Spec:
  Domain:
    Cpu:
      Cores:    1
      Model:    Broadwell-IBRS
      Sockets:  1
      Threads:  1
    Devices:
      Disks:
        Disk:
          Bus:  virtio
        Name:   rhel-8-2-1617295444-2900226
        Disk:
          Bus:  virtio
        Name:   cloudinitdisk
      Interfaces:
        Mac Address:  02:33:01:00:00:09
        Masquerade:
        Name:                        default
      Network Interface Multiqueue:  true
      Rng:
    Features:
      Acpi:
        Enabled:  true
    Firmware:
      Uuid:  f31566eb-2cb3-5e02-83e0-c75371342d71
    Machine:
      Type:  pc-q35-rhel8.3.0
    Resources:
      Requests:
        Cpu:     100m
        Memory:  1536Mi
  Networks:
    Name:  default
    Pod:
  Termination Grace Period Seconds:  180
  Volumes:
    Data Volume:
      Name:  rhel-8-2-1617295444-2900226
    Name:    rhel-8-2-1617295444-2900226
    Cloud Init No Cloud:
      User Data:  #cloud-config
user: cloud-user
password: redhat
chpasswd: { expire: False }
    Name:  cloudinitdisk
Status:
  Active Pods:
    56f3a14e-4f26-4457-90d6-d0788fed9c39:  ruty-2-5-5-p-gbdmn-worker-0-zrts4
  Conditions:
    Last Probe Time:       <nil>
    Last Transition Time:  <nil>
    Message:               cannot migrate VMI: PVC rhel-8-2-1617295444-2900226 is not shared, live migration requires that all PVCs must be shared (using ReadWriteMany access mode)
    Reason:                DisksNotLiveMigratable
    Status:                False
    Type:                  LiveMigratable
    Last Probe Time:       <nil>
    Last Transition Time:  2021-04-01T16:45:06Z
    Status:                True
    Type:                  Ready
    Last Probe Time:       2021-04-01T16:45:58Z
    Last Transition Time:  <nil>
    Status:                True
    Type:                  AgentConnected
  Guest OS Info:
    Id:              rhel
    Kernel Release:  4.18.0-193.35.1.el8_2.x86_64
    Kernel Version:  #1 SMP Tue Nov 24 05:22:39 EST 2020
    Name:            Red Hat Enterprise Linux
    Pretty Name:     Red Hat Enterprise Linux 8.2 (Ootpa)
    Version:         8.2
    Version Id:      8.2
  Interfaces:
    Interface Name:  eth0
    Ip Address:      10.129.2.255
    Ip Addresses:
      10.129.2.255
    Mac:             02:33:01:00:00:09
    Name:            default
  Migration Method:  BlockMigration
  Node Name:         ruty-2-5-5-p-gbdmn-worker-0-zrts4
  Phase:             Running
  Qos Class:         Burstable
  Volume Status:
    Name:    cloudinitdisk
    Target:  vdb
    Name:    rhel-8-2-1617295444-2900226
    Target:  vda
Events:
  Type    Reason            Age                     From                       Message
  ----    ------            ----                    ----                       -------
  Normal  SuccessfulCreate  9m24s                   virtualmachine-controller  Created virtual machine pod virt-launcher-rhel-8-2-1617295444-2900226-d6z5p
  Normal  SuccessfulDelete  9m24s                   virtualmachine-controller  Deleted temporary pod virt-launcher-rhel-8-2-1617295444-2900226-d6z5p
  Normal  SuccessfulCreate  8m28s                   virtualmachine-controller  Created virtual machine pod virt-launcher-rhel-8-2-1617295444-2900226-4nmbh
  Normal  Started           8m22s                   virt-handler               VirtualMachineInstance started.
  Normal  Created           2m13s (x16 over 8m22s)  virt-handler               VirtualMachineInstance defined.
===============================

  Guest OS Info:
  Interfaces:
    Interface Name:  eth0
    Ip Address:      10.129.2.255
    Ip Addresses:
      10.129.2.255
    Mac:             02:33:01:00:00:09
    Name:            default
  Migration Method:  BlockMigration
  Node Name:         ruty-2-5-5-p-gbdmn-worker-0-zrts4
  Phase:             Running
  Qos Class:         Burstable
  Volume Status:
    Name:    cloudinitdisk
    Target:  vdb
    Name:    rhel-8-2-1617295444-2900226
    Target:  vda
Events:
  Type    Reason            Age                   From                       Message
  ----    ------            ----                  ----                       -------
  Normal  SuccessfulCreate  10m                   virtualmachine-controller  Created virtual machine pod virt-launcher-rhel-8-2-1617295444-2900226-d6z5p
  Normal  SuccessfulDelete  10m                   virtualmachine-controller  Deleted temporary pod virt-launcher-rhel-8-2-1617295444-2900226-d6z5p
  Normal  SuccessfulCreate  9m44s                 virtualmachine-controller  Created virtual machine pod virt-launcher-rhel-8-2-1617295444-2900226-4nmbh
  Normal  Started           9m38s                 virt-handler               VirtualMachineInstance started.
  Normal  Created           23s (x18 over 9m38s)  virt-handler               VirtualMachineInstance defined.

===============================
$ sudo systemctl status qemu-guest-agent
● qemu-guest-agent.service - QEMU Guest Agent
   Loaded: loaded (/usr/lib/systemd/system/qemu-guest-agent.service; disabled; vendor preset: enabled)
   Active: active (running) since Thu 2021-04-01 16:45:58 UTC; 5min ago
 Main PID: 820 (qemu-ga)
    Tasks: 1 (limit: 8008)
   Memory: 1.8M
   CGroup: /system.slice/qemu-guest-agent.service
           └─820 /usr/bin/qemu-ga --method=virtio-serial --path=/dev/virtio-ports/org.qemu.guest_agent.0 --blacklist=guest-file-open,guest-file-close,guest-file-read,guest-file-write,guest-file-seek,guest-file-flush,guest-exec,guest-exe>

Apr 01 16:45:58 localhost systemd[1]: Started QEMU Guest Agent.

===============================

Comment 1 Ruth Netser 2021-04-01 17:07:19 UTC
Created attachment 1768305 [details]
virt-launcher log

Comment 2 Ruth Netser 2021-04-01 17:08:19 UTC
Created attachment 1768306 [details]
virt-handler log

Comment 3 Kedar Bidarkar 2021-04-05 12:10:46 UTC
This bug appears to be a duplicate of https://bugzilla.redhat.com/show_bug.cgi?id=1924479

Comment 4 Kedar Bidarkar 2021-04-05 12:26:02 UTC
But yeah this bug is raised for CNV-2.6.1

Comment 7 Antonio Cardace 2021-05-14 09:31:18 UTC
PR https://github.com/kubevirt/kubevirt/pull/5560 has been merged to master.

Comment 12 Antonio Cardace 2021-06-10 13:39:06 UTC
This is still waiting for an '/approve' to make it into 0.36.

Comment 13 Antonio Cardace 2021-06-18 06:50:46 UTC
https://github.com/kubevirt/kubevirt/pull/5655 got merged into 0.36, moving to MODIFIED.

Comment 14 zhe peng 2021-07-16 11:41:21 UTC
verify with build:
virt-operator-container-v2.6.6-5 
hco-bundle-registry-container-v2.6.6-35

step:
1. create a rhel8 vm from template
2. check guestosinfo via virtctl
$ virtctl guestosinfo rhel84
"hostname": "rhel84",
  "os": {
    "name": "Red Hat Enterprise Linux",
    "kernelRelease": "4.18.0-317.el8.kpq1.x86_64",
    "version": "8.5 (Ootpa)",
    "prettyName": "Red Hat Enterprise Linux 8.5 Beta (Ootpa)",
    "versionId": "8.5",
    "kernelVersion": "#1 SMP Wed Jun 23 13:33:27 EDT 2021",
    "machine": "x86_64",
    "id": "rhel"
  },
check guestosinfo via oc cmd
$ oc describe vmi rhel84 -n default | grep -A 15 "Guest OS Info"
  Guest OS Info:
    Id:              rhel
    Kernel Release:  4.18.0-317.el8.kpq1.x86_64
    Kernel Version:  #1 SMP Wed Jun 23 13:33:27 EDT 2021
    Name:            Red Hat Enterprise Linux
    Pretty Name:     Red Hat Enterprise Linux 8.5 Beta (Ootpa)
    Version:         8.5
    Version Id:      8.5
  Interfaces:
    Interface Name:  eth0
    Ip Address:      10.128.3.216
    Ip Addresses:
      10.128.3.216
    Mac:             52:54:00:06:be:07
    Name:            default
  Migration Method:  BlockMigration
let the vm running > 24hours
$ oc get vmi
NAME     AGE   PHASE     IP             NODENAME
rhel84   27h   Running   10.129.2.118   virt03-t27tv-worker-0-rn458

check guestosinfo again using oc cmd and virtctl, it's same with first time, can get full guest info

3. run live migration, after migration finished, check guestosinfo again
can get correct info from virtctl and oc cmd
move to verified.

Comment 19 errata-xmlrpc 2021-08-10 17:33:37 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: OpenShift Virtualization 2.6.6 Images security and bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2021:3119


Note You need to log in before you can comment on or make changes to this bug.