Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1878129

Summary:	MCO ClusterOperator resource does reference Nodes as relatedObjects
Product:	OpenShift Container Platform	Reporter:	Tomáš Nožička <tnozicka>
Component:	Machine Config Operator	Assignee:	Antonio Murdaca <amurdaca>
Status:	CLOSED ERRATA	QA Contact:	Michael Nguyen <mnguyen>
Severity:	medium	Docs Contact:
Priority:	high
Version:	4.6	CC:	aos-bugs, deads, jokerman, kgarriso, miabbott, walters
Target Milestone:	---
Target Release:	4.6.0
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2020-10-27 16:40:10 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Tomáš Nožička 2020-09-11 12:17:39 UTC

When running `oc adm inspect clusteroperators` (subset of must-gather) Nodes and CSRs aren't collected.

In order to collect them, the responsible (owning) operator has to reference them in relatedObjects in their ClusterOperator.config.openshift.io CR.

The logical owner for CSRs and Nodes is machine-api.

Having Nodes collected is essential for debugging scheduling and pod issues. CSRs are essential for debugging certificate and kubelet issues.

This should make it to LTS.

Comment 1 Alberto 2020-09-11 12:39:25 UTC

>The logical owner for CSRs and Nodes is machine-api.

Although boundaries are blurry the machine API main domain scope is infrastructure management. Either CSRs and nodes belong to kubelet lifecycle, they don't need the machine API to exist, it is complementary see e.g multiple UPI scenarios.

CSRs are collected via machine-approver clusteroperator. A Node does not need a machine resource to exist in OCP. We can include nodes in the machine API related objects as an additional nice to have but I think the most appropriate component for this is the machine-config which existence is necessary and tied to the node lifecycle. Moving to MCO for then to consider include nodes in the machine-config related objects.

Comment 2 David Eads 2020-09-11 13:19:56 UTC

The machine API owns the controller that approves CSRs.  Since approval has been our first area of concern, it seems reasonable to have the operator that owns the approver provide the reference.

Comment 3 Kirsten Garrison 2020-09-11 19:24:47 UTC

This doesn't seem to fit well within the MCO machine-config related objects as the MCO is not related to approving CSR or troubleshooting CSR approval.. Seems like this should live in machine API or elsewhere. Looping in Node team as they along with machine-api are closer to CSR approval than MCO.

Comment 4 Seth Jennings 2020-09-11 19:55:24 UTC

Node team manages no components with clusteroperators, thus we can not resolve either of these (referencing CSRs or Nodes).

This is also not trivial to handle in a bug.  We are talking about adding a new controller to an operator.

Basically either the machine-api-operator or MCO would have add a new controller that watched for new Nodes and CSRs and added/removed them to the related objects in their clusteroperator resource.

This bug should likely be broken up into two bugs: one for CSR and one for Nodes.

I'm going to scope this one down the Nodes, which, in my mind, falls to the MCO.  CSRs probably shouldn't because MCO has never been CSR aware.  Reporter might open a separate bug for machine-approver to reference CSRs and assign to machine-api.

Sending this one back to MCO.  They might want to make a Jira out of this.  Don't see this making 4.6.0.

Comment 6 Colin Walters 2020-09-11 20:23:58 UTC

Nodes are a fundamental resource, shouldn't they just be collected by default?  I see the elegance of having them referenced, but still...

As far as CSRs...right, hmm.  machineAPI is optional, so we can't rely on it for collecting.

I imagine collecting CSRs would be particularly important in the UPI scenarios without machineAPI.  

It's completely correct that today the MCO has nothing to do with CSRs, however https://github.com/openshift/enhancements/pull/443 touches on the point that ultimately we probably want just one mechanism to authenticate nodes.  Particularly if the MCO manages per-machine secrets injected then CSR approval can be *much* stricter and more reliable.

It certainly seems like a big jump today to have the MCO watch CSRs if it's not actually doing anything with them.

So short term...hardcode nodes and csrs for collection?

Comment 7 David Eads 2020-09-14 13:13:21 UTC

Maybe you're misunderstanding the details of how data collection happens.  The request to merge PRs like https://github.com/openshift/machine-config-operator/pull/2081 and https://github.com/openshift/machine-api-operator/pull/700.

I don't think a card is necessary and it would be a real shame to push this out of 4.7 because we couldn't connect the dots.

Comment 8 Seth Jennings 2020-09-14 14:00:07 UTC

I did misunderstand.  I thought the relatedObjects referenced actual individual objects, not whole group-kinds.

Owning teams for the operators that would need changed are the same though.

Comment 10 Micah Abbott 2020-09-19 19:04:17 UTC

Verified with 4.6.0-0.nightly-2020-09-19-060512 

```
$ oc get clusterversion                                                                            
NAME      VERSION                             AVAILABLE   PROGRESSING   SINCE   STATUS
version   4.6.0-0.nightly-2020-09-19-060512   True        False         13m     Cluster version is 4.6.0-0.nightly-2020-09-19-060512

$ oc get co/machine-config -o json | jq .status.relatedObjects                                                                                                                                                                                                    
[                     
  {                                                          
    "group": "",                                                                                                                                               
    "name": "openshift-machine-config-operator",                                                                                                                                                                                                                                                                              
    "resource": "namespaces"       
  },                                       
  {                                       
    "group": "machineconfiguration.openshift.io",            
    "name": "",                                                           
    "resource": "machineconfigpools"                                        
  },                                 
  {                                                 
    "group": "machineconfiguration.openshift.io",
    "name": "",                                    
    "resource": "controllerconfigs"                                                                                                                            
  },                                                                                                                                                           
  {                                      
    "group": "machineconfiguration.openshift.io",
    "name": "",                    
    "resource": "kubeletconfigs"          
  },                                                                                                                                                           
  {                                                                                                                                                            
    "group": "machineconfiguration.openshift.io",
    "name": "",           
    "resource": "containerruntimeconfigs"                                                                                                                      
  },                                                     
  {                                               
    "group": "machineconfiguration.openshift.io",     
    "name": "",                       
    "resource": "machineconfigs"                             
  },                                                                                                                                                           
  {                                            
    "group": "",                                       
    "name": "",                                
    "resource": "nodes"                                      
  }                                                
]                                              

$ ls ./cluster-scoped-resources/core/nodes                        
ci-ln-j3tbpx2-f76d1-lrx8m-master-0.yaml  ci-ln-j3tbpx2-f76d1-lrx8m-master-1.yaml  ci-ln-j3tbpx2-f76d1-lrx8m-master-2.yaml  ci-ln-j3tbpx2-f76d1-lrx8m-worker-b-25cc7.yaml  ci-ln-j3tbpx2-f76d1-lrx8m-worker-c-pvg2x.yaml  ci-ln-j3tbpx2-f76d1-lrx8m-worker-d-zs8jq.yaml
[miabbott@toolbox (container) ~/openshift-cluster-installs/inspect.local.7518956659735043563 ]$ cat ./cluster-scoped-resources/core/nodes/ci-ln-j3tbpx2-f76d1-lrx8m-master-0.yaml
---                                                                                                                                                            
apiVersion: v1                                                    
kind: Node                                                                                                                                                     
metadata:                                                         
  annotations:                                                                                                                                                 
    machine.openshift.io/machine: openshift-machine-api/ci-ln-j3tbpx2-f76d1-lrx8m-master-0
    machineconfiguration.openshift.io/currentConfig: rendered-master-9d39db7fc2ec3a03099836ae174057df                                                          
    machineconfiguration.openshift.io/desiredConfig: rendered-master-9d39db7fc2ec3a03099836ae174057df
    machineconfiguration.openshift.io/reason: ""
    machineconfiguration.openshift.io/state: Done
    volumes.kubernetes.io/controller-managed-attach-detach: "true"
  creationTimestamp: "2020-09-19T17:37:39Z"
  labels:
    beta.kubernetes.io/arch: amd64
    beta.kubernetes.io/instance-type: n1-standard-4
    beta.kubernetes.io/os: linux
    failure-domain.beta.kubernetes.io/region: us-east1
    failure-domain.beta.kubernetes.io/zone: us-east1-b
    kubernetes.io/arch: amd64
    kubernetes.io/hostname: ci-ln-j3tbpx2-f76d1-lrx8m-master-0
    kubernetes.io/os: linux
    node-role.kubernetes.io/master: ""
    node.kubernetes.io/instance-type: n1-standard-4
    node.openshift.io/os_id: rhcos
    topology.kubernetes.io/region: us-east1
    topology.kubernetes.io/zone: us-east1-b
  managedFields:
  - apiVersion: v1
    fieldsType: FieldsV1
    fieldsV1:
      f:status:
        f:conditions:
          k:{"type":"NetworkUnavailable"}:
            f:lastTransitionTime: {}
            f:message: {}
            f:reason: {}
            f:status: {}
    manager: openshift-sdn-controller
    operation: Update
    time: "2020-09-19T17:38:36Z"
  - apiVersion: v1
    fieldsType: FieldsV1
    fieldsV1:
      f:metadata:
        f:labels:
          f:beta.kubernetes.io/arch: {}
          f:beta.kubernetes.io/os: {}
      f:spec:
        f:podCIDR: {}
        f:podCIDRs:
          .: {}
          v:"10.128.1.0/24": {}
        f:taints: {}
    manager: kube-controller-manager
    operation: Update                                                                                                                                          
    time: "2020-09-19T17:38:49Z"                                  
  - apiVersion: v1                                                                                                                                             
    fieldsType: FieldsV1                                          
    fieldsV1:                                                                                                                                                  
      f:metadata:                                                        
        f:annotations:                                                                                                                                         
          f:machineconfiguration.openshift.io/currentConfig: {}                                                                                                                                                                                                                                                               
          f:machineconfiguration.openshift.io/desiredConfig: {}                                                                                                
          f:machineconfiguration.openshift.io/reason: {}                                                                                                       
          f:machineconfiguration.openshift.io/state: {}                                                                                                                                                                                                                                                                       
    manager: machine-config-daemon                                                                                                                             
    operation: Update                                                                                                                                          
    time: "2020-09-19T17:39:55Z"                                                                                                                                                                                                                                                                                              
  - apiVersion: v1                                                                                                                                                                                                                                                                                                            
    fieldsType: FieldsV1                                                                                                                                                                                                                                                                                                      
    fieldsV1:                                                                                                                                                  
      f:metadata:                                                 
        f:annotations:                                                                                                                                         
          f:machine.openshift.io/machine: {}                      
    manager: nodelink-controller                                                                                                                               
    operation: Update                                                                                                                                          
    time: "2020-09-19T17:46:33Z"                                                                                                                               
  - apiVersion: v1                                                                                                                                             
    fieldsType: FieldsV1                        
    fieldsV1:                                    
      f:metadata:                                                 
        f:annotations:                     
          .: {}
          f:volumes.kubernetes.io/controller-managed-attach-detach: {}
        f:labels:                                  
          .: {}                 
          f:beta.kubernetes.io/instance-type: {}      
          f:failure-domain.beta.kubernetes.io/region: {}
          f:failure-domain.beta.kubernetes.io/zone: {}
          f:kubernetes.io/arch: {}                            
          f:kubernetes.io/hostname: {}
          f:kubernetes.io/os: {}      
          f:node-role.kubernetes.io/master: {}     
          f:node.kubernetes.io/instance-type: {}
          f:node.openshift.io/os_id: {}    
          f:topology.kubernetes.io/region: {}
          f:topology.kubernetes.io/zone: {}
      f:spec:     
        f:providerID: {}
      f:status:
        f:addresses:
          .: {}      
          k:{"type":"Hostname"}:          
            .: {}                   
            f:address: {}
            f:type: {}  
          k:{"type":"InternalDNS"}:
            .: {}                    
            f:address: {}
            f:type: {}          
          k:{"type":"InternalIP"}:
            .: {}       
            f:address: {}
            f:type: {}
        f:allocatable:
          .: {}                        
          f:attachable-volumes-gce-pd: {}
          f:cpu: {}
          f:ephemeral-storage: {}
          f:hugepages-1Gi: {}
          f:hugepages-2Mi: {}
          f:memory: {}         
          f:pods: {}
        f:capacity:                 
          .: {}      
          f:attachable-volumes-gce-pd: {}
          f:cpu: {}
          f:ephemeral-storage: {}
          f:hugepages-1Gi: {}
          f:hugepages-2Mi: {}
          f:memory: {}
          f:pods: {}
        f:conditions:
          .: {}
          k:{"type":"DiskPressure"}:
            .: {}
            f:lastHeartbeatTime: {}
            f:lastTransitionTime: {}
            f:message: {}
            f:reason: {}
            f:status: {}
            f:type: {}
          k:{"type":"MemoryPressure"}:
            .: {}
            f:lastHeartbeatTime: {}
            f:lastTransitionTime: {}
            f:message: {}
            f:reason: {}
            f:status: {}
            f:type: {}
          k:{"type":"NetworkUnavailable"}:
            .: {}
            f:lastHeartbeatTime: {}
            f:type: {}
          k:{"type":"PIDPressure"}:
            .: {}
            f:lastHeartbeatTime: {}
            f:lastTransitionTime: {}
            f:message: {}
            f:reason: {}
            f:status: {}
            f:type: {}
          k:{"type":"Ready"}:
            .: {}
            f:lastHeartbeatTime: {}
            f:lastTransitionTime: {}
            f:message: {}
            f:reason: {}
            f:status: {}
            f:type: {}
        f:daemonEndpoints:
          f:kubeletEndpoint:
            f:Port: {}
        f:images: {}
        f:nodeInfo:
          f:architecture: {}
          f:bootID: {}
          f:containerRuntimeVersion: {}
          f:kernelVersion: {}
          f:kubeProxyVersion: {}
          f:kubeletVersion: {}
          f:machineID: {}
          f:operatingSystem: {}
          f:osImage: {}
          f:systemUUID: {}
    manager: kubelet
    operation: Update
    time: "2020-09-19T18:40:08Z"
  name: ci-ln-j3tbpx2-f76d1-lrx8m-master-0
  resourceVersion: "64364"
  selfLink: /api/v1/nodes/ci-ln-j3tbpx2-f76d1-lrx8m-master-0
  uid: 8fd89fee-9938-4129-86b3-861c6d38e799
spec:
  podCIDR: 10.128.1.0/24
  podCIDRs:
  - 10.128.1.0/24
  providerID: gce://openshift-gce-devel-ci/us-east1-b/ci-ln-j3tbpx2-f76d1-lrx8m-master-0
  taints:
  - effect: NoSchedule
    key: node-role.kubernetes.io/master
status:
  addresses:
  - address: 10.0.0.3
    type: InternalIP
  - address: ci-ln-j3tbpx2-f76d1-lrx8m-master-0.c.openshift-gce-devel-ci.internal
    type: InternalDNS
  - address: ci-ln-j3tbpx2-f76d1-lrx8m-master-0.c.openshift-gce-devel-ci.internal
    type: Hostname
  allocatable:
    attachable-volumes-gce-pd: "127"
    cpu: 3500m
    ephemeral-storage: "122112633448"
    hugepages-1Gi: "0"
    hugepages-2Mi: "0"
    memory: 14235176Ki
    pods: "250"
  capacity:
    attachable-volumes-gce-pd: "127"
    cpu: "4"
    ephemeral-storage: 133665772Ki
    hugepages-1Gi: "0"
    hugepages-2Mi: "0"
    memory: 15386152Ki
    pods: "250"
  conditions:
  - lastHeartbeatTime: null
    lastTransitionTime: "2020-09-19T17:38:36Z"
    message: openshift-sdn cleared kubelet-set NoRouteCreated
    reason: RouteCreated
    status: "False"
    type: NetworkUnavailable
  - lastHeartbeatTime: "2020-09-19T18:40:08Z"
    lastTransitionTime: "2020-09-19T17:37:39Z"
    message: kubelet has sufficient memory available
    reason: KubeletHasSufficientMemory
    status: "False"
    type: MemoryPressure
  - lastHeartbeatTime: "2020-09-19T18:40:08Z"
    lastTransitionTime: "2020-09-19T17:37:39Z"
    message: kubelet has no disk pressure
    reason: KubeletHasNoDiskPressure
    status: "False"
    type: DiskPressure
  - lastHeartbeatTime: "2020-09-19T18:40:08Z"
    lastTransitionTime: "2020-09-19T17:37:39Z"
    message: kubelet has sufficient PID available
    reason: KubeletHasSufficientPID
    status: "False"
    type: PIDPressure
  - lastHeartbeatTime: "2020-09-19T18:40:08Z"
    lastTransitionTime: "2020-09-19T17:38:49Z"
    message: kubelet is posting ready status
    reason: KubeletReady
    status: "True"
    type: Ready
  daemonEndpoints:
    kubeletEndpoint:
      Port: 10250
  images:
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ac6f78cac5f98b75fb5f72f7e4022ab1b78a310da805c262a7fb8f67f61cc610
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 766485750
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f2341034a0068fc68d5d0c07aadc1eaf9637705e28a5e554884d94f3a6a0345f
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 575554256
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fa0d27e509cc4da24a98f6574c6d1e64e0651771209f2956151e83a5a709fd3e
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 564634661
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf9aa22cf64066b40fda9160910c6007bfc112d29b88a4738243a22babe79e2c
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 543257035
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:757ee6ee9962b7f93b6265a3c5bd9bb6a688b9f9ae987b567843ebce54a45124
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 489294054
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:df79c728167a734b917f5375583b3ee7bdf1e399ae7c0ab406932f257eda7efc
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 438083306
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:01af62a0ccf704509b0211dd777062c74fb7243af5cc6d997ab0e7f8e55266e5
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 427883966
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b7ff0798116e171fadef70a03d2ebb5fe5d726a8c0ce74f57abfb7c17f1083d9
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 401865245
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46469ec9c6a1263579b1ff41fe74dd90428be9ea2ccc150a5514e026fd7eccf0
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 399909626
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea52263935862977469f137d4468189918fdc0f81e9a882c6157f44fa5db48bc
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 399724858
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5acc93e13013e960d1040131eba089f6add0677ca2bfe2c8efa60a0038aced5b
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 398995285
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7f925d26ddbde12a36a8912f4f4d39e55a90b4ee9878bdb37a255cd2bd0e3f38
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 398094604
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d475adf3c4fc0a84df9e9bd9d83cd0f967ce4cb75b0fdcf02204c21965ca619f
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 397584902
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:42f93f7952edb3c27942acb8f752fc7eff81b88e27d22227f862b274ca1b54a5
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 396093032
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a7343b3a855dfc7216fe0d08906afd0de6c9c6ad8e4c1da687c2e34d5e477e55
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 387899465
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be37b432c7d20d1eead866f9de33d711d0e4fee27defb98959994b9c6c37700d
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 379583126
  - names:
    - registry.svc.ci.openshift.org/ocp/release@sha256:0e7c779d96fd0e416ff221beef102e4c5bee7ce2b4c5ce60cf5683a3ff18cd15
    - registry.svc.ci.openshift.org/ocp/release@sha256:<none>
    sizeBytes: 379312911
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b68f3af766c58bfc473d2a8fbfdd6432317935069803b98a35d82e7a9b91ca1
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 378957684
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:061a804d4dc76e97011e5a2515f6431e682a9a3dd3179af5cd290ece4c683173
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 378720472
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6c2c544b085e3d879b07d505cb958f36903dc0376a243ba0489212d83947c311
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 377768726
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3f520b364ec86a7573eb821a23d0ecae18841badb6dd932cc14a7b8708d7334
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 377740229
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87397484515b79242def3f9bee7640f64af3de8ab8c336e61f0e1c743b19ac64
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 376578310
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6ed9c3be4b5a9b3b9ea89443306332e9762f0c6b9aa8964a23a09a42392e8663
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 375933647
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4db4309b3f38ea8833b4150154626c550798b88a78fc4984d9b5082471c2af7d
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 375701815
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:54fa7b8601549e01a6be170da86406d4e11d7d38b9514537bcf4a0fbc570d71f
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 375696051
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0ca58e526831f1ed86d7e9e4c1b5781b77a326dfe7416f718fe99c32087981b1
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 375492722
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:006e408bdae7b8aebecbb322bc6124b4720c769287591542487b6ed097946e1f
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 374514002
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4226dcece07a0ce366135e2e1c614dbfea929c7a75e87bc7f74756fec15bfa83
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 373029679
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7369f5f756e20ca732cb3f17a784e043c0bda528cbf093c4988135aa5403f527
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 372381483
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4ef7f1aca9e8170f42586f6ae772345734b6eaf11b3930d18f4d937d2df1a609
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 367447584
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b297ad75b73923998dc338e53013035750089772a82defb121f63a16fb2dcf27
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 365261463
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06d8856491a7dbec30802d6913f868c911afcf01ec7903fa07afbd6a2f0817dc
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 363723458
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f33e9e26fe0d231b13f3271caa812afe68fc1d3d07b022d2d052bfd9846bc4d8
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 362491432
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bfdcd009214a75bab87136d21e5085bc9d79a9a0bfddbfbbb2be070361b7820e
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 361558287
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fa952e488a6b8251ac6f0a644b5f9a726961eecfaf58c9a30faeda864c599ea2
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 341923646
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:70a88050d9c755137378b8a8618bb42b35e78397b9d044986aa3ba72aae97077
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 324347415
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:565ae112fa2b958c9a19f4ac8eaf156ecf9b30f857da2a738ee7a57dd0de640c
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 266807346
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2399db45d4377ef930a27120d25d3b9c015993f6c475d23e17077f542b4e4a4d
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 248345003
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2b9e543cc3941ffd89218544cf8de2a7b9b720ecc930a4afabfa08682422e145
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 236846914
  nodeInfo:
    architecture: amd64
    bootID: 3d30df9c-09f2-4e06-a951-abb275309153
    containerRuntimeVersion: cri-o://1.19.0-18.rhaos4.6.gitd802e19.el8
    kernelVersion: 4.18.0-193.23.1.el8_2.x86_64
    kubeProxyVersion: v1.19.0+7f9e863
    kubeletVersion: v1.19.0+7f9e863
    machineID: 98d84a8fb89240c7be4202b5e09fb9ea
    operatingSystem: linux
    osImage: Red Hat Enterprise Linux CoreOS 46.82.202009182140-0 (Ootpa)
    systemUUID: 98d84a8f-b892-40c7-be42-02b5e09fb9ea
```

Comment 13 errata-xmlrpc 2020-10-27 16:40:10 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.6 GA Images), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:4196