Bug 1878129 - MCO ClusterOperator resource does reference Nodes as relatedObjects
Summary: MCO ClusterOperator resource does reference Nodes as relatedObjects
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Machine Config Operator
Version: 4.6
Hardware: Unspecified
OS: Unspecified
high
medium
Target Milestone: ---
: 4.6.0
Assignee: Antonio Murdaca
QA Contact: Michael Nguyen
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-09-11 12:17 UTC by Tomáš Nožička
Modified: 2020-10-27 16:40 UTC (History)
6 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-10-27 16:40:10 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github openshift machine-config-operator pull 2081 0 None closed bug 1878129: add node collection for oc adm inspect 2020-09-23 17:09:30 UTC
Red Hat Product Errata RHBA-2020:4196 0 None None None 2020-10-27 16:40:24 UTC

Description Tomáš Nožička 2020-09-11 12:17:39 UTC 
When running `oc adm inspect clusteroperators` (subset of must-gather) Nodes and CSRs aren't collected.

In order to collect them, the responsible (owning) operator has to reference them in relatedObjects in their ClusterOperator.config.openshift.io CR.

The logical owner for CSRs and Nodes is machine-api.

Having Nodes collected is essential for debugging scheduling and pod issues. CSRs are essential for debugging certificate and kubelet issues.

This should make it to LTS.
Comment 1 Alberto 2020-09-11 12:39:25 UTC 
>The logical owner for CSRs and Nodes is machine-api.

Although boundaries are blurry the machine API main domain scope is infrastructure management. Either CSRs and nodes belong to kubelet lifecycle, they don't need the machine API to exist, it is complementary see e.g multiple UPI scenarios.

CSRs are collected via machine-approver clusteroperator. A Node does not need a machine resource to exist in OCP. We can include nodes in the machine API related objects as an additional nice to have but I think the most appropriate component for this is the machine-config which existence is necessary and tied to the node lifecycle. Moving to MCO for then to consider include nodes in the machine-config related objects.
Comment 2 David Eads 2020-09-11 13:19:56 UTC 
The machine API owns the controller that approves CSRs.  Since approval has been our first area of concern, it seems reasonable to have the operator that owns the approver provide the reference.
Comment 3 Kirsten Garrison 2020-09-11 19:24:47 UTC 
This doesn't seem to fit well within the MCO machine-config related objects as the MCO is not related to approving CSR or troubleshooting CSR approval.. Seems like this should live in machine API or elsewhere. Looping in Node team as they along with machine-api are closer to CSR approval than MCO.
Comment 4 Seth Jennings 2020-09-11 19:55:24 UTC 
Node team manages no components with clusteroperators, thus we can not resolve either of these (referencing CSRs or Nodes).

This is also not trivial to handle in a bug.  We are talking about adding a new controller to an operator.

Basically either the machine-api-operator or MCO would have add a new controller that watched for new Nodes and CSRs and added/removed them to the related objects in their clusteroperator resource.

This bug should likely be broken up into two bugs: one for CSR and one for Nodes.

I'm going to scope this one down the Nodes, which, in my mind, falls to the MCO.  CSRs probably shouldn't because MCO has never been CSR aware.  Reporter might open a separate bug for machine-approver to reference CSRs and assign to machine-api.

Sending this one back to MCO.  They might want to make a Jira out of this.  Don't see this making 4.6.0.
Comment 6 Colin Walters 2020-09-11 20:23:58 UTC 
Nodes are a fundamental resource, shouldn't they just be collected by default?  I see the elegance of having them referenced, but still...

As far as CSRs...right, hmm.  machineAPI is optional, so we can't rely on it for collecting.

I imagine collecting CSRs would be particularly important in the UPI scenarios without machineAPI.  

It's completely correct that today the MCO has nothing to do with CSRs, however https://github.com/openshift/enhancements/pull/443 touches on the point that ultimately we probably want just one mechanism to authenticate nodes.  Particularly if the MCO manages per-machine secrets injected then CSR approval can be *much* stricter and more reliable.

It certainly seems like a big jump today to have the MCO watch CSRs if it's not actually doing anything with them.

So short term...hardcode nodes and csrs for collection?
Comment 7 David Eads 2020-09-14 13:13:21 UTC 
Maybe you're misunderstanding the details of how data collection happens.  The request to merge PRs like https://github.com/openshift/machine-config-operator/pull/2081 and https://github.com/openshift/machine-api-operator/pull/700.

I don't think a card is necessary and it would be a real shame to push this out of 4.7 because we couldn't connect the dots.
Comment 8 Seth Jennings 2020-09-14 14:00:07 UTC 
I did misunderstand.  I thought the relatedObjects referenced actual individual objects, not whole group-kinds.

Owning teams for the operators that would need changed are the same though.
Comment 10 Micah Abbott 2020-09-19 19:04:17 UTC 
Verified with 4.6.0-0.nightly-2020-09-19-060512 

```
$ oc get clusterversion                                                                            
NAME      VERSION                             AVAILABLE   PROGRESSING   SINCE   STATUS
version   4.6.0-0.nightly-2020-09-19-060512   True        False         13m     Cluster version is 4.6.0-0.nightly-2020-09-19-060512

$ oc get co/machine-config -o json | jq .status.relatedObjects                                                                                                                                                                                                    
[                     
  {                                                          
    "group": "",                                                                                                                                               
    "name": "openshift-machine-config-operator",                                                                                                                                                                                                                                                                              
    "resource": "namespaces"       
  },                                       
  {                                       
    "group": "machineconfiguration.openshift.io",            
    "name": "",                                                           
    "resource": "machineconfigpools"                                        
  },                                 
  {                                                 
    "group": "machineconfiguration.openshift.io",
    "name": "",                                    
    "resource": "controllerconfigs"                                                                                                                            
  },                                                                                                                                                           
  {                                      
    "group": "machineconfiguration.openshift.io",
    "name": "",                    
    "resource": "kubeletconfigs"          
  },                                                                                                                                                           
  {                                                                                                                                                            
    "group": "machineconfiguration.openshift.io",
    "name": "",           
    "resource": "containerruntimeconfigs"                                                                                                                      
  },                                                     
  {                                               
    "group": "machineconfiguration.openshift.io",     
    "name": "",                       
    "resource": "machineconfigs"                             
  },                                                                                                                                                           
  {                                            
    "group": "",                                       
    "name": "",                                
    "resource": "nodes"                                      
  }                                                
]                                              

$ ls ./cluster-scoped-resources/core/nodes                        
ci-ln-j3tbpx2-f76d1-lrx8m-master-0.yaml  ci-ln-j3tbpx2-f76d1-lrx8m-master-1.yaml  ci-ln-j3tbpx2-f76d1-lrx8m-master-2.yaml  ci-ln-j3tbpx2-f76d1-lrx8m-worker-b-25cc7.yaml  ci-ln-j3tbpx2-f76d1-lrx8m-worker-c-pvg2x.yaml  ci-ln-j3tbpx2-f76d1-lrx8m-worker-d-zs8jq.yaml
[miabbott@toolbox (container) ~/openshift-cluster-installs/inspect.local.7518956659735043563 ]$ cat ./cluster-scoped-resources/core/nodes/ci-ln-j3tbpx2-f76d1-lrx8m-master-0.yaml
---                                                                                                                                                            
apiVersion: v1                                                    
kind: Node                                                                                                                                                     
metadata:                                                         
  annotations:                                                                                                                                                 
    machine.openshift.io/machine: openshift-machine-api/ci-ln-j3tbpx2-f76d1-lrx8m-master-0
    machineconfiguration.openshift.io/currentConfig: rendered-master-9d39db7fc2ec3a03099836ae174057df                                                          
    machineconfiguration.openshift.io/desiredConfig: rendered-master-9d39db7fc2ec3a03099836ae174057df
    machineconfiguration.openshift.io/reason: ""
    machineconfiguration.openshift.io/state: Done
    volumes.kubernetes.io/controller-managed-attach-detach: "true"
  creationTimestamp: "2020-09-19T17:37:39Z"
  labels:
    beta.kubernetes.io/arch: amd64
    beta.kubernetes.io/instance-type: n1-standard-4
    beta.kubernetes.io/os: linux
    failure-domain.beta.kubernetes.io/region: us-east1
    failure-domain.beta.kubernetes.io/zone: us-east1-b
    kubernetes.io/arch: amd64
    kubernetes.io/hostname: ci-ln-j3tbpx2-f76d1-lrx8m-master-0
    kubernetes.io/os: linux
    node-role.kubernetes.io/master: ""
    node.kubernetes.io/instance-type: n1-standard-4
    node.openshift.io/os_id: rhcos
    topology.kubernetes.io/region: us-east1
    topology.kubernetes.io/zone: us-east1-b
  managedFields:
  - apiVersion: v1
    fieldsType: FieldsV1
    fieldsV1:
      f:status:
        f:conditions:
          k:{"type":"NetworkUnavailable"}:
            f:lastTransitionTime: {}
            f:message: {}
            f:reason: {}
            f:status: {}
    manager: openshift-sdn-controller
    operation: Update
    time: "2020-09-19T17:38:36Z"
  - apiVersion: v1
    fieldsType: FieldsV1
    fieldsV1:
      f:metadata:
        f:labels:
          f:beta.kubernetes.io/arch: {}
          f:beta.kubernetes.io/os: {}
      f:spec:
        f:podCIDR: {}
        f:podCIDRs:
          .: {}
          v:"10.128.1.0/24": {}
        f:taints: {}
    manager: kube-controller-manager
    operation: Update                                                                                                                                          
    time: "2020-09-19T17:38:49Z"                                  
  - apiVersion: v1                                                                                                                                             
    fieldsType: FieldsV1                                          
    fieldsV1:                                                                                                                                                  
      f:metadata:                                                        
        f:annotations:                                                                                                                                         
          f:machineconfiguration.openshift.io/currentConfig: {}                                                                                                                                                                                                                                                               
          f:machineconfiguration.openshift.io/desiredConfig: {}                                                                                                
          f:machineconfiguration.openshift.io/reason: {}                                                                                                       
          f:machineconfiguration.openshift.io/state: {}                                                                                                                                                                                                                                                                       
    manager: machine-config-daemon                                                                                                                             
    operation: Update                                                                                                                                          
    time: "2020-09-19T17:39:55Z"                                                                                                                                                                                                                                                                                              
  - apiVersion: v1                                                                                                                                                                                                                                                                                                            
    fieldsType: FieldsV1                                                                                                                                                                                                                                                                                                      
    fieldsV1:                                                                                                                                                  
      f:metadata:                                                 
        f:annotations:                                                                                                                                         
          f:machine.openshift.io/machine: {}                      
    manager: nodelink-controller                                                                                                                               
    operation: Update                                                                                                                                          
    time: "2020-09-19T17:46:33Z"                                                                                                                               
  - apiVersion: v1                                                                                                                                             
    fieldsType: FieldsV1                        
    fieldsV1:                                    
      f:metadata:                                                 
        f:annotations:                     
          .: {}
          f:volumes.kubernetes.io/controller-managed-attach-detach: {}
        f:labels:                                  
          .: {}                 
          f:beta.kubernetes.io/instance-type: {}      
          f:failure-domain.beta.kubernetes.io/region: {}
          f:failure-domain.beta.kubernetes.io/zone: {}
          f:kubernetes.io/arch: {}                            
          f:kubernetes.io/hostname: {}
          f:kubernetes.io/os: {}      
          f:node-role.kubernetes.io/master: {}     
          f:node.kubernetes.io/instance-type: {}
          f:node.openshift.io/os_id: {}    
          f:topology.kubernetes.io/region: {}
          f:topology.kubernetes.io/zone: {}
      f:spec:     
        f:providerID: {}
      f:status:
        f:addresses:
          .: {}      
          k:{"type":"Hostname"}:          
            .: {}                   
            f:address: {}
            f:type: {}  
          k:{"type":"InternalDNS"}:
            .: {}                    
            f:address: {}
            f:type: {}          
          k:{"type":"InternalIP"}:
            .: {}       
            f:address: {}
            f:type: {}
        f:allocatable:
          .: {}                        
          f:attachable-volumes-gce-pd: {}
          f:cpu: {}
          f:ephemeral-storage: {}
          f:hugepages-1Gi: {}
          f:hugepages-2Mi: {}
          f:memory: {}         
          f:pods: {}
        f:capacity:                 
          .: {}      
          f:attachable-volumes-gce-pd: {}
          f:cpu: {}
          f:ephemeral-storage: {}
          f:hugepages-1Gi: {}
          f:hugepages-2Mi: {}
          f:memory: {}
          f:pods: {}
        f:conditions:
          .: {}
          k:{"type":"DiskPressure"}:
            .: {}
            f:lastHeartbeatTime: {}
            f:lastTransitionTime: {}
            f:message: {}
            f:reason: {}
            f:status: {}
            f:type: {}
          k:{"type":"MemoryPressure"}:
            .: {}
            f:lastHeartbeatTime: {}
            f:lastTransitionTime: {}
            f:message: {}
            f:reason: {}
            f:status: {}
            f:type: {}
          k:{"type":"NetworkUnavailable"}:
            .: {}
            f:lastHeartbeatTime: {}
            f:type: {}
          k:{"type":"PIDPressure"}:
            .: {}
            f:lastHeartbeatTime: {}
            f:lastTransitionTime: {}
            f:message: {}
            f:reason: {}
            f:status: {}
            f:type: {}
          k:{"type":"Ready"}:
            .: {}
            f:lastHeartbeatTime: {}
            f:lastTransitionTime: {}
            f:message: {}
            f:reason: {}
            f:status: {}
            f:type: {}
        f:daemonEndpoints:
          f:kubeletEndpoint:
            f:Port: {}
        f:images: {}
        f:nodeInfo:
          f:architecture: {}
          f:bootID: {}
          f:containerRuntimeVersion: {}
          f:kernelVersion: {}
          f:kubeProxyVersion: {}
          f:kubeletVersion: {}
          f:machineID: {}
          f:operatingSystem: {}
          f:osImage: {}
          f:systemUUID: {}
    manager: kubelet
    operation: Update
    time: "2020-09-19T18:40:08Z"
  name: ci-ln-j3tbpx2-f76d1-lrx8m-master-0
  resourceVersion: "64364"
  selfLink: /api/v1/nodes/ci-ln-j3tbpx2-f76d1-lrx8m-master-0
  uid: 8fd89fee-9938-4129-86b3-861c6d38e799
spec:
  podCIDR: 10.128.1.0/24
  podCIDRs:
  - 10.128.1.0/24
  providerID: gce://openshift-gce-devel-ci/us-east1-b/ci-ln-j3tbpx2-f76d1-lrx8m-master-0
  taints:
  - effect: NoSchedule
    key: node-role.kubernetes.io/master
status:
  addresses:
  - address: 10.0.0.3
    type: InternalIP
  - address: ci-ln-j3tbpx2-f76d1-lrx8m-master-0.c.openshift-gce-devel-ci.internal
    type: InternalDNS
  - address: ci-ln-j3tbpx2-f76d1-lrx8m-master-0.c.openshift-gce-devel-ci.internal
    type: Hostname
  allocatable:
    attachable-volumes-gce-pd: "127"
    cpu: 3500m
    ephemeral-storage: "122112633448"
    hugepages-1Gi: "0"
    hugepages-2Mi: "0"
    memory: 14235176Ki
    pods: "250"
  capacity:
    attachable-volumes-gce-pd: "127"
    cpu: "4"
    ephemeral-storage: 133665772Ki
    hugepages-1Gi: "0"
    hugepages-2Mi: "0"
    memory: 15386152Ki
    pods: "250"
  conditions:
  - lastHeartbeatTime: null
    lastTransitionTime: "2020-09-19T17:38:36Z"
    message: openshift-sdn cleared kubelet-set NoRouteCreated
    reason: RouteCreated
    status: "False"
    type: NetworkUnavailable
  - lastHeartbeatTime: "2020-09-19T18:40:08Z"
    lastTransitionTime: "2020-09-19T17:37:39Z"
    message: kubelet has sufficient memory available
    reason: KubeletHasSufficientMemory
    status: "False"
    type: MemoryPressure
  - lastHeartbeatTime: "2020-09-19T18:40:08Z"
    lastTransitionTime: "2020-09-19T17:37:39Z"
    message: kubelet has no disk pressure
    reason: KubeletHasNoDiskPressure
    status: "False"
    type: DiskPressure
  - lastHeartbeatTime: "2020-09-19T18:40:08Z"
    lastTransitionTime: "2020-09-19T17:37:39Z"
    message: kubelet has sufficient PID available
    reason: KubeletHasSufficientPID
    status: "False"
    type: PIDPressure
  - lastHeartbeatTime: "2020-09-19T18:40:08Z"
    lastTransitionTime: "2020-09-19T17:38:49Z"
    message: kubelet is posting ready status
    reason: KubeletReady
    status: "True"
    type: Ready
  daemonEndpoints:
    kubeletEndpoint:
      Port: 10250
  images:
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ac6f78cac5f98b75fb5f72f7e4022ab1b78a310da805c262a7fb8f67f61cc610
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 766485750
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f2341034a0068fc68d5d0c07aadc1eaf9637705e28a5e554884d94f3a6a0345f
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 575554256
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fa0d27e509cc4da24a98f6574c6d1e64e0651771209f2956151e83a5a709fd3e
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 564634661
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cf9aa22cf64066b40fda9160910c6007bfc112d29b88a4738243a22babe79e2c
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 543257035
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:757ee6ee9962b7f93b6265a3c5bd9bb6a688b9f9ae987b567843ebce54a45124
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 489294054
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:df79c728167a734b917f5375583b3ee7bdf1e399ae7c0ab406932f257eda7efc
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 438083306
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:01af62a0ccf704509b0211dd777062c74fb7243af5cc6d997ab0e7f8e55266e5
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 427883966
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b7ff0798116e171fadef70a03d2ebb5fe5d726a8c0ce74f57abfb7c17f1083d9
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 401865245
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46469ec9c6a1263579b1ff41fe74dd90428be9ea2ccc150a5514e026fd7eccf0
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 399909626
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea52263935862977469f137d4468189918fdc0f81e9a882c6157f44fa5db48bc
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 399724858
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5acc93e13013e960d1040131eba089f6add0677ca2bfe2c8efa60a0038aced5b
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 398995285
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7f925d26ddbde12a36a8912f4f4d39e55a90b4ee9878bdb37a255cd2bd0e3f38
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 398094604
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d475adf3c4fc0a84df9e9bd9d83cd0f967ce4cb75b0fdcf02204c21965ca619f
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 397584902
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:42f93f7952edb3c27942acb8f752fc7eff81b88e27d22227f862b274ca1b54a5
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 396093032
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a7343b3a855dfc7216fe0d08906afd0de6c9c6ad8e4c1da687c2e34d5e477e55
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 387899465
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:be37b432c7d20d1eead866f9de33d711d0e4fee27defb98959994b9c6c37700d
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 379583126
  - names:
    - registry.svc.ci.openshift.org/ocp/release@sha256:0e7c779d96fd0e416ff221beef102e4c5bee7ce2b4c5ce60cf5683a3ff18cd15
    - registry.svc.ci.openshift.org/ocp/release@sha256:<none>
    sizeBytes: 379312911
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1b68f3af766c58bfc473d2a8fbfdd6432317935069803b98a35d82e7a9b91ca1
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 378957684
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:061a804d4dc76e97011e5a2515f6431e682a9a3dd3179af5cd290ece4c683173
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 378720472
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6c2c544b085e3d879b07d505cb958f36903dc0376a243ba0489212d83947c311
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 377768726
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c3f520b364ec86a7573eb821a23d0ecae18841badb6dd932cc14a7b8708d7334
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 377740229
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:87397484515b79242def3f9bee7640f64af3de8ab8c336e61f0e1c743b19ac64
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 376578310
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6ed9c3be4b5a9b3b9ea89443306332e9762f0c6b9aa8964a23a09a42392e8663
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 375933647
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4db4309b3f38ea8833b4150154626c550798b88a78fc4984d9b5082471c2af7d
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 375701815
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:54fa7b8601549e01a6be170da86406d4e11d7d38b9514537bcf4a0fbc570d71f
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 375696051
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0ca58e526831f1ed86d7e9e4c1b5781b77a326dfe7416f718fe99c32087981b1
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 375492722
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:006e408bdae7b8aebecbb322bc6124b4720c769287591542487b6ed097946e1f
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 374514002
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4226dcece07a0ce366135e2e1c614dbfea929c7a75e87bc7f74756fec15bfa83
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 373029679
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7369f5f756e20ca732cb3f17a784e043c0bda528cbf093c4988135aa5403f527
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 372381483
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4ef7f1aca9e8170f42586f6ae772345734b6eaf11b3930d18f4d937d2df1a609
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 367447584
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b297ad75b73923998dc338e53013035750089772a82defb121f63a16fb2dcf27
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 365261463
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:06d8856491a7dbec30802d6913f868c911afcf01ec7903fa07afbd6a2f0817dc
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 363723458
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f33e9e26fe0d231b13f3271caa812afe68fc1d3d07b022d2d052bfd9846bc4d8
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 362491432
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bfdcd009214a75bab87136d21e5085bc9d79a9a0bfddbfbbb2be070361b7820e
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 361558287
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fa952e488a6b8251ac6f0a644b5f9a726961eecfaf58c9a30faeda864c599ea2
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 341923646
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:70a88050d9c755137378b8a8618bb42b35e78397b9d044986aa3ba72aae97077
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 324347415
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:565ae112fa2b958c9a19f4ac8eaf156ecf9b30f857da2a738ee7a57dd0de640c
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 266807346
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2399db45d4377ef930a27120d25d3b9c015993f6c475d23e17077f542b4e4a4d
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 248345003
  - names:
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2b9e543cc3941ffd89218544cf8de2a7b9b720ecc930a4afabfa08682422e145
    - quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<none>
    sizeBytes: 236846914
  nodeInfo:
    architecture: amd64
    bootID: 3d30df9c-09f2-4e06-a951-abb275309153
    containerRuntimeVersion: cri-o://1.19.0-18.rhaos4.6.gitd802e19.el8
    kernelVersion: 4.18.0-193.23.1.el8_2.x86_64
    kubeProxyVersion: v1.19.0+7f9e863
    kubeletVersion: v1.19.0+7f9e863
    machineID: 98d84a8fb89240c7be4202b5e09fb9ea
    operatingSystem: linux
    osImage: Red Hat Enterprise Linux CoreOS 46.82.202009182140-0 (Ootpa)
    systemUUID: 98d84a8f-b892-40c7-be42-02b5e09fb9ea
```
Comment 13 errata-xmlrpc 2020-10-27 16:40:10 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.6 GA Images), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:4196
Note You need to log in before you can comment on or make changes to this bug.