Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1834927

Summary: revision-pruner killed during OCP 4.3 installation
Product: OpenShift Container Platform Reporter: Andreas Karis <akaris>
Component: NodeAssignee: Ryan Phillips <rphillips>
Status: CLOSED DUPLICATE QA Contact: Sunil Choudhary <schoudha>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 4.3.0CC: aos-bugs, jokerman, mfojtik
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-05-13 16:28:42 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Comment 1 Andreas Karis 2020-05-12 16:59:02 UTC
One of the revision pruner pods shows as OOM killed:

[root@jumpserver ~]# oc get pods -A -o wide | grep -iv runn | grep -iv compl
NAMESPACE                                               NAME                                                              READY   STATUS      RESTARTS   AGE     IP               NODE                                     NOMINATED NODE   READINESS GATES
openshift-kube-scheduler                                revision-pruner-7-master01.example.com          0/1     OOMKilled   0          13d     192.168.3.96      master01.example.com   <none>           <none>
[root@jumpserver ~]# oc describe pod -n openshift-kube-scheduler revision-pruner-7-master01.example.com
Name:                 revision-pruner-7-master01.example.com
Namespace:            openshift-kube-scheduler
Priority:             2000001000
Priority Class Name:  system-node-critical
Node:                 master01.example.com/10.0.0.251
Start Time:           Wed, 29 Apr 2020 10:29:15 +0200
Labels:               app=pruner
Annotations:          k8s.v1.cni.cncf.io/networks-status:
Status:               Succeeded
IP:                   192.168.3.96
IPs:
  IP:  192.168.3.96
Containers:
  pruner:
    Container ID:  cri-o://<container id>
    Image:         quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<checksum>
    Image ID:      quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:<checksum>
    Port:          <none>
    Host Port:     <none>
    Command:
      cluster-kube-scheduler-operator
      prune
    Args:
      -v=4
      --max-eligible-revision=7
      --protected-revisions=1,2,3,4,5,6,7
      --resource-dir=/etc/kubernetes/static-pod-resources
      --static-pod-name=kube-scheduler-pod
    State:          Terminated
      Reason:       OOMKilled
      Exit Code:    0
      Started:      Wed, 29 Apr 2020 10:29:18 +0200
      Finished:     Wed, 29 Apr 2020 10:29:18 +0200
    Ready:          False
    Restart Count:  0
    Environment:    <none>
    Mounts:
      /etc/kubernetes/ from kubelet-dir (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from installer-sa-token-aaaaa (ro)
Conditions:
  Type              Status
  Initialized       True
  Ready             False
  ContainersReady   False
  PodScheduled      True
Volumes:
  kubelet-dir:
    Type:          HostPath (bare host directory volume)
    Path:          /etc/kubernetes/
    HostPathType:
  installer-sa-token-aaaaa:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  installer-sa-token-aaaaa
    Optional:    false
QoS Class:       BestEffort
Node-Selectors:  <none>
Tolerations:
Events:          <none>

---------------

root@jumpserver ~]# oc logs -n openshift-kube-scheduler revision-pruner-7-master01.example.com
unable to retrieve container logs for cri-o://<container id>[root@jumpserver ~]#
[root@jumpserver ~]#
[root@jumpserver ~]#



Could be related to any of the following so please close as duplicate if that's the case: https://bugzilla.redhat.com/show_bug.cgi?id=1800609  ; https://bugzilla.redhat.com/show_bug.cgi?id=1799079 ; https://bugzilla.redhat.com/show_bug.cgi?id=1792501 ; https://github.com/openshift/origin/pull/24596

Comment 2 Maciej Szulik 2020-05-13 10:00:42 UTC
Yes, these look like similar cases to aforementioned, but I'll let the node team give the final call if it's a duplicate.

Comment 3 Ryan Phillips 2020-05-13 16:28:42 UTC

*** This bug has been marked as a duplicate of bug 1800609 ***