Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1883635

Summary: must-gather and oc adm inspect are missing events in CI
Product: OpenShift Container Platform Reporter: David Eads <deads>
Component: ocAssignee: Maciej Szulik <maszulik>
Status: CLOSED ERRATA QA Contact: RamaKasturi <knarra>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 4.6CC: aos-bugs, jokerman, knarra, mfojtik, wking
Target Milestone: ---   
Target Release: 4.6.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-10-27 16:46:20 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description David Eads 2020-09-29 18:31:08 UTC
I have seen multiple CI runs in multiple jobs that are missing events, configmaps, and other core resources.  This is fairly recent.  Might be about the time you removed audit logs from must-gather even though the relationship is not obvious.

We cannot ship without a functional must-gather and CI failure suggest we are not functional.

Comment 2 RamaKasturi 2020-10-06 17:05:04 UTC
Verified with payload below and i see that configmaps, events, endpoints,persistentVolumeclaims, secrets are present.

[knarra@knarra namespaces]$ oc version
Client Version: 4.6.0-202009302026.p0-eadaf89
Server Version: 4.6.0-0.nightly-2020-10-03-051134
Kubernetes Version: v1.19.0+db1fc96
[knarra@knarra namespaces]$ 

Below are the steps followed to verify the bug here:
====================================================
1) Install a cluster with out fix
2) Run oc adm must-gather
3) Install a cluster with fix
4) Run oc adm must-gather

cd to must-gather/quay-io/namespaces/openshift-apiserver-operator collected for both the clusters

with out fix, user will only be able to see below under every namespace core directory:
========================================================================================
[knarra@knarra core]$ ls -l
total 20
-rwxr-xr-x. 1 knarra knarra 10290 Oct  6 20:38 pods.yaml
-rwxr-xr-x. 1 knarra knarra   186 Oct  6 20:38 replicationcontrollers.yaml
-rwxr-xr-x. 1 knarra knarra  2433 Oct  6 20:38 services.yaml

[knarra@knarra namespaces]$ ls -l openshift-cluster-node-tuning-operator/core/
total 96
-rwxr-xr-x. 1 knarra knarra 86958 Oct  6 20:38 pods.yaml
-rwxr-xr-x. 1 knarra knarra   191 Oct  6 20:38 replicationcontrollers.yaml
-rwxr-xr-x. 1 knarra knarra   163 Oct  6 20:38 services.yaml
[knarra@knarra namespaces]$ ls -l openshift-service-ca-operator/core
total 20
-rwxr-xr-x. 1 knarra knarra 8995 Oct  6 20:38 pods.yaml
-rwxr-xr-x. 1 knarra knarra  182 Oct  6 20:38 replicationcontrollers.yaml
-rwxr-xr-x. 1 knarra knarra 2093 Oct  6 20:38 services.yaml


With fix, user can see below under every namesapce core directory:
=====================================================================
[knarra@knarra namespaces]$ ls -l openshift-kube-apiserver-operator/core/
total 268
-rwxr-xr-x. 1 knarra knarra  17234 Oct  6 21:48 configmaps.yaml
-rwxr-xr-x. 1 knarra knarra   1413 Oct  6 21:48 endpoints.yaml
-rwxr-xr-x. 1 knarra knarra    155 Oct  6 21:48 events.yaml
-rwxr-xr-x. 1 knarra knarra    187 Oct  6 21:48 persistentvolumeclaims.yaml
-rwxr-xr-x. 1 knarra knarra  10288 Oct  6 21:48 pods.yaml
-rwxr-xr-x. 1 knarra knarra    187 Oct  6 21:48 replicationcontrollers.yaml
-rwxr-xr-x. 1 knarra knarra 217488 Oct  6 21:48 secrets.yaml
-rwxr-xr-x. 1 knarra knarra   2434 Oct  6 21:48 services.yaml

[knarra@knarra namespaces]$ ls -l openshift-service-ca-operator/core
total 224
-rwxr-xr-x. 1 knarra knarra   1804 Oct  6 21:49 configmaps.yaml
-rwxr-xr-x. 1 knarra knarra   1390 Oct  6 21:49 endpoints.yaml
-rwxr-xr-x. 1 knarra knarra    151 Oct  6 21:49 events.yaml
-rwxr-xr-x. 1 knarra knarra    183 Oct  6 21:49 persistentvolumeclaims.yaml
-rwxr-xr-x. 1 knarra knarra   9003 Oct  6 21:49 pods.yaml
-rwxr-xr-x. 1 knarra knarra    183 Oct  6 21:49 replicationcontrollers.yaml
-rwxr-xr-x. 1 knarra knarra 190488 Oct  6 21:49 secrets.yaml
-rwxr-xr-x. 1 knarra knarra   2094 Oct  6 21:49 services.yaml

Based on the above, moving bug to verified state.

Comment 5 errata-xmlrpc 2020-10-27 16:46:20 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.6 GA Images), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:4196