Bug 1883635 - must-gather and oc adm inspect are missing events in CI
Summary: must-gather and oc adm inspect are missing events in CI
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: oc
Version: 4.6
Hardware: Unspecified
OS: Unspecified
urgent
urgent
Target Milestone: ---
: 4.6.0
Assignee: Maciej Szulik
QA Contact: RamaKasturi
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-09-29 18:31 UTC by David Eads
Modified: 2020-10-27 16:46 UTC (History)
5 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-10-27 16:46:20 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github openshift oc pull 594 0 None closed Bug 1883635: Revert "run inspect in parallel" 2021-02-18 03:02:15 UTC
Red Hat Product Errata RHBA-2020:4196 0 None None None 2020-10-27 16:46:39 UTC

Description David Eads 2020-09-29 18:31:08 UTC
I have seen multiple CI runs in multiple jobs that are missing events, configmaps, and other core resources.  This is fairly recent.  Might be about the time you removed audit logs from must-gather even though the relationship is not obvious.

We cannot ship without a functional must-gather and CI failure suggest we are not functional.

Comment 2 RamaKasturi 2020-10-06 17:05:04 UTC
Verified with payload below and i see that configmaps, events, endpoints,persistentVolumeclaims, secrets are present.

[knarra@knarra namespaces]$ oc version
Client Version: 4.6.0-202009302026.p0-eadaf89
Server Version: 4.6.0-0.nightly-2020-10-03-051134
Kubernetes Version: v1.19.0+db1fc96
[knarra@knarra namespaces]$ 

Below are the steps followed to verify the bug here:
====================================================
1) Install a cluster with out fix
2) Run oc adm must-gather
3) Install a cluster with fix
4) Run oc adm must-gather

cd to must-gather/quay-io/namespaces/openshift-apiserver-operator collected for both the clusters

with out fix, user will only be able to see below under every namespace core directory:
========================================================================================
[knarra@knarra core]$ ls -l
total 20
-rwxr-xr-x. 1 knarra knarra 10290 Oct  6 20:38 pods.yaml
-rwxr-xr-x. 1 knarra knarra   186 Oct  6 20:38 replicationcontrollers.yaml
-rwxr-xr-x. 1 knarra knarra  2433 Oct  6 20:38 services.yaml

[knarra@knarra namespaces]$ ls -l openshift-cluster-node-tuning-operator/core/
total 96
-rwxr-xr-x. 1 knarra knarra 86958 Oct  6 20:38 pods.yaml
-rwxr-xr-x. 1 knarra knarra   191 Oct  6 20:38 replicationcontrollers.yaml
-rwxr-xr-x. 1 knarra knarra   163 Oct  6 20:38 services.yaml
[knarra@knarra namespaces]$ ls -l openshift-service-ca-operator/core
total 20
-rwxr-xr-x. 1 knarra knarra 8995 Oct  6 20:38 pods.yaml
-rwxr-xr-x. 1 knarra knarra  182 Oct  6 20:38 replicationcontrollers.yaml
-rwxr-xr-x. 1 knarra knarra 2093 Oct  6 20:38 services.yaml


With fix, user can see below under every namesapce core directory:
=====================================================================
[knarra@knarra namespaces]$ ls -l openshift-kube-apiserver-operator/core/
total 268
-rwxr-xr-x. 1 knarra knarra  17234 Oct  6 21:48 configmaps.yaml
-rwxr-xr-x. 1 knarra knarra   1413 Oct  6 21:48 endpoints.yaml
-rwxr-xr-x. 1 knarra knarra    155 Oct  6 21:48 events.yaml
-rwxr-xr-x. 1 knarra knarra    187 Oct  6 21:48 persistentvolumeclaims.yaml
-rwxr-xr-x. 1 knarra knarra  10288 Oct  6 21:48 pods.yaml
-rwxr-xr-x. 1 knarra knarra    187 Oct  6 21:48 replicationcontrollers.yaml
-rwxr-xr-x. 1 knarra knarra 217488 Oct  6 21:48 secrets.yaml
-rwxr-xr-x. 1 knarra knarra   2434 Oct  6 21:48 services.yaml

[knarra@knarra namespaces]$ ls -l openshift-service-ca-operator/core
total 224
-rwxr-xr-x. 1 knarra knarra   1804 Oct  6 21:49 configmaps.yaml
-rwxr-xr-x. 1 knarra knarra   1390 Oct  6 21:49 endpoints.yaml
-rwxr-xr-x. 1 knarra knarra    151 Oct  6 21:49 events.yaml
-rwxr-xr-x. 1 knarra knarra    183 Oct  6 21:49 persistentvolumeclaims.yaml
-rwxr-xr-x. 1 knarra knarra   9003 Oct  6 21:49 pods.yaml
-rwxr-xr-x. 1 knarra knarra    183 Oct  6 21:49 replicationcontrollers.yaml
-rwxr-xr-x. 1 knarra knarra 190488 Oct  6 21:49 secrets.yaml
-rwxr-xr-x. 1 knarra knarra   2094 Oct  6 21:49 services.yaml

Based on the above, moving bug to verified state.

Comment 5 errata-xmlrpc 2020-10-27 16:46:20 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.6 GA Images), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:4196


Note You need to log in before you can comment on or make changes to this bug.