Created attachment 1897328 [details]
console output of must-gather command

Description of problem:
Running PAO and OCP must gather images in one command leads to not gathering all data about PAO due to having two pods in one command to get the pod image as such:
oc get pod -n openshift-must-gather-r7kg8 must-gather-6lsmh must-gather-zmqnm -o 'jsonpath={.spec.containers[0].image}'

Version-Release number of selected component (if applicable):
4.6 & 4.7
in >= 4.8 the pod of the other image seems to be terminated before the get command

How reproducible:
always 

Steps to Reproduce:
1.run must-gather with two or more images including PAO (in below example we used the ocp must-gather set in --image-stream):
 oc adm must-gather --image-stream=openshift/must-gather --image=registry-proxy.engineering.redhat.com/rh-osbs/openshift4-performance-addon-operator-must-gather-rhel8:v4.6.10-1

2.
3.

Actual results:

 POD_NAME='must-gather-6lsmh
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:49.164776880Z must-gather-zmqnm'
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:49.165193124Z ++ oc get pod -n openshift-must-gather-r7kg8 must-gather-6lsmh must-gather-zmqnm -o 'jsonpath={.spec.containers[0].image}'
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:49.313085911Z + MUST_GATHER_IMAGE=                  <---- the env var is empty
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:49.313085911Z ++ hostname -I
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:49.313085911Z ++ tr -d '[:blank:]'
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:49.315045670Z + POD_IP=10.132.0.14
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:49.315086009Z + echo '[openshift-must-gather-r7kg8/10.132.0.14/must-gather-6lsmh
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:49.315086009Z must-gather-zmqnm]'
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:49.315236687Z + oc get pod -n openshift-must-gather-r7kg8 must-gather-6lsmh must-gather-zmqnm -o json
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:49.468601493Z + sed -i -e s#MUST_GATHER_IMAGE## /etc/node-gather/daemonset.yaml
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:49.470596629Z + oc create -f /etc/node-gather/namespace.yaml
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:49.594456313Z namespace/perf-node-gather created
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:49.596585814Z + oc create -f /etc/node-gather/serviceaccount.yaml
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:49.832445135Z serviceaccount/perf-node-gather created
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:49.840006878Z + oc adm policy add-scc-to-user privileged -n perf-node-gather -z perf-node-gather
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:50.042681569Z clusterrole.rbac.authorization.k8s.io/system:openshift:scc:privileged added: "perf-node-gather"
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:50.044482761Z + oc create -f /etc/node-gather/daemonset.yaml
[2022-07-14T19:03:57.294Z] [must-gather-6lsmh] POD 2022-07-14T19:03:50.236641095Z The DaemonSet "perf-node-gather-daemonset" is invalid: spec.template.spec.containers[0].image: Required value       <--- could not create the ds properly with missing image

and the nodes directory is empty:
~/must-gather.local.1390608583816015145/registry../nodes 

Expected results:
should run without errors and should have worker nodes folders in ~/must-gather.local.1390608583816015145/registry../nodes

Additional info: