Description of problem: In my PR to the oc (https://github.com/openshift/oc/pull/922), and in a few neighbor PRs, test ci/prow/e2e-agnostic-cmd is failing with the same error every time. Version-Release number of selected component (if applicable): e2e tests during merge into master branch How reproducible: few PRs are affected Actual results: fail [github.com/openshift/origin/test/extended/cmd/cmd.go:118]: Expected <[]error | len:1, cap:1>: [ { s: "error waiting for the pod 'test-cmd' to complete: g success...\nSUCCESS after 0.000s: test/cmd/basicresources.sh:183: executing 'oc get route.v1.route.openshift.io frontend --template='{{.spec.port.targetPort}}'' expecting success\nRunning test/cmd/basicresources.sh:184: executing 'oc delete svc,route -l name=frontend' expecting success...\nSUCCESS after 0.000s: test/cmd/basicresources.sh:184: executing 'oc delete svc,route -l name=frontend' expecting success\nRunning test/cmd/basicresources.sh:186: executing 'oc create -f ${TEST_DATA}/external-service.yaml' expecting success...\nSUCCESS after 1.000s: test/cmd/basicresources.sh:186: executing 'oc create -f ${TEST_DATA}/external-service.yaml' expecting success\nRunning test/cmd/basicresources.sh:187: executing 'oc expose svc/external' expecting success...\nSUCCESS after 0.000s: test/cmd/basicresources.sh:187: executing 'oc expose svc/external' expecting success\nRunning test/cmd/basicresources.sh:188: executing 'oc get route external' expecting success and text 'external'...\nSUCCESS after 0.000s: test/cmd/basicresources.sh:188: executing 'oc get route external' expecting success and text 'external'\nRunning test/cmd/basicresources.sh:189: executing 'oc delete route external' expecting success...\nSUCCESS after 0.000s: test/cmd/basicresources.sh:189: executing 'oc delete route external' expecting success\nRunning test/cmd/basicresources.sh:190: executing 'oc delete svc external' expecting success...\nSUCCESS after 0.000s: test/cmd/basicresources.sh:190: executing 'oc delete svc external' expecting success\nRunning test/cmd/basicresources.sh:192: executing 'oc create -f ${TEST_DATA}/multiport-service.yaml' expecting success...\nFAILURE after 1.000s: test/cmd/basicresources.sh:192: executing 'oc create -f ${TEST_DATA}/multiport-service.yaml' expecting success: the command returned the wrong error code\nThere was no output from the command.\nStandard error from the command:\nerror: the path \"/var/tests/test/cmd/testdata/multiport-service.yaml\" does not exist\n[ERROR] hack/lib/cmd.sh:10: `return \"${return_code}\"` exited with status 1.\n", }, ] to have length 0 Expected results: No errors, tests passing Additional info: this test used to pass a few days ago before minor change in my PR (variable rename), after which it stopped passing, and is happening in another PR, so I believe my changes are not the reason it is failing now.
Test appears to be perm-failing since September 17th, 2021. Common error: FAILURE after 0.000s: test/cmd/basicresources.sh:192: executing 'oc create -f ${TEST_DATA}/multiport-service.yaml' expecting success: the command returned the wrong error code There was no output from the command. Standard error from the command: error: the path "/var/tests/test/cmd/testdata/multiport-service.yaml" does not exist
Looks like this PR removed the needed file: https://github.com/openshift/origin/pull/26415
The multi-service test failure appears to be fixed, but a new one just cropped up: ``` Running test/cmd/help.sh:22: executing 'oc adm ca' expecting failure and text 'Manage certificates'... FAILURE after 0.000s: test/cmd/help.sh:22: executing 'oc adm ca' expecting failure and text 'Manage certificates': the output content test failed There was no output from the command. Standard error from the command: error: unknown command "ca" See 'oc adm -h' for help and examples [ERROR] hack/lib/cmd.sh:41: `return "${return_code}"` exited with status 1. ```
Fixed in https://github.com/openshift/origin/pull/26513