Bug 1749882

Summary: e2e-gcp-serial: [sig-storage] ... [Serial] tests are failing
Product: OpenShift Container Platform Reporter: Christian Huffman <chuffman>
Component: StorageAssignee: Christian Huffman <chuffman>
Status: CLOSED DUPLICATE QA Contact: Liang Xia <lxia>
Severity: high Docs Contact:
Priority: high    
Version: 4.2.0CC: aos-bugs, aos-storage-staff, bchilds, miabbott
Target Milestone: ---   
Target Release: 4.3.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 1750968 (view as bug list) Environment:
Last Closed: 2019-11-26 15:28:37 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1750968    

Description Christian Huffman 2019-09-06 16:06:49 UTC
Example:

https://prow.svc.ci.openshift.org/view/gcs/origin-ci-test/logs/canary-openshift-ocp-installer-e2e-gcp-serial-4.2/101

We see a variety of tests failing, from CSI, Local Volume, and Volume Metrics, such as:

[sig-storage] [Serial] Volume metrics should create metrics for total time taken in volume operations in P/V Controller [Suite:openshift/conformance/serial] [Suite:k8s]
[sig-storage] In-tree Volumes [Driver: local][LocalVolumeType: gce-localssd-scsi-fs] [Serial] [Testpattern: Pre-provisioned PV (ext3)] volumes should allow exec of files on the volume [Suite:openshift/conformance/serial] [Suite:k8s] 
[sig-storage] CSI Volumes [Driver: pd.csi.storage.gke.io][Serial] [Testpattern: Dynamic PV (default fs)] provisioning should create and delete block persistent volumes [Suite:openshift/conformance/serial] [Suite:k8s] 

In addition, this seems to be similar to the CRI-O hostNetwork issue, as the following is found in the build.log:

csi-gce-pd-node-rv4dv/gce-pd-driver: W0906 11:10:28.546739       1 gce.go:126] GOOGLE_APPLICATION_CREDENTIALS env var not set
csi-gce-pd-node-rv4dv/gce-pd-driver: I0906 11:10:28.546776       1 gce.go:128] Using DefaultTokenSource &oauth2.reuseTokenSource{new:google.computeSource{account:""}, mu:sync.Mutex{state:0, sema:0x0}, t:(*oauth2.Token)(nil)}
csi-gce-pd-node-rv4dv/gce-pd-driver: E0906 11:10:29.570703       1 gce.go:135] error fetching initial token: Get http://169.254.169.254/computeMetadata/v1/instance/service-accounts/default/token: dial tcp 169.254.169.254:80: connect: connection refused
csi-gce-pd-node-rv4dv/gce-pd-driver: E0906 11:10:35.586678       1 gce.go:135] error fetching initial token: Get http://169.254.169.254/computeMetadata/v1/instance/service-accounts/default/token: dial tcp 169.254.169.254:80: connect: connection refused
csi-gce-pd-node-rv4dv/gce-pd-driver: E0906 11:10:40.578686       1 gce.go:135] error fetching initial token: Get http://169.254.169.254/computeMetadata/v1/instance/service-accounts/default/token: dial tcp 169.254.169.254:80: connect: connection refused
csi-gce-pd-node-rv4dv/gce-pd-driver: E0906 11:10:45.634635       1 gce.go:135] error fetching initial token: Get http://169.254.169.254/computeMetadata/v1/instance/service-accounts/default/token: dial tcp 169.254.169.254:80: connect: connection refused
csi-gce-pd-node-rv4dv/gce-pd-driver: E0906 11:10:50.626754       1 gce.go:135] error fetching initial token: Get http://169.254.169.254/computeMetadata/v1/instance/service-accounts/default/token: dial tcp 169.254.169.254:80: connect: connection refused
csi-gce-pd-node-rv4dv/gce-pd-driver: E0906 11:10:55.618659       1 gce.go:135] error fetching initial token: Get http://169.254.169.254/computeMetadata/v1/instance/service-accounts/default/token: dial tcp 169.254.169.254:80: connect: connection refused
csi-gce-pd-node-rv4dv/gce-pd-driver: E0906 11:11:00.610726       1 gce.go:135] error fetching initial token: Get http://169.254.169.254/computeMetadata/v1/instance/service-accounts/default/token: dial tcp 169.254.169.254:80: connect: connection refused
csi-gce-pd-node-rv4dv/gce-pd-driver: E0906 11:11:01.634650       1 gce.go:135] error fetching initial token: Get http://169.254.169.254/computeMetadata/v1/instance/service-accounts/default/token: dial tcp 169.254.169.254:80: connect: connection refused
csi-gce-pd-node-rv4dv/gce-pd-driver: F0906 11:11:01.634690       1 main.go:62] Failed to get cloud provider: timed out waiting for the condition

Note: The CSI tests should have been disabled previously under https://github.com/openshift/origin/pull/23720 .

Comment 1 Christian Huffman 2019-11-26 15:28:37 UTC
These tests were disabled in https://bugzilla.redhat.com/show_bug.cgi?id=1750968 , and are still being skipped in 4.3 and subsequent versions of OCP. There have not been recent failures since these tests are now being skipped.

Closing this bug as a duplicate of BZ1750968.

*** This bug has been marked as a duplicate of bug 1750968 ***