Bug 1509022

Summary:	Template instance provisioning via TSB fails sporadically
Product:	OpenShift Container Platform	Reporter:	Dan Mace <dmace>
Component:	Templates	Assignee:	Ben Parees <bparees>
Status:	CLOSED CURRENTRELEASE	QA Contact:	XiuJuan Wang <xiuwang>
Severity:	high	Docs Contact:
Priority:	high
Version:	3.7.0	CC:	aos-bugs, bparees, jminter, jokerman, mmccomas, pweil
Target Milestone:	---
Target Release:	3.7.0
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2017-11-08 16:57:57 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Dan Mace 2017-11-02 17:15:38 UTC

This bug is to track an issue discovered in an Origin test flake issue[1]. In CI, template instance provisioning can fail if the broker template instance and template instance are created very nearby in time. The root cause is a bug in GC which affects owner/dependent relationships where the owner is cluster scoped and the dependent is namespace scoped. In this case, broker template instance is cluster scoped, and template instance is namespace scoped.

I haven't verified the flake using actual service broker functionality in a cluster, but the CI test case is easy to reproduce in the Origin test suite and seems to indicate that instance provisioning will be flaky for end users while this bug exists.

The upstream issue[2] provides additional context.

[1] https://github.com/openshift/origin/issues/17085
[2] https://github.com/kubernetes/kubernetes/issues/54940

Comment 1 Ben Parees 2017-11-02 17:39:52 UTC

possible fix here:
https://github.com/openshift/origin/pull/17152

Comment 2 Ben Parees 2017-11-06 22:16:36 UTC

new fix is here:
https://github.com/openshift/origin/pull/17207

Comment 4 XiuJuan Wang 2017-11-08 10:06:33 UTC

Server https://172.16.120.33:8443
openshift v3.7.0-0.197.0
kubernetes v1.7.6+a08f5eeb62

templateinstance will be delay 5s after brokertemplateinstance created.
But I need verify with CI again.

Comment 5 XiuJuan Wang 2017-11-09 07:32:55 UTC

Also passed with e2e test.
openshift v3.7.0-0.197.0
kubernetes v1.7.6+a08f5eeb62

• [SLOW TEST:58.427 seconds]
[Conformance][templates] templateservicebroker end-to-end test
/root/origin/_output/local/go/src/github.com/openshift/origin/test/extended/templates/templateservicebroker_e2e.go:36
  
  /root/origin/_output/local/go/src/github.com/openshift/origin/test/extended/templates/templateservicebroker_e2e.go:360
    should pass an end-to-end test [Suite:openshift/conformance/parallel]
    /root/origin/_output/local/go/src/github.com/openshift/origin/test/extended/templates/templateservicebroker_e2e.go:371
------------------------------
Nov  9 02:22:23.068: INFO: Running AfterSuite actions on all node


Nov  9 02:21:24.732: INFO: Running AfterSuite actions on all node
Nov  9 02:22:23.099: INFO: Running AfterSuite actions on node 1


Ran 1 of 805 Specs in 59.174 seconds
SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 804 Skipped