Bug 1677329

Summary:	[marketplace]installed catalogsources are deleted automatically
Product:	OpenShift Container Platform	Reporter:	Fan Jia <jfan>
Component:	OLM	Assignee:	Abu Kashem <akashem>
Status:	CLOSED DUPLICATE	QA Contact:	Fan Jia <jfan>
Severity:	high	Docs Contact:
Priority:	high
Version:	4.1.0	CC:	akashem, aravindh, chezhang, dyan, jiazha, zitang
Target Milestone:	---
Target Release:	4.1.0
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2019-02-20 21:03:25 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Fan Jia 2019-02-14 14:57:23 UTC

Description of problem:
The default catalogsource "installed-XXXX" will be deleted automatically (every one hour) after it is created.

Version-Release number of selected component (if applicable):
clusterversion: 4.0.0-0.nightly-2019-02-13-204401
console : quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:65d45bc11133e47d739c729969241654813830bb315ad805e71e7a677a8e73e6
console 
marketplace :  quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da0e454dfd9f4d9b142dedc23175a19133b47b0f47857f6b4403c04681dbc6a3
olm: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6a6d55c7119f4ba1815c41d5e3cf5931c4787409030c203dfa2a7ab2db829f74

How reproducible:
Always

Steps to Reproduce:
1.install operator "etcd" to ns "openshift-operators" through the operatorhub page
2.can get the catalogsource in ns "openshift-operators"
#oc get catalogsource -n openshift-operators
NAME                                   NAME                  TYPE       PUBLISHER   AGE
installed-community-global-operators   Community Operators   internal   Red Hat     1m


Actual results:
1.wait for one hour later the catalogsource "installed-community-global-operators" will be deleted automatically


Expected results:
the catalogsource "wait for one hour later the catalogsource "installed-community-global-operators" will be deleted automatically" should remain until someone delete it manually


Additional info:
This also impact the reinstall of operator to the same ns after delete all the source of operators(like subscription,csv).

Comment 1 Fan Jia 2019-02-14 15:15:10 UTC

the logs of marketplace aroud the deletion of the catalogsource
1. marketplace logs:
"E0214 10:41:53.243551       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=27, ErrCode=NO_ERROR, debug=""
E0214 10:41:53.244119       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=27, ErrCode=NO_ERROR, debug=""
time="2019-02-14T10:41:55Z" level=info msg="Reconciling CatalogSourceConfig openshift-marketplace/installed-community-global-operators\n"
time="2019-02-14T10:41:55Z" level=info msg="No action taken, the object has already been reconciled" name=installed-community-global-operators targetNamespace=openshift-operators type=CatalogSourceConfig
time="2019-02-14T10:41:55Z" level=info msg="Reconciling CatalogSourceConfig openshift-marketplace/installed-community-openshift-production\n"
time="2019-02-14T10:41:56Z" level=info msg="No action taken, the object has already been reconciled" name=installed-community-openshift-production targetNamespace=yapei1 type=CatalogSourceConfig
time="2019-02-14T10:41:56Z" level=info msg="Reconciling CatalogSourceConfig openshift-marketplace/installed-redhat-global-operators\n"
time="2019-02-14T10:41:56Z" level=info msg="No action taken, the object has already been reconciled" name=installed-redhat-global-operators targetNamespace=openshift-operators type=CatalogSourceConfig
time="2019-02-14T10:41:56Z" level=info msg="Reconciling CatalogSourceConfig openshift-marketplace/redhat-operators\n"
time="2019-02-14T10:41:56Z" level=info msg="No action taken, the object has already been reconciled" name=redhat-operators targetNamespace=openshift-marketplace type=CatalogSourceConfig
time="2019-02-14T10:41:56Z" level=info msg="Reconciling CatalogSourceConfig openshift-marketplace/test1\n"
time="2019-02-14T10:41:56Z" level=info msg="No action taken, the object has already been reconciled" name=test1 targetNamespace=openshift-marketplace type=CatalogSourceConfig
time="2019-02-14T10:41:56Z" level=info msg="Reconciling CatalogSourceConfig openshift-marketplace/certified-operators\n"
time="2019-02-14T10:41:56Z" level=info msg="No action taken, the object has already been reconciled" name=certified-operators targetNamespace=openshift-marketplace type=CatalogSourceConfig
time="2019-02-14T10:41:56Z" level=info msg="Reconciling CatalogSourceConfig openshift-marketplace/community-operators\n"
time="2019-02-14T10:41:56Z" level=info msg="No action taken, the object has already been reconciled" name=community-operators targetNamespace=openshift-marketplace type=CatalogSourceConfig
time="2019-02-14T10:41:56Z" level=info msg="Reconciling CatalogSourceConfig openshift-marketplace/installed-certified-global-operators\n"
time="2019-02-14T10:41:56Z" level=info msg="No action taken, the object has already been reconciled" name=installed-certified-global-operators targetNamespace=openshift-operators type=CatalogSourceConfig
time="2019-02-14T10:41:56Z" level=info msg="Reconciling CatalogSourceConfig openshift-marketplace/installed-community-ansible-service-broker\n"
time="2019-02-14T10:41:56Z" level=info msg="No action taken, the object has already been reconciled" name=installed-community-ansible-service-broker targetNamespace=openshift-ansible-service-broker type=CatalogSourceConfig
time="2019-02-14T10:41:56Z" level=info msg="Reconciling CatalogSourceConfig openshift-marketplace/installed-dddd-global-operators\n"
time="2019-02-14T10:41:56Z" level=info msg="No action taken, the object has already been reconciled" name=installed-dddd-global-operators targetNamespace=openshift-operators type=CatalogSourceConfig
time="2019-02-14T10:41:56Z" level=info msg="Reconciling OperatorSource openshift-marketplace/certified-operators\n"
time="2019-02-14T10:41:56Z" level=info msg="No action taken, the object has already been reconciled" name=certified-operators namespace=openshift-marketplace type=OperatorSource
time="2019-02-14T10:41:56Z" level=info msg="Reconciling OperatorSource openshift-marketplace/community-operators\n"
time="2019-02-14T10:41:56Z" level=info msg="No action taken, the object has already been reconciled" name=community-operators namespace=openshift-marketplace type=OperatorSource
time="2019-02-14T10:41:56Z" level=info msg="Reconciling OperatorSource openshift-marketplace/redhat-operators\n"
time="2019-02-14T10:41:56Z" level=info msg="No action taken, the object has already been reconciled" name=redhat-operators namespace=openshift-marketplace type=OperatorSource
time="2019-02-14T10:41:56Z" level=info msg="Reconciling OperatorSource openshift-marketplace/test1\n"
time="2019-02-14T10:41:56Z" level=info msg="No action taken, the object has already been reconciled" name=test1 namespace=openshift-marketplace type=OperatorSource
E0214 12:35:23.375509       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=89, ErrCode=NO_ERROR, debug=""
E0214 12:35:23.391116       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=89, ErrCode=NO_ERROR, debug=""
E0214 12:35:23.398203       1 reflector.go:251] sigs.k8s.io/controller-runtime/pkg/cache/internal/informers_map.go:126: Failed to watch *v1alpha1.CatalogSourceConfig: Get https://172.30.0.1:443/apis/marketplace.redhat.com/v1alpha1/namespaces/openshift-marketplace/catalogsourceconfigs?resourceVersion=458253&timeoutSeconds=509&watch=true: dial tcp 172.30.0.1:443: connect: connection refused


2. catalog-operator logs around the delete operation:
"E0214 10:42:14.828317       1 queueinformer_operator.go:155] Sync "openshift-operators" failed: {mongodb-enterprise-test preview mongodboperator.v0.3.2 {installed-dddd-global-operators openshift-operators}} not found: CatalogSource {installed-dddd-global-operators openshift-operators} not found
time="2019-02-14T10:42:31Z" level=info msg="removed client for deleted catalogsource" source="{installed-community-global-operators openshift-operators}"
time="2019-02-14T10:42:33Z" level=info msg="couldn't get from queue" key=openshift-operators/installed-community-global-operators queue=catsrc
time="2019-02-14T10:42:33Z" level=info msg="couldn't get from queue" key=openshift-operators/installed-community-global-operators queue=catsrc
time="2019-02-14T10:42:33Z" level=info msg="couldn't get from queue" key=openshift-operators/installed-community-global-operators queue=catsrc
time="2019-02-14T10:42:33Z" level=info msg="couldn't get from queue" key=openshift-operators/installed-community-global-operators queue=catsrc
time="2019-02-14T10:42:41Z" level=info msg="couldn't get from queue" key=openshift-operators/installed-community-global-operators queue=catsrc
time="2019-02-14T10:43:04Z" level=info msg="couldn't get from queue" key=openshift-controller-manager/controller-manager-6mwq4 queue=pod
time="2019-02-14T10:56:57Z" level=info msg=syncing id=nI6NG ip=install-5xsnv namespace=openshift-operator-lifecycle-manager phase=Complete
time="2019-02-14T10:56:58Z" level=info msg=syncing id=DVXZa ip=install-zx598 namespace=openshift-operators phase=Complete
time="2019-02-14T10:56:59Z" level=info msg=syncing id=3uiqx ip=install-sv7p9 namespace=openshift-operators phase=Complete
time="2019-02-14T10:57:00Z" level=info msg=syncing id=8RZWV ip=install-nlfbw namespace=openshift-operators phase=Complete
time="2019-02-14T10:57:00Z" level=info msg=syncing id=sZCTb ip=install-pbl4k namespace=openshift-operators phase=
"
""

Comment 2 Abu Kashem 2019-02-19 18:11:00 UTC

*** Bug 1678841 has been marked as a duplicate of this bug. ***

Comment 3 Aravindh Puthiyaparambil 2019-02-20 21:03:25 UTC


*** This bug has been marked as a duplicate of bug 1679309 ***