Description of problem: Something is modifying the KAS shared cache when it should not. A: B: panic: cache *apiextensions.CustomResourceDefinition modified goroutine 2598 [running]: github.com/openshift/origin/vendor/k8s.io/client-go/tools/cache.(*defaultCacheMutationDetector).CompareObjects(0xc001d1cc00) https://storage.googleapis.com/origin-ci-test/pr-logs/pull/22904/pull-ci-openshift-origin-master-cmd/6230/artifacts/cmd/logs/kube-apiserver.log Version-Release number of selected component (if applicable): How reproducible: Steps to Reproduce: 1. 2. 3. Actual results: Expected results: Additional info:
After I found the bug, Stefan fixed it in https://github.com/openshift/origin/pull/23142 I have various followups to make this easier to debug in the future, but this bug is fixed.
I don't think we can easily test this in a normal cluster. It requires some internal cache detection logic to uncover (that's what @Mo did). Usually you won't notice as a user that there is an issue. Yet, there is a chance for inconsistent behavour. That's why we have to fix it.
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2019:2922