Bug 1889873 - MutatingAdmissionWebhook causing pod deployment failures and other errors [NEEDINFO]
Summary: MutatingAdmissionWebhook causing pod deployment failures and other errors
Keywords:
Status: NEW
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: kube-controller-manager
Version: 4.3.z
Hardware: Unspecified
OS: Unspecified
medium
medium
Target Milestone: ---
: 4.7.0
Assignee: Maciej Szulik
QA Contact: zhou ying
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-10-20 18:45 UTC by Luke Stanton
Modified: 2020-12-04 16:29 UTC (History)
2 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:
Target Upstream Version:
maszulik: needinfo? (lstanton)


Attachments (Terms of Use)

Description Luke Stanton 2020-10-20 18:45:30 UTC
Description of problem:

The addition of a MutatingAdmissionWebhook is causing pod deployment failures and other errors when running commands such as the following:

~~~~~~~~~~
$ oc debug node/...com
Error from server (InternalError): Internal error occurred: admission plugin "MutatingAdmissionWebhook" failed to complete mutation in 13s
~~~~~~~~~~


~~~~~~~~~~
2020-10-16T16:21:17.357064063Z I1016 16:21:17.357024       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"openshift-operator-lifecycle-manager", Name:"olm-operator-9d666b5b9", UID:"69c72a6d-f1b7-49b6-bc45-9e611c6bffda", APIVersion:"apps/v1", ResourceVersion:"142186292", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: Internal error occurred: admission plugin "MutatingAdmissionWebhook" failed to complete mutation in 13s
2020-10-16T16:21:17.357112317Z E1016 16:21:17.357103       1 replica_set.go:534] sync "openshift-operator-lifecycle-manager/olm-operator-9d666b5b9" failed with Internal error occurred: admission plugin "MutatingAdmissionWebhook" failed to complete mutation in 13s
~~~~~~~~~~


How reproducible:

Consistently


Actual results:

Adding MutatingAdmissionWebhook is causing problems for cluster components.


Expected results:

MutatingAdmissionWebhook would work as expected without adverse affects on the cluster.

Comment 1 Luke Stanton 2020-10-20 18:47:16 UTC
Meant to indicate the following error in the summary is from the kube-controller-manager pods:

~~~~~~~~~~
2020-10-16T16:21:17.357064063Z I1016 16:21:17.357024       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"openshift-operator-lifecycle-manager", Name:"olm-operator-9d666b5b9", UID:"69c72a6d-f1b7-49b6-bc45-9e611c6bffda", APIVersion:"apps/v1", ResourceVersion:"142186292", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: Internal error occurred: admission plugin "MutatingAdmissionWebhook" failed to complete mutation in 13s
2020-10-16T16:21:17.357112317Z E1016 16:21:17.357103       1 replica_set.go:534] sync "openshift-operator-lifecycle-manager/olm-operator-9d666b5b9" failed with Internal error occurred: admission plugin "MutatingAdmissionWebhook" failed to complete mutation in 13s
~~~~~~~~~~

Comment 7 Maciej Szulik 2020-11-13 11:03:58 UTC
I’m adding UpcomingSprint, because I was occupied by fixing bugs with higher priority/severity, developing new features with higher priority, or developing new features to improve stability at a macro level. I will revisit this bug next sprint.

Comment 8 Maciej Szulik 2020-12-04 16:29:54 UTC
I’m adding UpcomingSprint, because I was occupied by fixing bugs with higher priority/severity, developing new features with higher priority, or developing new features to improve stability at a macro level. I will revisit this bug next sprint.


Note You need to log in before you can comment on or make changes to this bug.