Bug 1974424 - Upgrade from 4.5.0-0.nightly-2021-06-16-152501 to 4.6.0-0.nightly-2021-06-18-114144 failed with 1 crashlooping apiserver
Summary: Upgrade from 4.5.0-0.nightly-2021-06-16-152501 to 4.6.0-0.nightly-2021-06-18-...
Keywords:
Status: CLOSED DUPLICATE of bug 1973770
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Networking
Version: 4.6
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
: ---
Assignee: Ben Bennett
QA Contact: Anurag saxena
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-06-21 16:19 UTC by Mike Fiedler
Modified: 2021-06-22 02:45 UTC (History)
3 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2021-06-21 18:52:04 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)

Description Mike Fiedler 2021-06-21 16:19:33 UTC 
Description of problem:

Upgrade from 4.5.0-0.nightly-2021-06-16-152501 to 4.6.0-0.nightly-2021-06-18-114144 failed with 1 crashlooping apiserver

[2021-06-19T00:52:43.777Z] 2021-06-18T22:35:23Z [openshift-apiserver] -->>Degraded True<<-- APIServerDeployment_UnavailablePod APIServerDeploymentDegraded: 1 of 3 requested instances are unavailable for apiserver.openshift-apiserver (crashlooping container is waiting in apiserver-5678c5b5f5-qzzd6 pod)


Version-Release number of selected component (if applicable):4.6.0-0.nightly-2021-06-18-114144


How reproducible: Unknown - found in QE CI



Additional info:

oc adm must-gather location in private comment
Comment 4 Mike Fiedler 2021-06-21 18:52:04 UTC 
Re-running CI job to try to reproduce.  Will reopen with full must-gather.
Comment 5 Stefan Schimanski 2021-06-21 18:52:37 UTC 
have you looked into networking? It also says it's degraded and has not upgraded to the 4.6 version:

  [2021-06-19T00:51:35.766Z] network        4.5.0-0.nightly-2021-06-16-152501   True        True          True       4h48m
  RolloutHung DaemonSet "openshift-ovn-kubernetes/ovnkube-node" rollout is not making progress - last change 2021-06-18T22:27:35Z

openshift-apiserver depends on networking (service network).

This also looks like networking while connecting to openshift-apiserver:

  response from https://10.128.0.11:8443/apis/authorization.openshift.io/v1: Get "https://10.128.0.11:8443/apis/authorization.openshift.io/v1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) is most likely networking
Comment 6 Xingxing Xia 2021-06-22 02:43:21 UTC 

*** This bug has been marked as a duplicate of bug 1961528 ***
Comment 7 Xingxing Xia 2021-06-22 02:45:01 UTC 

*** This bug has been marked as a duplicate of bug 1973770 ***
Note You need to log in before you can comment on or make changes to this bug.