Bug 1572914

Summary: Kubelet failed to get node info: failed to get zone from cloud provider: invalid character 'B' looking for beginning of value]
Product: OpenShift Container Platform Reporter: Steven Walter <stwalter>
Component: InstallerAssignee: Michal Fojtik <mfojtik>
Status: CLOSED CURRENTRELEASE QA Contact: Johnny Liu <jialiu>
Severity: urgent Docs Contact:
Priority: unspecified    
Version: 3.7.0CC: aos-bugs, eparis, jfoots, jminter, jokerman, mfojtik, mmccomas, pweil, rchopra, vlaad
Target Milestone: ---Keywords: Reopened
Target Release: 3.7.z   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-08-28 12:33:36 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
Output from journal of errors none

Description Steven Walter 2018-04-28 17:40:39 UTC
Description of problem:
Customer is able to register masters with Azure api but not nodes. Nodes start up normally but if they enable azure cloud provider it fails to start.

Version-Release number of selected component (if applicable):
3.7

How reproducible:
Unconfirmed

Steps to Reproduce:
1. Install openshift successfully
2. Add azure cloud config
3. Restart node

Actual results:
Kubelet failed to get node info: failed to get zone from cloud provider: invalid character 'B' looking for beginning of value]

Expected results:
Start normally

Additional info:
Will attach configs in private comment

Comment 5 Josh Foots 2018-04-28 18:19:58 UTC
Created attachment 1428249 [details]
Output from journal of errors

output from following command in sosreport:

cat sos_commands/origin/journal* | grep zone

Comment 6 Steven Walter 2018-04-28 18:29:08 UTC
Not sure which kubelet.go is reporting this issue/responsible for cloud provider integration. Possibly https://github.com/openshift/kubernetes/blob/release-1.9.1/pkg/kubelet/kubelet.go but it only has similar messages, not the same.

Comment 11 Michal Fojtik 2018-04-30 09:53:34 UTC
Problem solved. Had to add: 169.254.169.254 to no_proxy settings

Comment 12 Scott Dodson 2018-04-30 13:33:59 UTC
We should make sure to add cloud provider metadata endpoints to the list of no_proxy hosts by default.

Comment 13 Michal Fojtik 2018-04-30 14:40:18 UTC
PR: https://github.com/openshift/openshift-ansible/pull/8203

Comment 16 Scott Dodson 2018-06-21 13:37:31 UTC
This is in 3.10

Comment 17 Gan Huang 2018-06-25 06:18:20 UTC
Verified in openshift-ansible-3.10.7-1.git.220.50204c4.el7.noarch.rpm

For any installation with global proxy variables defined, '169.254.169.254' would be added to NO_PROXY list by default.