Bug 1387630

Summary: master unable to create a loadbalancer service type in google cloud
Product: OpenShift Container Platform Reporter: raffaele spazzoli <rspazzol>
Component: NetworkingAssignee: Ben Bennett <bbennett>
Status: CLOSED NOTABUG QA Contact: Meng Bo <bmeng>
Severity: medium Docs Contact:
Priority: medium    
Version: 3.3.0CC: aos-bugs, dcbw, rspazzol
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-01-30 19:23:05 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description raffaele spazzoli 2016-10-21 12:21:20 UTC
Description of problem:

when I create a simple service type LoadBalancer, the cluster cannot assign an external ip and the service remains stuck in pending status:

NAME          CLUSTER-IP      EXTERNAL-IP   PORT(S)    AGE
egress-test   172.30.38.195   <pending>     9999/TCP   4m


Version-Release number of selected component (if applicable):
3.3

How reproducible:
reliably.


Steps to Reproduce:
please find instructions here to create the cluster in google cloud:
https://github.com/raffaelespazzoli/openshift-enablement-exam

and here to reproduce the service problem
https://github.com/raffaelespazzoli/openshift-enablement-exam/blob/master/misc/egress/setup-egress-test.md


Actual results:
pending status forever


Expected results:
external ip assigned to the service and load balancing on google cloud rules created by the openshift.


Additional info:

here is the log from the master service controller:


Oct 21 02:00:34 master1 atomic-openshift-master-controllers[1295]: I1021 02:00:34.688619    1295 servicecontroller.go:257] Got new Added delta for service: egress-test/egress-test
Oct 21 02:00:34 master1 atomic-openshift-master-controllers[1295]: I1021 02:00:34.696673    1295 servicecontroller.go:359] Ensuring LB for service egress-test/egress-test
Oct 21 02:00:34 master1 atomic-openshift-master-controllers[1295]: E1021 02:00:34.793825    1295 gce.go:2581] Failed to retrieve instance: "infranode1.c.openshift-enablement-exam2.internal"
Oct 21 02:00:34 master1 atomic-openshift-master-controllers[1295]: E1021 02:00:34.793913    1295 servicecontroller.go:211] Failed to process service delta. Retrying in 5s: Failed to create load balancer for service egress-test/egress-test: instance not found
Oct 21 02:00:39 master1 atomic-openshift-master-controllers[1295]: I1021 02:00:39.794341    1295 servicecontroller.go:257] Got new Added delta for service: egress-test/egress-test
Oct 21 02:00:39 master1 atomic-openshift-master-controllers[1295]: I1021 02:00:39.799707    1295 servicecontroller.go:359] Ensuring LB for service egress-test/egress-test
Oct 21 02:00:39 master1 atomic-openshift-master-controllers[1295]: E1021 02:00:39.865621    1295 gce.go:2581] Failed to retrieve instance: "infranode1.c.openshift-enablement-exam2.internal"
Oct 21 02:00:39 master1 atomic-openshift-master-controllers[1295]: E1021 02:00:39.865706    1295 servicecontroller.go:211] Failed to process service delta. Retrying in 10s: Failed to create load balancer for service egress-test/egress-test: instance not found
Oct 21 02:00:49 master1 atomic-openshift-master-controllers[1295]: I1021 02:00:49.865894    1295 servicecontroller.go:257] Got new Added delta for service: egress-test/egress-test
Oct 21 02:00:49 master1 atomic-openshift-master-controllers[1295]: I1021 02:00:49.870261    1295 servicecontroller.go:359] Ensuring LB for service egress-test/egress-test
Oct 21 02:00:49 master1 atomic-openshift-master-controllers[1295]: E1021 02:00:49.973723    1295 gce.go:2581] Failed to retrieve instance: "infranode1.c.openshift-enablement-exam2.internal"
Oct 21 02:00:49 master1 atomic-openshift-master-controllers[1295]: E1021 02:00:49.973848    1295 servicecontroller.go:211] Failed to process service delta. Retrying in 20s: Failed to create load balancer for service egress-test/egress-test: instance not found

Comment 1 Ben Bennett 2017-01-17 15:36:12 UTC
Seems to be related to: https://github.com/kubernetes/kubernetes/issues/26897 or https://github.com/kubernetes/kubernetes/pull/34831

Do you have --hostname-override set?

dcbw: Do you have any insight?

Comment 2 Ben Bennett 2017-01-30 19:23:05 UTC
Closing due to inactivity.  If you can check the above configuration suggestion and come back with more information, please feel free to reopen.