Bug 1875491

Summary: Listener creation failed because no LoadBalancer found
Product: OpenShift Container Platform Reporter: rlobillo
Component: NetworkingAssignee: Maysa Macedo <mdemaced>
Networking sub component: kuryr QA Contact: GenadiC <gcheresh>
Status: VERIFIED --- Docs Contact:
Severity: high    
Priority: medium CC: mdemaced
Version: 4.6   
Target Milestone: ---   
Target Release: 4.6.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Bug Depends On: 1878725    
Bug Blocks:    
Attachments:
Description Flags
kuryr-controller logs
none
NP results for verification none

Description rlobillo 2020-09-03 15:28:36 UTC
Created attachment 1713641 [details]
kuryr-controller logs

Description of problem:

While running NP, below exception appears on kuryr-controller:

2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2 [-] Listener creation failed, most probably because protocol TCP is not supported: openstack.exceptions.ResourceNotFound: No LoadBalancer found for 8fa6ce23-7385-40dd-8eb0-deb46ade2a1d: Client Error for url: https://10.46.22.71:13876/v2.0/lbaas/loadbalancers/8fa6ce23-7385-40dd-8eb0-deb46ade2a1d, Not Found
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2 Traceback (most recent call last):
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2   File "/usr/lib/python3.6/site-packages/kuryr_kubernetes/controller/drivers/lbaasv2.py", line 342, in ensure_listener
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2     self._find_listener, _LB_STS_POLL_SLOW_INTERVAL)
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2   File "/usr/lib/python3.6/site-packages/kuryr_kubernetes/controller/drivers/lbaasv2.py", line 668, in _ensure_provisioned
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2     self._wait_for_provisioning(loadbalancer, remaining, interval)
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2   File "/usr/lib/python3.6/site-packages/kuryr_kubernetes/controller/drivers/lbaasv2.py", line 698, in _wait_for_provisioning
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2     response = lbaas.get_load_balancer(loadbalancer['id'])
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2   File "/usr/lib/python3.6/site-packages/openstack/load_balancer/v2/_proxy.py", line 58, in get_load_balancer
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2     return self._get(_lb.LoadBalancer, *attrs)
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2   File "/usr/lib/python3.6/site-packages/openstack/proxy.py", line 46, in check
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2     return method(self, expected, actual, *args, **kwargs)
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2   File "/usr/lib/python3.6/site-packages/openstack/proxy.py", line 508, in _get
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2     resource_type=resource_type.__name__, value=value))
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2   File "/usr/lib/python3.6/site-packages/openstack/resource.py", line 1416, in fetch
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2     self._translate_response(response, **kwargs)
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2   File "/usr/lib/python3.6/site-packages/openstack/resource.py", line 1113, in _translate_response
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2     exceptions.raise_from_response(response, error_message=error_message)
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2   File "/usr/lib/python3.6/site-packages/openstack/exceptions.py", line 235, in raise_from_response
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2     http_status=http_status, request_id=request_id
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2 openstack.exceptions.ResourceNotFound: No LoadBalancer found for 8fa6ce23-7385-40dd-8eb0-deb46ade2a1d: Client Error for url: https://10.46.22.71:13876/v2.0/lbaas/loadbalancers/8fa6ce23-7385-40dd-8eb0-deb46ade2a1d, Not Found
2020-09-03 11:18:01.072 1 ERROR kuryr_kubernetes.controller.drivers.lbaasv2


Version-Release number of selected component (if applicable):
OCP4.6.0-0.nightly-2020-09-03-063148

How reproducible: 


Steps to Reproduce:
1. Install latest OCP.6 over OSP16.1 (ovn-octavia)
2. Run NP tests.
3.

Actual results: 


Expected results: No exception like that should be observed.


Additional info: kuryr-controller logs attached.

Comment 2 rlobillo 2020-09-17 16:28:28 UTC
Verified on 4.6.0-0.nightly-2020-09-17-073141 over OSP RHOS-16.1-RHEL-8-20200903.n.0

NP test run with expected results. No exceptions observed:

[stack@undercloud-0 ~]$ oc get pods -n openshift-kuryr
NAME                                READY   STATUS    RESTARTS   AGE
kuryr-cni-7869s                     1/1     Running   0          3h17m
kuryr-cni-7lgg6                     1/1     Running   0          3h16m
kuryr-cni-n6lwn                     1/1     Running   0          3h14m
kuryr-cni-v4ccn                     1/1     Running   0          3h17m
kuryr-cni-wdnxk                     1/1     Running   0          3h15m
kuryr-cni-xkvcr                     1/1     Running   0          3h14m
kuryr-controller-66469ccbb9-bbmph   1/1     Running   1          173m
[stack@undercloud-0 ~]$ oc logs -n openshift-kuryr kuryr-controller-66469ccbb9-bbmph | grep "No LoadBalancer found"
[stack@undercloud-0 ~]$ oc logs -n openshift-kuryr kuryr-controller-66469ccbb9-bbmph -p | grep "No LoadBalancer found"

Attaching NP results.

Comment 3 rlobillo 2020-09-17 16:29:50 UTC
Created attachment 1715251 [details]
NP results for verification