Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1724798

Summary:	Octavia loadbalancer shows ACTIVE/OFFLINE and members show as NO_MONITOR even though healthmonitor is attached and loadbalancer works.
Product:	Red Hat OpenStack	Reporter:	Andreas Karis <akaris>
Component:	openstack-octavia	Assignee:	Gregory Thiemonge <gthiemon>
Status:	CLOSED WORKSFORME	QA Contact:	Bruna Bonguardo <bbonguar>
Severity:	unspecified	Docs Contact:
Priority:	unspecified
Version:	13.0 (Queens)	CC:	cgoncalves, ihrachys, lpeer, majopela, michjohn, pmannidi, scohen
Target Milestone:	---
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2019-08-21 14:11:52 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Andreas Karis 2019-06-27 20:08:48 UTC

Description of problem:
Octavia loadbalancer shows ACTIVE/OFFLINE and members show as NO_MONITOR even though healthmonitor is attached and loadbalancer works.

Version-Release number of selected component (if applicable):
[akaris@collab-shell sosreport-20190625-141216]$ find . -name installed-rpms | xargs grep octavia 
./controller0/installed-rpms:openstack-octavia-api-2.0.2-2.el7ost.noarch                 Mon Dec 10 14:53:56 2018
./controller0/installed-rpms:openstack-octavia-common-2.0.2-2.el7ost.noarch              Mon Dec 10 14:48:50 2018
./controller0/installed-rpms:openstack-octavia-health-manager-2.0.2-2.el7ost.noarch      Mon Dec 10 14:53:56 2018
./controller0/installed-rpms:openstack-octavia-housekeeping-2.0.2-2.el7ost.noarch        Mon Dec 10 14:53:56 2018
./controller0/installed-rpms:openstack-octavia-worker-2.0.2-2.el7ost.noarch              Mon Dec 10 14:53:56 2018
./controller0/installed-rpms:puppet-octavia-12.4.0-3.el7ost.noarch                       Mon Dec 10 14:48:22 2018
./controller0/installed-rpms:python2-octaviaclient-1.4.0-1.el7ost.noarch                 Wed Sep  5 14:25:09 2018
./controller0/installed-rpms:python-octavia-2.0.2-2.el7ost.noarch                        Mon Dec 10 14:48:50 2018
./controller2/installed-rpms:openstack-octavia-api-2.0.2-2.el7ost.noarch                 Mon Dec 10 14:36:25 2018
./controller2/installed-rpms:openstack-octavia-common-2.0.2-2.el7ost.noarch              Mon Dec 10 14:31:22 2018
./controller2/installed-rpms:openstack-octavia-health-manager-2.0.2-2.el7ost.noarch      Mon Dec 10 14:36:25 2018
./controller2/installed-rpms:openstack-octavia-housekeeping-2.0.2-2.el7ost.noarch        Mon Dec 10 14:36:25 2018
./controller2/installed-rpms:openstack-octavia-worker-2.0.2-2.el7ost.noarch              Mon Dec 10 14:36:25 2018
./controller2/installed-rpms:puppet-octavia-12.4.0-3.el7ost.noarch                       Mon Dec 10 14:30:58 2018
./controller2/installed-rpms:python2-octaviaclient-1.4.0-1.el7ost.noarch                 Wed Sep  5 14:25:09 2018
./controller2/installed-rpms:python-octavia-2.0.2-2.el7ost.noarch                        Mon Dec 10 14:31:22 2018
./controller1/installed-rpms:openstack-octavia-api-2.0.2-2.el7ost.noarch                 Mon Dec 10 13:47:00 2018
./controller1/installed-rpms:openstack-octavia-common-2.0.2-2.el7ost.noarch              Mon Dec 10 13:42:02 2018
./controller1/installed-rpms:openstack-octavia-health-manager-2.0.2-2.el7ost.noarch      Mon Dec 10 13:47:00 2018
./controller1/installed-rpms:openstack-octavia-housekeeping-2.0.2-2.el7ost.noarch        Mon Dec 10 13:47:00 2018
./controller1/installed-rpms:openstack-octavia-worker-2.0.2-2.el7ost.noarch              Mon Dec 10 13:47:00 2018
./controller1/installed-rpms:puppet-octavia-12.4.0-3.el7ost.noarch                       Mon Dec 10 13:41:35 2018
./controller1/installed-rpms:python2-octaviaclient-1.4.0-1.el7ost.noarch                 Wed Sep  5 14:25:09 2018
./controller1/installed-rpms:python-octavia-2.0.2-2.el7ost.noarch                        Mon Dec 10 13:42:02 2018
./amphora-5c1fda0c-5b6c-416f-bd96-61af65325d49/installed-rpms:openstack-octavia-amphora-agent-2.0.2-2.el7ost.noarch       Wed Nov  7 15:56:37 2018
./amphora-5c1fda0c-5b6c-416f-bd96-61af65325d49/installed-rpms:openstack-octavia-common-2.0.2-2.el7ost.noarch              Wed Nov  7 15:56:37 2018
./amphora-5c1fda0c-5b6c-416f-bd96-61af65325d49/installed-rpms:python-octavia-2.0.2-2.el7ost.noarch                        Wed Nov  7 15:56:35 2018

How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

~~~
(overcloud) # openstack loadbalancer pool show 2ba6e23a-4daf-4ef6-8b35-415ad921395e
+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| admin_state_up      | True                                 |
| created_at          | 2019-06-25T16:53:53                  |
| description         |                                      |
| healthmonitor_id    | 563c1558-d841-47d5-8415-de58e9a81e8e |
| id                  | 2ba6e23a-4daf-4ef6-8b35-415ad921395e |
| lb_algorithm        | ROUND_ROBIN                          |
| listeners           | 7398c300-4111-49c7-a96b-fb4c39d811ad |
| loadbalancers       | 4b649e47-c572-498c-9a8e-0f7e955daab0 |
| members             | 8cddec32-c0a8-4687-af5a-05f4292a5e0b |
|                     | 58bab3b0-4dc1-45fb-84dd-60d1030d391e |
| name                | Pool 1                               |
| operating_status    | OFFLINE                              |
| project_id          | 924aff92b04745468fd65081ba318cb4     |
| protocol            | TCP                                  |
| provisioning_status | ACTIVE                               |
| session_persistence | None                                 |
| updated_at          | 2019-06-25T18:07:40                  |
+---------------------+--------------------------------------+
(overcloud) # openstack loadbalancer pool show 2ba6e23a-4daf-4ef6-8b35-415ad921395e
+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| admin_state_up      | True                                 |
| created_at          | 2019-06-25T16:53:53                  |
| description         |                                      |
| healthmonitor_id    | 563c1558-d841-47d5-8415-de58e9a81e8e |
| id                  | 2ba6e23a-4daf-4ef6-8b35-415ad921395e |
| lb_algorithm        | ROUND_ROBIN                          |
| listeners           | 7398c300-4111-49c7-a96b-fb4c39d811ad |
| loadbalancers       | 4b649e47-c572-498c-9a8e-0f7e955daab0 |
| members             | 8cddec32-c0a8-4687-af5a-05f4292a5e0b |
|                     | 58bab3b0-4dc1-45fb-84dd-60d1030d391e |
| name                | Pool 1                               |
| operating_status    | OFFLINE                              |
| project_id          | 924aff92b04745468fd65081ba318cb4     |
| protocol            | TCP                                  |
| provisioning_status | ACTIVE                               |
| session_persistence | None                                 |
| updated_at          | 2019-06-25T18:07:40                  |
(overcloud) # openstack loadbalancer listener show 7398c300-4111-49c7-a96b-fb4c39d811ad
+---------------------------+--------------------------------------+
| Field                     | Value                                |
+---------------------------+--------------------------------------+
| admin_state_up            | True                                 |
| connection_limit          | -1                                   |
| created_at                | 2019-06-25T16:53:49                  |
| default_pool_id           | 2ba6e23a-4daf-4ef6-8b35-415ad921395e |
| default_tls_container_ref | None                                 |
| description               |                                      |
| id                        | 7398c300-4111-49c7-a96b-fb4c39d811ad |
| insert_headers            | None                                 |
| l7policies                |                                      |
| loadbalancers             | 4b649e47-c572-498c-9a8e-0f7e955daab0 |
| name                      | Listener 1                           |
| operating_status          | OFFLINE                              |
| project_id                | 924aff92b04745468fd65081ba318cb4     |
| protocol                  | TCP                                  |
| protocol_port             | 443                                  |
| provisioning_status       | ACTIVE                               |
| sni_container_refs        | []                                   |
| updated_at                | 2019-06-25T18:07:40                  |
+---------------------------+--------------------------------------+
(overcloud) # for i in 58bab3b0-4dc1-45fb-84dd-60d1030d391e   8cddec32-c0a8-4687-af5a-05f4292a5e0b ; do openstack loadbalancer member show 2ba6e23a-4daf-4ef6-8b35-415ad921395e $i; done
+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| address             | 10.47.169.137                        |
| admin_state_up      | True                                 |
| created_at          | 2019-06-25T16:53:57                  |
| id                  | 58bab3b0-4dc1-45fb-84dd-60d1030d391e |
| name                |                                      |
| operating_status    | NO_MONITOR                           |
| project_id          | 924aff92b04745468fd65081ba318cb4     |
| protocol_port       | 443                                  |
| provisioning_status | ACTIVE                               |
| subnet_id           | ed2ae419-93b4-459e-8dba-2231b141f9db |
| updated_at          | 2019-06-25T16:53:59                  |
| weight              | 1                                    |
| monitor_port        | None                                 |
| monitor_address     | None                                 |
+---------------------+--------------------------------------+
+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| address             | 10.47.144.97                         |
| admin_state_up      | True                                 |
| created_at          | 2019-06-25T16:54:01                  |
| id                  | 8cddec32-c0a8-4687-af5a-05f4292a5e0b |
| name                |                                      |
| operating_status    | NO_MONITOR                           |
| project_id          | 924aff92b04745468fd65081ba318cb4     |
| protocol_port       | 443                                  |
| provisioning_status | ACTIVE                               |
| subnet_id           | ed2ae419-93b4-459e-8dba-2231b141f9db |
| updated_at          | 2019-06-25T16:54:03                  |
| weight              | 1                                    |
| monitor_port        | None                                 |
| monitor_address     | None                                 |
+---------------------+--------------------------------------+
(overcloud) # openstack loadbalancer healthmonitor show 563c1558-d841-47d5-8415-de58e9a81e8e
+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| project_id          | 924aff92b04745468fd65081ba318cb4     |
| name                |                                      |
| admin_state_up      | True                                 |
| pools               | 2ba6e23a-4daf-4ef6-8b35-415ad921395e |
| created_at          | 2019-06-25T18:07:40                  |
| provisioning_status | ACTIVE                               |
| updated_at          | 2019-06-25T18:07:40                  |
| delay               | 5                                    |
| expected_codes      | None                                 |
| max_retries         | 3                                    |
| http_method         | None                                 |
| timeout             | 5                                    |
| max_retries_down    | 3                                    |
| url_path            | None                                 |
| type                | TCP                                  |
| id                  | 563c1558-d841-47d5-8415-de58e9a81e8e |
| operating_status    | ONLINE                               |
+---------------------+--------------------------------------+
~~~

Octavia configuration looks ok:
~~~
[amphora-5c1fda0c-5b6c-416f-bd96-61af65325d49]$ cat var/lib/octavia/7398c300-4111-49c7-a96b-fb4c39d811ad/haproxy.cfg 
# Configuration for Load Balancer 2
global
    daemon
    user nobody
    log /dev/log local0
    log /dev/log local1 notice
    stats socket /var/lib/octavia/7398c300-4111-49c7-a96b-fb4c39d811ad.sock mode 0666 level user
    maxconn 1000000

defaults
    log global
    retries 3
    option redispatch
    timeout connect 5000
    timeout client 50000
    timeout server 50000



frontend 7398c300-4111-49c7-a96b-fb4c39d811ad
    option tcplog
    maxconn 1000000
    bind 10.47.144.235:443
    mode tcp
    default_backend 2ba6e23a-4daf-4ef6-8b35-415ad921395e

backend 2ba6e23a-4daf-4ef6-8b35-415ad921395e
    mode tcp
    balance roundrobin
    timeout check 5s
    fullconn 1000000
    server 8cddec32-c0a8-4687-af5a-05f4292a5e0b 10.47.144.97:443 weight 1 check inter 5s fall 3 rise 3
    server 58bab3b0-4dc1-45fb-84dd-60d1030d391e 10.47.169.137:443 weight 1 check inter 5s fall 3 rise 3
~~~

Comment 6 Red Hat Bugzilla 2023-09-14 05:31:00 UTC

The needinfo request[s] on this closed bug have been removed as they have been unresolved for 1000 days