Bug 1697277
Summary: | octavia services use more cpu after each performance iteration | ||
---|---|---|---|
Product: | Red Hat OpenStack | Reporter: | Carlos Goncalves <cgoncalves> |
Component: | openstack-octavia | Assignee: | Carlos Goncalves <cgoncalves> |
Status: | CLOSED ERRATA | QA Contact: | Bruna Bonguardo <bbonguar> |
Severity: | high | Docs Contact: | |
Priority: | high | ||
Version: | 13.0 (Queens) | CC: | astafeye, cgoncalves, ihrachys, jtaleric, lpeer, majopela, scohen |
Target Milestone: | z7 | Keywords: | Triaged, ZStream |
Target Release: | 13.0 (Queens) | ||
Hardware: | Unspecified | ||
OS: | Unspecified | ||
Whiteboard: | scale_lab | ||
Fixed In Version: | openstack-octavia-2.0.4-5 | Doc Type: | If docs needed, set a value |
Doc Text: | Story Points: | --- | |
Clone Of: | 1661575 | Environment: | |
Last Closed: | 2019-07-10 13:02:00 UTC | Type: | --- |
Regression: | --- | Mount Type: | --- |
Documentation: | --- | CRM: | |
Verified Versions: | Category: | --- | |
oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
Cloudforms Team: | --- | Target Upstream Version: | |
Embargoed: | |||
Bug Depends On: | 1661575 | ||
Bug Blocks: |
Description
Carlos Goncalves
2019-04-08 09:28:13 UTC
(overcloud) [stack@undercloud-0 ~]$ cat /etc/yum.repos.d/latest-installed 13 -p 2019-06-13.2 (overcloud) [stack@undercloud-0 ~]$ rpm -qa | grep octavia octavia-amphora-image-x86_64-13.0-20190610.2.el7ost.noarch puppet-octavia-12.4.0-9.el7ost.noarch octavia-amphora-image-13.0-20190610.2.el7ost.noarch python2-octaviaclient-1.4.0-1.1.el7ost.noarch ***Verification steps: *After the creation of 3 Load Balancers with a listener each: [2019-06-19 06:29:22] (tester) [stack@undercloud-0 ~]$ openstack loadbalancer list +--------------------------------------+--------+----------------------------------+-------------+---------------------+----------+ | id | name | project_id | vip_address | provisioning_status | provider | +--------------------------------------+--------+----------------------------------+-------------+---------------------+----------+ | 05ae5d5f-6939-4c51-b909-a947011a1e9f | first | f0229de8ca8e4670b5982bb7980d2dda | 10.0.1.18 | ACTIVE | octavia | | 1f243cd6-2249-4d25-bdb2-69321ef88da2 | second | f0229de8ca8e4670b5982bb7980d2dda | 10.0.1.21 | ACTIVE | octavia | | 1d381474-b4a8-492c-9295-007a7ca40996 | third | f0229de8ca8e4670b5982bb7980d2dda | 10.0.1.11 | ACTIVE | octavia | +--------------------------------------+--------+----------------------------------+-------------+---------------------+----------+ [2019-06-19 06:29:29] (tester) [stack@undercloud-0 ~]$ openstack loadbalancer listener list +--------------------------------------+-----------------+--------------------+----------------------------------+----------+---------------+----------------+ | id | default_pool_id | name | project_id | protocol | protocol_port | admin_state_up | +--------------------------------------+-----------------+--------------------+----------------------------------+----------+---------------+----------------+ | fcb23f0a-d4b7-427a-ac57-0691d6b23810 | None | listenerHTTPfirst | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 80 | True | | 04034aee-701b-4de5-9b69-06cf033a0406 | None | listenerHTTPsecond | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 80 | True | | e58f24d9-135b-4438-8cc4-39ca6e12ab4a | None | listenerHTTPthird | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 80 | True | +--------------------------------------+-----------------+--------------------+----------------------------------+----------+---------------+---------------- *While creating 9 MORE Load Balancers with 3 listeners each. *After creating a total of 12 Load Balancers and 30 listeners. [2019-06-19 09:03:42] (tester) [stack@undercloud-0 ~]$ openstack loadbalancer list +--------------------------------------+--------+----------------------------------+-------------+---------------------+----------+ | id | name | project_id | vip_address | provisioning_status | provider | +--------------------------------------+--------+----------------------------------+-------------+---------------------+----------+ | 05ae5d5f-6939-4c51-b909-a947011a1e9f | first | f0229de8ca8e4670b5982bb7980d2dda | 10.0.1.18 | ACTIVE | octavia | | 1f243cd6-2249-4d25-bdb2-69321ef88da2 | second | f0229de8ca8e4670b5982bb7980d2dda | 10.0.1.21 | ACTIVE | octavia | | 1d381474-b4a8-492c-9295-007a7ca40996 | third | f0229de8ca8e4670b5982bb7980d2dda | 10.0.1.11 | ACTIVE | octavia | | 6c24915f-36df-4c5c-992c-019c43ae23c6 | LB-1 | f0229de8ca8e4670b5982bb7980d2dda | 10.0.1.5 | ACTIVE | octavia | | 1ad180ff-8c93-4b59-8ac0-7553f5b8c691 | LB-2 | f0229de8ca8e4670b5982bb7980d2dda | 10.0.1.34 | ACTIVE | octavia | | 3570476c-8d4b-4c36-9c41-0ca3f9e26d59 | LB-3 | f0229de8ca8e4670b5982bb7980d2dda | 10.0.1.22 | ACTIVE | octavia | | 222c73d3-565b-4d15-a83e-ed3731fd8bfe | LB-4 | f0229de8ca8e4670b5982bb7980d2dda | 10.0.1.37 | ACTIVE | octavia | | cea9bec9-733f-4993-a287-edb8fcd79345 | LB-5 | f0229de8ca8e4670b5982bb7980d2dda | 10.0.1.16 | ACTIVE | octavia | | c8c64526-bb31-4f6b-be6f-35bdde5c4b69 | LB-6 | f0229de8ca8e4670b5982bb7980d2dda | 10.0.1.29 | ACTIVE | octavia | | 6ef6d4ea-3394-4b9b-a578-c8272d6ae606 | LB-7 | f0229de8ca8e4670b5982bb7980d2dda | 10.0.1.28 | ACTIVE | octavia | | f2b01e76-39dd-4f60-9291-6bc4b429f1ee | LB-8 | f0229de8ca8e4670b5982bb7980d2dda | 10.0.1.33 | ACTIVE | octavia | | fb80bc85-f6e0-423c-97e8-95a1040e820c | LB-9 | f0229de8ca8e4670b5982bb7980d2dda | 10.0.1.19 | ACTIVE | octavia | +--------------------------------------+--------+----------------------------------+-------------+---------------------+----------+ [2019-06-19 09:10:08] (tester) [stack@undercloud-0 ~]$ openstack loadbalancer listener list +--------------------------------------+-----------------+--------------------+----------------------------------+----------+---------------+----------------+ | id | default_pool_id | name | project_id | protocol | protocol_port | admin_state_up | +--------------------------------------+-----------------+--------------------+----------------------------------+----------+---------------+----------------+ | fcb23f0a-d4b7-427a-ac57-0691d6b23810 | None | listenerHTTPfirst | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 80 | True | | 04034aee-701b-4de5-9b69-06cf033a0406 | None | listenerHTTPsecond | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 80 | True | | e58f24d9-135b-4438-8cc4-39ca6e12ab4a | None | listenerHTTPthird | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 80 | True | | 0b5713a3-db44-4b26-934f-9823b65d9332 | None | listenerHTTP-1-1 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 80 | True | | 5386ca86-f6da-4ab7-aaab-bac22241e893 | None | listenerHTTP-1-2 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 81 | True | | 544e0a9f-1d6e-4a6a-aa21-50ff189b8701 | None | listenerHTTP-1-3 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 82 | True | | 0b726c8e-e5bc-455b-839c-0fde11291f2b | None | listenerHTTP-2-1 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 83 | True | | 6a0de29f-fd38-4a4e-a187-136b37c3d53e | None | listenerHTTP-2-2 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 84 | True | | 94179047-8061-468b-a14c-4ae1020b4131 | None | listenerHTTP-2-3 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 85 | True | | e83b208b-011a-49e3-bc74-5b2454fb9a60 | None | listenerHTTP-3-1 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 86 | True | | 86410cc4-4c29-4f1a-86d0-2f161868399a | None | listenerHTTP-3-2 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 87 | True | | fdb3eb55-d679-4ce8-89cb-4084d4acf5d0 | None | listenerHTTP-3-3 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 88 | True | | b0932f28-c81e-40ea-89d8-ea6d5ec1c4f3 | None | listenerHTTP-4-1 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 89 | True | | 01b53c3e-c466-4b15-9711-7aeb6c00bcbd | None | listenerHTTP-4-2 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 90 | True | | 1b8ed5d2-ab0a-4a8f-a4c9-bdae99e20956 | None | listenerHTTP-4-3 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 91 | True | | fc928c90-bd96-4637-9cfe-53a919671aa5 | None | listenerHTTP-5-1 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 92 | True | | 005fee6a-8a23-4cbb-bb49-61bcd871397b | None | listenerHTTP-5-2 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 93 | True | | 36d4ebeb-4c1b-4300-aa0c-744c062c0e9f | None | listenerHTTP-5-3 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 94 | True | | 98879610-3e50-4938-92d3-8a51ad616685 | None | listenerHTTP-6-1 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 95 | True | | b155d2d7-0630-42d0-9ab6-9ad7669b36fb | None | listenerHTTP-6-2 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 96 | True | | 04de25dd-1b71-45e4-9c16-64f291a33cd2 | None | listenerHTTP-6-3 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 97 | True | | 96acec1c-0c53-473a-8042-9a529aab6585 | None | listenerHTTP-7-1 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 98 | True | | d0a2df95-8389-4b7a-89e0-36e8d36b0262 | None | listenerHTTP-7-2 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 99 | True | | 3587e965-08ef-480b-b0e1-5b16d4a53340 | None | listenerHTTP-7-3 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 100 | True | | ed11f46d-1f17-4647-933e-129def593deb | None | listenerHTTP-8-1 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 101 | True | | 5acba879-bf27-4a61-83a5-60475866641e | None | listenerHTTP-8-2 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 102 | True | | 28321ee5-6da9-47eb-98ed-93d82a67bc14 | None | listenerHTTP-8-3 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 103 | True | | 111e5212-6cdf-472f-9479-31fa93bd758f | None | listenerHTTP-9-1 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 104 | True | | bcf68ec0-84a3-46b8-b664-6decebb4f977 | None | listenerHTTP-9-2 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 105 | True | | b62a672e-e6ca-4a20-978a-feaa09a279e8 | None | listenerHTTP-9-3 | f0229de8ca8e4670b5982bb7980d2dda | HTTP | 106 | True | +--------------------------------------+-----------------+--------------------+----------------------------------+----------+---------------+----------------+ Full command output for Before, while and after the creation of the 12 Load Balancers and 30 listeners: http://pastebin.test.redhat.com/773548 I don't see any dramatic change to the cpu or memory in the controller/compute nodes. Moving the bug to VERIFIED. Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2019:1744 |