Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 1460228 Details for
Bug 1602350
[OCP on OSP via kuryr] Got invalid status code from CNI daemon
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
Octavia - worker log
worker.log (text/plain), 1.86 MB, created by
Jon Uriarte
on 2018-07-19 14:20:23 UTC
(
hide
)
Description:
Octavia - worker log
Filename:
MIME Type:
Creator:
Jon Uriarte
Created:
2018-07-19 14:20:23 UTC
Size:
1.86 MB
patch
obsolete
>2018-06-24 17:35:38.118 1 INFO octavia.common.config [-] Logging enabled! >2018-06-24 17:35:38.118 1 INFO octavia.common.config [-] /usr/bin/octavia-worker version 2.0.1 >2018-06-24 17:35:38.130 24 INFO octavia.controller.queue.consumer [-] Starting consumer... >2018-06-24 17:40:25.905 1 INFO cotyledon._service_manager [-] Caught SIGTERM signal, graceful exiting of master process >2018-06-24 17:40:25.907 24 INFO cotyledon._service [-] Caught SIGTERM signal, graceful exiting of service ConsumerService(0) [24] >2018-06-24 17:40:25.908 24 INFO octavia.controller.queue.consumer [-] Stopping consumer... >2018-06-24 17:40:36.550 1 INFO octavia.common.config [-] Logging enabled! >2018-06-24 17:40:36.550 1 INFO octavia.common.config [-] /usr/bin/octavia-worker version 2.0.1 >2018-06-24 17:40:36.560 23 INFO octavia.controller.queue.consumer [-] Starting consumer... >2018-06-25 17:05:38.230 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer '9c094cbd-8b76-4b80-9963-838bf1d6d17a'... >2018-06-25 17:05:38.676 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id f5928268-7b3d-4f4e-ac55-3899b5d6d8e0 >2018-06-25 17:05:38.827 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally. >2018-06-25 17:05:38.827 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config. >2018-06-25 17:05:38.827 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config. >2018-06-25 17:05:38.828 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config. >2018-06-25 17:06:17.688 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: f5928268-7b3d-4f4e-ac55-3899b5d6d8e0 with compute id 2e1ce231-1060-4c76-a0ce-2fc1369de7c4 for load balancer: 9c094cbd-8b76-4b80-9963-838bf1d6d17a >2018-06-25 17:06:18.526 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port 83207c56-e4e4-4afc-b7c1-ea405f26d4e6 already exists. Nothing to be done. >2018-06-25 17:06:24.745 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.4', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.0.1 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47081bd610>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-06-25 17:06:35.592 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: 9c094cbd-8b76-4b80-9963-838bf1d6d17a >2018-06-25 17:06:35.925 23 INFO octavia.controller.queue.endpoint [-] Creating pool 'feed960d-2f52-4ba3-97d8-638b48165ae2'... >2018-06-25 17:06:37.446 23 INFO octavia.controller.queue.endpoint [-] Creating listener '92a6b9f2-c799-4007-9d62-f0e0644e29f5'... >2018-06-25 17:06:38.630 23 INFO octavia.controller.queue.endpoint [-] Creating listener '93dbb899-9a00-4fd3-b8d1-1d27b28bf3c0'... >2018-06-25 17:07:00.198 23 INFO octavia.controller.queue.endpoint [req-faf0088d-b0b4-4be1-89f5-0d894d52e37a - 6730069018ad4583bba11c467ec9bd3b - - -] Creating member 'a05a2d51-8c29-44aa-9200-f01f54c8ab6e'... >2018-06-25 17:07:01.490 23 INFO octavia.controller.queue.endpoint [req-20d46a55-8a4a-4243-9931-d3aaa6b0f40f - 6730069018ad4583bba11c467ec9bd3b - - -] Creating member '533558f1-deaf-4ad3-ba57-e52b3657d543'... >2018-06-25 17:07:02.924 23 INFO octavia.controller.queue.endpoint [req-8195a121-9a0c-41a9-894c-27c2386ab273 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating member '2123986a-9cad-4191-97be-c86353417fcf'... >2018-06-26 15:27:11.354 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer '77a22b82-5a61-42b8-a74e-fe183b0530a4'... >2018-06-26 15:27:11.456 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id 974016f5-4990-4f24-a82d-7a6346afa58b >2018-06-26 15:27:11.471 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally. >2018-06-26 15:27:11.471 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config. >2018-06-26 15:27:11.471 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config. >2018-06-26 15:27:11.471 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config. >2018-06-26 15:27:28.374 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: 974016f5-4990-4f24-a82d-7a6346afa58b with compute id ffbbceaf-ef45-40a6-ad71-ebd9cfa2c78d for load balancer: 77a22b82-5a61-42b8-a74e-fe183b0530a4 >2018-06-26 15:27:29.304 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port e6913ad4-1bb3-4e07-b98f-0c7d70fa746e already exists. Nothing to be done. >2018-06-26 15:27:35.596 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.10', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.48.128 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47080827d0>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-06-26 15:27:45.186 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: 77a22b82-5a61-42b8-a74e-fe183b0530a4 >2018-06-26 15:27:53.595 23 INFO octavia.controller.queue.endpoint [-] Creating listener '4f442891-4c5a-4459-8379-d65e4ecba9c5'... >2018-06-26 15:27:58.863 23 INFO octavia.controller.queue.endpoint [-] Creating listener 'e2b36944-0559-4b6a-8e5f-f2c735cb824a'... >2018-06-26 15:28:03.863 23 INFO octavia.controller.queue.endpoint [-] Creating listener '1d2e2437-6408-45e0-99f2-a311cd12bc8d'... >2018-06-26 15:28:09.013 23 INFO octavia.controller.queue.endpoint [-] Creating pool '08a832e2-5621-4c17-936b-c816918e5ef3'... >2018-06-26 15:28:14.178 23 INFO octavia.controller.queue.endpoint [req-37761f34-c3c8-4799-a3d8-5fe2b86fe684 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating pool 'e9d9fdda-0d72-42b1-81c7-0753cf27da79'... >2018-06-26 15:28:19.291 23 INFO octavia.controller.queue.endpoint [-] Creating pool 'b2d074eb-855b-4c09-97c1-a6accb814bd8'... >2018-06-26 15:28:24.842 23 INFO octavia.controller.queue.endpoint [-] Creating member '20988d6e-de74-43c9-b7a8-628c62867d70'... >2018-06-26 15:28:29.705 23 INFO octavia.controller.queue.endpoint [-] Creating member 'f36ba5c1-1ecb-43a0-8e7a-da262814dea0'... >2018-06-26 15:28:35.036 23 INFO octavia.controller.queue.endpoint [-] Creating member 'b23f49af-baad-45e8-b75d-2fb9bb78cafb'... >2018-06-26 15:28:36.462 23 INFO octavia.controller.queue.endpoint [req-74230cd8-46ea-4fa9-ad5b-7d0da2039207 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating member 'bebf0ae6-358d-427e-a5db-2404a543264d'... >2018-06-26 15:28:42.167 23 INFO octavia.controller.queue.endpoint [-] Creating member 'd37c188f-be35-49df-99b3-da22a54f0d79'... >2018-06-26 15:28:47.533 23 INFO octavia.controller.queue.endpoint [req-1f439938-8bc5-4f58-b387-f877d0e27bfb - 6730069018ad4583bba11c467ec9bd3b - - -] Creating member '6901d2f1-b413-4c51-809c-2e3248f5b5fd'... >2018-06-28 06:26:55.327 23 INFO octavia.controller.queue.endpoint [-] Deleting member '20988d6e-de74-43c9-b7a8-628c62867d70'... >2018-06-28 06:27:04.478 23 INFO octavia.controller.queue.endpoint [-] Deleting member 'f36ba5c1-1ecb-43a0-8e7a-da262814dea0'... >2018-06-28 06:27:14.594 23 INFO octavia.controller.queue.endpoint [req-71e88743-6382-4e83-8336-7abe1efa9868 - 6730069018ad4583bba11c467ec9bd3b - - -] Deleting member 'b23f49af-baad-45e8-b75d-2fb9bb78cafb'... >2018-06-28 06:42:42.837 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer '29288579-489c-4b7b-8cdb-33f0aa81080a'... >2018-06-28 06:42:42.962 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id 9feb4e05-b485-44ca-8bad-e1a1ad4a1096 >2018-06-28 06:42:43.012 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally. >2018-06-28 06:42:43.012 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config. >2018-06-28 06:42:43.012 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config. >2018-06-28 06:42:43.013 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config. >2018-06-28 06:43:00.105 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: 9feb4e05-b485-44ca-8bad-e1a1ad4a1096 with compute id 86aa7630-1380-43cb-929f-5d0138a751cd for load balancer: 29288579-489c-4b7b-8cdb-33f0aa81080a >2018-06-28 06:43:00.828 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port c8eda54c-9929-48b3-b0b9-e4929761897b already exists. Nothing to be done. >2018-06-28 06:43:07.762 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.15', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.176.206 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470a51da50>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-06-28 06:43:17.323 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: 29288579-489c-4b7b-8cdb-33f0aa81080a >2018-06-28 06:43:25.809 23 INFO octavia.controller.queue.endpoint [req-62d273bc-74cb-42bf-8a15-49e8acb0e1e4 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating listener 'a6579302-0264-4057-9a87-31fcdb316b36'... >2018-06-28 06:43:30.789 23 INFO octavia.controller.queue.endpoint [-] Creating pool '4f8eec80-3e12-4880-b4b0-749429ad7522'... >2018-06-28 06:43:35.806 23 INFO octavia.controller.queue.endpoint [req-221fd11f-a074-40e2-b09f-dd8418efa9a0 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating member '29bae00e-5457-478b-9bf2-5678767f924c'... >2018-06-28 10:40:35.104 23 INFO octavia.controller.queue.endpoint [-] Deleting load balancer '29288579-489c-4b7b-8cdb-33f0aa81080a'... >2018-06-28 10:40:36.402 23 INFO octavia.controller.queue.endpoint [-] Deleting load balancer '77a22b82-5a61-42b8-a74e-fe183b0530a4'... >2018-06-28 10:40:38.821 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Removing security group a8dc7062-f860-497c-bd71-f307f2b1251b from port c8eda54c-9929-48b3-b0b9-e4929761897b >2018-06-28 10:40:39.110 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Removing security group aee7f360-c767-4a6f-8cbc-497e336fa1d4 from port e6913ad4-1bb3-4e07-b98f-0c7d70fa746e >2018-06-28 10:40:39.516 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Deleted security group a8dc7062-f860-497c-bd71-f307f2b1251b >2018-06-28 10:40:39.793 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Deleted security group aee7f360-c767-4a6f-8cbc-497e336fa1d4 >2018-06-28 10:41:28.968 23 INFO octavia.controller.queue.endpoint [req-d3a022fd-642e-444f-a253-a1a3b14aefab - 6730069018ad4583bba11c467ec9bd3b - - -] Deleting listener '93dbb899-9a00-4fd3-b8d1-1d27b28bf3c0'... >2018-06-28 10:41:30.068 23 INFO octavia.controller.worker.tasks.database_tasks [req-d3a022fd-642e-444f-a253-a1a3b14aefab - 6730069018ad4583bba11c467ec9bd3b - - -] Mark ACTIVE in DB for load balancer id: 9c094cbd-8b76-4b80-9963-838bf1d6d17a >2018-06-28 10:41:30.354 23 INFO octavia.controller.queue.endpoint [-] Deleting member '2123986a-9cad-4191-97be-c86353417fcf'... >2018-06-28 10:41:31.353 23 INFO octavia.controller.queue.endpoint [-] Deleting member 'a05a2d51-8c29-44aa-9200-f01f54c8ab6e'... >2018-06-28 10:41:32.444 23 INFO octavia.controller.queue.endpoint [req-4bba9f8a-96a8-414c-a8bb-029abeedc0dc - 6730069018ad4583bba11c467ec9bd3b - - -] Deleting member '533558f1-deaf-4ad3-ba57-e52b3657d543'... >2018-06-28 10:41:33.989 23 INFO octavia.controller.queue.endpoint [req-d3a022fd-642e-444f-a253-a1a3b14aefab - 6730069018ad4583bba11c467ec9bd3b - - -] Deleting listener '92a6b9f2-c799-4007-9d62-f0e0644e29f5'... >2018-06-28 10:42:13.950 23 INFO octavia.controller.worker.tasks.database_tasks [req-d3a022fd-642e-444f-a253-a1a3b14aefab - 6730069018ad4583bba11c467ec9bd3b - - -] Mark ACTIVE in DB for load balancer id: 9c094cbd-8b76-4b80-9963-838bf1d6d17a >2018-06-28 10:42:14.161 23 INFO octavia.controller.queue.endpoint [-] Deleting pool 'feed960d-2f52-4ba3-97d8-638b48165ae2'... >2018-06-28 10:42:15.317 23 INFO octavia.controller.queue.endpoint [-] Deleting load balancer '9c094cbd-8b76-4b80-9963-838bf1d6d17a'... >2018-06-28 10:42:17.249 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Removing security group 6ed9539f-5dad-43e1-a9f9-3f1be47e8945 from port 83207c56-e4e4-4afc-b7c1-ea405f26d4e6 >2018-06-28 10:42:17.884 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Deleted security group 6ed9539f-5dad-43e1-a9f9-3f1be47e8945 >2018-06-28 12:06:48.051 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer 'cc7cc346-cd0d-43dc-b439-b35cab76aade'... >2018-06-28 12:06:48.165 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id 44db8f73-0e50-4662-94a2-a916f9eb0ea6 >2018-06-28 12:06:48.241 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally. >2018-06-28 12:06:48.241 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config. >2018-06-28 12:06:48.242 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config. >2018-06-28 12:06:48.242 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config. >2018-06-28 12:07:05.304 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: 44db8f73-0e50-4662-94a2-a916f9eb0ea6 with compute id f9e67527-5754-4e85-aa4c-9ffe9f557950 for load balancer: cc7cc346-cd0d-43dc-b439-b35cab76aade >2018-06-28 12:07:06.096 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port 4bec33a4-e201-43e9-9835-f3a020b56250 already exists. Nothing to be done. >2018-06-28 12:07:13.982 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.9', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.0.1 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470066fe10>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-06-28 12:07:23.504 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: cc7cc346-cd0d-43dc-b439-b35cab76aade >2018-06-28 15:27:23.213 23 INFO octavia.controller.queue.endpoint [-] Deleting load balancer 'cc7cc346-cd0d-43dc-b439-b35cab76aade'... >2018-06-28 15:27:26.369 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Removing security group 6fa3df47-c676-4c53-bbe1-28be871514ab from port 4bec33a4-e201-43e9-9835-f3a020b56250 >2018-06-28 15:27:27.004 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Deleted security group 6fa3df47-c676-4c53-bbe1-28be871514ab >2018-06-28 15:30:38.463 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer 'e0993121-1460-44e3-8aff-48a608378f2f'... >2018-06-28 15:30:38.575 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id fa2a5c72-654e-475e-b359-4bfecc8b16a4 >2018-06-28 15:30:38.804 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally. >2018-06-28 15:30:38.804 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config. >2018-06-28 15:30:38.805 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config. >2018-06-28 15:30:38.805 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config. >2018-06-28 15:30:54.006 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: fa2a5c72-654e-475e-b359-4bfecc8b16a4 with compute id 40985656-d51e-4c5a-818f-74ffd4048bc5 for load balancer: e0993121-1460-44e3-8aff-48a608378f2f >2018-06-28 15:30:54.324 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port 968f99f5-e704-410e-af4d-d69d5d778670 already exists. Nothing to be done. >2018-06-28 15:31:02.992 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.12', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.0.1 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47085d63d0>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-06-28 15:31:12.582 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: e0993121-1460-44e3-8aff-48a608378f2f >2018-06-28 15:31:13.582 23 INFO octavia.controller.queue.endpoint [-] Creating pool '1d74b1a2-2921-4a2c-8e82-866f87b2d74b'... >2018-06-28 15:31:15.197 23 INFO octavia.controller.queue.endpoint [-] Creating listener '2363ab8f-b50a-465e-a45c-2c6ef3cec490'... >2018-06-28 15:31:16.417 23 INFO octavia.controller.queue.endpoint [-] Creating listener '9f2304fb-df61-43a8-b60d-5718f3e39deb'... >2018-06-28 15:31:40.739 23 INFO octavia.controller.queue.endpoint [-] Creating member 'ffc3d1fd-4b48-41b3-a822-e6b742d06612'... >2018-06-28 15:31:42.273 23 INFO octavia.controller.queue.endpoint [req-16fb797f-5993-47d9-97c9-5a68d11b4a51 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'acb774d1-d44f-451f-873c-dffabdffd391'... >2018-06-28 15:31:43.498 23 INFO octavia.controller.queue.endpoint [-] Creating member 'edaadac8-e02c-41f3-aa10-d732d9101dc1'... >2018-06-28 15:47:09.069 23 INFO octavia.controller.queue.endpoint [req-397ebfb4-138d-4c83-9ffc-86054460a02f - 6730069018ad4583bba11c467ec9bd3b - - -] Deleting listener '9f2304fb-df61-43a8-b60d-5718f3e39deb'... >2018-06-28 15:47:11.300 23 INFO octavia.controller.worker.tasks.database_tasks [req-397ebfb4-138d-4c83-9ffc-86054460a02f - 6730069018ad4583bba11c467ec9bd3b - - -] Mark ACTIVE in DB for load balancer id: e0993121-1460-44e3-8aff-48a608378f2f >2018-06-28 15:47:11.620 23 INFO octavia.controller.queue.endpoint [-] Deleting listener '2363ab8f-b50a-465e-a45c-2c6ef3cec490'... >2018-06-28 15:47:12.323 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: e0993121-1460-44e3-8aff-48a608378f2f >2018-06-28 15:47:14.847 23 INFO octavia.controller.queue.endpoint [-] Deleting member 'edaadac8-e02c-41f3-aa10-d732d9101dc1'... >2018-06-28 15:47:16.877 23 INFO octavia.controller.queue.endpoint [-] Deleting member 'ffc3d1fd-4b48-41b3-a822-e6b742d06612'... >2018-06-28 15:47:18.878 23 INFO octavia.controller.queue.endpoint [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'acb774d1-d44f-451f-873c-dffabdffd391'... >2018-06-28 15:47:36.673 23 INFO octavia.controller.queue.endpoint [-] Deleting pool '1d74b1a2-2921-4a2c-8e82-866f87b2d74b'... >2018-06-28 15:47:37.828 23 INFO octavia.controller.queue.endpoint [-] Deleting load balancer 'e0993121-1460-44e3-8aff-48a608378f2f'... >2018-06-28 15:47:41.283 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Removing security group 759c43cf-59d3-48bc-90c9-0b613e02dd33 from port 968f99f5-e704-410e-af4d-d69d5d778670 >2018-06-28 15:47:42.018 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Deleted security group 759c43cf-59d3-48bc-90c9-0b613e02dd33 >2018-06-28 15:48:41.603 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer '8f5bd668-48ac-49ab-bf6d-e9d466e88857'... >2018-06-28 15:48:41.715 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id 7ac95d17-90d6-4bcf-ba81-f3b2f7a5ad6c >2018-06-28 15:48:41.837 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally. >2018-06-28 15:48:41.837 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config. >2018-06-28 15:48:41.837 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config. >2018-06-28 15:48:41.837 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config. >2018-06-28 15:48:55.319 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: 7ac95d17-90d6-4bcf-ba81-f3b2f7a5ad6c with compute id 507424e9-13d7-417f-8688-de54f9b3c5ff for load balancer: 8f5bd668-48ac-49ab-bf6d-e9d466e88857 >2018-06-28 15:48:55.663 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port 8c161b8d-33c1-4d02-a89d-7abe0c5f78b4 already exists. Nothing to be done. >2018-06-28 15:49:10.223 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: 8f5bd668-48ac-49ab-bf6d-e9d466e88857 >2018-06-28 15:49:10.626 23 INFO octavia.controller.queue.endpoint [-] Creating pool '45b4e20e-0e24-44e6-ae23-9145ec043dd0'... >2018-06-28 15:49:12.143 23 INFO octavia.controller.queue.endpoint [-] Creating listener '1c244904-ea4a-45e0-85c1-65f29bf42044'... >2018-06-28 15:49:13.323 23 INFO octavia.controller.queue.endpoint [req-397ebfb4-138d-4c83-9ffc-86054460a02f - 6730069018ad4583bba11c467ec9bd3b - - -] Creating listener 'a7d940b0-9d38-4f4c-8fe3-978ea57d23d7'... >2018-06-28 15:49:36.352 23 INFO octavia.controller.queue.endpoint [-] Creating member '8b716383-b539-45b1-84c1-5fef1806f048'... >2018-06-28 15:49:38.201 23 INFO octavia.controller.queue.endpoint [-] Creating member 'b916c752-e4f9-4c13-a079-c1287918fb25'... >2018-06-28 15:49:40.329 23 INFO octavia.controller.queue.endpoint [-] Creating member '3d20f45c-ff86-4f69-87d7-9b5fa581aa37'... >2018-06-28 15:56:33.609 23 INFO octavia.controller.queue.endpoint [req-ba50690a-337d-4646-b0a9-1071e7ec61b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '3d20f45c-ff86-4f69-87d7-9b5fa581aa37'... >2018-06-28 15:56:34.347 23 INFO octavia.controller.queue.endpoint [-] Deleting member 'b916c752-e4f9-4c13-a079-c1287918fb25'... >2018-06-28 15:56:34.851 23 INFO octavia.controller.queue.endpoint [-] Deleting member '8b716383-b539-45b1-84c1-5fef1806f048'... >2018-06-28 15:56:36.014 23 INFO octavia.controller.queue.endpoint [req-ceb22f21-9d3e-4c90-9a32-cd085942f824 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'a7d940b0-9d38-4f4c-8fe3-978ea57d23d7'... >2018-06-28 15:56:37.239 23 INFO octavia.controller.worker.tasks.database_tasks [req-ceb22f21-9d3e-4c90-9a32-cd085942f824 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 8f5bd668-48ac-49ab-bf6d-e9d466e88857 >2018-06-28 15:56:38.391 23 INFO octavia.controller.queue.endpoint [-] Deleting listener '1c244904-ea4a-45e0-85c1-65f29bf42044'... >2018-06-28 15:56:39.045 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: 8f5bd668-48ac-49ab-bf6d-e9d466e88857 >2018-06-28 15:56:49.196 23 INFO octavia.controller.queue.endpoint [req-951b777d-9d19-412f-9a91-b293d76d549e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool '45b4e20e-0e24-44e6-ae23-9145ec043dd0'... >2018-06-28 15:56:50.370 23 INFO octavia.controller.queue.endpoint [-] Deleting load balancer '8f5bd668-48ac-49ab-bf6d-e9d466e88857'... >2018-06-28 15:56:53.102 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Removing security group b65eb141-353c-4a37-8804-2d1748841fa6 from port 8c161b8d-33c1-4d02-a89d-7abe0c5f78b4 >2018-06-28 15:56:54.126 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Deleted security group b65eb141-353c-4a37-8804-2d1748841fa6 >2018-06-28 15:58:36.904 23 INFO octavia.controller.queue.endpoint [req-c652652f-f830-420e-be81-6469ab4d007a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'c7a35a44-9f7f-4fce-b410-b41ad09cccf1'... >2018-06-28 15:58:37.022 23 INFO octavia.controller.worker.tasks.database_tasks [req-c652652f-f830-420e-be81-6469ab4d007a - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id e6062006-6e20-4f21-b9c3-34b5c085ceb9 >2018-06-28 15:58:37.179 23 INFO octavia.certificates.generator.local [req-c652652f-f830-420e-be81-6469ab4d007a - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-06-28 15:58:37.179 23 INFO octavia.certificates.generator.local [req-c652652f-f830-420e-be81-6469ab4d007a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-06-28 15:58:37.179 23 INFO octavia.certificates.generator.local [req-c652652f-f830-420e-be81-6469ab4d007a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-06-28 15:58:37.180 23 INFO octavia.certificates.generator.local [req-c652652f-f830-420e-be81-6469ab4d007a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-06-28 15:58:50.457 23 INFO octavia.controller.worker.tasks.database_tasks [req-c652652f-f830-420e-be81-6469ab4d007a - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: e6062006-6e20-4f21-b9c3-34b5c085ceb9 with compute id 140cc3f7-d8e4-4ee1-be14-b9ca24177ea5 for load balancer: c7a35a44-9f7f-4fce-b410-b41ad09cccf1 >2018-06-28 15:58:50.777 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-c652652f-f830-420e-be81-6469ab4d007a - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 800480ab-a0ad-483a-997a-acb150566baa already exists. Nothing to be done. >2018-06-28 15:59:06.895 23 INFO octavia.controller.worker.tasks.database_tasks [req-c652652f-f830-420e-be81-6469ab4d007a - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: c7a35a44-9f7f-4fce-b410-b41ad09cccf1 >2018-06-28 15:59:07.910 23 INFO octavia.controller.queue.endpoint [-] Creating pool '6a1288b7-aacb-44cc-860d-667393cd9d92'... >2018-06-28 15:59:09.472 23 INFO octavia.controller.queue.endpoint [req-d4b38c84-85b0-442f-af52-d5221c81b5a9 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating listener 'a59b7237-aecf-4a1f-a6a5-463e6fbd99ad'... >2018-06-28 15:59:10.670 23 INFO octavia.controller.queue.endpoint [-] Creating listener '0e6d7746-ce99-4f6f-ac6e-d480e885393f'... >2018-06-28 15:59:31.934 23 INFO octavia.controller.queue.endpoint [-] Creating member 'fe721394-d41e-452e-9fba-996f7bb677fb'... >2018-06-28 15:59:35.011 23 INFO octavia.controller.queue.endpoint [-] Creating member '9c47f593-afbd-42a9-aa8b-d954da5b3276'... >2018-06-28 15:59:36.463 23 INFO octavia.controller.queue.endpoint [-] Creating member 'aa7a0f4d-c8cd-4ecc-9102-d77b15519dd5'... >2018-06-29 12:10:56.239 23 INFO octavia.controller.queue.endpoint [-] Deleting member 'aa7a0f4d-c8cd-4ecc-9102-d77b15519dd5'... >2018-06-29 12:10:57.189 23 INFO octavia.controller.queue.endpoint [-] Deleting member '9c47f593-afbd-42a9-aa8b-d954da5b3276'... >2018-06-29 12:10:57.822 23 INFO octavia.controller.queue.endpoint [-] Deleting listener 'a59b7237-aecf-4a1f-a6a5-463e6fbd99ad'... >2018-06-29 12:10:59.438 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: c7a35a44-9f7f-4fce-b410-b41ad09cccf1 >2018-06-29 12:11:00.059 23 INFO octavia.controller.queue.endpoint [-] Deleting listener '0e6d7746-ce99-4f6f-ac6e-d480e885393f'... >2018-06-29 12:11:00.583 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: c7a35a44-9f7f-4fce-b410-b41ad09cccf1 >2018-06-29 12:11:01.391 23 INFO octavia.controller.queue.endpoint [req-3b8358d7-0ac2-4585-aabb-0d55d5f85d95 - 6730069018ad4583bba11c467ec9bd3b - - -] Deleting member 'fe721394-d41e-452e-9fba-996f7bb677fb'... >2018-06-29 12:11:13.022 23 INFO octavia.controller.queue.endpoint [req-3b8358d7-0ac2-4585-aabb-0d55d5f85d95 - 6730069018ad4583bba11c467ec9bd3b - - -] Deleting pool '6a1288b7-aacb-44cc-860d-667393cd9d92'... >2018-06-29 12:11:14.193 23 INFO octavia.controller.queue.endpoint [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'c7a35a44-9f7f-4fce-b410-b41ad09cccf1'... >2018-06-29 12:11:17.216 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 2acdfdbe-5067-4c5b-bb1a-58168940a72a from port 800480ab-a0ad-483a-997a-acb150566baa >2018-06-29 12:11:17.899 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 2acdfdbe-5067-4c5b-bb1a-58168940a72a >2018-06-29 12:12:39.542 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer '0e02fb1e-c5a7-4ae1-9042-db47930e00ce'... >2018-06-29 12:12:39.666 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id b6b86dda-cfcf-48bd-9541-2e38701bbdfa >2018-06-29 12:12:39.819 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally. >2018-06-29 12:12:39.819 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config. >2018-06-29 12:12:39.820 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config. >2018-06-29 12:12:39.820 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config. >2018-06-29 12:12:54.180 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: b6b86dda-cfcf-48bd-9541-2e38701bbdfa with compute id f26af519-7931-4663-b92b-17c8e97ad35b for load balancer: 0e02fb1e-c5a7-4ae1-9042-db47930e00ce >2018-06-29 12:12:54.280 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port 31a6937c-e242-4b3b-9fb6-7e8a352e5004 already exists. Nothing to be done. >2018-06-29 12:13:12.954 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: 0e02fb1e-c5a7-4ae1-9042-db47930e00ce >2018-06-29 12:13:13.651 23 INFO octavia.controller.queue.endpoint [req-76a87814-06e2-4fc0-898b-c7f5403ee32e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '7d968555-a7fc-4eaa-8cc5-11cb7b04ac35'... >2018-06-29 12:13:15.213 23 INFO octavia.controller.queue.endpoint [-] Creating listener 'fafad22b-13d5-4456-8191-936d93f48cad'... >2018-06-29 12:13:16.414 23 INFO octavia.controller.queue.endpoint [req-a5ce3d62-30b9-4c56-b7ff-19acabfc0dd0 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating listener '52931e5e-c0de-4bb9-a767-5c8d0cb0f7bc'... >2018-06-29 12:13:40.217 23 INFO octavia.controller.queue.endpoint [req-1c0117f5-ddb8-42a2-bae8-29469ff88f57 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '06e4f392-62fb-4267-906a-ded836db793d'... >2018-06-29 12:13:41.686 23 INFO octavia.controller.queue.endpoint [req-76a87814-06e2-4fc0-898b-c7f5403ee32e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b4c353c4-9f96-44a1-bb49-1070bb96423a'... >2018-06-29 12:13:42.470 23 INFO octavia.controller.queue.endpoint [req-d0773a57-eafa-4e36-aac9-04f2b86d7bd9 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating member '434ea20a-bb29-4c60-8ca4-9d417045c038'... >2018-06-29 13:44:17.582 23 INFO octavia.controller.queue.endpoint [req-ef3e5d54-140a-4c4c-b21d-5ffec7dd79a3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'fafad22b-13d5-4456-8191-936d93f48cad'... >2018-06-29 13:44:18.857 23 INFO octavia.controller.worker.tasks.database_tasks [req-ef3e5d54-140a-4c4c-b21d-5ffec7dd79a3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 0e02fb1e-c5a7-4ae1-9042-db47930e00ce >2018-06-29 13:44:18.936 23 INFO octavia.controller.queue.endpoint [req-da864f61-5841-4329-a566-a10fffd0d61c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b4c353c4-9f96-44a1-bb49-1070bb96423a'... >2018-06-29 13:44:20.920 23 INFO octavia.controller.queue.endpoint [req-58b9a367-0c68-4137-bf25-199313a5bcdd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '06e4f392-62fb-4267-906a-ded836db793d'... >2018-06-29 13:44:21.959 23 INFO octavia.controller.queue.endpoint [req-e0f60885-d1dc-4a6b-ac4a-611b325f0cad - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '434ea20a-bb29-4c60-8ca4-9d417045c038'... >2018-06-29 13:44:22.584 23 INFO octavia.controller.queue.endpoint [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '52931e5e-c0de-4bb9-a767-5c8d0cb0f7bc'... >2018-06-29 13:44:23.119 23 INFO octavia.controller.worker.tasks.database_tasks [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 0e02fb1e-c5a7-4ae1-9042-db47930e00ce >2018-06-29 13:44:34.774 23 INFO octavia.controller.queue.endpoint [-] Deleting pool '7d968555-a7fc-4eaa-8cc5-11cb7b04ac35'... >2018-06-29 13:44:35.992 23 INFO octavia.controller.queue.endpoint [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '0e02fb1e-c5a7-4ae1-9042-db47930e00ce'... >2018-06-29 13:44:38.492 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 695b0143-5b84-4d58-901d-c0fd3d258822 from port 31a6937c-e242-4b3b-9fb6-7e8a352e5004 >2018-06-29 13:44:39.394 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 695b0143-5b84-4d58-901d-c0fd3d258822 >2018-06-29 13:47:38.427 23 INFO octavia.controller.queue.endpoint [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'f4d6d4f4-695c-471a-ba1b-aabb3591aa79'... >2018-06-29 13:47:38.534 23 INFO octavia.controller.worker.tasks.database_tasks [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 4516a2a4-b11d-48ad-9306-76c25bff9b43 >2018-06-29 13:47:38.644 23 INFO octavia.certificates.generator.local [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-06-29 13:47:38.644 23 INFO octavia.certificates.generator.local [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-06-29 13:47:38.645 23 INFO octavia.certificates.generator.local [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-06-29 13:47:38.645 23 INFO octavia.certificates.generator.local [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-06-29 13:47:53.714 23 INFO octavia.controller.worker.tasks.database_tasks [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 4516a2a4-b11d-48ad-9306-76c25bff9b43 with compute id 3a430979-c123-420a-90d3-c5f948fefd1b for load balancer: f4d6d4f4-695c-471a-ba1b-aabb3591aa79 >2018-06-29 13:47:54.037 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 9f41843a-651d-4957-9d80-9459e0714f82 already exists. Nothing to be done. >2018-06-29 13:48:03.815 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.3', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.0.1 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47005765d0>: Failed to establish a new connection: [Errno 113] No route to host',)) >2018-06-29 13:48:13.421 23 INFO octavia.controller.worker.tasks.database_tasks [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f4d6d4f4-695c-471a-ba1b-aabb3591aa79 >2018-06-29 13:48:14.567 23 INFO octavia.controller.queue.endpoint [req-4d260b54-44b6-4e45-82f4-5d73a941181d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '4f367b2e-0ca1-49bc-8d85-9cf8bcb4ce26'... >2018-06-29 13:48:16.127 23 INFO octavia.controller.queue.endpoint [req-916529cb-1024-42e0-b3b8-af082e6eec7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '75f37de6-d9b6-4c9f-b88a-6fc137d9c9bf'... >2018-06-29 13:48:17.361 23 INFO octavia.controller.queue.endpoint [req-5f41cc09-2629-49be-952f-d77183deb815 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating listener '6c49cbba-f210-4083-bbf9-5957921263de'... >2018-06-29 13:48:39.955 23 INFO octavia.controller.queue.endpoint [req-c2627cf8-4171-4a1f-8533-8dfc24c03fc1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5a4173f2-65da-4873-a425-b121b0c3c72d'... >2018-06-29 13:48:42.366 23 INFO octavia.controller.queue.endpoint [req-4e77ac31-7a24-4026-aff3-3910ad47ad3f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cc03118a-426e-4442-a286-eb7674eac920'... >2018-06-29 13:48:43.601 23 INFO octavia.controller.queue.endpoint [req-4d260b54-44b6-4e45-82f4-5d73a941181d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a807ec76-0904-4f4d-865d-de3ffcbd3425'... >2018-06-29 14:15:02.065 23 INFO octavia.controller.queue.endpoint [req-3b8358d7-0ac2-4585-aabb-0d55d5f85d95 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating load balancer '7eaf1e05-ea45-49ee-ad8c-006a84eb6870'... >2018-06-29 14:15:02.302 23 INFO octavia.controller.worker.tasks.database_tasks [req-3b8358d7-0ac2-4585-aabb-0d55d5f85d95 - 6730069018ad4583bba11c467ec9bd3b - - -] Created Amphora in DB with id 9353a2a8-aef7-45e5-a0ec-ee2588a61d21 >2018-06-29 14:15:02.429 23 INFO octavia.certificates.generator.local [req-3b8358d7-0ac2-4585-aabb-0d55d5f85d95 - 6730069018ad4583bba11c467ec9bd3b - - -] Signing a certificate request using OpenSSL locally. >2018-06-29 14:15:02.430 23 INFO octavia.certificates.generator.local [req-3b8358d7-0ac2-4585-aabb-0d55d5f85d95 - 6730069018ad4583bba11c467ec9bd3b - - -] Using CA Certificate from config. >2018-06-29 14:15:02.430 23 INFO octavia.certificates.generator.local [req-3b8358d7-0ac2-4585-aabb-0d55d5f85d95 - 6730069018ad4583bba11c467ec9bd3b - - -] Using CA Private Key from config. >2018-06-29 14:15:02.430 23 INFO octavia.certificates.generator.local [req-3b8358d7-0ac2-4585-aabb-0d55d5f85d95 - 6730069018ad4583bba11c467ec9bd3b - - -] Using CA Private Key Passphrase from config. >2018-06-29 14:15:15.699 23 INFO octavia.controller.worker.tasks.database_tasks [req-3b8358d7-0ac2-4585-aabb-0d55d5f85d95 - 6730069018ad4583bba11c467ec9bd3b - - -] Mark ALLOCATED in DB for amphora: 9353a2a8-aef7-45e5-a0ec-ee2588a61d21 with compute id 93874129-dbb7-45ca-a2f1-4def882eb060 for load balancer: 7eaf1e05-ea45-49ee-ad8c-006a84eb6870 >2018-06-29 14:15:16.008 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-3b8358d7-0ac2-4585-aabb-0d55d5f85d95 - 6730069018ad4583bba11c467ec9bd3b - - -] Port 121ae96a-2900-48da-8ebd-b2ae07a9ba74 already exists. Nothing to be done. >2018-06-29 14:15:33.594 23 INFO octavia.controller.worker.tasks.database_tasks [req-3b8358d7-0ac2-4585-aabb-0d55d5f85d95 - 6730069018ad4583bba11c467ec9bd3b - - -] Mark ACTIVE in DB for load balancer id: 7eaf1e05-ea45-49ee-ad8c-006a84eb6870 >2018-06-29 14:15:42.522 23 INFO octavia.controller.queue.endpoint [req-3b8358d7-0ac2-4585-aabb-0d55d5f85d95 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating listener '4722a992-e18e-42ca-8f86-3d1605949e7b'... >2018-06-29 14:15:47.427 23 INFO octavia.controller.queue.endpoint [req-966567c9-253d-4223-ad0b-13013167fc1b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '4f270a29-62cb-4f32-a90a-a0a77400c671'... >2018-06-29 14:15:52.314 23 INFO octavia.controller.queue.endpoint [req-2220f9bf-d5e0-4c2b-898d-d439a2609489 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '168707a1-4be5-4660-a836-52b0225fb346'... >2018-06-29 14:15:57.597 23 INFO octavia.controller.queue.endpoint [-] Creating pool '4c02c1e4-af59-4711-bf1d-7c59330aa99c'... >2018-06-29 14:16:03.109 23 INFO octavia.controller.queue.endpoint [req-ef3e5d54-140a-4c4c-b21d-5ffec7dd79a3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '76e48c84-9c93-4639-952e-c7c812df9d2a'... >2018-06-29 14:16:08.599 23 INFO octavia.controller.queue.endpoint [-] Creating pool '40a2be26-82d6-4753-88e8-320ee449c67f'... >2018-06-29 14:16:13.791 23 INFO octavia.controller.queue.endpoint [req-a6b58c20-c584-455e-b24d-7d12ce152167 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c720f57c-e42b-4b23-b73f-4e519aed7957'... >2018-06-29 14:16:18.984 23 INFO octavia.controller.queue.endpoint [req-e9870baa-d091-4749-b818-4ce4a3103955 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b849b1f8-ed5d-4001-8bf3-6b84b60344fa'... >2018-06-29 14:16:24.036 23 INFO octavia.controller.queue.endpoint [-] Creating member 'd06e20a3-317f-4e02-b6a8-d37e671b9845'... >2018-06-29 14:16:25.528 23 INFO octavia.controller.queue.endpoint [req-9e238a22-7546-4e4e-ae13-eea17c9d43f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7349bd0a-903e-4fee-a288-e25898e6e44a'... >2018-06-29 14:16:30.950 23 INFO octavia.controller.queue.endpoint [-] Creating member '293e35d4-5817-42c1-adf1-83e164d6adc9'... >2018-06-29 14:16:36.565 23 INFO octavia.controller.queue.endpoint [req-f3bc586a-c0e2-4fa2-8730-92c82f181abc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5a0fb5aa-4b48-4070-b8e8-c0525cc6bfe5'... >2018-06-29 14:23:38.507 23 INFO octavia.controller.queue.endpoint [req-3fb87aae-b9a1-46ff-adc3-609ea410301a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '7eaf1e05-ea45-49ee-ad8c-006a84eb6870'... >2018-06-29 14:23:41.410 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-3fb87aae-b9a1-46ff-adc3-609ea410301a - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group cbc5e04e-60e5-4a8a-b8ab-8aab69e107e0 from port 121ae96a-2900-48da-8ebd-b2ae07a9ba74 >2018-06-29 14:23:42.137 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-3fb87aae-b9a1-46ff-adc3-609ea410301a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group cbc5e04e-60e5-4a8a-b8ab-8aab69e107e0 >2018-06-29 14:24:19.922 23 INFO octavia.controller.queue.endpoint [req-91352940-3d54-479c-9e27-d9aca33116bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cc03118a-426e-4442-a286-eb7674eac920'... >2018-06-29 14:24:20.551 23 INFO octavia.controller.queue.endpoint [req-55334126-c116-49c4-b277-e9f2dff30505 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '6c49cbba-f210-4083-bbf9-5957921263de'... >2018-06-29 14:24:57.377 23 INFO octavia.controller.worker.tasks.database_tasks [req-55334126-c116-49c4-b277-e9f2dff30505 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f4d6d4f4-695c-471a-ba1b-aabb3591aa79 >2018-06-29 14:24:57.559 23 INFO octavia.controller.queue.endpoint [req-46731bdf-9345-4065-b9ae-f3b54f139b6e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5a4173f2-65da-4873-a425-b121b0c3c72d'... >2018-06-29 14:24:58.466 23 INFO octavia.controller.queue.endpoint [req-7768cf09-3ebd-424e-94e5-166427922764 - 6730069018ad4583bba11c467ec9bd3b - - -] Deleting listener '75f37de6-d9b6-4c9f-b88a-6fc137d9c9bf'... >2018-06-29 14:25:07.296 23 INFO octavia.controller.worker.tasks.database_tasks [req-7768cf09-3ebd-424e-94e5-166427922764 - 6730069018ad4583bba11c467ec9bd3b - - -] Mark ACTIVE in DB for load balancer id: f4d6d4f4-695c-471a-ba1b-aabb3591aa79 >2018-06-29 14:25:07.705 23 INFO octavia.controller.queue.endpoint [-] Deleting member 'a807ec76-0904-4f4d-865d-de3ffcbd3425'... >2018-06-29 14:25:19.924 23 INFO octavia.controller.queue.endpoint [req-3fb87aae-b9a1-46ff-adc3-609ea410301a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool '4f367b2e-0ca1-49bc-8d85-9cf8bcb4ce26'... >2018-06-29 14:25:21.031 23 INFO octavia.controller.queue.endpoint [req-3fb87aae-b9a1-46ff-adc3-609ea410301a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f4d6d4f4-695c-471a-ba1b-aabb3591aa79'... >2018-06-29 14:25:23.369 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-3fb87aae-b9a1-46ff-adc3-609ea410301a - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 913f1246-c4e2-454d-a5d5-8591c3689464 from port 9f41843a-651d-4957-9d80-9459e0714f82 >2018-06-29 14:25:24.065 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-3fb87aae-b9a1-46ff-adc3-609ea410301a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 913f1246-c4e2-454d-a5d5-8591c3689464 >2018-06-29 14:26:19.716 23 INFO octavia.controller.queue.endpoint [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'e0ff1a58-85bf-4999-8a26-380921b3c49a'... >2018-06-29 14:26:19.851 23 INFO octavia.controller.worker.tasks.database_tasks [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 270cc0f9-3a28-47fc-b930-1c6f930292b2 >2018-06-29 14:26:19.920 23 INFO octavia.certificates.generator.local [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-06-29 14:26:19.921 23 INFO octavia.certificates.generator.local [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-06-29 14:26:19.921 23 INFO octavia.certificates.generator.local [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-06-29 14:26:19.922 23 INFO octavia.certificates.generator.local [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-06-29 14:26:33.975 23 INFO octavia.controller.worker.tasks.database_tasks [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 270cc0f9-3a28-47fc-b930-1c6f930292b2 with compute id bb7cbad1-52f7-4daa-8bb7-a95cfa238a67 for load balancer: e0ff1a58-85bf-4999-8a26-380921b3c49a >2018-06-29 14:26:34.332 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 9eee905d-d531-4764-8a6c-42a59b681391 already exists. Nothing to be done. >2018-06-29 14:26:53.091 23 INFO octavia.controller.worker.tasks.database_tasks [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: e0ff1a58-85bf-4999-8a26-380921b3c49a >2018-06-29 14:26:53.803 23 INFO octavia.controller.queue.endpoint [req-61d9e956-045f-4d03-abbc-273fcb7e066a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'f2267776-207f-474d-bbb0-02a8a951f137'... >2018-06-29 14:26:55.403 23 INFO octavia.controller.queue.endpoint [req-55334126-c116-49c4-b277-e9f2dff30505 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'cb9918e0-6dae-483d-8718-e9b767106c38'... >2018-06-29 14:26:57.688 23 INFO octavia.controller.queue.endpoint [req-d3a022fd-642e-444f-a253-a1a3b14aefab - 6730069018ad4583bba11c467ec9bd3b - - -] Creating listener '2e0d5f5e-5c11-49db-af30-367a14ebc63a'... >2018-06-29 14:27:17.749 23 INFO octavia.controller.queue.endpoint [req-7b357a3b-1e07-44f1-96a1-5f87444acf3c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'db2bfb0a-daf9-4850-8846-73808d48ce72'... >2018-06-29 14:27:20.729 23 INFO octavia.controller.queue.endpoint [req-5d077fd1-3f68-4173-90b2-780f1d686496 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4ebda7ef-6f0d-4c01-a46e-8bcb02b0cc32'... >2018-06-29 14:27:22.417 23 INFO octavia.controller.queue.endpoint [req-512c4c20-4444-4769-910c-d2008fbc12ca - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '26589e2b-ad02-435c-89c8-4de4cd654b4b'... >2018-06-29 15:34:51.330 23 INFO octavia.controller.queue.endpoint [req-a3d33db1-855f-490c-ace5-85a5a362dce3 - 6730069018ad4583bba11c467ec9bd3b - - -] Deleting member 'db2bfb0a-daf9-4850-8846-73808d48ce72'... >2018-06-29 15:34:52.324 23 INFO octavia.controller.queue.endpoint [-] Deleting member '4ebda7ef-6f0d-4c01-a46e-8bcb02b0cc32'... >2018-06-29 15:34:52.972 23 INFO octavia.controller.queue.endpoint [req-0bf10ec8-4509-4fa7-908e-d5e7cf489c37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'cb9918e0-6dae-483d-8718-e9b767106c38'... >2018-06-29 15:34:55.412 23 INFO octavia.controller.worker.tasks.database_tasks [req-0bf10ec8-4509-4fa7-908e-d5e7cf489c37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: e0ff1a58-85bf-4999-8a26-380921b3c49a >2018-06-29 15:34:55.599 23 INFO octavia.controller.queue.endpoint [req-3fb87aae-b9a1-46ff-adc3-609ea410301a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '26589e2b-ad02-435c-89c8-4de4cd654b4b'... >2018-06-29 15:34:55.991 23 INFO octavia.controller.queue.endpoint [req-e60230ad-adb5-4a74-a0ba-b6ac743ae859 - 6730069018ad4583bba11c467ec9bd3b - - -] Deleting listener '2e0d5f5e-5c11-49db-af30-367a14ebc63a'... >2018-06-29 15:34:56.561 23 INFO octavia.controller.worker.tasks.database_tasks [req-e60230ad-adb5-4a74-a0ba-b6ac743ae859 - 6730069018ad4583bba11c467ec9bd3b - - -] Mark ACTIVE in DB for load balancer id: e0ff1a58-85bf-4999-8a26-380921b3c49a >2018-06-29 15:35:08.144 23 INFO octavia.controller.queue.endpoint [-] Deleting pool 'f2267776-207f-474d-bbb0-02a8a951f137'... >2018-06-29 15:35:09.294 23 INFO octavia.controller.queue.endpoint [-] Deleting load balancer 'e0ff1a58-85bf-4999-8a26-380921b3c49a'... >2018-06-29 15:35:12.828 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Removing security group 3b2cfa00-1bcf-495b-8c89-1453c3455262 from port 9eee905d-d531-4764-8a6c-42a59b681391 >2018-06-29 15:35:13.513 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Deleted security group 3b2cfa00-1bcf-495b-8c89-1453c3455262 >2018-06-29 15:36:19.658 23 INFO octavia.controller.queue.endpoint [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'e2a24f84-530f-4174-acc9-b232c821e743'... >2018-06-29 15:36:19.778 23 INFO octavia.controller.worker.tasks.database_tasks [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 12142b4f-fca9-42ba-bfab-40e95fb58bc6 >2018-06-29 15:36:19.832 23 INFO octavia.certificates.generator.local [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-06-29 15:36:19.833 23 INFO octavia.certificates.generator.local [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-06-29 15:36:19.833 23 INFO octavia.certificates.generator.local [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-06-29 15:36:19.833 23 INFO octavia.certificates.generator.local [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-06-29 15:36:35.237 23 INFO octavia.controller.worker.tasks.database_tasks [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 12142b4f-fca9-42ba-bfab-40e95fb58bc6 with compute id 07dfdf41-9f7e-47a8-a86d-ee63fae4858f for load balancer: e2a24f84-530f-4174-acc9-b232c821e743 >2018-06-29 15:36:35.548 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 31ea4699-831f-415d-a3c8-f817dd9afd25 already exists. Nothing to be done. >2018-06-29 15:36:54.709 23 INFO octavia.controller.worker.tasks.database_tasks [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: e2a24f84-530f-4174-acc9-b232c821e743 >2018-06-29 15:36:55.791 23 INFO octavia.controller.queue.endpoint [req-d47d3f71-c1ae-4ed7-950e-325d41ab6961 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '6d6c2254-1c33-4724-aa89-9a62d38e9224'... >2018-06-29 15:36:57.363 23 INFO octavia.controller.queue.endpoint [-] Creating listener 'a868fcc5-8a30-4c69-a24f-8f48be318808'... >2018-06-29 15:36:58.618 23 INFO octavia.controller.queue.endpoint [req-9b7bb819-d4b7-4b40-bef9-910fc8dc8f02 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '120ab472-e8c3-4a9e-8513-e190cbf99768'... >2018-06-29 15:37:21.673 23 INFO octavia.controller.queue.endpoint [req-c652652f-f830-420e-be81-6469ab4d007a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3582272b-c1a0-495d-8fe9-54e8736a7dc5'... >2018-06-29 15:37:22.400 23 INFO octavia.controller.queue.endpoint [req-61d9e956-045f-4d03-abbc-273fcb7e066a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3b1aaabe-a8a7-453a-b9bc-d1112a350019'... >2018-06-29 15:37:23.225 23 INFO octavia.controller.queue.endpoint [req-4dedf296-c09c-40ae-b003-e9c0928186fc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c2b7c972-9861-4200-a5ae-ff25685e588e'... >2018-06-29 16:03:13.295 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer 'ec364242-01f8-4aed-966f-95b2440d3c75'... >2018-06-29 16:03:13.408 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id 22d95f8d-2988-48f1-b2d8-b9b536d3761b >2018-06-29 16:03:13.466 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally. >2018-06-29 16:03:13.466 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config. >2018-06-29 16:03:13.466 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config. >2018-06-29 16:03:13.467 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config. >2018-06-29 16:03:26.316 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: 22d95f8d-2988-48f1-b2d8-b9b536d3761b with compute id e446f8cd-648a-441c-a10a-37ec845fcc5c for load balancer: ec364242-01f8-4aed-966f-95b2440d3c75 >2018-06-29 16:03:26.634 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port 661728c0-4184-49c2-9b20-158d51595889 already exists. Nothing to be done. >2018-06-29 16:03:32.481 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.14', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.40.42 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4708035610>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-06-29 16:03:42.026 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: ec364242-01f8-4aed-966f-95b2440d3c75 >2018-06-29 16:03:53.695 23 INFO octavia.controller.queue.endpoint [req-0ecbd60f-6d45-4290-b82a-1cb08781f284 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'f04bc414-9673-48f2-9616-7c1624f27186'... >2018-06-29 16:03:58.472 23 INFO octavia.controller.queue.endpoint [req-528891e8-ff29-4b95-8cb9-5d2d6890924b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '01743da9-94a0-4a7d-a8b0-b2c8cf721b22'... >2018-06-29 16:04:03.538 23 INFO octavia.controller.queue.endpoint [req-759e416f-8db0-454c-aa38-b8228dfd3ea3 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating listener 'bd47704b-f9c1-4760-bc35-4cbac8ce2544'... >2018-06-29 16:04:08.447 23 INFO octavia.controller.queue.endpoint [req-51863228-174c-446c-9818-1cdfca00ce83 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '2ea7b4bb-bd2e-4eff-986f-d25bb255046d'... >2018-06-29 16:04:13.442 23 INFO octavia.controller.queue.endpoint [-] Creating pool '834fd9aa-73d7-426e-9e6e-ec5e09cc5a62'... >2018-06-29 16:04:17.872 23 INFO octavia.controller.queue.endpoint [req-e6447054-ef5e-412f-bb9b-4f54d820874d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '5324df07-6685-42e0-b236-234c7ca2f4ee'... >2018-06-29 16:04:22.807 23 INFO octavia.controller.queue.endpoint [req-e60230ad-adb5-4a74-a0ba-b6ac743ae859 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating member '15341cf7-6e69-4d45-8cff-d85630c7a27c'... >2018-06-29 16:04:28.541 23 INFO octavia.controller.queue.endpoint [-] Creating member '7a1023b5-d5fa-4537-a65e-1a99f3f36bb3'... >2018-06-29 16:04:33.925 23 INFO octavia.controller.queue.endpoint [-] Creating member '0b454c11-7800-4369-8da0-d8d4cd6e8449'... >2018-06-29 16:04:35.321 23 INFO octavia.controller.queue.endpoint [req-0593f13d-6e76-4e44-a9b7-0316500992ba - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd76169a7-3281-4ab3-98f7-237707548532'... >2018-06-29 16:04:40.848 23 INFO octavia.controller.queue.endpoint [req-57834383-7be4-497a-877b-cc627895ed15 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '565ba280-5b74-42d0-99c7-a6a7b7659d65'... >2018-06-29 16:04:46.128 23 INFO octavia.controller.queue.endpoint [req-384846a9-f915-4dc2-9567-3b90dea08ea2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ce5a8787-fb60-4587-ad4e-401ffaed3fd5'... >2018-07-02 10:17:20.124 23 INFO octavia.controller.queue.endpoint [req-d12dab09-c909-41f1-b810-30c54743fbf1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '89d8db33-c5ba-4a5b-9631-136eb8a33171'... >2018-07-02 10:17:20.237 23 INFO octavia.controller.worker.tasks.database_tasks [req-d12dab09-c909-41f1-b810-30c54743fbf1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 48aea9f9-f8d1-4fee-b0c8-629f016bbb87 >2018-07-02 10:17:20.306 23 INFO octavia.certificates.generator.local [req-d12dab09-c909-41f1-b810-30c54743fbf1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-02 10:17:20.306 23 INFO octavia.certificates.generator.local [req-d12dab09-c909-41f1-b810-30c54743fbf1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-02 10:17:20.307 23 INFO octavia.certificates.generator.local [req-d12dab09-c909-41f1-b810-30c54743fbf1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-02 10:17:20.307 23 INFO octavia.certificates.generator.local [req-d12dab09-c909-41f1-b810-30c54743fbf1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-02 10:17:35.199 23 INFO octavia.controller.worker.tasks.database_tasks [req-d12dab09-c909-41f1-b810-30c54743fbf1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 48aea9f9-f8d1-4fee-b0c8-629f016bbb87 with compute id 907beae0-c222-438e-a9a4-10d2cae7be62 for load balancer: 89d8db33-c5ba-4a5b-9631-136eb8a33171 >2018-07-02 10:17:36.040 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-d12dab09-c909-41f1-b810-30c54743fbf1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 1c5a90c7-d870-4df3-ad98-f0a77363de54 already exists. Nothing to be done. >2018-07-02 10:17:53.809 23 INFO octavia.controller.worker.tasks.database_tasks [req-d12dab09-c909-41f1-b810-30c54743fbf1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 89d8db33-c5ba-4a5b-9631-136eb8a33171 >2018-07-02 10:18:03.384 23 INFO octavia.controller.queue.endpoint [req-d12dab09-c909-41f1-b810-30c54743fbf1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'c6fa3c3d-6319-4afd-9ec3-f92de55ea9df'... >2018-07-02 10:18:08.732 23 INFO octavia.controller.queue.endpoint [req-f7d2f10a-cb2c-4a4e-bddd-5a1d2a2d719c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '39315eab-10e9-4a88-904a-b05c7d45893e'... >2018-07-02 10:18:14.582 23 INFO octavia.controller.queue.endpoint [req-be79b232-821d-4d7f-8fda-a54e7a5b589a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8d9ff841-201d-448f-b12d-a94fd440dc3c'... >2018-07-02 10:18:20.133 23 INFO octavia.controller.queue.endpoint [req-3bb76f22-398d-4846-bbd2-dfb4c99b50d3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd9624c82-9e22-4096-9b17-3ba2bd35aa00'... >2018-07-02 10:18:25.111 23 INFO octavia.controller.queue.endpoint [req-fc1d3067-86f6-453f-b3a2-5968816edecd - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6c57a704-edfb-4ba9-860c-027448e43e97'... >2018-07-05 16:52:19.927 23 INFO octavia.controller.queue.endpoint [-] Deleting load balancer 'ec364242-01f8-4aed-966f-95b2440d3c75'... >2018-07-05 16:52:21.128 23 INFO octavia.controller.queue.endpoint [-] Deleting load balancer '89d8db33-c5ba-4a5b-9631-136eb8a33171'... >2018-07-05 16:52:24.661 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Removing security group e0bf7efb-5f56-46d9-b5ce-4dcd4ea0d19e from port 1c5a90c7-d870-4df3-ad98-f0a77363de54 >2018-07-05 16:52:24.749 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Removing security group e9bc51e4-6ac1-4c05-8351-7067c788b855 from port 661728c0-4184-49c2-9b20-158d51595889 >2018-07-05 16:52:25.499 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Deleted security group e0bf7efb-5f56-46d9-b5ce-4dcd4ea0d19e >2018-07-05 16:52:25.588 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Deleted security group e9bc51e4-6ac1-4c05-8351-7067c788b855 >2018-07-05 16:53:06.635 23 INFO octavia.controller.queue.endpoint [-] Deleting listener 'a868fcc5-8a30-4c69-a24f-8f48be318808'... >2018-07-05 16:53:07.375 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: e2a24f84-530f-4174-acc9-b232c821e743 >2018-07-05 16:53:08.586 23 INFO octavia.controller.queue.endpoint [req-3c42ac0c-3cab-40ad-8789-c8ce2224cefa - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '120ab472-e8c3-4a9e-8513-e190cbf99768'... >2018-07-05 16:53:09.524 23 INFO octavia.controller.worker.tasks.database_tasks [req-3c42ac0c-3cab-40ad-8789-c8ce2224cefa - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: e2a24f84-530f-4174-acc9-b232c821e743 >2018-07-05 16:53:10.981 23 INFO octavia.controller.queue.endpoint [-] Deleting member 'c2b7c972-9861-4200-a5ae-ff25685e588e'... >2018-07-05 16:53:12.196 23 INFO octavia.controller.queue.endpoint [-] Deleting member '3b1aaabe-a8a7-453a-b9bc-d1112a350019'... >2018-07-05 16:53:13.055 23 INFO octavia.controller.queue.endpoint [-] Deleting member '3582272b-c1a0-495d-8fe9-54e8736a7dc5'... >2018-07-05 16:53:24.875 23 INFO octavia.controller.queue.endpoint [-] Deleting pool '6d6c2254-1c33-4724-aa89-9a62d38e9224'... >2018-07-05 16:53:26.027 23 INFO octavia.controller.queue.endpoint [-] Deleting load balancer 'e2a24f84-530f-4174-acc9-b232c821e743'... >2018-07-05 16:53:27.939 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Removing security group a5f43a38-c147-42b9-9aed-c7804c76843d from port 31ea4699-831f-415d-a3c8-f817dd9afd25 >2018-07-05 16:53:28.657 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Deleted security group a5f43a38-c147-42b9-9aed-c7804c76843d >2018-07-05 17:04:59.393 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer 'b8ec762e-0651-46f6-89f1-6fcd48e3fc98'... >2018-07-05 17:04:59.517 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id 1868dcd2-adea-4a06-af42-2df36d6f35e2 >2018-07-05 17:04:59.743 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally. >2018-07-05 17:04:59.744 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config. >2018-07-05 17:04:59.744 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config. >2018-07-05 17:04:59.744 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config. >2018-07-05 17:05:14.871 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: 1868dcd2-adea-4a06-af42-2df36d6f35e2 with compute id 58f85770-b2d9-451b-b964-8c7abe973ce6 for load balancer: b8ec762e-0651-46f6-89f1-6fcd48e3fc98 >2018-07-05 17:05:15.191 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port ebcf3945-51a9-4ba4-88d1-a989c5a7b614 already exists. Nothing to be done. >2018-07-05 17:05:21.521 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.11', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.0.1 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470818b710>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-05 17:05:31.188 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: b8ec762e-0651-46f6-89f1-6fcd48e3fc98 >2018-07-05 17:05:32.492 23 INFO octavia.controller.queue.endpoint [-] Creating pool '445c3a6b-b6b9-461c-bff9-098bcb53c474'... >2018-07-05 17:05:34.067 23 INFO octavia.controller.queue.endpoint [-] Creating listener '117ffa43-3ab1-4ac6-97d5-b5dd499f0037'... >2018-07-05 17:05:35.235 23 INFO octavia.controller.queue.endpoint [-] Creating listener 'db23be14-43f6-4c1e-aafc-4b5dab6a9627'... >2018-07-05 17:05:59.500 23 INFO octavia.controller.queue.endpoint [req-3c42ac0c-3cab-40ad-8789-c8ce2224cefa - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2a341656-6b49-49a9-8dad-9b5de590dcb5'... >2018-07-05 17:06:00.833 23 INFO octavia.controller.queue.endpoint [-] Creating member '6e6e0edb-318e-4020-baa7-5b29499a87bf'... >2018-07-05 17:06:02.348 23 INFO octavia.controller.queue.endpoint [-] Creating member 'bc5e2c52-d324-404b-af03-610cac893a77'... >2018-07-05 17:30:58.921 23 INFO octavia.controller.queue.endpoint [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '07bbc38f-cb62-4817-8010-df93bb97738f'... >2018-07-05 17:30:59.036 23 INFO octavia.controller.worker.tasks.database_tasks [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id d3cde43e-903a-4860-8d90-939fc9a08485 >2018-07-05 17:30:59.154 23 INFO octavia.certificates.generator.local [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-05 17:30:59.155 23 INFO octavia.certificates.generator.local [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-05 17:30:59.155 23 INFO octavia.certificates.generator.local [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-05 17:30:59.155 23 INFO octavia.certificates.generator.local [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-05 17:31:07.320 23 INFO octavia.controller.queue.endpoint [req-11dcc1b8-64db-4e99-ae0c-cb914e030057 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'd99ba887-0c9f-4cc9-ba74-6e9cc3a56c91'... >2018-07-05 17:31:07.437 23 INFO octavia.controller.worker.tasks.database_tasks [req-11dcc1b8-64db-4e99-ae0c-cb914e030057 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 4c3103c1-5454-4627-bfd0-272a6b686c28 >2018-07-05 17:31:07.568 23 INFO octavia.certificates.generator.local [req-11dcc1b8-64db-4e99-ae0c-cb914e030057 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-05 17:31:07.568 23 INFO octavia.certificates.generator.local [req-11dcc1b8-64db-4e99-ae0c-cb914e030057 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-05 17:31:07.568 23 INFO octavia.certificates.generator.local [req-11dcc1b8-64db-4e99-ae0c-cb914e030057 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-05 17:31:07.569 23 INFO octavia.certificates.generator.local [req-11dcc1b8-64db-4e99-ae0c-cb914e030057 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-05 17:31:12.106 23 INFO octavia.controller.worker.tasks.database_tasks [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: d3cde43e-903a-4860-8d90-939fc9a08485 with compute id 54a71456-0cb7-4df8-931e-db5a2795b44a for load balancer: 07bbc38f-cb62-4817-8010-df93bb97738f >2018-07-05 17:31:12.392 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 9f895887-1466-4778-aa85-fc6651251346 already exists. Nothing to be done. >2018-07-05 17:31:18.976 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.7', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.15.13 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47005ad090>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-05 17:31:19.824 23 INFO octavia.controller.worker.tasks.database_tasks [req-11dcc1b8-64db-4e99-ae0c-cb914e030057 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 4c3103c1-5454-4627-bfd0-272a6b686c28 with compute id 5ba4fb0d-6a74-40ed-a558-98b3c815ac50 for load balancer: d99ba887-0c9f-4cc9-ba74-6e9cc3a56c91 >2018-07-05 17:31:19.911 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-11dcc1b8-64db-4e99-ae0c-cb914e030057 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port ebc31cf4-5c9b-4f00-a6b8-49abc6502290 already exists. Nothing to be done. >2018-07-05 17:31:28.574 23 INFO octavia.controller.worker.tasks.database_tasks [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 07bbc38f-cb62-4817-8010-df93bb97738f >2018-07-05 17:31:37.095 23 INFO octavia.controller.worker.tasks.database_tasks [req-11dcc1b8-64db-4e99-ae0c-cb914e030057 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: d99ba887-0c9f-4cc9-ba74-6e9cc3a56c91 >2018-07-05 17:31:42.522 23 INFO octavia.controller.queue.endpoint [req-c10a757d-e88e-43af-b4e8-ea0ad23256ba - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '63c30456-e2a6-4bba-93cf-fdb9f8787a54'... >2018-07-05 17:31:47.930 23 INFO octavia.controller.queue.endpoint [req-ceecf32a-c49b-47e8-99e4-c2baf61ef6ac - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '3b285fbe-e3d9-4d5c-9f1d-8cab6648e218'... >2018-07-05 17:31:49.155 23 INFO octavia.controller.queue.endpoint [req-9670ffc7-c35d-41b4-9b20-a3521ce88a2e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '801114b2-f546-4099-a5fe-1bfc2dea21b6'... >2018-07-05 17:31:53.734 23 INFO octavia.controller.queue.endpoint [req-c4119cea-91d6-4636-a1cd-0a93800bce15 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '353c8e6f-c51e-4dca-b082-e0292e391ca1'... >2018-07-05 17:31:53.931 23 INFO octavia.controller.queue.endpoint [req-5b01403e-e07a-42e9-9663-8eddd548c210 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'e7caa564-c960-4b45-8640-b204853ae77c'... >2018-07-05 17:31:55.066 23 INFO octavia.controller.queue.endpoint [-] Creating member '31d47674-84ba-434c-bc55-77f7e8c432b5'... >2018-07-05 17:31:58.783 23 INFO octavia.controller.queue.endpoint [req-826efc43-1432-40be-98b5-d5c8bb0bfa21 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '2b2ab4bf-725d-43cd-a146-d256656cd60f'... >2018-07-05 17:32:00.885 23 INFO octavia.controller.queue.endpoint [req-1310b78c-0136-4246-905a-554921a71e6b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a21ea1c2-ad27-4a00-9112-2d8ea77c7b46'... >2018-07-05 17:32:03.935 23 INFO octavia.controller.queue.endpoint [-] Creating pool '9dafc36f-936a-4075-8f01-be5ab3d22db0'... >2018-07-05 17:32:09.119 23 INFO octavia.controller.queue.endpoint [req-7fc9a81b-8142-4444-8bec-4fb70e54ae6d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'ece606e4-55fb-48ed-b532-9f80b7b6d2d7'... >2018-07-05 17:32:14.296 23 INFO octavia.controller.queue.endpoint [req-4aa888e5-8c4a-41cf-9e13-0aba736096ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'e618439f-f509-4147-b210-ec61eeb9c41f'... >2018-07-05 17:32:19.392 23 INFO octavia.controller.queue.endpoint [req-c4b9c0eb-0b55-456d-8883-3dbdb70b8183 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '11a24c6b-f3d4-4593-9e7e-faaaae05ecc2'... >2018-07-05 17:32:24.714 23 INFO octavia.controller.queue.endpoint [req-5b7d911b-07da-4abb-8ec3-58fe48b2cb54 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e9f89203-74c6-4b21-a0df-3f961cdfd03e'... >2018-07-05 17:32:29.739 23 INFO octavia.controller.queue.endpoint [req-12a6efed-0c0d-434d-9b00-2ceb8d51a57d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '57541234-eb8f-4558-8622-5a2279772e86'... >2018-07-05 17:32:31.190 23 INFO octavia.controller.queue.endpoint [req-49eee263-aed3-4f05-aec0-128b7c91dd0a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '728c70a2-ed02-4732-810e-3f040106ff57'... >2018-07-05 17:32:36.311 23 INFO octavia.controller.queue.endpoint [req-d2e13156-63cb-4790-a47c-2fd76f0ea866 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'bf705c31-ab63-4222-9399-20178cdaff61'... >2018-07-05 17:32:41.648 23 INFO octavia.controller.queue.endpoint [req-94afda73-4b03-4bb0-996b-328264f719d2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0f8e23e6-87e4-4e24-8d53-1aa810ed9891'... >2018-07-06 14:44:03.319 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer 'f61b7695-efd1-421c-8e51-36ae78af31c3'... >2018-07-06 14:44:03.438 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id 4ad483de-d907-4a0c-90df-df555567134d >2018-07-06 14:44:03.645 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally. >2018-07-06 14:44:03.646 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config. >2018-07-06 14:44:03.646 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config. >2018-07-06 14:44:03.647 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config. >2018-07-06 14:44:18.861 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: 4ad483de-d907-4a0c-90df-df555567134d with compute id 0a004ffe-936f-444a-bc81-c30dc00cebc3 for load balancer: f61b7695-efd1-421c-8e51-36ae78af31c3 >2018-07-06 14:44:19.658 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port c8fd869a-358a-4bfb-a1ec-022971343820 already exists. Nothing to be done. >2018-07-06 14:44:37.283 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: f61b7695-efd1-421c-8e51-36ae78af31c3 >2018-07-06 14:44:44.209 23 INFO octavia.controller.queue.endpoint [-] Creating listener '5b0650cc-d3c0-4de4-8e3f-3db3bcd40e38'... >2018-07-06 14:44:50.028 23 INFO octavia.controller.queue.endpoint [req-c72ae2b1-96f1-4e8b-944d-3e3217cae0f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '98a2c8ca-9291-4def-b892-f640917b0fd8'... >2018-07-06 14:44:55.224 23 INFO octavia.controller.queue.endpoint [req-09a38c83-5eea-403a-9c2d-a1c668f7d02f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '613b0fe5-1c6c-43c6-b263-b47807f9a8d4'... >2018-07-06 14:45:00.480 23 INFO octavia.controller.queue.endpoint [-] Creating member '7a9cfd2a-0b00-42e7-9706-c2c8aef717e5'... >2018-07-06 14:45:05.483 23 INFO octavia.controller.queue.endpoint [-] Creating member '1979c65d-39ff-4486-bf77-0f24598d9dc9'... >2018-07-09 10:33:14.414 23 INFO octavia.controller.queue.endpoint [req-da2ad16b-9b3a-48f6-9a93-46efdf22c804 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'd99ba887-0c9f-4cc9-ba74-6e9cc3a56c91'... >2018-07-09 10:33:15.616 23 INFO octavia.controller.queue.endpoint [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '07bbc38f-cb62-4817-8010-df93bb97738f'... >2018-07-09 10:33:16.865 23 INFO octavia.controller.queue.endpoint [req-200b6a82-d07c-4478-b632-56a378956c1c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f61b7695-efd1-421c-8e51-36ae78af31c3'... >2018-07-09 10:33:18.349 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-da2ad16b-9b3a-48f6-9a93-46efdf22c804 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 3a7bc1ac-6f45-4d52-946a-de4280d44f31 from port ebc31cf4-5c9b-4f00-a6b8-49abc6502290 >2018-07-09 10:33:19.037 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group dfb59218-7568-493f-b19f-cdb4cbcdfb8a from port 9f895887-1466-4778-aa85-fc6651251346 >2018-07-09 10:33:19.759 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-da2ad16b-9b3a-48f6-9a93-46efdf22c804 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 3a7bc1ac-6f45-4d52-946a-de4280d44f31 >2018-07-09 10:33:20.119 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group dfb59218-7568-493f-b19f-cdb4cbcdfb8a >2018-07-09 10:33:20.217 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-200b6a82-d07c-4478-b632-56a378956c1c - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 04d6fa17-ca53-45ec-a04c-b89040678dbb from port c8fd869a-358a-4bfb-a1ec-022971343820 >2018-07-09 10:33:20.921 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-200b6a82-d07c-4478-b632-56a378956c1c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 04d6fa17-ca53-45ec-a04c-b89040678dbb >2018-07-09 10:33:57.931 23 INFO octavia.controller.queue.endpoint [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'db23be14-43f6-4c1e-aafc-4b5dab6a9627'... >2018-07-09 10:33:58.575 23 INFO octavia.controller.worker.tasks.database_tasks [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: b8ec762e-0651-46f6-89f1-6fcd48e3fc98 >2018-07-09 10:34:02.396 23 INFO octavia.controller.queue.endpoint [req-200b6a82-d07c-4478-b632-56a378956c1c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2a341656-6b49-49a9-8dad-9b5de590dcb5'... >2018-07-09 10:34:03.330 23 INFO octavia.controller.queue.endpoint [req-15486e21-7942-4afb-8bfa-833545c311b6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '6e6e0edb-318e-4020-baa7-5b29499a87bf'... >2018-07-09 10:34:04.712 23 INFO octavia.controller.queue.endpoint [req-da2ad16b-9b3a-48f6-9a93-46efdf22c804 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'bc5e2c52-d324-404b-af03-610cac893a77'... >2018-07-09 10:34:05.974 23 INFO octavia.controller.queue.endpoint [req-eb0a4bc7-25bb-4997-b42d-32495e1959d4 - 6730069018ad4583bba11c467ec9bd3b - - -] Deleting listener '117ffa43-3ab1-4ac6-97d5-b5dd499f0037'... >2018-07-09 10:34:46.768 23 INFO octavia.controller.worker.tasks.database_tasks [req-eb0a4bc7-25bb-4997-b42d-32495e1959d4 - 6730069018ad4583bba11c467ec9bd3b - - -] Mark ACTIVE in DB for load balancer id: b8ec762e-0651-46f6-89f1-6fcd48e3fc98 >2018-07-09 10:34:47.080 23 INFO octavia.controller.queue.endpoint [req-b41427fe-b8df-466d-ab10-c3737e51aae6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool '445c3a6b-b6b9-461c-bff9-098bcb53c474'... >2018-07-09 10:34:48.231 23 INFO octavia.controller.queue.endpoint [req-51fced28-40c7-4a07-939d-5a899815e504 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'b8ec762e-0651-46f6-89f1-6fcd48e3fc98'... >2018-07-09 10:34:49.716 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-51fced28-40c7-4a07-939d-5a899815e504 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 6573083d-694e-4491-bc14-093fd69939c0 from port ebcf3945-51a9-4ba4-88d1-a989c5a7b614 >2018-07-09 10:34:50.535 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-51fced28-40c7-4a07-939d-5a899815e504 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 6573083d-694e-4491-bc14-093fd69939c0 >2018-07-09 10:36:11.188 23 INFO octavia.controller.queue.endpoint [req-b41427fe-b8df-466d-ab10-c3737e51aae6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'bc5639b4-bce3-46a7-be9c-f074d2d0b204'... >2018-07-09 10:36:11.307 23 INFO octavia.controller.worker.tasks.database_tasks [req-b41427fe-b8df-466d-ab10-c3737e51aae6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 8cdbae60-5bde-453b-a884-87452ba31a27 >2018-07-09 10:36:11.496 23 INFO octavia.certificates.generator.local [req-b41427fe-b8df-466d-ab10-c3737e51aae6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-09 10:36:11.496 23 INFO octavia.certificates.generator.local [req-b41427fe-b8df-466d-ab10-c3737e51aae6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-09 10:36:11.497 23 INFO octavia.certificates.generator.local [req-b41427fe-b8df-466d-ab10-c3737e51aae6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-09 10:36:11.497 23 INFO octavia.certificates.generator.local [req-b41427fe-b8df-466d-ab10-c3737e51aae6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-09 10:36:26.598 23 INFO octavia.controller.worker.tasks.database_tasks [req-b41427fe-b8df-466d-ab10-c3737e51aae6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 8cdbae60-5bde-453b-a884-87452ba31a27 with compute id 9abe3ce1-bafc-45f2-aeae-4e7b6c6d9305 for load balancer: bc5639b4-bce3-46a7-be9c-f074d2d0b204 >2018-07-09 10:36:26.698 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b41427fe-b8df-466d-ab10-c3737e51aae6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 27b76c2e-b06f-4f69-a7de-c16a209a54c6 already exists. Nothing to be done. >2018-07-09 10:36:34.858 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-b41427fe-b8df-466d-ab10-c3737e51aae6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.11', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.0.1 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4708425e10>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-09 10:36:44.448 23 INFO octavia.controller.worker.tasks.database_tasks [req-b41427fe-b8df-466d-ab10-c3737e51aae6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: bc5639b4-bce3-46a7-be9c-f074d2d0b204 >2018-07-09 10:36:45.332 23 INFO octavia.controller.queue.endpoint [req-23a4cb3c-5767-4377-857f-7ecd7bfafa1a - 6730069018ad4583bba11c467ec9bd3b - - -] Creating pool '81b756dc-b863-4531-9b9a-7904be8cb0d3'... >2018-07-09 10:36:46.916 23 INFO octavia.controller.queue.endpoint [req-e669524c-8062-4043-890d-4f1a920cb2f6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'c4a50183-4bd6-4b2b-897f-b98c01aa57c1'... >2018-07-09 10:36:48.109 23 INFO octavia.controller.queue.endpoint [req-51fced28-40c7-4a07-939d-5a899815e504 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'd72d3aea-362e-4f54-9959-52f97f1c574f'... >2018-07-09 10:37:09.754 23 INFO octavia.controller.queue.endpoint [req-f524e48e-1875-49f7-ab1b-a8b71c67fd1c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cab68203-95ad-4b44-82b9-62d65f3dbdbb'... >2018-07-09 10:37:10.947 23 INFO octavia.controller.queue.endpoint [req-39db9b23-7862-4181-bdec-047a0a57faf9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5e961509-6ce5-48b6-95ab-247498f02ad6'... >2018-07-09 10:37:14.255 23 INFO octavia.controller.queue.endpoint [req-1192e188-f544-4182-9a3c-d1a4d23c3fb1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5603a064-32e7-4bd1-941a-158384a89725'... >2018-07-09 11:02:50.393 23 INFO octavia.controller.queue.endpoint [req-017de3d6-7dbe-4849-972b-a3f13eb49673 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating load balancer 'daaddb63-bb7b-405e-b84c-6a315ad8d871'... >2018-07-09 11:02:50.501 23 INFO octavia.controller.worker.tasks.database_tasks [req-017de3d6-7dbe-4849-972b-a3f13eb49673 - 6730069018ad4583bba11c467ec9bd3b - - -] Created Amphora in DB with id d50dee47-115b-482a-a78d-6c9c74555a7a >2018-07-09 11:02:50.609 23 INFO octavia.certificates.generator.local [req-017de3d6-7dbe-4849-972b-a3f13eb49673 - 6730069018ad4583bba11c467ec9bd3b - - -] Signing a certificate request using OpenSSL locally. >2018-07-09 11:02:50.609 23 INFO octavia.certificates.generator.local [req-017de3d6-7dbe-4849-972b-a3f13eb49673 - 6730069018ad4583bba11c467ec9bd3b - - -] Using CA Certificate from config. >2018-07-09 11:02:50.609 23 INFO octavia.certificates.generator.local [req-017de3d6-7dbe-4849-972b-a3f13eb49673 - 6730069018ad4583bba11c467ec9bd3b - - -] Using CA Private Key from config. >2018-07-09 11:02:50.610 23 INFO octavia.certificates.generator.local [req-017de3d6-7dbe-4849-972b-a3f13eb49673 - 6730069018ad4583bba11c467ec9bd3b - - -] Using CA Private Key Passphrase from config. >2018-07-09 11:02:58.495 23 INFO octavia.controller.queue.endpoint [req-83010087-b086-4eea-af3c-2d7560743670 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '25829d56-5685-449c-8c5f-8a20166ce45d'... >2018-07-09 11:02:58.628 23 INFO octavia.controller.worker.tasks.database_tasks [req-83010087-b086-4eea-af3c-2d7560743670 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 81f46a38-0640-4b56-974f-ce223ccee5d0 >2018-07-09 11:02:58.693 23 INFO octavia.certificates.generator.local [req-83010087-b086-4eea-af3c-2d7560743670 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-09 11:02:58.693 23 INFO octavia.certificates.generator.local [req-83010087-b086-4eea-af3c-2d7560743670 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-09 11:02:58.694 23 INFO octavia.certificates.generator.local [req-83010087-b086-4eea-af3c-2d7560743670 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-09 11:02:58.694 23 INFO octavia.certificates.generator.local [req-83010087-b086-4eea-af3c-2d7560743670 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-09 11:03:01.545 23 INFO octavia.controller.queue.endpoint [req-795e6efd-ef63-40bd-91fb-e1768f85ddb0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '8a443efb-2a88-4435-bdfc-01c3280afac4'... >2018-07-09 11:03:01.681 23 INFO octavia.controller.worker.tasks.database_tasks [req-795e6efd-ef63-40bd-91fb-e1768f85ddb0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 36628b33-db29-49e7-a557-340f93963cd4 >2018-07-09 11:03:01.764 23 INFO octavia.certificates.generator.local [req-795e6efd-ef63-40bd-91fb-e1768f85ddb0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-09 11:03:01.764 23 INFO octavia.certificates.generator.local [req-795e6efd-ef63-40bd-91fb-e1768f85ddb0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-09 11:03:01.765 23 INFO octavia.certificates.generator.local [req-795e6efd-ef63-40bd-91fb-e1768f85ddb0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-09 11:03:01.765 23 INFO octavia.certificates.generator.local [req-795e6efd-ef63-40bd-91fb-e1768f85ddb0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-09 11:03:03.153 23 INFO octavia.controller.worker.tasks.database_tasks [req-017de3d6-7dbe-4849-972b-a3f13eb49673 - 6730069018ad4583bba11c467ec9bd3b - - -] Mark ALLOCATED in DB for amphora: d50dee47-115b-482a-a78d-6c9c74555a7a with compute id 66420ed7-e76b-4151-a4d1-8b3658f86cb8 for load balancer: daaddb63-bb7b-405e-b84c-6a315ad8d871 >2018-07-09 11:03:03.463 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-017de3d6-7dbe-4849-972b-a3f13eb49673 - 6730069018ad4583bba11c467ec9bd3b - - -] Port 9b0859c0-da86-4e22-8653-2f0567a139bb already exists. Nothing to be done. >2018-07-09 11:03:10.575 23 INFO octavia.controller.worker.tasks.database_tasks [req-83010087-b086-4eea-af3c-2d7560743670 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 81f46a38-0640-4b56-974f-ce223ccee5d0 with compute id 46b7633f-71cf-428b-8c2a-df2731fd9ae1 for load balancer: 25829d56-5685-449c-8c5f-8a20166ce45d >2018-07-09 11:03:10.675 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-83010087-b086-4eea-af3c-2d7560743670 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 7441334c-13f4-44b6-9fbd-9de4abeace25 already exists. Nothing to be done. >2018-07-09 11:03:13.411 23 INFO octavia.controller.worker.tasks.database_tasks [req-795e6efd-ef63-40bd-91fb-e1768f85ddb0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 36628b33-db29-49e7-a557-340f93963cd4 with compute id c822df76-0745-4354-aac6-47ccd2a5a996 for load balancer: 8a443efb-2a88-4435-bdfc-01c3280afac4 >2018-07-09 11:03:13.505 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-795e6efd-ef63-40bd-91fb-e1768f85ddb0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 36060ec2-9837-4a8f-863a-c89101609527 already exists. Nothing to be done. >2018-07-09 11:03:16.189 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-017de3d6-7dbe-4849-972b-a3f13eb49673 - 6730069018ad4583bba11c467ec9bd3b - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.4', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.215.99 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47004f53d0>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-09 11:03:21.656 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-795e6efd-ef63-40bd-91fb-e1768f85ddb0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.16', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.116.169 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470051e310>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-09 11:03:25.819 23 INFO octavia.controller.worker.tasks.database_tasks [req-017de3d6-7dbe-4849-972b-a3f13eb49673 - 6730069018ad4583bba11c467ec9bd3b - - -] Mark ACTIVE in DB for load balancer id: daaddb63-bb7b-405e-b84c-6a315ad8d871 >2018-07-09 11:03:26.754 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-83010087-b086-4eea-af3c-2d7560743670 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.9', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.197.110 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47004f5690>, 'Connection to 172.24.0.9 timed out. (connect timeout=10.0)')) >2018-07-09 11:03:29.501 23 INFO octavia.controller.queue.endpoint [req-73d31847-234d-403b-ac12-219107ac96ed - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '100f027c-44b8-4e53-a016-be0a1fbeaba6'... >2018-07-09 11:03:31.181 23 INFO octavia.controller.worker.tasks.database_tasks [req-795e6efd-ef63-40bd-91fb-e1768f85ddb0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 8a443efb-2a88-4435-bdfc-01c3280afac4 >2018-07-09 11:03:34.713 23 INFO octavia.controller.queue.endpoint [req-9554f4d7-3188-4773-a211-dc72958e39d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '6d98afd4-3881-43f3-8329-847239d6bf65'... >2018-07-09 11:03:36.323 23 INFO octavia.controller.worker.tasks.database_tasks [req-83010087-b086-4eea-af3c-2d7560743670 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 25829d56-5685-449c-8c5f-8a20166ce45d >2018-07-09 11:03:36.744 23 INFO octavia.controller.queue.endpoint [req-017de3d6-7dbe-4849-972b-a3f13eb49673 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating listener '55f51b5c-fe74-4c08-8bff-04fa8a7d3ea7'... >2018-07-09 11:03:40.199 23 INFO octavia.controller.queue.endpoint [req-83010087-b086-4eea-af3c-2d7560743670 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'aa135346-5a0e-4432-82f9-5ce6a50ace12'... >2018-07-09 11:03:41.539 23 INFO octavia.controller.queue.endpoint [req-f52e0f46-267d-4399-80d3-5ed042080f0f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e9cbc7d2-3d60-49ca-87eb-c6f2b1fa3c1c'... >2018-07-09 11:03:42.308 23 INFO octavia.controller.queue.endpoint [req-161229fc-4f9e-4b46-baf0-f7f860b10a0c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '846a8614-131b-467a-a784-55596b21048c'... >2018-07-09 11:03:42.459 23 INFO octavia.controller.queue.endpoint [req-951b777d-9d19-412f-9a91-b293d76d549e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '8352d67c-fc21-4410-9850-36b04f79011b'... >2018-07-09 11:03:47.006 23 INFO octavia.controller.queue.endpoint [req-eb0a4bc7-25bb-4997-b42d-32495e1959d4 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating member '02feefe5-a26e-4b08-ae07-ecb4b9f9c083'... >2018-07-09 11:03:47.193 23 INFO octavia.controller.queue.endpoint [req-795e6efd-ef63-40bd-91fb-e1768f85ddb0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'f1a9a75b-eebc-4d90-b212-c674493dc9f5'... >2018-07-09 11:03:47.466 23 INFO octavia.controller.queue.endpoint [req-46d8bdb1-9c55-4bc5-a956-d89be37f6c28 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '12f1f3e1-8edf-412a-945e-f6aff08225cc'... >2018-07-09 11:03:52.754 23 INFO octavia.controller.queue.endpoint [req-ad93feed-6b73-4777-bd33-92c1aa404d08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '144063ac-e1fe-4fa7-a2f1-3421dccc0508'... >2018-07-09 11:03:57.706 23 INFO octavia.controller.queue.endpoint [req-b07a7bd6-0001-4bb3-8803-195d9a1abe18 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'a03a9b8f-a4d2-41c5-a36a-c0840e3abf0d'... >2018-07-09 11:04:02.127 23 INFO octavia.controller.queue.endpoint [req-8b58c2fd-27b1-405f-9cdb-0a0be96e320d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '09e7e982-6c05-4ebd-bca4-8587a0ff1162'... >2018-07-09 11:04:07.269 23 INFO octavia.controller.queue.endpoint [req-e4fcee5c-7417-47de-a6c7-2ca1753a1b44 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '85c2748a-7056-4672-bbe6-47434444d754'... >2018-07-09 11:04:12.496 23 INFO octavia.controller.queue.endpoint [req-7fa79b8e-d664-4627-a15b-7498609a43d8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f6b7ddbc-5157-478f-8664-a0fde79d1d78'... >2018-07-09 11:04:18.319 23 INFO octavia.controller.queue.endpoint [req-4846b8f9-e129-49b2-a9e1-72994914bfe5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1ab4b0b4-137e-4045-bcbd-bca055837c8a'... >2018-07-09 11:04:23.651 23 INFO octavia.controller.queue.endpoint [req-5bede91f-e8f7-4deb-be05-b0470d698856 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e9125e18-d1e2-41e8-a7c2-ae784abf321d'... >2018-07-09 11:04:25.061 23 INFO octavia.controller.queue.endpoint [req-9f915cb4-2fdb-474c-b753-e682fe7ff4c2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4e105e43-54c5-4dcf-b0e6-cee997188dd7'... >2018-07-09 11:04:29.815 23 INFO octavia.controller.queue.endpoint [req-9ad2bc51-5487-4453-9115-326184a75d43 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0069fc3e-1ebd-4592-bd59-afa325f24f48'... >2018-07-09 11:04:35.106 23 INFO octavia.controller.queue.endpoint [req-0139bc67-3dac-4fe9-aea1-269b7daf9dae - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '10c02bbe-6461-4d31-82fa-e8cd2515d67f'... >2018-07-09 11:37:36.108 23 INFO octavia.controller.queue.endpoint [req-e25146f7-7fa1-4d73-a906-f616d08e1dd0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '32ab9353-2028-48bc-b0f1-3f9eaedd1a2f'... >2018-07-09 11:37:36.230 23 INFO octavia.controller.worker.tasks.database_tasks [req-e25146f7-7fa1-4d73-a906-f616d08e1dd0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 7f98372d-8477-4ea9-9a25-3c82a8102a9b >2018-07-09 11:37:36.308 23 INFO octavia.certificates.generator.local [req-e25146f7-7fa1-4d73-a906-f616d08e1dd0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-09 11:37:36.309 23 INFO octavia.certificates.generator.local [req-e25146f7-7fa1-4d73-a906-f616d08e1dd0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-09 11:37:36.309 23 INFO octavia.certificates.generator.local [req-e25146f7-7fa1-4d73-a906-f616d08e1dd0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-09 11:37:36.309 23 INFO octavia.certificates.generator.local [req-e25146f7-7fa1-4d73-a906-f616d08e1dd0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-09 11:37:51.603 23 INFO octavia.controller.worker.tasks.database_tasks [req-e25146f7-7fa1-4d73-a906-f616d08e1dd0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 7f98372d-8477-4ea9-9a25-3c82a8102a9b with compute id b12219a9-4fde-4b17-9393-c9c747e9b394 for load balancer: 32ab9353-2028-48bc-b0f1-3f9eaedd1a2f >2018-07-09 11:37:52.411 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-e25146f7-7fa1-4d73-a906-f616d08e1dd0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 046f8d54-83b2-4569-88d0-6e2e9f492f70 already exists. Nothing to be done. >2018-07-09 11:38:09.754 23 INFO octavia.controller.worker.tasks.database_tasks [req-e25146f7-7fa1-4d73-a906-f616d08e1dd0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 32ab9353-2028-48bc-b0f1-3f9eaedd1a2f >2018-07-09 11:38:15.724 23 INFO octavia.controller.queue.endpoint [req-db95df1b-69e6-4bdb-9074-23b49baf50ce - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '9e60b745-dd84-4dfd-947e-460af0853210'... >2018-07-09 11:38:21.060 23 INFO octavia.controller.queue.endpoint [req-5e09d18d-64d0-4234-a20c-9bcef3c242d7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '6041a270-6d44-47f8-ac08-7595e8c763bc'... >2018-07-09 11:38:26.843 23 INFO octavia.controller.queue.endpoint [-] Creating member '181005f0-e6ea-4752-ab10-f9d9cc99b981'... >2018-07-09 12:45:50.273 23 INFO octavia.controller.queue.endpoint [req-e25146f7-7fa1-4d73-a906-f616d08e1dd0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '25829d56-5685-449c-8c5f-8a20166ce45d'... >2018-07-09 12:45:51.993 23 INFO octavia.controller.queue.endpoint [req-5283a777-25c5-4cf1-9040-0e69ea50937d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '8a443efb-2a88-4435-bdfc-01c3280afac4'... >2018-07-09 12:45:53.228 23 INFO octavia.controller.queue.endpoint [req-b9a61df8-7489-4f4b-b060-524004eabd3d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'daaddb63-bb7b-405e-b84c-6a315ad8d871'... >2018-07-09 12:45:54.062 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-e25146f7-7fa1-4d73-a906-f616d08e1dd0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 32231f54-bd81-4110-a275-1c012f067404 from port 7441334c-13f4-44b6-9fbd-9de4abeace25 >2018-07-09 12:45:54.332 23 INFO octavia.controller.queue.endpoint [req-41197aa8-50ce-4327-8918-62e9695f8956 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '32ab9353-2028-48bc-b0f1-3f9eaedd1a2f'... >2018-07-09 12:45:55.514 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-e25146f7-7fa1-4d73-a906-f616d08e1dd0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 32231f54-bd81-4110-a275-1c012f067404 >2018-07-09 12:45:55.971 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b9a61df8-7489-4f4b-b060-524004eabd3d - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group a4040d42-2570-4be9-b85f-d54df788f53c from port 9b0859c0-da86-4e22-8653-2f0567a139bb >2018-07-09 12:45:56.299 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-5283a777-25c5-4cf1-9040-0e69ea50937d - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group f1c91098-837d-43eb-a80c-1390f64a85c2 from port 36060ec2-9837-4a8f-863a-c89101609527 >2018-07-09 12:45:56.721 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b9a61df8-7489-4f4b-b060-524004eabd3d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group a4040d42-2570-4be9-b85f-d54df788f53c >2018-07-09 12:45:56.990 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-41197aa8-50ce-4327-8918-62e9695f8956 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 6c81159e-468c-4ea6-89c0-aac05c026f12 from port 046f8d54-83b2-4569-88d0-6e2e9f492f70 >2018-07-09 12:45:57.574 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-5283a777-25c5-4cf1-9040-0e69ea50937d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group f1c91098-837d-43eb-a80c-1390f64a85c2 >2018-07-09 12:45:57.808 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-41197aa8-50ce-4327-8918-62e9695f8956 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 6c81159e-468c-4ea6-89c0-aac05c026f12 >2018-07-09 12:46:41.053 23 INFO octavia.controller.queue.endpoint [req-e25146f7-7fa1-4d73-a906-f616d08e1dd0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'd72d3aea-362e-4f54-9959-52f97f1c574f'... >2018-07-09 12:46:41.763 23 INFO octavia.controller.worker.tasks.database_tasks [req-e25146f7-7fa1-4d73-a906-f616d08e1dd0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: bc5639b4-bce3-46a7-be9c-f074d2d0b204 >2018-07-09 12:46:42.083 23 INFO octavia.controller.queue.endpoint [req-5283a777-25c5-4cf1-9040-0e69ea50937d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'c4a50183-4bd6-4b2b-897f-b98c01aa57c1'... >2018-07-09 12:46:42.550 23 INFO octavia.controller.worker.tasks.database_tasks [req-5283a777-25c5-4cf1-9040-0e69ea50937d - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: bc5639b4-bce3-46a7-be9c-f074d2d0b204 >2018-07-09 12:46:51.558 23 INFO octavia.controller.queue.endpoint [req-5283a777-25c5-4cf1-9040-0e69ea50937d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5e961509-6ce5-48b6-95ab-247498f02ad6'... >2018-07-09 12:46:52.795 23 INFO octavia.controller.queue.endpoint [req-10ccdafe-f252-429d-b285-2a8d1a568e6c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5603a064-32e7-4bd1-941a-158384a89725'... >2018-07-09 12:46:53.611 23 INFO octavia.controller.queue.endpoint [req-b9a61df8-7489-4f4b-b060-524004eabd3d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cab68203-95ad-4b44-82b9-62d65f3dbdbb'... >2018-07-09 12:47:05.303 23 INFO octavia.controller.queue.endpoint [req-7c8fdd6e-4b45-486b-9822-29c8a61b0068 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool '81b756dc-b863-4531-9b9a-7904be8cb0d3'... >2018-07-09 12:47:06.441 23 INFO octavia.controller.queue.endpoint [-] Deleting load balancer 'bc5639b4-bce3-46a7-be9c-f074d2d0b204'... >2018-07-09 12:47:08.804 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Removing security group 83d86423-6744-48f7-9214-886d26f1d715 from port 27b76c2e-b06f-4f69-a7de-c16a209a54c6 >2018-07-09 12:47:09.514 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Deleted security group 83d86423-6744-48f7-9214-886d26f1d715 >2018-07-09 18:24:23.073 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer '1a9302f0-a40f-4e3e-bb68-fb3c091a4ae2'... >2018-07-09 18:24:23.187 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id 8e1f114a-456a-4c10-acab-525fcc4f785c >2018-07-09 18:24:23.288 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally. >2018-07-09 18:24:23.288 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config. >2018-07-09 18:24:23.288 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config. >2018-07-09 18:24:23.289 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config. >2018-07-09 18:24:39.870 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: 8e1f114a-456a-4c10-acab-525fcc4f785c with compute id aeb3211f-f388-4ea2-a1ae-b5ba631c771a for load balancer: 1a9302f0-a40f-4e3e-bb68-fb3c091a4ae2 >2018-07-09 18:24:40.718 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port 4f820548-1721-42d9-8990-be2fbafeb1ba already exists. Nothing to be done. >2018-07-09 18:24:49.146 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.8', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.0.1 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47005b4210>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-09 18:24:58.761 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: 1a9302f0-a40f-4e3e-bb68-fb3c091a4ae2 >2018-07-09 18:24:59.243 23 INFO octavia.controller.queue.endpoint [req-5b044dc9-765c-43e2-9a8c-580d58e9d455 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '4c684c67-7dae-40c3-8af5-810eea076f6c'... >2018-07-09 18:25:00.770 23 INFO octavia.controller.queue.endpoint [-] Creating listener '2abdbda0-4e88-4940-aef7-1a20e4c8d98c'... >2018-07-09 18:25:02.026 23 INFO octavia.controller.queue.endpoint [req-5b044dc9-765c-43e2-9a8c-580d58e9d455 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '2dbc32cf-cc47-458f-9919-daaae5336908'... >2018-07-09 18:25:23.997 23 INFO octavia.controller.queue.endpoint [req-23a4cb3c-5767-4377-857f-7ecd7bfafa1a - 6730069018ad4583bba11c467ec9bd3b - - -] Creating member 'd1a41718-87da-4931-925e-87fbe721f1f2'... >2018-07-09 18:25:27.032 23 INFO octavia.controller.queue.endpoint [req-f6e0d53f-34be-4719-a9a7-1836ec454201 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ff2ad276-2e33-4c11-9b5c-b5c9a8e0701a'... >2018-07-09 18:25:28.581 23 INFO octavia.controller.queue.endpoint [req-aa16f77b-bbfe-4441-aca7-e8097a682259 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '53570307-e3f2-4cbd-9951-5ba002c27fd2'... >2018-07-09 18:36:28.351 23 INFO octavia.controller.queue.endpoint [-] Deleting listener '2dbc32cf-cc47-458f-9919-daaae5336908'... >2018-07-09 18:36:29.059 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: 1a9302f0-a40f-4e3e-bb68-fb3c091a4ae2 >2018-07-09 18:36:30.352 23 INFO octavia.controller.queue.endpoint [req-11dcc1b8-64db-4e99-ae0c-cb914e030057 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '2abdbda0-4e88-4940-aef7-1a20e4c8d98c'... >2018-07-09 18:36:30.844 23 INFO octavia.controller.worker.tasks.database_tasks [req-11dcc1b8-64db-4e99-ae0c-cb914e030057 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 1a9302f0-a40f-4e3e-bb68-fb3c091a4ae2 >2018-07-09 18:36:34.745 23 INFO octavia.controller.queue.endpoint [req-5522415d-a3cb-4e9b-baec-55b2fbf74918 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd1a41718-87da-4931-925e-87fbe721f1f2'... >2018-07-09 18:36:35.726 23 INFO octavia.controller.queue.endpoint [req-10ccdafe-f252-429d-b285-2a8d1a568e6c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ff2ad276-2e33-4c11-9b5c-b5c9a8e0701a'... >2018-07-09 18:36:35.981 23 INFO octavia.controller.queue.endpoint [-] Deleting member '53570307-e3f2-4cbd-9951-5ba002c27fd2'... >2018-07-09 18:36:48.561 23 INFO octavia.controller.queue.endpoint [req-e25146f7-7fa1-4d73-a906-f616d08e1dd0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool '4c684c67-7dae-40c3-8af5-810eea076f6c'... >2018-07-09 18:36:49.729 23 INFO octavia.controller.queue.endpoint [req-727e8fbd-4588-4778-bfa9-3961de88d5f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '1a9302f0-a40f-4e3e-bb68-fb3c091a4ae2'... >2018-07-09 18:36:51.911 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-727e8fbd-4588-4778-bfa9-3961de88d5f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 7412d643-fae7-47e6-8d8a-8d2e322f74d9 from port 4f820548-1721-42d9-8990-be2fbafeb1ba >2018-07-09 18:36:52.612 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-727e8fbd-4588-4778-bfa9-3961de88d5f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 7412d643-fae7-47e6-8d8a-8d2e322f74d9 >2018-07-09 18:37:50.365 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer 'f01439db-2f39-461f-a3c0-ff8b445af3a4'... >2018-07-09 18:37:50.513 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id 961905f2-87c1-43fc-a987-7877fd1e192b >2018-07-09 18:37:50.804 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally. >2018-07-09 18:37:50.804 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config. >2018-07-09 18:37:50.804 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config. >2018-07-09 18:37:50.805 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config. >2018-07-09 18:38:03.817 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: 961905f2-87c1-43fc-a987-7877fd1e192b with compute id d1b03781-f741-415e-87b5-1031ab8cf3dd for load balancer: f01439db-2f39-461f-a3c0-ff8b445af3a4 >2018-07-09 18:38:04.162 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port 91c0bd70-af63-4ede-94cf-61c8666e7961 already exists. Nothing to be done. >2018-07-09 18:38:19.561 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: f01439db-2f39-461f-a3c0-ff8b445af3a4 >2018-07-09 18:38:20.420 23 INFO octavia.controller.queue.endpoint [req-e358e2e1-82cc-413d-859a-babbd4bf5dd1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '9445171a-18de-4ff7-b64d-78e7f9643975'... >2018-07-09 18:38:21.993 23 INFO octavia.controller.queue.endpoint [-] Creating listener 'bb14639d-7c2b-4ee3-a7d8-9c5db7b9faa6'... >2018-07-09 18:38:23.199 23 INFO octavia.controller.queue.endpoint [req-5cc27da4-1f87-4955-9e6e-003d0893424c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'eb052c07-6af9-4095-b1b7-87146a11e8d8'... >2018-07-09 18:38:46.406 23 INFO octavia.controller.queue.endpoint [req-e358e2e1-82cc-413d-859a-babbd4bf5dd1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'bcdf2415-2d44-4744-a7b0-d36a2b22c7f8'... >2018-07-09 18:38:48.864 23 INFO octavia.controller.queue.endpoint [req-5522415d-a3cb-4e9b-baec-55b2fbf74918 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5815934e-4a9a-46ac-9edd-0229c18d48d6'... >2018-07-09 18:38:50.642 23 INFO octavia.controller.queue.endpoint [req-e25146f7-7fa1-4d73-a906-f616d08e1dd0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'fb3d0667-7fbc-4437-b708-8438ce74d991'... >2018-07-09 18:51:49.948 23 INFO octavia.controller.queue.endpoint [req-1e99537d-85b4-4ab1-ab6a-49cd45e83493 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'eb052c07-6af9-4095-b1b7-87146a11e8d8'... >2018-07-09 18:51:50.648 23 INFO octavia.controller.worker.tasks.database_tasks [req-1e99537d-85b4-4ab1-ab6a-49cd45e83493 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f01439db-2f39-461f-a3c0-ff8b445af3a4 >2018-07-09 18:51:55.981 23 INFO octavia.controller.queue.endpoint [req-867ef8fc-e97d-45f0-82d9-97a53b47c9ff - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'bb14639d-7c2b-4ee3-a7d8-9c5db7b9faa6'... >2018-07-09 18:51:56.533 23 INFO octavia.controller.worker.tasks.database_tasks [req-867ef8fc-e97d-45f0-82d9-97a53b47c9ff - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f01439db-2f39-461f-a3c0-ff8b445af3a4 >2018-07-09 18:51:57.318 23 INFO octavia.controller.queue.endpoint [req-727e8fbd-4588-4778-bfa9-3961de88d5f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'bcdf2415-2d44-4744-a7b0-d36a2b22c7f8'... >2018-07-09 18:51:59.412 23 INFO octavia.controller.queue.endpoint [req-727e8fbd-4588-4778-bfa9-3961de88d5f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5815934e-4a9a-46ac-9edd-0229c18d48d6'... >2018-07-09 18:52:00.691 23 INFO octavia.controller.queue.endpoint [req-866d5b76-df03-46d2-a943-e1b3bf20bec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'fb3d0667-7fbc-4437-b708-8438ce74d991'... >2018-07-09 18:52:13.167 23 INFO octavia.controller.queue.endpoint [req-baee9065-d8a6-4b72-acc1-21626d0a1b9f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool '9445171a-18de-4ff7-b64d-78e7f9643975'... >2018-07-09 18:52:14.308 23 INFO octavia.controller.queue.endpoint [req-e612f41e-d121-4304-b09b-9f26cb4224c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f01439db-2f39-461f-a3c0-ff8b445af3a4'... >2018-07-09 18:52:17.112 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-e612f41e-d121-4304-b09b-9f26cb4224c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 0a6d023b-8982-4574-9ed8-0aab36500962 from port 91c0bd70-af63-4ede-94cf-61c8666e7961 >2018-07-09 18:52:17.803 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-e612f41e-d121-4304-b09b-9f26cb4224c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 0a6d023b-8982-4574-9ed8-0aab36500962 >2018-07-09 18:54:12.431 23 INFO octavia.controller.queue.endpoint [req-e612f41e-d121-4304-b09b-9f26cb4224c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '086161c5-d21c-470b-aeec-4cc56bcaf2fd'... >2018-07-09 18:54:12.546 23 INFO octavia.controller.worker.tasks.database_tasks [req-e612f41e-d121-4304-b09b-9f26cb4224c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id e488ec4f-3fff-4224-9beb-78cb904ef15d >2018-07-09 18:54:12.651 23 INFO octavia.certificates.generator.local [req-e612f41e-d121-4304-b09b-9f26cb4224c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-09 18:54:12.652 23 INFO octavia.certificates.generator.local [req-e612f41e-d121-4304-b09b-9f26cb4224c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-09 18:54:12.652 23 INFO octavia.certificates.generator.local [req-e612f41e-d121-4304-b09b-9f26cb4224c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-09 18:54:12.653 23 INFO octavia.certificates.generator.local [req-e612f41e-d121-4304-b09b-9f26cb4224c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-09 18:54:26.733 23 INFO octavia.controller.worker.tasks.database_tasks [req-e612f41e-d121-4304-b09b-9f26cb4224c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: e488ec4f-3fff-4224-9beb-78cb904ef15d with compute id 1475fb10-3692-4c47-b2ca-94b5af5e1009 for load balancer: 086161c5-d21c-470b-aeec-4cc56bcaf2fd >2018-07-09 18:54:27.207 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-e612f41e-d121-4304-b09b-9f26cb4224c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 0846f477-8a02-4e8a-9e8c-d734e922cd53 already exists. Nothing to be done. >2018-07-09 18:54:43.629 23 INFO octavia.controller.worker.tasks.database_tasks [req-e612f41e-d121-4304-b09b-9f26cb4224c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 086161c5-d21c-470b-aeec-4cc56bcaf2fd >2018-07-09 18:54:44.523 23 INFO octavia.controller.queue.endpoint [req-727e8fbd-4588-4778-bfa9-3961de88d5f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '99e683c7-9811-4783-834f-82077b92b1be'... >2018-07-09 18:54:46.090 23 INFO octavia.controller.queue.endpoint [req-e3c27443-5a49-4de8-b20d-0c0ef49aed8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '6693a673-225f-4a60-8e7e-cf6e149d89ad'... >2018-07-09 18:54:47.288 23 INFO octavia.controller.queue.endpoint [req-baee9065-d8a6-4b72-acc1-21626d0a1b9f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '907133d2-2ecb-41f4-a144-5b23fc30c975'... >2018-07-09 18:55:09.895 23 INFO octavia.controller.queue.endpoint [req-10ccdafe-f252-429d-b285-2a8d1a568e6c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9aea97ac-dc26-4d36-911c-e3f4a146cfcb'... >2018-07-09 18:55:11.382 23 INFO octavia.controller.queue.endpoint [req-867ef8fc-e97d-45f0-82d9-97a53b47c9ff - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ac774dfc-07c0-407e-9a5d-592e875a8c71'... >2018-07-09 18:55:12.361 23 INFO octavia.controller.queue.endpoint [req-727e8fbd-4588-4778-bfa9-3961de88d5f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a7a4773f-3e7c-43ec-aef5-2e80a8549080'... >2018-07-09 19:20:38.428 23 INFO octavia.controller.queue.endpoint [req-6b6f0b18-f8d4-42b1-9333-26da8cb2306f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'f88d70db-20a8-4784-bc0a-d9401225b63a'... >2018-07-09 19:20:38.565 23 INFO octavia.controller.worker.tasks.database_tasks [req-6b6f0b18-f8d4-42b1-9333-26da8cb2306f - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 552af31f-88b1-4cc1-990b-7995b784fb90 >2018-07-09 19:20:38.654 23 INFO octavia.certificates.generator.local [req-6b6f0b18-f8d4-42b1-9333-26da8cb2306f - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-09 19:20:38.654 23 INFO octavia.certificates.generator.local [req-6b6f0b18-f8d4-42b1-9333-26da8cb2306f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-09 19:20:38.655 23 INFO octavia.certificates.generator.local [req-6b6f0b18-f8d4-42b1-9333-26da8cb2306f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-09 19:20:38.655 23 INFO octavia.certificates.generator.local [req-6b6f0b18-f8d4-42b1-9333-26da8cb2306f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-09 19:20:47.588 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer '7d7fdbfc-7d4c-4986-bc27-09fbc98ee48c'... >2018-07-09 19:20:47.810 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id 814d0686-3d41-48d0-b2d4-813f05eee8c2 >2018-07-09 19:20:47.901 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally. >2018-07-09 19:20:47.901 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config. >2018-07-09 19:20:47.901 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config. >2018-07-09 19:20:47.901 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config. >2018-07-09 19:20:51.615 23 INFO octavia.controller.worker.tasks.database_tasks [req-6b6f0b18-f8d4-42b1-9333-26da8cb2306f - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 552af31f-88b1-4cc1-990b-7995b784fb90 with compute id c5a63f70-5e24-44e9-a79b-f6aef293aa48 for load balancer: f88d70db-20a8-4784-bc0a-d9401225b63a >2018-07-09 19:20:51.968 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-6b6f0b18-f8d4-42b1-9333-26da8cb2306f - 293061856e1a4cffbae3ed099cf4f619 - - -] Port ee18712e-63af-42d7-888c-a221d493002e already exists. Nothing to be done. >2018-07-09 19:20:55.640 23 INFO octavia.controller.queue.endpoint [req-c5669dab-5a50-4280-834c-e5b9ea9e9b7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'ca849617-112e-4670-9fbc-83d0b158e648'... >2018-07-09 19:20:55.756 23 INFO octavia.controller.worker.tasks.database_tasks [req-c5669dab-5a50-4280-834c-e5b9ea9e9b7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 9f7a17ac-3ff4-46c8-a196-f5dd8f159b57 >2018-07-09 19:20:55.788 23 INFO octavia.certificates.generator.local [req-c5669dab-5a50-4280-834c-e5b9ea9e9b7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-09 19:20:55.788 23 INFO octavia.certificates.generator.local [req-c5669dab-5a50-4280-834c-e5b9ea9e9b7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-09 19:20:55.788 23 INFO octavia.certificates.generator.local [req-c5669dab-5a50-4280-834c-e5b9ea9e9b7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-09 19:20:55.789 23 INFO octavia.certificates.generator.local [req-c5669dab-5a50-4280-834c-e5b9ea9e9b7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-09 19:21:07.344 23 INFO octavia.controller.worker.tasks.database_tasks [req-c5669dab-5a50-4280-834c-e5b9ea9e9b7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 9f7a17ac-3ff4-46c8-a196-f5dd8f159b57 with compute id feea02bd-5fe6-4950-a090-6d4a29d5539b for load balancer: ca849617-112e-4670-9fbc-83d0b158e648 >2018-07-09 19:21:07.442 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-c5669dab-5a50-4280-834c-e5b9ea9e9b7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Port c00819f0-d6b6-4fe0-94e7-6498dd236409 already exists. Nothing to be done. >2018-07-09 19:21:10.025 23 INFO octavia.controller.worker.tasks.database_tasks [req-6b6f0b18-f8d4-42b1-9333-26da8cb2306f - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f88d70db-20a8-4784-bc0a-d9401225b63a >2018-07-09 19:21:18.287 23 INFO octavia.controller.queue.endpoint [req-c12f57fd-8551-4eaa-b527-a767c7f23e29 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '25914e2f-ae0e-47f0-9b56-5ad8bf9822c0'... >2018-07-09 19:21:20.839 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: 814d0686-3d41-48d0-b2d4-813f05eee8c2 with compute id 040602c9-3806-4743-88c1-cedeb54e5f91 for load balancer: 7d7fdbfc-7d4c-4986-bc27-09fbc98ee48c >2018-07-09 19:21:20.936 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port 1dc57ded-d36c-4d25-90ec-fe6cf949d19e already exists. Nothing to be done. >2018-07-09 19:21:23.644 23 INFO octavia.controller.queue.endpoint [-] Creating pool '69797cc0-6031-46a6-8844-7dee0625bd8a'... >2018-07-09 19:21:25.752 23 INFO octavia.controller.worker.tasks.database_tasks [req-c5669dab-5a50-4280-834c-e5b9ea9e9b7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: ca849617-112e-4670-9fbc-83d0b158e648 >2018-07-09 19:21:29.037 23 INFO octavia.controller.queue.endpoint [req-6b6f0b18-f8d4-42b1-9333-26da8cb2306f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '118277c1-78a4-4218-b729-c5534a7760ac'... >2018-07-09 19:21:30.396 23 INFO octavia.controller.queue.endpoint [req-11625d2f-c0a8-43b2-a88e-e8a9f425d87d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4b101883-ce52-465d-8bee-b58d2c2ac2db'... >2018-07-09 19:21:35.580 23 INFO octavia.controller.queue.endpoint [req-c5669dab-5a50-4280-834c-e5b9ea9e9b7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '143a247a-b9ad-4f42-a09c-de4161584498'... >2018-07-09 19:21:36.225 23 INFO octavia.controller.queue.endpoint [req-c074d7ed-1dca-42d6-90ff-e9f2c4b96284 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '9da0ce87-c686-42e8-a1de-ad183ed8af5a'... >2018-07-09 19:21:36.530 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.3', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.254.95 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4702f9c1d0>, 'Connection to 172.24.0.3 timed out. (connect timeout=10.0)')) >2018-07-09 19:21:41.228 23 INFO octavia.controller.queue.endpoint [req-11dcc1b8-64db-4e99-ae0c-cb914e030057 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'ac1bb267-91a4-4623-aadb-9e5992f8ace7'... >2018-07-09 19:21:46.055 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: 7d7fdbfc-7d4c-4986-bc27-09fbc98ee48c >2018-07-09 19:21:46.641 23 INFO octavia.controller.queue.endpoint [req-28f0e388-b21e-40ab-8cb0-c4121a69019e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c424622e-6b14-453c-b97e-c375962b41eb'... >2018-07-09 19:21:57.912 23 INFO octavia.controller.queue.endpoint [req-ab828f8a-eafc-4cc2-8737-3e5a90d87738 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'b6eccc0a-8696-442e-8b4d-cb1cbb234bb0'... >2018-07-09 19:22:03.601 23 INFO octavia.controller.queue.endpoint [req-e612f41e-d121-4304-b09b-9f26cb4224c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '795b0a1d-50bb-4a9a-af51-42d33f679aff'... >2018-07-09 19:22:08.891 23 INFO octavia.controller.queue.endpoint [req-f8ab3237-6901-4933-8f04-217211cf23a4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '9df3cd4f-62e8-43cb-9c38-704292580683'... >2018-07-09 19:22:14.150 23 INFO octavia.controller.queue.endpoint [req-a412c750-2aa8-4d11-b6b8-7b911348f52f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '3fb57493-72bb-4b13-aeb2-db0f5959d4e2'... >2018-07-09 19:22:19.297 23 INFO octavia.controller.queue.endpoint [req-d6e60b9a-de90-4d1f-86de-04f4d6f0e958 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'b9bb0e6b-e1b6-463f-9f93-319870cdc30d'... >2018-07-09 19:22:24.325 23 INFO octavia.controller.queue.endpoint [req-a0e0102e-2adc-45ea-a167-22cee058cb50 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '41fe568c-a01a-4031-97fe-26dd840a6d5a'... >2018-07-09 19:22:29.990 23 INFO octavia.controller.queue.endpoint [req-f6076d72-b428-47e5-8d02-b449e411298c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '679903f6-6083-4a70-879c-ac8bd69b1a6d'... >2018-07-09 19:22:35.241 23 INFO octavia.controller.queue.endpoint [req-3570ab7a-1bee-48c6-9df1-107d3cb0317c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '15eb1410-52f8-4eaf-9b48-61c4a736890d'... >2018-07-09 19:22:40.763 23 INFO octavia.controller.queue.endpoint [req-9860fc84-db72-4bdc-8245-f25ffa80248e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8729fcd0-6f00-4ab1-81be-f563c28fcf32'... >2018-07-09 19:22:47.175 23 INFO octavia.controller.queue.endpoint [req-4942f779-8dc9-4c34-909d-3024d2c8a337 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b932e212-32a8-45d9-9aad-ed1d0c9ad7ec'... >2018-07-09 19:22:52.893 23 INFO octavia.controller.queue.endpoint [req-b745dba3-88eb-42f8-bef3-1ced5bd84355 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8a35b956-08d5-458b-8ad9-7b8815cb2e1c'... >2018-07-09 19:22:57.746 23 INFO octavia.controller.queue.endpoint [req-074b9d10-8c60-4a58-81cb-cc41b4223130 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2a256c6c-af0d-48e8-89bf-5f0d219dec92'... >2018-07-10 08:11:33.375 23 INFO octavia.controller.queue.endpoint [req-c024519e-28d0-4488-ba97-d85e9841e61e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '075a3b7a-2e4f-454a-954d-75972e7e5af2'... >2018-07-10 08:11:33.493 23 INFO octavia.controller.worker.tasks.database_tasks [req-c024519e-28d0-4488-ba97-d85e9841e61e - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id e3b80415-b59d-4acf-8f3c-a50bdc4a3ffa >2018-07-10 08:11:33.662 23 INFO octavia.certificates.generator.local [req-c024519e-28d0-4488-ba97-d85e9841e61e - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-10 08:11:33.662 23 INFO octavia.certificates.generator.local [req-c024519e-28d0-4488-ba97-d85e9841e61e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-10 08:11:33.662 23 INFO octavia.certificates.generator.local [req-c024519e-28d0-4488-ba97-d85e9841e61e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-10 08:11:33.663 23 INFO octavia.certificates.generator.local [req-c024519e-28d0-4488-ba97-d85e9841e61e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-10 08:11:49.227 23 INFO octavia.controller.worker.tasks.database_tasks [req-c024519e-28d0-4488-ba97-d85e9841e61e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: e3b80415-b59d-4acf-8f3c-a50bdc4a3ffa with compute id 4029582e-cc57-458e-bc9c-5a87c2da3cda for load balancer: 075a3b7a-2e4f-454a-954d-75972e7e5af2 >2018-07-10 08:11:50.077 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-c024519e-28d0-4488-ba97-d85e9841e61e - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 7e6649fb-54a7-4fba-889f-9ed53bc4fc3f already exists. Nothing to be done. >2018-07-10 08:11:56.955 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-c024519e-28d0-4488-ba97-d85e9841e61e - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.13', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.91.189 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700646510>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-10 08:12:06.526 23 INFO octavia.controller.worker.tasks.database_tasks [req-c024519e-28d0-4488-ba97-d85e9841e61e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 075a3b7a-2e4f-454a-954d-75972e7e5af2 >2018-07-10 08:12:13.331 23 INFO octavia.controller.queue.endpoint [req-8da089b8-b8b4-4f50-aaa6-106984416816 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'ae010a2a-fde1-45ca-94c9-1c8a175bc270'... >2018-07-10 08:12:18.332 23 INFO octavia.controller.queue.endpoint [req-3302ce35-aaf8-4341-97bf-12573c598849 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'f04cbff6-a77b-478b-986d-1504952ab835'... >2018-07-10 08:12:23.569 23 INFO octavia.controller.queue.endpoint [req-ae9f304f-e972-43f8-bb19-3fdc23a763b7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '75324162-8dcf-4640-948c-49f84ab014b2'... >2018-07-10 08:15:14.829 23 INFO octavia.controller.queue.endpoint [-] Deleting load balancer '075a3b7a-2e4f-454a-954d-75972e7e5af2'... >2018-07-10 08:15:17.085 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Removing security group 7f872e71-a22b-423b-b801-3006d3523670 from port 7e6649fb-54a7-4fba-889f-9ed53bc4fc3f >2018-07-10 08:15:17.991 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Deleted security group 7f872e71-a22b-423b-b801-3006d3523670 >2018-07-10 08:29:03.955 23 INFO octavia.controller.queue.endpoint [req-5f1072d5-142a-46e7-928e-6d424fa4f62f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'bf691cc6-68f2-4cb5-8aac-b5c6f75906b3'... >2018-07-10 08:29:04.071 23 INFO octavia.controller.worker.tasks.database_tasks [req-5f1072d5-142a-46e7-928e-6d424fa4f62f - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 02a017d8-6a6a-4af4-9610-daece1b9cc61 >2018-07-10 08:29:04.240 23 INFO octavia.certificates.generator.local [req-5f1072d5-142a-46e7-928e-6d424fa4f62f - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-10 08:29:04.240 23 INFO octavia.certificates.generator.local [req-5f1072d5-142a-46e7-928e-6d424fa4f62f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-10 08:29:04.240 23 INFO octavia.certificates.generator.local [req-5f1072d5-142a-46e7-928e-6d424fa4f62f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-10 08:29:04.241 23 INFO octavia.certificates.generator.local [req-5f1072d5-142a-46e7-928e-6d424fa4f62f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-10 08:29:18.259 23 INFO octavia.controller.worker.tasks.database_tasks [req-5f1072d5-142a-46e7-928e-6d424fa4f62f - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 02a017d8-6a6a-4af4-9610-daece1b9cc61 with compute id dbeeb9a9-0382-49e2-a013-370c79508414 for load balancer: bf691cc6-68f2-4cb5-8aac-b5c6f75906b3 >2018-07-10 08:29:18.472 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-5f1072d5-142a-46e7-928e-6d424fa4f62f - 293061856e1a4cffbae3ed099cf4f619 - - -] Port c39aeac3-f770-4cba-a263-2f1962f7002c already exists. Nothing to be done. >2018-07-10 08:29:36.227 23 INFO octavia.controller.worker.tasks.database_tasks [req-5f1072d5-142a-46e7-928e-6d424fa4f62f - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: bf691cc6-68f2-4cb5-8aac-b5c6f75906b3 >2018-07-10 08:29:46.047 23 INFO octavia.controller.queue.endpoint [req-cef0e5d0-2977-41da-bee1-4fd482f0ae2c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '93aa92fb-f6bf-4f38-b2db-1aa4104d464f'... >2018-07-10 08:29:50.913 23 INFO octavia.controller.queue.endpoint [req-1dbd91c4-d44a-479e-867f-09e9f93f9c33 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '7efa93ca-1f75-4747-bd34-abdf3082c246'... >2018-07-10 08:29:55.687 23 INFO octavia.controller.queue.endpoint [req-c024519e-28d0-4488-ba97-d85e9841e61e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e6fe4d89-d6a2-4ead-a8f0-693907adccba'... >2018-07-10 10:22:29.898 23 INFO octavia.controller.queue.endpoint [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '39bd048e-b34c-4a4b-b929-84e4d1d49f76'... >2018-07-10 10:22:30.020 23 INFO octavia.controller.worker.tasks.database_tasks [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id bacbac3a-b524-4dd2-b794-876eaafa9e82 >2018-07-10 10:22:30.215 23 INFO octavia.certificates.generator.local [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-10 10:22:30.215 23 INFO octavia.certificates.generator.local [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-10 10:22:30.216 23 INFO octavia.certificates.generator.local [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-10 10:22:30.216 23 INFO octavia.certificates.generator.local [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-10 10:22:45.245 23 INFO octavia.controller.worker.tasks.database_tasks [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: bacbac3a-b524-4dd2-b794-876eaafa9e82 with compute id 4e2815e6-5b9e-413b-9004-1525fd286daf for load balancer: 39bd048e-b34c-4a4b-b929-84e4d1d49f76 >2018-07-10 10:22:46.070 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port b70b55e2-0e77-4ead-af9f-558116089590 already exists. Nothing to be done. >2018-07-10 10:23:01.932 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.12', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.166.211 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4702f9cc10>, 'Connection to 172.24.0.12 timed out. (connect timeout=10.0)')) >2018-07-10 10:23:11.511 23 INFO octavia.controller.worker.tasks.database_tasks [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 39bd048e-b34c-4a4b-b929-84e4d1d49f76 >2018-07-10 10:23:24.313 23 INFO octavia.controller.queue.endpoint [req-af00b7d9-0be1-40d8-b00e-6cdc3a4d52d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '3ee52e9f-ed02-478c-8ddf-16677987ee72'... >2018-07-10 10:23:29.664 23 INFO octavia.controller.queue.endpoint [req-7fa5bb32-0ed6-4645-a6ca-fe83ebffd8f8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '3f7ec0ff-330b-485d-b745-7c0798400917'... >2018-07-10 10:23:35.009 23 INFO octavia.controller.queue.endpoint [req-d47d3f71-c1ae-4ed7-950e-325d41ab6961 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ca73aa05-b70b-4a05-8167-59433b2dabbf'... >2018-07-10 10:23:44.827 23 INFO octavia.controller.queue.endpoint [-] Deleting load balancer '39bd048e-b34c-4a4b-b929-84e4d1d49f76'... >2018-07-10 10:23:46.815 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Removing security group 17df369e-3e81-44a9-9940-03827f60ae40 from port b70b55e2-0e77-4ead-af9f-558116089590 >2018-07-10 10:23:47.532 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Deleted security group 17df369e-3e81-44a9-9940-03827f60ae40 >2018-07-10 10:38:07.541 23 INFO octavia.controller.queue.endpoint [req-f2763234-4ce0-4fa9-97b3-66c9f9bf7664 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '770520c1-fa9b-4328-8ea5-1ba5b5770a00'... >2018-07-10 10:38:07.654 23 INFO octavia.controller.worker.tasks.database_tasks [req-f2763234-4ce0-4fa9-97b3-66c9f9bf7664 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 4f9ee737-7e67-4835-be45-affd6c35bc12 >2018-07-10 10:38:07.740 23 INFO octavia.certificates.generator.local [req-f2763234-4ce0-4fa9-97b3-66c9f9bf7664 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-10 10:38:07.740 23 INFO octavia.certificates.generator.local [req-f2763234-4ce0-4fa9-97b3-66c9f9bf7664 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-10 10:38:07.741 23 INFO octavia.certificates.generator.local [req-f2763234-4ce0-4fa9-97b3-66c9f9bf7664 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-10 10:38:07.741 23 INFO octavia.certificates.generator.local [req-f2763234-4ce0-4fa9-97b3-66c9f9bf7664 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-10 10:38:20.701 23 INFO octavia.controller.worker.tasks.database_tasks [req-f2763234-4ce0-4fa9-97b3-66c9f9bf7664 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 4f9ee737-7e67-4835-be45-affd6c35bc12 with compute id 8b987d33-2a89-4572-8220-d97d9b7da54c for load balancer: 770520c1-fa9b-4328-8ea5-1ba5b5770a00 >2018-07-10 10:38:21.112 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f2763234-4ce0-4fa9-97b3-66c9f9bf7664 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port a4fe8d5f-07e1-4874-8d67-d67b3517826d already exists. Nothing to be done. >2018-07-10 10:38:39.277 23 INFO octavia.controller.worker.tasks.database_tasks [req-f2763234-4ce0-4fa9-97b3-66c9f9bf7664 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 770520c1-fa9b-4328-8ea5-1ba5b5770a00 >2018-07-10 10:38:49.334 23 INFO octavia.controller.queue.endpoint [-] Creating listener '9bb1c21b-4b26-4254-9bb7-f794b6b1b3f5'... >2018-07-10 10:38:54.199 23 INFO octavia.controller.queue.endpoint [req-d68c68c4-b58c-47f3-970d-49a553b0607f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '818b7eac-07cf-48ee-95e7-1b6b2d413474'... >2018-07-10 10:38:58.933 23 INFO octavia.controller.queue.endpoint [req-0feba816-8764-4ef7-9bf2-8030f5136248 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd95e14fb-2a32-4e54-a6ce-4c293b40ee67'... >2018-07-10 10:39:08.534 23 INFO octavia.controller.queue.endpoint [req-963ee89f-dab2-4e91-be4d-e8ca102aea73 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '770520c1-fa9b-4328-8ea5-1ba5b5770a00'... >2018-07-10 10:39:10.976 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-963ee89f-dab2-4e91-be4d-e8ca102aea73 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 638ba4e0-0e17-49ce-b0c7-9d64cf9a0a4d from port a4fe8d5f-07e1-4874-8d67-d67b3517826d >2018-07-10 10:39:11.677 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-963ee89f-dab2-4e91-be4d-e8ca102aea73 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 638ba4e0-0e17-49ce-b0c7-9d64cf9a0a4d >2018-07-10 11:14:51.861 23 INFO octavia.controller.queue.endpoint [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '3a157f62-4f4b-48eb-8f0f-11084436cadd'... >2018-07-10 11:14:51.973 23 INFO octavia.controller.worker.tasks.database_tasks [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 937033c8-ff45-40ab-b59d-506140787af1 >2018-07-10 11:14:52.033 23 INFO octavia.certificates.generator.local [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-10 11:14:52.033 23 INFO octavia.certificates.generator.local [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-10 11:14:52.034 23 INFO octavia.certificates.generator.local [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-10 11:14:52.034 23 INFO octavia.certificates.generator.local [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-10 11:15:05.545 23 INFO octavia.controller.worker.tasks.database_tasks [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 937033c8-ff45-40ab-b59d-506140787af1 with compute id 20c90716-e63a-4726-a92b-793082296dec for load balancer: 3a157f62-4f4b-48eb-8f0f-11084436cadd >2018-07-10 11:15:05.847 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port ba043f57-dce9-4bcd-a019-df14ea6ab72c already exists. Nothing to be done. >2018-07-10 11:15:23.239 23 INFO octavia.controller.worker.tasks.database_tasks [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 3a157f62-4f4b-48eb-8f0f-11084436cadd >2018-07-10 11:15:33.376 23 INFO octavia.controller.queue.endpoint [req-7c8fdd6e-4b45-486b-9822-29c8a61b0068 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'f313e174-8cf6-40de-8c73-5d33b847d55f'... >2018-07-10 11:15:38.647 23 INFO octavia.controller.queue.endpoint [req-963ee89f-dab2-4e91-be4d-e8ca102aea73 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '39c7e3de-3f43-4fac-b632-0b4e28247a59'... >2018-07-10 11:15:44.016 23 INFO octavia.controller.queue.endpoint [req-5b01c9c3-2546-4b7b-83db-9d65ec332f07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '417645df-f685-4c5e-9229-c7b131954f78'... >2018-07-10 11:16:58.536 23 INFO octavia.controller.queue.endpoint [req-2c603fbb-8f63-4b4f-84a2-5d4a30002a42 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '3a157f62-4f4b-48eb-8f0f-11084436cadd'... >2018-07-10 11:17:00.282 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-2c603fbb-8f63-4b4f-84a2-5d4a30002a42 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 5e4354c4-ee8e-4057-a1bf-dd5f75c3e03d from port ba043f57-dce9-4bcd-a019-df14ea6ab72c >2018-07-10 11:17:01.220 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-2c603fbb-8f63-4b4f-84a2-5d4a30002a42 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 5e4354c4-ee8e-4057-a1bf-dd5f75c3e03d >2018-07-10 11:17:37.378 23 INFO octavia.controller.queue.endpoint [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '4fb44bf3-b770-458a-adf9-a6e62c6b0be4'... >2018-07-10 11:17:37.488 23 INFO octavia.controller.worker.tasks.database_tasks [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 6f4de79b-4d53-46e8-a951-d0afdf758bcb >2018-07-10 11:17:37.599 23 INFO octavia.certificates.generator.local [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-10 11:17:37.600 23 INFO octavia.certificates.generator.local [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-10 11:17:37.600 23 INFO octavia.certificates.generator.local [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-10 11:17:37.601 23 INFO octavia.certificates.generator.local [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-10 11:17:39.064 23 INFO octavia.controller.queue.endpoint [req-8d198b3d-0b87-44e6-ba3d-ab1099bc3ac1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '633f93ed-52d9-4852-9590-42e4a4f2a132'... >2018-07-10 11:17:39.304 23 INFO octavia.controller.worker.tasks.database_tasks [req-8d198b3d-0b87-44e6-ba3d-ab1099bc3ac1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 573c38a7-e683-49e4-b80e-2baef5c372bc >2018-07-10 11:17:39.588 23 INFO octavia.certificates.generator.local [req-8d198b3d-0b87-44e6-ba3d-ab1099bc3ac1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-10 11:17:39.589 23 INFO octavia.certificates.generator.local [req-8d198b3d-0b87-44e6-ba3d-ab1099bc3ac1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-10 11:17:39.589 23 INFO octavia.certificates.generator.local [req-8d198b3d-0b87-44e6-ba3d-ab1099bc3ac1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-10 11:17:39.590 23 INFO octavia.certificates.generator.local [req-8d198b3d-0b87-44e6-ba3d-ab1099bc3ac1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-10 11:17:49.928 23 INFO octavia.controller.worker.tasks.database_tasks [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 6f4de79b-4d53-46e8-a951-d0afdf758bcb with compute id 7c62555b-2a11-432b-aabf-f92e3edb111a for load balancer: 4fb44bf3-b770-458a-adf9-a6e62c6b0be4 >2018-07-10 11:17:50.230 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 2b5f811d-0f53-4ea1-ab39-430643ea93db already exists. Nothing to be done. >2018-07-10 11:17:51.349 23 INFO octavia.controller.worker.tasks.database_tasks [req-8d198b3d-0b87-44e6-ba3d-ab1099bc3ac1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 573c38a7-e683-49e4-b80e-2baef5c372bc with compute id 35f0e616-3113-4b6a-b232-d2a8165e2231 for load balancer: 633f93ed-52d9-4852-9590-42e4a4f2a132 >2018-07-10 11:17:51.667 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-8d198b3d-0b87-44e6-ba3d-ab1099bc3ac1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 2c446e6d-a79a-43fc-9a98-afa20fe66316 already exists. Nothing to be done. >2018-07-10 11:17:58.238 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-8d198b3d-0b87-44e6-ba3d-ab1099bc3ac1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.18', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.40.118 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470065d790>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-10 11:18:07.769 23 INFO octavia.controller.worker.tasks.database_tasks [req-8d198b3d-0b87-44e6-ba3d-ab1099bc3ac1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 633f93ed-52d9-4852-9590-42e4a4f2a132 >2018-07-10 11:18:07.878 23 INFO octavia.controller.worker.tasks.database_tasks [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 4fb44bf3-b770-458a-adf9-a6e62c6b0be4 >2018-07-10 11:18:16.349 23 INFO octavia.controller.queue.endpoint [req-0bf10ec8-4509-4fa7-908e-d5e7cf489c37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '7c1fa0f9-662b-4393-ae0a-e82e6d1609ab'... >2018-07-10 11:18:17.350 23 INFO octavia.controller.queue.endpoint [req-5831e717-4517-47b2-bae4-698f58e30103 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '0bdea3b7-b24c-4f11-b692-14c883599d7a'... >2018-07-10 11:18:21.695 23 INFO octavia.controller.queue.endpoint [req-ef3443a0-1ca9-4638-b19c-f138883b97d7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'a924328e-6da4-4df9-9088-074688e75b5f'... >2018-07-10 11:18:22.747 23 INFO octavia.controller.queue.endpoint [req-8d198b3d-0b87-44e6-ba3d-ab1099bc3ac1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '9c83fa44-c9f2-4abc-9d67-66a1150a4345'... >2018-07-10 11:18:26.947 23 INFO octavia.controller.queue.endpoint [req-37bc2609-a870-48f5-bfcf-cf29835bbe8b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '56234750-b309-4488-bb62-7d7c919c131b'... >2018-07-10 11:18:27.536 23 INFO octavia.controller.queue.endpoint [req-009c5f19-2359-4b3c-971a-834c98bcb908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8e6c9121-df8d-4320-be8b-fda2d3e502bf'... >2018-07-10 11:18:32.647 23 INFO octavia.controller.queue.endpoint [req-270d5cb5-3624-4407-b5a8-1cc4c1c7a4a6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9bb4860b-d21a-4fef-b795-be2a0e7765b6'... >2018-07-10 11:18:37.349 23 INFO octavia.controller.queue.endpoint [req-d8d8f43d-7c8b-4090-94b7-99de164c855f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '4fb44bf3-b770-458a-adf9-a6e62c6b0be4'... >2018-07-10 11:18:37.378 23 INFO octavia.controller.queue.endpoint [req-cb17bfa6-34d0-4006-9b3a-6b07d84917db - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '633f93ed-52d9-4852-9590-42e4a4f2a132'... >2018-07-10 11:18:40.073 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-d8d8f43d-7c8b-4090-94b7-99de164c855f - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 1d798d62-bc8b-4e41-a078-2109ec4a39e0 from port 2b5f811d-0f53-4ea1-ab39-430643ea93db >2018-07-10 11:18:40.487 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-cb17bfa6-34d0-4006-9b3a-6b07d84917db - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group b3f4831b-9a43-48b6-bdc4-f29742980ac2 from port 2c446e6d-a79a-43fc-9a98-afa20fe66316 >2018-07-10 11:18:40.794 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-d8d8f43d-7c8b-4090-94b7-99de164c855f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 1d798d62-bc8b-4e41-a078-2109ec4a39e0 >2018-07-10 11:18:41.201 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-cb17bfa6-34d0-4006-9b3a-6b07d84917db - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group b3f4831b-9a43-48b6-bdc4-f29742980ac2 >2018-07-10 11:52:10.783 23 INFO octavia.controller.queue.endpoint [req-d8d8f43d-7c8b-4090-94b7-99de164c855f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '35bef51c-0d3d-47a4-925c-a9f1ae0fd073'... >2018-07-10 11:52:10.921 23 INFO octavia.controller.worker.tasks.database_tasks [req-d8d8f43d-7c8b-4090-94b7-99de164c855f - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 87bd3bb6-9b7e-4c37-afaf-b3e6a9d072af >2018-07-10 11:52:11.092 23 INFO octavia.certificates.generator.local [req-d8d8f43d-7c8b-4090-94b7-99de164c855f - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-10 11:52:11.092 23 INFO octavia.certificates.generator.local [req-d8d8f43d-7c8b-4090-94b7-99de164c855f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-10 11:52:11.093 23 INFO octavia.certificates.generator.local [req-d8d8f43d-7c8b-4090-94b7-99de164c855f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-10 11:52:11.093 23 INFO octavia.certificates.generator.local [req-d8d8f43d-7c8b-4090-94b7-99de164c855f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-10 11:52:25.827 23 INFO octavia.controller.worker.tasks.database_tasks [req-d8d8f43d-7c8b-4090-94b7-99de164c855f - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 87bd3bb6-9b7e-4c37-afaf-b3e6a9d072af with compute id 996e6b21-b495-470e-a524-912bbe49ad80 for load balancer: 35bef51c-0d3d-47a4-925c-a9f1ae0fd073 >2018-07-10 11:52:26.681 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-d8d8f43d-7c8b-4090-94b7-99de164c855f - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 1aa24ab2-9652-4f6f-b402-ef7746c2bde1 already exists. Nothing to be done. >2018-07-10 11:52:42.823 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-d8d8f43d-7c8b-4090-94b7-99de164c855f - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.8', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.152.133 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470850fd90>, 'Connection to 172.24.0.8 timed out. (connect timeout=10.0)')) >2018-07-10 11:52:52.407 23 INFO octavia.controller.worker.tasks.database_tasks [req-d8d8f43d-7c8b-4090-94b7-99de164c855f - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 35bef51c-0d3d-47a4-925c-a9f1ae0fd073 >2018-07-10 11:52:53.250 23 INFO octavia.controller.queue.endpoint [req-673a21a9-ad7f-4cb6-890d-2617ff0396f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'af572061-6c06-489e-a1f5-342045c86960'... >2018-07-10 11:52:58.001 23 INFO octavia.controller.queue.endpoint [req-f47af341-b9b1-42a4-9314-1a39792fda0b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '5a1077b5-abff-41bb-b96f-6e2e2ac867dd'... >2018-07-10 11:53:03.087 23 INFO octavia.controller.queue.endpoint [req-9a3238fb-8e9b-418e-9253-d48061a2b805 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9a16d7f1-31da-4f2b-96d3-51cc8bffdfe0'... >2018-07-10 11:53:08.396 23 INFO octavia.controller.queue.endpoint [req-531186e0-c088-42dc-8348-7d182fb2bf53 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '05929ada-71b1-419d-910a-9bcdf8dfc906'... >2018-07-10 12:40:07.519 23 INFO octavia.controller.queue.endpoint [req-47487332-58de-47a8-b8f7-1d2aab4a6f11 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '35bef51c-0d3d-47a4-925c-a9f1ae0fd073'... >2018-07-10 12:40:10.140 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-47487332-58de-47a8-b8f7-1d2aab4a6f11 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 4d938c3f-cf69-4a40-90b5-d8b9a42b4c81 from port 1aa24ab2-9652-4f6f-b402-ef7746c2bde1 >2018-07-10 12:40:10.997 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-47487332-58de-47a8-b8f7-1d2aab4a6f11 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 4d938c3f-cf69-4a40-90b5-d8b9a42b4c81 >2018-07-10 12:42:56.411 23 INFO octavia.controller.queue.endpoint [req-71d41c6f-b908-4891-9793-2743a7049cfe - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '8b599f20-ba68-423c-a781-cf52d1783f31'... >2018-07-10 12:42:56.527 23 INFO octavia.controller.worker.tasks.database_tasks [req-71d41c6f-b908-4891-9793-2743a7049cfe - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 3ca36c3b-bf38-4096-92ad-27b77dce877e >2018-07-10 12:42:56.636 23 INFO octavia.certificates.generator.local [req-71d41c6f-b908-4891-9793-2743a7049cfe - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-10 12:42:56.637 23 INFO octavia.certificates.generator.local [req-71d41c6f-b908-4891-9793-2743a7049cfe - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-10 12:42:56.637 23 INFO octavia.certificates.generator.local [req-71d41c6f-b908-4891-9793-2743a7049cfe - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-10 12:42:56.638 23 INFO octavia.certificates.generator.local [req-71d41c6f-b908-4891-9793-2743a7049cfe - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-10 12:43:09.476 23 INFO octavia.controller.worker.tasks.database_tasks [req-71d41c6f-b908-4891-9793-2743a7049cfe - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 3ca36c3b-bf38-4096-92ad-27b77dce877e with compute id 9c3dd4ed-978b-4bc1-96be-c7792b0a9725 for load balancer: 8b599f20-ba68-423c-a781-cf52d1783f31 >2018-07-10 12:43:09.778 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-71d41c6f-b908-4891-9793-2743a7049cfe - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 109c3bc1-8c12-40dc-b894-7c143199ae1f already exists. Nothing to be done. >2018-07-10 12:43:27.216 23 INFO octavia.controller.worker.tasks.database_tasks [req-71d41c6f-b908-4891-9793-2743a7049cfe - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 8b599f20-ba68-423c-a781-cf52d1783f31 >2018-07-10 12:43:36.369 23 INFO octavia.controller.queue.endpoint [req-578d4305-ef15-415d-b7bf-2992d38de1f0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '9357d1e8-6bee-48c1-adb0-02f748681362'... >2018-07-10 12:43:41.520 23 INFO octavia.controller.queue.endpoint [req-745cf7a7-9057-42a1-86a7-eb0ce39d2ee5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '9e01849f-1002-489d-9d64-9e2881234c83'... >2018-07-10 12:43:46.860 23 INFO octavia.controller.queue.endpoint [req-9aab7bec-1408-42e2-badf-aa6c08aec340 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '65d03b5c-dedf-40f1-a3a9-03f998bd13e6'... >2018-07-10 12:43:57.273 23 INFO octavia.controller.queue.endpoint [req-7cb5bdb5-5bfd-4cd5-b78e-5e41757be3ed - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '8b599f20-ba68-423c-a781-cf52d1783f31'... >2018-07-10 12:43:59.835 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-7cb5bdb5-5bfd-4cd5-b78e-5e41757be3ed - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group f7571319-76a0-479e-8dcc-94b8f08a10b0 from port 109c3bc1-8c12-40dc-b894-7c143199ae1f >2018-07-10 12:44:00.544 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-7cb5bdb5-5bfd-4cd5-b78e-5e41757be3ed - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group f7571319-76a0-479e-8dcc-94b8f08a10b0 >2018-07-10 12:55:15.852 23 INFO octavia.controller.queue.endpoint [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'affca814-df91-4bf9-a2bb-9efbaed36fa3'... >2018-07-10 12:55:15.999 23 INFO octavia.controller.worker.tasks.database_tasks [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id ce80cce1-4f70-4a1e-8328-f153d86f979e >2018-07-10 12:55:16.158 23 INFO octavia.certificates.generator.local [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-10 12:55:16.158 23 INFO octavia.certificates.generator.local [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-10 12:55:16.159 23 INFO octavia.certificates.generator.local [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-10 12:55:16.159 23 INFO octavia.certificates.generator.local [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-10 12:55:30.921 23 INFO octavia.controller.worker.tasks.database_tasks [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: ce80cce1-4f70-4a1e-8328-f153d86f979e with compute id 54a0f63f-f2ca-47bf-abbb-aba4cdbaac1d for load balancer: affca814-df91-4bf9-a2bb-9efbaed36fa3 >2018-07-10 12:55:31.735 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 8f4d39ee-0b43-4b86-a9ca-0a7b0e18abf0 already exists. Nothing to be done. >2018-07-10 12:55:50.017 23 INFO octavia.controller.worker.tasks.database_tasks [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: affca814-df91-4bf9-a2bb-9efbaed36fa3 >2018-07-10 12:55:56.298 23 INFO octavia.controller.queue.endpoint [req-71d41c6f-b908-4891-9793-2743a7049cfe - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'eb28d3d3-7a04-4fbf-a189-0eb0a9adf521'... >2018-07-10 12:56:01.140 23 INFO octavia.controller.queue.endpoint [-] Creating pool '6d926af0-9baa-4a0b-bb70-19978db366af'... >2018-07-10 12:56:06.631 23 INFO octavia.controller.queue.endpoint [req-7cbc29b6-77be-4604-b65f-23e1595ff886 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a4d21c47-3111-41e9-8fa5-f9eafb5c3fc8'... >2018-07-10 12:56:11.762 23 INFO octavia.controller.queue.endpoint [req-47487332-58de-47a8-b8f7-1d2aab4a6f11 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd3f4b32b-33b9-4f33-a911-17e122f3d050'... >2018-07-10 12:56:20.683 23 INFO octavia.controller.queue.endpoint [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'affca814-df91-4bf9-a2bb-9efbaed36fa3'... >2018-07-10 12:56:22.962 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group be3181d2-8df3-4be6-be86-f625ffcb7a26 from port 8f4d39ee-0b43-4b86-a9ca-0a7b0e18abf0 >2018-07-10 12:56:23.843 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group be3181d2-8df3-4be6-be86-f625ffcb7a26 >2018-07-10 13:10:30.993 23 INFO octavia.controller.queue.endpoint [req-b1ae5616-266b-4fc5-9036-9a51b2d105b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '1e238de7-5fce-44f2-900d-5dda8b0d52ca'... >2018-07-10 13:10:31.114 23 INFO octavia.controller.worker.tasks.database_tasks [req-b1ae5616-266b-4fc5-9036-9a51b2d105b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 60473edd-d778-445a-be8d-86a5d91498c4 >2018-07-10 13:10:31.487 23 INFO octavia.certificates.generator.local [req-b1ae5616-266b-4fc5-9036-9a51b2d105b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-10 13:10:31.487 23 INFO octavia.certificates.generator.local [req-b1ae5616-266b-4fc5-9036-9a51b2d105b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-10 13:10:31.488 23 INFO octavia.certificates.generator.local [req-b1ae5616-266b-4fc5-9036-9a51b2d105b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-10 13:10:31.488 23 INFO octavia.certificates.generator.local [req-b1ae5616-266b-4fc5-9036-9a51b2d105b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-10 13:10:45.531 23 INFO octavia.controller.worker.tasks.database_tasks [req-b1ae5616-266b-4fc5-9036-9a51b2d105b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 60473edd-d778-445a-be8d-86a5d91498c4 with compute id 96e4ff78-b7bf-4535-acf0-7c18b166eefc for load balancer: 1e238de7-5fce-44f2-900d-5dda8b0d52ca >2018-07-10 13:10:45.834 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b1ae5616-266b-4fc5-9036-9a51b2d105b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 66dd76a2-f67c-40f0-9874-335486a342ca already exists. Nothing to be done. >2018-07-10 13:11:03.303 23 INFO octavia.controller.worker.tasks.database_tasks [req-b1ae5616-266b-4fc5-9036-9a51b2d105b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 1e238de7-5fce-44f2-900d-5dda8b0d52ca >2018-07-10 13:11:13.525 23 INFO octavia.controller.queue.endpoint [-] Creating listener '5be9dd72-243e-406a-8fcd-c3d480d6a972'... >2018-07-10 13:11:18.574 23 INFO octavia.controller.queue.endpoint [req-3912c3ff-f9c4-42ea-9f64-89e92d20a303 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '075feb82-d47b-465e-90b0-9ab36e09897f'... >2018-07-10 13:14:02.218 23 INFO octavia.controller.queue.endpoint [req-cfc8eea2-e7ea-4864-bf93-4565ecc709e1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'e1d611e6-ce1b-459c-a6a7-d88c0d34eb91'... >2018-07-10 13:14:02.337 23 INFO octavia.controller.worker.tasks.database_tasks [req-cfc8eea2-e7ea-4864-bf93-4565ecc709e1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 98e1e2e7-fc30-4d2f-87c6-e287fdeab74e >2018-07-10 13:14:02.501 23 INFO octavia.certificates.generator.local [req-cfc8eea2-e7ea-4864-bf93-4565ecc709e1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-10 13:14:02.501 23 INFO octavia.certificates.generator.local [req-cfc8eea2-e7ea-4864-bf93-4565ecc709e1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-10 13:14:02.502 23 INFO octavia.certificates.generator.local [req-cfc8eea2-e7ea-4864-bf93-4565ecc709e1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-10 13:14:02.502 23 INFO octavia.certificates.generator.local [req-cfc8eea2-e7ea-4864-bf93-4565ecc709e1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-10 13:14:15.187 23 INFO octavia.controller.worker.tasks.database_tasks [req-cfc8eea2-e7ea-4864-bf93-4565ecc709e1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 98e1e2e7-fc30-4d2f-87c6-e287fdeab74e with compute id 22f2e735-eb98-41ad-926e-01673f3085c3 for load balancer: e1d611e6-ce1b-459c-a6a7-d88c0d34eb91 >2018-07-10 13:14:15.488 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-cfc8eea2-e7ea-4864-bf93-4565ecc709e1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 9b690422-02de-4ddc-8287-49c2cbc52389 already exists. Nothing to be done. >2018-07-10 13:14:21.920 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-cfc8eea2-e7ea-4864-bf93-4565ecc709e1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.19', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.13.70 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47080bde50>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-10 13:14:31.498 23 INFO octavia.controller.worker.tasks.database_tasks [req-cfc8eea2-e7ea-4864-bf93-4565ecc709e1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: e1d611e6-ce1b-459c-a6a7-d88c0d34eb91 >2018-07-10 13:14:39.929 23 INFO octavia.controller.queue.endpoint [req-60af57ed-93ef-4130-b086-b6d1a6243ee1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'ef087ba0-fdb2-47f6-b4af-04fbe81a1761'... >2018-07-10 13:14:44.958 23 INFO octavia.controller.queue.endpoint [req-2fdd909a-ff11-454e-a671-26fff43ed6e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'c92cde8e-7eb6-4250-b248-267bd02f9280'... >2018-07-10 13:14:49.710 23 INFO octavia.controller.queue.endpoint [req-75b794d7-3181-4717-94bf-bd0e62d63c5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f1986693-ef4c-4edb-b28e-f51c7190a86e'... >2018-07-10 13:14:54.311 23 INFO octavia.controller.queue.endpoint [req-b1ae5616-266b-4fc5-9036-9a51b2d105b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5cf47340-6545-4eaf-9b6a-3eaf3eeddfd9'... >2018-07-10 15:08:42.631 23 INFO octavia.controller.queue.endpoint [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '1d887734-e44c-4e22-8050-6d1996228972'... >2018-07-10 15:08:42.750 23 INFO octavia.controller.worker.tasks.database_tasks [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id ed85ddc9-077a-41c4-95bb-f9695236bbfa >2018-07-10 15:08:42.805 23 INFO octavia.certificates.generator.local [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-10 15:08:42.805 23 INFO octavia.certificates.generator.local [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-10 15:08:42.806 23 INFO octavia.certificates.generator.local [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-10 15:08:42.806 23 INFO octavia.certificates.generator.local [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-10 15:08:43.753 23 INFO octavia.controller.queue.endpoint [req-52f23cf0-1018-4c9f-956e-b2d48ef8434a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '2d817013-a78c-402d-876e-7b94b95b1202'... >2018-07-10 15:08:43.864 23 INFO octavia.controller.worker.tasks.database_tasks [req-52f23cf0-1018-4c9f-956e-b2d48ef8434a - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 9cd9de3f-e3fc-41cc-9ee3-f2defa5cca56 >2018-07-10 15:08:44.017 23 INFO octavia.certificates.generator.local [req-52f23cf0-1018-4c9f-956e-b2d48ef8434a - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-10 15:08:44.018 23 INFO octavia.certificates.generator.local [req-52f23cf0-1018-4c9f-956e-b2d48ef8434a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-10 15:08:44.018 23 INFO octavia.certificates.generator.local [req-52f23cf0-1018-4c9f-956e-b2d48ef8434a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-10 15:08:44.019 23 INFO octavia.certificates.generator.local [req-52f23cf0-1018-4c9f-956e-b2d48ef8434a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-10 15:08:44.698 23 INFO octavia.controller.queue.endpoint [req-b99bae6f-cb68-459e-96e1-89246aa2451e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '6114bd1b-ba1b-432e-ab94-e70a23ca9377'... >2018-07-10 15:08:44.828 23 INFO octavia.controller.worker.tasks.database_tasks [req-b99bae6f-cb68-459e-96e1-89246aa2451e - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 8c25805a-a506-4a37-a796-a71b1666d614 >2018-07-10 15:08:44.921 23 INFO octavia.certificates.generator.local [req-b99bae6f-cb68-459e-96e1-89246aa2451e - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-10 15:08:44.921 23 INFO octavia.certificates.generator.local [req-b99bae6f-cb68-459e-96e1-89246aa2451e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-10 15:08:44.922 23 INFO octavia.certificates.generator.local [req-b99bae6f-cb68-459e-96e1-89246aa2451e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-10 15:08:44.922 23 INFO octavia.certificates.generator.local [req-b99bae6f-cb68-459e-96e1-89246aa2451e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-10 15:08:57.154 23 INFO octavia.controller.worker.tasks.database_tasks [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: ed85ddc9-077a-41c4-95bb-f9695236bbfa with compute id 8016e537-4790-4d06-919d-5539fc5fd400 for load balancer: 1d887734-e44c-4e22-8050-6d1996228972 >2018-07-10 15:08:57.662 23 INFO octavia.controller.worker.tasks.database_tasks [req-52f23cf0-1018-4c9f-956e-b2d48ef8434a - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 9cd9de3f-e3fc-41cc-9ee3-f2defa5cca56 with compute id 0bf29289-c9af-4f2e-9b42-f2bb627faf87 for load balancer: 2d817013-a78c-402d-876e-7b94b95b1202 >2018-07-10 15:08:57.989 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-52f23cf0-1018-4c9f-956e-b2d48ef8434a - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 40115c56-d940-4407-bcd0-2abe6dd85e9f already exists. Nothing to be done. >2018-07-10 15:08:58.000 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port ab82605c-b562-47b0-b161-39acf99a0e6a already exists. Nothing to be done. >2018-07-10 15:09:06.741 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.17', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.223.105 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700494690>: Failed to establish a new connection: [Errno 113] No route to host',)) >2018-07-10 15:09:07.656 23 INFO octavia.controller.worker.tasks.database_tasks [req-b99bae6f-cb68-459e-96e1-89246aa2451e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 8c25805a-a506-4a37-a796-a71b1666d614 with compute id a59050be-87ba-4add-a5c2-21c72537f725 for load balancer: 6114bd1b-ba1b-432e-ab94-e70a23ca9377 >2018-07-10 15:09:07.745 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b99bae6f-cb68-459e-96e1-89246aa2451e - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 353a790f-a191-47aa-aa3c-c038a328e4ec already exists. Nothing to be done. >2018-07-10 15:09:12.750 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.17', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.223.105 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470059fcd0>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-10 15:09:13.802 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-52f23cf0-1018-4c9f-956e-b2d48ef8434a - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.4', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.101.153 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47003c7c10>, 'Connection to 172.24.0.4 timed out. (connect timeout=10.0)')) >2018-07-10 15:09:22.375 23 INFO octavia.controller.worker.tasks.database_tasks [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 1d887734-e44c-4e22-8050-6d1996228972 >2018-07-10 15:09:23.386 23 INFO octavia.controller.worker.tasks.database_tasks [req-52f23cf0-1018-4c9f-956e-b2d48ef8434a - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 2d817013-a78c-402d-876e-7b94b95b1202 >2018-07-10 15:09:24.883 23 INFO octavia.controller.worker.tasks.database_tasks [req-b99bae6f-cb68-459e-96e1-89246aa2451e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 6114bd1b-ba1b-432e-ab94-e70a23ca9377 >2018-07-10 15:09:25.053 23 INFO octavia.controller.queue.endpoint [req-d8d8f43d-7c8b-4090-94b7-99de164c855f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'bfc4ae01-1cc3-4f13-89b0-9fc8c94af6fb'... >2018-07-10 15:09:26.554 23 INFO octavia.controller.queue.endpoint [req-7cb5bdb5-5bfd-4cd5-b78e-5e41757be3ed - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '3c39e665-beaf-49c8-b559-636619cfe18d'... >2018-07-10 15:09:29.963 23 INFO octavia.controller.queue.endpoint [req-e0b0c5a4-50c8-4f7f-9d1f-3d6365ff496f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '984f2ce3-8294-4800-900f-1f11a450d458'... >2018-07-10 15:09:31.563 23 INFO octavia.controller.queue.endpoint [req-cb17bfa6-34d0-4006-9b3a-6b07d84917db - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'e0036865-8b08-4d6e-8cf8-b543c8c6d149'... >2018-07-10 15:09:35.772 23 INFO octavia.controller.queue.endpoint [req-203beb37-8534-4ee9-b0e5-7c76d988803b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0c499c28-987b-4b44-acbb-e205733f61d3'... >2018-07-10 15:09:36.714 23 INFO octavia.controller.queue.endpoint [req-2c603fbb-8f63-4b4f-84a2-5d4a30002a42 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e47a7c0a-a14a-46dd-8e8a-34f26ce803f9'... >2018-07-10 15:09:39.388 23 INFO octavia.controller.queue.endpoint [req-6020280d-3e9b-4df1-808d-346cef7db998 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '7d67e65c-b394-4f48-9cd6-e2699e42b5f1'... >2018-07-10 15:09:44.306 23 INFO octavia.controller.queue.endpoint [req-d7f4d634-bf30-431a-bc00-6cf8b7074182 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '1b2004b5-936b-427c-9f6f-f725983e98d6'... >2018-07-10 15:09:49.862 23 INFO octavia.controller.queue.endpoint [req-b99bae6f-cb68-459e-96e1-89246aa2451e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '17b1a047-7fd6-46fb-b53b-9f8b771bb260'... >2018-07-11 01:12:08.849 23 INFO octavia.controller.queue.endpoint [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'e1d611e6-ce1b-459c-a6a7-d88c0d34eb91'... >2018-07-11 01:12:12.710 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group c961e90c-09c2-4dfc-9834-a7453e9e3a97 from port 9b690422-02de-4ddc-8287-49c2cbc52389 >2018-07-11 01:12:13.465 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group c961e90c-09c2-4dfc-9834-a7453e9e3a97 >2018-07-11 01:18:21.947 23 INFO octavia.controller.queue.endpoint [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '185e9164-029f-498c-99f6-44e45a5411a1'... >2018-07-11 01:18:22.056 23 INFO octavia.controller.worker.tasks.database_tasks [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 0853101d-abe4-4d0e-8777-36f5d2b07764 >2018-07-11 01:18:22.129 23 INFO octavia.certificates.generator.local [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 01:18:22.130 23 INFO octavia.certificates.generator.local [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 01:18:22.130 23 INFO octavia.certificates.generator.local [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 01:18:22.130 23 INFO octavia.certificates.generator.local [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 01:18:36.712 23 INFO octavia.controller.worker.tasks.database_tasks [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 0853101d-abe4-4d0e-8777-36f5d2b07764 with compute id 666dcb9c-eeae-4a21-ae41-9f0c3b69417d for load balancer: 185e9164-029f-498c-99f6-44e45a5411a1 >2018-07-11 01:18:37.019 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port dcd88999-3542-4f6e-9f7c-a2a5dac2f976 already exists. Nothing to be done. >2018-07-11 01:18:52.534 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.16', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.247.74 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47005262d0>, 'Connection to 172.24.0.16 timed out. (connect timeout=10.0)')) >2018-07-11 01:19:02.097 23 INFO octavia.controller.worker.tasks.database_tasks [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 185e9164-029f-498c-99f6-44e45a5411a1 >2018-07-11 01:19:03.261 23 INFO octavia.controller.queue.endpoint [req-f2972850-e870-4164-9fb2-998bf6c79223 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'c6df34ec-ad8f-46e2-8aaf-2bfb9c9ffe01'... >2018-07-11 01:19:08.286 23 INFO octavia.controller.queue.endpoint [req-47f94141-3629-4112-add8-c17ea0e0c7ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'aa5ff929-3bba-487c-bc09-2b80684ee575'... >2018-07-11 01:19:13.614 23 INFO octavia.controller.queue.endpoint [req-2124dd96-6a17-4a7c-b3e2-ab5fe4f2111d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e6d89ad7-100e-4beb-a176-85b4e370aaa9'... >2018-07-11 01:19:23.565 23 INFO octavia.controller.queue.endpoint [req-03a77e6e-737b-48df-9e99-bd9c77715355 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '185e9164-029f-498c-99f6-44e45a5411a1'... >2018-07-11 01:19:25.970 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-03a77e6e-737b-48df-9e99-bd9c77715355 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 9d384426-ff6e-4e78-b673-75510b0c15a7 from port dcd88999-3542-4f6e-9f7c-a2a5dac2f976 >2018-07-11 01:19:26.664 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-03a77e6e-737b-48df-9e99-bd9c77715355 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 9d384426-ff6e-4e78-b673-75510b0c15a7 >2018-07-11 02:41:09.520 23 INFO octavia.controller.queue.endpoint [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'fd08c65e-d1e3-4cc3-98da-a2756cd3de02'... >2018-07-11 02:41:09.642 23 INFO octavia.controller.worker.tasks.database_tasks [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 97a767e5-9609-4b79-829e-f1373e8e27ae >2018-07-11 02:41:09.724 23 INFO octavia.certificates.generator.local [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 02:41:09.724 23 INFO octavia.certificates.generator.local [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 02:41:09.725 23 INFO octavia.certificates.generator.local [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 02:41:09.725 23 INFO octavia.certificates.generator.local [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 02:41:24.775 23 INFO octavia.controller.worker.tasks.database_tasks [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 97a767e5-9609-4b79-829e-f1373e8e27ae with compute id 2a60e6cf-c4c7-4c96-a259-31e93c307f84 for load balancer: fd08c65e-d1e3-4cc3-98da-a2756cd3de02 >2018-07-11 02:41:25.608 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 8b417d51-ccba-4870-9f52-c4566e0242a6 already exists. Nothing to be done. >2018-07-11 02:41:43.168 23 INFO octavia.controller.worker.tasks.database_tasks [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: fd08c65e-d1e3-4cc3-98da-a2756cd3de02 >2018-07-11 02:41:47.409 23 INFO octavia.controller.queue.endpoint [req-f98175c8-a40e-4d13-a5f1-ee8c6e443aa8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '18f82eef-3b9a-4357-99e7-bdd3aeff7b95'... >2018-07-11 02:41:52.365 23 INFO octavia.controller.queue.endpoint [req-235ee0b0-a0dc-49bb-8d15-ea7088ffee92 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '3c7eeddb-fbf2-4a96-9e25-75b9597e3474'... >2018-07-11 02:41:57.710 23 INFO octavia.controller.queue.endpoint [req-644016fb-5697-4496-a459-2bc24c42586a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '200a3169-02d0-4f10-9342-63ff7ebd1b83'... >2018-07-11 02:42:02.555 23 INFO octavia.controller.queue.endpoint [req-c00c746e-cb8f-40c8-b575-12bd8a0e4666 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e8f741e5-2b80-4ce3-aca1-e7172c706c88'... >2018-07-11 02:42:50.537 23 INFO octavia.controller.queue.endpoint [req-55adc879-9929-4b3d-8548-8bdf343af8ed - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'fd08c65e-d1e3-4cc3-98da-a2756cd3de02'... >2018-07-11 02:42:53.571 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-55adc879-9929-4b3d-8548-8bdf343af8ed - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group ac9feda8-3138-40bd-b23c-d606e82ac6b9 from port 8b417d51-ccba-4870-9f52-c4566e0242a6 >2018-07-11 02:42:54.445 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-55adc879-9929-4b3d-8548-8bdf343af8ed - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group ac9feda8-3138-40bd-b23c-d606e82ac6b9 >2018-07-11 03:24:31.791 23 INFO octavia.controller.queue.endpoint [req-ceb22f21-9d3e-4c90-9a32-cd085942f824 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '60ac5ed5-ab06-4075-84b3-600e4a05dbae'... >2018-07-11 03:24:31.921 23 INFO octavia.controller.worker.tasks.database_tasks [req-ceb22f21-9d3e-4c90-9a32-cd085942f824 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 8e0e9d8b-5ef1-4700-a3af-5304dbede78a >2018-07-11 03:24:32.171 23 INFO octavia.certificates.generator.local [req-ceb22f21-9d3e-4c90-9a32-cd085942f824 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 03:24:32.171 23 INFO octavia.certificates.generator.local [req-ceb22f21-9d3e-4c90-9a32-cd085942f824 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 03:24:32.171 23 INFO octavia.certificates.generator.local [req-ceb22f21-9d3e-4c90-9a32-cd085942f824 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 03:24:32.172 23 INFO octavia.certificates.generator.local [req-ceb22f21-9d3e-4c90-9a32-cd085942f824 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 03:24:46.044 23 INFO octavia.controller.worker.tasks.database_tasks [req-ceb22f21-9d3e-4c90-9a32-cd085942f824 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 8e0e9d8b-5ef1-4700-a3af-5304dbede78a with compute id 00b9f747-e217-4292-a6a0-40e774d191a2 for load balancer: 60ac5ed5-ab06-4075-84b3-600e4a05dbae >2018-07-11 03:24:46.342 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ceb22f21-9d3e-4c90-9a32-cd085942f824 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 0f627e7c-ce69-415c-86e0-b1e55bc0e29d already exists. Nothing to be done. >2018-07-11 03:24:52.864 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-ceb22f21-9d3e-4c90-9a32-cd085942f824 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.22', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.233.127 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470066d650>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-11 03:25:02.432 23 INFO octavia.controller.worker.tasks.database_tasks [req-ceb22f21-9d3e-4c90-9a32-cd085942f824 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 60ac5ed5-ab06-4075-84b3-600e4a05dbae >2018-07-11 03:25:09.767 23 INFO octavia.controller.queue.endpoint [req-6448f401-2f45-43ce-b449-35cd4d85f177 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating listener 'a0dd0a76-0bc6-4538-a23d-3957cd49fda3'... >2018-07-11 03:25:14.909 23 INFO octavia.controller.queue.endpoint [req-ceb22f21-9d3e-4c90-9a32-cd085942f824 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '4fd7449d-49ee-49b5-b25b-2e991df6b9dc'... >2018-07-11 03:25:20.012 23 INFO octavia.controller.queue.endpoint [req-7e9bde5e-e6b8-4ce2-a7f2-444a30925d35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2942a1d2-e117-45d2-ba29-bc6b428ac802'... >2018-07-11 03:25:30.312 23 INFO octavia.controller.queue.endpoint [req-501682ce-acc8-4ee0-9689-dd82e5942ad7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '60ac5ed5-ab06-4075-84b3-600e4a05dbae'... >2018-07-11 03:25:33.043 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-501682ce-acc8-4ee0-9689-dd82e5942ad7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 0f144e24-84b1-4ca4-b78a-e3584b09a327 from port 0f627e7c-ce69-415c-86e0-b1e55bc0e29d >2018-07-11 03:25:33.752 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-501682ce-acc8-4ee0-9689-dd82e5942ad7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 0f144e24-84b1-4ca4-b78a-e3584b09a327 >2018-07-11 03:35:59.416 23 INFO octavia.controller.queue.endpoint [req-1c85a072-6437-4962-a04a-03160e773490 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '73d65fe4-7ee3-4e25-94c2-07661ec8b3ca'... >2018-07-11 03:35:59.657 23 INFO octavia.controller.worker.tasks.database_tasks [req-1c85a072-6437-4962-a04a-03160e773490 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id e838413d-4e6e-4be0-ac76-72169bc25c25 >2018-07-11 03:36:00.019 23 INFO octavia.certificates.generator.local [req-1c85a072-6437-4962-a04a-03160e773490 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 03:36:00.019 23 INFO octavia.certificates.generator.local [req-1c85a072-6437-4962-a04a-03160e773490 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 03:36:00.020 23 INFO octavia.certificates.generator.local [req-1c85a072-6437-4962-a04a-03160e773490 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 03:36:00.020 23 INFO octavia.certificates.generator.local [req-1c85a072-6437-4962-a04a-03160e773490 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 03:36:13.925 23 INFO octavia.controller.worker.tasks.database_tasks [req-1c85a072-6437-4962-a04a-03160e773490 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: e838413d-4e6e-4be0-ac76-72169bc25c25 with compute id df7d213f-058c-4ff4-88a4-d995c8984746 for load balancer: 73d65fe4-7ee3-4e25-94c2-07661ec8b3ca >2018-07-11 03:36:14.223 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-1c85a072-6437-4962-a04a-03160e773490 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 02beb1aa-ef2c-435c-b4ff-7fffd7e7c651 already exists. Nothing to be done. >2018-07-11 03:36:31.115 23 INFO octavia.controller.worker.tasks.database_tasks [req-1c85a072-6437-4962-a04a-03160e773490 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 73d65fe4-7ee3-4e25-94c2-07661ec8b3ca >2018-07-11 03:36:39.174 23 INFO octavia.controller.queue.endpoint [req-55adc879-9929-4b3d-8548-8bdf343af8ed - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'f5d1292c-b819-4462-b96b-e8e6b183c982'... >2018-07-11 03:36:44.325 23 INFO octavia.controller.queue.endpoint [req-89968960-9a88-4fd1-a329-1de662020525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '6ff473f4-a68c-4518-905a-e28f62ffd6d7'... >2018-07-11 03:36:49.340 23 INFO octavia.controller.queue.endpoint [req-a96f1dc7-8abe-48ba-9588-0b79147ace1f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a5d87df2-d692-462b-a9f4-c1902bf6274b'... >2018-07-11 03:39:17.851 23 INFO octavia.controller.queue.endpoint [req-0fc56760-9807-4ff6-b245-111ccce4943b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'd839bfd4-f87e-49b2-a926-6be954ab606a'... >2018-07-11 03:39:17.990 23 INFO octavia.controller.worker.tasks.database_tasks [req-0fc56760-9807-4ff6-b245-111ccce4943b - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 7c8633f1-0703-4a46-8a9d-1cb87525a4a4 >2018-07-11 03:39:18.038 23 INFO octavia.certificates.generator.local [req-0fc56760-9807-4ff6-b245-111ccce4943b - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 03:39:18.038 23 INFO octavia.certificates.generator.local [req-0fc56760-9807-4ff6-b245-111ccce4943b - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 03:39:18.039 23 INFO octavia.certificates.generator.local [req-0fc56760-9807-4ff6-b245-111ccce4943b - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 03:39:18.039 23 INFO octavia.certificates.generator.local [req-0fc56760-9807-4ff6-b245-111ccce4943b - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 03:39:32.846 23 INFO octavia.controller.worker.tasks.database_tasks [req-0fc56760-9807-4ff6-b245-111ccce4943b - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 7c8633f1-0703-4a46-8a9d-1cb87525a4a4 with compute id 668b3851-83ba-4ed7-ad52-2be5fc06b149 for load balancer: d839bfd4-f87e-49b2-a926-6be954ab606a >2018-07-11 03:39:33.697 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-0fc56760-9807-4ff6-b245-111ccce4943b - 293061856e1a4cffbae3ed099cf4f619 - - -] Port f6e8669b-165d-4314-b21b-6bbb966608f1 already exists. Nothing to be done. >2018-07-11 03:39:40.575 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-0fc56760-9807-4ff6-b245-111ccce4943b - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.23', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.157.47 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700586110>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-11 03:39:50.383 23 INFO octavia.controller.worker.tasks.database_tasks [req-0fc56760-9807-4ff6-b245-111ccce4943b - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: d839bfd4-f87e-49b2-a926-6be954ab606a >2018-07-11 03:39:58.393 23 INFO octavia.controller.queue.endpoint [req-0fc56760-9807-4ff6-b245-111ccce4943b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'afb53d9b-aed7-4320-ad51-7ecbf69ea583'... >2018-07-11 03:40:03.257 23 INFO octavia.controller.queue.endpoint [req-6854f9ca-7a72-48b8-95ab-206681bbc8eb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '5ad310bf-3dc9-4e97-b3b4-7f82344a7e81'... >2018-07-11 04:45:55.158 23 INFO octavia.controller.queue.endpoint [req-99f4a84a-7b1b-4de5-9b0f-d129071cb31e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'cb089d74-7924-4791-a5c6-42321c7e9ffe'... >2018-07-11 04:45:55.282 23 INFO octavia.controller.worker.tasks.database_tasks [req-99f4a84a-7b1b-4de5-9b0f-d129071cb31e - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 4490cc70-6bf5-4ef0-a42f-2ba8f6915976 >2018-07-11 04:45:55.349 23 INFO octavia.certificates.generator.local [req-99f4a84a-7b1b-4de5-9b0f-d129071cb31e - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 04:45:55.349 23 INFO octavia.certificates.generator.local [req-99f4a84a-7b1b-4de5-9b0f-d129071cb31e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 04:45:55.349 23 INFO octavia.certificates.generator.local [req-99f4a84a-7b1b-4de5-9b0f-d129071cb31e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 04:45:55.350 23 INFO octavia.certificates.generator.local [req-99f4a84a-7b1b-4de5-9b0f-d129071cb31e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 04:46:10.192 23 INFO octavia.controller.worker.tasks.database_tasks [req-99f4a84a-7b1b-4de5-9b0f-d129071cb31e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 4490cc70-6bf5-4ef0-a42f-2ba8f6915976 with compute id cecdbe58-8230-4bec-91fc-2ee1db50855e for load balancer: cb089d74-7924-4791-a5c6-42321c7e9ffe >2018-07-11 04:46:11.000 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-99f4a84a-7b1b-4de5-9b0f-d129071cb31e - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 1146b5b0-96aa-4f85-acdf-176bc9810f66 already exists. Nothing to be done. >2018-07-11 04:46:28.835 23 INFO octavia.controller.worker.tasks.database_tasks [req-99f4a84a-7b1b-4de5-9b0f-d129071cb31e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: cb089d74-7924-4791-a5c6-42321c7e9ffe >2018-07-11 04:46:36.580 23 INFO octavia.controller.queue.endpoint [req-1c85a072-6437-4962-a04a-03160e773490 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'f36e9cc1-abe5-49d4-8fd6-1f8ba80cdbe0'... >2018-07-11 04:46:41.974 23 INFO octavia.controller.queue.endpoint [req-e5645859-4f1f-4413-bf18-2294f7c810e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '6814f6a0-887e-4683-8540-ca93f7891043'... >2018-07-11 04:48:26.339 23 INFO octavia.controller.queue.endpoint [req-d1cad98a-d019-43df-861a-b345fdc3bd67 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '078973c6-f076-4e00-902f-4c6c788b2219'... >2018-07-11 04:48:26.463 23 INFO octavia.controller.worker.tasks.database_tasks [req-d1cad98a-d019-43df-861a-b345fdc3bd67 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 13103c82-939e-492b-acb4-8a19668351e1 >2018-07-11 04:48:26.490 23 INFO octavia.certificates.generator.local [req-d1cad98a-d019-43df-861a-b345fdc3bd67 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 04:48:26.491 23 INFO octavia.certificates.generator.local [req-d1cad98a-d019-43df-861a-b345fdc3bd67 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 04:48:26.491 23 INFO octavia.certificates.generator.local [req-d1cad98a-d019-43df-861a-b345fdc3bd67 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 04:48:26.492 23 INFO octavia.certificates.generator.local [req-d1cad98a-d019-43df-861a-b345fdc3bd67 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 04:48:39.480 23 INFO octavia.controller.worker.tasks.database_tasks [req-d1cad98a-d019-43df-861a-b345fdc3bd67 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 13103c82-939e-492b-acb4-8a19668351e1 with compute id 905e370d-6319-47a7-acd3-3bb1942c9a97 for load balancer: 078973c6-f076-4e00-902f-4c6c788b2219 >2018-07-11 04:48:39.574 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-d1cad98a-d019-43df-861a-b345fdc3bd67 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 0af2da80-4da5-49a8-9131-674bc514b9be already exists. Nothing to be done. >2018-07-11 04:48:57.282 23 INFO octavia.controller.worker.tasks.database_tasks [req-d1cad98a-d019-43df-861a-b345fdc3bd67 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 078973c6-f076-4e00-902f-4c6c788b2219 >2018-07-11 04:49:04.481 23 INFO octavia.controller.queue.endpoint [req-f9af373f-4b16-471c-9a68-1cba2dba5b91 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'b56e450c-fbc8-46c5-8c8a-d7f4077141e8'... >2018-07-11 04:49:09.693 23 INFO octavia.controller.queue.endpoint [req-fa4b871d-19d0-46b4-98dc-860302f9b2d0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'c8dbd86e-5a32-46da-ad44-3b7c016d186c'... >2018-07-11 04:49:15.063 23 INFO octavia.controller.queue.endpoint [req-074e5a61-3d3f-46ba-93e9-ddf3c5cef393 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0d748740-6ab9-41de-b177-65ed4e64bcfd'... >2018-07-11 04:49:19.869 23 INFO octavia.controller.queue.endpoint [req-99f4a84a-7b1b-4de5-9b0f-d129071cb31e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f9db50e7-9512-4044-a215-bb51c5d7bdf9'... >2018-07-11 04:50:16.064 23 INFO octavia.controller.queue.endpoint [req-501682ce-acc8-4ee0-9689-dd82e5942ad7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '078973c6-f076-4e00-902f-4c6c788b2219'... >2018-07-11 04:50:18.608 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-501682ce-acc8-4ee0-9689-dd82e5942ad7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 17661293-dd6e-45c2-b0ae-e6223c22ab3e from port 0af2da80-4da5-49a8-9131-674bc514b9be >2018-07-11 04:50:19.441 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-501682ce-acc8-4ee0-9689-dd82e5942ad7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 17661293-dd6e-45c2-b0ae-e6223c22ab3e >2018-07-11 05:47:23.914 23 INFO octavia.controller.queue.endpoint [req-87676208-5595-4281-8436-380c7f455fa4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'a6be7128-353e-40dc-a12f-464658460b12'... >2018-07-11 05:47:24.065 23 INFO octavia.controller.worker.tasks.database_tasks [req-87676208-5595-4281-8436-380c7f455fa4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 3bd5ab9d-497b-4cd1-8003-5056c352ea5a >2018-07-11 05:47:24.121 23 INFO octavia.certificates.generator.local [req-87676208-5595-4281-8436-380c7f455fa4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 05:47:24.121 23 INFO octavia.certificates.generator.local [req-87676208-5595-4281-8436-380c7f455fa4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 05:47:24.121 23 INFO octavia.certificates.generator.local [req-87676208-5595-4281-8436-380c7f455fa4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 05:47:24.122 23 INFO octavia.certificates.generator.local [req-87676208-5595-4281-8436-380c7f455fa4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 05:47:37.935 23 INFO octavia.controller.worker.tasks.database_tasks [req-87676208-5595-4281-8436-380c7f455fa4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 3bd5ab9d-497b-4cd1-8003-5056c352ea5a with compute id fdd7fdbb-5644-4d2a-83c8-6e1fbdebb699 for load balancer: a6be7128-353e-40dc-a12f-464658460b12 >2018-07-11 05:47:38.756 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-87676208-5595-4281-8436-380c7f455fa4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 2f25912d-46c5-4224-920b-323be639605d already exists. Nothing to be done. >2018-07-11 05:47:54.614 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-87676208-5595-4281-8436-380c7f455fa4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.19', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.35.62 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470054da10>, 'Connection to 172.24.0.19 timed out. (connect timeout=10.0)')) >2018-07-11 05:48:04.219 23 INFO octavia.controller.worker.tasks.database_tasks [req-87676208-5595-4281-8436-380c7f455fa4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: a6be7128-353e-40dc-a12f-464658460b12 >2018-07-11 05:48:18.439 23 INFO octavia.controller.queue.endpoint [req-c4b87f26-a914-4298-a995-691d5ea52032 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '4c4bca22-a5a2-4f99-92ff-baf4c2889a6f'... >2018-07-11 05:48:23.557 23 INFO octavia.controller.queue.endpoint [req-501682ce-acc8-4ee0-9689-dd82e5942ad7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'cc407479-92ab-4bb7-9e00-bfd52296eb68'... >2018-07-11 05:48:28.969 23 INFO octavia.controller.queue.endpoint [req-fda2d837-15ab-4eb8-a790-1fe23479c6f4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '18972cae-31e2-42a0-b36d-eb68f6359adb'... >2018-07-11 05:49:24.000 23 INFO octavia.controller.queue.endpoint [req-124ce01c-3b36-476f-bae1-d395df23d2d8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0e125e4d-3d80-4e73-9ee4-dcc66bf0df5a'... >2018-07-11 05:49:34.481 23 INFO octavia.controller.queue.endpoint [req-e4ba02aa-8688-4f6f-9b4e-bdad582d055a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '18972cae-31e2-42a0-b36d-eb68f6359adb'... >2018-07-11 05:50:23.327 23 INFO octavia.controller.queue.endpoint [req-dbbf0769-08d8-4a59-bc39-29bc64ea2b59 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'a6be7128-353e-40dc-a12f-464658460b12'... >2018-07-11 05:50:26.605 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-dbbf0769-08d8-4a59-bc39-29bc64ea2b59 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 34f24865-7fd7-402e-a4d1-b3a97c01752b from port 2f25912d-46c5-4224-920b-323be639605d >2018-07-11 05:50:27.646 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-dbbf0769-08d8-4a59-bc39-29bc64ea2b59 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 34f24865-7fd7-402e-a4d1-b3a97c01752b >2018-07-11 06:28:43.999 23 INFO octavia.controller.queue.endpoint [req-2aa9abe3-938e-4459-89d7-77a5aa08c293 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '7074d78b-0d2a-4cf5-b662-959897b2702a'... >2018-07-11 06:28:44.122 23 INFO octavia.controller.worker.tasks.database_tasks [req-2aa9abe3-938e-4459-89d7-77a5aa08c293 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 5e242779-7562-49da-8059-0a45ea324231 >2018-07-11 06:28:44.444 23 INFO octavia.certificates.generator.local [req-2aa9abe3-938e-4459-89d7-77a5aa08c293 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 06:28:44.444 23 INFO octavia.certificates.generator.local [req-2aa9abe3-938e-4459-89d7-77a5aa08c293 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 06:28:44.445 23 INFO octavia.certificates.generator.local [req-2aa9abe3-938e-4459-89d7-77a5aa08c293 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 06:28:44.445 23 INFO octavia.certificates.generator.local [req-2aa9abe3-938e-4459-89d7-77a5aa08c293 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 06:28:57.916 23 INFO octavia.controller.worker.tasks.database_tasks [req-2aa9abe3-938e-4459-89d7-77a5aa08c293 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 5e242779-7562-49da-8059-0a45ea324231 with compute id 704065e9-2861-498f-be3d-c97e112328f7 for load balancer: 7074d78b-0d2a-4cf5-b662-959897b2702a >2018-07-11 06:28:58.204 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-2aa9abe3-938e-4459-89d7-77a5aa08c293 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port b56134ea-cf99-48f4-b40e-83fad7663e7f already exists. Nothing to be done. >2018-07-11 06:29:16.172 23 INFO octavia.controller.worker.tasks.database_tasks [req-2aa9abe3-938e-4459-89d7-77a5aa08c293 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 7074d78b-0d2a-4cf5-b662-959897b2702a >2018-07-11 06:29:22.880 23 INFO octavia.controller.queue.endpoint [req-6196a0cd-e1d8-4b9b-b143-b2831bc6ac7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'b8480229-60d4-4a00-a507-5d50043e7df9'... >2018-07-11 06:29:27.728 23 INFO octavia.controller.queue.endpoint [req-dbbf0769-08d8-4a59-bc39-29bc64ea2b59 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'cd8e0312-97c5-411a-947d-3d65ca2e9554'... >2018-07-11 06:29:33.621 23 INFO octavia.controller.queue.endpoint [req-5f400a63-bb5f-4ebe-9fdf-3a586cb98690 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '886ebe00-dc1a-4678-a86e-c99eac3401d3'... >2018-07-11 06:56:06.197 23 INFO octavia.controller.queue.endpoint [req-b7f42c9a-a5da-4dbb-83d0-cb0a1a1c3b1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '19135075-ba3b-48c3-b4c7-6b70fea09e82'... >2018-07-11 06:56:06.324 23 INFO octavia.controller.worker.tasks.database_tasks [req-b7f42c9a-a5da-4dbb-83d0-cb0a1a1c3b1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 4deac251-93f7-4bae-b820-678c5042ec76 >2018-07-11 06:56:06.638 23 INFO octavia.certificates.generator.local [req-b7f42c9a-a5da-4dbb-83d0-cb0a1a1c3b1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 06:56:06.639 23 INFO octavia.certificates.generator.local [req-b7f42c9a-a5da-4dbb-83d0-cb0a1a1c3b1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 06:56:06.639 23 INFO octavia.certificates.generator.local [req-b7f42c9a-a5da-4dbb-83d0-cb0a1a1c3b1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 06:56:06.640 23 INFO octavia.certificates.generator.local [req-b7f42c9a-a5da-4dbb-83d0-cb0a1a1c3b1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 06:56:21.622 23 INFO octavia.controller.worker.tasks.database_tasks [req-b7f42c9a-a5da-4dbb-83d0-cb0a1a1c3b1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 4deac251-93f7-4bae-b820-678c5042ec76 with compute id 42d5163c-df90-41d4-96c6-48021e8f1e1f for load balancer: 19135075-ba3b-48c3-b4c7-6b70fea09e82 >2018-07-11 06:56:22.432 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b7f42c9a-a5da-4dbb-83d0-cb0a1a1c3b1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Port b35a06de-83e7-444d-b0fa-f83858329536 already exists. Nothing to be done. >2018-07-11 06:56:31.360 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-b7f42c9a-a5da-4dbb-83d0-cb0a1a1c3b1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.25', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.37.199 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470065d0d0>: Failed to establish a new connection: [Errno 113] No route to host',)) >2018-07-11 06:56:40.965 23 INFO octavia.controller.worker.tasks.database_tasks [req-b7f42c9a-a5da-4dbb-83d0-cb0a1a1c3b1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 19135075-ba3b-48c3-b4c7-6b70fea09e82 >2018-07-11 06:56:46.200 23 INFO octavia.controller.queue.endpoint [req-a767eaf0-7a99-4f0d-b8f0-304f65f07580 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '2c27b5d3-2660-4fc7-95e5-d2e2c07bc473'... >2018-07-11 06:56:51.211 23 INFO octavia.controller.queue.endpoint [req-e4b97c5e-d128-467b-9b80-c04d59feba9b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '9c0ccc58-eff1-4874-b429-3de3f916c533'... >2018-07-11 06:56:56.671 23 INFO octavia.controller.queue.endpoint [req-87676208-5595-4281-8436-380c7f455fa4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4b4eb5a4-e790-43a1-a665-89885de5fbfb'... >2018-07-11 06:57:06.751 23 INFO octavia.controller.queue.endpoint [req-840f29d7-d5ea-4627-a454-8fcdcf12370c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '19135075-ba3b-48c3-b4c7-6b70fea09e82'... >2018-07-11 06:57:08.441 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-840f29d7-d5ea-4627-a454-8fcdcf12370c - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 45e53393-766b-4227-bf91-70ce9f8a09db from port b35a06de-83e7-444d-b0fa-f83858329536 >2018-07-11 06:57:09.258 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-840f29d7-d5ea-4627-a454-8fcdcf12370c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 45e53393-766b-4227-bf91-70ce9f8a09db >2018-07-11 06:59:09.747 23 INFO octavia.controller.queue.endpoint [req-840f29d7-d5ea-4627-a454-8fcdcf12370c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'b6f93ce6-4121-410f-b15b-b5a2ab079589'... >2018-07-11 06:59:09.869 23 INFO octavia.controller.worker.tasks.database_tasks [req-840f29d7-d5ea-4627-a454-8fcdcf12370c - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 119c25ed-37fc-4b90-bfbe-8447337d6a3c >2018-07-11 06:59:10.047 23 INFO octavia.certificates.generator.local [req-840f29d7-d5ea-4627-a454-8fcdcf12370c - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 06:59:10.048 23 INFO octavia.certificates.generator.local [req-840f29d7-d5ea-4627-a454-8fcdcf12370c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 06:59:10.048 23 INFO octavia.certificates.generator.local [req-840f29d7-d5ea-4627-a454-8fcdcf12370c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 06:59:10.049 23 INFO octavia.certificates.generator.local [req-840f29d7-d5ea-4627-a454-8fcdcf12370c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 06:59:23.005 23 INFO octavia.controller.worker.tasks.database_tasks [req-840f29d7-d5ea-4627-a454-8fcdcf12370c - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 119c25ed-37fc-4b90-bfbe-8447337d6a3c with compute id 73b5d702-e3a2-4d0e-92a0-4d2bb6dd1d63 for load balancer: b6f93ce6-4121-410f-b15b-b5a2ab079589 >2018-07-11 06:59:23.331 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-840f29d7-d5ea-4627-a454-8fcdcf12370c - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 06bb2f42-82d3-46a3-96e3-6207e40ca9f9 already exists. Nothing to be done. >2018-07-11 06:59:29.563 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-840f29d7-d5ea-4627-a454-8fcdcf12370c - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.26', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.30.162 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700620490>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-11 06:59:39.185 23 INFO octavia.controller.worker.tasks.database_tasks [req-840f29d7-d5ea-4627-a454-8fcdcf12370c - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: b6f93ce6-4121-410f-b15b-b5a2ab079589 >2018-07-11 06:59:51.388 23 INFO octavia.controller.queue.endpoint [req-d1cad98a-d019-43df-861a-b345fdc3bd67 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'd980cb20-677f-4dd9-85b9-9ba228e4163f'... >2018-07-11 06:59:56.578 23 INFO octavia.controller.queue.endpoint [-] Creating pool 'da6d4b25-254a-4ed1-976e-2e4cf80a4a4e'... >2018-07-11 07:00:01.691 23 INFO octavia.controller.queue.endpoint [req-4804b9ff-2c4a-463c-8a58-c1e8d61bac8d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0529cff9-ca16-42a6-b49b-64f635835732'... >2018-07-11 07:00:17.669 23 INFO octavia.controller.queue.endpoint [req-b7f42c9a-a5da-4dbb-83d0-cb0a1a1c3b1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'b6f93ce6-4121-410f-b15b-b5a2ab079589'... >2018-07-11 07:00:20.147 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b7f42c9a-a5da-4dbb-83d0-cb0a1a1c3b1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 56c0e4f4-75c3-40ab-b067-f7330f613822 from port 06bb2f42-82d3-46a3-96e3-6207e40ca9f9 >2018-07-11 07:00:20.819 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b7f42c9a-a5da-4dbb-83d0-cb0a1a1c3b1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 56c0e4f4-75c3-40ab-b067-f7330f613822 >2018-07-11 07:04:48.017 23 INFO octavia.controller.queue.endpoint [req-7c8cf26c-c0f9-4a9c-9461-584063274041 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'bda3f406-2943-4374-8207-d748841fe75f'... >2018-07-11 07:04:48.133 23 INFO octavia.controller.worker.tasks.database_tasks [req-7c8cf26c-c0f9-4a9c-9461-584063274041 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 32e64748-882f-4479-b5b5-cda57b65e721 >2018-07-11 07:04:48.206 23 INFO octavia.certificates.generator.local [req-7c8cf26c-c0f9-4a9c-9461-584063274041 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 07:04:48.207 23 INFO octavia.certificates.generator.local [req-7c8cf26c-c0f9-4a9c-9461-584063274041 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 07:04:48.207 23 INFO octavia.certificates.generator.local [req-7c8cf26c-c0f9-4a9c-9461-584063274041 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 07:04:48.208 23 INFO octavia.certificates.generator.local [req-7c8cf26c-c0f9-4a9c-9461-584063274041 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 07:05:01.167 23 INFO octavia.controller.worker.tasks.database_tasks [req-7c8cf26c-c0f9-4a9c-9461-584063274041 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 32e64748-882f-4479-b5b5-cda57b65e721 with compute id 40292a31-fab6-4db1-a7e7-01b7793e90e8 for load balancer: bda3f406-2943-4374-8207-d748841fe75f >2018-07-11 07:05:01.460 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-7c8cf26c-c0f9-4a9c-9461-584063274041 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 41d909fb-b383-4dbc-baab-a02eb190c817 already exists. Nothing to be done. >2018-07-11 07:05:19.786 23 INFO octavia.controller.worker.tasks.database_tasks [req-7c8cf26c-c0f9-4a9c-9461-584063274041 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: bda3f406-2943-4374-8207-d748841fe75f >2018-07-11 07:05:25.367 23 INFO octavia.controller.queue.endpoint [req-c56cec21-d239-4ba2-a00f-ca6cb18b5a08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'a582e9dd-79c0-4d7c-ab1a-4ad7efca4938'... >2018-07-11 07:05:30.525 23 INFO octavia.controller.queue.endpoint [req-7ff246a2-51c1-49bd-9acf-24864c5b00c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '6ba83bd5-4a13-4eea-b8ea-2dbfd9978a61'... >2018-07-11 07:05:35.108 23 INFO octavia.controller.queue.endpoint [req-840f29d7-d5ea-4627-a454-8fcdcf12370c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd1179566-be45-44a3-8649-17914fcc1664'... >2018-07-11 07:05:45.167 23 INFO octavia.controller.queue.endpoint [req-539d9ae9-14f7-47b8-8bb7-f92db39c135f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'bda3f406-2943-4374-8207-d748841fe75f'... >2018-07-11 07:05:46.991 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-539d9ae9-14f7-47b8-8bb7-f92db39c135f - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group b202d426-191d-453b-9215-7f95cb704864 from port 41d909fb-b383-4dbc-baab-a02eb190c817 >2018-07-11 07:05:47.827 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-539d9ae9-14f7-47b8-8bb7-f92db39c135f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group b202d426-191d-453b-9215-7f95cb704864 >2018-07-11 07:07:43.084 23 INFO octavia.controller.queue.endpoint [req-05523d33-965a-4026-abb2-6bc0697efd8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '3d060eea-2cab-4674-85fa-96d38a3a3b97'... >2018-07-11 07:07:43.202 23 INFO octavia.controller.worker.tasks.database_tasks [req-05523d33-965a-4026-abb2-6bc0697efd8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 72ef6b24-4c79-4553-b193-ad0e5850f730 >2018-07-11 07:07:43.504 23 INFO octavia.certificates.generator.local [req-05523d33-965a-4026-abb2-6bc0697efd8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 07:07:43.505 23 INFO octavia.certificates.generator.local [req-05523d33-965a-4026-abb2-6bc0697efd8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 07:07:43.505 23 INFO octavia.certificates.generator.local [req-05523d33-965a-4026-abb2-6bc0697efd8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 07:07:43.506 23 INFO octavia.certificates.generator.local [req-05523d33-965a-4026-abb2-6bc0697efd8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 07:07:55.909 23 INFO octavia.controller.worker.tasks.database_tasks [req-05523d33-965a-4026-abb2-6bc0697efd8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 72ef6b24-4c79-4553-b193-ad0e5850f730 with compute id 56557413-36be-4e13-bf9a-2f1b3e7a2507 for load balancer: 3d060eea-2cab-4674-85fa-96d38a3a3b97 >2018-07-11 07:07:56.224 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-05523d33-965a-4026-abb2-6bc0697efd8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 0b4eb23a-5268-4f62-a9a4-b35a72f32053 already exists. Nothing to be done. >2018-07-11 07:08:10.849 23 INFO octavia.controller.worker.tasks.database_tasks [req-05523d33-965a-4026-abb2-6bc0697efd8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 3d060eea-2cab-4674-85fa-96d38a3a3b97 >2018-07-11 07:08:23.736 23 INFO octavia.controller.queue.endpoint [req-7c8cf26c-c0f9-4a9c-9461-584063274041 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '06fe2470-79b4-4bec-a655-c9936c814b8c'... >2018-07-11 07:08:28.620 23 INFO octavia.controller.queue.endpoint [-] Creating pool '31390257-5b76-4624-930c-729087f94d3c'... >2018-07-11 07:09:24.920 23 INFO octavia.controller.queue.endpoint [req-d56e07cf-b0b7-4550-a877-d3aa06022a37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '4a680908-0d16-4208-af10-5c854abb0ce6'... >2018-07-11 07:09:25.039 23 INFO octavia.controller.worker.tasks.database_tasks [req-d56e07cf-b0b7-4550-a877-d3aa06022a37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 47c448a7-228d-47c5-8ad7-0b4553f6bdc7 >2018-07-11 07:09:25.077 23 INFO octavia.certificates.generator.local [req-d56e07cf-b0b7-4550-a877-d3aa06022a37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 07:09:25.077 23 INFO octavia.certificates.generator.local [req-d56e07cf-b0b7-4550-a877-d3aa06022a37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 07:09:25.078 23 INFO octavia.certificates.generator.local [req-d56e07cf-b0b7-4550-a877-d3aa06022a37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 07:09:25.078 23 INFO octavia.certificates.generator.local [req-d56e07cf-b0b7-4550-a877-d3aa06022a37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 07:09:37.206 23 INFO octavia.controller.worker.tasks.database_tasks [req-d56e07cf-b0b7-4550-a877-d3aa06022a37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 47c448a7-228d-47c5-8ad7-0b4553f6bdc7 with compute id 0f682f2f-81d9-4f28-8fa7-d968fe98e0a2 for load balancer: 4a680908-0d16-4208-af10-5c854abb0ce6 >2018-07-11 07:09:37.302 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-d56e07cf-b0b7-4550-a877-d3aa06022a37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 1fcb1e88-3b4c-4417-9c20-53d16fa841a5 already exists. Nothing to be done. >2018-07-11 07:09:44.782 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-d56e07cf-b0b7-4550-a877-d3aa06022a37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.20', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.74.78 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470066dc10>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-11 07:09:54.412 23 INFO octavia.controller.worker.tasks.database_tasks [req-d56e07cf-b0b7-4550-a877-d3aa06022a37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 4a680908-0d16-4208-af10-5c854abb0ce6 >2018-07-11 07:10:05.190 23 INFO octavia.controller.queue.endpoint [req-d56e07cf-b0b7-4550-a877-d3aa06022a37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'a2bec30a-4ce4-48d2-9d5c-6c5d33e35eb5'... >2018-07-11 07:10:10.427 23 INFO octavia.controller.queue.endpoint [req-03a77e6e-737b-48df-9e99-bd9c77715355 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '17cd1384-6853-45a2-9228-16bdc0b94de0'... >2018-07-11 07:10:16.429 23 INFO octavia.controller.queue.endpoint [req-2aa9abe3-938e-4459-89d7-77a5aa08c293 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '92093f5e-7fad-4b47-a63b-3fb9ecdfe8ae'... >2018-07-11 07:11:55.887 23 INFO octavia.controller.queue.endpoint [req-ac6e1ac2-c8bf-48bb-93f6-c4dce6d1f7c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '4a680908-0d16-4208-af10-5c854abb0ce6'... >2018-07-11 07:11:58.391 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ac6e1ac2-c8bf-48bb-93f6-c4dce6d1f7c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 0d2f1854-c75d-43c4-b5a2-6725bcb487e3 from port 1fcb1e88-3b4c-4417-9c20-53d16fa841a5 >2018-07-11 07:11:59.377 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ac6e1ac2-c8bf-48bb-93f6-c4dce6d1f7c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 0d2f1854-c75d-43c4-b5a2-6725bcb487e3 >2018-07-11 07:21:46.730 23 INFO octavia.controller.queue.endpoint [req-94b5ba05-189a-4e59-8129-93d6eac6944a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '095a5856-7a21-41fb-9f8e-621d3b27d657'... >2018-07-11 07:21:46.862 23 INFO octavia.controller.worker.tasks.database_tasks [req-94b5ba05-189a-4e59-8129-93d6eac6944a - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id b354b9e7-da04-40c9-aafc-01955ba9d3e0 >2018-07-11 07:21:46.893 23 INFO octavia.certificates.generator.local [req-94b5ba05-189a-4e59-8129-93d6eac6944a - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 07:21:46.893 23 INFO octavia.certificates.generator.local [req-94b5ba05-189a-4e59-8129-93d6eac6944a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 07:21:46.894 23 INFO octavia.certificates.generator.local [req-94b5ba05-189a-4e59-8129-93d6eac6944a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 07:21:46.894 23 INFO octavia.certificates.generator.local [req-94b5ba05-189a-4e59-8129-93d6eac6944a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 07:22:00.309 23 INFO octavia.controller.worker.tasks.database_tasks [req-94b5ba05-189a-4e59-8129-93d6eac6944a - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: b354b9e7-da04-40c9-aafc-01955ba9d3e0 with compute id 82169b00-a678-4f67-9a72-fcdcdca319ad for load balancer: 095a5856-7a21-41fb-9f8e-621d3b27d657 >2018-07-11 07:22:00.606 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-94b5ba05-189a-4e59-8129-93d6eac6944a - 293061856e1a4cffbae3ed099cf4f619 - - -] Port a43e20d7-a5dc-468a-9391-9f7751755ef8 already exists. Nothing to be done. >2018-07-11 07:22:09.445 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-94b5ba05-189a-4e59-8129-93d6eac6944a - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.21', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.90.113 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700531350>: Failed to establish a new connection: [Errno 113] No route to host',)) >2018-07-11 07:22:14.453 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-94b5ba05-189a-4e59-8129-93d6eac6944a - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.21', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.90.113 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4702fcafd0>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-11 07:22:24.065 23 INFO octavia.controller.worker.tasks.database_tasks [req-94b5ba05-189a-4e59-8129-93d6eac6944a - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 095a5856-7a21-41fb-9f8e-621d3b27d657 >2018-07-11 07:22:37.867 23 INFO octavia.controller.queue.endpoint [req-c7ddc043-389d-4f63-b6b4-50a89c6466af - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'a9987374-e18e-420a-8673-03b7950af486'... >2018-07-11 07:22:42.741 23 INFO octavia.controller.queue.endpoint [req-b228e1a9-c41f-44ea-a2fc-a30223f240cb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'cccd6268-bdbc-4a45-8b88-6d51fbce1051'... >2018-07-11 07:30:12.600 23 INFO octavia.controller.queue.endpoint [req-b531f784-ea0b-4ecc-8e3b-f8a350c3be39 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'c4ff9e45-b4ba-4a81-a38b-8015c2a67ceb'... >2018-07-11 07:30:12.720 23 INFO octavia.controller.worker.tasks.database_tasks [req-b531f784-ea0b-4ecc-8e3b-f8a350c3be39 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 2db04963-9f44-4a29-8916-bc888ce488eb >2018-07-11 07:30:12.766 23 INFO octavia.certificates.generator.local [req-b531f784-ea0b-4ecc-8e3b-f8a350c3be39 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 07:30:12.767 23 INFO octavia.certificates.generator.local [req-b531f784-ea0b-4ecc-8e3b-f8a350c3be39 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 07:30:12.767 23 INFO octavia.certificates.generator.local [req-b531f784-ea0b-4ecc-8e3b-f8a350c3be39 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 07:30:12.767 23 INFO octavia.certificates.generator.local [req-b531f784-ea0b-4ecc-8e3b-f8a350c3be39 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 07:30:27.121 23 INFO octavia.controller.worker.tasks.database_tasks [req-b531f784-ea0b-4ecc-8e3b-f8a350c3be39 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 2db04963-9f44-4a29-8916-bc888ce488eb with compute id a24cf1e8-3c36-415e-83f4-40f48bddb9c9 for load balancer: c4ff9e45-b4ba-4a81-a38b-8015c2a67ceb >2018-07-11 07:30:27.506 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b531f784-ea0b-4ecc-8e3b-f8a350c3be39 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port a8ee203e-86d4-45e5-80c5-a04bfa3cae2c already exists. Nothing to be done. >2018-07-11 07:30:44.990 23 INFO octavia.controller.worker.tasks.database_tasks [req-b531f784-ea0b-4ecc-8e3b-f8a350c3be39 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: c4ff9e45-b4ba-4a81-a38b-8015c2a67ceb >2018-07-11 07:30:53.342 23 INFO octavia.controller.queue.endpoint [req-b7f42c9a-a5da-4dbb-83d0-cb0a1a1c3b1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '390a4439-9391-4f5f-ba2a-7c51ea9c4150'... >2018-07-11 07:30:58.308 23 INFO octavia.controller.queue.endpoint [req-454d1e1c-d0bc-48be-901a-a79c4f077821 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'a8f8da8d-bf6c-41e1-9b3b-34c695c7e779'... >2018-07-11 07:31:03.002 23 INFO octavia.controller.queue.endpoint [req-b531f784-ea0b-4ecc-8e3b-f8a350c3be39 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '42361e3b-4d9a-465e-bd2b-aa82875ac0a4'... >2018-07-11 07:31:13.029 23 INFO octavia.controller.queue.endpoint [req-4c2d6e03-b0d5-4f6a-9811-f2d04470a25f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'c4ff9e45-b4ba-4a81-a38b-8015c2a67ceb'... >2018-07-11 07:31:14.913 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-4c2d6e03-b0d5-4f6a-9811-f2d04470a25f - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 0637d90e-c5c4-433d-b9af-14acc0c8f42b from port a8ee203e-86d4-45e5-80c5-a04bfa3cae2c >2018-07-11 07:31:15.619 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-4c2d6e03-b0d5-4f6a-9811-f2d04470a25f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 0637d90e-c5c4-433d-b9af-14acc0c8f42b >2018-07-11 07:34:52.686 23 INFO octavia.controller.queue.endpoint [req-539d9ae9-14f7-47b8-8bb7-f92db39c135f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '1cf0d8f3-8da3-4821-a1b2-f13ce81efaac'... >2018-07-11 07:34:52.799 23 INFO octavia.controller.worker.tasks.database_tasks [req-539d9ae9-14f7-47b8-8bb7-f92db39c135f - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id b8279699-3b95-47bb-98e3-dbf8be2726f2 >2018-07-11 07:34:52.980 23 INFO octavia.certificates.generator.local [req-539d9ae9-14f7-47b8-8bb7-f92db39c135f - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 07:34:52.980 23 INFO octavia.certificates.generator.local [req-539d9ae9-14f7-47b8-8bb7-f92db39c135f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 07:34:52.981 23 INFO octavia.certificates.generator.local [req-539d9ae9-14f7-47b8-8bb7-f92db39c135f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 07:34:52.981 23 INFO octavia.certificates.generator.local [req-539d9ae9-14f7-47b8-8bb7-f92db39c135f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 07:35:06.426 23 INFO octavia.controller.worker.tasks.database_tasks [req-539d9ae9-14f7-47b8-8bb7-f92db39c135f - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: b8279699-3b95-47bb-98e3-dbf8be2726f2 with compute id 81a39429-a922-40f5-afe8-2135604bb666 for load balancer: 1cf0d8f3-8da3-4821-a1b2-f13ce81efaac >2018-07-11 07:35:06.734 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-539d9ae9-14f7-47b8-8bb7-f92db39c135f - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 241fb018-a7f2-4eb3-a763-08565e5c13d5 already exists. Nothing to be done. >2018-07-11 07:35:24.839 23 INFO octavia.controller.worker.tasks.database_tasks [req-539d9ae9-14f7-47b8-8bb7-f92db39c135f - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 1cf0d8f3-8da3-4821-a1b2-f13ce81efaac >2018-07-11 07:35:34.280 23 INFO octavia.controller.queue.endpoint [req-a203043d-6fa2-4f4e-bd6a-d9e2595b4dc7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '4a7fb178-0e23-42d0-a6cd-a8a5054fb68c'... >2018-07-11 07:35:38.558 23 INFO octavia.controller.queue.endpoint [req-d194ca0f-d293-4b61-bd88-19432ff169cd - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'ca874426-efc0-4a7c-81b0-7827a5d314de'... >2018-07-11 07:35:43.407 23 INFO octavia.controller.queue.endpoint [req-fd3a01cf-a30c-458d-b047-cf0fd0e4b8a8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '795204b2-4c33-48c7-b6ac-90041c7f9306'... >2018-07-11 07:35:48.818 23 INFO octavia.controller.queue.endpoint [req-539d9ae9-14f7-47b8-8bb7-f92db39c135f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'e86e7c0f-a6c4-45d9-a494-d8acb35e33ff'... >2018-07-11 07:35:54.514 23 INFO octavia.controller.queue.endpoint [req-68227349-3613-471d-8d39-18de3a1af4be - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '327ff6d1-d47e-4ca0-966d-aa0d211363e7'... >2018-07-11 07:35:59.775 23 INFO octavia.controller.queue.endpoint [req-7768cf09-3ebd-424e-94e5-166427922764 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating member '737b4307-7bbd-4d63-b029-738db688bd03'... >2018-07-11 07:36:09.727 23 INFO octavia.controller.queue.endpoint [req-866d5b76-df03-46d2-a943-e1b3bf20bec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '1cf0d8f3-8da3-4821-a1b2-f13ce81efaac'... >2018-07-11 07:36:12.124 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-866d5b76-df03-46d2-a943-e1b3bf20bec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 709bbe0b-43e4-4343-abb0-dfe6f0ba36d3 from port 241fb018-a7f2-4eb3-a763-08565e5c13d5 >2018-07-11 07:36:12.829 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-866d5b76-df03-46d2-a943-e1b3bf20bec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 709bbe0b-43e4-4343-abb0-dfe6f0ba36d3 >2018-07-11 07:47:49.000 23 INFO octavia.controller.queue.endpoint [req-27bfd204-831b-4616-ac9d-ccce08767ab8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '1485af28-de5c-4e61-9b22-bf1e2d4b3380'... >2018-07-11 07:47:49.119 23 INFO octavia.controller.worker.tasks.database_tasks [req-27bfd204-831b-4616-ac9d-ccce08767ab8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id db751f69-e5f5-4a9e-b4b6-e4c825c38c4b >2018-07-11 07:47:49.227 23 INFO octavia.certificates.generator.local [req-27bfd204-831b-4616-ac9d-ccce08767ab8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 07:47:49.227 23 INFO octavia.certificates.generator.local [req-27bfd204-831b-4616-ac9d-ccce08767ab8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 07:47:49.228 23 INFO octavia.certificates.generator.local [req-27bfd204-831b-4616-ac9d-ccce08767ab8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 07:47:49.228 23 INFO octavia.certificates.generator.local [req-27bfd204-831b-4616-ac9d-ccce08767ab8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 07:47:50.966 23 INFO octavia.controller.queue.endpoint [req-a2aeaafe-0057-4658-b755-39d75bda22ec - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '44d5aacd-413e-46fd-88ef-590660744838'... >2018-07-11 07:47:51.087 23 INFO octavia.controller.worker.tasks.database_tasks [req-a2aeaafe-0057-4658-b755-39d75bda22ec - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id f407e5c2-9298-4c82-979d-29fd1db90e0f >2018-07-11 07:47:51.184 23 INFO octavia.certificates.generator.local [req-a2aeaafe-0057-4658-b755-39d75bda22ec - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 07:47:51.185 23 INFO octavia.certificates.generator.local [req-a2aeaafe-0057-4658-b755-39d75bda22ec - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 07:47:51.185 23 INFO octavia.certificates.generator.local [req-a2aeaafe-0057-4658-b755-39d75bda22ec - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 07:47:51.186 23 INFO octavia.certificates.generator.local [req-a2aeaafe-0057-4658-b755-39d75bda22ec - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 07:48:02.617 23 INFO octavia.controller.worker.tasks.database_tasks [req-27bfd204-831b-4616-ac9d-ccce08767ab8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: db751f69-e5f5-4a9e-b4b6-e4c825c38c4b with compute id 803fdc39-fc43-4917-8f14-fd069db6944b for load balancer: 1485af28-de5c-4e61-9b22-bf1e2d4b3380 >2018-07-11 07:48:02.929 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-27bfd204-831b-4616-ac9d-ccce08767ab8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port bef105a6-8ab5-466f-8518-733b9db7d60a already exists. Nothing to be done. >2018-07-11 07:48:03.598 23 INFO octavia.controller.worker.tasks.database_tasks [req-a2aeaafe-0057-4658-b755-39d75bda22ec - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: f407e5c2-9298-4c82-979d-29fd1db90e0f with compute id c1d89459-d4e9-43ea-8353-63b960870ef8 for load balancer: 44d5aacd-413e-46fd-88ef-590660744838 >2018-07-11 07:48:04.019 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a2aeaafe-0057-4658-b755-39d75bda22ec - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 190ed855-faaf-4083-a5cc-ac46874c042d already exists. Nothing to be done. >2018-07-11 07:48:12.621 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-a2aeaafe-0057-4658-b755-39d75bda22ec - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.27', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.79.31 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470038d850>: Failed to establish a new connection: [Errno 113] No route to host',)) >2018-07-11 07:48:17.624 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-a2aeaafe-0057-4658-b755-39d75bda22ec - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.27', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.79.31 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700399cd0>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-11 07:48:18.721 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-27bfd204-831b-4616-ac9d-ccce08767ab8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.8', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.215.33 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700399610>, 'Connection to 172.24.0.8 timed out. (connect timeout=10.0)')) >2018-07-11 07:48:27.251 23 INFO octavia.controller.worker.tasks.database_tasks [req-a2aeaafe-0057-4658-b755-39d75bda22ec - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 44d5aacd-413e-46fd-88ef-590660744838 >2018-07-11 07:48:28.312 23 INFO octavia.controller.worker.tasks.database_tasks [req-27bfd204-831b-4616-ac9d-ccce08767ab8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 1485af28-de5c-4e61-9b22-bf1e2d4b3380 >2018-07-11 07:48:30.145 23 INFO octavia.controller.queue.endpoint [req-bc38d5a7-661f-4550-a8de-178ae15bbde3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'fe1fec8f-5ef8-4266-99f6-0ddf18590ac0'... >2018-07-11 07:48:30.978 23 INFO octavia.controller.queue.endpoint [req-eb7e7a2c-3db1-43b6-8cd8-c0840786260b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'e8ee0029-336f-4531-b479-9a9cf5b6b0d8'... >2018-07-11 07:48:35.176 23 INFO octavia.controller.queue.endpoint [req-5f9acb26-0206-44cb-a31e-72ccc989a29b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '7c376216-e658-47dd-9d8f-fecc855bec75'... >2018-07-11 07:48:36.023 23 INFO octavia.controller.queue.endpoint [req-05523d33-965a-4026-abb2-6bc0697efd8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '43d581bf-74bf-4088-8f78-86b418e61b53'... >2018-07-11 07:48:40.974 23 INFO octavia.controller.queue.endpoint [req-41197aa8-50ce-4327-8918-62e9695f8956 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '46a13920-fc05-4042-987f-f9d88f15f9f0'... >2018-07-11 07:48:41.209 23 INFO octavia.controller.queue.endpoint [req-2a43c178-e64f-44ca-88a1-8d929dd24e4e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '55d149f8-cacb-4f74-9f7f-7893a48984c4'... >2018-07-11 07:48:42.258 23 INFO octavia.controller.queue.endpoint [req-62cf6f84-f95f-4ac4-963b-69f0590347c5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '98e3aeac-e7b8-4223-808c-f9040c9e58b5'... >2018-07-11 07:48:46.800 23 INFO octavia.controller.queue.endpoint [req-866d5b76-df03-46d2-a943-e1b3bf20bec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c711c6f4-2002-4f92-b5dd-efd336440521'... >2018-07-11 07:48:47.348 23 INFO octavia.controller.queue.endpoint [req-1d742314-b54a-4658-b6d9-4bb2a99d0f90 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9eb88453-f65a-4497-872d-300e73ae175c'... >2018-07-11 07:48:48.181 23 INFO octavia.controller.queue.endpoint [req-a2aeaafe-0057-4658-b755-39d75bda22ec - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1064e0d1-5019-44c4-b198-afc5f5960a55'... >2018-07-11 07:50:54.423 23 INFO octavia.controller.queue.endpoint [req-9223ccaf-faa0-4021-8f81-20d3fc467ef4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '7b64a842-9be9-4b7d-a351-9e3c0df2dcbb'... >2018-07-11 07:50:54.541 23 INFO octavia.controller.worker.tasks.database_tasks [req-9223ccaf-faa0-4021-8f81-20d3fc467ef4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 6f9ab31f-e3c3-4edd-bf86-19345c4ce92b >2018-07-11 07:50:54.628 23 INFO octavia.certificates.generator.local [req-9223ccaf-faa0-4021-8f81-20d3fc467ef4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 07:50:54.628 23 INFO octavia.certificates.generator.local [req-9223ccaf-faa0-4021-8f81-20d3fc467ef4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 07:50:54.629 23 INFO octavia.certificates.generator.local [req-9223ccaf-faa0-4021-8f81-20d3fc467ef4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 07:50:54.629 23 INFO octavia.certificates.generator.local [req-9223ccaf-faa0-4021-8f81-20d3fc467ef4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 07:50:55.512 23 INFO octavia.controller.queue.endpoint [req-dcb8b60b-6693-48da-a4c5-ba7d9f395044 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '87758df5-ad27-4e56-95fa-295938682eba'... >2018-07-11 07:50:55.631 23 INFO octavia.controller.worker.tasks.database_tasks [req-dcb8b60b-6693-48da-a4c5-ba7d9f395044 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 8389a2db-d40b-4f0a-b647-d7d4009b6a2f >2018-07-11 07:50:55.907 23 INFO octavia.certificates.generator.local [req-dcb8b60b-6693-48da-a4c5-ba7d9f395044 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 07:50:55.907 23 INFO octavia.certificates.generator.local [req-dcb8b60b-6693-48da-a4c5-ba7d9f395044 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 07:50:55.908 23 INFO octavia.certificates.generator.local [req-dcb8b60b-6693-48da-a4c5-ba7d9f395044 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 07:50:55.908 23 INFO octavia.certificates.generator.local [req-dcb8b60b-6693-48da-a4c5-ba7d9f395044 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 07:51:06.897 23 INFO octavia.controller.worker.tasks.database_tasks [req-9223ccaf-faa0-4021-8f81-20d3fc467ef4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 6f9ab31f-e3c3-4edd-bf86-19345c4ce92b with compute id b81cba99-9c87-4be8-ab38-a07922f34dfb for load balancer: 7b64a842-9be9-4b7d-a351-9e3c0df2dcbb >2018-07-11 07:51:07.190 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-9223ccaf-faa0-4021-8f81-20d3fc467ef4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 61714dab-74b9-4034-b81d-d0064359f8ee already exists. Nothing to be done. >2018-07-11 07:51:08.067 23 INFO octavia.controller.worker.tasks.database_tasks [req-dcb8b60b-6693-48da-a4c5-ba7d9f395044 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 8389a2db-d40b-4f0a-b647-d7d4009b6a2f with compute id 8a99003a-d495-49df-a5ef-509e4f370a72 for load balancer: 87758df5-ad27-4e56-95fa-295938682eba >2018-07-11 07:51:08.155 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-dcb8b60b-6693-48da-a4c5-ba7d9f395044 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port ef4d6bb6-ddfd-4dfe-8561-8e928cb46da5 already exists. Nothing to be done. >2018-07-11 07:51:14.135 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-9223ccaf-faa0-4021-8f81-20d3fc467ef4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.24', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.215.213 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470809d3d0>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-11 07:51:23.780 23 INFO octavia.controller.worker.tasks.database_tasks [req-9223ccaf-faa0-4021-8f81-20d3fc467ef4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 7b64a842-9be9-4b7d-a351-9e3c0df2dcbb >2018-07-11 07:51:26.191 23 INFO octavia.controller.worker.tasks.database_tasks [req-dcb8b60b-6693-48da-a4c5-ba7d9f395044 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 87758df5-ad27-4e56-95fa-295938682eba >2018-07-11 07:51:33.814 23 INFO octavia.controller.queue.endpoint [req-fa3fe7e8-3876-4d66-8b19-53ba698e6e09 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'f287a8f6-01d6-4b84-afad-f6d7c1b8d25b'... >2018-07-11 07:51:34.965 23 INFO octavia.controller.queue.endpoint [req-24056847-b9ce-45f8-8e86-df7acb3a7839 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '4e02f000-2c35-463d-abc6-6b96ff4d5af7'... >2018-07-11 07:51:38.839 23 INFO octavia.controller.queue.endpoint [req-3af7638c-3d81-483c-afc1-57a1e8af5b54 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '072d1c94-5fea-4cb6-9d04-4c56bf4ba2d1'... >2018-07-11 07:51:39.701 23 INFO octavia.controller.queue.endpoint [req-083fb93b-5002-4607-b52d-0c45b0a7acd3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '3511bdff-dc5f-434b-961f-000f203188da'... >2018-07-11 07:51:44.118 23 INFO octavia.controller.queue.endpoint [req-dcb8b60b-6693-48da-a4c5-ba7d9f395044 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f531ef6e-668c-4b23-9805-bd4c9885f641'... >2018-07-11 07:51:44.658 23 INFO octavia.controller.queue.endpoint [req-9223ccaf-faa0-4021-8f81-20d3fc467ef4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c82ad8bd-7ac9-4ed3-87c0-0a931efaa7ca'... >2018-07-11 08:05:42.633 23 INFO octavia.controller.queue.endpoint [req-7f2e896d-386f-4cf6-b203-3c88138a9b1f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c82ad8bd-7ac9-4ed3-87c0-0a931efaa7ca'... >2018-07-11 08:05:42.723 23 INFO octavia.controller.queue.endpoint [req-38575469-253a-421e-933c-aa545642c01b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f531ef6e-668c-4b23-9805-bd4c9885f641'... >2018-07-11 08:05:48.188 23 INFO octavia.controller.queue.endpoint [req-396b302b-4da0-4c4a-aec1-7b48ff11cb7f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7ce9f0ba-da92-4dc6-b486-e1b0ef7219a0'... >2018-07-11 08:05:48.423 23 INFO octavia.controller.queue.endpoint [req-cfa9b982-01ea-46f3-9864-7b10dffb1c52 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'bc7306f5-50a1-4b43-9106-06bd62983411'... >2018-07-11 08:22:20.680 23 INFO octavia.controller.queue.endpoint [req-4c2d6e03-b0d5-4f6a-9811-f2d04470a25f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'a796e34c-86bd-426d-909c-5d89897d40d1'... >2018-07-11 08:22:20.796 23 INFO octavia.controller.worker.tasks.database_tasks [req-4c2d6e03-b0d5-4f6a-9811-f2d04470a25f - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 66bc0b27-a3a6-4af3-88ad-22f0038ca8be >2018-07-11 08:22:20.904 23 INFO octavia.certificates.generator.local [req-4c2d6e03-b0d5-4f6a-9811-f2d04470a25f - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 08:22:20.904 23 INFO octavia.certificates.generator.local [req-4c2d6e03-b0d5-4f6a-9811-f2d04470a25f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 08:22:20.905 23 INFO octavia.certificates.generator.local [req-4c2d6e03-b0d5-4f6a-9811-f2d04470a25f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 08:22:20.905 23 INFO octavia.certificates.generator.local [req-4c2d6e03-b0d5-4f6a-9811-f2d04470a25f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 08:22:34.724 23 INFO octavia.controller.worker.tasks.database_tasks [req-4c2d6e03-b0d5-4f6a-9811-f2d04470a25f - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 66bc0b27-a3a6-4af3-88ad-22f0038ca8be with compute id ecd40784-057a-4adb-8054-4c824351e213 for load balancer: a796e34c-86bd-426d-909c-5d89897d40d1 >2018-07-11 08:22:35.035 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-4c2d6e03-b0d5-4f6a-9811-f2d04470a25f - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 002c2424-3054-4214-80bf-44c3b25bb442 already exists. Nothing to be done. >2018-07-11 08:22:42.404 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-4c2d6e03-b0d5-4f6a-9811-f2d04470a25f - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.29', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.210.113 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470058cb10>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-11 08:22:52.006 23 INFO octavia.controller.worker.tasks.database_tasks [req-4c2d6e03-b0d5-4f6a-9811-f2d04470a25f - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: a796e34c-86bd-426d-909c-5d89897d40d1 >2018-07-11 08:23:03.982 23 INFO octavia.controller.queue.endpoint [req-4c2d6e03-b0d5-4f6a-9811-f2d04470a25f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'f1ef647a-f00a-46ed-905a-afea5c83b37c'... >2018-07-11 08:23:09.311 23 INFO octavia.controller.queue.endpoint [req-f1d3fb79-8e3a-408e-b528-d445642c98dc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'b8bcef25-5a70-4b64-be06-4e08e8442197'... >2018-07-11 08:34:04.699 23 INFO octavia.controller.queue.endpoint [req-ac6e1ac2-c8bf-48bb-93f6-c4dce6d1f7c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'f1d2663d-144e-48cf-8106-b1612f2e2df7'... >2018-07-11 08:34:04.832 23 INFO octavia.controller.worker.tasks.database_tasks [req-ac6e1ac2-c8bf-48bb-93f6-c4dce6d1f7c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 0a3d15ac-a26d-4f15-b101-b8e317775161 >2018-07-11 08:34:05.065 23 INFO octavia.certificates.generator.local [req-ac6e1ac2-c8bf-48bb-93f6-c4dce6d1f7c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 08:34:05.065 23 INFO octavia.certificates.generator.local [req-ac6e1ac2-c8bf-48bb-93f6-c4dce6d1f7c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 08:34:05.066 23 INFO octavia.certificates.generator.local [req-ac6e1ac2-c8bf-48bb-93f6-c4dce6d1f7c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 08:34:05.066 23 INFO octavia.certificates.generator.local [req-ac6e1ac2-c8bf-48bb-93f6-c4dce6d1f7c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 08:34:19.286 23 INFO octavia.controller.worker.tasks.database_tasks [req-ac6e1ac2-c8bf-48bb-93f6-c4dce6d1f7c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 0a3d15ac-a26d-4f15-b101-b8e317775161 with compute id 98e5cf5f-25a4-422e-97cc-1d1c6ab9d0d1 for load balancer: f1d2663d-144e-48cf-8106-b1612f2e2df7 >2018-07-11 08:34:19.601 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ac6e1ac2-c8bf-48bb-93f6-c4dce6d1f7c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port aa49a583-f7df-4a68-b099-fbe49000a875 already exists. Nothing to be done. >2018-07-11 08:34:26.719 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-ac6e1ac2-c8bf-48bb-93f6-c4dce6d1f7c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.32', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.191.212 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470040a990>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-11 08:34:36.377 23 INFO octavia.controller.worker.tasks.database_tasks [req-ac6e1ac2-c8bf-48bb-93f6-c4dce6d1f7c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f1d2663d-144e-48cf-8106-b1612f2e2df7 >2018-07-11 08:34:45.815 23 INFO octavia.controller.queue.endpoint [req-70b14d58-e16c-43e8-b7ef-5c9091db4350 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '34d79291-7a4b-47de-96bb-1011b1a15c39'... >2018-07-11 08:34:50.870 23 INFO octavia.controller.queue.endpoint [req-f5656e65-639c-4714-ac56-3fd8f55277ef - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '62215afa-2a74-4c5d-baa7-7d536f349356'... >2018-07-11 08:34:55.729 23 INFO octavia.controller.queue.endpoint [req-02a5fc45-3d2f-4dcc-8ed2-d506927c80b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '3260f126-69ad-47ef-97ef-1e73b50b09aa'... >2018-07-11 08:35:00.882 23 INFO octavia.controller.queue.endpoint [req-21997354-889c-4db5-be4c-4bcb3ab6412a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'aed6b7e1-9477-45a7-a1d5-636a76d78042'... >2018-07-11 08:35:06.023 23 INFO octavia.controller.queue.endpoint [req-61e44288-ec46-4272-a7b5-82026eb56190 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a2e7481e-4e82-42aa-9b99-77115f96bcc5'... >2018-07-11 08:35:11.455 23 INFO octavia.controller.queue.endpoint [req-b8d101e6-752f-4ebb-a68d-491bb0987725 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4c1845fc-aa87-49f7-bd90-c519cb82fde3'... >2018-07-11 08:37:40.385 23 INFO octavia.controller.queue.endpoint [req-a9d6e5c6-3988-4241-ad6c-f40b7fabdeec - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '6d6b2155-9e74-440e-9bff-6c1f1e44f712'... >2018-07-11 08:37:40.503 23 INFO octavia.controller.worker.tasks.database_tasks [req-a9d6e5c6-3988-4241-ad6c-f40b7fabdeec - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id e25c75bc-1359-4b0d-bb41-6d9011d2e919 >2018-07-11 08:37:40.722 23 INFO octavia.certificates.generator.local [req-a9d6e5c6-3988-4241-ad6c-f40b7fabdeec - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 08:37:40.722 23 INFO octavia.certificates.generator.local [req-a9d6e5c6-3988-4241-ad6c-f40b7fabdeec - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 08:37:40.722 23 INFO octavia.certificates.generator.local [req-a9d6e5c6-3988-4241-ad6c-f40b7fabdeec - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 08:37:40.723 23 INFO octavia.certificates.generator.local [req-a9d6e5c6-3988-4241-ad6c-f40b7fabdeec - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 08:37:54.330 23 INFO octavia.controller.worker.tasks.database_tasks [req-a9d6e5c6-3988-4241-ad6c-f40b7fabdeec - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: e25c75bc-1359-4b0d-bb41-6d9011d2e919 with compute id 706a9089-ceb9-4b7d-8a68-8678cd8562b1 for load balancer: 6d6b2155-9e74-440e-9bff-6c1f1e44f712 >2018-07-11 08:37:54.628 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a9d6e5c6-3988-4241-ad6c-f40b7fabdeec - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 29e4821c-aeae-42fb-976b-5565b87a2ab6 already exists. Nothing to be done. >2018-07-11 08:38:00.954 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-a9d6e5c6-3988-4241-ad6c-f40b7fabdeec - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.34', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.229.136 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47080e3a10>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-11 08:38:10.556 23 INFO octavia.controller.worker.tasks.database_tasks [req-a9d6e5c6-3988-4241-ad6c-f40b7fabdeec - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 6d6b2155-9e74-440e-9bff-6c1f1e44f712 >2018-07-11 08:38:19.531 23 INFO octavia.controller.queue.endpoint [req-a9d6e5c6-3988-4241-ad6c-f40b7fabdeec - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '74a92aed-9055-46b0-9f45-f0c5af986aa4'... >2018-07-11 08:38:24.917 23 INFO octavia.controller.queue.endpoint [req-78f7524e-7d30-4a37-af07-a43f983f16fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'a332eb60-ae80-4dbc-aa4d-edca08f1752b'... >2018-07-11 08:38:30.365 23 INFO octavia.controller.queue.endpoint [req-5e03ccc0-0ef0-4282-a58b-a79896fd98dc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '14bcb6e8-8e62-4037-8ad2-4836ba665f18'... >2018-07-11 08:42:57.220 23 INFO octavia.controller.queue.endpoint [req-eeca93a6-05fd-466d-85b1-63e5bdd9c958 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'a373dcb2-e2b4-4974-8917-0c450740d3d3'... >2018-07-11 08:42:57.340 23 INFO octavia.controller.worker.tasks.database_tasks [req-eeca93a6-05fd-466d-85b1-63e5bdd9c958 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 1707f330-bb97-4696-ab66-c0d520fc350f >2018-07-11 08:42:57.520 23 INFO octavia.certificates.generator.local [req-eeca93a6-05fd-466d-85b1-63e5bdd9c958 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 08:42:57.520 23 INFO octavia.certificates.generator.local [req-eeca93a6-05fd-466d-85b1-63e5bdd9c958 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 08:42:57.521 23 INFO octavia.certificates.generator.local [req-eeca93a6-05fd-466d-85b1-63e5bdd9c958 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 08:42:57.521 23 INFO octavia.certificates.generator.local [req-eeca93a6-05fd-466d-85b1-63e5bdd9c958 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 08:43:11.307 23 INFO octavia.controller.worker.tasks.database_tasks [req-eeca93a6-05fd-466d-85b1-63e5bdd9c958 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 1707f330-bb97-4696-ab66-c0d520fc350f with compute id 59d70fb2-1dd6-48f9-9f45-470131f93939 for load balancer: a373dcb2-e2b4-4974-8917-0c450740d3d3 >2018-07-11 08:43:11.590 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-eeca93a6-05fd-466d-85b1-63e5bdd9c958 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 4084cd7e-aa06-494b-be20-380f6d16ad1c already exists. Nothing to be done. >2018-07-11 08:43:20.249 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-eeca93a6-05fd-466d-85b1-63e5bdd9c958 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.6', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.187.176 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700639a50>: Failed to establish a new connection: [Errno 113] No route to host',)) >2018-07-11 08:43:29.868 23 INFO octavia.controller.worker.tasks.database_tasks [req-eeca93a6-05fd-466d-85b1-63e5bdd9c958 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: a373dcb2-e2b4-4974-8917-0c450740d3d3 >2018-07-11 08:43:37.952 23 INFO octavia.controller.queue.endpoint [req-52c1269c-e230-46b6-9399-e9f9127c0f7d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '082bba36-0704-48ec-9a80-28d414ddd11b'... >2018-07-11 08:43:43.020 23 INFO octavia.controller.queue.endpoint [req-ce4d9221-8ed2-44c4-a383-f49765be2b8b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '7a65b671-8271-4c15-a798-bc31d34ac41d'... >2018-07-11 08:43:47.972 23 INFO octavia.controller.queue.endpoint [req-d4249380-b478-42d2-a50b-a59c72b239ea - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0243104c-4d9d-4a97-9b79-1218dba826d7'... >2018-07-11 08:59:05.450 23 INFO octavia.controller.queue.endpoint [req-36d0f9f4-ab0f-41ef-a0a7-3c655fd79654 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b932e212-32a8-45d9-9aad-ed1d0c9ad7ec'... >2018-07-11 08:59:16.098 23 INFO octavia.controller.queue.endpoint [req-7a45d8f3-6e24-4c80-b707-6278cd73688c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '8a35b956-08d5-458b-8ad9-7b8815cb2e1c'... >2018-07-11 08:59:26.132 23 INFO octavia.controller.queue.endpoint [req-fb150df9-0be3-479b-b13d-00f76bc694f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2a256c6c-af0d-48e8-89bf-5f0d219dec92'... >2018-07-11 08:59:47.312 23 INFO octavia.controller.queue.endpoint [req-2a926ad0-c442-4208-b401-de076f5e37ba - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9eb88453-f65a-4497-872d-300e73ae175c'... >2018-07-11 08:59:54.118 23 INFO octavia.controller.queue.endpoint [req-4ef2a990-a6b3-4f20-bd3f-fe80738ae9bf - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '98e3aeac-e7b8-4223-808c-f9040c9e58b5'... >2018-07-11 08:59:59.545 23 INFO octavia.controller.queue.endpoint [req-bc3abc0b-b0ac-4413-b436-8f4a7cba5152 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b79e1f11-f868-4e82-9825-f5cf41065480'... >2018-07-11 09:00:06.742 23 INFO octavia.controller.queue.endpoint [req-07bc403e-bcc2-49f8-a143-8af8e3ff5ece - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '46a13920-fc05-4042-987f-f9d88f15f9f0'... >2018-07-11 09:00:11.119 23 INFO octavia.controller.queue.endpoint [req-54c3d9c0-92cd-4b61-b330-f3c7d69d7a1d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1e30b1b7-31a8-4473-aea2-8512e14f63ba'... >2018-07-11 09:00:14.561 23 INFO octavia.controller.queue.endpoint [req-4ca320c3-6982-4654-a1b4-5f0be402a20f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4749d9c4-9e93-475e-a511-10a22cce40a9'... >2018-07-11 09:02:56.225 23 INFO octavia.controller.queue.endpoint [req-2c8fcbdb-0746-433b-bfd2-028d9eabc7dd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '6d6b2155-9e74-440e-9bff-6c1f1e44f712'... >2018-07-11 09:02:58.954 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-2c8fcbdb-0746-433b-bfd2-028d9eabc7dd - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group a98fa63b-ba21-4b8b-8a4e-348060f300fa from port 29e4821c-aeae-42fb-976b-5565b87a2ab6 >2018-07-11 09:03:00.062 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-2c8fcbdb-0746-433b-bfd2-028d9eabc7dd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group a98fa63b-ba21-4b8b-8a4e-348060f300fa >2018-07-11 09:03:20.493 23 INFO octavia.controller.queue.endpoint [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'a373dcb2-e2b4-4974-8917-0c450740d3d3'... >2018-07-11 09:03:22.576 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 96de8454-36df-4e12-aa01-5f100f60b2e1 from port 4084cd7e-aa06-494b-be20-380f6d16ad1c >2018-07-11 09:03:23.438 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 96de8454-36df-4e12-aa01-5f100f60b2e1 >2018-07-11 09:05:24.008 23 INFO octavia.controller.queue.endpoint [req-855fdebb-694e-4685-bfda-7c20c224d3b8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f1d2663d-144e-48cf-8106-b1612f2e2df7'... >2018-07-11 09:05:28.322 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-855fdebb-694e-4685-bfda-7c20c224d3b8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 6fc6c553-c986-46e1-a913-14ef1dc7763e from port aa49a583-f7df-4a68-b099-fbe49000a875 >2018-07-11 09:05:29.246 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-855fdebb-694e-4685-bfda-7c20c224d3b8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 6fc6c553-c986-46e1-a913-14ef1dc7763e >2018-07-11 09:11:19.955 23 INFO octavia.controller.queue.endpoint [req-5b0505ec-a2a7-41b0-9308-f85b47ef4af8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'bf56153a-c3e5-4403-91dc-41971a1b7cb5'... >2018-07-11 09:11:20.074 23 INFO octavia.controller.worker.tasks.database_tasks [req-5b0505ec-a2a7-41b0-9308-f85b47ef4af8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 8e7fe881-f854-4fcc-b52e-e6225ae37b46 >2018-07-11 09:11:20.151 23 INFO octavia.certificates.generator.local [req-5b0505ec-a2a7-41b0-9308-f85b47ef4af8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-11 09:11:20.151 23 INFO octavia.certificates.generator.local [req-5b0505ec-a2a7-41b0-9308-f85b47ef4af8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-11 09:11:20.152 23 INFO octavia.certificates.generator.local [req-5b0505ec-a2a7-41b0-9308-f85b47ef4af8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-11 09:11:20.152 23 INFO octavia.certificates.generator.local [req-5b0505ec-a2a7-41b0-9308-f85b47ef4af8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-11 09:11:32.858 23 INFO octavia.controller.worker.tasks.database_tasks [req-5b0505ec-a2a7-41b0-9308-f85b47ef4af8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 8e7fe881-f854-4fcc-b52e-e6225ae37b46 with compute id b2985d0f-00c4-44e2-8e0d-d5f456359f77 for load balancer: bf56153a-c3e5-4403-91dc-41971a1b7cb5 >2018-07-11 09:11:33.181 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-5b0505ec-a2a7-41b0-9308-f85b47ef4af8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 848e82e7-0280-4a47-8cf6-e3d6e5ffcf80 already exists. Nothing to be done. >2018-07-11 09:11:50.907 23 INFO octavia.controller.worker.tasks.database_tasks [req-5b0505ec-a2a7-41b0-9308-f85b47ef4af8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: bf56153a-c3e5-4403-91dc-41971a1b7cb5 >2018-07-11 09:12:02.520 23 INFO octavia.controller.queue.endpoint [req-53b40b50-a74b-4ee8-8afd-e03938577606 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '056bf3d9-c828-4399-ae52-f91e8974a737'... >2018-07-11 09:12:08.093 23 INFO octavia.controller.queue.endpoint [req-e8411fbd-d4fd-46aa-b59d-4c5036abd548 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'd89958ce-1f62-455f-b9f4-ab5c21e4def3'... >2018-07-11 09:12:13.354 23 INFO octavia.controller.queue.endpoint [req-92dac2e8-e221-4e55-b8ad-e1077ee4e371 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'e63ded29-2e49-4fb9-9276-bb4c659244a1'... >2018-07-11 09:12:18.485 23 INFO octavia.controller.queue.endpoint [req-a779f3cf-ac17-4fd5-8c6b-c2d72cfb0112 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '5d65627d-4abd-4bb8-8e43-693919b1cf4d'... >2018-07-11 09:12:24.574 23 INFO octavia.controller.queue.endpoint [req-9bb0eb8b-4b24-4fb1-8d86-b9944cdac31e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'bd281646-cb2e-4d32-aeed-e0c0969453e2'... >2018-07-11 09:12:29.762 23 INFO octavia.controller.queue.endpoint [req-2c8fcbdb-0746-433b-bfd2-028d9eabc7dd - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '156c2420-fc1e-47b3-bfb1-674f06fc96e6'... >2018-07-11 09:12:39.774 23 INFO octavia.controller.queue.endpoint [req-ee2bdfb3-778c-4fa4-9ddd-33f442447db7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'bf56153a-c3e5-4403-91dc-41971a1b7cb5'... >2018-07-11 09:12:42.036 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ee2bdfb3-778c-4fa4-9ddd-33f442447db7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group fed00429-034a-45a6-b526-6d2d96a483b1 from port 848e82e7-0280-4a47-8cf6-e3d6e5ffcf80 >2018-07-11 09:12:42.991 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ee2bdfb3-778c-4fa4-9ddd-33f442447db7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group fed00429-034a-45a6-b526-6d2d96a483b1 >2018-07-11 09:13:12.476 23 INFO octavia.controller.queue.endpoint [req-ee2bdfb3-778c-4fa4-9ddd-33f442447db7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1e30b1b7-31a8-4473-aea2-8512e14f63ba'... >2018-07-11 09:13:12.531 23 INFO octavia.controller.queue.endpoint [req-cfc8eea2-e7ea-4864-bf93-4565ecc709e1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1064e0d1-5019-44c4-b198-afc5f5960a55'... >2018-07-11 09:13:12.634 23 INFO octavia.controller.queue.endpoint [req-13b295ac-13eb-4611-937f-7f5ebd33b824 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '143a247a-b9ad-4f42-a09c-de4161584498'... >2018-07-11 09:13:55.017 23 INFO octavia.controller.queue.endpoint [req-7633ba4c-eca2-446d-827d-2f1fa29ada36 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b2bd35f0-bb7d-4f4d-b344-45e793a58137'... >2018-07-11 09:13:56.236 23 INFO octavia.controller.queue.endpoint [req-6e348e5b-30e3-4f75-828c-dcfa95b5d68f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f382a716-8367-4c59-afcb-1890f98176b8'... >2018-07-11 09:14:03.025 23 INFO octavia.controller.queue.endpoint [req-855fdebb-694e-4685-bfda-7c20c224d3b8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'be790661-ce6d-4aae-a9c3-1cdda530258b'... >2018-07-11 09:40:12.892 23 INFO octavia.controller.queue.endpoint [req-5283a777-25c5-4cf1-9040-0e69ea50937d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '118277c1-78a4-4218-b729-c5534a7760ac'... >2018-07-11 09:40:22.550 23 INFO octavia.controller.queue.endpoint [req-9722aeb6-93e5-4445-b653-824beeef289e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4b101883-ce52-465d-8bee-b58d2c2ac2db'... >2018-07-11 09:41:53.048 23 INFO octavia.controller.queue.endpoint [req-bf15f2e7-62bd-4c12-8ae7-bf5ff647fd25 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'be790661-ce6d-4aae-a9c3-1cdda530258b'... >2018-07-11 09:41:56.489 23 INFO octavia.controller.queue.endpoint [req-59291728-2a55-4456-a937-8f81d73b663b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '04a9183e-d908-41f0-b73e-3d4bbf51c7cc'... >2018-07-11 09:42:15.784 23 INFO octavia.controller.queue.endpoint [req-8d43db47-0a88-45e1-9cb8-ee44c7ab7da1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '679903f6-6083-4a70-879c-ac8bd69b1a6d'... >2018-07-11 09:42:25.528 23 INFO octavia.controller.queue.endpoint [req-1ec3e7eb-0df8-4fc8-838d-9e2d00594eeb - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '15eb1410-52f8-4eaf-9b48-61c4a736890d'... >2018-07-11 09:42:35.490 23 INFO octavia.controller.queue.endpoint [req-0cd8f0e4-1319-4cd7-8b93-bacc30dcb970 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '8729fcd0-6f00-4ab1-81be-f563c28fcf32'... >2018-07-11 09:42:42.006 23 INFO octavia.controller.queue.endpoint [req-6f1459c2-28d5-4b3f-a5fc-fa9979195244 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b79e1f11-f868-4e82-9825-f5cf41065480'... >2018-07-11 09:42:42.045 23 INFO octavia.controller.queue.endpoint [req-2ca93dcc-f532-4db1-a257-69c0b7081bec - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c711c6f4-2002-4f92-b5dd-efd336440521'... >2018-07-11 09:43:16.556 23 INFO octavia.controller.queue.endpoint [req-c92e8c09-9da4-484f-911e-df888345eff1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5fec4474-4fc2-43a8-96da-a7618030a8d3'... >2018-07-11 09:43:16.921 23 INFO octavia.controller.queue.endpoint [-] Creating member 'f43d4b40-ae56-427b-93b9-a66f5a84b07e'... >2018-07-11 09:43:17.743 23 INFO octavia.controller.queue.endpoint [req-ea360fc6-77c9-470b-8cf6-82aab3f762ef - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'fbd3d997-1976-4997-8dd4-a9e6e91c05e4'... >2018-07-11 09:47:38.513 23 INFO octavia.controller.queue.endpoint [req-7cdd64e4-802e-4877-bdeb-c3a35b532d91 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b2bd35f0-bb7d-4f4d-b344-45e793a58137'... >2018-07-11 09:47:38.582 23 INFO octavia.controller.queue.endpoint [-] Deleting member 'f382a716-8367-4c59-afcb-1890f98176b8'... >2018-07-11 09:47:38.684 23 INFO octavia.controller.queue.endpoint [req-fe3f8ecf-4547-424b-ae36-2bb56c82ca20 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '04a9183e-d908-41f0-b73e-3d4bbf51c7cc'... >2018-07-11 09:47:39.104 23 INFO octavia.controller.queue.endpoint [req-e75097ff-635c-48d8-81c6-93b4cb926ad0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '55d149f8-cacb-4f74-9f7f-7893a48984c4'... >2018-07-11 09:47:39.208 23 INFO octavia.controller.queue.endpoint [req-a29dd519-5dac-4703-a5e4-867c92e77abb - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4749d9c4-9e93-475e-a511-10a22cce40a9'... >2018-07-11 09:48:30.962 23 INFO octavia.controller.queue.endpoint [req-955edf9a-90f8-4107-82e9-5fd86548cf5b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b38a584b-a059-40a5-87eb-d734ee2bd96b'... >2018-07-11 09:48:33.597 23 INFO octavia.controller.queue.endpoint [req-dc56e60f-6359-43cc-bbfa-8bd5660fbbe0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '38708abe-2dcd-40a5-82ee-81effdb85035'... >2018-07-11 09:48:37.976 23 INFO octavia.controller.queue.endpoint [req-228afe32-038d-4201-80a1-0a11ffe8db95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'dabdbea2-aee8-41de-8d57-ea0270f24db9'... >2018-07-11 09:48:40.504 23 INFO octavia.controller.queue.endpoint [req-328516d8-473d-47ea-906c-0e030db1703b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '44d7ab6c-d15d-46fa-b98e-70a372bc9283'... >2018-07-11 09:48:40.944 23 INFO octavia.controller.queue.endpoint [req-84350fa6-3b13-45cb-adaf-04a1b377a629 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '60af3cb5-a574-4d95-b798-813a7f07171b'... >2018-07-11 09:48:43.796 23 INFO octavia.controller.queue.endpoint [req-86dc0019-7cfd-4fc6-b5ef-c6df04923c2f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9101bacc-8549-4175-958c-94e74f6c71b1'... >2018-07-11 09:51:18.270 23 INFO octavia.controller.queue.endpoint [req-27bfd204-831b-4616-ac9d-ccce08767ab8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7ce9f0ba-da92-4dc6-b486-e1b0ef7219a0'... >2018-07-11 09:51:18.350 23 INFO octavia.controller.queue.endpoint [req-baf27051-8cde-46d5-9fa1-99cae5062957 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'bc7306f5-50a1-4b43-9106-06bd62983411'... >2018-07-11 09:51:22.237 23 INFO octavia.controller.queue.endpoint [req-9c88a9bd-a83f-42a8-a242-30bc3da780fb - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a5d87df2-d692-462b-a9f4-c1902bf6274b'... >2018-07-11 09:51:23.642 23 INFO octavia.controller.queue.endpoint [req-11a7fcfd-d2a7-4091-9585-9951913bfa45 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '372c133e-3368-40e7-8ccc-93f6bd3896b2'... >2018-07-11 09:51:24.007 23 INFO octavia.controller.queue.endpoint [req-680cccba-1db5-4571-b656-b912033ed940 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4b7fb62d-69a4-4361-80bf-4937148ef4c5'... >2018-07-11 09:51:27.395 23 INFO octavia.controller.queue.endpoint [req-9da008d4-106a-466e-836b-c5ae826505d4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ada5090b-d373-44de-8d69-2e705a80274c'... >2018-07-11 09:58:18.287 23 INFO octavia.controller.queue.endpoint [req-5b0505ec-a2a7-41b0-9308-f85b47ef4af8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'fbd3d997-1976-4997-8dd4-a9e6e91c05e4'... >2018-07-11 09:58:23.258 23 INFO octavia.controller.queue.endpoint [req-abff26a6-f218-44cf-8503-8a3b4deb3b0d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'fde0fde7-01cd-4391-b6a9-d70d73c44047'... >2018-07-11 10:03:21.188 23 INFO octavia.controller.queue.endpoint [req-a4d916b3-7971-400f-848c-f0901a033230 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'dabdbea2-aee8-41de-8d57-ea0270f24db9'... >2018-07-11 10:03:24.775 23 INFO octavia.controller.queue.endpoint [req-676f1c96-096c-4d73-8bc1-54eed3b1f7f0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '50de9ee4-601c-40ae-916b-e2c84d6da926'... >2018-07-11 10:04:26.925 23 INFO octavia.controller.queue.endpoint [req-80cf0796-77ef-412e-bf10-6914beec6874 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9101bacc-8549-4175-958c-94e74f6c71b1'... >2018-07-11 10:04:31.562 23 INFO octavia.controller.queue.endpoint [req-6018c9ac-3c8b-492b-9264-f43de284c336 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4ca19fed-660d-4b9b-9203-6cdbf80e18c4'... >2018-07-11 10:06:32.329 23 INFO octavia.controller.queue.endpoint [req-6215b2b5-cf22-41cb-920d-31c8e7f03049 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c424622e-6b14-453c-b97e-c375962b41eb'... >2018-07-11 10:06:36.852 23 INFO octavia.controller.queue.endpoint [req-fdb53f34-75cd-4dbf-93d9-f578a8dead37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '85c66b75-8b21-4a2f-bf23-4482e9be224a'... >2018-07-11 10:06:38.184 23 INFO octavia.controller.queue.endpoint [req-df8f1a50-5509-434b-83af-9bf066c6ec7a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ba305912-cb20-4195-8c0c-c544585990e5'... >2018-07-11 10:06:43.503 23 INFO octavia.controller.queue.endpoint [req-7e8249ce-2b4c-450b-8aa5-9c9123cbd06d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd02f6e5a-df25-455a-893c-882f48afc6fc'... >2018-07-11 10:06:44.314 23 INFO octavia.controller.queue.endpoint [req-0ed6cd2a-60d4-4e58-8f19-c806e465425f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0c499c28-987b-4b44-acbb-e205733f61d3'... >2018-07-11 10:06:44.415 23 INFO octavia.controller.queue.endpoint [req-94b5ba05-189a-4e59-8129-93d6eac6944a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e47a7c0a-a14a-46dd-8e8a-34f26ce803f9'... >2018-07-11 10:06:44.507 23 INFO octavia.controller.queue.endpoint [req-93dc0b3b-8a1a-488b-8666-409e8eb46760 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '17b1a047-7fd6-46fb-b53b-9f8b771bb260'... >2018-07-11 10:06:48.847 23 INFO octavia.controller.queue.endpoint [req-575ec3e1-b7b5-4e19-b263-a2b955527cd6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '627809ef-8c1f-4c4c-a3db-d509b0d2575a'... >2018-07-11 10:06:49.100 23 INFO octavia.controller.queue.endpoint [req-e8f6e7b9-c23d-4243-841b-062f83554542 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c5aa071c-092e-4bf3-a619-e029c3172a4a'... >2018-07-11 10:06:49.318 23 INFO octavia.controller.queue.endpoint [req-4196a05f-dca9-4399-99b6-3e890d3b7749 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '38adead0-4d7b-4657-b296-9cce14d2445c'... >2018-07-11 10:06:49.662 23 INFO octavia.controller.queue.endpoint [req-3c12a216-c3b4-4f1e-8e07-e1d3d483aa43 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '615c3786-5981-4995-a216-a35930c634d6'... >2018-07-11 10:11:07.304 23 INFO octavia.controller.queue.endpoint [req-1ec9173e-9289-4c08-be7b-9ad9c38c37dc - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4b7fb62d-69a4-4361-80bf-4937148ef4c5'... >2018-07-11 10:11:07.355 23 INFO octavia.controller.queue.endpoint [req-4ce37f6c-e4f9-4bb0-a57b-19ad5feeedf1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '372c133e-3368-40e7-8ccc-93f6bd3896b2'... >2018-07-11 10:11:12.598 23 INFO octavia.controller.queue.endpoint [req-42cf6e92-b909-495a-9d8f-1ffbd66e47ee - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '040134a6-c751-4d79-8bc6-8abb54913506'... >2018-07-11 10:11:12.827 23 INFO octavia.controller.queue.endpoint [req-882ebb2d-da46-4ad3-bd5e-5ad2ddb61024 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '859d4801-fc42-4ea8-99f7-261fcede7c7c'... >2018-07-11 10:36:18.365 23 INFO octavia.controller.queue.endpoint [req-576f0c22-feb0-4817-8579-075d4ef89e13 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'fde0fde7-01cd-4391-b6a9-d70d73c44047'... >2018-07-11 10:36:20.517 23 INFO octavia.controller.queue.endpoint [req-3271ae3f-1ef2-4765-b059-65ae7ed0dd59 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a3d2546b-06b9-4bb1-aeaf-7f9912939b30'... >2018-07-11 10:39:17.624 23 INFO octavia.controller.queue.endpoint [req-30cf987d-0723-4589-81e4-1cae74866a0c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '50de9ee4-601c-40ae-916b-e2c84d6da926'... >2018-07-11 10:39:19.583 23 INFO octavia.controller.queue.endpoint [req-f5d0f6e4-92c3-48f4-bc62-dd87f85a7654 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3f7794d7-8328-47bf-8bd4-224fa79e7328'... >2018-07-11 10:43:24.884 23 INFO octavia.controller.queue.endpoint [req-4af5db70-f43d-4a05-b803-22f9697e1701 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4ca19fed-660d-4b9b-9203-6cdbf80e18c4'... >2018-07-11 10:43:27.461 23 INFO octavia.controller.queue.endpoint [req-36a888d7-daba-4052-b5e2-25f3927caf55 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f8d2570d-c730-44e3-a712-39b072d0c0f4'... >2018-07-11 10:51:25.252 23 INFO octavia.controller.queue.endpoint [req-de3cd3d9-ad01-4ba8-a74f-34f623148cd4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a3d2546b-06b9-4bb1-aeaf-7f9912939b30'... >2018-07-11 10:51:28.557 23 INFO octavia.controller.queue.endpoint [req-a978da2a-a51b-43f5-85b7-cd99e3507366 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9ddab562-dd38-415e-a364-d36d046932da'... >2018-07-11 10:54:25.013 23 INFO octavia.controller.queue.endpoint [req-faaf0ebe-4fd7-42ea-ac9c-020919ffb5d2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '3f7794d7-8328-47bf-8bd4-224fa79e7328'... >2018-07-11 10:54:27.764 23 INFO octavia.controller.queue.endpoint [req-4abae01d-6693-45a3-9552-933b5b7e6a12 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '586745f3-3827-46d1-9413-411238189c46'... >2018-07-11 10:58:28.887 23 INFO octavia.controller.queue.endpoint [req-b087bfef-e0f6-4e2d-b34a-b753063c6eab - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '85c66b75-8b21-4a2f-bf23-4482e9be224a'... >2018-07-11 10:58:34.128 23 INFO octavia.controller.queue.endpoint [req-0573385b-16ed-4139-8b51-3e1323df80d7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2941436f-9742-477d-acd0-ecdfdac37441'... >2018-07-11 10:58:52.051 23 INFO octavia.controller.queue.endpoint [req-6f747ca0-7578-4859-b815-0eeab989ce68 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c5aa071c-092e-4bf3-a619-e029c3172a4a'... >2018-07-11 10:58:52.150 23 INFO octavia.controller.queue.endpoint [req-c92a21f1-128c-44c4-938f-be5ddb7506a6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '615c3786-5981-4995-a216-a35930c634d6'... >2018-07-11 10:58:52.210 23 INFO octavia.controller.queue.endpoint [req-5326b838-577a-41cb-ad6e-8a4410574c80 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '38adead0-4d7b-4657-b296-9cce14d2445c'... >2018-07-11 10:58:56.955 23 INFO octavia.controller.queue.endpoint [req-a6ba3c7f-a954-449f-a35c-bc092f710974 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6513651a-bc02-489e-842e-9b64fcc58d53'... >2018-07-11 10:58:57.242 23 INFO octavia.controller.queue.endpoint [req-db9df765-2211-425b-b365-52a81d266d7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '91703b2b-f046-4922-9ccb-49566fa40088'... >2018-07-11 10:58:57.515 23 INFO octavia.controller.queue.endpoint [req-fcae6d3f-2baf-4f10-b6b6-4783bdeda548 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '43774055-631f-4129-8938-eea54ee0917e'... >2018-07-11 10:59:22.196 23 INFO octavia.controller.queue.endpoint [req-c46c836c-48f8-4bd4-8660-506405b896b7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '536653dc-1488-4757-a41d-78d2ecaeca97'... >2018-07-11 10:59:27.383 23 INFO octavia.controller.queue.endpoint [req-44220610-92f1-410f-8a23-37cc8df39404 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '49178d08-f245-4755-8b20-fce5225bf404'... >2018-07-11 10:59:32.769 23 INFO octavia.controller.queue.endpoint [req-3c85339e-6bfc-4cbb-89ae-100c50de2e2f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c30f30e3-b53a-40e0-85fc-ea1fe437c1fc'... >2018-07-11 11:17:18.740 23 INFO octavia.controller.queue.endpoint [req-1bb7e5a0-8939-4be0-85c4-1b8011738de9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9ddab562-dd38-415e-a364-d36d046932da'... >2018-07-11 11:17:24.578 23 INFO octavia.controller.queue.endpoint [req-67c41bc5-5406-489a-8c73-ff361db2a57f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd70e9b4b-32ce-4707-8d87-a8cc47716fb1'... >2018-07-11 11:19:22.453 23 INFO octavia.controller.queue.endpoint [req-276e454c-050c-4a97-ae88-e71313286e12 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '586745f3-3827-46d1-9413-411238189c46'... >2018-07-11 11:19:25.213 23 INFO octavia.controller.queue.endpoint [req-6cb15941-b9e6-4665-969b-b02b028cc9ea - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ac6f4d46-467c-4400-a1a8-5a16f22ad93a'... >2018-07-11 11:26:37.723 23 INFO octavia.controller.queue.endpoint [req-8b87cbd1-7af6-442c-b035-abcc4280da28 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '536653dc-1488-4757-a41d-78d2ecaeca97'... >2018-07-11 11:26:48.633 23 INFO octavia.controller.queue.endpoint [req-b3191446-874a-4dba-b97d-0c426bb442a6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '49178d08-f245-4755-8b20-fce5225bf404'... >2018-07-11 11:26:57.889 23 INFO octavia.controller.queue.endpoint [req-653129a6-8e4a-4e89-9b0c-300a60c640d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c30f30e3-b53a-40e0-85fc-ea1fe437c1fc'... >2018-07-11 11:27:33.129 23 INFO octavia.controller.queue.endpoint [req-27b633c9-e55f-47e3-ac29-3d14e99b803d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9b990f53-f6a2-48d7-8324-0f18eb13c54e'... >2018-07-11 11:27:38.440 23 INFO octavia.controller.queue.endpoint [req-28482d00-4bad-489f-82bb-e470709f144d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e58445d2-640c-4f95-b495-9f4bdddf0d73'... >2018-07-11 11:27:44.269 23 INFO octavia.controller.queue.endpoint [req-25fa873a-8075-4466-92aa-2aec6f98dafb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0633fc2d-1aa3-49ab-ba11-7b6bb4184d27'... >2018-07-11 11:32:19.653 23 INFO octavia.controller.queue.endpoint [req-8fc32fd5-a491-4c2d-acd0-af4f4677ea08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd70e9b4b-32ce-4707-8d87-a8cc47716fb1'... >2018-07-11 11:32:22.606 23 INFO octavia.controller.queue.endpoint [req-3c5e8adc-d51f-42f6-a266-fe7332448f49 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1a44e28a-7dd8-40e3-a564-be9efe97e82c'... >2018-07-11 11:34:19.513 23 INFO octavia.controller.queue.endpoint [req-8c6149e7-5201-48d9-a4c7-ae550fdd569e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ac6f4d46-467c-4400-a1a8-5a16f22ad93a'... >2018-07-11 11:34:22.259 23 INFO octavia.controller.queue.endpoint [req-0c517e95-c148-4ff1-85ba-a5c599b95cf3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '126933fd-60a8-4fce-b7ea-c596ca2b9e5b'... >2018-07-11 11:35:22.288 23 INFO octavia.controller.queue.endpoint [req-8c02db4a-8fbe-4b36-ab77-cef770abc04d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f8d2570d-c730-44e3-a712-39b072d0c0f4'... >2018-07-11 11:35:26.272 23 INFO octavia.controller.queue.endpoint [req-c5052e59-23dc-45da-a646-7a320847bef4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4a6401b6-2fe3-4c0b-8bb7-30870b655dcb'... >2018-07-11 11:38:44.650 23 INFO octavia.controller.queue.endpoint [req-ef5978e1-f334-45ad-8111-3d5f54ad2335 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ba305912-cb20-4195-8c0c-c544585990e5'... >2018-07-11 11:38:54.242 23 INFO octavia.controller.queue.endpoint [req-4731633c-4702-431a-a2d0-ea67c44ace1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd02f6e5a-df25-455a-893c-882f48afc6fc'... >2018-07-11 11:39:04.550 23 INFO octavia.controller.queue.endpoint [req-8d25360d-88c3-44ea-9bf8-bf45bc5ec173 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '627809ef-8c1f-4c4c-a3db-d509b0d2575a'... >2018-07-11 11:47:10.969 23 INFO octavia.controller.queue.endpoint [req-c54f0c31-e8e4-47db-a35d-f88f9be08850 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1a44e28a-7dd8-40e3-a564-be9efe97e82c'... >2018-07-11 11:47:17.294 23 INFO octavia.controller.queue.endpoint [req-971c25da-96b5-452f-873c-1702275c16b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9e2d4071-95fa-4e46-a7c2-65efc71dc0aa'... >2018-07-11 11:49:15.901 23 INFO octavia.controller.queue.endpoint [req-7e59026c-7c76-4a4f-986d-6fa2deea3143 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '126933fd-60a8-4fce-b7ea-c596ca2b9e5b'... >2018-07-11 11:49:18.569 23 INFO octavia.controller.queue.endpoint [req-297d0921-a7ed-4e83-baa0-b438e27a29bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c58546fb-08b5-4c2f-8c39-3c06f0bbf982'... >2018-07-11 11:50:18.205 23 INFO octavia.controller.queue.endpoint [req-93b352bd-ff5e-4f30-a5d3-897733933e55 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4a6401b6-2fe3-4c0b-8bb7-30870b655dcb'... >2018-07-11 11:50:20.405 23 INFO octavia.controller.queue.endpoint [req-550b9ae9-a4dc-4894-93d3-75cd8fa8f029 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b2fcf08d-5b17-466f-baa7-6e7deb1891d3'... >2018-07-11 12:00:07.618 23 INFO octavia.controller.queue.endpoint [req-028041e9-bf7b-4970-83de-747104fcd7d4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2941436f-9742-477d-acd0-ecdfdac37441'... >2018-07-11 12:00:10.717 23 INFO octavia.controller.queue.endpoint [req-a887000d-c13a-4286-8634-8efa9e93c160 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9b990f53-f6a2-48d7-8324-0f18eb13c54e'... >2018-07-11 12:00:13.158 23 INFO octavia.controller.queue.endpoint [req-c3bad624-e6b4-43df-906f-d7b6b52b0c1f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0c96e5a0-2806-4267-8250-9cb3c43099db'... >2018-07-11 12:00:21.512 23 INFO octavia.controller.queue.endpoint [req-9d6064b2-75d3-4de5-85f5-e7ca589902ab - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e58445d2-640c-4f95-b495-9f4bdddf0d73'... >2018-07-11 12:00:31.086 23 INFO octavia.controller.queue.endpoint [req-828bbeff-d61f-4a9e-8572-980a8c10d93f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0633fc2d-1aa3-49ab-ba11-7b6bb4184d27'... >2018-07-11 12:00:36.064 23 INFO octavia.controller.queue.endpoint [req-38b83836-0eb7-4eef-9020-ec7b2aa6a0c5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7f10b228-629a-4965-982d-913b13c91ea6'... >2018-07-11 12:00:41.603 23 INFO octavia.controller.queue.endpoint [req-9c751a61-3ecf-4450-bb3e-cd6be3d6db57 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1fef903b-bb85-4590-8e50-d92d1b7a7d5c'... >2018-07-11 12:00:46.642 23 INFO octavia.controller.queue.endpoint [req-ef8894ad-ce6c-4164-81cf-38fbc15e9668 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9bff1114-4cc4-4237-81f2-2cc233900eb1'... >2018-07-11 12:02:17.704 23 INFO octavia.controller.queue.endpoint [req-0093de81-dd4e-4e1b-933f-1afc1edf8292 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9e2d4071-95fa-4e46-a7c2-65efc71dc0aa'... >2018-07-11 12:02:24.968 23 INFO octavia.controller.queue.endpoint [req-a32b29da-1bbc-4697-9c4f-81574bfc41a3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0b0bd9bb-7056-4821-bffb-b73648549a15'... >2018-07-11 12:04:22.825 23 INFO octavia.controller.queue.endpoint [req-11910f66-ecd5-48c9-bf5a-02f2b6a78f54 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c58546fb-08b5-4c2f-8c39-3c06f0bbf982'... >2018-07-11 12:04:24.772 23 INFO octavia.controller.queue.endpoint [req-4972bd90-6eb2-45f0-b2ee-d1cf0586cbbc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7acf2fc1-5d27-4ba9-a2bd-3f53f7169f67'... >2018-07-11 12:05:25.591 23 INFO octavia.controller.queue.endpoint [req-d9cc3293-1c9c-49c1-b29d-b96a6b24571a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b2fcf08d-5b17-466f-baa7-6e7deb1891d3'... >2018-07-11 12:05:27.959 23 INFO octavia.controller.queue.endpoint [req-273ded4c-b741-41aa-bd44-799ba9a146c6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0f8f009f-ff7a-4527-986f-7cb5823335de'... >2018-07-11 12:17:20.258 23 INFO octavia.controller.queue.endpoint [req-e0428556-db84-44cd-9340-58959b8db1a9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0b0bd9bb-7056-4821-bffb-b73648549a15'... >2018-07-11 12:17:22.693 23 INFO octavia.controller.queue.endpoint [req-ca5e4e4a-8cd3-4771-8fb4-8864a306f24d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd3e799df-a1a6-4269-b8c0-5c9f18a13607'... >2018-07-11 12:26:04.592 23 INFO octavia.controller.queue.endpoint [req-949aa16c-0ab0-45e4-8525-ae1bdf816157 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '6513651a-bc02-489e-842e-9b64fcc58d53'... >2018-07-11 12:26:04.643 23 INFO octavia.controller.queue.endpoint [req-e68823b3-d256-4368-8ea6-f7aa1a264401 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '43774055-631f-4129-8938-eea54ee0917e'... >2018-07-11 12:26:04.736 23 INFO octavia.controller.queue.endpoint [req-4db3d6dd-2baf-4825-93fb-93b7505a56bf - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '91703b2b-f046-4922-9ccb-49566fa40088'... >2018-07-11 12:26:05.149 23 INFO octavia.controller.queue.endpoint [req-8d66de9e-1def-425d-9c6e-f1a8739c9336 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0c96e5a0-2806-4267-8250-9cb3c43099db'... >2018-07-11 12:26:09.773 23 INFO octavia.controller.queue.endpoint [req-66044e33-c51d-4bff-b10e-679147795e5d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4ba5b6c9-3be2-417a-ad9d-c1d8914c2953'... >2018-07-11 12:26:10.024 23 INFO octavia.controller.queue.endpoint [req-d247451d-6b9b-467b-981b-90a0a3edf10d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6e975429-467c-4533-bdc6-aa174af0db47'... >2018-07-11 12:26:10.236 23 INFO octavia.controller.queue.endpoint [req-c8b9d317-95a9-4a42-ba27-e79c1b26d67f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd9ebbd6f-f216-4057-a055-d627135764bb'... >2018-07-11 12:26:10.514 23 INFO octavia.controller.queue.endpoint [req-a3a3b3fa-2697-4cd1-9186-1bfcf708f989 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b36f5b1b-d394-48e9-ac44-1fa8bde4b843'... >2018-07-11 12:26:25.519 23 INFO octavia.controller.queue.endpoint [req-da8031d4-12fb-40a0-b3e8-09e308e16f1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7f10b228-629a-4965-982d-913b13c91ea6'... >2018-07-11 12:26:35.697 23 INFO octavia.controller.queue.endpoint [req-91b1bfc2-c159-49f5-b3fc-86bd78a30c99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1fef903b-bb85-4590-8e50-d92d1b7a7d5c'... >2018-07-11 12:26:46.012 23 INFO octavia.controller.queue.endpoint [req-cf1e3c42-bb5f-4ac7-8a3b-9a1121b3954d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9bff1114-4cc4-4237-81f2-2cc233900eb1'... >2018-07-11 12:26:51.281 23 INFO octavia.controller.queue.endpoint [req-c9d3ec35-93f7-47e5-a780-4ae025ccaaae - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '38f84fe5-62d5-4206-91cb-ffac7a45ab5a'... >2018-07-11 12:26:56.568 23 INFO octavia.controller.queue.endpoint [req-48b3a5ec-c6fa-462d-b4c0-83c44f69c340 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '552eabe8-7599-4405-81a4-5c40df213edd'... >2018-07-11 12:27:01.753 23 INFO octavia.controller.queue.endpoint [req-a66fe365-4324-48e6-9676-d06dac994128 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '642961cd-3017-4b3f-8798-2786d42b7611'... >2018-07-11 12:27:05.949 23 INFO octavia.controller.queue.endpoint [req-3ee341a5-1e5b-4b1e-94d5-12f48ccf851e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '09ff3606-5823-4e01-9098-5255ec1db0e3'... >2018-07-11 12:27:11.079 23 INFO octavia.controller.queue.endpoint [req-aea3bc2e-a0a7-4d68-a442-b04b2945041e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e60e7db1-9636-46c0-a458-bb0ecc1ae9dc'... >2018-07-11 12:27:16.756 23 INFO octavia.controller.queue.endpoint [req-95b3033a-0980-4cbc-9cd2-e832ace4dd1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a9fa37b4-1e3d-4f40-86f7-f7b1ae48b07f'... >2018-07-11 12:32:16.366 23 INFO octavia.controller.queue.endpoint [req-cd0ba5e7-6c80-43fb-92b0-27d7a9085280 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd3e799df-a1a6-4269-b8c0-5c9f18a13607'... >2018-07-11 12:32:19.070 23 INFO octavia.controller.queue.endpoint [req-0bbd9783-a3be-49e2-baec-b07c572b601e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e3d9af16-ef76-4231-9a36-d11bc45adf6e'... >2018-07-11 12:34:19.724 23 INFO octavia.controller.queue.endpoint [req-1a7391ec-89be-4f29-a770-b782c3e5f880 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7acf2fc1-5d27-4ba9-a2bd-3f53f7169f67'... >2018-07-11 12:34:22.525 23 INFO octavia.controller.queue.endpoint [req-8e17d2f1-f469-42f8-a69e-5eefea53f037 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1976ed97-a975-4841-8f41-7ba99c134920'... >2018-07-11 12:35:21.857 23 INFO octavia.controller.queue.endpoint [req-6eaca140-dcda-4899-806b-256ed1786020 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0f8f009f-ff7a-4527-986f-7cb5823335de'... >2018-07-11 12:35:26.742 23 INFO octavia.controller.queue.endpoint [req-5f79b771-6401-429a-9288-22ccd40a64e1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '04a7a756-60fe-4a62-873c-d0cb817e50b9'... >2018-07-11 12:41:36.673 23 INFO octavia.controller.queue.endpoint [req-166c8824-7cce-42a8-afeb-fa2b9296c25f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '38f84fe5-62d5-4206-91cb-ffac7a45ab5a'... >2018-07-11 12:41:46.162 23 INFO octavia.controller.queue.endpoint [req-3663d3b0-401f-41f1-a11c-bdecb2a5591d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '552eabe8-7599-4405-81a4-5c40df213edd'... >2018-07-11 12:41:56.491 23 INFO octavia.controller.queue.endpoint [req-a831859a-ed08-46b2-8602-f2fe6ad6cc42 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '642961cd-3017-4b3f-8798-2786d42b7611'... >2018-07-11 12:47:18.076 23 INFO octavia.controller.queue.endpoint [req-896ed336-7691-479c-9e39-857a929bc050 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e3d9af16-ef76-4231-9a36-d11bc45adf6e'... >2018-07-11 12:47:24.547 23 INFO octavia.controller.queue.endpoint [req-2a45289d-4273-4553-b1e4-01f8c9e4e768 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '46aaa77f-1e30-4a20-a810-6ff66b4cf413'... >2018-07-11 12:49:17.934 23 INFO octavia.controller.queue.endpoint [req-eeca93a6-05fd-466d-85b1-63e5bdd9c958 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1976ed97-a975-4841-8f41-7ba99c134920'... >2018-07-11 12:49:23.171 23 INFO octavia.controller.queue.endpoint [req-6202ce5e-73ea-4454-92c0-4ef8df50321a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'dc5ade26-ee5f-4bdf-a312-7e435601c3dc'... >2018-07-11 12:50:18.463 23 INFO octavia.controller.queue.endpoint [req-a9c5934e-8668-4e70-8e57-2af8ffd11393 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '04a7a756-60fe-4a62-873c-d0cb817e50b9'... >2018-07-11 12:50:20.623 23 INFO octavia.controller.queue.endpoint [req-bffb8f0d-b943-48ae-9d4e-d6a1accf48ca - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'bc0f6625-896c-41f0-9cae-ae75de4c8b86'... >2018-07-11 13:02:20.208 23 INFO octavia.controller.queue.endpoint [req-2c8d0294-45aa-4218-a794-0a716a14b3f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '46aaa77f-1e30-4a20-a810-6ff66b4cf413'... >2018-07-11 13:02:23.049 23 INFO octavia.controller.queue.endpoint [req-7d23d585-2765-4f9b-855d-63a8dde9dafb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd6feeced-0b3a-4aab-bc61-e0c415031167'... >2018-07-11 13:04:18.981 23 INFO octavia.controller.queue.endpoint [req-ae1f03af-ade5-4945-b31a-4f260f731156 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'dc5ade26-ee5f-4bdf-a312-7e435601c3dc'... >2018-07-11 13:04:25.086 23 INFO octavia.controller.queue.endpoint [req-0afd4a0f-8f54-41d7-a412-5afb02358f67 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ee7d9849-f260-4a8a-bd81-fe9867acf5c2'... >2018-07-11 13:05:25.650 23 INFO octavia.controller.queue.endpoint [req-a188e110-e819-4e1b-9f10-c62de82d82d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'bc0f6625-896c-41f0-9cae-ae75de4c8b86'... >2018-07-11 13:05:27.751 23 INFO octavia.controller.queue.endpoint [req-47eb868d-ed52-4d42-970f-60f517183771 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '65d4f845-2590-471c-8f74-5ddefb6add31'... >2018-07-11 13:17:18.554 23 INFO octavia.controller.queue.endpoint [req-b947a922-b6e2-4412-bc29-b49d2c96e226 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd6feeced-0b3a-4aab-bc61-e0c415031167'... >2018-07-11 13:17:22.479 23 INFO octavia.controller.queue.endpoint [req-90003dd1-e3f3-4199-9b0d-0776615bc27c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ccda38ef-5215-4ede-ba56-f274065ffb67'... >2018-07-11 13:23:33.901 23 INFO octavia.controller.queue.endpoint [req-d9e22ac8-c745-4509-8b5d-e5a695482de5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '6e975429-467c-4533-bdc6-aa174af0db47'... >2018-07-11 13:23:34.980 23 INFO octavia.controller.queue.endpoint [req-a0b6ecde-e91a-441d-8331-b5255d6defdd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd9ebbd6f-f216-4057-a055-d627135764bb'... >2018-07-11 13:23:35.104 23 INFO octavia.controller.queue.endpoint [req-1c99bba6-acee-4c24-9779-5aebdd762b1c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b36f5b1b-d394-48e9-ac44-1fa8bde4b843'... >2018-07-11 13:23:35.171 23 INFO octavia.controller.queue.endpoint [req-0289896a-9563-4a36-b892-e3881ddcb11c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4ba5b6c9-3be2-417a-ad9d-c1d8914c2953'... >2018-07-11 13:23:38.482 23 INFO octavia.controller.queue.endpoint [req-d6efb90f-5450-40e7-8a8c-f47fd9c8ff7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'fe23cf4d-eeb3-4292-9c3e-0257bce0f4b6'... >2018-07-11 13:23:39.453 23 INFO octavia.controller.queue.endpoint [req-ad9554c3-e4f3-40f3-b2e4-169220b84d50 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '87b4c64c-5bba-4254-a44f-0c542faf5c62'... >2018-07-11 13:23:39.927 23 INFO octavia.controller.queue.endpoint [req-7c224a3a-1a0f-4c44-82f2-306c4d1c9d3c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '06630934-588d-4e43-825c-350d8cbf9e2d'... >2018-07-11 13:23:40.456 23 INFO octavia.controller.queue.endpoint [req-d551f43d-25e0-4a6b-83a9-f021b9cc0b7f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4d148bbe-f12c-4181-a42c-e45993deb4a5'... >2018-07-11 13:23:47.649 23 INFO octavia.controller.queue.endpoint [req-01cea46a-7898-4452-9a73-afb1c938f8ed - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '09ff3606-5823-4e01-9098-5255ec1db0e3'... >2018-07-11 13:23:57.424 23 INFO octavia.controller.queue.endpoint [req-f13f893c-3e75-484b-8b4a-75760d2390b6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e60e7db1-9636-46c0-a458-bb0ecc1ae9dc'... >2018-07-11 13:24:07.830 23 INFO octavia.controller.queue.endpoint [req-baa5be1b-b179-4229-aec9-c91d160b6879 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a9fa37b4-1e3d-4f40-86f7-f7b1ae48b07f'... >2018-07-11 13:24:29.484 23 INFO octavia.controller.queue.endpoint [req-b4a20b84-dae2-4acc-b2bc-b04a143c7563 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '38ba515a-4221-4302-aef7-3d1ff88f8cd3'... >2018-07-11 13:24:34.347 23 INFO octavia.controller.queue.endpoint [req-e713828d-bfdd-420f-9917-dd00cf664336 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5dbbf6f4-96c3-4bd9-94ad-00a2249b8714'... >2018-07-11 13:24:39.587 23 INFO octavia.controller.queue.endpoint [req-11920f43-479f-455d-a82a-186551d6fb61 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8fdfeec3-91c2-4180-87e6-9e65388f741a'... >2018-07-11 13:32:23.993 23 INFO octavia.controller.queue.endpoint [req-baff6cb3-8d2d-41eb-8164-90e65cd90c88 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ccda38ef-5215-4ede-ba56-f274065ffb67'... >2018-07-11 13:32:27.801 23 INFO octavia.controller.queue.endpoint [req-4b76f44a-1bc1-4515-8b94-20b0df1c5928 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a937991b-70a7-435f-bc36-ae39dbfe26a5'... >2018-07-11 13:46:21.123 23 INFO octavia.controller.queue.endpoint [req-a75ea08f-dc99-4c90-a9a9-e7dc14068bc2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ee7d9849-f260-4a8a-bd81-fe9867acf5c2'... >2018-07-11 13:46:22.872 23 INFO octavia.controller.queue.endpoint [req-5db52e9f-5760-4ccc-9d64-78142a74c034 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '022f8297-9102-4409-ab30-97943354b1e4'... >2018-07-11 13:47:20.863 23 INFO octavia.controller.queue.endpoint [req-6b14eb0d-c177-47d9-8de6-77c6aaccb69d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a937991b-70a7-435f-bc36-ae39dbfe26a5'... >2018-07-11 13:47:21.970 23 INFO octavia.controller.queue.endpoint [req-f5a7576f-00b5-49e5-9cdb-a86838003c8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '65d4f845-2590-471c-8f74-5ddefb6add31'... >2018-07-11 13:47:23.429 23 INFO octavia.controller.queue.endpoint [req-0630d7b7-473e-4708-b6a9-867707eb56b5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '60c7705f-ccb2-4c3b-ab4e-0a9dbad68fcf'... >2018-07-11 13:47:25.433 23 INFO octavia.controller.queue.endpoint [req-5907b198-e3ad-4e24-a776-4c2433009348 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c6b5ca23-271a-4974-b4d9-752aa3fd4604'... >2018-07-11 14:01:13.038 23 INFO octavia.controller.queue.endpoint [req-f2763234-4ce0-4fa9-97b3-66c9f9bf7664 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '022f8297-9102-4409-ab30-97943354b1e4'... >2018-07-11 14:01:22.752 23 INFO octavia.controller.queue.endpoint [req-7ee889db-b51e-46f7-b338-4f3ca3952d4f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ea0fb839-1807-41d9-ac12-1daabfca8d06'... >2018-07-11 14:02:18.443 23 INFO octavia.controller.queue.endpoint [req-448f4ee3-a51f-40a6-a045-3d8c64fa9a38 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '60c7705f-ccb2-4c3b-ab4e-0a9dbad68fcf'... >2018-07-11 14:02:28.293 23 INFO octavia.controller.queue.endpoint [req-824b8d7d-15ea-4c43-90be-a9a1c1f083f6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c6b5ca23-271a-4974-b4d9-752aa3fd4604'... >2018-07-11 14:16:25.608 23 INFO octavia.controller.queue.endpoint [req-b868e4c3-07b9-4009-8567-83222ea2e501 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ea0fb839-1807-41d9-ac12-1daabfca8d06'... >2018-07-11 14:16:30.439 23 INFO octavia.controller.queue.endpoint [req-465504ca-0567-4d52-b94e-41c6fcb3cafe - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7e68c92b-d307-41df-9893-9f8973e2d950'... >2018-07-11 14:17:27.254 23 INFO octavia.controller.queue.endpoint [req-2deec50e-580c-4a5b-8f4a-9de5bfd6be8b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7ba35841-ec22-49c2-9fe3-bbe47b89201e'... >2018-07-11 14:17:32.902 23 INFO octavia.controller.queue.endpoint [req-56cabbde-a4fc-4770-a675-741bc3c451a4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '96015618-2991-48c2-a43c-35af267b0ad8'... >2018-07-11 14:23:39.799 23 INFO octavia.controller.queue.endpoint [req-dd8e31d9-a742-4c11-a03e-8bceb3d0a0e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'fe23cf4d-eeb3-4292-9c3e-0257bce0f4b6'... >2018-07-11 14:23:44.863 23 INFO octavia.controller.queue.endpoint [req-34254404-2109-4a1f-a09d-1f80f3183ac5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '39970ada-61f0-46e4-95e7-c9d53c749106'... >2018-07-11 14:24:00.101 23 INFO octavia.controller.queue.endpoint [req-819cf86e-ad40-42e7-a9a2-ddbfeb362736 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '87b4c64c-5bba-4254-a44f-0c542faf5c62'... >2018-07-11 14:24:00.155 23 INFO octavia.controller.queue.endpoint [req-abaf1fea-027a-49e0-95b9-aa29364dc97c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4d148bbe-f12c-4181-a42c-e45993deb4a5'... >2018-07-11 14:24:00.227 23 INFO octavia.controller.queue.endpoint [req-0b8aaec7-80dd-4dff-a8c4-46ba088f1c64 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '06630934-588d-4e43-825c-350d8cbf9e2d'... >2018-07-11 14:24:04.993 23 INFO octavia.controller.queue.endpoint [req-4c177f70-723a-44e2-9f9a-7ee0f98d40a6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e254e6e7-f7f2-471c-8b6e-77c8f38f9017'... >2018-07-11 14:24:05.510 23 INFO octavia.controller.queue.endpoint [req-15be350b-0408-4754-8c71-498a6437c1a9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'fa288727-bb99-4483-ac0d-3c1149aefaf3'... >2018-07-11 14:24:05.811 23 INFO octavia.controller.queue.endpoint [req-6ea085d8-6e04-40ca-8eff-c5ad2e5367bd - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3e3fcbfb-346e-4651-9008-ae3e54a42d04'... >2018-07-11 14:25:16.902 23 INFO octavia.controller.queue.endpoint [req-9a37c2f7-32b2-4564-82e5-ab6f5114721f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '656d1572-5380-4cee-ad1c-8e36dfb5d61d'... >2018-07-11 14:25:22.188 23 INFO octavia.controller.queue.endpoint [req-bf9f9037-be32-475f-9e85-3b98a85a6b4c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cca17a1e-ee9f-42bd-8703-2ff48ad4e30c'... >2018-07-11 14:25:27.300 23 INFO octavia.controller.queue.endpoint [req-bc7a040f-840d-45e8-a361-e1fbc7d1dd20 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2b944c51-4a4e-4b6a-a3c4-c42168e7fa4b'... >2018-07-11 14:32:23.544 23 INFO octavia.controller.queue.endpoint [req-0e855c65-a937-477b-9588-53e7e09693bb - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '96015618-2991-48c2-a43c-35af267b0ad8'... >2018-07-11 14:32:27.497 23 INFO octavia.controller.queue.endpoint [req-1f82d4fd-7a5d-4446-a96b-528b17342bd4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '26e51455-d523-49ca-aa47-2bcc53e6da36'... >2018-07-11 14:38:41.084 23 INFO octavia.controller.queue.endpoint [req-29d7fc59-0888-4e03-a966-5230ed07e713 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '38ba515a-4221-4302-aef7-3d1ff88f8cd3'... >2018-07-11 14:38:51.809 23 INFO octavia.controller.queue.endpoint [req-60a39955-4575-407d-b61c-cfdb98482828 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5dbbf6f4-96c3-4bd9-94ad-00a2249b8714'... >2018-07-11 14:39:01.991 23 INFO octavia.controller.queue.endpoint [req-12cf6b93-e86b-45e8-9574-0903855fccf4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '8fdfeec3-91c2-4180-87e6-9e65388f741a'... >2018-07-11 14:42:16.324 23 INFO octavia.controller.queue.endpoint [req-653c9e50-25a2-4189-8eff-734639daa273 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7e68c92b-d307-41df-9893-9f8973e2d950'... >2018-07-11 14:42:21.670 23 INFO octavia.controller.queue.endpoint [req-af15b2d8-9239-441e-87ee-40a7239b3a7d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7ba35841-ec22-49c2-9fe3-bbe47b89201e'... >2018-07-11 14:42:25.364 23 INFO octavia.controller.queue.endpoint [req-b41427fe-b8df-466d-ab10-c3737e51aae6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3eda7d47-0360-4dc7-a84b-1c194eaaff52'... >2018-07-11 14:42:30.538 23 INFO octavia.controller.queue.endpoint [req-9570e422-c219-4a4e-b2fc-9404619542e2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5e58ee1f-f3db-46aa-9634-4345984dea9e'... >2018-07-11 14:47:14.926 23 INFO octavia.controller.queue.endpoint [req-7f236a36-0129-40c7-bd17-200564471447 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '26e51455-d523-49ca-aa47-2bcc53e6da36'... >2018-07-11 14:47:23.309 23 INFO octavia.controller.queue.endpoint [req-3b2171f4-c049-45b0-9172-42d066869a9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'daf78859-5eda-492b-9891-8c27007b28d3'... >2018-07-11 14:57:14.389 23 INFO octavia.controller.queue.endpoint [req-d943185d-4b60-4886-8f58-cd1656c2f2e4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5e58ee1f-f3db-46aa-9634-4345984dea9e'... >2018-07-11 14:57:18.299 23 INFO octavia.controller.queue.endpoint [req-26fff5dc-e909-4ed1-8548-31a26d1d4448 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '3eda7d47-0360-4dc7-a84b-1c194eaaff52'... >2018-07-11 14:57:21.105 23 INFO octavia.controller.queue.endpoint [req-3d2d3bae-902c-4696-b8fb-85b73df9fc5e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'adf71c3b-c0dd-4bfd-84c9-646e7eb65845'... >2018-07-11 14:57:27.205 23 INFO octavia.controller.queue.endpoint [req-cd6c805a-5b82-4bee-87f1-93f6ff2be6e4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6b853ece-5bfa-4710-b085-7d61c81510d5'... >2018-07-11 15:02:21.209 23 INFO octavia.controller.queue.endpoint [req-91e25490-b122-4729-9c48-c813832c653d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'daf78859-5eda-492b-9891-8c27007b28d3'... >2018-07-11 15:02:27.530 23 INFO octavia.controller.queue.endpoint [req-e45a486b-23f0-45d0-8d69-bd216580a4d3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2ca5cba8-65bb-4e19-bbe4-8b47a94f50a9'... >2018-07-11 15:12:20.879 23 INFO octavia.controller.queue.endpoint [req-8353afdb-20b4-4124-ba28-4e71fdafafdd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'adf71c3b-c0dd-4bfd-84c9-646e7eb65845'... >2018-07-11 15:12:25.316 23 INFO octavia.controller.queue.endpoint [req-0695b666-9134-4c08-a002-d359b38c2500 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '6b853ece-5bfa-4710-b085-7d61c81510d5'... >2018-07-11 15:12:27.255 23 INFO octavia.controller.queue.endpoint [req-1e33d104-e545-49c0-9bbe-07b77a78bf8a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b9c9faae-6b01-40eb-8fd5-bb6b0e044c5b'... >2018-07-11 15:12:28.500 23 INFO octavia.controller.queue.endpoint [req-ab73cc24-000b-43df-9a53-6b39bd817c32 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a2ce0f65-f6fb-4e8c-adf0-8fee315215df'... >2018-07-11 15:17:24.743 23 INFO octavia.controller.queue.endpoint [req-3a334800-9227-477a-9dbe-2b55eaad8f77 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2ca5cba8-65bb-4e19-bbe4-8b47a94f50a9'... >2018-07-11 15:17:26.766 23 INFO octavia.controller.queue.endpoint [req-935d634b-fb50-4157-bb75-cd3d0895fdcf - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8c37b83f-30db-4c13-a321-ce5096b31948'... >2018-07-11 15:27:17.696 23 INFO octavia.controller.queue.endpoint [req-a5f88499-307c-4b2a-85ca-e9347cf182df - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b9c9faae-6b01-40eb-8fd5-bb6b0e044c5b'... >2018-07-11 15:27:22.181 23 INFO octavia.controller.queue.endpoint [req-f189c0c7-2baa-4687-9100-c79de3c3513d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a2ce0f65-f6fb-4e8c-adf0-8fee315215df'... >2018-07-11 15:27:24.123 23 INFO octavia.controller.queue.endpoint [req-b25d3b10-551c-491c-b2d9-f4bd166a4e99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f8e4eaeb-8391-4b85-81ee-8c40e09e6212'... >2018-07-11 15:27:25.399 23 INFO octavia.controller.queue.endpoint [req-ca3abb44-7bdf-477d-bfca-144df73dbf28 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '20d64f8e-0857-48d3-b2d9-d7433ab9b91a'... >2018-07-11 15:28:59.894 23 INFO octavia.controller.queue.endpoint [req-7badab83-7a16-4496-8c22-3a922e4e5908 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '39970ada-61f0-46e4-95e7-c9d53c749106'... >2018-07-11 15:29:02.588 23 INFO octavia.controller.queue.endpoint [req-456a17cd-a1fa-4cf5-a3f3-b9363094003e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '3e3fcbfb-346e-4651-9008-ae3e54a42d04'... >2018-07-11 15:29:02.675 23 INFO octavia.controller.queue.endpoint [req-c7019884-8df8-4afa-a07c-39b9a48e2a07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e254e6e7-f7f2-471c-8b6e-77c8f38f9017'... >2018-07-11 15:29:02.747 23 INFO octavia.controller.queue.endpoint [req-40f32c16-9351-4964-ad43-515ce8b2fc66 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'fa288727-bb99-4483-ac0d-3c1149aefaf3'... >2018-07-11 15:29:05.416 23 INFO octavia.controller.queue.endpoint [req-ec43b624-3d1c-4e7b-a3a0-735e5697f520 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd3e59174-440f-4896-b856-e31f2f9429bc'... >2018-07-11 15:29:07.484 23 INFO octavia.controller.queue.endpoint [req-6d9eae75-cdc5-4a43-9457-ff157a779868 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2d675f6b-3548-4502-bfb3-8d0d98c78154'... >2018-07-11 15:29:07.889 23 INFO octavia.controller.queue.endpoint [req-7a67b871-f304-4e2c-8752-8e5365273c1f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2d5461a0-eaf1-4ebb-873f-469d2d4cd29a'... >2018-07-11 15:29:08.176 23 INFO octavia.controller.queue.endpoint [req-3f8179ab-0f62-4f4f-94b2-de17b1ba93ef - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c411cadd-9142-406c-8b5f-9f291f363840'... >2018-07-11 15:29:13.944 23 INFO octavia.controller.queue.endpoint [req-29b3bf0f-65d3-40e0-a67c-14adaa20b186 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '656d1572-5380-4cee-ad1c-8e36dfb5d61d'... >2018-07-11 15:29:24.336 23 INFO octavia.controller.queue.endpoint [req-2cebde59-a2db-4351-b660-f553efa85524 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cca17a1e-ee9f-42bd-8703-2ff48ad4e30c'... >2018-07-11 15:29:34.513 23 INFO octavia.controller.queue.endpoint [req-a4219661-1f7d-4b45-a3a6-754014cfc8cf - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2b944c51-4a4e-4b6a-a3c4-c42168e7fa4b'... >2018-07-11 15:29:39.668 23 INFO octavia.controller.queue.endpoint [req-a69561a5-6d81-448a-929b-7b004f152212 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '64bfbc83-bf4d-4f38-a34c-8ea39f5f9f8f'... >2018-07-11 15:29:45.493 23 INFO octavia.controller.queue.endpoint [req-ed8e3081-837e-4d90-b9ea-7526e72404a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c2aa489f-09b1-4cb2-8437-68a943c396c7'... >2018-07-11 15:29:50.964 23 INFO octavia.controller.queue.endpoint [req-9e8efdbf-6abd-421c-8f15-d94a0b1586c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'be3c253c-1f9d-4b83-bd76-35aa6535be78'... >2018-07-11 15:30:37.661 23 INFO octavia.controller.queue.endpoint [req-c3ea7509-1ca2-4356-bdda-09063e74fb8f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a9bca9a6-6adf-42cf-aaab-e73a3d60d865'... >2018-07-11 15:30:42.841 23 INFO octavia.controller.queue.endpoint [req-c234cc05-d595-48ad-9147-1c15f332ebdb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1c991e5b-a6ff-4ebb-b7ca-028ef974e84b'... >2018-07-11 15:30:48.102 23 INFO octavia.controller.queue.endpoint [req-b81f0de0-6a89-457f-b646-8fdfc34299f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cac7c1a2-be4d-4322-8bdc-687ec1209991'... >2018-07-11 15:42:14.622 23 INFO octavia.controller.queue.endpoint [req-0673011e-e75a-43a7-a3fd-9c1424b4ced5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '20d64f8e-0857-48d3-b2d9-d7433ab9b91a'... >2018-07-11 15:42:19.062 23 INFO octavia.controller.queue.endpoint [req-61604b48-08dd-432f-b684-2e7f45328248 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f8e4eaeb-8391-4b85-81ee-8c40e09e6212'... >2018-07-11 15:42:21.473 23 INFO octavia.controller.queue.endpoint [req-e04b71b7-dee0-40f1-9477-b6a6d321445b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4dca7d5e-11b6-4c45-844c-c6b162fb3076'... >2018-07-11 15:42:26.600 23 INFO octavia.controller.queue.endpoint [req-fdea17e6-5a29-468a-a131-b77a5ac87d5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4f12c88c-e92c-491b-8786-1024d75042c4'... >2018-07-11 15:44:39.555 23 INFO octavia.controller.queue.endpoint [req-b8488896-8972-47b1-9ead-861202a0bb94 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a9bca9a6-6adf-42cf-aaab-e73a3d60d865'... >2018-07-11 15:44:48.306 23 INFO octavia.controller.queue.endpoint [req-cfa1147b-238a-4f1b-bccd-1b03cbd3e1eb - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1c991e5b-a6ff-4ebb-b7ca-028ef974e84b'... >2018-07-11 15:44:58.182 23 INFO octavia.controller.queue.endpoint [req-bad0373f-4e2e-49a8-9308-41f9896b0fa7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cac7c1a2-be4d-4322-8bdc-687ec1209991'... >2018-07-11 15:57:16.550 23 INFO octavia.controller.queue.endpoint [req-dfa8c766-9173-42bf-a449-6d46f1e00093 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4f12c88c-e92c-491b-8786-1024d75042c4'... >2018-07-11 15:57:19.531 23 INFO octavia.controller.queue.endpoint [req-872a428b-5b52-4e4f-8553-58f5c9ce7f38 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1b43c30f-b29a-445b-8473-772671de24ee'... >2018-07-11 15:57:21.843 23 INFO octavia.controller.queue.endpoint [req-79ef4ba9-6de8-4620-b885-7330845c7019 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4dca7d5e-11b6-4c45-844c-c6b162fb3076'... >2018-07-11 15:57:27.839 23 INFO octavia.controller.queue.endpoint [req-bb969847-3f29-4b2c-88c4-e30470a7da3e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '14e571be-4b5d-4e18-9a23-ba4473c76ece'... >2018-07-11 16:00:20.725 23 INFO octavia.controller.queue.endpoint [req-0d6ae958-f59f-4e97-bd4d-ded043635d7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '8c37b83f-30db-4c13-a321-ce5096b31948'... >2018-07-11 16:00:22.671 23 INFO octavia.controller.queue.endpoint [req-83e4bac5-0adf-4fc1-bacb-e771159f6a2f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '695d47ea-0045-40a6-a3aa-91971212e984'... >2018-07-11 16:12:22.522 23 INFO octavia.controller.queue.endpoint [req-a3046b8a-3960-47d5-9fec-77cc501e8739 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1b43c30f-b29a-445b-8473-772671de24ee'... >2018-07-11 16:12:23.626 23 INFO octavia.controller.queue.endpoint [req-8ea7983b-1612-4e70-9faa-815bd034ea12 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '14e571be-4b5d-4e18-9a23-ba4473c76ece'... >2018-07-11 16:12:25.720 23 INFO octavia.controller.queue.endpoint [req-1567798f-10fc-4c93-acb3-707d0c1aef4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c5a85f5a-0807-4202-8c36-68ff00cde383'... >2018-07-11 16:12:27.028 23 INFO octavia.controller.queue.endpoint [req-756bc3fb-6ec5-42c5-8821-0312f231fa7a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e3955500-1a9c-46b2-a934-a74c0587afd2'... >2018-07-11 16:15:12.482 23 INFO octavia.controller.queue.endpoint [req-5260f9ee-efff-4e49-9975-266a493236b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '695d47ea-0045-40a6-a3aa-91971212e984'... >2018-07-11 16:15:19.403 23 INFO octavia.controller.queue.endpoint [req-8fd42e67-65af-43bc-ba46-61796765a7de - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cb1f43d7-4a18-4f56-8aee-b1ced1ccfb3a'... >2018-07-11 16:21:47.811 23 INFO octavia.controller.queue.endpoint [req-b9a61df8-7489-4f4b-b060-524004eabd3d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2d5461a0-eaf1-4ebb-873f-469d2d4cd29a'... >2018-07-11 16:21:47.913 23 INFO octavia.controller.queue.endpoint [req-7c5906ec-9f7f-49ef-a0ca-9e7ac5af4f81 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c411cadd-9142-406c-8b5f-9f291f363840'... >2018-07-11 16:21:47.965 23 INFO octavia.controller.queue.endpoint [req-578e7ed2-dcc7-4d7d-8239-029632fb8fc9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2d675f6b-3548-4502-bfb3-8d0d98c78154'... >2018-07-11 16:21:53.055 23 INFO octavia.controller.queue.endpoint [req-5f067400-dc94-4506-94be-dee8f57e2031 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6a9039a8-f91f-4648-8352-a201a7554a11'... >2018-07-11 16:21:53.320 23 INFO octavia.controller.queue.endpoint [req-24af7b37-d0bc-45c5-b6c8-5afef343af34 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b06414d4-81b8-4516-9ab6-da44cd5a71a0'... >2018-07-11 16:21:53.542 23 INFO octavia.controller.queue.endpoint [req-582d497b-fe82-463e-8f03-5634262d07d2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '23e9ece4-4922-4b89-9a4e-1f8fbed321d7'... >2018-07-11 16:21:54.913 23 INFO octavia.controller.queue.endpoint [req-979f6873-9a27-4595-9512-5407cd03e1bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd3e59174-440f-4896-b856-e31f2f9429bc'... >2018-07-11 16:21:59.475 23 INFO octavia.controller.queue.endpoint [req-3476d086-8327-431f-a7ff-2b9085437f40 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8fc51a9a-6b71-4dca-a37f-681db12d8633'... >2018-07-11 16:23:21.025 23 INFO octavia.controller.queue.endpoint [req-8732f958-5e1f-43d4-8438-36ac1a35f821 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cf8e2688-9f63-4c3c-a823-186e5b752b71'... >2018-07-11 16:23:26.026 23 INFO octavia.controller.queue.endpoint [req-52f23cf0-1018-4c9f-956e-b2d48ef8434a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a1cc3ffb-1e1f-47cb-8d46-271efb121f46'... >2018-07-11 16:23:30.859 23 INFO octavia.controller.queue.endpoint [req-839853e5-314b-4bc6-b58f-78e896ead839 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '41a762d3-8c54-4b18-9044-765655d9f4c9'... >2018-07-11 16:46:34.621 23 INFO octavia.controller.queue.endpoint [req-325344c4-d3c5-43a9-a52b-1a487c95e411 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '64bfbc83-bf4d-4f38-a34c-8ea39f5f9f8f'... >2018-07-11 16:46:44.705 23 INFO octavia.controller.queue.endpoint [req-8fdb9519-219d-4585-baa8-4b64914db7ab - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c2aa489f-09b1-4cb2-8437-68a943c396c7'... >2018-07-11 16:46:54.336 23 INFO octavia.controller.queue.endpoint [req-6b0c2cfc-52e0-498a-9320-af8bde51dadf - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'be3c253c-1f9d-4b83-bd76-35aa6535be78'... >2018-07-11 16:51:15.174 23 INFO octavia.controller.queue.endpoint [req-b5db95b0-c912-4bf4-92b7-df7d1be295d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e3955500-1a9c-46b2-a934-a74c0587afd2'... >2018-07-11 16:51:22.553 23 INFO octavia.controller.queue.endpoint [req-a2264f4f-e44f-4643-94dc-041ea6d24fef - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '360df36f-8ea2-4228-9cf1-c67bc92029a3'... >2018-07-11 16:52:21.020 23 INFO octavia.controller.queue.endpoint [req-8b5b1d2a-f342-4bd4-9765-62565d750bf4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c5a85f5a-0807-4202-8c36-68ff00cde383'... >2018-07-11 16:52:22.795 23 INFO octavia.controller.queue.endpoint [req-398b744a-2336-4e98-9c02-5f919c237850 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '369b5967-6b5b-4fbc-b8b9-8ebfeb0c371a'... >2018-07-11 16:53:19.580 23 INFO octavia.controller.queue.endpoint [req-efb2962a-fae0-4e78-a534-ed6a28d3af85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cb1f43d7-4a18-4f56-8aee-b1ced1ccfb3a'... >2018-07-11 16:53:26.081 23 INFO octavia.controller.queue.endpoint [req-db90cf5c-c66f-4e18-b220-25327828758a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9ddc48f6-8d5e-4a92-a0f0-af3f6dda0070'... >2018-07-11 17:06:12.539 23 INFO octavia.controller.queue.endpoint [req-121c3dcc-5639-4e7c-b969-5362edd1a1b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '360df36f-8ea2-4228-9cf1-c67bc92029a3'... >2018-07-11 17:06:18.897 23 INFO octavia.controller.queue.endpoint [req-abcd4db8-e426-40e0-8fb0-99c014706b2f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f1bea878-7507-455b-bfb4-14ca222f3ef8'... >2018-07-11 17:07:18.015 23 INFO octavia.controller.queue.endpoint [req-ad1f2ff2-642e-417c-beb7-b28e35189d8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '369b5967-6b5b-4fbc-b8b9-8ebfeb0c371a'... >2018-07-11 17:07:20.794 23 INFO octavia.controller.queue.endpoint [req-b8ab3d0e-95c4-40f8-9fd9-8d45c7a2b7cb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5d93c928-dfa6-4bb0-bd83-89b5073512cf'... >2018-07-11 17:08:21.915 23 INFO octavia.controller.queue.endpoint [req-c8f1ffc3-99c0-4163-b041-026d5f7a2021 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9ddc48f6-8d5e-4a92-a0f0-af3f6dda0070'... >2018-07-11 17:08:26.248 23 INFO octavia.controller.queue.endpoint [req-da53c44b-821d-48ad-aaa9-a7a1351a26d2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a8274157-6e31-4cbd-be10-88b985bf8a96'... >2018-07-11 17:21:23.042 23 INFO octavia.controller.queue.endpoint [req-a2c67a25-9fbb-4443-8e13-60efe41f33e8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f1bea878-7507-455b-bfb4-14ca222f3ef8'... >2018-07-11 17:21:28.026 23 INFO octavia.controller.queue.endpoint [req-c63e3a3a-1d81-4700-a1e1-8a7e2eb9b098 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '875a7d61-232f-4f12-a03f-edc255389261'... >2018-07-11 17:22:36.844 23 INFO octavia.controller.queue.endpoint [req-1e634ba1-37d7-4cc5-9026-dec9d8147bbd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '8fc51a9a-6b71-4dca-a37f-681db12d8633'... >2018-07-11 17:22:42.179 23 INFO octavia.controller.queue.endpoint [req-4b375bed-29bf-469a-8563-6135332d399a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0376c0a2-1d21-4488-ab03-7fe5c88153fd'... >2018-07-11 17:23:01.248 23 INFO octavia.controller.queue.endpoint [req-486851ca-5ac6-446f-b7d5-64d4ce2d8e24 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '040134a6-c751-4d79-8bc6-8abb54913506'... >2018-07-11 17:23:01.362 23 INFO octavia.controller.queue.endpoint [req-200f5a46-7cab-4887-b823-a069dbe71fff - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '859d4801-fc42-4ea8-99f7-261fcede7c7c'... >2018-07-11 17:23:06.412 23 INFO octavia.controller.queue.endpoint [req-00be037c-6b09-4743-8a5d-142b4e4da202 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7118b998-32bc-410f-bf62-73d61cd2433d'... >2018-07-11 17:23:06.720 23 INFO octavia.controller.queue.endpoint [req-0c444a29-f57c-431d-95fb-9d37b312d2a0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5eead7d3-d75a-4187-94f8-2105c8a2bc4b'... >2018-07-11 17:23:49.107 23 INFO octavia.controller.queue.endpoint [req-0353405c-3209-43d7-8dad-3a05ae7f1f84 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '23e9ece4-4922-4b89-9a4e-1f8fbed321d7'... >2018-07-11 17:23:49.217 23 INFO octavia.controller.queue.endpoint [req-4a9faf50-53ef-4dfe-bd51-c55c0599da22 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '6a9039a8-f91f-4648-8352-a201a7554a11'... >2018-07-11 17:23:49.262 23 INFO octavia.controller.queue.endpoint [req-0dbde6b0-7ef6-4ecd-a006-4f37c268a885 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b06414d4-81b8-4516-9ab6-da44cd5a71a0'... >2018-07-11 17:23:54.223 23 INFO octavia.controller.queue.endpoint [req-3e4589c8-359f-4a13-b336-d6b053c70a39 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a6fa99fa-a887-4103-be3e-d2c2eb302f8e'... >2018-07-11 17:23:54.585 23 INFO octavia.controller.queue.endpoint [req-5dc37d68-8b73-47b5-abe0-c62dc4bb7d1e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7018b218-b2f7-49ae-9fb9-df23ea8135b6'... >2018-07-11 17:23:54.830 23 INFO octavia.controller.queue.endpoint [req-f0fdfcc2-961b-4a07-b8ba-22c3470ffe56 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4507ebbf-ebe4-41ed-b319-a7da443cddfc'... >2018-07-11 17:24:46.390 23 INFO octavia.controller.queue.endpoint [req-c06095ca-b69a-48d7-9184-218aae2c1b4b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f3147079-9ec1-49bd-8416-95e3c2d6d0d0'... >2018-07-11 17:24:51.318 23 INFO octavia.controller.queue.endpoint [req-b42aec9a-4d3c-4bd0-b832-f30a733a697f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f018cfe9-1299-40b9-8e9d-476ecd79c99d'... >2018-07-11 17:24:56.738 23 INFO octavia.controller.queue.endpoint [req-8886ca42-9151-46ab-b54d-a2eadf94b8e2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6b6a7763-e5d8-4d08-b547-ca3deb00db66'... >2018-07-11 17:33:18.882 23 INFO octavia.controller.queue.endpoint [req-19c2acce-fc8e-4782-9e49-d2c05a9ff64d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a8274157-6e31-4cbd-be10-88b985bf8a96'... >2018-07-11 17:33:20.611 23 INFO octavia.controller.queue.endpoint [req-1af7ead6-38b0-4176-8a09-ce609a004a22 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'dcb2e76c-391f-461f-a1d7-8e05b8078710'... >2018-07-11 17:35:25.950 23 INFO octavia.controller.queue.endpoint [req-8eec9928-099b-4fc7-bdb4-d91e057ff55d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5d93c928-dfa6-4bb0-bd83-89b5073512cf'... >2018-07-11 17:35:28.364 23 INFO octavia.controller.queue.endpoint [req-9b5d7ed2-6013-4457-9b39-83bfb52a20a2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0b57a4a8-26e2-40e3-80df-cd4cf89fa3f9'... >2018-07-11 17:37:38.521 23 INFO octavia.controller.queue.endpoint [req-8beb9b75-d47b-41fc-8b96-655775bbbf26 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cf8e2688-9f63-4c3c-a823-186e5b752b71'... >2018-07-11 17:37:49.044 23 INFO octavia.controller.queue.endpoint [req-565f33ac-5f93-4d05-9e6d-5048e8dd7438 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a1cc3ffb-1e1f-47cb-8d46-271efb121f46'... >2018-07-11 17:37:59.094 23 INFO octavia.controller.queue.endpoint [req-5abe344c-1298-469b-854d-e017431f123c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '41a762d3-8c54-4b18-9044-765655d9f4c9'... >2018-07-11 17:48:25.647 23 INFO octavia.controller.queue.endpoint [req-6f56dc2c-f9d0-414d-bc02-341ecbf3f31a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'dcb2e76c-391f-461f-a1d7-8e05b8078710'... >2018-07-11 17:48:27.432 23 INFO octavia.controller.queue.endpoint [req-5b6375d1-743d-4429-ba2e-6cc1f3f91869 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3e159671-1470-49e4-bf8e-bd52cfa15215'... >2018-07-11 17:50:22.415 23 INFO octavia.controller.queue.endpoint [req-eb1f9ec4-1b57-4714-99d0-66b7580da86c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0b57a4a8-26e2-40e3-80df-cd4cf89fa3f9'... >2018-07-11 17:50:25.599 23 INFO octavia.controller.queue.endpoint [req-5ba32366-6d25-4e5b-bab2-0562c9dc26eb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b0e400fd-da48-40c2-aa62-89f62c733fda'... >2018-07-11 17:51:12.097 23 INFO octavia.controller.queue.endpoint [req-0d30b31f-82a1-4054-8760-6ab7c8976a6b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '875a7d61-232f-4f12-a03f-edc255389261'... >2018-07-11 17:51:19.191 23 INFO octavia.controller.queue.endpoint [req-b889d682-0d8e-4a1d-aff3-4036a98cf64e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7d74fc4c-e01b-4754-893a-e5531056d24e'... >2018-07-11 18:03:17.399 23 INFO octavia.controller.queue.endpoint [req-af68cdee-1c50-4821-9f0d-364794d05284 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '3e159671-1470-49e4-bf8e-bd52cfa15215'... >2018-07-11 18:03:23.880 23 INFO octavia.controller.queue.endpoint [req-1011bd78-461a-484a-8557-fe088e88d387 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '18ab4ab6-f542-49d2-b213-8ce370d4157c'... >2018-07-11 18:05:19.415 23 INFO octavia.controller.queue.endpoint [req-574ecdb5-3c45-4c43-851d-e7d4af27af0d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b0e400fd-da48-40c2-aa62-89f62c733fda'... >2018-07-11 18:05:23.079 23 INFO octavia.controller.queue.endpoint [req-708601b5-9966-4868-9f9b-033455a3e579 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '587275dc-e503-4c95-8b98-5175cf101d19'... >2018-07-11 18:06:23.664 23 INFO octavia.controller.queue.endpoint [req-951d7c5c-7b99-459c-b559-77170836cd53 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7d74fc4c-e01b-4754-893a-e5531056d24e'... >2018-07-11 18:06:26.796 23 INFO octavia.controller.queue.endpoint [req-0dc84425-8be6-4038-b92e-f6de57c1af3e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '745d50c6-c721-461f-9a37-34eb849e2162'... >2018-07-11 18:20:17.114 23 INFO octavia.controller.queue.endpoint [req-873bce20-d3a0-4ba5-8e22-f7cf4eb2d14c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '587275dc-e503-4c95-8b98-5175cf101d19'... >2018-07-11 18:20:19.413 23 INFO octavia.controller.queue.endpoint [req-12991b51-b1f7-498e-958e-606f70206e08 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd8fd275e-1930-4c75-aeaf-133504836520'... >2018-07-11 18:22:59.568 23 INFO octavia.controller.queue.endpoint [req-451d427e-05d0-44a9-bb4d-ebdf4323c64c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f3147079-9ec1-49bd-8416-95e3c2d6d0d0'... >2018-07-11 18:23:09.681 23 INFO octavia.controller.queue.endpoint [req-2aae350a-1639-4605-a58c-140fa35560bf - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f018cfe9-1299-40b9-8e9d-476ecd79c99d'... >2018-07-11 18:23:19.956 23 INFO octavia.controller.queue.endpoint [req-ccf9bb66-5d4a-4b44-8499-29cb3f7906ee - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '6b6a7763-e5d8-4d08-b547-ca3deb00db66'... >2018-07-11 18:23:25.475 23 INFO octavia.controller.queue.endpoint [req-273a3c6f-c344-452f-95e4-ff44987ab7ed - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a0eac395-c98c-4ecc-9593-638c0fcdabd0'... >2018-07-11 18:23:30.376 23 INFO octavia.controller.queue.endpoint [req-707c4983-4345-40fa-989d-99f93a820803 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '249a2e52-32bc-41de-9813-b84a4487cf20'... >2018-07-11 18:23:33.646 23 INFO octavia.controller.queue.endpoint [req-f11d16c9-eea4-4c96-a23e-a9302d62ce13 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7118b998-32bc-410f-bf62-73d61cd2433d'... >2018-07-11 18:23:33.701 23 INFO octavia.controller.queue.endpoint [req-6e5055ec-5076-489a-addf-40ad2bb12f3f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5eead7d3-d75a-4187-94f8-2105c8a2bc4b'... >2018-07-11 18:23:35.994 23 INFO octavia.controller.queue.endpoint [req-e1a25eec-c029-4bfd-839a-983d4e3e94d0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '403e2269-1a15-4606-bf68-f34e0c69a821'... >2018-07-11 18:23:38.291 23 INFO octavia.controller.queue.endpoint [req-1133662b-5649-4de9-80a4-d90782f4909d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e2861c50-3444-4f9a-bcb9-1e0907f9a655'... >2018-07-11 18:23:39.048 23 INFO octavia.controller.queue.endpoint [req-043aa131-8444-47df-9d06-603c67a421a8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6aaf3630-15e6-4ab5-a7ad-1998de3240d1'... >2018-07-11 18:24:26.204 23 INFO octavia.controller.queue.endpoint [req-ddbd36b8-7038-4d34-8cd2-40b1acb80ed0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a6fa99fa-a887-4103-be3e-d2c2eb302f8e'... >2018-07-11 18:24:26.298 23 INFO octavia.controller.queue.endpoint [req-823735e0-c3ba-4b5c-b614-71c8d832dd89 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7018b218-b2f7-49ae-9fb9-df23ea8135b6'... >2018-07-11 18:24:26.349 23 INFO octavia.controller.queue.endpoint [req-d21105b8-d2bb-463f-801a-4d9eccd62143 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4507ebbf-ebe4-41ed-b319-a7da443cddfc'... >2018-07-11 18:24:31.403 23 INFO octavia.controller.queue.endpoint [req-711de036-d011-4226-9b23-8fa5ecff02f1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '59bc0046-65f3-4def-b4fd-8b04523eac4d'... >2018-07-11 18:24:31.697 23 INFO octavia.controller.queue.endpoint [req-03900b34-27b0-4c01-bf51-b54def202ad9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1a580bec-d860-4d40-972c-3d86a725abde'... >2018-07-11 18:24:31.911 23 INFO octavia.controller.queue.endpoint [req-8b59c358-f867-4a70-916d-612950239d53 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e92d1d7d-7653-41f2-9080-76823ee7760d'... >2018-07-11 18:24:44.975 23 INFO octavia.controller.queue.endpoint [req-7167471a-bd03-4974-ac63-f9d97cb2dbe0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cca0a15e-931f-4565-a5c8-920983f40b67'... >2018-07-11 18:24:50.360 23 INFO octavia.controller.queue.endpoint [req-84e108b8-a743-411e-9f97-2035720d89b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '39c048ca-6f97-4464-9b35-84eadd64e1d8'... >2018-07-11 18:24:55.952 23 INFO octavia.controller.queue.endpoint [req-2ffee110-ea33-4d17-9782-ba7ead1e76ee - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '06146001-1326-4675-81b3-28edaf9b420c'... >2018-07-11 18:32:19.955 23 INFO octavia.controller.queue.endpoint [req-3dbbed01-0c8c-432c-814e-b34d11bc3573 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '18ab4ab6-f542-49d2-b213-8ce370d4157c'... >2018-07-11 18:32:22.495 23 INFO octavia.controller.queue.endpoint [req-e5c96f37-4dc4-4578-82a4-8d8da40bca98 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b0b471ad-a2fd-4104-bd88-3fb5f0ed84d5'... >2018-07-11 18:33:16.162 23 INFO octavia.controller.queue.endpoint [req-0cd91ccf-ca1e-46bb-b372-3569e994d3c1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '745d50c6-c721-461f-9a37-34eb849e2162'... >2018-07-11 18:33:22.684 23 INFO octavia.controller.queue.endpoint [req-c098cfc5-d0fd-40dd-8ecb-3b3650d01118 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a68f57f0-77bc-404b-aa98-facdb3acd459'... >2018-07-11 18:47:26.889 23 INFO octavia.controller.queue.endpoint [req-b0cabe82-e81e-4581-a44f-822c950205b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b0b471ad-a2fd-4104-bd88-3fb5f0ed84d5'... >2018-07-11 18:47:30.241 23 INFO octavia.controller.queue.endpoint [req-3c660aad-8002-47c8-a437-a390282f2273 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd87c9668-7afb-4089-aca1-bb420cbd5e16'... >2018-07-11 18:48:18.205 23 INFO octavia.controller.queue.endpoint [req-67730fdc-4ad0-4003-aa91-9fc5973fcbe0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a68f57f0-77bc-404b-aa98-facdb3acd459'... >2018-07-11 18:48:22.122 23 INFO octavia.controller.queue.endpoint [req-17116ed7-6d4e-4f60-a3ac-b6fa24a5b468 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '647f316b-940c-4504-9c2b-51511043e5d2'... >2018-07-11 18:49:20.783 23 INFO octavia.controller.queue.endpoint [req-8949cc1b-c668-41d0-a317-d81a84dd466b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd8fd275e-1930-4c75-aeaf-133504836520'... >2018-07-11 18:49:26.929 23 INFO octavia.controller.queue.endpoint [req-5fa43fa9-82c0-451c-8ec5-4896d8a8d5f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '043daed4-631f-44ba-a3b1-6edecc581be3'... >2018-07-11 18:50:34.021 23 INFO octavia.controller.queue.endpoint [req-ea852058-c7f2-4b5b-9dc4-811d98751c0a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a0eac395-c98c-4ecc-9593-638c0fcdabd0'... >2018-07-11 18:50:43.554 23 INFO octavia.controller.queue.endpoint [req-4517edc3-2d14-4051-8036-b762ee594ae1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '249a2e52-32bc-41de-9813-b84a4487cf20'... >2018-07-11 18:50:53.388 23 INFO octavia.controller.queue.endpoint [req-8169d25e-fc30-487b-9cb2-ce7960658caa - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '403e2269-1a15-4606-bf68-f34e0c69a821'... >2018-07-11 19:03:20.704 23 INFO octavia.controller.queue.endpoint [req-adc32bdd-df79-4f71-a771-c720f35427f9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '647f316b-940c-4504-9c2b-51511043e5d2'... >2018-07-11 19:03:27.526 23 INFO octavia.controller.queue.endpoint [req-68bc39e0-7673-408d-a483-e1c3432e0663 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '01017d7b-374f-441a-9fc7-1484e898efd8'... >2018-07-11 19:04:22.312 23 INFO octavia.controller.queue.endpoint [req-c1027614-dccc-4fc7-b863-1aa138347566 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '043daed4-631f-44ba-a3b1-6edecc581be3'... >2018-07-11 19:04:24.318 23 INFO octavia.controller.queue.endpoint [req-b7f0a4af-c2f1-489e-b0e1-b551549f283a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9c28ca4b-7b11-4452-8def-17adaa52d41d'... >2018-07-11 19:16:23.471 23 INFO octavia.controller.queue.endpoint [req-23623cfe-c396-47f7-a850-1baa8b85321e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd87c9668-7afb-4089-aca1-bb420cbd5e16'... >2018-07-11 19:16:25.606 23 INFO octavia.controller.queue.endpoint [req-bdb33e68-1ce6-42c7-a181-39cde2ea2a22 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c6f481be-f67b-4fa6-8335-c3416fcaa089'... >2018-07-11 19:18:19.266 23 INFO octavia.controller.queue.endpoint [req-dac21785-726a-497a-a0e6-4d25f5c03825 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '01017d7b-374f-441a-9fc7-1484e898efd8'... >2018-07-11 19:18:24.870 23 INFO octavia.controller.queue.endpoint [req-3f41d2a4-2aa9-486a-8403-3410b870c50f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '016d3dd5-cda1-4eb9-b29a-aeb407bc738e'... >2018-07-11 19:19:14.227 23 INFO octavia.controller.queue.endpoint [req-42d259d0-f726-4685-877d-81cddbbbba99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9c28ca4b-7b11-4452-8def-17adaa52d41d'... >2018-07-11 19:19:20.419 23 INFO octavia.controller.queue.endpoint [req-077e8f9a-97cf-42fc-b7eb-ccab54d8ce9b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '96948bf0-24e5-4260-b719-b42d3b5960a3'... >2018-07-11 19:21:57.156 23 INFO octavia.controller.queue.endpoint [req-dab4f50a-24ac-4db3-90ef-1621cf326f27 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0376c0a2-1d21-4488-ab03-7fe5c88153fd'... >2018-07-11 19:22:02.267 23 INFO octavia.controller.queue.endpoint [req-ff5e6129-747c-45f0-a42a-60d551b97d78 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f7d73dcf-679b-40c5-8b01-5fafdffa5951'... >2018-07-11 19:22:23.918 23 INFO octavia.controller.queue.endpoint [req-f98cc972-4fd3-41cb-8492-6b93ac3a631c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e2861c50-3444-4f9a-bcb9-1e0907f9a655'... >2018-07-11 19:22:23.969 23 INFO octavia.controller.queue.endpoint [req-f14ea24e-27e2-46f4-b5b7-b920f055fe54 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '6aaf3630-15e6-4ab5-a7ad-1998de3240d1'... >2018-07-11 19:22:29.400 23 INFO octavia.controller.queue.endpoint [req-bee95c74-6a7b-4c1a-9129-ea4f5daa1922 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'dcfb3195-af61-4a51-9e79-aa7f4d12e850'... >2018-07-11 19:22:29.724 23 INFO octavia.controller.queue.endpoint [req-563b2bb8-a8d8-40d3-9ded-234fe826fcc3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0f1adcf0-db07-4d6c-9940-7d279d5f29cb'... >2018-07-11 19:22:40.284 23 INFO octavia.controller.queue.endpoint [req-c5bd9ce5-0e8c-4674-be8a-ab393ed891f0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1a580bec-d860-4d40-972c-3d86a725abde'... >2018-07-11 19:22:40.354 23 INFO octavia.controller.queue.endpoint [req-c59eccf4-64f6-46e9-b340-57f23daa1c8d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '59bc0046-65f3-4def-b4fd-8b04523eac4d'... >2018-07-11 19:22:40.430 23 INFO octavia.controller.queue.endpoint [req-3f1cdccd-7ad2-451f-a500-65c81edb0288 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e92d1d7d-7653-41f2-9080-76823ee7760d'... >2018-07-11 19:22:45.666 23 INFO octavia.controller.queue.endpoint [req-ac6e1ac2-c8bf-48bb-93f6-c4dce6d1f7c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f1a83613-9dda-4a2d-8427-59f7a6680eb2'... >2018-07-11 19:22:45.859 23 INFO octavia.controller.queue.endpoint [req-929f726c-eb9e-46b2-8496-83226033dbe6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c249dc66-52ae-48c4-aeb9-7af9bc2feeb7'... >2018-07-11 19:22:46.091 23 INFO octavia.controller.queue.endpoint [req-736f5e95-876d-4d1a-a36e-d3455ba98af1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b6d7719f-6a15-429e-8016-4b812a1e4837'... >2018-07-11 19:23:09.577 23 INFO octavia.controller.queue.endpoint [req-dca4513a-ed41-4696-9691-56efe437c4f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'edb85941-f689-40a5-8912-6ac4b56b70d0'... >2018-07-11 19:23:15.302 23 INFO octavia.controller.queue.endpoint [req-73bd7364-dee2-426f-ace3-70704d9a751c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '547e1285-e54d-477a-bd6b-3927c5e683e6'... >2018-07-11 19:23:20.817 23 INFO octavia.controller.queue.endpoint [req-44b08f01-ed95-43d1-931d-c615bb0d3f9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0fd5b343-ccfb-4976-9a73-cdfe5f0a930e'... >2018-07-11 19:31:20.588 23 INFO octavia.controller.queue.endpoint [req-63bd7a13-70a5-42f2-b473-01e3180588bf - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c6f481be-f67b-4fa6-8335-c3416fcaa089'... >2018-07-11 19:31:22.305 23 INFO octavia.controller.queue.endpoint [req-df061fde-4cad-4b4c-b0cf-172211d3d1fc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4cca3b56-3455-4f8f-ae57-5c25b3101ea7'... >2018-07-11 19:33:19.961 23 INFO octavia.controller.queue.endpoint [req-12b81efc-9f08-4d82-802c-e69637263f37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '016d3dd5-cda1-4eb9-b29a-aeb407bc738e'... >2018-07-11 19:33:22.337 23 INFO octavia.controller.queue.endpoint [req-93cb5a96-7106-4f3c-b6bf-8e2aeacbc8be - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd1ffdd9b-5661-4462-973c-e30c66769e4d'... >2018-07-11 19:34:11.477 23 INFO octavia.controller.queue.endpoint [req-b9ced674-a7f3-41d4-9f81-8926abee170a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '96948bf0-24e5-4260-b719-b42d3b5960a3'... >2018-07-11 19:34:18.030 23 INFO octavia.controller.queue.endpoint [req-6462b64a-c59a-49d2-ae85-01815beb20b6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '45e0c725-80e8-4ba3-a11a-3ea4d934890e'... >2018-07-11 19:37:37.643 23 INFO octavia.controller.queue.endpoint [req-fd53182d-64bf-4576-81c6-ddfd5b884dd3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'edb85941-f689-40a5-8912-6ac4b56b70d0'... >2018-07-11 19:37:47.798 23 INFO octavia.controller.queue.endpoint [-] Deleting member '547e1285-e54d-477a-bd6b-3927c5e683e6'... >2018-07-11 19:37:57.641 23 INFO octavia.controller.queue.endpoint [req-e61b192d-1538-4085-beff-a3a135c96977 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0fd5b343-ccfb-4976-9a73-cdfe5f0a930e'... >2018-07-11 19:42:16.791 23 INFO octavia.controller.queue.endpoint [req-95ebfd88-19bc-44f6-9919-c7571a4c08f8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0f1adcf0-db07-4d6c-9940-7d279d5f29cb'... >2018-07-11 19:42:16.826 23 INFO octavia.controller.queue.endpoint [req-d0c4ca94-ccc7-4f62-b92c-0b94554a109b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'dcfb3195-af61-4a51-9e79-aa7f4d12e850'... >2018-07-11 19:42:21.904 23 INFO octavia.controller.queue.endpoint [req-d95ea8f9-aff4-4a82-ba75-599a2473dc5f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '10eb73ad-42db-4107-940b-7be22efaa7f8'... >2018-07-11 19:42:22.445 23 INFO octavia.controller.queue.endpoint [req-d0820a0b-7656-4a54-a54b-f0287dd8667b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4ff606da-63f5-49f3-80de-6a80ec374b32'... >2018-07-11 19:46:26.681 23 INFO octavia.controller.queue.endpoint [req-a9e4449d-edb5-4247-91d8-7e03aafa59d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4cca3b56-3455-4f8f-ae57-5c25b3101ea7'... >2018-07-11 19:46:29.144 23 INFO octavia.controller.queue.endpoint [req-18b0ae50-34f1-4478-87e2-096d4485538f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b5eb9d54-f9de-4154-ae2c-58663613a395'... >2018-07-11 19:48:17.074 23 INFO octavia.controller.queue.endpoint [req-7bbc8dba-b687-475e-8d41-ee41bfe5e9c0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd1ffdd9b-5661-4462-973c-e30c66769e4d'... >2018-07-11 19:48:20.447 23 INFO octavia.controller.queue.endpoint [req-6cc3cacd-92f0-49b3-8061-21cb5969f5ca - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '09ed1118-9a4a-437d-88dc-cdb18e89bed7'... >2018-07-11 19:49:22.709 23 INFO octavia.controller.queue.endpoint [req-1d0786d2-59eb-4ebc-840c-eeb6ccbf0bf9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '45e0c725-80e8-4ba3-a11a-3ea4d934890e'... >2018-07-11 19:49:24.859 23 INFO octavia.controller.queue.endpoint [req-9dddf1fb-1313-4177-8262-a95a9ab8d614 - 6730069018ad4583bba11c467ec9bd3b - - -] Creating member '2861c3fd-a39c-4552-8c90-7bdb9396cbcd'... >2018-07-11 20:01:23.865 23 INFO octavia.controller.queue.endpoint [-] Deleting member 'b5eb9d54-f9de-4154-ae2c-58663613a395'... >2018-07-11 20:01:26.026 23 INFO octavia.controller.queue.endpoint [req-2b06a9e9-fc02-4bc6-b886-53ed52e7a4c2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '83c5336a-aff5-463f-a8ff-60350cde32b7'... >2018-07-11 20:03:18.700 23 INFO octavia.controller.queue.endpoint [req-cea7bf9f-31a9-4093-b1a0-e13dcf89860f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '09ed1118-9a4a-437d-88dc-cdb18e89bed7'... >2018-07-11 20:03:25.212 23 INFO octavia.controller.queue.endpoint [req-c4c493e0-e463-43e6-8350-43f9b2f74e52 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b38efdfb-c497-472e-b36a-7ede832daec5'... >2018-07-11 20:04:19.609 23 INFO octavia.controller.queue.endpoint [req-9c65cf00-f720-45d0-8b78-1381be8e8385 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2861c3fd-a39c-4552-8c90-7bdb9396cbcd'... >2018-07-11 20:04:21.337 23 INFO octavia.controller.queue.endpoint [req-b4384b60-32b3-4e5d-9f22-0d6e5143763b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7427830f-40b3-4600-a217-766b8400d6f6'... >2018-07-11 20:07:54.898 23 INFO octavia.controller.queue.endpoint [req-fb41a9f1-1e76-49e1-880e-caee96d6f3bf - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4ff606da-63f5-49f3-80de-6a80ec374b32'... >2018-07-11 20:07:54.972 23 INFO octavia.controller.queue.endpoint [req-3d70592d-89a8-47ba-b3f7-8f1c28b5b065 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '10eb73ad-42db-4107-940b-7be22efaa7f8'... >2018-07-11 20:08:00.096 23 INFO octavia.controller.queue.endpoint [req-8aac4f25-7567-48ac-9649-3fdf4a0b6f6d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '722eabbe-250a-44ba-a571-54063de48863'... >2018-07-11 20:08:00.403 23 INFO octavia.controller.queue.endpoint [req-e5e6c270-f2b8-4cbf-87ff-2db680beca90 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '19f08050-bf9b-49d0-9ee8-6d716ff8cb8b'... >2018-07-11 20:16:21.684 23 INFO octavia.controller.queue.endpoint [req-cc6db637-7766-487e-b5f2-79579f27c775 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '83c5336a-aff5-463f-a8ff-60350cde32b7'... >2018-07-11 20:16:25.826 23 INFO octavia.controller.queue.endpoint [req-99ccc833-ccb0-4b8e-a594-b7124045444a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '491ceffb-42b1-45cf-9117-5c58f937b12c'... >2018-07-11 20:18:15.769 23 INFO octavia.controller.queue.endpoint [req-dab962cf-e402-446e-ae1c-a6d0392f3831 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b38efdfb-c497-472e-b36a-7ede832daec5'... >2018-07-11 20:18:22.292 23 INFO octavia.controller.queue.endpoint [req-e9087c59-d3c0-48cc-9e5e-e853d93bb3dc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '218ef004-104c-4508-9b69-e1295b6fb75a'... >2018-07-11 20:27:05.630 23 INFO octavia.controller.queue.endpoint [req-d17dcbf7-28de-46eb-ba00-62186790d9a3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '722eabbe-250a-44ba-a571-54063de48863'... >2018-07-11 20:27:05.725 23 INFO octavia.controller.queue.endpoint [req-a57100c1-b875-45aa-aaa4-be5b17fbf53a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '19f08050-bf9b-49d0-9ee8-6d716ff8cb8b'... >2018-07-11 20:27:10.914 23 INFO octavia.controller.queue.endpoint [req-2d01e99b-45db-4be7-8311-d83dd3b82f6d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9cf96d69-da46-4798-9481-55be80135628'... >2018-07-11 20:27:11.226 23 INFO octavia.controller.queue.endpoint [req-8f574689-4d16-4219-a745-58987332ae8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'af56c19c-d617-4ae1-ab08-15665bb13e28'... >2018-07-11 20:28:33.704 23 INFO octavia.controller.queue.endpoint [req-a4d41daa-be4c-4115-8742-e12130137d16 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b6d7719f-6a15-429e-8016-4b812a1e4837'... >2018-07-11 20:28:33.787 23 INFO octavia.controller.queue.endpoint [req-6acdc351-f6dc-41d4-bfd0-13520e17fcc1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f1a83613-9dda-4a2d-8427-59f7a6680eb2'... >2018-07-11 20:28:33.868 23 INFO octavia.controller.queue.endpoint [req-50fec431-f409-4e7b-94aa-dac6cea30252 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c249dc66-52ae-48c4-aeb9-7af9bc2feeb7'... >2018-07-11 20:28:36.534 23 INFO octavia.controller.queue.endpoint [req-097a49d8-776e-4ecd-bbe7-b3706114504d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f7d73dcf-679b-40c5-8b01-5fafdffa5951'... >2018-07-11 20:28:38.949 23 INFO octavia.controller.queue.endpoint [req-ecb9d37c-7938-46dc-9198-42d1d5101074 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1775bdd0-37b2-42a4-a317-532307de97ff'... >2018-07-11 20:28:39.242 23 INFO octavia.controller.queue.endpoint [req-541362ad-e1c6-4dc2-a5bc-fa07f996d396 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '820b0d7a-c6d5-4d83-b242-7ea0768aa364'... >2018-07-11 20:28:39.484 23 INFO octavia.controller.queue.endpoint [req-2acb62ba-7ec6-4e4d-b91f-eb655a50e09f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ba889bc8-8728-4432-8ed2-e814b312c216'... >2018-07-11 20:28:41.335 23 INFO octavia.controller.queue.endpoint [req-6330c28e-7720-4dfb-ba86-f2551d8e409e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c8af028f-ffd6-45ea-a38b-fa24c9b8efe7'... >2018-07-11 20:30:26.501 23 INFO octavia.controller.queue.endpoint [req-75ab17c7-3660-4f61-a8ee-44b61b962de6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '650db3d9-4904-4ab6-8bea-c443e7bb2fc6'... >2018-07-11 20:30:31.536 23 INFO octavia.controller.queue.endpoint [req-57454464-e2ed-4aa6-a9a1-e545283ba640 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6de5acf6-7a1e-4730-b8c6-e20c0fe5d75a'... >2018-07-11 20:30:37.292 23 INFO octavia.controller.queue.endpoint [req-a9a8fa45-1bab-4dbe-9812-3a6cf3778fdc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '884fbe4e-0e34-48ba-8e24-cd80fffe309c'... >2018-07-11 20:31:27.182 23 INFO octavia.controller.queue.endpoint [req-0c20517d-3981-4650-9b1f-33bc094b9d2d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '491ceffb-42b1-45cf-9117-5c58f937b12c'... >2018-07-11 20:31:29.512 23 INFO octavia.controller.queue.endpoint [req-c4ade9e3-5bae-42cb-8e52-a3aa78bf7485 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1b84993f-05f9-4e5b-9fd3-c91a8931383f'... >2018-07-11 20:33:16.661 23 INFO octavia.controller.queue.endpoint [req-68891a37-88a2-43cf-9b3b-ced4d29ebfef - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7427830f-40b3-4600-a217-766b8400d6f6'... >2018-07-11 20:33:18.253 23 INFO octavia.controller.queue.endpoint [req-71c2cda9-c595-4c91-8ced-c3d954943a70 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '218ef004-104c-4508-9b69-e1295b6fb75a'... >2018-07-11 20:33:23.530 23 INFO octavia.controller.queue.endpoint [req-e745e45d-8739-476a-8be8-43b76f99c019 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '34d98a24-82df-4984-8776-9c57247bd0ac'... >2018-07-11 20:39:13.631 23 INFO octavia.controller.queue.endpoint [req-578884ed-8636-4357-bfe5-ab2b9f86736d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'af56c19c-d617-4ae1-ab08-15665bb13e28'... >2018-07-11 20:39:13.715 23 INFO octavia.controller.queue.endpoint [req-63dd69fe-9b9b-46b1-8ba3-cf88c2c95125 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9cf96d69-da46-4798-9481-55be80135628'... >2018-07-11 20:39:18.720 23 INFO octavia.controller.queue.endpoint [req-e417543c-d1b8-43a6-8f7a-34880840adf1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '81a2b9f7-ec66-4bec-a2fa-45c3288f2b11'... >2018-07-11 20:39:18.970 23 INFO octavia.controller.queue.endpoint [req-0712ac18-f862-489e-82ab-d10f31aeecac - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '10875971-7e93-49ff-ae9e-2ed8a95557eb'... >2018-07-11 20:43:41.508 23 INFO octavia.controller.queue.endpoint [req-aac8e4f3-0858-4896-beff-f70e4626cbf6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cca0a15e-931f-4565-a5c8-920983f40b67'... >2018-07-11 20:43:50.723 23 INFO octavia.controller.queue.endpoint [req-e58920ac-5654-4165-9f6e-ac599a035970 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '39c048ca-6f97-4464-9b35-84eadd64e1d8'... >2018-07-11 20:43:59.896 23 INFO octavia.controller.queue.endpoint [req-0e8a40b4-7b79-43ef-9d37-ca453cbf146d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '06146001-1326-4675-81b3-28edaf9b420c'... >2018-07-11 20:46:19.058 23 INFO octavia.controller.queue.endpoint [req-cf2fefa8-e699-4d42-a4e9-f112ddc3672c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1b84993f-05f9-4e5b-9fd3-c91a8931383f'... >2018-07-11 20:46:28.340 23 INFO octavia.controller.queue.endpoint [req-dfb9027c-ad9c-4000-a201-12a15211fe17 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4498689f-d977-4bd4-bbc1-0aa481b1066b'... >2018-07-11 20:48:18.594 23 INFO octavia.controller.queue.endpoint [req-ee977324-1e29-4c77-99c8-3352a8e86c38 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '34d98a24-82df-4984-8776-9c57247bd0ac'... >2018-07-11 20:48:26.537 23 INFO octavia.controller.queue.endpoint [req-85758401-0889-402f-bd23-f178d560fe9d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f9e9398d-b878-4895-9e2e-57ddf42a9302'... >2018-07-11 20:48:31.867 23 INFO octavia.controller.queue.endpoint [req-6a4f5be6-269d-4930-871a-ba472028341d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '553d3a67-e89c-4538-a504-327371616c6d'... >2018-07-11 21:01:21.264 23 INFO octavia.controller.queue.endpoint [req-055e20d5-35f1-463d-a24c-581f96c63c06 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4498689f-d977-4bd4-bbc1-0aa481b1066b'... >2018-07-11 21:01:23.563 23 INFO octavia.controller.queue.endpoint [req-a9bd4329-4189-413b-b62f-38a641d4fc2a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '530b088e-e4a6-4158-86c9-119ee9f0c32d'... >2018-07-11 21:03:16.335 23 INFO octavia.controller.queue.endpoint [req-62c1fc54-4b2f-4b31-9959-ffbeef9668b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '553d3a67-e89c-4538-a504-327371616c6d'... >2018-07-11 21:03:20.192 23 INFO octavia.controller.queue.endpoint [req-d5cafe8e-3e3e-4c1c-b9e8-765442ef2eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f9e9398d-b878-4895-9e2e-57ddf42a9302'... >2018-07-11 21:03:22.203 23 INFO octavia.controller.queue.endpoint [req-14b68bc0-92e7-469e-92c1-401a609965f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7958e3f1-c94b-4f5f-8f0a-044b34387c38'... >2018-07-11 21:03:28.341 23 INFO octavia.controller.queue.endpoint [req-247c5d47-baf5-41b0-9229-d37123d401bd - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '88ede2ee-6a2f-4d1a-bf21-ccc28ed6f134'... >2018-07-11 21:16:18.885 23 INFO octavia.controller.queue.endpoint [req-5f8e6f0e-fa45-48c1-997d-0961954247c2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '530b088e-e4a6-4158-86c9-119ee9f0c32d'... >2018-07-11 21:18:17.316 23 INFO octavia.controller.queue.endpoint [req-0c11d94a-4822-41a5-a86e-2f57f37f2794 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7958e3f1-c94b-4f5f-8f0a-044b34387c38'... >2018-07-11 21:18:27.127 23 INFO octavia.controller.queue.endpoint [req-2e04b467-2f97-4748-b0b1-a2cae8887cba - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '88ede2ee-6a2f-4d1a-bf21-ccc28ed6f134'... >2018-07-11 21:22:20.448 23 INFO octavia.controller.queue.endpoint [req-ef6976bd-3582-4848-8cbe-0d8203eff8c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ba889bc8-8728-4432-8ed2-e814b312c216'... >2018-07-11 21:22:20.485 23 INFO octavia.controller.queue.endpoint [req-2326e06e-bc1a-4f5e-a81c-f61daed2a682 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '820b0d7a-c6d5-4d83-b242-7ea0768aa364'... >2018-07-11 21:22:20.659 23 INFO octavia.controller.queue.endpoint [req-ed7ba428-5590-4ee3-86f2-97dfe498d47b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1775bdd0-37b2-42a4-a317-532307de97ff'... >2018-07-11 21:22:25.504 23 INFO octavia.controller.queue.endpoint [req-c0a13734-6638-4247-97ff-29fbfd698cb6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cf9fd8e1-e036-4eb2-8f83-e1503cf6b794'... >2018-07-11 21:22:25.844 23 INFO octavia.controller.queue.endpoint [req-e5f4b2c8-c80f-4573-87fb-e46ec52c26f7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'aa7b35b7-1e2f-4e50-8aaf-2844d67c3950'... >2018-07-11 21:22:26.086 23 INFO octavia.controller.queue.endpoint [req-f29ebda7-f516-421d-95b1-de70752f1698 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '414debc5-fea9-4d98-88be-5cf69fbc7dce'... >2018-07-11 21:22:32.113 23 INFO octavia.controller.queue.endpoint [req-40975a30-e71d-4871-bcbe-309a566ce109 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '650db3d9-4904-4ab6-8bea-c443e7bb2fc6'... >2018-07-11 21:22:42.782 23 INFO octavia.controller.queue.endpoint [req-20c20d0e-9484-46aa-a987-c55a03f255e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '6de5acf6-7a1e-4730-b8c6-e20c0fe5d75a'... >2018-07-11 21:22:44.840 23 INFO octavia.controller.queue.endpoint [req-b4ac0cca-c066-4ab4-b9cd-01980fae09d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '81a2b9f7-ec66-4bec-a2fa-45c3288f2b11'... >2018-07-11 21:22:44.939 23 INFO octavia.controller.queue.endpoint [req-55df1082-8c4e-4b58-8d0a-558f8a2ca199 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '10875971-7e93-49ff-ae9e-2ed8a95557eb'... >2018-07-11 21:22:49.644 23 INFO octavia.controller.queue.endpoint [req-468d74a6-edb2-4b43-8f18-1f36d97ba953 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b20bcdf6-d354-4f2c-b8bf-f088d3df89e4'... >2018-07-11 21:22:50.266 23 INFO octavia.controller.queue.endpoint [req-e7b77608-551d-4987-99a0-06a11a8ab0f6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9e216704-6c05-4289-8efe-18a1d06e9d5d'... >2018-07-11 21:22:52.216 23 INFO octavia.controller.queue.endpoint [req-002c90a5-898e-4156-9ff4-e1f0729b4e3c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '884fbe4e-0e34-48ba-8e24-cd80fffe309c'... >2018-07-11 21:22:58.080 23 INFO octavia.controller.queue.endpoint [req-46e75365-ef88-40be-b0f1-d29231c5844d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cb000e84-6ff7-4ab7-81dd-d16eac27c56a'... >2018-07-11 21:23:03.912 23 INFO octavia.controller.queue.endpoint [req-137782cc-3134-431f-985d-b0b1711effd4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd354914e-01d5-45b7-a37d-d36d74d9e9e9'... >2018-07-11 21:23:05.117 23 INFO octavia.controller.queue.endpoint [req-39aa0f48-64aa-48e4-8828-07e144c996be - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c8af028f-ffd6-45ea-a38b-fa24c9b8efe7'... >2018-07-11 21:23:09.000 23 INFO octavia.controller.queue.endpoint [req-5c81bd9c-8728-4743-8f1a-4901736a1421 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '54f6587f-d65c-417f-8bfd-184db773cbaa'... >2018-07-11 21:23:10.086 23 INFO octavia.controller.queue.endpoint [req-5b0c4eea-d153-4d42-8b14-b7f10904adcd - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b0682d52-6a37-449d-b976-a2d5d767574e'... >2018-07-11 21:23:26.005 23 INFO octavia.controller.queue.endpoint [req-11fa25f9-8a28-4e1b-b68c-35e406cfda4d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '21358ee9-bce4-4546-90c4-e38398326c77'... >2018-07-11 21:23:31.387 23 INFO octavia.controller.queue.endpoint [req-1c214626-0dea-44bf-9d2f-9816ea3ad47c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '441982a8-471c-4bea-8256-2f47d7b8dfd5'... >2018-07-11 21:23:36.886 23 INFO octavia.controller.queue.endpoint [req-9fc7cd28-0f4f-4c8f-a84e-1811ac642de3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '25b422ee-631f-4082-89c8-9c8234335506'... >2018-07-11 21:31:29.260 23 INFO octavia.controller.queue.endpoint [req-51799c46-4580-4576-8916-ae12818e15b4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '62330213-8b8e-4b8d-aa16-53cee1469180'... >2018-07-11 21:33:25.355 23 INFO octavia.controller.queue.endpoint [req-f6d921d1-fb35-49a7-abc2-2608ba4b5f8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5ccc73e3-7ba7-4c91-b426-2a1f503c908b'... >2018-07-11 21:33:31.147 23 INFO octavia.controller.queue.endpoint [req-c4307f8e-fb9e-4a6c-8ac5-bb1477fe7dcd - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e54f8b9c-8a92-408f-851c-2e33efa0d576'... >2018-07-11 21:38:37.192 23 INFO octavia.controller.queue.endpoint [req-5ff563c0-8121-4dbb-9883-ca315792ae86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '21358ee9-bce4-4546-90c4-e38398326c77'... >2018-07-11 21:38:46.829 23 INFO octavia.controller.queue.endpoint [req-e906934f-f66e-4b2e-b3ea-879e0e134fcc - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '441982a8-471c-4bea-8256-2f47d7b8dfd5'... >2018-07-11 21:38:57.049 23 INFO octavia.controller.queue.endpoint [req-c75ecf12-9cb7-4678-926e-997be219f9dc - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '25b422ee-631f-4082-89c8-9c8234335506'... >2018-07-11 21:42:18.001 23 INFO octavia.controller.queue.endpoint [req-71e7d53d-a9ba-4ee3-8dac-bca0f0f9283a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b20bcdf6-d354-4f2c-b8bf-f088d3df89e4'... >2018-07-11 21:42:18.118 23 INFO octavia.controller.queue.endpoint [req-b5726c87-91c8-4756-97cc-7864d21c4b8f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9e216704-6c05-4289-8efe-18a1d06e9d5d'... >2018-07-11 21:42:23.227 23 INFO octavia.controller.queue.endpoint [req-f502f47a-334e-4182-bb30-258962ea0155 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ac278929-4ba6-44cc-bfe7-92e074991423'... >2018-07-11 21:42:23.387 23 INFO octavia.controller.queue.endpoint [req-994e85b6-4d9d-4d64-a1f3-74cc1d526863 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'dd57d665-76d6-4e67-b034-7d37a1c3a521'... >2018-07-11 21:46:22.162 23 INFO octavia.controller.queue.endpoint [req-0491f745-2365-479e-b9d1-f454324f9f3e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '62330213-8b8e-4b8d-aa16-53cee1469180'... >2018-07-11 21:46:24.298 23 INFO octavia.controller.queue.endpoint [req-a19efa80-938d-40a8-a090-5a6414095e12 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '424361b2-47bf-4aae-9f91-b32405f99277'... >2018-07-11 21:48:21.531 23 INFO octavia.controller.queue.endpoint [req-8a61180a-5d3a-486c-a178-e004701c10ec - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5ccc73e3-7ba7-4c91-b426-2a1f503c908b'... >2018-07-11 21:48:31.100 23 INFO octavia.controller.queue.endpoint [req-7a72d8cb-cfbb-4aec-9479-36994cee4820 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e54f8b9c-8a92-408f-851c-2e33efa0d576'... >2018-07-11 22:00:38.192 23 INFO octavia.controller.queue.endpoint [req-3883396f-9f1d-44e9-a4a2-006615e40715 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b0682d52-6a37-449d-b976-a2d5d767574e'... >2018-07-11 22:00:43.288 23 INFO octavia.controller.queue.endpoint [req-8ed16fae-4d84-4a83-914d-b10a1bdb7f4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '959e5f30-25ec-49e0-87d2-3d2ddc0c7a27'... >2018-07-11 22:00:53.610 23 INFO octavia.controller.queue.endpoint [req-4d0602e4-5108-43c1-80cc-412df6bda10d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cb000e84-6ff7-4ab7-81dd-d16eac27c56a'... >2018-07-11 22:01:03.298 23 INFO octavia.controller.queue.endpoint [req-68c341f3-a828-48b3-9cae-9c9c6d8d0c95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd354914e-01d5-45b7-a37d-d36d74d9e9e9'... >2018-07-11 22:01:12.824 23 INFO octavia.controller.queue.endpoint [req-d6727546-cce3-466f-be85-510570dccf1d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '54f6587f-d65c-417f-8bfd-184db773cbaa'... >2018-07-11 22:01:18.088 23 INFO octavia.controller.queue.endpoint [req-9cc869f9-d898-4aaa-a672-3f912a5d6608 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '08804e1a-7e43-4e70-bd48-638cfd5027eb'... >2018-07-11 22:01:19.354 23 INFO octavia.controller.queue.endpoint [req-83a43153-d9a4-49e3-8852-c4d2f1603dc1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '424361b2-47bf-4aae-9f91-b32405f99277'... >2018-07-11 22:01:21.105 23 INFO octavia.controller.queue.endpoint [req-740b3c5f-49ba-46d9-af26-82434b9fb155 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'dc1d77e9-e060-4db5-a2c0-97e1c661aefb'... >2018-07-11 22:01:23.025 23 INFO octavia.controller.queue.endpoint [req-178305e3-26a5-4044-a968-f0ebf49e0f63 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7619a39c-0126-4721-92cc-1a469c7e8c2e'... >2018-07-11 22:01:23.405 23 INFO octavia.controller.queue.endpoint [req-52abf057-a235-4edd-aaf6-6e14be8dc276 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'dd57d665-76d6-4e67-b034-7d37a1c3a521'... >2018-07-11 22:01:23.440 23 INFO octavia.controller.queue.endpoint [req-d3bb3ef3-0471-41e7-99c5-cd3ec340b010 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ac278929-4ba6-44cc-bfe7-92e074991423'... >2018-07-11 22:01:28.358 23 INFO octavia.controller.queue.endpoint [req-2ac0ad70-8037-4405-8738-2a9b80df7514 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f0680ccd-a87f-4706-b07c-14e20fdf2552'... >2018-07-11 22:01:28.964 23 INFO octavia.controller.queue.endpoint [req-7185fda1-2681-431f-b97b-12ea7b5bd5f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ddb816ca-8c1f-4050-8112-7cbb7e2360f0'... >2018-07-11 22:01:29.313 23 INFO octavia.controller.queue.endpoint [req-ec7fade3-f40f-480e-8a65-fcc64d1f6f17 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5c7800cd-22eb-46eb-870d-ab0a0e0b58fe'... >2018-07-11 22:03:21.624 23 INFO octavia.controller.queue.endpoint [req-f2eb0fd3-7d62-470e-a6a6-c71cc97e632c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2e3efa8c-979d-4b97-b242-b3aab53abf1d'... >2018-07-11 22:03:26.124 23 INFO octavia.controller.queue.endpoint [req-e3d4b5c1-71bc-4a03-89f9-a3d9eff3e75f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f7a7aec6-5a9c-42de-abfa-b5e1701c7c21'... >2018-07-11 22:16:22.345 23 INFO octavia.controller.queue.endpoint [req-1b6156cb-7adf-4d28-b961-cfed8904af5d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'dc1d77e9-e060-4db5-a2c0-97e1c661aefb'... >2018-07-11 22:16:28.011 23 INFO octavia.controller.queue.endpoint [req-e977dc23-8bcf-4d9c-83fa-68d48cef463f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1790fdf8-3cc5-41e3-8e4d-aacafb99b20f'... >2018-07-11 22:18:23.217 23 INFO octavia.controller.queue.endpoint [req-6b7a8a56-8197-4ce6-b25f-bc38601cd783 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f7a7aec6-5a9c-42de-abfa-b5e1701c7c21'... >2018-07-11 22:18:27.028 23 INFO octavia.controller.queue.endpoint [req-88838ecc-9c1b-4c97-8550-2515bc0517a5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0552952b-e89f-49c6-b7d4-00bd902c7cd5'... >2018-07-11 22:28:28.890 23 INFO octavia.controller.queue.endpoint [req-3399ee44-3f7e-4b2f-9207-92ed0a073928 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f0680ccd-a87f-4706-b07c-14e20fdf2552'... >2018-07-11 22:28:28.931 23 INFO octavia.controller.queue.endpoint [req-249a749c-019c-4c14-a40c-73b733285a63 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ddb816ca-8c1f-4050-8112-7cbb7e2360f0'... >2018-07-11 22:28:34.818 23 INFO octavia.controller.queue.endpoint [req-93fb3f35-547d-452f-abd2-77bf52a8368c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0bd6b91b-d4ff-48e0-832a-c74ef5e2c3c3'... >2018-07-11 22:28:35.127 23 INFO octavia.controller.queue.endpoint [req-71cb3460-b1a1-416e-82d1-30c00ff818d7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ee34a358-392b-4948-af6f-8c04412eb1f9'... >2018-07-11 22:28:38.801 23 INFO octavia.controller.queue.endpoint [req-d19cb7ec-e07f-44ea-9d84-1d4c2cccd558 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'aa7b35b7-1e2f-4e50-8aaf-2844d67c3950'... >2018-07-11 22:28:38.901 23 INFO octavia.controller.queue.endpoint [req-573890f1-e2f9-4f1e-96fc-1639b13b37ef - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '414debc5-fea9-4d98-88be-5cf69fbc7dce'... >2018-07-11 22:28:38.932 23 INFO octavia.controller.queue.endpoint [req-7725677a-b435-40cf-97f2-d0c21c6c3d62 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cf9fd8e1-e036-4eb2-8f83-e1503cf6b794'... >2018-07-11 22:28:41.055 23 INFO octavia.controller.queue.endpoint [req-46ce1a70-f693-4473-9d87-7a67a2620b06 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '959e5f30-25ec-49e0-87d2-3d2ddc0c7a27'... >2018-07-11 22:28:43.822 23 INFO octavia.controller.queue.endpoint [req-769dcb26-0b9b-44e1-a917-0a7018b288fb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f38902f4-5b3c-4fc3-8a06-7417a55fb3be'... >2018-07-11 22:28:44.177 23 INFO octavia.controller.queue.endpoint [req-4b41c474-c5cb-4228-976e-8d443c199cc6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f3cf201e-d489-4afb-a8a5-fcd5f863d8a2'... >2018-07-11 22:28:44.363 23 INFO octavia.controller.queue.endpoint [req-30cefe28-e44c-47ee-a8b1-ac543d9ea2b9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '796fdbbb-ec18-43de-8016-f6c6eb6962a8'... >2018-07-11 22:28:46.121 23 INFO octavia.controller.queue.endpoint [req-8ffbba29-0929-4c16-92d4-2a6e8920e91b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f15a7cf2-709b-4197-a878-1709ca86db7c'... >2018-07-11 22:29:01.021 23 INFO octavia.controller.queue.endpoint [req-cefc0a35-abdf-4098-98b3-9323c3af992d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '08804e1a-7e43-4e70-bd48-638cfd5027eb'... >2018-07-11 22:29:10.959 23 INFO octavia.controller.queue.endpoint [req-e9275c0a-5dc9-4c80-b61e-16f022716001 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7619a39c-0126-4721-92cc-1a469c7e8c2e'... >2018-07-11 22:29:20.733 23 INFO octavia.controller.queue.endpoint [req-9ba0a6f8-677d-4d78-b22c-e49c0ef2867b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5c7800cd-22eb-46eb-870d-ab0a0e0b58fe'... >2018-07-11 22:29:27.116 23 INFO octavia.controller.queue.endpoint [req-889cdfaa-cf45-41c4-99b7-1076a3127586 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cd67b7cd-ad59-4bf4-bd41-a3506e5ca69f'... >2018-07-11 22:29:32.761 23 INFO octavia.controller.queue.endpoint [req-3b3fdd2b-af8c-4e00-bef0-69a0adf57b47 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'fb6fcd6b-0651-4969-91f7-965ad3181b10'... >2018-07-11 22:29:37.946 23 INFO octavia.controller.queue.endpoint [req-1026e500-4bee-441d-8073-32e88d07196f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e11970a7-5acf-4493-adb2-dcf523e3579c'... >2018-07-11 22:30:12.541 23 INFO octavia.controller.queue.endpoint [req-245af0b4-a723-4b50-b08f-305b41dc5952 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f8f62606-1607-4eb1-a87f-2af87949a548'... >2018-07-11 22:30:17.790 23 INFO octavia.controller.queue.endpoint [req-28e0c17f-3aef-4150-952e-9e1169ceeb96 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cb8a7411-f081-4b3e-a94b-f2db4ba53258'... >2018-07-11 22:30:22.905 23 INFO octavia.controller.queue.endpoint [req-b6df626e-4fff-47c5-b377-dd8e26dd5bca - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '956b1588-50fd-4775-a6a8-78a97a9095bd'... >2018-07-11 22:31:23.289 23 INFO octavia.controller.queue.endpoint [req-a0f623d6-0379-435c-8612-6c52b297e571 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1790fdf8-3cc5-41e3-8e4d-aacafb99b20f'... >2018-07-11 22:31:27.588 23 INFO octavia.controller.queue.endpoint [req-6f6f8b8f-43af-425c-99ac-e23b22d6f082 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e1f7aa33-e0b7-4858-bc7a-df0872b05e22'... >2018-07-11 22:33:21.789 23 INFO octavia.controller.queue.endpoint [req-6d3ed357-9ad6-416b-bfc0-54bf9f113720 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0552952b-e89f-49c6-b7d4-00bd902c7cd5'... >2018-07-11 22:33:25.880 23 INFO octavia.controller.queue.endpoint [req-d0d5be4b-5add-42aa-8b4e-c766e30c48d7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2e3efa8c-979d-4b97-b242-b3aab53abf1d'... >2018-07-11 22:33:30.935 23 INFO octavia.controller.queue.endpoint [req-d0e333a0-be86-4f8f-b66b-7dc9063b1550 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '93af8d41-d9d9-4bff-a499-367dcb3cf7e1'... >2018-07-11 22:43:40.578 23 INFO octavia.controller.queue.endpoint [req-3faf250c-7262-4e39-b721-90f8a3f7766b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cd67b7cd-ad59-4bf4-bd41-a3506e5ca69f'... >2018-07-11 22:43:50.440 23 INFO octavia.controller.queue.endpoint [req-80f03768-a5d8-44de-a9d7-c8ddd7c37e36 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'fb6fcd6b-0651-4969-91f7-965ad3181b10'... >2018-07-11 22:44:00.821 23 INFO octavia.controller.queue.endpoint [req-203e5351-73bb-4911-905c-1c33ad1bcc12 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e11970a7-5acf-4493-adb2-dcf523e3579c'... >2018-07-11 22:46:14.844 23 INFO octavia.controller.queue.endpoint [req-a0550eea-4b46-4571-a8ce-9914e901917e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e1f7aa33-e0b7-4858-bc7a-df0872b05e22'... >2018-07-11 22:46:21.843 23 INFO octavia.controller.queue.endpoint [req-e7152861-2647-4ef5-9ef4-b41869537b5e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4e58f7eb-fe46-4128-b8ee-940ff658f824'... >2018-07-11 22:48:18.124 23 INFO octavia.controller.queue.endpoint [req-a6dd37e7-f610-4e47-963e-0beeaf5ded5d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '93af8d41-d9d9-4bff-a499-367dcb3cf7e1'... >2018-07-11 22:48:23.368 23 INFO octavia.controller.queue.endpoint [req-3f805bb8-b2b9-47bc-874f-785d04741703 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd12401f7-cd8c-408f-b763-a4ff0f22688b'... >2018-07-11 22:48:24.945 23 INFO octavia.controller.queue.endpoint [req-18596ba2-f750-4595-a2bf-73756a5ea18d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '662ea117-d914-4409-91a5-8e7cc8f89c58'... >2018-07-11 22:55:08.344 23 INFO octavia.controller.queue.endpoint [req-cbbc2ad2-df8f-492f-9124-85d0549f68de - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0bd6b91b-d4ff-48e0-832a-c74ef5e2c3c3'... >2018-07-11 22:55:08.380 23 INFO octavia.controller.queue.endpoint [req-2f9ed4c0-d3d4-487c-857b-8b66836790ea - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ee34a358-392b-4948-af6f-8c04412eb1f9'... >2018-07-11 22:55:13.348 23 INFO octavia.controller.queue.endpoint [req-f47fc055-cb12-482d-a088-a967d925014e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '67ce0e73-f783-42bd-abf3-dc533b175bc3'... >2018-07-11 22:55:13.585 23 INFO octavia.controller.queue.endpoint [req-87ca2de5-6916-4287-88c9-8dfb090756f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'abee8cfc-8ef6-4760-b8e5-26c0a7d3a60c'... >2018-07-11 23:01:27.295 23 INFO octavia.controller.queue.endpoint [req-42ee0798-9ebc-48bc-9d40-9d42793d92b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4e58f7eb-fe46-4128-b8ee-940ff658f824'... >2018-07-11 23:01:30.258 23 INFO octavia.controller.queue.endpoint [req-7c0c2e9e-29cc-4d38-a865-c3de357eb2be - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f1d98a41-48b5-4120-ab01-42fd1ed7c382'... >2018-07-11 23:03:18.734 23 INFO octavia.controller.queue.endpoint [req-13392cec-745e-49f2-bfac-bb00f0d21413 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '662ea117-d914-4409-91a5-8e7cc8f89c58'... >2018-07-11 23:03:21.077 23 INFO octavia.controller.queue.endpoint [req-6d27f04c-5f86-4dd5-90f5-045853150a3f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a9f0d213-ea17-4bb9-8cdd-70dd4bf661e7'... >2018-07-11 23:03:25.042 23 INFO octavia.controller.queue.endpoint [req-c5e1baf0-388e-4466-8838-1df06cf231c1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd12401f7-cd8c-408f-b763-a4ff0f22688b'... >2018-07-11 23:03:28.453 23 INFO octavia.controller.queue.endpoint [req-91e657c2-efd1-4910-9570-6f97d7881a61 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'debf11ea-5043-4689-9a0e-c3154b84e45e'... >2018-07-11 23:16:19.818 23 INFO octavia.controller.queue.endpoint [req-d6e374dc-9315-422a-af91-aba96112a984 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f1d98a41-48b5-4120-ab01-42fd1ed7c382'... >2018-07-11 23:16:25.768 23 INFO octavia.controller.queue.endpoint [req-93b59c72-ab2c-44b3-805e-490c2de0caa5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ccb8b5ce-eefb-49e3-9d31-7ce8e72fc0f3'... >2018-07-11 23:18:21.816 23 INFO octavia.controller.queue.endpoint [req-16465e11-2017-44d0-9410-9c06accdb76c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'debf11ea-5043-4689-9a0e-c3154b84e45e'... >2018-07-11 23:18:24.160 23 INFO octavia.controller.queue.endpoint [req-7f31c48c-a868-471f-ba85-30cd7609030b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3d6a8929-0bc1-4ff6-b189-7728c76ac07b'... >2018-07-11 23:22:06.066 23 INFO octavia.controller.queue.endpoint [req-3ae2393b-9c14-4a45-b84a-4941269047fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '67ce0e73-f783-42bd-abf3-dc533b175bc3'... >2018-07-11 23:22:06.131 23 INFO octavia.controller.queue.endpoint [req-2ef701b0-5271-431e-8d6f-facd45fad949 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'abee8cfc-8ef6-4760-b8e5-26c0a7d3a60c'... >2018-07-11 23:22:11.136 23 INFO octavia.controller.queue.endpoint [req-e49227a7-7b1a-4f55-a65b-5ebe32b4c3cc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a34d25e3-fda6-45fb-845b-21b50f00cb98'... >2018-07-11 23:22:11.394 23 INFO octavia.controller.queue.endpoint [req-0af5246a-9031-4cb9-9bd5-25ff5e57cf4f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '47caf002-5e65-41b6-831b-a4c86a1b1e6f'... >2018-07-11 23:22:27.515 23 INFO octavia.controller.queue.endpoint [req-8d5875e4-3ecc-4972-b1ad-96133805502d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f3cf201e-d489-4afb-a8a5-fcd5f863d8a2'... >2018-07-11 23:22:27.574 23 INFO octavia.controller.queue.endpoint [req-d73bf572-0575-4107-a619-2499aac3a320 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f38902f4-5b3c-4fc3-8a06-7417a55fb3be'... >2018-07-11 23:22:27.626 23 INFO octavia.controller.queue.endpoint [req-7531ad37-9492-4caf-9880-5f93ba5e60fb - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '796fdbbb-ec18-43de-8016-f6c6eb6962a8'... >2018-07-11 23:22:32.950 23 INFO octavia.controller.queue.endpoint [req-51fb56d3-45fa-418a-8c42-39867354097f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7146fd9e-33f8-402e-bee8-f73928304718'... >2018-07-11 23:22:33.259 23 INFO octavia.controller.queue.endpoint [req-e8085443-af77-4c41-bf62-f4f3d02e8e14 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2814c36c-f337-4007-9c18-2f5434512be0'... >2018-07-11 23:22:33.524 23 INFO octavia.controller.queue.endpoint [req-f9de4c7a-1fbc-44be-b49f-7a95266dfb13 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cd3bda23-8ee7-4d1b-9c65-4ca059c46c08'... >2018-07-11 23:22:37.285 23 INFO octavia.controller.queue.endpoint [req-1bc25856-92a4-45b3-b94d-da59e56e3395 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f15a7cf2-709b-4197-a878-1709ca86db7c'... >2018-07-11 23:22:42.346 23 INFO octavia.controller.queue.endpoint [req-984a06b4-a3e4-4685-9b21-dd362d2decee - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a24d9f12-fa7d-4b01-a5ba-561fee2ee105'... >2018-07-11 23:22:43.830 23 INFO octavia.controller.queue.endpoint [req-2908fad3-74fc-4079-991d-761531a7e799 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f8f62606-1607-4eb1-a87f-2af87949a548'... >2018-07-11 23:22:54.091 23 INFO octavia.controller.queue.endpoint [req-5a6df915-1b44-4453-881c-2aa774c295d0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cb8a7411-f081-4b3e-a94b-f2db4ba53258'... >2018-07-11 23:23:04.765 23 INFO octavia.controller.queue.endpoint [req-4ce65856-0027-43ef-bf2f-4039b400ffc4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '956b1588-50fd-4775-a6a8-78a97a9095bd'... >2018-07-11 23:23:10.491 23 INFO octavia.controller.queue.endpoint [req-94e6a096-5209-4119-8899-fcf085de9bc7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6528c72b-10f1-42c0-829c-1b189a43e2e2'... >2018-07-11 23:23:16.221 23 INFO octavia.controller.queue.endpoint [req-801def3a-783d-4e42-ac05-9be21444be0a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e413f8ad-e9e3-497a-915f-0cf9e96f647a'... >2018-07-11 23:23:21.343 23 INFO octavia.controller.queue.endpoint [req-c450e3e4-fd56-4603-a62a-07065aee6369 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '922e7626-fc51-4841-a000-2f551987499e'... >2018-07-11 23:23:53.497 23 INFO octavia.controller.queue.endpoint [req-1e99537d-85b4-4ab1-ab6a-49cd45e83493 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f42fc768-2fa5-4e04-bbb2-f8fdf238cfe9'... >2018-07-11 23:23:58.448 23 INFO octavia.controller.queue.endpoint [req-2b9f36ce-61a7-4c87-b441-fc008f80f69a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '51946196-0b94-4010-8f1f-6b8a5d213faf'... >2018-07-11 23:24:03.294 23 INFO octavia.controller.queue.endpoint [req-9412f274-6752-4ea4-a682-63c88ec5db27 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'abca56c9-7903-4d84-85d1-304c21a0b678'... >2018-07-11 23:33:18.742 23 INFO octavia.controller.queue.endpoint [req-0131f643-5aac-4019-9015-e157a4edfac0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '3d6a8929-0bc1-4ff6-b189-7728c76ac07b'... >2018-07-11 23:33:24.534 23 INFO octavia.controller.queue.endpoint [req-b0986cd3-0d98-469c-a18a-dd6846078211 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6deaf9f9-513a-4158-b3e5-2e984f0a67a9'... >2018-07-11 23:37:34.757 23 INFO octavia.controller.queue.endpoint [req-5f1072d5-142a-46e7-928e-6d424fa4f62f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '6528c72b-10f1-42c0-829c-1b189a43e2e2'... >2018-07-11 23:37:45.252 23 INFO octavia.controller.queue.endpoint [req-15d877d1-eb0e-4df4-9284-5dd9b8865829 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e413f8ad-e9e3-497a-915f-0cf9e96f647a'... >2018-07-11 23:37:54.870 23 INFO octavia.controller.queue.endpoint [req-150c208d-678f-4e8c-865d-54d0db50e959 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '922e7626-fc51-4841-a000-2f551987499e'... >2018-07-11 23:42:13.291 23 INFO octavia.controller.queue.endpoint [req-848dbb20-5008-459a-a16b-23045b7a112f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a9f0d213-ea17-4bb9-8cdd-70dd4bf661e7'... >2018-07-11 23:42:18.067 23 INFO octavia.controller.queue.endpoint [req-d4dce52b-fc80-420e-bb94-322a8f71092c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9b066af1-465f-4e38-bb53-c6ba6ac31842'... >2018-07-11 23:42:20.295 23 INFO octavia.controller.queue.endpoint [req-faa18dcc-14c2-457c-bc5e-f9b9d322ced3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ccb8b5ce-eefb-49e3-9d31-7ce8e72fc0f3'... >2018-07-11 23:42:22.069 23 INFO octavia.controller.queue.endpoint [req-10e0c430-8147-4169-bd49-88bf56678bde - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'baba5691-42de-487f-b787-a19339a9cd82'... >2018-07-11 23:48:26.188 23 INFO octavia.controller.queue.endpoint [req-05f7bb5d-ccbd-4eca-b70f-60eb77fae095 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '6deaf9f9-513a-4158-b3e5-2e984f0a67a9'... >2018-07-11 23:48:29.538 23 INFO octavia.controller.queue.endpoint [req-8f909d31-e5ee-4c90-94c5-9cecd2091151 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a4f68256-f9cf-4cf2-8ee1-5e0204069547'... >2018-07-11 23:57:20.573 23 INFO octavia.controller.queue.endpoint [req-8fd6d750-dc17-4b89-b577-5d30f25dfd5c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9b066af1-465f-4e38-bb53-c6ba6ac31842'... >2018-07-11 23:57:25.809 23 INFO octavia.controller.queue.endpoint [req-01ce891e-3bbf-40c7-8069-38aa8aa65af5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd5e139b3-2c53-4c6b-979e-26de69a9a345'... >2018-07-11 23:57:27.263 23 INFO octavia.controller.queue.endpoint [req-a60dddb9-5283-423c-b6b6-2e47a8fb2355 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'baba5691-42de-487f-b787-a19339a9cd82'... >2018-07-11 23:57:29.818 23 INFO octavia.controller.queue.endpoint [req-c4ce0737-112c-4fbc-8473-52f730ec59dc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '962f0a40-bd76-4a0f-a592-65e892d7f2f0'... >2018-07-12 00:03:18.274 23 INFO octavia.controller.queue.endpoint [req-1427c4cd-630a-46f7-9bbd-dc9c2a96a5a2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a4f68256-f9cf-4cf2-8ee1-5e0204069547'... >2018-07-12 00:03:24.983 23 INFO octavia.controller.queue.endpoint [req-cbef5b8b-78e1-4555-949d-e3fc11e1205f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '97d7acee-a012-430a-90de-cc5c365e0226'... >2018-07-12 00:03:41.102 23 INFO octavia.controller.queue.endpoint [req-74d4564c-79f1-4e52-88ab-75d75956f8f6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f42fc768-2fa5-4e04-bbb2-f8fdf238cfe9'... >2018-07-12 00:03:50.955 23 INFO octavia.controller.queue.endpoint [req-1a3fcb83-38de-49a5-8c10-94fe11128868 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '51946196-0b94-4010-8f1f-6b8a5d213faf'... >2018-07-12 00:04:00.807 23 INFO octavia.controller.queue.endpoint [req-1f4900f4-3667-410f-b68a-693728e2dbf6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'abca56c9-7903-4d84-85d1-304c21a0b678'... >2018-07-12 00:04:06.175 23 INFO octavia.controller.queue.endpoint [req-5ddbd6fc-7819-4c71-8289-7976f548ae6d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a59157a6-857a-4b31-b444-146f1f410849'... >2018-07-12 00:04:11.352 23 INFO octavia.controller.queue.endpoint [req-816f317b-95f5-4b27-9380-28d8b6d86a4d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0bfb3e78-baec-4619-8903-d145dc54697c'... >2018-07-12 00:04:16.438 23 INFO octavia.controller.queue.endpoint [req-e06844ea-51c9-402b-8aa0-4f1428519314 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '025de550-df90-49a8-a8a6-9650d4135ca4'... >2018-07-12 00:04:20.396 23 INFO octavia.controller.queue.endpoint [req-2610112f-a4ee-445a-8883-73041815f98c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '47caf002-5e65-41b6-831b-a4c86a1b1e6f'... >2018-07-12 00:04:20.475 23 INFO octavia.controller.queue.endpoint [req-b7e8f2f8-1cb3-4ef9-a7c6-42e292657cf4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a34d25e3-fda6-45fb-845b-21b50f00cb98'... >2018-07-12 00:04:25.319 23 INFO octavia.controller.queue.endpoint [req-016f3868-0906-4fe1-9c20-c545d36dde2f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '764147b7-0323-4765-b749-70c9619481ed'... >2018-07-12 00:04:25.545 23 INFO octavia.controller.queue.endpoint [req-45f82f73-cbe8-42d6-bf28-c2abf9226f57 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'dc75b549-2e00-4578-9759-3b0967d00e5d'... >2018-07-12 00:05:10.359 23 INFO octavia.controller.queue.endpoint [req-c871fdf7-457d-4dff-a0af-55b5770a6324 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'dca2e0dc-2361-47fc-9975-08e0b9e1270f'... >2018-07-12 00:05:15.859 23 INFO octavia.controller.queue.endpoint [req-3d219e8e-cb11-40f9-baea-6f33cf427ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b19f3712-06bc-4dc3-b627-f3617316126f'... >2018-07-12 00:05:21.422 23 INFO octavia.controller.queue.endpoint [req-79d93032-df37-4573-bd52-923ace92a5cb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '671a4250-7408-41bc-b75c-545cebb511eb'... >2018-07-12 00:12:18.907 23 INFO octavia.controller.queue.endpoint [req-d8ec7f93-1890-4cc4-b643-db5d370210bd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '962f0a40-bd76-4a0f-a592-65e892d7f2f0'... >2018-07-12 00:12:20.011 23 INFO octavia.controller.queue.endpoint [req-61487b50-c2b0-4bd3-af49-4a42b16a8b58 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd5e139b3-2c53-4c6b-979e-26de69a9a345'... >2018-07-12 00:12:21.857 23 INFO octavia.controller.queue.endpoint [req-c22fd52c-b2d4-471b-ba52-77495cc362cd - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ef8ec4de-3e4e-44d0-b559-5e9b7394f282'... >2018-07-12 00:12:25.027 23 INFO octavia.controller.queue.endpoint [req-3d3a9f4b-d793-4446-9cb2-d0dcf5514a9c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ccc6e15a-4ae5-4a9f-9f65-0c46733e193b'... >2018-07-12 00:18:16.030 23 INFO octavia.controller.queue.endpoint [req-3ac339ae-b804-4183-8f89-6eae976d7041 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '97d7acee-a012-430a-90de-cc5c365e0226'... >2018-07-12 00:18:21.637 23 INFO octavia.controller.queue.endpoint [req-896729b2-3b28-4bdc-9ea6-32720d83f294 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '71ffe89d-8e30-4fb6-ab52-8ab45921a05a'... >2018-07-12 00:18:34.799 23 INFO octavia.controller.queue.endpoint [req-cfb0ea55-3d50-434a-8398-59b902907f5d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a59157a6-857a-4b31-b444-146f1f410849'... >2018-07-12 00:18:44.609 23 INFO octavia.controller.queue.endpoint [req-e40fd206-ce73-41a7-880d-eb4fb8072d8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0bfb3e78-baec-4619-8903-d145dc54697c'... >2018-07-12 00:18:54.435 23 INFO octavia.controller.queue.endpoint [req-758b1812-095a-4346-ad9f-3c18cac03538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '025de550-df90-49a8-a8a6-9650d4135ca4'... >2018-07-12 00:26:07.896 23 INFO octavia.controller.queue.endpoint [req-ab586dec-8ebc-44cc-b040-6f31a23b7ffc - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a24d9f12-fa7d-4b01-a5ba-561fee2ee105'... >2018-07-12 00:26:13.475 23 INFO octavia.controller.queue.endpoint [req-cb93f27d-ba9c-49fd-bc0e-4381f8efa9ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3318d314-0486-44f8-8805-6011c532a81d'... >2018-07-12 00:26:21.177 23 INFO octavia.controller.queue.endpoint [req-6ab80c3f-5f1b-4d8d-aa4f-904bdd613005 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'dca2e0dc-2361-47fc-9975-08e0b9e1270f'... >2018-07-12 00:26:30.829 23 INFO octavia.controller.queue.endpoint [req-ecf27fcd-fa0b-4ef6-8960-82287084a5c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b19f3712-06bc-4dc3-b627-f3617316126f'... >2018-07-12 00:26:40.397 23 INFO octavia.controller.queue.endpoint [req-969ea669-9d0a-4b43-8748-4279a8d74c6c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '671a4250-7408-41bc-b75c-545cebb511eb'... >2018-07-12 00:26:45.886 23 INFO octavia.controller.queue.endpoint [req-9197b222-9af0-4916-9410-85d81edb8dca - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '38873092-4559-4bcc-87a6-a02eb8134fad'... >2018-07-12 00:26:50.522 23 INFO octavia.controller.queue.endpoint [req-8b2d4961-d7cd-4999-bf8e-8471d54b2554 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd435d248-1fbc-4f84-be55-31fa1d773601'... >2018-07-12 00:26:55.794 23 INFO octavia.controller.queue.endpoint [req-b4079b86-7e27-4065-adc7-8d899b551f1d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '926e8548-a19e-4ce1-82fe-443433cf1bfe'... >2018-07-12 00:27:16.620 23 INFO octavia.controller.queue.endpoint [req-595d52fd-21ee-471e-9c6e-2ed329ff81e7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ef8ec4de-3e4e-44d0-b559-5e9b7394f282'... >2018-07-12 00:27:20.748 23 INFO octavia.controller.queue.endpoint [req-c1feed95-a2d8-4666-a946-639fe8adbe09 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '95c605aa-5dda-4634-8c33-8d61b2defdb8'... >2018-07-12 00:33:16.373 23 INFO octavia.controller.queue.endpoint [req-69b70627-e2a9-4eac-b4a8-194c4b22d1e0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '71ffe89d-8e30-4fb6-ab52-8ab45921a05a'... >2018-07-12 00:33:22.240 23 INFO octavia.controller.queue.endpoint [req-2dd23e0e-5c6b-4cdd-9753-f3529fe5a953 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'dd502de6-4d76-4195-83c2-15d5ee52c316'... >2018-07-12 00:37:11.324 23 INFO octavia.controller.queue.endpoint [req-4ed6cf8e-c12b-4c81-98b4-5e484559e3db - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4feb3be2-513e-4d91-abfc-6a2a804b733e'... >2018-07-12 00:37:11.410 23 INFO octavia.controller.queue.endpoint [req-0efca2c2-6921-4d13-8d70-ffab6f601d94 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '764147b7-0323-4765-b749-70c9619481ed'... >2018-07-12 00:37:11.488 23 INFO octavia.controller.queue.endpoint [req-e291566f-3232-48f4-a23a-2941cc518b68 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'dc75b549-2e00-4578-9759-3b0967d00e5d'... >2018-07-12 00:37:16.674 23 INFO octavia.controller.queue.endpoint [req-bdcc9485-1300-4989-98dd-27bd95941683 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5f10a712-2fe7-4836-824b-dc7ebe6210da'... >2018-07-12 00:37:17.083 23 INFO octavia.controller.queue.endpoint [req-5018df26-e16b-412e-85d8-2570fd33be4e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6039b3e6-703b-4913-b699-d9343d0a8688'... >2018-07-12 00:37:17.297 23 INFO octavia.controller.queue.endpoint [req-20d404c8-9b84-4cb2-a34f-01e5e0a4ce0f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '102511ce-a7ff-4ad8-967b-d106e1ed2e69'... >2018-07-12 00:37:21.974 23 INFO octavia.controller.queue.endpoint [req-f2b52fbd-d8ae-485e-9764-fa73bc33239a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1268e292-039b-446f-94f5-c781e126ba78'... >2018-07-12 00:40:21.102 23 INFO octavia.controller.queue.endpoint [req-94169205-87a0-41ca-af06-3a8cccd08706 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ccc6e15a-4ae5-4a9f-9f65-0c46733e193b'... >2018-07-12 00:40:24.003 23 INFO octavia.controller.queue.endpoint [req-d4d1beba-6b02-49df-91c4-99c32ae389cf - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '88473f67-6c52-4ed7-a6cd-c6245353438d'... >2018-07-12 00:41:44.930 23 INFO octavia.controller.queue.endpoint [req-6364fb91-3267-4390-b888-f4f038c3befb - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '38873092-4559-4bcc-87a6-a02eb8134fad'... >2018-07-12 00:41:55.525 23 INFO octavia.controller.queue.endpoint [req-db73fe5d-151e-4b62-9f4a-732d38c723c6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd435d248-1fbc-4f84-be55-31fa1d773601'... >2018-07-12 00:42:05.455 23 INFO octavia.controller.queue.endpoint [req-9d198bb5-7465-435c-926e-83cce5dcc3b9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '926e8548-a19e-4ce1-82fe-443433cf1bfe'... >2018-07-12 00:42:18.705 23 INFO octavia.controller.queue.endpoint [req-0849b9de-f480-4670-9e27-62a1b331e690 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '95c605aa-5dda-4634-8c33-8d61b2defdb8'... >2018-07-12 00:42:24.837 23 INFO octavia.controller.queue.endpoint [req-cbbb4b7d-e7b4-4dbf-8924-6a7e36eafe3f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e27fa715-0a96-4074-bdf5-c50260db5221'... >2018-07-12 00:46:15.667 23 INFO octavia.controller.queue.endpoint [req-2eaae8ce-7cc5-4364-8878-ec5f4594874a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '3318d314-0486-44f8-8805-6011c532a81d'... >2018-07-12 00:46:20.539 23 INFO octavia.controller.queue.endpoint [req-77dc9991-8d47-41a3-bcf8-566a977a1f97 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'eb0305fc-b81c-478f-9bbb-37c5167e969e'... >2018-07-12 00:47:10.394 23 INFO octavia.controller.queue.endpoint [req-0989bdb4-cccd-47dc-afb0-d985139806a4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '102511ce-a7ff-4ad8-967b-d106e1ed2e69'... >2018-07-12 00:47:10.471 23 INFO octavia.controller.queue.endpoint [req-2487459e-317b-4301-b33a-d421527c00b9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '6039b3e6-703b-4913-b699-d9343d0a8688'... >2018-07-12 00:47:15.533 23 INFO octavia.controller.queue.endpoint [req-63e09c83-a630-4534-a1a6-4a70497fdfda - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0637c59c-aa0b-4ed5-8d0d-51ee902787e1'... >2018-07-12 00:47:15.711 23 INFO octavia.controller.queue.endpoint [req-dbc5bef7-fed7-4007-98a4-3679691b7384 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9d1221c9-e193-45ee-9900-fecec15adfc7'... >2018-07-12 00:48:18.358 23 INFO octavia.controller.queue.endpoint [req-237c4969-654b-4bcb-a7ab-d9e12ee0fa56 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'dd502de6-4d76-4195-83c2-15d5ee52c316'... >2018-07-12 00:48:28.432 23 INFO octavia.controller.queue.endpoint [req-0c020e3f-edcd-433b-ae39-adcb110f1680 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '21db0770-5634-4acd-9474-a2a048c7ecce'... >2018-07-12 00:55:12.906 23 INFO octavia.controller.queue.endpoint [req-3ab5ad94-dcf1-4efb-8dae-101fbe561775 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '88473f67-6c52-4ed7-a6cd-c6245353438d'... >2018-07-12 00:55:19.260 23 INFO octavia.controller.queue.endpoint [req-03c0667f-2e7f-4093-ae42-52cdb2a70e96 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '230bcdd6-7a87-49bd-a4d7-62bc18d86233'... >2018-07-12 00:57:19.744 23 INFO octavia.controller.queue.endpoint [req-ad4923ed-b2c7-4946-8a31-8292f4ce516d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e27fa715-0a96-4074-bdf5-c50260db5221'... >2018-07-12 00:57:22.124 23 INFO octavia.controller.queue.endpoint [req-21b90da3-777f-43c4-b516-89241737766a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c1424c32-bad0-401d-8957-8e45295fa33d'... >2018-07-12 03:28:41.566 23 INFO octavia.controller.queue.endpoint [req-f8e965d6-882e-4b6f-9932-835783ac6082 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '38708abe-2dcd-40a5-82ee-81effdb85035'... >2018-07-12 03:28:41.667 23 INFO octavia.controller.queue.endpoint [req-86e37dfa-cb1b-43a7-91dc-a69e55a491b4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b38a584b-a059-40a5-87eb-d734ee2bd96b'... >2018-07-12 03:28:51.769 23 INFO octavia.controller.queue.endpoint [req-1b998708-9ca1-4a33-a2ba-60818cf299f1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '44d7ab6c-d15d-46fa-b98e-70a372bc9283'... >2018-07-12 03:28:51.908 23 INFO octavia.controller.queue.endpoint [req-f37843b2-b81b-4e5f-b826-b1e088007288 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '60af3cb5-a574-4d95-b798-813a7f07171b'... >2018-07-12 03:28:53.996 23 INFO octavia.controller.queue.endpoint [req-bc229fa9-6818-4b8c-907e-f4768774f8b1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd89d3bb5-e81b-4d82-b055-ec5a3b846c09'... >2018-07-12 03:28:54.287 23 INFO octavia.controller.queue.endpoint [req-f00a39bd-f825-4271-a7fa-a432cf3b757a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c8fdcdc6-2f0c-4efa-a47b-fc68cf4a0435'... >2018-07-12 03:28:57.039 23 INFO octavia.controller.queue.endpoint [req-5deb2233-ff7b-47ad-9537-a1ca0f1ae15d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2814c36c-f337-4007-9c18-2f5434512be0'... >2018-07-12 03:28:57.075 23 INFO octavia.controller.queue.endpoint [req-c4454752-be9c-470f-b98f-6659ba014c1d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cd3bda23-8ee7-4d1b-9c65-4ca059c46c08'... >2018-07-12 03:28:57.148 23 INFO octavia.controller.queue.endpoint [req-1557eb17-fb26-4e11-ac00-d430863c3fad - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7146fd9e-33f8-402e-bee8-f73928304718'... >2018-07-12 03:28:57.994 23 INFO octavia.controller.queue.endpoint [req-0af2be00-a760-458c-8c04-68629cbfcb24 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'eb0305fc-b81c-478f-9bbb-37c5167e969e'... >2018-07-12 03:29:02.137 23 INFO octavia.controller.queue.endpoint [req-47509980-6cfd-4681-9a7a-ac7186771c11 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ec595582-f227-4e07-b72c-12484508cabf'... >2018-07-12 03:29:02.736 23 INFO octavia.controller.queue.endpoint [req-d3bebc55-09ce-4fd2-8587-db4fd136c218 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '69bca149-a8fb-4b0a-858f-c3b02191614a'... >2018-07-12 03:29:02.943 23 INFO octavia.controller.queue.endpoint [req-67ab2ca1-54ac-4c32-9c55-2a54e57e23ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a6673d41-f584-4e84-91a7-38314fc52d4e'... >2018-07-12 03:29:03.196 23 INFO octavia.controller.queue.endpoint [req-805b5c5f-a12d-43bc-a5cd-f7132255f038 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ba3d7145-b1a6-4084-932b-d8a3b0ca78d8'... >2018-07-12 03:29:07.943 23 INFO octavia.controller.queue.endpoint [req-64758952-d29a-4223-b546-e0ada82469a9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4feb3be2-513e-4d91-abfc-6a2a804b733e'... >2018-07-12 03:29:17.781 23 INFO octavia.controller.queue.endpoint [req-932a09f7-fb44-4094-bb64-222868fe7850 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5f10a712-2fe7-4836-824b-dc7ebe6210da'... >2018-07-12 03:29:28.303 23 INFO octavia.controller.queue.endpoint [req-2f756f4e-dbf9-4f38-b7b1-97c2ec171749 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1268e292-039b-446f-94f5-c781e126ba78'... >2018-07-12 03:29:33.951 23 INFO octavia.controller.queue.endpoint [req-3b295fdf-6a2b-4587-a752-231d13f5b7fe - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5c6a1c96-826f-43ab-8d69-5f14eb0a99aa'... >2018-07-12 03:29:39.575 23 INFO octavia.controller.queue.endpoint [req-5ad49121-1a56-4fed-adbd-eb3df3f0a478 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'abd83f12-e331-499c-9bd2-a706b3ce464e'... >2018-07-12 03:29:45.050 23 INFO octavia.controller.queue.endpoint [req-d80e90c6-fcfe-49f2-936a-d59a46cbd371 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f2c3e7d6-9aa6-4644-8d83-41aaed6fac84'... >2018-07-12 05:14:26.577 23 INFO octavia.controller.queue.endpoint [req-9aeb0e98-38f1-4038-b46c-cd46841f3098 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '4a7e06b3-efd8-4cff-9a23-5420b50c2cb4'... >2018-07-12 05:14:26.817 23 INFO octavia.controller.worker.tasks.database_tasks [req-9aeb0e98-38f1-4038-b46c-cd46841f3098 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id f5a8ba84-c57a-47fa-8e61-895659f12e15 >2018-07-12 05:14:26.920 23 INFO octavia.certificates.generator.local [req-9aeb0e98-38f1-4038-b46c-cd46841f3098 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 05:14:26.921 23 INFO octavia.certificates.generator.local [req-9aeb0e98-38f1-4038-b46c-cd46841f3098 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 05:14:26.921 23 INFO octavia.certificates.generator.local [req-9aeb0e98-38f1-4038-b46c-cd46841f3098 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 05:14:26.922 23 INFO octavia.certificates.generator.local [req-9aeb0e98-38f1-4038-b46c-cd46841f3098 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 05:14:27.902 23 INFO octavia.controller.queue.endpoint [req-929a5a23-c72a-460d-8472-cf05c0a67680 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'be4174e7-7e6f-44e6-9fcd-31d43e1d91f4'... >2018-07-12 05:14:28.019 23 INFO octavia.controller.worker.tasks.database_tasks [req-929a5a23-c72a-460d-8472-cf05c0a67680 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 74997d13-9bea-412d-a2cc-b3f01a0c4206 >2018-07-12 05:14:28.090 23 INFO octavia.certificates.generator.local [req-929a5a23-c72a-460d-8472-cf05c0a67680 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 05:14:28.090 23 INFO octavia.certificates.generator.local [req-929a5a23-c72a-460d-8472-cf05c0a67680 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 05:14:28.090 23 INFO octavia.certificates.generator.local [req-929a5a23-c72a-460d-8472-cf05c0a67680 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 05:14:28.091 23 INFO octavia.certificates.generator.local [req-929a5a23-c72a-460d-8472-cf05c0a67680 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 05:14:41.505 23 INFO octavia.controller.worker.tasks.database_tasks [req-929a5a23-c72a-460d-8472-cf05c0a67680 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 74997d13-9bea-412d-a2cc-b3f01a0c4206 with compute id 2c4e7fc1-52df-43c4-95de-b90c41aa271d for load balancer: be4174e7-7e6f-44e6-9fcd-31d43e1d91f4 >2018-07-12 05:14:41.862 23 INFO octavia.controller.worker.tasks.database_tasks [req-9aeb0e98-38f1-4038-b46c-cd46841f3098 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: f5a8ba84-c57a-47fa-8e61-895659f12e15 with compute id faafca0e-9bb3-4703-858b-7b26c72e9b05 for load balancer: 4a7e06b3-efd8-4cff-9a23-5420b50c2cb4 >2018-07-12 05:14:42.346 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-9aeb0e98-38f1-4038-b46c-cd46841f3098 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 325db92e-ef55-42f6-88ef-1cbab8203f3a already exists. Nothing to be done. >2018-07-12 05:14:42.347 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-929a5a23-c72a-460d-8472-cf05c0a67680 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 1cfa4476-be07-48b6-a414-3e3ea8cbf356 already exists. Nothing to be done. >2018-07-12 05:14:51.783 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-929a5a23-c72a-460d-8472-cf05c0a67680 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.30', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.252.184 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470073dd50>: Failed to establish a new connection: [Errno 113] No route to host',)) >2018-07-12 05:14:56.793 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-929a5a23-c72a-460d-8472-cf05c0a67680 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.30', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.252.184 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470073db90>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-12 05:14:59.170 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-9aeb0e98-38f1-4038-b46c-cd46841f3098 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.19', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.131.153 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470073d0d0>, 'Connection to 172.24.0.19 timed out. (connect timeout=10.0)')) >2018-07-12 05:15:06.405 23 INFO octavia.controller.worker.tasks.database_tasks [req-929a5a23-c72a-460d-8472-cf05c0a67680 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: be4174e7-7e6f-44e6-9fcd-31d43e1d91f4 >2018-07-12 05:15:08.757 23 INFO octavia.controller.worker.tasks.database_tasks [req-9aeb0e98-38f1-4038-b46c-cd46841f3098 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 4a7e06b3-efd8-4cff-9a23-5420b50c2cb4 >2018-07-12 05:15:09.057 23 INFO octavia.controller.queue.endpoint [req-87111388-2daf-4dda-ba5b-2176746b66ea - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'e465be97-75a2-4f63-857c-1698a7b25ad3'... >2018-07-12 05:15:13.959 23 INFO octavia.controller.queue.endpoint [req-129ee7e7-6d3c-4457-ab0c-9ea20a66eb85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '2a7b2d05-5523-4275-b30d-c2a6ac349c48'... >2018-07-12 05:15:19.855 23 INFO octavia.controller.queue.endpoint [req-e0c2f957-e941-445e-9b42-bb262dbda4be - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c0765501-e8f7-4ac9-8bfa-4b3bc3631918'... >2018-07-12 05:15:22.094 23 INFO octavia.controller.queue.endpoint [req-31b779bb-6480-400d-9a7f-6df2ec622cb5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'b951d5fc-bdf0-42eb-be64-e38b9f7b75d5'... >2018-07-12 05:15:27.212 23 INFO octavia.controller.queue.endpoint [req-ed591e50-b6fa-4869-b8a8-d12025bdebe2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'a1cbb2a4-aac1-492f-a0b1-eed746153086'... >2018-07-12 05:15:32.587 23 INFO octavia.controller.queue.endpoint [req-8419cf5a-567f-4177-9d3c-fea5d21ccf67 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '82b24105-b57d-4aaa-90e2-84c78c7c2379'... >2018-07-12 05:21:07.533 23 INFO octavia.controller.queue.endpoint [req-6a644e35-c1df-4ee0-9982-353007b634fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '75c4425a-0d40-4b6e-a047-05c62c29389d'... >2018-07-12 05:21:07.666 23 INFO octavia.controller.worker.tasks.database_tasks [req-6a644e35-c1df-4ee0-9982-353007b634fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id c7fc5cf7-31ed-4162-b510-3700489cc645 >2018-07-12 05:21:07.799 23 INFO octavia.certificates.generator.local [req-6a644e35-c1df-4ee0-9982-353007b634fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 05:21:07.799 23 INFO octavia.certificates.generator.local [req-6a644e35-c1df-4ee0-9982-353007b634fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 05:21:07.800 23 INFO octavia.certificates.generator.local [req-6a644e35-c1df-4ee0-9982-353007b634fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 05:21:07.800 23 INFO octavia.certificates.generator.local [req-6a644e35-c1df-4ee0-9982-353007b634fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 05:21:08.668 23 INFO octavia.controller.queue.endpoint [req-3f45bc06-f502-4b18-87dc-59fd3f01111d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'e0e8f1f8-1a2b-4faa-b133-0620d5901d9e'... >2018-07-12 05:21:08.793 23 INFO octavia.controller.worker.tasks.database_tasks [req-3f45bc06-f502-4b18-87dc-59fd3f01111d - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 3e5fafd4-2bd6-48c0-bebd-ba6c83826376 >2018-07-12 05:21:08.900 23 INFO octavia.certificates.generator.local [req-3f45bc06-f502-4b18-87dc-59fd3f01111d - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 05:21:08.901 23 INFO octavia.certificates.generator.local [req-3f45bc06-f502-4b18-87dc-59fd3f01111d - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 05:21:08.901 23 INFO octavia.certificates.generator.local [req-3f45bc06-f502-4b18-87dc-59fd3f01111d - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 05:21:08.901 23 INFO octavia.certificates.generator.local [req-3f45bc06-f502-4b18-87dc-59fd3f01111d - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 05:21:20.996 23 INFO octavia.controller.worker.tasks.database_tasks [req-6a644e35-c1df-4ee0-9982-353007b634fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: c7fc5cf7-31ed-4162-b510-3700489cc645 with compute id c0d4d500-bd26-4fc4-9ef3-3097420737d1 for load balancer: 75c4425a-0d40-4b6e-a047-05c62c29389d >2018-07-12 05:21:21.227 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-6a644e35-c1df-4ee0-9982-353007b634fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 71ef6aac-6287-465d-b295-de358f49b57a already exists. Nothing to be done. >2018-07-12 05:21:29.791 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-6a644e35-c1df-4ee0-9982-353007b634fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.31', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.176.7 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47005d13d0>: Failed to establish a new connection: [Errno 113] No route to host',)) >2018-07-12 05:21:31.747 23 INFO octavia.controller.worker.tasks.database_tasks [req-3f45bc06-f502-4b18-87dc-59fd3f01111d - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 3e5fafd4-2bd6-48c0-bebd-ba6c83826376 with compute id c9360c80-5380-47d3-89f7-a30fc53adcfa for load balancer: e0e8f1f8-1a2b-4faa-b133-0620d5901d9e >2018-07-12 05:21:31.834 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-3f45bc06-f502-4b18-87dc-59fd3f01111d - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 5befeea6-395f-48c5-8689-9f1cc982c2df already exists. Nothing to be done. >2018-07-12 05:21:34.800 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-6a644e35-c1df-4ee0-9982-353007b634fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.31', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.176.7 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47005d1950>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-12 05:21:44.374 23 INFO octavia.controller.worker.tasks.database_tasks [req-6a644e35-c1df-4ee0-9982-353007b634fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 75c4425a-0d40-4b6e-a047-05c62c29389d >2018-07-12 05:21:44.636 23 INFO octavia.controller.worker.tasks.database_tasks [req-3f45bc06-f502-4b18-87dc-59fd3f01111d - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: e0e8f1f8-1a2b-4faa-b133-0620d5901d9e >2018-07-12 05:21:46.015 23 INFO octavia.controller.queue.endpoint [req-508dbb0a-9909-42aa-a423-f617611a8e4f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '287a4a6c-a014-4355-a492-75f5352046bb'... >2018-07-12 05:21:48.647 23 INFO octavia.controller.queue.endpoint [req-3f45bc06-f502-4b18-87dc-59fd3f01111d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '8969516f-a380-499f-9555-e24d446ca58e'... >2018-07-12 05:21:51.472 23 INFO octavia.controller.queue.endpoint [req-f27a8657-274a-4f37-ba7d-20c1ce99f224 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '42ae40ee-b444-4d30-8a9f-00c4ac7f2cc1'... >2018-07-12 05:21:53.785 23 INFO octavia.controller.queue.endpoint [req-9aeb0e98-38f1-4038-b46c-cd46841f3098 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'b5ae2cb8-a3df-4d22-ba35-cd71368607bd'... >2018-07-12 05:21:56.886 23 INFO octavia.controller.queue.endpoint [req-26247662-c729-4d94-9eb3-f3bf55bc2755 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8ef100b6-601d-42d9-9147-6a50b6599be0'... >2018-07-12 05:21:58.840 23 INFO octavia.controller.queue.endpoint [req-3eb07fc4-3f52-4fdd-a0c7-aade8e8595a3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'eb37683c-4284-4748-8d62-380701667c3f'... >2018-07-12 05:22:00.643 23 INFO octavia.controller.queue.endpoint [req-f1619029-d3dc-4b8b-a8a9-bf215f509077 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '466407e0-a650-4c5a-bd49-36817c380a9b'... >2018-07-12 05:25:58.749 23 INFO octavia.controller.queue.endpoint [req-73c8e553-f3b5-4549-bdcb-af95ac268819 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9c4a184c-92dc-4a0a-9c77-6d1ff97d28d5'... >2018-07-12 05:25:59.863 23 INFO octavia.controller.queue.endpoint [req-21283042-7526-47cd-92c9-39e828bd6f05 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '466407e0-a650-4c5a-bd49-36817c380a9b'... >2018-07-12 05:26:04.781 23 INFO octavia.controller.queue.endpoint [req-9c83ee01-3dca-4e3b-92d1-ebfef5d98151 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'eb37683c-4284-4748-8d62-380701667c3f'... >2018-07-12 05:26:10.340 23 INFO octavia.controller.queue.endpoint [req-457ac6f3-c55e-4e68-b52e-856eaaf5c9aa - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '78bbb3f0-c6ae-4bd8-9778-6a55a49decba'... >2018-07-12 05:35:16.681 23 INFO octavia.controller.queue.endpoint [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'e4fbb806-a2a1-443c-8f5b-84d027350a39'... >2018-07-12 05:35:16.801 23 INFO octavia.controller.worker.tasks.database_tasks [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id c632e2ec-679d-4ef0-946b-c082ae9f8e00 >2018-07-12 05:35:16.876 23 INFO octavia.certificates.generator.local [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 05:35:16.877 23 INFO octavia.certificates.generator.local [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 05:35:16.877 23 INFO octavia.certificates.generator.local [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 05:35:16.878 23 INFO octavia.certificates.generator.local [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 05:35:30.615 23 INFO octavia.controller.worker.tasks.database_tasks [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: c632e2ec-679d-4ef0-946b-c082ae9f8e00 with compute id b7876930-f8d2-4750-90b1-f48d22da3a94 for load balancer: e4fbb806-a2a1-443c-8f5b-84d027350a39 >2018-07-12 05:35:30.893 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port ad531959-af7a-4af8-b6a0-59b4a39abb49 already exists. Nothing to be done. >2018-07-12 05:35:48.373 23 INFO octavia.controller.worker.tasks.database_tasks [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: e4fbb806-a2a1-443c-8f5b-84d027350a39 >2018-07-12 05:36:00.054 23 INFO octavia.controller.queue.endpoint [req-f1e5611c-37ab-4151-88d6-bb4fa8ab9fc0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '1609f24f-ece2-4d95-aa0a-f42a41b8ed9b'... >2018-07-12 05:36:04.766 23 INFO octavia.controller.queue.endpoint [req-6afa7344-3048-45c9-8ff3-c318acf1a99b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '4b00fa56-92ee-473b-84af-a8a15cd3043d'... >2018-07-12 05:36:09.889 23 INFO octavia.controller.queue.endpoint [req-ba1915db-56cd-4d10-9bbf-42652cff0bbb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd07aaa73-9514-4d7a-b8e0-8e257aa08ba9'... >2018-07-12 06:02:40.910 23 INFO octavia.controller.queue.endpoint [req-c77cd20d-2b99-48e0-975a-4c90c6f77abb - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5c6a1c96-826f-43ab-8d69-5f14eb0a99aa'... >2018-07-12 06:02:50.691 23 INFO octavia.controller.queue.endpoint [req-6a644e35-c1df-4ee0-9982-353007b634fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'abd83f12-e331-499c-9bd2-a706b3ce464e'... >2018-07-12 06:03:01.321 23 INFO octavia.controller.queue.endpoint [req-b8db2bfd-b104-4c8a-9d92-fce29cbba45f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f2c3e7d6-9aa6-4644-8d83-41aaed6fac84'... >2018-07-12 06:13:34.361 23 INFO octavia.controller.queue.endpoint [req-de5ba783-0990-4a80-ae59-c01a216415de - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ba3d7145-b1a6-4084-932b-d8a3b0ca78d8'... >2018-07-12 06:13:40.145 23 INFO octavia.controller.queue.endpoint [req-cc1bcf08-0721-452a-bb0a-f81f9392f420 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e81e10b8-37a5-4b17-a671-be067d12107e'... >2018-07-12 06:13:42.854 23 INFO octavia.controller.queue.endpoint [req-10838520-cf29-4185-903c-6c96d90a2e0f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '69bca149-a8fb-4b0a-858f-c3b02191614a'... >2018-07-12 06:13:42.933 23 INFO octavia.controller.queue.endpoint [req-80586cad-c2a0-4b4a-92bb-2ef31f387e18 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ec595582-f227-4e07-b72c-12484508cabf'... >2018-07-12 06:13:42.986 23 INFO octavia.controller.queue.endpoint [req-5deb4d63-8571-466d-a240-ebca16873237 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a6673d41-f584-4e84-91a7-38314fc52d4e'... >2018-07-12 06:13:47.805 23 INFO octavia.controller.queue.endpoint [req-a140aa02-e2f2-41a0-a18f-0bde1214996b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '587e0182-6b57-404c-af64-a6d390b9d2a0'... >2018-07-12 06:13:48.153 23 INFO octavia.controller.queue.endpoint [req-b82507a2-bea6-4c35-a3bb-c2d17490e456 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '90ce72ae-f9eb-414d-9822-fca6ecda4eb7'... >2018-07-12 06:13:48.474 23 INFO octavia.controller.queue.endpoint [req-d67cc04c-c172-4e0d-a477-2571730aed9b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9637c64b-aaca-40cb-9ab7-d2691820f56d'... >2018-07-12 06:14:26.232 23 INFO octavia.controller.queue.endpoint [req-7513850a-ec64-45ca-8c2e-2578ad992f1d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2f37c1c5-7d44-43b0-a447-8f48a451b27f'... >2018-07-12 06:14:31.350 23 INFO octavia.controller.queue.endpoint [req-998d72a3-6fb5-4f85-97e1-03b9213f43f0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9542a1e2-0774-49ab-8968-935c552f9079'... >2018-07-12 06:14:36.532 23 INFO octavia.controller.queue.endpoint [req-6377ffbd-847f-40a4-aa77-00166f2d5d02 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2fc71233-43df-4a4a-81e2-56fe42b060a4'... >2018-07-12 06:28:12.799 23 INFO octavia.controller.queue.endpoint [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'bfc107ff-e9ca-4e49-8153-a3d7c8f86104'... >2018-07-12 06:28:12.934 23 INFO octavia.controller.worker.tasks.database_tasks [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 65e803bf-0a7f-4e96-af27-ad4e19c676f8 >2018-07-12 06:28:12.975 23 INFO octavia.certificates.generator.local [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 06:28:12.976 23 INFO octavia.certificates.generator.local [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 06:28:12.976 23 INFO octavia.certificates.generator.local [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 06:28:12.976 23 INFO octavia.certificates.generator.local [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 06:28:28.555 23 INFO octavia.controller.worker.tasks.database_tasks [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 65e803bf-0a7f-4e96-af27-ad4e19c676f8 with compute id 13391a19-1c80-4446-a8c6-74dc5e4338cc for load balancer: bfc107ff-e9ca-4e49-8153-a3d7c8f86104 >2018-07-12 06:28:28.846 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port a8136ee8-d02b-4d7c-a19d-277e7720f7f6 already exists. Nothing to be done. >2018-07-12 06:28:37.837 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.36', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.122.88 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47006d2850>: Failed to establish a new connection: [Errno 113] No route to host',)) >2018-07-12 06:28:47.472 23 INFO octavia.controller.worker.tasks.database_tasks [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: bfc107ff-e9ca-4e49-8153-a3d7c8f86104 >2018-07-12 06:28:54.241 23 INFO octavia.controller.queue.endpoint [req-c55130ca-c92c-452f-aa11-09a26dcd2ab2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'c42d1a5a-e6f7-4614-a3f5-940a722bf3bd'... >2018-07-12 06:28:59.135 23 INFO octavia.controller.queue.endpoint [req-916517b2-caa7-48f1-b926-838bf2afd931 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '5900ca7a-c3d8-4c48-a204-76e0e04c0d5c'... >2018-07-12 06:29:04.391 23 INFO octavia.controller.queue.endpoint [req-f311c4fe-4604-425d-b330-e506e85c271a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b0eee7ec-8719-4d27-86ba-a0ebe99dc175'... >2018-07-12 06:39:39.888 23 INFO octavia.controller.queue.endpoint [req-aa0d68ad-502e-4c19-b951-65a3cb2040ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2f37c1c5-7d44-43b0-a447-8f48a451b27f'... >2018-07-12 06:39:49.773 23 INFO octavia.controller.queue.endpoint [req-3dbd1293-3d04-4052-8ea2-15cd9f067312 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9542a1e2-0774-49ab-8968-935c552f9079'... >2018-07-12 06:40:00.029 23 INFO octavia.controller.queue.endpoint [req-55e2a970-a2d6-4093-b9d8-6377624bc07a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2fc71233-43df-4a4a-81e2-56fe42b060a4'... >2018-07-12 06:43:53.310 23 INFO octavia.controller.queue.endpoint [req-15f51a8a-54da-45b1-a79f-812f6c3fc14d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '879e38aa-57f0-4ee0-ac95-4aa0eff06394'... >2018-07-12 06:43:58.524 23 INFO octavia.controller.queue.endpoint [req-5ec65d0b-e2d2-4c0c-aec3-a0e68d29a75c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'edeaeb0b-e3a1-488c-b387-ca196fdfc91b'... >2018-07-12 06:44:03.849 23 INFO octavia.controller.queue.endpoint [req-40fa2358-11eb-408b-ac4a-4a76474df85c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e0bd6c08-118f-4a9b-b6b3-f61548d89371'... >2018-07-12 06:45:11.652 23 INFO octavia.controller.queue.endpoint [req-b6e842ad-4e97-486f-9e9d-7ec3ecbe9e6b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e81e10b8-37a5-4b17-a671-be067d12107e'... >2018-07-12 06:45:17.076 23 INFO octavia.controller.queue.endpoint [req-7d31a981-0dcd-47f3-8c05-27b63497272a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c65ef623-c90e-4279-ace4-30ce8821e35f'... >2018-07-12 06:45:24.431 23 INFO octavia.controller.queue.endpoint [req-eeb97699-fceb-4dc3-916b-e65edca3b32c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '90ce72ae-f9eb-414d-9822-fca6ecda4eb7'... >2018-07-12 06:45:24.484 23 INFO octavia.controller.queue.endpoint [req-f2e35bac-910e-45c6-9754-ef2fab93b16b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9637c64b-aaca-40cb-9ab7-d2691820f56d'... >2018-07-12 06:45:24.520 23 INFO octavia.controller.queue.endpoint [req-c2ef88a8-d315-45ec-91ae-97b263f1234e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '587e0182-6b57-404c-af64-a6d390b9d2a0'... >2018-07-12 06:45:30.139 23 INFO octavia.controller.queue.endpoint [req-27017d19-d9aa-4300-88ed-47ad5d30bf66 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '08284254-62b1-408e-9974-5980ae1edfb6'... >2018-07-12 06:45:30.483 23 INFO octavia.controller.queue.endpoint [req-3bc2f9e7-f0d4-4cb4-894c-d0dbac32c529 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0476f3d1-7796-4c35-a170-bbfea0a846af'... >2018-07-12 06:45:30.616 23 INFO octavia.controller.queue.endpoint [req-827432ad-821c-440a-a740-e636392058e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8d182938-5adf-4eb0-9fe6-e7956182b100'... >2018-07-12 06:45:49.490 23 INFO octavia.controller.queue.endpoint [req-2f2829b1-fbe6-4ced-a2e2-6bcf7304e58f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7b95450c-9d4e-42e5-a8fb-e39a8942a1d6'... >2018-07-12 06:45:54.905 23 INFO octavia.controller.queue.endpoint [req-912c88d1-00bc-455b-9445-5b5f8775e571 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '545c46ff-a8ab-4643-874b-479f1475cb1d'... >2018-07-12 06:45:59.995 23 INFO octavia.controller.queue.endpoint [req-5528678e-4d3b-42c9-9b91-1ba4fa9b91d4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '39362432-b4ed-454f-a0e9-037c27fa3b57'... >2018-07-12 06:47:14.924 23 INFO octavia.controller.queue.endpoint [req-fae93a28-acd2-4712-88c7-7695a7ff741b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b0eee7ec-8719-4d27-86ba-a0ebe99dc175'... >2018-07-12 06:47:19.799 23 INFO octavia.controller.queue.endpoint [req-09853af0-1bf8-4124-952d-69139dbe46ab - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '33e1af7d-b9a8-40d5-9a74-fc553ac2c3bd'... >2018-07-12 06:59:34.318 23 INFO octavia.controller.queue.endpoint [req-a05343a4-6a12-4490-b73f-bb36d59766e4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '879e38aa-57f0-4ee0-ac95-4aa0eff06394'... >2018-07-12 06:59:44.118 23 INFO octavia.controller.queue.endpoint [req-b554617e-ed6c-4649-85b3-3a0c20ce3f77 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'edeaeb0b-e3a1-488c-b387-ca196fdfc91b'... >2018-07-12 06:59:55.287 23 INFO octavia.controller.queue.endpoint [req-deaa4390-82bd-4322-be86-53de216410da - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e0bd6c08-118f-4a9b-b6b3-f61548d89371'... >2018-07-12 07:22:38.112 23 INFO octavia.controller.queue.endpoint [req-664b9a29-88c4-4a5f-93f0-d37b6bf90a4c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7b95450c-9d4e-42e5-a8fb-e39a8942a1d6'... >2018-07-12 07:22:48.619 23 INFO octavia.controller.queue.endpoint [req-f59fc2a9-ae91-42f6-80d5-b040af7d64ca - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '545c46ff-a8ab-4643-874b-479f1475cb1d'... >2018-07-12 07:22:58.779 23 INFO octavia.controller.queue.endpoint [req-424426b7-4ce2-4095-ac4b-963ca4830997 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '39362432-b4ed-454f-a0e9-037c27fa3b57'... >2018-07-12 07:23:04.491 23 INFO octavia.controller.queue.endpoint [req-15ab1e32-f45a-4a70-8fe2-1aed862b5ceb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4b2736dd-61d1-47f1-bda9-6f900237f87f'... >2018-07-12 07:23:10.118 23 INFO octavia.controller.queue.endpoint [req-f73bed88-3b0a-45cb-94a9-4da3a63f2342 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e92b51ff-7b65-478e-b1b1-1d35443869c4'... >2018-07-12 07:23:15.781 23 INFO octavia.controller.queue.endpoint [req-ff55b481-5123-480f-8f56-791ef55e3d98 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9ed83b57-e55e-436a-8be8-53bc9fffd019'... >2018-07-12 07:23:25.659 23 INFO octavia.controller.queue.endpoint [req-a7f63b19-01a7-4c9f-be49-8e5189c4b9e0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '8d182938-5adf-4eb0-9fe6-e7956182b100'... >2018-07-12 07:23:25.746 23 INFO octavia.controller.queue.endpoint [req-d33aac98-055c-44a4-9f16-1be3652da99f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '08284254-62b1-408e-9974-5980ae1edfb6'... >2018-07-12 07:23:25.797 23 INFO octavia.controller.queue.endpoint [req-02ed26ce-6a59-4e34-baf0-6f3ee1057133 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0476f3d1-7796-4c35-a170-bbfea0a846af'... >2018-07-12 07:23:30.577 23 INFO octavia.controller.queue.endpoint [req-81aa42a1-fefe-483e-a237-d267881d0e9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2f8aa960-2e2e-41cc-a706-b2ef8a791640'... >2018-07-12 07:23:30.894 23 INFO octavia.controller.queue.endpoint [req-1abd1b0d-5632-47b0-9b11-e7c17a74119a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5fb3cacb-1da2-4b75-8282-1889cedba526'... >2018-07-12 07:23:31.121 23 INFO octavia.controller.queue.endpoint [req-ac25e04f-ae55-46fa-9c2e-684a90c47d15 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '02681d7e-0f02-4ae5-8209-d34dda5feb28'... >2018-07-12 07:23:48.848 23 INFO octavia.controller.queue.endpoint [req-1bc92e5b-fec8-4e7b-9ab1-d515dc16d6a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '052a22fe-748a-4220-bf52-e751767e26dc'... >2018-07-12 07:23:53.836 23 INFO octavia.controller.queue.endpoint [req-9269f35a-dd05-4e78-b868-b45a6b4894b7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '900fb6f1-a94e-41e7-8c1f-df5bc94dc383'... >2018-07-12 07:23:58.472 23 INFO octavia.controller.queue.endpoint [req-d3bf1e37-8f57-4b1b-84b4-958393db1215 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cb1f2fba-38ea-4eb9-8396-74bf6be4cc7a'... >2018-07-12 07:25:58.508 23 INFO octavia.controller.queue.endpoint [req-1c765fe1-6fdf-4412-b853-27ec73e3a628 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0637c59c-aa0b-4ed5-8d0d-51ee902787e1'... >2018-07-12 07:25:58.584 23 INFO octavia.controller.queue.endpoint [req-d2bb28f9-d992-4383-bc06-d00c4c05b130 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9d1221c9-e193-45ee-9900-fecec15adfc7'... >2018-07-12 07:26:03.688 23 INFO octavia.controller.queue.endpoint [req-de205e0a-79c2-403b-87f8-8dcd50d18778 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '88d022f6-a463-4d06-b252-8cda64b6a3ab'... >2018-07-12 07:26:03.929 23 INFO octavia.controller.queue.endpoint [req-a847952a-daeb-4728-92d3-e4e28d1bfc80 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c888a934-eda4-4db0-954f-46a9478de235'... >2018-07-12 07:26:05.109 23 INFO octavia.controller.queue.endpoint [req-ca812b81-ac6a-47a5-be2f-4641c045a1e2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '886ebe00-dc1a-4678-a86e-c99eac3401d3'... >2018-07-12 07:26:09.997 23 INFO octavia.controller.queue.endpoint [req-6c2bd34b-b030-464b-ac22-984fea2c022e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '35eef8e0-e891-4a8c-aa8c-d33a40e69559'... >2018-07-12 07:27:31.455 23 INFO octavia.controller.queue.endpoint [req-91354eb2-6bb7-40b9-a220-fa0b88361cb2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'f89af06f-115c-4950-8a4c-044361a63c83'... >2018-07-12 07:27:31.567 23 INFO octavia.controller.worker.tasks.database_tasks [req-91354eb2-6bb7-40b9-a220-fa0b88361cb2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id b6ae1529-30b9-435f-a20a-304481a7aa34 >2018-07-12 07:27:31.585 23 INFO octavia.certificates.generator.local [req-91354eb2-6bb7-40b9-a220-fa0b88361cb2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 07:27:31.586 23 INFO octavia.certificates.generator.local [req-91354eb2-6bb7-40b9-a220-fa0b88361cb2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 07:27:31.586 23 INFO octavia.certificates.generator.local [req-91354eb2-6bb7-40b9-a220-fa0b88361cb2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 07:27:31.586 23 INFO octavia.certificates.generator.local [req-91354eb2-6bb7-40b9-a220-fa0b88361cb2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 07:27:46.493 23 INFO octavia.controller.worker.tasks.database_tasks [req-91354eb2-6bb7-40b9-a220-fa0b88361cb2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: b6ae1529-30b9-435f-a20a-304481a7aa34 with compute id d41ff240-4a84-40ec-a1fd-8d6e9c1d5630 for load balancer: f89af06f-115c-4950-8a4c-044361a63c83 >2018-07-12 07:27:46.580 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-91354eb2-6bb7-40b9-a220-fa0b88361cb2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 8dba06f5-dec2-48c5-b084-b38a7a26b2f1 already exists. Nothing to be done. >2018-07-12 07:28:02.087 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-91354eb2-6bb7-40b9-a220-fa0b88361cb2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.32', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.153.11 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700500090>, 'Connection to 172.24.0.32 timed out. (connect timeout=10.0)')) >2018-07-12 07:28:11.617 23 INFO octavia.controller.worker.tasks.database_tasks [req-91354eb2-6bb7-40b9-a220-fa0b88361cb2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f89af06f-115c-4950-8a4c-044361a63c83 >2018-07-12 07:28:12.226 23 INFO octavia.controller.queue.endpoint [req-8abebbd1-93f4-4274-b1cb-adf4b7956529 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '7f79bf42-3520-4b4d-8d67-901a27e5f457'... >2018-07-12 07:28:17.668 23 INFO octavia.controller.queue.endpoint [req-08d5776d-cbdc-4e49-a95f-9facbc213344 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '5c19d413-6ea2-4c15-9bdd-36eabde8f137'... >2018-07-12 07:28:23.575 23 INFO octavia.controller.queue.endpoint [req-91d6a19d-5b1c-48c1-b64a-b2e68b39059e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'fb2d1900-f397-4dab-9324-caaab48c7ed3'... >2018-07-12 07:29:29.678 23 INFO octavia.controller.queue.endpoint [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'f1022762-3823-4f64-a8d2-7ea95f24e435'... >2018-07-12 07:29:29.906 23 INFO octavia.controller.worker.tasks.database_tasks [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 16d1f7b6-5d50-440c-a9bf-c657741a6c74 >2018-07-12 07:29:30.048 23 INFO octavia.certificates.generator.local [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 07:29:30.048 23 INFO octavia.certificates.generator.local [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 07:29:30.049 23 INFO octavia.certificates.generator.local [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 07:29:30.049 23 INFO octavia.certificates.generator.local [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 07:29:43.149 23 INFO octavia.controller.worker.tasks.database_tasks [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 16d1f7b6-5d50-440c-a9bf-c657741a6c74 with compute id 1626837c-fa75-430d-83f0-d12977c258c0 for load balancer: f1022762-3823-4f64-a8d2-7ea95f24e435 >2018-07-12 07:29:43.240 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port a312ed55-8980-4599-a054-e49823fc209f already exists. Nothing to be done. >2018-07-12 07:29:51.376 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.40', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.31.2 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470066d710>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-12 07:30:01.006 23 INFO octavia.controller.worker.tasks.database_tasks [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f1022762-3823-4f64-a8d2-7ea95f24e435 >2018-07-12 07:30:14.188 23 INFO octavia.controller.queue.endpoint [req-2898fd1e-f8d5-4071-a4e6-67bb7d285ad5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'a8490be6-b197-41dc-a0ef-083c5fd16918'... >2018-07-12 07:30:19.046 23 INFO octavia.controller.queue.endpoint [req-74340982-47fa-4172-8ea6-e64ec77ca488 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '58384dab-37b9-4232-b5f7-71e6c78dd391'... >2018-07-12 07:30:23.722 23 INFO octavia.controller.queue.endpoint [req-96a6fa96-611c-46e6-bed4-9750387bf163 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1e3005e7-c22f-4273-bd70-804bfb27370f'... >2018-07-12 07:48:19.163 23 INFO octavia.controller.queue.endpoint [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'f0d71bce-f757-43bd-942c-28f824b87789'... >2018-07-12 07:48:19.295 23 INFO octavia.controller.worker.tasks.database_tasks [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 5b405a43-2012-4858-8fac-5fbdf1f75ef2 >2018-07-12 07:48:19.334 23 INFO octavia.certificates.generator.local [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 07:48:19.334 23 INFO octavia.certificates.generator.local [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 07:48:19.334 23 INFO octavia.certificates.generator.local [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 07:48:19.335 23 INFO octavia.certificates.generator.local [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 07:48:33.209 23 INFO octavia.controller.worker.tasks.database_tasks [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 5b405a43-2012-4858-8fac-5fbdf1f75ef2 with compute id 7251bc43-3776-4420-926d-485803a513da for load balancer: f0d71bce-f757-43bd-942c-28f824b87789 >2018-07-12 07:48:33.505 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 4b75aaee-93dd-486f-8061-e439cdbd7960 already exists. Nothing to be done. >2018-07-12 07:48:40.920 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.28', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.240.191 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47080bbe90>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-12 07:48:50.470 23 INFO octavia.controller.worker.tasks.database_tasks [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f0d71bce-f757-43bd-942c-28f824b87789 >2018-07-12 07:49:02.934 23 INFO octavia.controller.queue.endpoint [req-6d8be6b0-8d89-426a-b903-181b7f10d039 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '4c1e662a-3480-4487-b625-6da5833b8ac1'... >2018-07-12 07:49:08.171 23 INFO octavia.controller.queue.endpoint [req-155dd8e1-13ec-47da-907a-d5a2aba17469 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '3f74085a-fd08-47ed-865c-7a6da3593600'... >2018-07-12 07:49:13.290 23 INFO octavia.controller.queue.endpoint [req-7e51db64-360a-4639-9c0e-baf555924289 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '21425ccb-cb3d-48e8-909d-65e3874e0c4a'... >2018-07-12 07:49:18.147 23 INFO octavia.controller.queue.endpoint [req-a99b1efd-7799-4b82-bc34-9b1854ecd24c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd82f29b3-443b-4069-900b-fe6237a6c820'... >2018-07-12 07:50:39.159 23 INFO octavia.controller.queue.endpoint [req-775b5b69-12e3-4941-94b1-e44deb49aa90 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4b2736dd-61d1-47f1-bda9-6f900237f87f'... >2018-07-12 07:50:49.372 23 INFO octavia.controller.queue.endpoint [req-8e25c6a2-38cb-43fc-922f-c0bd24f7f12c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e92b51ff-7b65-478e-b1b1-1d35443869c4'... >2018-07-12 07:50:59.444 23 INFO octavia.controller.queue.endpoint [req-fd842070-2df6-413c-9aa3-f630efdf9f8b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9ed83b57-e55e-436a-8be8-53bc9fffd019'... >2018-07-12 08:04:49.577 23 INFO octavia.controller.queue.endpoint [req-b102530a-bc4c-4406-9d66-54c367bc8eb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c65ef623-c90e-4279-ace4-30ce8821e35f'... >2018-07-12 08:04:55.151 23 INFO octavia.controller.queue.endpoint [req-0fa56443-a7da-4844-81aa-005004827f53 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd4b0aec8-ae22-4652-b18d-4822be6d6e11'... >2018-07-12 08:05:02.117 23 INFO octavia.controller.queue.endpoint [req-2b936d8c-e695-42c5-bac7-7dd00291ad69 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5fb3cacb-1da2-4b75-8282-1889cedba526'... >2018-07-12 08:05:02.184 23 INFO octavia.controller.queue.endpoint [req-aa14dc7a-95fd-4618-9a03-270da0e788f1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '02681d7e-0f02-4ae5-8209-d34dda5feb28'... >2018-07-12 08:05:02.276 23 INFO octavia.controller.queue.endpoint [req-b1f55b79-a1c7-44d7-bf25-994054e488e8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2f8aa960-2e2e-41cc-a706-b2ef8a791640'... >2018-07-12 08:05:07.488 23 INFO octavia.controller.queue.endpoint [req-15fc6e27-ae36-4fcf-acbf-21f91f19a3b5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f62f58ff-db3b-4028-8e4a-461adedd5346'... >2018-07-12 08:05:07.790 23 INFO octavia.controller.queue.endpoint [req-11932480-0860-49da-93fe-71d1336b3ff4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9eb74750-51d9-4659-9729-26cbae04ee9f'... >2018-07-12 08:05:08.006 23 INFO octavia.controller.queue.endpoint [req-f8bd51b1-bd16-4e95-9e79-b3c563fdeec7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4a958bda-8091-4b10-8d43-c7b544fe9222'... >2018-07-12 08:05:11.424 23 INFO octavia.controller.queue.endpoint [req-5dd09eb1-a0a4-4f14-bbd2-ed031ac07967 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '24b438bf-32ed-49f0-8bbd-a9d8331718f7'... >2018-07-12 08:05:16.872 23 INFO octavia.controller.queue.endpoint [req-929a5a23-c72a-460d-8472-cf05c0a67680 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f57ba48e-e11a-4232-9b19-ba6187095e90'... >2018-07-12 08:05:22.120 23 INFO octavia.controller.queue.endpoint [req-3bf0bdae-3862-4b4d-8c7d-43f98f30c95b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2e4b2958-4746-4614-95dd-6bcec619f3af'... >2018-07-12 08:06:15.755 23 INFO octavia.controller.queue.endpoint [req-294d22f8-1956-400b-9c2c-ac9003ea658e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c888a934-eda4-4db0-954f-46a9478de235'... >2018-07-12 08:06:15.847 23 INFO octavia.controller.queue.endpoint [req-742e9238-0c3b-4256-9973-ec2b02f7a569 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '88d022f6-a463-4d06-b252-8cda64b6a3ab'... >2018-07-12 08:06:21.026 23 INFO octavia.controller.queue.endpoint [req-89739c48-ace6-4a8a-a3c0-a8df4643f822 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '257748c3-a681-4233-8ab4-a81068304557'... >2018-07-12 08:06:21.287 23 INFO octavia.controller.queue.endpoint [req-9112a54d-2cea-4e9b-958a-d232f8ed2d40 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a1d6ed48-bb5f-4691-be25-64772ffab327'... >2018-07-12 08:06:25.454 23 INFO octavia.controller.queue.endpoint [req-1dd4cce4-bdd1-4ab0-8436-e61910214650 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '35eef8e0-e891-4a8c-aa8c-d33a40e69559'... >2018-07-12 08:06:30.291 23 INFO octavia.controller.queue.endpoint [req-b35405d5-74ea-42a3-82c1-2a78ef536292 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3af95abd-aa21-4b56-b833-7579c5bb3941'... >2018-07-12 08:31:37.768 23 INFO octavia.controller.queue.endpoint [req-348f20d1-b7cb-4239-b8a8-7a28261ffda7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '257748c3-a681-4233-8ab4-a81068304557'... >2018-07-12 08:31:37.863 23 INFO octavia.controller.queue.endpoint [req-ecc324f2-9bda-486b-bc97-c5bcf525844c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a1d6ed48-bb5f-4691-be25-64772ffab327'... >2018-07-12 08:31:43.500 23 INFO octavia.controller.queue.endpoint [req-86d13d37-c1e0-4f57-8488-fe679e3b2d9d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e9a2942f-adc7-447c-a80d-b39ee9a5253e'... >2018-07-12 08:31:43.772 23 INFO octavia.controller.queue.endpoint [req-e94c5f80-c588-4dc7-905c-d86941030f75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b01e5ed0-977f-4f10-b4c3-fd34eca52968'... >2018-07-12 08:32:08.338 23 INFO octavia.controller.queue.endpoint [req-4f6cee2b-7df0-4f9e-a19f-781030d3b5af - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '3af95abd-aa21-4b56-b833-7579c5bb3941'... >2018-07-12 08:32:13.743 23 INFO octavia.controller.queue.endpoint [req-c0ffc994-ffa2-4d7c-a647-ce409bbe0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ff6f14dd-b146-42de-8c89-59814b0b83cd'... >2018-07-12 08:45:42.768 23 INFO octavia.controller.queue.endpoint [req-329ddfbb-950a-481e-83ea-da4ede3a5c55 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '052a22fe-748a-4220-bf52-e751767e26dc'... >2018-07-12 08:45:53.016 23 INFO octavia.controller.queue.endpoint [req-fef0931e-ae6e-42c3-af64-7b5afcc893f6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '900fb6f1-a94e-41e7-8c1f-df5bc94dc383'... >2018-07-12 08:46:01.523 23 INFO octavia.controller.queue.endpoint [req-5ca8e3d1-b5f8-464d-8a1c-57daa2b331ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cb1f2fba-38ea-4eb9-8396-74bf6be4cc7a'... >2018-07-12 09:03:31.171 23 INFO octavia.controller.queue.endpoint [req-1a957867-afaa-4d20-9d2f-45772226d585 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd4b0aec8-ae22-4652-b18d-4822be6d6e11'... >2018-07-12 09:03:36.913 23 INFO octavia.controller.queue.endpoint [req-c9aae8e4-fa96-45e5-bf1a-c0be1402717d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7bf495f6-9cdf-4b73-aae6-2f47a9f4d9b0'... >2018-07-12 09:03:38.219 23 INFO octavia.controller.queue.endpoint [req-5a707261-075c-4c39-b7b6-0fd9d142fcc3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '24b438bf-32ed-49f0-8bbd-a9d8331718f7'... >2018-07-12 09:03:47.999 23 INFO octavia.controller.queue.endpoint [req-e6bca95b-71eb-4966-9d3e-274a4f455294 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f57ba48e-e11a-4232-9b19-ba6187095e90'... >2018-07-12 09:03:58.088 23 INFO octavia.controller.queue.endpoint [req-1f4a3862-3c21-43af-bc22-339b083ae69a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2e4b2958-4746-4614-95dd-6bcec619f3af'... >2018-07-12 09:04:03.766 23 INFO octavia.controller.queue.endpoint [req-a2ddb85e-bc7a-49d9-b7ce-be5e88a2af97 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0fb3f272-1974-4f5c-8100-f73e53901cff'... >2018-07-12 09:04:09.186 23 INFO octavia.controller.queue.endpoint [req-3205f8dc-f07b-4aba-83d0-0bf6f9c3a35f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c03e77b8-1719-41f6-bb2a-753a27f7664b'... >2018-07-12 09:04:14.353 23 INFO octavia.controller.queue.endpoint [req-4dd69781-2abc-4991-910a-e5a35f8ec950 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0e55b0b5-b1e6-48ec-b9a4-bf99bd2b364c'... >2018-07-12 09:04:22.414 23 INFO octavia.controller.queue.endpoint [req-e84e0860-87f0-4c30-a685-53d9fd00c2f4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4a958bda-8091-4b10-8d43-c7b544fe9222'... >2018-07-12 09:04:22.452 23 INFO octavia.controller.queue.endpoint [req-195158b5-4300-4f25-a8eb-550c012cdfd4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9eb74750-51d9-4659-9729-26cbae04ee9f'... >2018-07-12 09:04:22.539 23 INFO octavia.controller.queue.endpoint [req-46104fce-db45-4f22-90a3-09ef5b51fda9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f62f58ff-db3b-4028-8e4a-461adedd5346'... >2018-07-12 09:04:27.804 23 INFO octavia.controller.queue.endpoint [req-bf6efee4-067f-41ea-9418-cd51ace5555b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3a003380-8c0f-4fae-8fbc-a709b2776977'... >2018-07-12 09:04:28.274 23 INFO octavia.controller.queue.endpoint [req-d5c7f7b6-bbab-4e5c-ab11-df556e563855 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '512e7424-128a-45de-9c2b-04de68f5ab16'... >2018-07-12 09:04:28.455 23 INFO octavia.controller.queue.endpoint [req-cdb0c5d2-fe9a-42ac-ba9a-4569396a6a60 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f6495d9e-a5de-4c10-9ed4-ccda47159abb'... >2018-07-12 09:05:21.696 23 INFO octavia.controller.queue.endpoint [req-3116d65c-1b13-4548-be6d-4fa98bd24354 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3af3d87f-728e-40d9-90c8-f699d7c12ca0'... >2018-07-12 09:05:26.905 23 INFO octavia.controller.queue.endpoint [req-66d9f1db-a604-442f-b63e-3b5d2d2b5f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1441ba98-2be5-41a2-8e28-b43ebddbeb82'... >2018-07-12 09:05:32.366 23 INFO octavia.controller.queue.endpoint [req-2aa864f1-ca51-4b01-8177-f110afbc0577 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b824f55c-596c-4cac-a7ee-43717032cdaa'... >2018-07-12 09:19:35.039 23 INFO octavia.controller.queue.endpoint [req-5edcc706-b09d-4030-9061-1871a07edde1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '3af3d87f-728e-40d9-90c8-f699d7c12ca0'... >2018-07-12 09:19:45.173 23 INFO octavia.controller.queue.endpoint [req-1118fe34-7124-4d41-ad02-dc7472f1b5e8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1441ba98-2be5-41a2-8e28-b43ebddbeb82'... >2018-07-12 09:19:55.182 23 INFO octavia.controller.queue.endpoint [req-55dc512f-44e7-43b2-a87e-66f039d0479c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b824f55c-596c-4cac-a7ee-43717032cdaa'... >2018-07-12 09:26:14.740 23 INFO octavia.controller.queue.endpoint [req-5523e9d8-e102-4a0f-bcfd-a3d528920111 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '5771c255-10ba-4377-9afe-8cc71fb28142'... >2018-07-12 09:26:14.869 23 INFO octavia.controller.worker.tasks.database_tasks [req-5523e9d8-e102-4a0f-bcfd-a3d528920111 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id f34e257b-3e90-4957-9a81-afe84428bfba >2018-07-12 09:26:15.009 23 INFO octavia.certificates.generator.local [req-5523e9d8-e102-4a0f-bcfd-a3d528920111 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 09:26:15.010 23 INFO octavia.certificates.generator.local [req-5523e9d8-e102-4a0f-bcfd-a3d528920111 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 09:26:15.010 23 INFO octavia.certificates.generator.local [req-5523e9d8-e102-4a0f-bcfd-a3d528920111 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 09:26:15.011 23 INFO octavia.certificates.generator.local [req-5523e9d8-e102-4a0f-bcfd-a3d528920111 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 09:26:15.837 23 INFO octavia.controller.queue.endpoint [req-b6af6dd8-b728-4bd0-b22c-e8c1a97d092e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '79eadec6-792e-4cfa-8be3-87c21b816ec2'... >2018-07-12 09:26:15.956 23 INFO octavia.controller.worker.tasks.database_tasks [req-b6af6dd8-b728-4bd0-b22c-e8c1a97d092e - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id d4dc329f-e1b2-4599-9673-9c9fcb779fcb >2018-07-12 09:26:16.003 23 INFO octavia.certificates.generator.local [req-b6af6dd8-b728-4bd0-b22c-e8c1a97d092e - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 09:26:16.004 23 INFO octavia.certificates.generator.local [req-b6af6dd8-b728-4bd0-b22c-e8c1a97d092e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 09:26:16.004 23 INFO octavia.certificates.generator.local [req-b6af6dd8-b728-4bd0-b22c-e8c1a97d092e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 09:26:16.004 23 INFO octavia.certificates.generator.local [req-b6af6dd8-b728-4bd0-b22c-e8c1a97d092e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 09:26:29.656 23 INFO octavia.controller.worker.tasks.database_tasks [req-5523e9d8-e102-4a0f-bcfd-a3d528920111 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: f34e257b-3e90-4957-9a81-afe84428bfba with compute id 7aa06c14-b1f9-4236-a3c9-5b9d9aa82b71 for load balancer: 5771c255-10ba-4377-9afe-8cc71fb28142 >2018-07-12 09:26:29.747 23 INFO octavia.controller.worker.tasks.database_tasks [req-b6af6dd8-b728-4bd0-b22c-e8c1a97d092e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: d4dc329f-e1b2-4599-9673-9c9fcb779fcb with compute id e8bc8862-e808-41ce-b3c2-162103502d51 for load balancer: 79eadec6-792e-4cfa-8be3-87c21b816ec2 >2018-07-12 09:26:29.963 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-5523e9d8-e102-4a0f-bcfd-a3d528920111 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port b1d1a9fc-741a-443e-bd7c-9b0d06bddfa1 already exists. Nothing to be done. >2018-07-12 09:26:30.061 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b6af6dd8-b728-4bd0-b22c-e8c1a97d092e - 293061856e1a4cffbae3ed099cf4f619 - - -] Port b24a9ee2-a06e-47b6-bd3c-c3f71c46890f already exists. Nothing to be done. >2018-07-12 09:26:41.142 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-b6af6dd8-b728-4bd0-b22c-e8c1a97d092e - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.35', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.6.231 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700531590>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-12 09:26:48.648 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-5523e9d8-e102-4a0f-bcfd-a3d528920111 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.34', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.87.95 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47006e59d0>, 'Connection to 172.24.0.34 timed out. (connect timeout=10.0)')) >2018-07-12 09:26:50.737 23 INFO octavia.controller.worker.tasks.database_tasks [req-b6af6dd8-b728-4bd0-b22c-e8c1a97d092e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 79eadec6-792e-4cfa-8be3-87c21b816ec2 >2018-07-12 09:26:55.878 23 INFO octavia.controller.queue.endpoint [req-bc8b4547-253f-4e0f-884e-35f9285bb828 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '0fa869a6-1ad7-4fd5-881f-93c2ce6b4505'... >2018-07-12 09:26:58.221 23 INFO octavia.controller.worker.tasks.database_tasks [req-5523e9d8-e102-4a0f-bcfd-a3d528920111 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 5771c255-10ba-4377-9afe-8cc71fb28142 >2018-07-12 09:27:01.030 23 INFO octavia.controller.queue.endpoint [req-45dbbc56-9a69-4940-80e7-574eedfa63ff - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '10114c74-4728-4654-9a9c-5266270b1de0'... >2018-07-12 09:27:06.004 23 INFO octavia.controller.queue.endpoint [req-cc37909b-2977-4a08-a03e-0f1dfb252b2e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5cd56eb7-b472-4619-af52-c7c00b07876b'... >2018-07-12 09:27:10.126 23 INFO octavia.controller.queue.endpoint [req-10a540f9-c575-4c4d-a0f3-f9ac00f0b5ef - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '20eb6035-5a7c-40de-90d4-b35dcc581402'... >2018-07-12 09:27:10.799 23 INFO octavia.controller.queue.endpoint [req-4a310668-3dff-433f-890b-aed204830a5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4944f711-21c6-412a-9260-0a523a97b865'... >2018-07-12 09:27:15.513 23 INFO octavia.controller.queue.endpoint [req-429bfb29-14c8-46d1-a60d-36af110aefae - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '0dd4fb3a-4e65-461d-b18a-b79af4d49e62'... >2018-07-12 09:27:20.454 23 INFO octavia.controller.queue.endpoint [req-e20fb6c1-02c7-48d9-86c8-3527acce2f45 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a4f4b421-95c2-4699-af02-295c29811d99'... >2018-07-12 09:37:16.009 23 INFO octavia.controller.queue.endpoint [req-c6b9cb2e-13c0-40d4-a30e-93efe77b53c6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5cd56eb7-b472-4619-af52-c7c00b07876b'... >2018-07-12 09:37:25.230 23 INFO octavia.controller.queue.endpoint [req-28cd0c66-1876-416f-b1ab-79ece88f46c1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4944f711-21c6-412a-9260-0a523a97b865'... >2018-07-12 09:37:30.783 23 INFO octavia.controller.queue.endpoint [req-18d36340-a743-424b-aa4f-cb5139733130 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cf94f157-66f6-4120-952c-eb8875e28cde'... >2018-07-12 09:37:33.455 23 INFO octavia.controller.queue.endpoint [req-b31ee482-152f-497e-b0af-3b3f498a2dc2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a4f4b421-95c2-4699-af02-295c29811d99'... >2018-07-12 09:37:36.543 23 INFO octavia.controller.queue.endpoint [req-0785863a-cf57-40aa-8355-4569ec422377 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8d32aaac-f58b-4e37-a5d6-1d8d89681850'... >2018-07-12 09:37:38.717 23 INFO octavia.controller.queue.endpoint [req-6816656f-df67-47da-8826-5629d1aaa87b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6c97b2ed-4aa0-4d42-9836-f099edf884c3'... >2018-07-12 09:37:42.929 23 INFO octavia.controller.queue.endpoint [req-ff64055b-eab2-4e1e-8dc2-3bdf74f3c72b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7450ad70-e19f-43ed-b1b9-df1661012ae6'... >2018-07-12 09:37:48.111 23 INFO octavia.controller.queue.endpoint [req-61549934-0a19-428f-a602-1f4aaf59e569 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd0641f1d-3594-46f1-9023-fb7984a924b9'... >2018-07-12 09:37:52.208 23 INFO octavia.controller.queue.endpoint [req-306612f7-a0fb-48fe-af5d-f0e143f1df99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e9a2942f-adc7-447c-a80d-b39ee9a5253e'... >2018-07-12 09:37:52.246 23 INFO octavia.controller.queue.endpoint [req-a4067a79-48d2-4bf2-9bae-5722793102bf - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b01e5ed0-977f-4f10-b4c3-fd34eca52968'... >2018-07-12 09:37:53.360 23 INFO octavia.controller.queue.endpoint [req-a4d4ac82-8f15-48e5-bc9f-97097cf6773c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4341a8da-a2ee-4dfd-a1c9-6db866085474'... >2018-07-12 09:37:57.398 23 INFO octavia.controller.queue.endpoint [req-7e1de72b-36aa-4840-94fe-ba1eafc21663 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ab13300c-e53b-471e-b09e-1a6e1e61759b'... >2018-07-12 09:37:57.680 23 INFO octavia.controller.queue.endpoint [req-897eae7c-8fa0-4ad5-92a3-f2ba01dcc400 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '52555c9b-33a3-4854-a204-ac5ebc694a96'... >2018-07-12 09:41:19.575 23 INFO octavia.controller.queue.endpoint [req-12592474-f73c-4f6c-8e68-358ba7de03ed - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ff6f14dd-b146-42de-8c89-59814b0b83cd'... >2018-07-12 09:41:25.176 23 INFO octavia.controller.queue.endpoint [req-33af11ae-62cc-4c34-990d-c217e49cac5f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c79222a1-2a9f-4287-a049-97937e967d44'... >2018-07-12 10:01:35.479 23 INFO octavia.controller.queue.endpoint [req-5523e9d8-e102-4a0f-bcfd-a3d528920111 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0fb3f272-1974-4f5c-8100-f73e53901cff'... >2018-07-12 10:01:44.941 23 INFO octavia.controller.queue.endpoint [req-442835d8-50f6-4eb0-ad9f-ba38c1636b16 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c03e77b8-1719-41f6-bb2a-753a27f7664b'... >2018-07-12 10:01:54.314 23 INFO octavia.controller.queue.endpoint [req-62ba0377-7634-4f4f-86f1-c164fa849a85 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0e55b0b5-b1e6-48ec-b9a4-bf99bd2b364c'... >2018-07-12 10:23:27.328 23 INFO octavia.controller.queue.endpoint [req-0d6cc883-c732-4ec5-9741-36d931f6e9f6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7450ad70-e19f-43ed-b1b9-df1661012ae6'... >2018-07-12 10:23:36.741 23 INFO octavia.controller.queue.endpoint [req-286e9d63-925a-4ffe-940c-4768ae73f1e7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd0641f1d-3594-46f1-9023-fb7984a924b9'... >2018-07-12 10:23:46.835 23 INFO octavia.controller.queue.endpoint [req-cb14013d-62e9-4ad8-ae69-9dcd2f1311d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4341a8da-a2ee-4dfd-a1c9-6db866085474'... >2018-07-12 10:23:52.272 23 INFO octavia.controller.queue.endpoint [req-8569b07e-6dae-421b-b24d-5eb508667ddf - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '36ff3b60-bbd5-4102-9ee0-af7b4cac36fb'... >2018-07-12 10:23:57.384 23 INFO octavia.controller.queue.endpoint [req-28dd11df-7077-40bb-ad86-e292621f6ee1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6f14b877-7b96-4150-b43a-2cc93d71b157'... >2018-07-12 10:24:02.802 23 INFO octavia.controller.queue.endpoint [req-82dd3146-17eb-4099-ab87-50192996ffb0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6bff70a4-525d-4137-b4dc-1469b312c6d5'... >2018-07-12 10:24:22.277 23 INFO octavia.controller.queue.endpoint [req-44b64252-3650-4d93-bbe0-37fb459a22dc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3471d047-2c35-4294-898d-a8ba7534691c'... >2018-07-12 10:24:27.090 23 INFO octavia.controller.queue.endpoint [req-eadfcb0d-274a-4464-aee2-4192d761af7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '74b403d0-9235-44b8-aec1-780afbc1e1b8'... >2018-07-12 10:24:32.357 23 INFO octavia.controller.queue.endpoint [req-8d318bdb-fe2a-47b7-9530-40898284d8f7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '55bab0a8-dc7d-4fbb-84be-7930a0ba9899'... >2018-07-12 10:25:29.429 23 INFO octavia.controller.queue.endpoint [req-3fd973ba-663a-48b2-b9ee-0b8b3be73488 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '52555c9b-33a3-4854-a204-ac5ebc694a96'... >2018-07-12 10:25:29.515 23 INFO octavia.controller.queue.endpoint [req-9be25936-56d3-4c6a-a0f7-7d0fbb6ad9f4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ab13300c-e53b-471e-b09e-1a6e1e61759b'... >2018-07-12 10:25:33.041 23 INFO octavia.controller.queue.endpoint [req-ea92c102-044e-4799-bbff-eb9b26c4dd0c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c79222a1-2a9f-4287-a049-97937e967d44'... >2018-07-12 10:25:33.984 23 INFO octavia.controller.queue.endpoint [req-de115675-15ad-41e3-8f0a-77aca096db8b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '86abf707-b178-4a13-b054-6ac20626a459'... >2018-07-12 10:25:35.219 23 INFO octavia.controller.queue.endpoint [req-b6af6dd8-b728-4bd0-b22c-e8c1a97d092e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '71f2422f-0ff1-4481-ba90-ef62780635c7'... >2018-07-12 10:25:38.247 23 INFO octavia.controller.queue.endpoint [req-c5b48aed-b2f7-488f-a72f-4b3d148c1419 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '37a0f81c-65e0-41d1-933f-56cba29c1b1f'... >2018-07-12 10:51:43.588 23 INFO octavia.controller.queue.endpoint [req-982a1e36-f082-4b28-8552-bbf670608215 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '36ff3b60-bbd5-4102-9ee0-af7b4cac36fb'... >2018-07-12 10:51:52.873 23 INFO octavia.controller.queue.endpoint [req-a607c9f8-890b-45fc-b22b-375614cab870 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '6f14b877-7b96-4150-b43a-2cc93d71b157'... >2018-07-12 10:52:03.080 23 INFO octavia.controller.queue.endpoint [req-6f77d9ab-6f69-41f3-add8-fe05b38f6640 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '6bff70a4-525d-4137-b4dc-1469b312c6d5'... >2018-07-12 11:04:01.927 23 INFO octavia.controller.queue.endpoint [req-030e48a9-c259-4b1a-a72d-6858ddf7d178 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '3471d047-2c35-4294-898d-a8ba7534691c'... >2018-07-12 11:04:11.633 23 INFO octavia.controller.queue.endpoint [req-f5912dff-c792-4374-8747-beafe82a6ad1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '74b403d0-9235-44b8-aec1-780afbc1e1b8'... >2018-07-12 11:04:21.701 23 INFO octavia.controller.queue.endpoint [req-bc7e1e71-bc4e-40aa-a09a-0e05d97bd2e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '55bab0a8-dc7d-4fbb-84be-7930a0ba9899'... >2018-07-12 11:04:27.442 23 INFO octavia.controller.queue.endpoint [req-7fdb0578-fab8-4655-82f7-9970b9a0d726 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'fd11393d-5d6c-43ef-8832-aa6e3d22b22e'... >2018-07-12 11:04:32.497 23 INFO octavia.controller.queue.endpoint [req-b5ae28f0-db1b-4dc9-9b22-b6d742b9e1f1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '470ad0d2-0a0a-4e10-8c11-925298991456'... >2018-07-12 11:04:37.950 23 INFO octavia.controller.queue.endpoint [req-81f19a31-33db-493e-9048-fde46381bd3c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b4129de5-c1a0-4834-95c3-eb69358dace1'... >2018-07-12 11:05:51.267 23 INFO octavia.controller.queue.endpoint [req-38715b77-bde1-4e8f-ae55-088b402a1d9b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ae8dd633-d54b-4981-9835-eee9069d9692'... >2018-07-12 11:05:57.169 23 INFO octavia.controller.queue.endpoint [req-87671a34-ef06-419f-aeb7-e172ad2bbd7a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2cf22f2b-c11b-45a9-8d00-ff453598147e'... >2018-07-12 11:06:02.618 23 INFO octavia.controller.queue.endpoint [req-c6083054-8e90-4e14-9451-412ff3dc1b1a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e9320b89-8a72-4ab0-9467-7ec0cff516d7'... >2018-07-12 11:30:42.235 23 INFO octavia.controller.queue.endpoint [req-c8ea695d-0a67-49bc-94e4-9bfba9fc7bbc - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'fd11393d-5d6c-43ef-8832-aa6e3d22b22e'... >2018-07-12 11:30:52.074 23 INFO octavia.controller.queue.endpoint [req-52a2bc36-3c14-40b6-a02f-a57f30b870bf - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '470ad0d2-0a0a-4e10-8c11-925298991456'... >2018-07-12 11:31:02.541 23 INFO octavia.controller.queue.endpoint [req-76ea18e9-31a3-4377-8ef5-586fcea355ca - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b4129de5-c1a0-4834-95c3-eb69358dace1'... >2018-07-12 11:34:53.633 23 INFO octavia.controller.queue.endpoint [req-f03ee458-3256-4398-9d84-d552b1735736 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ae8dd633-d54b-4981-9835-eee9069d9692'... >2018-07-12 11:35:03.337 23 INFO octavia.controller.queue.endpoint [req-23e8cc2d-8565-4cf2-9f3b-7da30863f6ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2cf22f2b-c11b-45a9-8d00-ff453598147e'... >2018-07-12 11:35:13.775 23 INFO octavia.controller.queue.endpoint [req-139498d7-6411-4ac3-972e-c93ab719ece5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e9320b89-8a72-4ab0-9467-7ec0cff516d7'... >2018-07-12 11:35:19.070 23 INFO octavia.controller.queue.endpoint [req-bb38e68c-50ac-4d42-9778-afa037f261f4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cf1b3bbb-9079-45de-9261-0724f4d7b3e1'... >2018-07-12 11:35:24.028 23 INFO octavia.controller.queue.endpoint [req-884d0b3f-0965-48eb-a8f3-520da81d2cb5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '954ebf1e-81da-41c6-a993-26b19c67b65e'... >2018-07-12 11:35:29.590 23 INFO octavia.controller.queue.endpoint [req-3c0527b9-a493-40e7-8f67-6ea586e43c37 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '41523a6c-60d0-4e18-87f1-1b468ddbb237'... >2018-07-12 11:36:11.191 23 INFO octavia.controller.queue.endpoint [req-4d5b7772-9d54-491b-ab08-5b840a764d8a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f8285559-5581-4e06-b667-f0a87284ba85'... >2018-07-12 11:36:16.649 23 INFO octavia.controller.queue.endpoint [req-bde39829-9f63-40fc-8661-c88fa8af79c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '51940fd2-9d84-4d9c-b874-4e724fe75dde'... >2018-07-12 11:36:21.929 23 INFO octavia.controller.queue.endpoint [req-51aae1cc-8822-4fbc-b653-ec6a15d7e1af - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8744ca18-7636-4466-aa09-2e99d4e3700e'... >2018-07-12 12:03:43.873 23 INFO octavia.controller.queue.endpoint [req-5353b1ba-c3ce-4b57-afbe-0dc2b9f549cf - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f8285559-5581-4e06-b667-f0a87284ba85'... >2018-07-12 12:03:53.911 23 INFO octavia.controller.queue.endpoint [req-83000c3f-f99e-4416-8d92-3581928eed76 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '51940fd2-9d84-4d9c-b874-4e724fe75dde'... >2018-07-12 12:04:03.535 23 INFO octavia.controller.queue.endpoint [req-cffa1fbd-ed9f-4add-a8c2-5e05dba9a1ac - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '8744ca18-7636-4466-aa09-2e99d4e3700e'... >2018-07-12 12:21:26.652 23 INFO octavia.controller.queue.endpoint [req-c77f0e7b-fd7a-4459-9dee-ff50c3e748bf - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7dec9d9e-3966-43fc-9314-21aefdc5c814'... >2018-07-12 12:21:32.021 23 INFO octavia.controller.queue.endpoint [req-97157377-a237-42c5-ba0c-d51dc24d714b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'df4938fc-5388-4e09-bbc6-286eb300490c'... >2018-07-12 12:21:37.022 23 INFO octavia.controller.queue.endpoint [req-816a9258-b1d9-4c48-888e-1165fddcca7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4a4ef40d-c7d9-49e0-8ef5-71d161dc7e21'... >2018-07-12 12:22:18.839 23 INFO octavia.controller.queue.endpoint [req-b65a3988-5982-4095-92af-e0d22942e471 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '71f2422f-0ff1-4481-ba90-ef62780635c7'... >2018-07-12 12:22:18.875 23 INFO octavia.controller.queue.endpoint [req-4e5535bb-87af-448d-b51d-51eb7bbc78e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '86abf707-b178-4a13-b054-6ac20626a459'... >2018-07-12 12:22:24.064 23 INFO octavia.controller.queue.endpoint [req-7af31ac8-f623-47e6-a9e3-b2616044a34c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '478e5c17-5073-4224-a98a-91757ba2afa4'... >2018-07-12 12:22:24.216 23 INFO octavia.controller.queue.endpoint [req-6d6ab4cd-789f-422b-89c8-589d71c37b63 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3d269c6b-969a-4bde-b7ab-9ebd5cf6be3d'... >2018-07-12 12:22:46.228 23 INFO octavia.controller.queue.endpoint [req-73eeb51e-7a10-4572-9996-c357b2ce7734 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '37a0f81c-65e0-41d1-933f-56cba29c1b1f'... >2018-07-12 12:22:51.845 23 INFO octavia.controller.queue.endpoint [req-3dd9f590-95dc-4f0f-a63e-c6edea20239d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a39fd529-d3a2-4e48-bc73-7de503c0e2a6'... >2018-07-12 12:35:39.952 23 INFO octavia.controller.queue.endpoint [req-0cd96eed-7aee-48ea-af80-aa1d17e8b916 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cf1b3bbb-9079-45de-9261-0724f4d7b3e1'... >2018-07-12 12:35:50.258 23 INFO octavia.controller.queue.endpoint [req-e77bfe94-23b5-4954-bf20-bc367e668179 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '954ebf1e-81da-41c6-a993-26b19c67b65e'... >2018-07-12 12:36:00.397 23 INFO octavia.controller.queue.endpoint [req-39387c97-ff2a-4866-8ac2-0e32b928571b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '41523a6c-60d0-4e18-87f1-1b468ddbb237'... >2018-07-12 12:40:00.203 23 INFO octavia.controller.queue.endpoint [req-2b38a689-6889-41b9-8e60-3800840ca4fe - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '3d269c6b-969a-4bde-b7ab-9ebd5cf6be3d'... >2018-07-12 12:40:00.265 23 INFO octavia.controller.queue.endpoint [req-948f8d08-27b0-493d-a360-81eb2f6e6ae4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '478e5c17-5073-4224-a98a-91757ba2afa4'... >2018-07-12 12:40:05.093 23 INFO octavia.controller.queue.endpoint [req-49a8982a-ca1a-4820-a062-6a6712f354b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e7d26a2c-e809-4e71-b043-329a1fdc64ee'... >2018-07-12 12:40:05.730 23 INFO octavia.controller.queue.endpoint [req-6ec41061-6498-4edd-b37b-4467718e3d10 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '655eb6ca-0273-440d-8113-0df8062f5781'... >2018-07-12 12:40:10.441 23 INFO octavia.controller.queue.endpoint [req-8e3b7832-2b26-4c1c-a104-21eafbe9c325 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7bf495f6-9cdf-4b73-aae6-2f47a9f4d9b0'... >2018-07-12 12:40:15.781 23 INFO octavia.controller.queue.endpoint [req-aa4c1f8c-5cd7-45fb-9cf0-d25191697c3b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4ca73923-3a60-4df3-bf2b-f207b2ee43d4'... >2018-07-12 12:46:32.425 23 INFO octavia.controller.queue.endpoint [req-2edb2a3f-e57f-4e66-bba4-c48d44bd8c38 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f6495d9e-a5de-4c10-9ed4-ccda47159abb'... >2018-07-12 12:46:32.455 23 INFO octavia.controller.queue.endpoint [req-c9f6017d-f4d4-4318-b28f-8415f5b50c05 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '512e7424-128a-45de-9c2b-04de68f5ab16'... >2018-07-12 12:46:32.555 23 INFO octavia.controller.queue.endpoint [req-f8633cad-3ec5-4f81-8b4e-ce357f0159ef - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '3a003380-8c0f-4fae-8fbc-a709b2776977'... >2018-07-12 12:46:37.846 23 INFO octavia.controller.queue.endpoint [req-6c6b2b3b-5a0a-48e4-b93b-7c1f87e853f1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b69e27d8-ae51-4f82-83c7-baa41df4f99a'... >2018-07-12 12:46:38.163 23 INFO octavia.controller.queue.endpoint [req-5297487c-d372-4ad0-9f3a-26b746f9291f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '388e352b-78ae-42ed-918b-102d689bb241'... >2018-07-12 12:46:38.356 23 INFO octavia.controller.queue.endpoint [req-8b9718c1-7aa8-4eb3-84de-0ff2607ef57b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b162fbcb-13d8-4b9c-a396-e67d29087481'... >2018-07-12 12:46:43.995 23 INFO octavia.controller.queue.endpoint [req-60ae3a51-74f2-4c92-baef-2536ec5fed89 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'db10a947-ecd8-4a8d-8089-c50578e189db'... >2018-07-12 12:46:49.471 23 INFO octavia.controller.queue.endpoint [req-f3d6ff69-7c99-40af-be06-509f242001e1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5da6def1-9562-4d29-8fc8-eafd2a9f1306'... >2018-07-12 12:46:54.837 23 INFO octavia.controller.queue.endpoint [req-e38763fa-e1de-4af8-9702-5885b168c61b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'dc96c618-422c-4375-96bd-1f80552a6203'... >2018-07-12 12:48:24.401 23 INFO octavia.controller.queue.endpoint [req-c9467e59-bb91-4b50-ad0c-9f38122d5658 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a39fd529-d3a2-4e48-bc73-7de503c0e2a6'... >2018-07-12 12:48:29.390 23 INFO octavia.controller.queue.endpoint [req-0f0732aa-a2d7-4148-8095-4341151b517b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0dd7f373-f22f-4335-8abb-1396a3051037'... >2018-07-12 13:01:47.228 23 INFO octavia.controller.queue.endpoint [req-9bf879a2-6112-47a0-8e64-0aebcdfdbf7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'db10a947-ecd8-4a8d-8089-c50578e189db'... >2018-07-12 13:01:56.611 23 INFO octavia.controller.queue.endpoint [req-1f681a91-1d41-4ac8-a16f-d48748f45ad4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5da6def1-9562-4d29-8fc8-eafd2a9f1306'... >2018-07-12 13:02:05.926 23 INFO octavia.controller.queue.endpoint [req-094fd533-0b99-4fcc-84e7-dfbd94b03ecf - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'dc96c618-422c-4375-96bd-1f80552a6203'... >2018-07-12 13:15:22.388 23 INFO octavia.controller.queue.endpoint [req-a813db5d-3066-4c5a-b126-8dfb347d9429 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7dec9d9e-3966-43fc-9314-21aefdc5c814'... >2018-07-12 13:15:32.251 23 INFO octavia.controller.queue.endpoint [req-080a2107-c8ab-4ddd-b45a-3b811f558a10 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'df4938fc-5388-4e09-bbc6-286eb300490c'... >2018-07-12 13:15:42.489 23 INFO octavia.controller.queue.endpoint [req-8f0b8391-86fd-4da2-b5ce-c8b5a28bea44 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4a4ef40d-c7d9-49e0-8ef5-71d161dc7e21'... >2018-07-12 13:15:46.652 23 INFO octavia.controller.queue.endpoint [req-022398a9-fdb2-4941-afa5-d37098ca9ea5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4ca73923-3a60-4df3-bf2b-f207b2ee43d4'... >2018-07-12 13:15:47.714 23 INFO octavia.controller.queue.endpoint [req-d8a98659-dc12-4ef9-8d83-e4851fddef45 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2c47c5dc-6145-4817-8fe7-0a186631bcf6'... >2018-07-12 13:15:52.715 23 INFO octavia.controller.queue.endpoint [req-6333c0ea-ef71-400f-9e6d-cdc7a61b511e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2fc94546-ba0e-4fc2-a26d-5de7f18bb564'... >2018-07-12 13:15:52.912 23 INFO octavia.controller.queue.endpoint [req-7c1be85c-823e-42dd-8d97-ef83836f5d40 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6a44e0d9-b53c-47e5-83b1-ddf8c3ec209a'... >2018-07-12 13:15:58.397 23 INFO octavia.controller.queue.endpoint [req-c34a9d1b-d296-4882-9519-1e4a7eda48cb - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e7d26a2c-e809-4e71-b043-329a1fdc64ee'... >2018-07-12 13:15:58.458 23 INFO octavia.controller.queue.endpoint [req-29093f92-59e3-4b49-83b2-0e041779e4eb - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '655eb6ca-0273-440d-8113-0df8062f5781'... >2018-07-12 13:15:58.721 23 INFO octavia.controller.queue.endpoint [req-43e63909-319d-45f2-a152-bb60470eafe4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1deb0a7a-c95c-47a8-b73b-e125ac598c47'... >2018-07-12 13:15:58.950 23 INFO octavia.controller.queue.endpoint [req-010ffc5d-b075-4815-8504-66003d062d9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '34224081-52a0-4a9f-a88c-33d135606337'... >2018-07-12 13:16:04.074 23 INFO octavia.controller.queue.endpoint [req-55d0c4e0-2bed-4447-8543-a6924fa47b6e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b1cc053a-143c-4354-a0cd-5a1d15740a71'... >2018-07-12 13:17:02.701 23 INFO octavia.controller.queue.endpoint [req-3940ef83-333d-4132-a60e-6fb84ac451f8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0978509b-e998-4747-8072-19ed0dbe4a34'... >2018-07-12 13:17:07.961 23 INFO octavia.controller.queue.endpoint [req-0d123a49-06dc-48d1-9703-7f3f895117ed - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '67c0869d-0cb6-4d8d-b9f6-bb3ef11d9ec2'... >2018-07-12 13:17:13.165 23 INFO octavia.controller.queue.endpoint [req-5d5ba160-b7f1-479d-a981-91d8110bcb50 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f5022acb-bba5-4b49-aac4-1cb2efe3fa22'... >2018-07-12 13:18:18.428 23 INFO octavia.controller.queue.endpoint [req-6c5f50e9-9e2a-44a6-beeb-bba0d04388e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0dd7f373-f22f-4335-8abb-1396a3051037'... >2018-07-12 13:18:23.349 23 INFO octavia.controller.queue.endpoint [req-a6e7f9eb-5747-48d6-a94f-56a4057417f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '829b25bb-8740-4198-b9b3-a29d131b5276'... >2018-07-12 13:38:33.799 23 INFO octavia.controller.queue.endpoint [req-49ea725b-0a7e-4b44-9a41-2aac97ed4b49 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '18c3e42d-490f-40ed-9ce4-088e18116100'... >2018-07-12 13:38:33.912 23 INFO octavia.controller.worker.tasks.database_tasks [req-49ea725b-0a7e-4b44-9a41-2aac97ed4b49 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 89aa761d-ae07-4912-b6c7-6eeb282aea6d >2018-07-12 13:38:34.058 23 INFO octavia.certificates.generator.local [req-49ea725b-0a7e-4b44-9a41-2aac97ed4b49 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 13:38:34.059 23 INFO octavia.certificates.generator.local [req-49ea725b-0a7e-4b44-9a41-2aac97ed4b49 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 13:38:34.059 23 INFO octavia.certificates.generator.local [req-49ea725b-0a7e-4b44-9a41-2aac97ed4b49 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 13:38:34.059 23 INFO octavia.certificates.generator.local [req-49ea725b-0a7e-4b44-9a41-2aac97ed4b49 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 13:38:49.148 23 INFO octavia.controller.worker.tasks.database_tasks [req-49ea725b-0a7e-4b44-9a41-2aac97ed4b49 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 89aa761d-ae07-4912-b6c7-6eeb282aea6d with compute id 8d7c3382-f7fd-4e5e-9748-3cf49b917e3b for load balancer: 18c3e42d-490f-40ed-9ce4-088e18116100 >2018-07-12 13:38:49.974 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-49ea725b-0a7e-4b44-9a41-2aac97ed4b49 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 2e19e563-18d8-44f6-8a2c-2d130651f1d9 already exists. Nothing to be done. >2018-07-12 13:38:57.556 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-49ea725b-0a7e-4b44-9a41-2aac97ed4b49 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.43', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.19.193 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47080b91d0>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-12 13:39:07.131 23 INFO octavia.controller.worker.tasks.database_tasks [req-49ea725b-0a7e-4b44-9a41-2aac97ed4b49 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 18c3e42d-490f-40ed-9ce4-088e18116100 >2018-07-12 13:39:14.505 23 INFO octavia.controller.queue.endpoint [req-8ec9b064-edcd-4c63-8405-03ff90581f31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '2203e97b-0a5a-4b49-85f6-ff3b03a265f1'... >2018-07-12 13:39:18.989 23 INFO octavia.controller.queue.endpoint [req-8d839399-c489-4c69-84cd-f0fad20155ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '2784b65e-95c0-41b9-9884-c8b72e149a9b'... >2018-07-12 13:39:24.303 23 INFO octavia.controller.queue.endpoint [req-35b69414-7df9-4c34-b441-db7cd691c942 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c07f555c-6b79-4eef-8367-902698287060'... >2018-07-12 13:39:29.560 23 INFO octavia.controller.queue.endpoint [req-f76e9285-11a7-46a0-9989-a7c30775962f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '283a89c3-2076-41c6-9fcb-88ec1d1c0bef'... >2018-07-12 13:40:37.196 23 INFO octavia.controller.queue.endpoint [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '6490007e-8c2a-4655-8bf5-ec0a63a88a58'... >2018-07-12 13:40:37.427 23 INFO octavia.controller.worker.tasks.database_tasks [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 3234efac-7136-4c3a-8633-51b7cdbf46bf >2018-07-12 13:40:37.498 23 INFO octavia.certificates.generator.local [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 13:40:37.498 23 INFO octavia.certificates.generator.local [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 13:40:37.498 23 INFO octavia.certificates.generator.local [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 13:40:37.499 23 INFO octavia.certificates.generator.local [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 13:40:50.600 23 INFO octavia.controller.worker.tasks.database_tasks [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 3234efac-7136-4c3a-8633-51b7cdbf46bf with compute id d367e37f-e095-463a-b4ce-92401cb5a02b for load balancer: 6490007e-8c2a-4655-8bf5-ec0a63a88a58 >2018-07-12 13:40:50.928 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 76832527-4f07-4b7d-a86c-8159546236ad already exists. Nothing to be done. >2018-07-12 13:40:57.257 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.39', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.36.9 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47004ce290>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-12 13:41:06.779 23 INFO octavia.controller.worker.tasks.database_tasks [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 6490007e-8c2a-4655-8bf5-ec0a63a88a58 >2018-07-12 13:41:17.824 23 INFO octavia.controller.queue.endpoint [req-a38ef94f-f548-481d-9d25-13190493cb57 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'b12beba5-7a82-4fab-979d-58228f14aacb'... >2018-07-12 13:41:23.350 23 INFO octavia.controller.queue.endpoint [req-c5dfb175-4d2d-4def-9838-40928552e94e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '474677df-19cd-4656-9d7f-000341fbb69d'... >2018-07-12 13:41:28.525 23 INFO octavia.controller.queue.endpoint [req-1fa10d32-b456-4aec-ba18-1de3fddcad69 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cdf471fb-d033-41d9-9636-784e82561cd6'... >2018-07-12 13:57:34.070 23 INFO octavia.controller.queue.endpoint [req-86db9d9b-76bd-409e-9380-cabfef86ed7d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c07f555c-6b79-4eef-8367-902698287060'... >2018-07-12 14:02:05.186 23 INFO octavia.controller.queue.endpoint [req-69858785-4f13-4c90-9e68-0aa4a4464f43 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '34224081-52a0-4a9f-a88c-33d135606337'... >2018-07-12 14:02:05.269 23 INFO octavia.controller.queue.endpoint [req-a7e860e8-d3a9-44ff-b9b0-d799fdeb3108 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b1cc053a-143c-4354-a0cd-5a1d15740a71'... >2018-07-12 14:02:10.119 23 INFO octavia.controller.queue.endpoint [req-9dc52bb8-5783-417c-9966-67de491a2b2e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b7562939-981d-4d99-bfb3-c9d415da35c5'... >2018-07-12 14:02:10.369 23 INFO octavia.controller.queue.endpoint [req-791eaab7-4942-4f0e-9a9a-8db84093acca - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd883d198-9bbb-40e4-9e0e-74fc9108eda4'... >2018-07-12 14:06:22.154 23 INFO octavia.controller.queue.endpoint [req-3d09c72d-4c93-4f41-821f-ba793fb8b6f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '008748a6-ba6c-4851-ae15-aed308614837'... >2018-07-12 14:06:22.270 23 INFO octavia.controller.worker.tasks.database_tasks [req-3d09c72d-4c93-4f41-821f-ba793fb8b6f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 2706f483-9935-4d84-bf75-622632c0c810 >2018-07-12 14:06:22.324 23 INFO octavia.certificates.generator.local [req-3d09c72d-4c93-4f41-821f-ba793fb8b6f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 14:06:22.324 23 INFO octavia.certificates.generator.local [req-3d09c72d-4c93-4f41-821f-ba793fb8b6f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 14:06:22.325 23 INFO octavia.certificates.generator.local [req-3d09c72d-4c93-4f41-821f-ba793fb8b6f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 14:06:22.325 23 INFO octavia.certificates.generator.local [req-3d09c72d-4c93-4f41-821f-ba793fb8b6f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 14:06:23.205 23 INFO octavia.controller.queue.endpoint [req-e05fad84-a99e-4667-850c-6999010faf98 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '51d2eede-a5ab-4b81-a637-f6f078173db5'... >2018-07-12 14:06:23.323 23 INFO octavia.controller.worker.tasks.database_tasks [req-e05fad84-a99e-4667-850c-6999010faf98 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 652d6b28-34a1-44ac-8c61-fa93bf0cb989 >2018-07-12 14:06:23.449 23 INFO octavia.certificates.generator.local [req-e05fad84-a99e-4667-850c-6999010faf98 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 14:06:23.449 23 INFO octavia.certificates.generator.local [req-e05fad84-a99e-4667-850c-6999010faf98 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 14:06:23.450 23 INFO octavia.certificates.generator.local [req-e05fad84-a99e-4667-850c-6999010faf98 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 14:06:23.450 23 INFO octavia.certificates.generator.local [req-e05fad84-a99e-4667-850c-6999010faf98 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 14:06:35.185 23 INFO octavia.controller.worker.tasks.database_tasks [req-3d09c72d-4c93-4f41-821f-ba793fb8b6f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 2706f483-9935-4d84-bf75-622632c0c810 with compute id 21574706-809c-4633-a527-2dcd42d852f7 for load balancer: 008748a6-ba6c-4851-ae15-aed308614837 >2018-07-12 14:06:35.468 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-3d09c72d-4c93-4f41-821f-ba793fb8b6f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port c8863e25-4719-4183-838d-535c81f40ae1 already exists. Nothing to be done. >2018-07-12 14:06:35.601 23 INFO octavia.controller.worker.tasks.database_tasks [req-e05fad84-a99e-4667-850c-6999010faf98 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 652d6b28-34a1-44ac-8c61-fa93bf0cb989 with compute id ed863bb8-7ff5-4bae-a4c7-372be87fce2e for load balancer: 51d2eede-a5ab-4b81-a637-f6f078173db5 >2018-07-12 14:06:35.915 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-e05fad84-a99e-4667-850c-6999010faf98 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 54cc38b9-4760-422f-97b0-b580fa562e6b already exists. Nothing to be done. >2018-07-12 14:06:44.583 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-3d09c72d-4c93-4f41-821f-ba793fb8b6f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.37', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.71.255 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700453ed0>: Failed to establish a new connection: [Errno 113] No route to host',)) >2018-07-12 14:06:49.592 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-3d09c72d-4c93-4f41-821f-ba793fb8b6f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.37', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.71.255 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700646ad0>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-12 14:06:51.920 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-e05fad84-a99e-4667-850c-6999010faf98 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.6', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.170.104 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4708185550>, 'Connection to 172.24.0.6 timed out. (connect timeout=10.0)')) >2018-07-12 14:06:59.198 23 INFO octavia.controller.worker.tasks.database_tasks [req-3d09c72d-4c93-4f41-821f-ba793fb8b6f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 008748a6-ba6c-4851-ae15-aed308614837 >2018-07-12 14:07:00.173 23 INFO octavia.controller.queue.endpoint [req-3d09c72d-4c93-4f41-821f-ba793fb8b6f2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '696071ef-00cf-4252-9be4-5776e2707d75'... >2018-07-12 14:07:01.488 23 INFO octavia.controller.worker.tasks.database_tasks [req-e05fad84-a99e-4667-850c-6999010faf98 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 51d2eede-a5ab-4b81-a637-f6f078173db5 >2018-07-12 14:07:04.438 23 INFO octavia.controller.queue.endpoint [req-e94d380d-064b-4589-8a86-b364ae3e9a79 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'e72b7093-87c8-473a-bc05-4ba392d9f1b2'... >2018-07-12 14:07:05.498 23 INFO octavia.controller.queue.endpoint [req-e05fad84-a99e-4667-850c-6999010faf98 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '23fabd71-623f-4678-8844-906f63cd1aac'... >2018-07-12 14:07:09.426 23 INFO octavia.controller.queue.endpoint [req-1bf8f088-cf1d-4286-90ca-072315da9229 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '6dc397c4-1c7f-4cc3-b0b4-c4e4a937126f'... >2018-07-12 14:07:11.311 23 INFO octavia.controller.queue.endpoint [req-56582208-9b2c-4942-9ec5-ad8874755dba - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f9248b9c-0e03-4919-ac92-05e94be3ed85'... >2018-07-12 14:07:14.774 23 INFO octavia.controller.queue.endpoint [req-df7da687-5bf9-4b7a-bf4a-0d81f4f3702c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '68af10f5-b7ea-4c1b-a0d9-180fbdccecbb'... >2018-07-12 14:07:16.519 23 INFO octavia.controller.queue.endpoint [req-63d37438-74e1-44bc-a8ec-434e7d564e25 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '53232d23-6a8a-4a8b-a294-592889362323'... >2018-07-12 14:08:43.684 23 INFO octavia.controller.queue.endpoint [req-af9f068f-0235-46c7-b123-f7f31a85cdab - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2c47c5dc-6145-4817-8fe7-0a186631bcf6'... >2018-07-12 14:08:53.482 23 INFO octavia.controller.queue.endpoint [req-cf5b5df6-2ff4-4095-943f-be62ad446790 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2fc94546-ba0e-4fc2-a26d-5de7f18bb564'... >2018-07-12 14:09:03.085 23 INFO octavia.controller.queue.endpoint [req-32b31c0e-1230-4e28-98d4-2d15e581e721 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1deb0a7a-c95c-47a8-b73b-e125ac598c47'... >2018-07-12 14:16:18.446 23 INFO octavia.controller.queue.endpoint [req-d0fde12b-35e0-4c88-a012-61733174329d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b7562939-981d-4d99-bfb3-c9d415da35c5'... >2018-07-12 14:16:18.547 23 INFO octavia.controller.queue.endpoint [req-ea4a2267-693c-4b7a-abb3-039a077fd12b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd883d198-9bbb-40e4-9e0e-74fc9108eda4'... >2018-07-12 14:16:23.948 23 INFO octavia.controller.queue.endpoint [req-18e0e664-cbb1-45f1-9963-a34ab6d4a0f6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f45dd495-1b3e-4e1d-b3ba-36becf2bd2c4'... >2018-07-12 14:16:24.163 23 INFO octavia.controller.queue.endpoint [req-d609dee7-cedd-4d5e-98ea-574db237f89e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0de3fe0c-1f28-4657-bbcb-5a17215c6f65'... >2018-07-12 14:16:59.280 23 INFO octavia.controller.queue.endpoint [req-9a310be2-53a7-4fb6-b905-726a3538cbff - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '829b25bb-8740-4198-b9b3-a29d131b5276'... >2018-07-12 14:17:04.108 23 INFO octavia.controller.queue.endpoint [req-dc900072-c47d-41e6-a2f9-76ab8565aca1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8afea38d-4f0c-48a7-8002-cb79f801060c'... >2018-07-12 14:17:06.483 23 INFO octavia.controller.queue.endpoint [req-fdbd8745-c726-442d-a6da-5fecb42ab4de - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b162fbcb-13d8-4b9c-a396-e67d29087481'... >2018-07-12 14:17:06.569 23 INFO octavia.controller.queue.endpoint [req-ed20b7a7-f4e4-4cf4-a27a-701d270fc751 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '388e352b-78ae-42ed-918b-102d689bb241'... >2018-07-12 14:17:06.607 23 INFO octavia.controller.queue.endpoint [req-19a4347f-952a-4b73-8627-f61b8b73b50c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b69e27d8-ae51-4f82-83c7-baa41df4f99a'... >2018-07-12 14:17:11.455 23 INFO octavia.controller.queue.endpoint [req-595206ae-6443-4ca8-86f3-a49ebb373ed6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9926815b-d34b-4046-afe4-ebe7a14e38b0'... >2018-07-12 14:17:11.781 23 INFO octavia.controller.queue.endpoint [req-be913c4e-0c1a-4cfa-88e3-681bbc81dcc9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'df53a687-0283-42c3-8abe-80cab767bb0b'... >2018-07-12 14:17:12.024 23 INFO octavia.controller.queue.endpoint [req-a3f7d017-7e33-4208-a0e8-493bee9cc9b5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '92368750-175a-48cd-9688-0d7e3b99bb6e'... >2018-07-12 14:17:38.504 23 INFO octavia.controller.queue.endpoint [req-2c4a9c5c-f302-4fb7-a149-d4086fdaea27 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0978509b-e998-4747-8072-19ed0dbe4a34'... >2018-07-12 14:17:47.936 23 INFO octavia.controller.queue.endpoint [req-d0708029-5210-4970-8113-2ccc7351abc2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '67c0869d-0cb6-4d8d-b9f6-bb3ef11d9ec2'... >2018-07-12 14:17:57.124 23 INFO octavia.controller.queue.endpoint [req-d1575542-4312-4fed-9c43-ff9a13af7b26 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f5022acb-bba5-4b49-aac4-1cb2efe3fa22'... >2018-07-12 14:18:02.196 23 INFO octavia.controller.queue.endpoint [req-e60ec24d-eb99-4d8c-ab3c-b5001e5b78e7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cfb2541c-e7a2-4321-ba74-6881a068921a'... >2018-07-12 14:18:06.763 23 INFO octavia.controller.queue.endpoint [req-21e62bd2-4a6f-4849-bb7e-400b3731e8fc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'eae28dfb-dbfb-45f8-a609-6b748cb9c6df'... >2018-07-12 14:18:12.564 23 INFO octavia.controller.queue.endpoint [req-aa027418-055f-4bc0-bb80-fd044f39bb5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2ad4c2b5-1c81-4bbb-afde-7d7354fc81b2'... >2018-07-12 14:53:36.356 23 INFO octavia.controller.queue.endpoint [req-a67c87eb-0b2d-4869-b371-2819a3b99838 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cfb2541c-e7a2-4321-ba74-6881a068921a'... >2018-07-12 14:53:45.449 23 INFO octavia.controller.queue.endpoint [req-83d98dae-19ac-43bd-8c07-42becf6e2828 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'eae28dfb-dbfb-45f8-a609-6b748cb9c6df'... >2018-07-12 14:53:55.285 23 INFO octavia.controller.queue.endpoint [req-a8166258-e6e6-4f02-affb-9fb3f1f8347b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2ad4c2b5-1c81-4bbb-afde-7d7354fc81b2'... >2018-07-12 15:01:17.163 23 INFO octavia.controller.queue.endpoint [req-93798e3d-83e8-475b-83ed-382d958891bb - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0de3fe0c-1f28-4657-bbcb-5a17215c6f65'... >2018-07-12 15:01:17.244 23 INFO octavia.controller.queue.endpoint [req-3442fdce-3d8e-40fc-95f1-8ba04837b748 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f45dd495-1b3e-4e1d-b3ba-36becf2bd2c4'... >2018-07-12 15:01:22.932 23 INFO octavia.controller.queue.endpoint [req-74aa1a55-2ec5-4f8c-8a90-914f2f8e3187 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6233084a-9864-4178-a447-53b58c0f3a93'... >2018-07-12 15:01:23.164 23 INFO octavia.controller.queue.endpoint [req-10302f9e-325f-4b7e-8507-6d08cba3a22d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9e4f1cd6-9f23-4e91-871c-152cc33d6952'... >2018-07-12 15:07:43.884 23 INFO octavia.controller.queue.endpoint [req-c392ba29-5b47-44e4-86c1-5ecf037a74f0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f58b27ca-8939-49fa-94a5-2f9bd056f0c8'... >2018-07-12 15:07:49.086 23 INFO octavia.controller.queue.endpoint [req-99fe03da-990c-4568-acf7-f13541d13c75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f7d4c514-bf77-4481-b85a-1e4d09f87212'... >2018-07-12 15:07:54.681 23 INFO octavia.controller.queue.endpoint [req-e3a9de2c-5a6f-446f-b50e-309f237ed27a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '125e79fa-730f-45dc-aa78-dbe773bce6fd'... >2018-07-12 15:08:23.370 23 INFO octavia.controller.queue.endpoint [req-9d98b621-2546-4d00-8048-3f5a34942a9c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '6a44e0d9-b53c-47e5-83b1-ddf8c3ec209a'... >2018-07-12 15:08:29.092 23 INFO octavia.controller.queue.endpoint [req-44a1ae09-e504-45e2-9cb7-d4177da0ebbc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '423d7b7d-68c0-443f-9e64-c1cb452d0607'... >2018-07-12 15:08:36.265 23 INFO octavia.controller.queue.endpoint [req-5c418dac-fbc5-44f8-ab8c-05643a70a0b0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8b9ee2e0-9beb-47fa-9d67-d433ccef2751'... >2018-07-12 15:08:41.643 23 INFO octavia.controller.queue.endpoint [req-905a0999-1250-472c-9ba5-4f887c736b52 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'fb2f5c65-396b-4927-a0f6-2d656ac4ee39'... >2018-07-12 15:08:46.994 23 INFO octavia.controller.queue.endpoint [req-39b600dd-3e00-4075-a6a2-1fed70961729 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1325d71b-ac6c-4d83-b553-94af405f6d83'... >2018-07-12 15:15:15.266 23 INFO octavia.controller.queue.endpoint [req-2cadb437-91ed-4ef4-bfff-77681f2bb84d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '6233084a-9864-4178-a447-53b58c0f3a93'... >2018-07-12 15:15:15.364 23 INFO octavia.controller.queue.endpoint [req-1f4af923-f4dc-4846-a8df-8fabc472fed6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9e4f1cd6-9f23-4e91-871c-152cc33d6952'... >2018-07-12 15:15:20.465 23 INFO octavia.controller.queue.endpoint [req-ec5d6d4f-ea21-49b9-bc38-636e0f5d5abc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2950f834-7581-40e8-bad1-a3abcca08b9c'... >2018-07-12 15:15:20.766 23 INFO octavia.controller.queue.endpoint [req-24ed3557-7faf-4bdf-aa25-e4ac9bd1b1fc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '64cf5d69-7b73-4572-a319-0d183c9628b3'... >2018-07-12 15:19:23.645 23 INFO octavia.controller.queue.endpoint [req-b21eda23-acb3-49d0-a2d8-8c6b242b12c4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '8afea38d-4f0c-48a7-8002-cb79f801060c'... >2018-07-12 15:19:28.823 23 INFO octavia.controller.queue.endpoint [req-095440e4-0d89-4ae6-a44f-ef6262b11403 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd9d12dc2-7700-4607-8119-0d2066afa99a'... >2018-07-12 15:23:35.820 23 INFO octavia.controller.queue.endpoint [req-173ecdb2-90f8-4c05-8cbb-0056caf540ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '8b9ee2e0-9beb-47fa-9d67-d433ccef2751'... >2018-07-12 15:23:45.466 23 INFO octavia.controller.queue.endpoint [req-dcbdb762-600b-4af7-84b8-c0ff319df7f4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'fb2f5c65-396b-4927-a0f6-2d656ac4ee39'... >2018-07-12 15:23:55.719 23 INFO octavia.controller.queue.endpoint [req-6a3b8ca5-4922-4851-92bf-3c9eb1d387fc - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1325d71b-ac6c-4d83-b553-94af405f6d83'... >2018-07-12 15:28:03.232 23 INFO octavia.controller.queue.endpoint [req-63063497-01f7-42d8-a980-5aeefc6c196e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '423d7b7d-68c0-443f-9e64-c1cb452d0607'... >2018-07-12 15:28:08.599 23 INFO octavia.controller.queue.endpoint [req-ccd1a1ce-f970-4eab-94e0-0d0e5b98b670 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c6346d2c-fdd8-4aac-a70e-15d0d751db46'... >2018-07-12 15:30:17.102 23 INFO octavia.controller.queue.endpoint [req-12a8e22c-a490-4c34-92ee-c76cccd87b87 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9e9b8dc2-53dd-49eb-8949-18052ef6a3e9'... >2018-07-12 15:30:22.872 23 INFO octavia.controller.queue.endpoint [req-9f7c4b29-7c7a-4f04-b50e-1c588188e23d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5f4101b6-f540-4f7c-8454-74723010e7b3'... >2018-07-12 15:30:28.016 23 INFO octavia.controller.queue.endpoint [req-a95e85af-7ecb-4dd5-b3de-72b19d0e0015 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '79b49c0c-1fa9-45ba-a2cd-32b16d8c8360'... >2018-07-12 15:45:37.989 23 INFO octavia.controller.queue.endpoint [req-ffbed1c0-21a2-4250-8ac1-a7e0d0e002f1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9e9b8dc2-53dd-49eb-8949-18052ef6a3e9'... >2018-07-12 15:45:47.269 23 INFO octavia.controller.queue.endpoint [req-019df85a-7b01-4485-a3b3-d7b4a4038ec3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5f4101b6-f540-4f7c-8454-74723010e7b3'... >2018-07-12 15:45:57.499 23 INFO octavia.controller.queue.endpoint [req-36c090df-c9aa-413f-b5a2-2becfab7dc81 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '79b49c0c-1fa9-45ba-a2cd-32b16d8c8360'... >2018-07-12 16:07:27.226 23 INFO octavia.controller.queue.endpoint [req-02e9331b-7b34-421a-b5bd-b6e006577eb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c6346d2c-fdd8-4aac-a70e-15d0d751db46'... >2018-07-12 16:07:32.847 23 INFO octavia.controller.queue.endpoint [req-a22629c2-c9b8-44bb-a99c-e774a2e2a031 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e546a13a-dbdd-4764-a2db-73b622c1e4e8'... >2018-07-12 16:07:36.467 23 INFO octavia.controller.queue.endpoint [req-f9b28ff2-17aa-4497-8f87-7c280fafa7e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f58b27ca-8939-49fa-94a5-2f9bd056f0c8'... >2018-07-12 16:07:46.734 23 INFO octavia.controller.queue.endpoint [req-7d0c3a42-3a26-43ac-bcb9-bad7d10e2bb0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f7d4c514-bf77-4481-b85a-1e4d09f87212'... >2018-07-12 16:07:52.433 23 INFO octavia.controller.queue.endpoint [req-02cee67c-21e7-402f-88d1-b1e23241021b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '92368750-175a-48cd-9688-0d7e3b99bb6e'... >2018-07-12 16:07:52.553 23 INFO octavia.controller.queue.endpoint [req-4f921f32-7aad-4190-a3ac-01a8633d4ef9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'df53a687-0283-42c3-8abe-80cab767bb0b'... >2018-07-12 16:07:52.628 23 INFO octavia.controller.queue.endpoint [req-77f77859-11a3-4441-8005-f0a397136bee - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9926815b-d34b-4046-afe4-ebe7a14e38b0'... >2018-07-12 16:07:57.007 23 INFO octavia.controller.queue.endpoint [req-04ecf9d7-dcfb-485a-92bd-c7955cc3b8a3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '125e79fa-730f-45dc-aa78-dbe773bce6fd'... >2018-07-12 16:07:58.123 23 INFO octavia.controller.queue.endpoint [req-19f80270-0c15-4541-9986-fc64f08e0143 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '09ede14c-f10c-4525-86b9-9c8ada1c8d02'... >2018-07-12 16:07:58.354 23 INFO octavia.controller.queue.endpoint [req-53035905-d8cd-4727-b402-058b23a4146b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9a370895-4962-4ea9-b587-3e7c76b66b06'... >2018-07-12 16:07:58.558 23 INFO octavia.controller.queue.endpoint [req-b7c05b11-0e81-49de-b5b8-324613988a49 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2e3e3461-c0a3-4328-bfe6-db3584f01b95'... >2018-07-12 16:08:02.132 23 INFO octavia.controller.queue.endpoint [req-95b76eaf-3442-46e2-8824-f3d37b419719 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e5ab4512-e790-43c7-b9ed-89e9d649eae6'... >2018-07-12 16:08:07.574 23 INFO octavia.controller.queue.endpoint [req-420fedb2-aa3e-4742-9d63-37ec5a11597a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '25db708f-b4d3-4602-80b1-40384626bd8b'... >2018-07-12 16:08:13.062 23 INFO octavia.controller.queue.endpoint [req-b4d2a561-567a-4ca3-8cd8-f6fde4ece305 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3cce96bb-06df-4660-95f6-7185ec10c9e2'... >2018-07-12 16:09:02.773 23 INFO octavia.controller.queue.endpoint [req-c6da8b3b-c962-4708-97bd-2c9f7ceb25ea - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '62e7b2ae-0f1d-4071-ab26-4e184584798a'... >2018-07-12 16:09:08.028 23 INFO octavia.controller.queue.endpoint [req-e3dfde87-955c-43ee-8625-06a597dc3d61 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c0ff7fa3-0598-4046-9a49-dbc147357386'... >2018-07-12 16:09:13.477 23 INFO octavia.controller.queue.endpoint [req-ecefb376-67c1-4eac-b47a-59ea6584494b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a0c3d113-eb7f-40dd-8159-6b1f3608e128'... >2018-07-12 16:34:44.495 23 INFO octavia.controller.queue.endpoint [req-2ac0b88c-216c-4693-a9de-eab1ba829d2f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e5ab4512-e790-43c7-b9ed-89e9d649eae6'... >2018-07-12 16:34:54.818 23 INFO octavia.controller.queue.endpoint [req-fc34d6c4-d892-4b56-9d41-06bac5d214ce - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '25db708f-b4d3-4602-80b1-40384626bd8b'... >2018-07-12 16:35:04.730 23 INFO octavia.controller.queue.endpoint [req-c9a64107-5673-45b2-9206-96c056916de3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '3cce96bb-06df-4660-95f6-7185ec10c9e2'... >2018-07-12 16:35:56.793 23 INFO octavia.controller.queue.endpoint [req-8d4f8087-1a58-4ea8-9988-c2e45c2eb38e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c22e944b-402a-48c1-96dd-177e9ebc54f9'... >2018-07-12 16:36:02.513 23 INFO octavia.controller.queue.endpoint [req-27d9811d-980c-4e4f-9ff9-412698669fa5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'eb7f38f7-fe70-4fb1-94ef-bf3dcd10cda8'... >2018-07-12 16:36:07.281 23 INFO octavia.controller.queue.endpoint [req-43ffad75-a227-44d0-9df2-92e33629e566 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '70e605c2-3c36-4f19-b6f0-50948e05e173'... >2018-07-12 16:47:38.321 23 INFO octavia.controller.queue.endpoint [req-bbe978ec-3dbe-4a06-8542-30fdf4301899 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '62e7b2ae-0f1d-4071-ab26-4e184584798a'... >2018-07-12 16:47:47.991 23 INFO octavia.controller.queue.endpoint [req-707e9f1b-2654-4ee5-97ee-e7fc52606e66 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c0ff7fa3-0598-4046-9a49-dbc147357386'... >2018-07-12 16:47:58.009 23 INFO octavia.controller.queue.endpoint [req-a29f568b-23b4-4118-9f8a-331607c5d039 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a0c3d113-eb7f-40dd-8159-6b1f3608e128'... >2018-07-12 17:05:08.479 23 INFO octavia.controller.queue.endpoint [req-237020e7-8b64-46b1-9c6d-2207e52f5628 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2e3e3461-c0a3-4328-bfe6-db3584f01b95'... >2018-07-12 17:05:08.585 23 INFO octavia.controller.queue.endpoint [req-c4752cae-7264-45a5-9289-c9d90b5de9ed - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9a370895-4962-4ea9-b587-3e7c76b66b06'... >2018-07-12 17:05:08.647 23 INFO octavia.controller.queue.endpoint [req-b4dd7c9b-48c7-4f48-952c-2dffaaae34e5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '09ede14c-f10c-4525-86b9-9c8ada1c8d02'... >2018-07-12 17:05:13.243 23 INFO octavia.controller.queue.endpoint [req-4cf7e327-43c0-4978-a5d0-6bf2d2bb55f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '137f3800-b92c-4ee2-883d-018d153fe547'... >2018-07-12 17:05:14.077 23 INFO octavia.controller.queue.endpoint [req-af836b27-5d47-493d-8ccf-3260e382d121 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9fa1d5dd-ddc9-43a2-948a-7f241d467d84'... >2018-07-12 17:05:14.372 23 INFO octavia.controller.queue.endpoint [req-5fac5ea8-aaba-4d64-9bca-d295807a69d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '24a4d7ac-cdf2-456f-93c4-0b7c38a8b74c'... >2018-07-12 17:05:29.654 23 INFO octavia.controller.queue.endpoint [req-5b1bd708-1f5d-4ba1-875f-d7423411e42d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e546a13a-dbdd-4764-a2db-73b622c1e4e8'... >2018-07-12 17:05:35.615 23 INFO octavia.controller.queue.endpoint [req-9b1d1dff-fd92-4810-a180-3332a06a1366 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'edd3bfe0-97de-4067-a336-8a2e471ddf86'... >2018-07-12 17:05:35.731 23 INFO octavia.controller.queue.endpoint [req-7863fb06-b533-4fee-a33f-6abd2f80bd7a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c22e944b-402a-48c1-96dd-177e9ebc54f9'... >2018-07-12 17:05:45.734 23 INFO octavia.controller.queue.endpoint [req-51f1a0c0-ba73-4769-8034-5664f568f15f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'eb7f38f7-fe70-4fb1-94ef-bf3dcd10cda8'... >2018-07-12 17:05:55.848 23 INFO octavia.controller.queue.endpoint [req-2d8a7853-f7f1-4ecf-a384-b078abe03414 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '70e605c2-3c36-4f19-b6f0-50948e05e173'... >2018-07-12 17:06:01.703 23 INFO octavia.controller.queue.endpoint [req-7df9a121-981f-4d3b-8b83-f633b6e03449 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '187d426c-9596-4c20-864a-dbdc61f5b952'... >2018-07-12 17:06:07.050 23 INFO octavia.controller.queue.endpoint [req-8f226f72-21e9-4824-84e1-d5761da418c0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0a6c434e-b3b0-4705-826d-6abff0c146b1'... >2018-07-12 17:06:12.337 23 INFO octavia.controller.queue.endpoint [req-6095941c-4c42-4298-a3ba-89b47ebceae1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd3f3f9c9-b2ca-48f1-869f-4db2936c5812'... >2018-07-12 17:20:33.082 23 INFO octavia.controller.queue.endpoint [req-a399dd70-3a8f-424c-b676-b0345bb34c47 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2950f834-7581-40e8-bad1-a3abcca08b9c'... >2018-07-12 17:20:33.168 23 INFO octavia.controller.queue.endpoint [req-020f740f-85f6-4381-87ed-91f6f7645333 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '64cf5d69-7b73-4572-a319-0d183c9628b3'... >2018-07-12 17:20:38.588 23 INFO octavia.controller.queue.endpoint [req-efabac9a-e229-4d47-bd45-af5e60603b9f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6d9b01da-d565-416e-a506-5b2305cf2aa5'... >2018-07-12 17:20:38.814 23 INFO octavia.controller.queue.endpoint [req-5153ab56-52c8-46ca-adec-265084bcab44 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '302b265a-1a9c-479b-bb01-a5e80aa634d9'... >2018-07-12 17:20:52.441 23 INFO octavia.controller.queue.endpoint [req-4896337b-a57e-453d-8345-a28d418f617b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '187d426c-9596-4c20-864a-dbdc61f5b952'... >2018-07-12 17:21:02.415 23 INFO octavia.controller.queue.endpoint [req-69edb50e-0a8d-4961-bccc-e0888895cbe0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0a6c434e-b3b0-4705-826d-6abff0c146b1'... >2018-07-12 17:21:12.353 23 INFO octavia.controller.queue.endpoint [req-ec31414a-c658-4d6d-ab37-705c0bc0d900 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd3f3f9c9-b2ca-48f1-869f-4db2936c5812'... >2018-07-12 17:21:17.594 23 INFO octavia.controller.queue.endpoint [req-5ab1ac74-62bf-4911-9ae6-924387a8291c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '38e8fea5-6e0b-43b4-b4ea-e2091c291240'... >2018-07-12 17:21:22.770 23 INFO octavia.controller.queue.endpoint [req-e3631a19-95fc-4130-82ff-548d60ceee11 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '73f0d6ef-bc45-4356-b61e-f80099c203c4'... >2018-07-12 17:21:28.240 23 INFO octavia.controller.queue.endpoint [req-96a6f2b0-0c19-4e23-aad0-20bd9b988f35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3dd19327-8877-4909-b3f8-501fa93bbfc2'... >2018-07-12 17:24:22.146 23 INFO octavia.controller.queue.endpoint [req-1e371012-4b9a-4771-a051-1129bcc396d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '902e1fa6-1049-469b-a40a-24d84c255f27'... >2018-07-12 17:24:22.269 23 INFO octavia.controller.worker.tasks.database_tasks [req-1e371012-4b9a-4771-a051-1129bcc396d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 7b36cd88-378a-4a7d-9db0-06b7c3487218 >2018-07-12 17:24:22.672 23 INFO octavia.certificates.generator.local [req-1e371012-4b9a-4771-a051-1129bcc396d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 17:24:22.673 23 INFO octavia.certificates.generator.local [req-1e371012-4b9a-4771-a051-1129bcc396d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 17:24:22.673 23 INFO octavia.certificates.generator.local [req-1e371012-4b9a-4771-a051-1129bcc396d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 17:24:22.673 23 INFO octavia.certificates.generator.local [req-1e371012-4b9a-4771-a051-1129bcc396d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 17:24:23.120 23 INFO octavia.controller.queue.endpoint [req-078f4788-eda5-4696-9d9e-9c406ec03194 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'ca7a26a8-9a71-43fd-96dc-fe0714d9256d'... >2018-07-12 17:24:23.260 23 INFO octavia.controller.worker.tasks.database_tasks [req-078f4788-eda5-4696-9d9e-9c406ec03194 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 7dd3ae3f-00c6-483a-8d42-6d602598e643 >2018-07-12 17:24:23.386 23 INFO octavia.certificates.generator.local [req-078f4788-eda5-4696-9d9e-9c406ec03194 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-12 17:24:23.387 23 INFO octavia.certificates.generator.local [req-078f4788-eda5-4696-9d9e-9c406ec03194 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-12 17:24:23.387 23 INFO octavia.certificates.generator.local [req-078f4788-eda5-4696-9d9e-9c406ec03194 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-12 17:24:23.387 23 INFO octavia.certificates.generator.local [req-078f4788-eda5-4696-9d9e-9c406ec03194 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-12 17:24:37.177 23 INFO octavia.controller.worker.tasks.database_tasks [req-078f4788-eda5-4696-9d9e-9c406ec03194 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 7dd3ae3f-00c6-483a-8d42-6d602598e643 with compute id 079bbba5-8690-44a5-9f11-d4471cff0e10 for load balancer: ca7a26a8-9a71-43fd-96dc-fe0714d9256d >2018-07-12 17:24:37.488 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-078f4788-eda5-4696-9d9e-9c406ec03194 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 8f959c54-3e2d-4daf-9911-c531cce7b1fc already exists. Nothing to be done. >2018-07-12 17:24:37.506 23 INFO octavia.controller.worker.tasks.database_tasks [req-1e371012-4b9a-4771-a051-1129bcc396d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 7b36cd88-378a-4a7d-9db0-06b7c3487218 with compute id 86c410da-8c7f-4a7d-b694-ccf3b8fd6df6 for load balancer: 902e1fa6-1049-469b-a40a-24d84c255f27 >2018-07-12 17:24:37.631 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-1e371012-4b9a-4771-a051-1129bcc396d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port ab096239-6e84-4e2b-8d2d-44141a7a12c5 already exists. Nothing to be done. >2018-07-12 17:24:46.273 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-078f4788-eda5-4696-9d9e-9c406ec03194 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.42', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.220.201 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47081d6b10>: Failed to establish a new connection: [Errno 113] No route to host',)) >2018-07-12 17:24:46.376 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-1e371012-4b9a-4771-a051-1129bcc396d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.41', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.199.136 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47081ab4d0>: Failed to establish a new connection: [Errno 113] No route to host',)) >2018-07-12 17:24:51.280 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-078f4788-eda5-4696-9d9e-9c406ec03194 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.42', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.220.201 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47081abdd0>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-12 17:24:51.384 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-1e371012-4b9a-4771-a051-1129bcc396d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.41', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.199.136 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47081d6d10>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-12 17:25:00.886 23 INFO octavia.controller.worker.tasks.database_tasks [req-078f4788-eda5-4696-9d9e-9c406ec03194 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: ca7a26a8-9a71-43fd-96dc-fe0714d9256d >2018-07-12 17:25:00.914 23 INFO octavia.controller.worker.tasks.database_tasks [req-1e371012-4b9a-4771-a051-1129bcc396d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 902e1fa6-1049-469b-a40a-24d84c255f27 >2018-07-12 17:25:02.126 23 INFO octavia.controller.queue.endpoint [req-4bf7d799-077d-4abc-b300-0594d95adba4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'daf07624-b382-4046-b735-245f59f13ba5'... >2018-07-12 17:25:07.678 23 INFO octavia.controller.queue.endpoint [req-23006a15-7d7a-488b-acb4-88cba0a21b4e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '847fcd34-b68d-417c-b258-08ccab3238ca'... >2018-07-12 17:25:08.017 23 INFO octavia.controller.queue.endpoint [req-bc298b5a-4586-4dd6-931a-be20f7df562b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'edd3bfe0-97de-4067-a336-8a2e471ddf86'... >2018-07-12 17:25:12.989 23 INFO octavia.controller.queue.endpoint [req-49ea725b-0a7e-4b44-9a41-2aac97ed4b49 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'eb8596fb-129e-411b-8acb-18a68da7376a'... >2018-07-12 17:25:13.240 23 INFO octavia.controller.queue.endpoint [req-30868fd5-67b9-4a41-ac98-c83da00d774e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5e117726-0c0f-40a6-b54e-141d26b1c43f'... >2018-07-12 17:25:14.292 23 INFO octavia.controller.queue.endpoint [req-cc05878c-f2a5-4aee-b4a1-06104dba08a5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '978fb24e-6cff-452d-9e4a-9a07dddea5a7'... >2018-07-12 17:25:17.992 23 INFO octavia.controller.queue.endpoint [req-fa728e44-56f9-45a8-a4aa-dee1a7bb09fc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f882dbed-efdf-48c6-bb7c-286e4bb6decb'... >2018-07-12 17:25:18.880 23 INFO octavia.controller.queue.endpoint [req-0fcc45d1-4c38-40b1-b809-400dcb620183 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '2c841dd1-8312-433d-8de7-6415d443d784'... >2018-07-12 17:25:23.926 23 INFO octavia.controller.queue.endpoint [req-1e371012-4b9a-4771-a051-1129bcc396d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e7e5d26f-0269-4b61-8633-b58b6d0dc025'... >2018-07-12 17:27:54.252 23 INFO octavia.controller.queue.endpoint [req-841c4d42-0f87-4df2-add8-0ee654c53644 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9fa1d5dd-ddc9-43a2-948a-7f241d467d84'... >2018-07-12 17:27:54.341 23 INFO octavia.controller.queue.endpoint [req-da24ca43-e191-421d-8d6b-449ba5ae142d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '24a4d7ac-cdf2-456f-93c4-0b7c38a8b74c'... >2018-07-12 17:27:54.387 23 INFO octavia.controller.queue.endpoint [req-e0aebcb8-cad3-4d96-a218-995f5e5986d3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '137f3800-b92c-4ee2-883d-018d153fe547'... >2018-07-12 17:27:59.468 23 INFO octavia.controller.queue.endpoint [req-11a03687-491f-42a5-9d7d-a69005e03519 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '364e45ea-3113-405d-884f-2b9bcfb190a5'... >2018-07-12 17:27:59.838 23 INFO octavia.controller.queue.endpoint [req-b6999c74-df3d-44b6-8334-224335dd5196 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9ed04c3f-dc04-412c-aedd-d98fa6d66fbc'... >2018-07-12 17:28:00.064 23 INFO octavia.controller.queue.endpoint [req-aab854e7-cb75-4cf9-a0f4-14b44c943b16 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9b184e58-f6f4-4e85-ad05-de83f83f7aae'... >2018-07-12 17:28:30.353 23 INFO octavia.controller.queue.endpoint [req-6763ecaf-3d11-4064-a7be-9f163ed2b96a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '490186da-6e47-4d89-b56c-3a8657223d53'... >2018-07-12 17:28:36.143 23 INFO octavia.controller.queue.endpoint [req-781fef9a-7aa6-4a40-92c6-f22c50f29daa - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c14af14d-6693-4625-b475-0c3f7be0d68e'... >2018-07-12 17:28:41.428 23 INFO octavia.controller.queue.endpoint [req-918d12f7-364c-40ab-ae8c-75e935fc9be2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '115a5234-d5d4-4a2a-b6ba-4547a61523f6'... >2018-07-12 17:30:54.925 23 INFO octavia.controller.queue.endpoint [req-078f4788-eda5-4696-9d9e-9c406ec03194 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd9d12dc2-7700-4607-8119-0d2066afa99a'... >2018-07-12 17:30:59.680 23 INFO octavia.controller.queue.endpoint [req-27202a9a-509b-43d0-b193-e4a2b02f0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ccef26b0-fb4d-4f58-85c9-18e8aff60b52'... >2018-07-13 10:06:22.019 23 INFO octavia.controller.queue.endpoint [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f0d71bce-f757-43bd-942c-28f824b87789'... >2018-07-13 10:06:23.269 23 INFO octavia.controller.queue.endpoint [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '6490007e-8c2a-4655-8bf5-ec0a63a88a58'... >2018-07-13 10:06:23.303 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group bc86132c-9e68-4346-a79e-65bc33e1423d from port 4b75aaee-93dd-486f-8061-e439cdbd7960 >2018-07-13 10:06:23.988 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:24.045 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group bad80a9a-daac-428f-8037-6d2419bfd46c from port 76832527-4f07-4b7d-a86c-8159546236ad >2018-07-13 10:06:24.471 23 INFO octavia.controller.queue.endpoint [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '18c3e42d-490f-40ed-9ce4-088e18116100'... >2018-07-13 10:06:24.654 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:25.040 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:25.706 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:25.722 23 INFO octavia.controller.queue.endpoint [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f1022762-3823-4f64-a8d2-7ea95f24e435'... >2018-07-13 10:06:26.104 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:26.521 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group e6624c69-2b1d-458b-9671-7797a9f3b290 from port a312ed55-8980-4599-a054-e49823fc209f >2018-07-13 10:06:26.761 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:26.971 23 INFO octavia.controller.queue.endpoint [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f89af06f-115c-4950-8a4c-044361a63c83'... >2018-07-13 10:06:27.153 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:27.162 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:27.653 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group ba73156d-5684-4628-b632-9861037dfcca from port 2e19e563-18d8-44f6-8a2c-2d130651f1d9 >2018-07-13 10:06:27.815 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:28.207 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:28.216 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:28.409 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group ba73156d-5684-4628-b632-9861037dfcca >2018-07-13 10:06:28.866 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:29.072 23 INFO octavia.controller.queue.endpoint [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'e4fbb806-a2a1-443c-8f5b-84d027350a39'... >2018-07-13 10:06:29.277 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:29.312 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:29.558 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 18b72ba0-f6a8-4020-a71e-09cc3374a32b from port 8dba06f5-dec2-48c5-b084-b38a7a26b2f1 >2018-07-13 10:06:29.921 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:30.330 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:30.373 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:30.658 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 18b72ba0-f6a8-4020-a71e-09cc3374a32b >2018-07-13 10:06:30.845 23 INFO octavia.controller.queue.endpoint [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '5771c255-10ba-4377-9afe-8cc71fb28142'... >2018-07-13 10:06:31.089 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:31.272 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group c4d8898a-575e-4535-aaa7-ae6172964de3 from port ad531959-af7a-4af8-b6a0-59b4a39abb49 >2018-07-13 10:06:31.392 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:31.470 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:31.680 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 31a3c3d9-118c-4e41-bd31-66de701df8bf from port b1d1a9fc-741a-443e-bd7c-9b0d06bddfa1 >2018-07-13 10:06:32.024 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group c4d8898a-575e-4535-aaa7-ae6172964de3 >2018-07-13 10:06:32.146 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:32.263 23 INFO octavia.controller.queue.endpoint [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '79eadec6-792e-4cfa-8be3-87c21b816ec2'... >2018-07-13 10:06:32.349 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:32.449 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:32.534 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:33.196 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:33.411 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:33.502 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:33.540 23 INFO octavia.controller.queue.endpoint [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '902e1fa6-1049-469b-a40a-24d84c255f27'... >2018-07-13 10:06:33.611 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:34.246 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group e2b2f47f-237e-4052-b304-646f8141eb07 from port ab096239-6e84-4e2b-8d2d-44141a7a12c5 >2018-07-13 10:06:34.252 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:34.294 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 46c9b4cd-ec79-48d3-9f10-01f8e2cb2f72 from port b24a9ee2-a06e-47b6-bd3c-c3f71c46890f >2018-07-13 10:06:34.491 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:34.555 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:34.670 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:34.673 23 INFO octavia.controller.queue.endpoint [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'ca7a26a8-9a71-43fd-96dc-fe0714d9256d'... >2018-07-13 10:06:35.019 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 46c9b4cd-ec79-48d3-9f10-01f8e2cb2f72 >2018-07-13 10:06:35.195 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 0f96d132-c29a-49fe-a984-b55dba03acc2 from port 8f959c54-3e2d-4daf-9911-c531cce7b1fc >2018-07-13 10:06:35.224 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:35.302 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:35.545 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:35.607 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:35.725 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:35.949 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:36.018 23 INFO octavia.controller.queue.endpoint [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'ca849617-112e-4670-9fbc-83d0b158e648'... >2018-07-13 10:06:36.276 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:36.359 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:36.596 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:36.658 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:36.781 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:36.999 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:37.225 23 INFO octavia.controller.queue.endpoint [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'bf691cc6-68f2-4cb5-8aac-b5c6f75906b3'... >2018-07-13 10:06:37.376 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:37.423 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:37.653 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:37.709 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:37.805 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group c63248dd-e4de-4d1e-a475-db236013fcb2 from port c39aeac3-f770-4cba-a263-2f1962f7002c >2018-07-13 10:06:37.843 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:38.053 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:38.437 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:38.450 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:38.458 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 731d79dc-fc86-4af3-baa9-67950e7f16dc from port c00819f0-d6b6-4fe0-94e7-6498dd236409 >2018-07-13 10:06:38.488 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:38.536 23 INFO octavia.controller.queue.endpoint [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '7d7fdbfc-7d4c-4986-bc27-09fbc98ee48c'... >2018-07-13 10:06:38.728 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:38.770 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:38.903 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:39.121 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:39.172 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 731d79dc-fc86-4af3-baa9-67950e7f16dc >2018-07-13 10:06:39.502 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:39.511 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:39.556 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:39.637 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 from port 1dc57ded-d36c-4d25-90ec-fe6cf949d19e >2018-07-13 10:06:39.779 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:39.810 23 INFO octavia.controller.queue.endpoint [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '7b64a842-9be9-4b7d-a351-9e3c0df2dcbb'... >2018-07-13 10:06:39.823 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:39.972 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:40.171 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:40.226 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:40.395 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 71110b7f-f779-4a26-b70d-43f5a8394899 from port 61714dab-74b9-4034-b81d-d0064359f8ee >2018-07-13 10:06:40.553 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:40.563 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:40.609 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d have failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >Neutron server returns request_ids: ['req-02856e76-2129-4359-a8a8-d1bf7103fd46'] >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-02856e76-2129-4359-a8a8-d1bf7103fd46'] >2018-07-13 10:06:40.825 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:06:40.833 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:40.837 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (d5cc637e-aacf-4460-a8da-0cd4b4c4e450) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470074d450>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_4c1e662a-3480-4487-b625-6da5833b8ac1' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f4708040610>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_4c1e662a-3480-4487-b625-6da5833b8ac1' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f4708040610>}, 'provides': None} > |__Atom 'delete_update_vip_listener_4c1e662a-3480-4487-b625-6da5833b8ac1' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470074d450>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool3f74085a-fd08-47ed-865c-7a6da3593600' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 2, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f470809b950>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool3f74085a-fd08-47ed-865c-7a6da3593600' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f470809b950>}, 'provides': None} > |__Atom 'delete_model_object_pool3f74085a-fd08-47ed-865c-7a6da3593600' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f470809b950>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool3f74085a-fd08-47ed-865c-7a6da3593600' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f470809b950>}, 'provides': {'member': 2, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool3f74085a-fd08-47ed-865c-7a6da3593600' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f470809b950>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470074d450>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470074d450>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d have failed. >2018-07-13 10:06:40.837 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:06:40.837 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:40.837 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:06:40.837 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:40.837 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:40.837 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:40.837 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:06:40.837 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:40.837 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:40.837 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:40.837 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:06:40.837 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d have failed. >2018-07-13 10:06:40.837 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:06:40.846 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (d5cc637e-aacf-4460-a8da-0cd4b4c4e450) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:40.850 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (35dcbc5a-c677-4d64-b368-83206f7b5da6) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:40.853 23 WARNING octavia.controller.worker.tasks.database_tasks [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:40.865 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_4c1e662a-3480-4487-b625-6da5833b8ac1' (007453f2-1da2-4a37-9ca9-0bd8fb3d7f01) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:40.868 23 WARNING octavia.controller.worker.tasks.database_tasks [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id 4c1e662a-3480-4487-b625-6da5833b8ac1 >2018-07-13 10:06:40.870 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_4c1e662a-3480-4487-b625-6da5833b8ac1' (278857bb-0028-4197-80ee-24ef2dbed446) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:40.873 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_4c1e662a-3480-4487-b625-6da5833b8ac1' (2f4f3738-0cb8-4b01-b800-f14edc9f306a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:40.876 23 WARNING octavia.controller.worker.tasks.database_tasks [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:40.902 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool3f74085a-fd08-47ed-865c-7a6da3593600' (86c0e746-3835-4466-8bc0-f47f293e3e6a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:40.904 23 WARNING octavia.controller.worker.tasks.database_tasks [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 3f74085a-fd08-47ed-865c-7a6da3593600 >2018-07-13 10:06:40.908 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool3f74085a-fd08-47ed-865c-7a6da3593600' (bb20a572-5d2a-44ef-b634-d4feb436c877) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:40.911 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool3f74085a-fd08-47ed-865c-7a6da3593600' (95cdecff-da76-48f9-8cb9-34b7d5704696) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:40.914 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool3f74085a-fd08-47ed-865c-7a6da3593600' (b21ab767-3e87-4211-a29f-0ab5f1f31381) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:40.915 23 WARNING octavia.controller.worker.tasks.database_tasks [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 3f74085a-fd08-47ed-865c-7a6da3593600 >2018-07-13 10:06:40.919 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool3f74085a-fd08-47ed-865c-7a6da3593600' (5bbe1993-fde4-4628-875f-a0a56f57910e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:40.922 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (941e1cf7-0390-4744-9b9d-21fcd31207dc) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:40.924 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (b14fc341-a4e2-4bcb-a7d3-3982cb471ae0) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:40.930 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (970a2127-66bd-456e-8eb3-ccd090c98f3d) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:40.934 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (eceb5ccc-9041-481d-ac8a-b9bb1f0c1484) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d have failed. >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d have failed. >2018-07-13 10:06:40.935 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:06:41.029 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:41.044 23 INFO octavia.controller.queue.endpoint [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '87758df5-ad27-4e56-95fa-295938682eba'... >2018-07-13 10:06:41.176 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:41.233 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:41.452 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:41.573 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc from port ef4d6bb6-ddfd-4dfe-8561-8e928cb46da5 >2018-07-13 10:06:41.605 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c have failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >Neutron server returns request_ids: ['req-6a667e39-c01d-4183-860d-3befbeca5142'] >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-6a667e39-c01d-4183-860d-3befbeca5142'] >2018-07-13 10:06:41.610 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:06:41.616 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:41.617 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (7a4ede07-9758-433a-a529-b5dd1cce275e) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470065dd10>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_b12beba5-7a82-4fab-979d-58228f14aacb' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f470065dd90>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_b12beba5-7a82-4fab-979d-58228f14aacb' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f470065dd90>}, 'provides': None} > |__Atom 'delete_update_vip_listener_b12beba5-7a82-4fab-979d-58228f14aacb' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470065dd10>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool474677df-19cd-4656-9d7f-000341fbb69d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 1, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f47080bd390>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool474677df-19cd-4656-9d7f-000341fbb69d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47080bd390>}, 'provides': None} > |__Atom 'delete_model_object_pool474677df-19cd-4656-9d7f-000341fbb69d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f47080bd390>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool474677df-19cd-4656-9d7f-000341fbb69d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47080bd390>}, 'provides': {'member': 1, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool474677df-19cd-4656-9d7f-000341fbb69d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47080bd390>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470065dd10>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470065dd10>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c have failed. >2018-07-13 10:06:41.617 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:06:41.617 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:41.617 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:06:41.617 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:41.617 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:41.617 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:41.617 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:06:41.617 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:41.617 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:41.617 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:41.617 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:06:41.617 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c have failed. >2018-07-13 10:06:41.617 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:06:41.637 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (7a4ede07-9758-433a-a529-b5dd1cce275e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:41.640 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (fc619247-1d1b-49f2-8969-cdb1a4d12e89) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:41.643 23 WARNING octavia.controller.worker.tasks.database_tasks [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:41.653 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_b12beba5-7a82-4fab-979d-58228f14aacb' (075e16f5-c485-4d36-9dd4-082a5c2995f1) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:41.655 23 WARNING octavia.controller.worker.tasks.database_tasks [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id b12beba5-7a82-4fab-979d-58228f14aacb >2018-07-13 10:06:41.657 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_b12beba5-7a82-4fab-979d-58228f14aacb' (5e4b98f3-ae87-4cdd-8f35-b3856e2e56d2) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:41.660 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_b12beba5-7a82-4fab-979d-58228f14aacb' (c11624a2-e34f-4d6b-ae4d-a0d15ba673c5) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:41.662 23 WARNING octavia.controller.worker.tasks.database_tasks [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:41.678 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool474677df-19cd-4656-9d7f-000341fbb69d' (965fab5d-57f0-43cc-ac23-5509e191f198) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:41.681 23 WARNING octavia.controller.worker.tasks.database_tasks [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 474677df-19cd-4656-9d7f-000341fbb69d >2018-07-13 10:06:41.684 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool474677df-19cd-4656-9d7f-000341fbb69d' (cb5fcf96-2b93-46d7-99a0-17b32a54f27f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:41.688 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool474677df-19cd-4656-9d7f-000341fbb69d' (62a292af-323c-44f8-8283-43be1a11121e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:41.690 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool474677df-19cd-4656-9d7f-000341fbb69d' (a5325ad7-7a09-4152-98e1-b60540335dce) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:41.692 23 WARNING octavia.controller.worker.tasks.database_tasks [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 474677df-19cd-4656-9d7f-000341fbb69d >2018-07-13 10:06:41.696 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool474677df-19cd-4656-9d7f-000341fbb69d' (d0d1555f-7f2a-478b-a54c-ede463ec351b) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:41.698 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (a7feb65d-9a62-46c8-9f4c-0ab9493c95b7) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:41.701 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (78623226-e8f1-4462-94b6-b931e936b18f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:41.706 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (a2f139e2-2a91-434b-81f9-6c8dfd1cebb5) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:41.710 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (39e375b2-3669-4dd1-98c4-7af67dac40a7) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c have failed. >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c have failed. >2018-07-13 10:06:41.710 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:06:41.884 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:42.083 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:42.196 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:42.227 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:42.282 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:42.378 23 INFO octavia.controller.queue.endpoint [req-3f6717d1-8b53-48ed-9146-39369d1d5aa6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '1485af28-de5c-4e61-9b22-bf1e2d4b3380'... >2018-07-13 10:06:42.529 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:42.665 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:42.827 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:42.934 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:43.133 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:43.247 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:43.279 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:43.336 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:43.577 23 INFO octavia.controller.queue.endpoint [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '44d5aacd-413e-46fd-88ef-590660744838'... >2018-07-13 10:06:43.583 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:43.728 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:43.884 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:43.985 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 have failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >Neutron server returns request_ids: ['req-88e10220-a3ac-4d2e-9ddc-92734b53e031'] >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-88e10220-a3ac-4d2e-9ddc-92734b53e031'] >2018-07-13 10:06:44.134 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:06:44.141 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (e20dc4fc-fd50-48d4-aa4f-7713088e8021) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47084183d0>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_a8490be6-b197-41dc-a0ef-083c5fd16918' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f4708418410>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_a8490be6-b197-41dc-a0ef-083c5fd16918' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f4708418410>}, 'provides': None} > |__Atom 'delete_update_vip_listener_a8490be6-b197-41dc-a0ef-083c5fd16918' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47084183d0>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool58384dab-37b9-4232-b5f7-71e6c78dd391' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 1, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f4708209550>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool58384dab-37b9-4232-b5f7-71e6c78dd391' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4708209550>}, 'provides': None} > |__Atom 'delete_model_object_pool58384dab-37b9-4232-b5f7-71e6c78dd391' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f4708209550>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool58384dab-37b9-4232-b5f7-71e6c78dd391' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4708209550>}, 'provides': {'member': 1, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool58384dab-37b9-4232-b5f7-71e6c78dd391' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4708209550>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47084183d0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47084183d0>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 have failed. >2018-07-13 10:06:44.141 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:06:44.141 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:44.141 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:06:44.141 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:44.141 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:44.141 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:44.141 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:06:44.141 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:44.141 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:44.141 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:44.141 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:06:44.141 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 have failed. >2018-07-13 10:06:44.141 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:06:44.151 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (e20dc4fc-fd50-48d4-aa4f-7713088e8021) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:44.154 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (a2b32899-f895-4784-b300-6c255eb61760) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:44.159 23 WARNING octavia.controller.worker.tasks.database_tasks [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:44.180 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_a8490be6-b197-41dc-a0ef-083c5fd16918' (c1ed4421-d448-4553-be71-cd0a3b1ad950) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:44.187 23 WARNING octavia.controller.worker.tasks.database_tasks [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id a8490be6-b197-41dc-a0ef-083c5fd16918 >2018-07-13 10:06:44.188 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_a8490be6-b197-41dc-a0ef-083c5fd16918' (0663c7e0-2f94-4103-8698-1f7d85b97c6f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:44.191 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_a8490be6-b197-41dc-a0ef-083c5fd16918' (e82c19a6-608a-4d57-86c3-604520930c7a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:44.194 23 WARNING octavia.controller.worker.tasks.database_tasks [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:44.211 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool58384dab-37b9-4232-b5f7-71e6c78dd391' (004668cb-6af1-424e-9ee3-f3e5e1d91d2c) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:44.214 23 WARNING octavia.controller.worker.tasks.database_tasks [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 58384dab-37b9-4232-b5f7-71e6c78dd391 >2018-07-13 10:06:44.218 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool58384dab-37b9-4232-b5f7-71e6c78dd391' (43bdcbca-369c-46bd-bbae-8447084e7ecd) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:44.221 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool58384dab-37b9-4232-b5f7-71e6c78dd391' (06242b31-5c86-4c0f-b881-87fa05683533) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:44.224 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool58384dab-37b9-4232-b5f7-71e6c78dd391' (1c2561ea-56a7-414b-bf98-6d601ce4b4b4) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:44.226 23 WARNING octavia.controller.worker.tasks.database_tasks [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 58384dab-37b9-4232-b5f7-71e6c78dd391 >2018-07-13 10:06:44.230 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool58384dab-37b9-4232-b5f7-71e6c78dd391' (1314839a-52af-4c9a-b8d4-ca82a5278e59) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:44.233 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (2c5bd554-5b98-4d00-955d-c095e223007a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:44.236 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (5d8a375a-2192-43c2-b647-4de0d58fd78b) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:44.251 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (a6d09754-7929-497c-8638-5ae7a9796090) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:44.264 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (1f6fdb5d-e081-4c5f-948d-12b51740dc7e) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 have failed. >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 have failed. >2018-07-13 10:06:44.264 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:06:44.312 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-3f6717d1-8b53-48ed-9146-39369d1d5aa6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group d39cef28-7c99-40de-a050-1e84195d4f9c from port bef105a6-8ab5-466f-8518-733b9db7d60a >2018-07-13 10:06:44.316 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:44.334 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:44.388 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:44.671 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:44.729 23 INFO octavia.controller.queue.endpoint [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'be4174e7-7e6f-44e6-9fcd-31d43e1d91f4'... >2018-07-13 10:06:44.790 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:44.945 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:45.016 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-3f6717d1-8b53-48ed-9146-39369d1d5aa6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group d39cef28-7c99-40de-a050-1e84195d4f9c >2018-07-13 10:06:45.039 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:45.301 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 66d1823a-d457-4229-91dc-5a76b4221c45 from port 1cfa4476-be07-48b6-a414-3e3ea8cbf356 >2018-07-13 10:06:45.368 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:45.442 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:45.605 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:45.726 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:45.847 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:45.877 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:06:45.899 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group e37ad6e9-6082-41f8-90dd-e95c263d845d from port 190ed855-faaf-4083-a5cc-ac46874c042d >2018-07-13 10:06:45.981 23 INFO octavia.controller.queue.endpoint [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '4a7e06b3-efd8-4cff-9a23-5420b50c2cb4'... >2018-07-13 10:06:45.997 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:46.119 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:46.425 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:46.501 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:46.697 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:46.765 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group e37ad6e9-6082-41f8-90dd-e95c263d845d >2018-07-13 10:06:46.785 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:46.898 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:46.930 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:06:47.049 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:47.177 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:47.280 23 INFO octavia.controller.queue.endpoint [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'bfc107ff-e9ca-4e49-8153-a3d7c8f86104'... >2018-07-13 10:06:47.582 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:47.604 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:47.760 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:47.843 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:47.958 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:47.990 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:06:48.068 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 from port a8136ee8-d02b-4d7c-a19d-277e7720f7f6 >2018-07-13 10:06:48.113 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:48.240 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:48.355 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group f87c5613-9f39-4e49-a217-f9fd4e012b16 from port 325db92e-ef55-42f6-88ef-1cbab8203f3a >2018-07-13 10:06:48.482 23 INFO octavia.controller.queue.endpoint [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '51d2eede-a5ab-4b81-a637-f6f078173db5'... >2018-07-13 10:06:48.643 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:48.724 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:48.857 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:06:48.867 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:48.900 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:49.016 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:49.041 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:06:49.086 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 from port 54cc38b9-4760-422f-97b0-b580fa562e6b >2018-07-13 10:06:49.167 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf have failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >Neutron server returns request_ids: ['req-57c0e5d7-f2e7-4a82-b1b4-efd6900b7ef3'] >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-57c0e5d7-f2e7-4a82-b1b4-efd6900b7ef3'] >2018-07-13 10:06:49.242 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:06:49.248 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (dc624dea-1575-44b8-a62d-a500804b165f) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005b4590>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_20eb6035-5a7c-40de-90d4-b35dcc581402' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f470061cd50>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_20eb6035-5a7c-40de-90d4-b35dcc581402' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f470061cd50>}, 'provides': None} > |__Atom 'delete_update_vip_listener_20eb6035-5a7c-40de-90d4-b35dcc581402' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005b4590>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool0dd4fb3a-4e65-461d-b18a-b79af4d49e62' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 1, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f470061cd10>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool0dd4fb3a-4e65-461d-b18a-b79af4d49e62' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f470061cd10>}, 'provides': None} > |__Atom 'delete_model_object_pool0dd4fb3a-4e65-461d-b18a-b79af4d49e62' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f470061cd10>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool0dd4fb3a-4e65-461d-b18a-b79af4d49e62' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f470061cd10>}, 'provides': {'member': 1, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool0dd4fb3a-4e65-461d-b18a-b79af4d49e62' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f470061cd10>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005b4590>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005b4590>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf have failed. >2018-07-13 10:06:49.248 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:06:49.248 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:49.248 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:06:49.248 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:49.248 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:49.248 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:49.248 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:06:49.248 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:49.248 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:49.248 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:49.248 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:06:49.248 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf have failed. >2018-07-13 10:06:49.248 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:06:49.259 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group f87c5613-9f39-4e49-a217-f9fd4e012b16 >2018-07-13 10:06:49.261 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (dc624dea-1575-44b8-a62d-a500804b165f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:49.272 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (76f35501-4efc-4c16-a87c-7243d508701b) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:49.281 23 WARNING octavia.controller.worker.tasks.database_tasks [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:49.292 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_20eb6035-5a7c-40de-90d4-b35dcc581402' (fb0e4841-8896-421d-a5c0-87b8d6bde32f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:49.295 23 WARNING octavia.controller.worker.tasks.database_tasks [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id 20eb6035-5a7c-40de-90d4-b35dcc581402 >2018-07-13 10:06:49.296 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_20eb6035-5a7c-40de-90d4-b35dcc581402' (c63d62d7-cc81-48f2-808d-527efac4d2e1) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:49.299 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_20eb6035-5a7c-40de-90d4-b35dcc581402' (16d0aae0-a95c-45d4-ade7-79b9b2501dc1) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:49.302 23 WARNING octavia.controller.worker.tasks.database_tasks [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:49.320 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool0dd4fb3a-4e65-461d-b18a-b79af4d49e62' (bbd7a8de-bb62-40c6-bbc6-67226282d398) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:49.322 23 WARNING octavia.controller.worker.tasks.database_tasks [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 0dd4fb3a-4e65-461d-b18a-b79af4d49e62 >2018-07-13 10:06:49.327 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool0dd4fb3a-4e65-461d-b18a-b79af4d49e62' (d1c64992-f109-4b59-88b3-b3bd0f6233ec) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:49.332 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool0dd4fb3a-4e65-461d-b18a-b79af4d49e62' (fe1dad77-82ef-4d18-a20b-80b14ca4232f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:49.337 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool0dd4fb3a-4e65-461d-b18a-b79af4d49e62' (ea715948-f44d-4018-aeb8-05a0f77f02bf) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:49.341 23 WARNING octavia.controller.worker.tasks.database_tasks [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 0dd4fb3a-4e65-461d-b18a-b79af4d49e62 >2018-07-13 10:06:49.346 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool0dd4fb3a-4e65-461d-b18a-b79af4d49e62' (fcf9afd1-9411-44d7-b0ab-02adac3d853f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:49.349 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (e51e9e6e-9566-4e14-b02d-3a5ec81dad95) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:49.351 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (1b9df85c-5074-4068-9ef2-36fa46f04cfb) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:49.358 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (44d24379-a662-468a-a8bd-e76dec984e19) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:49.362 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (57bbc684-44ad-4089-9ab9-a8a70fecb9b4) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf have failed. >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf have failed. >2018-07-13 10:06:49.362 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:06:49.698 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:49.779 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:49.785 23 INFO octavia.controller.queue.endpoint [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '008748a6-ba6c-4851-ae15-aed308614837'... >2018-07-13 10:06:49.859 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:06:49.955 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:49.959 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:06:49.974 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:50.072 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:50.091 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:06:50.244 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:50.452 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 8507debd-a565-40b0-85c8-5f0509f0d522 from port c8863e25-4719-4183-838d-535c81f40ae1 >2018-07-13 10:06:50.838 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:50.841 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:50.967 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:06:51.008 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:51.014 23 INFO octavia.controller.queue.endpoint [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '6114bd1b-ba1b-432e-ab94-e70a23ca9377'... >2018-07-13 10:06:51.017 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:06:51.069 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:51.081 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:06:51.211 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:06:51.214 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:51.312 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:51.894 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:51.897 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:52.019 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:06:52.068 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:06:52.093 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:52.128 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:52.139 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 have failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >Neutron server returns request_ids: ['req-69cb7ee6-fefe-427b-8aa7-a1a97158e25b'] >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-69cb7ee6-fefe-427b-8aa7-a1a97158e25b'] >2018-07-13 10:06:52.216 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:06:52.223 23 WARNING octavia.controller.worker.controller_worker [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (d48385a9-bb9f-4f3f-9a4c-c1f808494db9) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700478cd0>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_978fb24e-6cff-452d-9e4a-9a07dddea5a7' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47005d4990>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_978fb24e-6cff-452d-9e4a-9a07dddea5a7' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47005d4990>}, 'provides': None} > |__Atom 'delete_update_vip_listener_978fb24e-6cff-452d-9e4a-9a07dddea5a7' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700478cd0>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool2c841dd1-8312-433d-8de7-6415d443d784' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 1, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f47006d29d0>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool2c841dd1-8312-433d-8de7-6415d443d784' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47006d29d0>}, 'provides': None} > |__Atom 'delete_model_object_pool2c841dd1-8312-433d-8de7-6415d443d784' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f47006d29d0>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool2c841dd1-8312-433d-8de7-6415d443d784' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47006d29d0>}, 'provides': {'member': 1, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool2c841dd1-8312-433d-8de7-6415d443d784' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47006d29d0>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700478cd0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700478cd0>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 have failed. >2018-07-13 10:06:52.223 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:06:52.223 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:52.223 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:06:52.223 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:52.223 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:52.223 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:52.223 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:06:52.223 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:52.223 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:52.223 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:52.223 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:06:52.223 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 have failed. >2018-07-13 10:06:52.223 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:06:52.245 23 WARNING octavia.controller.worker.controller_worker [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (d48385a9-bb9f-4f3f-9a4c-c1f808494db9) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.250 23 WARNING octavia.controller.worker.controller_worker [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (671beaba-6618-4cdf-9974-46d38a6cbd44) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.256 23 WARNING octavia.controller.worker.tasks.database_tasks [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:52.269 23 WARNING octavia.controller.worker.controller_worker [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_978fb24e-6cff-452d-9e4a-9a07dddea5a7' (b140389c-3399-4f22-a8f9-706137e05583) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.272 23 WARNING octavia.controller.worker.tasks.database_tasks [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id 978fb24e-6cff-452d-9e4a-9a07dddea5a7 >2018-07-13 10:06:52.274 23 WARNING octavia.controller.worker.controller_worker [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_978fb24e-6cff-452d-9e4a-9a07dddea5a7' (a1bd51ba-df58-4bbc-b1ed-759bae64506a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.278 23 WARNING octavia.controller.worker.controller_worker [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_978fb24e-6cff-452d-9e4a-9a07dddea5a7' (4c025411-b00c-4528-be3b-d842dface9ca) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.279 23 INFO octavia.controller.queue.endpoint [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '2d817013-a78c-402d-876e-7b94b95b1202'... >2018-07-13 10:06:52.285 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:06:52.292 23 WARNING octavia.controller.worker.tasks.database_tasks [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:52.341 23 WARNING octavia.controller.worker.controller_worker [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool2c841dd1-8312-433d-8de7-6415d443d784' (08b02240-6d25-4a08-bdd4-aa029bcff027) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.358 23 WARNING octavia.controller.worker.tasks.database_tasks [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 2c841dd1-8312-433d-8de7-6415d443d784 >2018-07-13 10:06:52.366 23 WARNING octavia.controller.worker.controller_worker [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool2c841dd1-8312-433d-8de7-6415d443d784' (fdb52957-5e50-447a-ab37-274137db1822) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.379 23 WARNING octavia.controller.worker.controller_worker [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool2c841dd1-8312-433d-8de7-6415d443d784' (a0c17a96-c33f-4a2c-a1c3-df910c43fe5f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.401 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:52.432 23 WARNING octavia.controller.worker.controller_worker [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool2c841dd1-8312-433d-8de7-6415d443d784' (e5801c32-0351-44cf-b7c7-e0e6df4a55ee) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.443 23 WARNING octavia.controller.worker.tasks.database_tasks [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 2c841dd1-8312-433d-8de7-6415d443d784 >2018-07-13 10:06:52.452 23 WARNING octavia.controller.worker.controller_worker [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool2c841dd1-8312-433d-8de7-6415d443d784' (7ff0de0d-84f9-471a-9428-6478bb2829b4) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.463 23 WARNING octavia.controller.worker.controller_worker [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (b4589dbd-eff4-48cd-ba38-810f3f8829d3) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.474 23 WARNING octavia.controller.worker.controller_worker [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (fbd6fee7-c66b-4da8-b680-2318a57b1f46) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.491 23 WARNING octavia.controller.worker.controller_worker [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (cef3a35a-3b77-40d8-ad83-2ebfaa38e250) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.505 23 WARNING octavia.controller.worker.controller_worker [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (f4a64614-726c-4722-bbed-6ab4c93e6686) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 have failed. >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 have failed. >2018-07-13 10:06:52.506 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >Neutron server returns request_ids: ['req-90247655-9f92-4809-9a46-f6bd9da08875'] >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-90247655-9f92-4809-9a46-f6bd9da08875'] >2018-07-13 10:06:52.895 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:06:52.911 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (3f301f8f-0a77-4813-b8e9-22334a3a8bd6) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470073bad0>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_daf07624-b382-4046-b735-245f59f13ba5' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47005bf690>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_daf07624-b382-4046-b735-245f59f13ba5' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47005bf690>}, 'provides': None} > |__Atom 'delete_update_vip_listener_daf07624-b382-4046-b735-245f59f13ba5' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470073bad0>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool847fcd34-b68d-417c-b258-08ccab3238ca' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 2, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f47003db5d0>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool847fcd34-b68d-417c-b258-08ccab3238ca' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47003db5d0>}, 'provides': None} > |__Atom 'delete_model_object_pool847fcd34-b68d-417c-b258-08ccab3238ca' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f47003db5d0>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool847fcd34-b68d-417c-b258-08ccab3238ca' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47003db5d0>}, 'provides': {'member': 2, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool847fcd34-b68d-417c-b258-08ccab3238ca' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47003db5d0>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470073bad0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470073bad0>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:06:52.911 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:06:52.911 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:52.911 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:06:52.911 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:52.911 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:52.911 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:52.911 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:06:52.911 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:52.911 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:52.911 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:52.911 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:06:52.911 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:06:52.911 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:06:52.924 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (3f301f8f-0a77-4813-b8e9-22334a3a8bd6) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.927 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (833cc765-2ac8-49df-a512-c14fb2e30ed9) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.930 23 WARNING octavia.controller.worker.tasks.database_tasks [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:52.947 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_daf07624-b382-4046-b735-245f59f13ba5' (7593732b-e4f5-4ab7-96cd-09b4ee904866) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.950 23 WARNING octavia.controller.worker.tasks.database_tasks [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id daf07624-b382-4046-b735-245f59f13ba5 >2018-07-13 10:06:52.951 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_daf07624-b382-4046-b735-245f59f13ba5' (afd22551-eb81-4a0b-b722-2cecf99fa629) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.955 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_daf07624-b382-4046-b735-245f59f13ba5' (ccff9720-c7dd-46b3-b81e-e95c0e05c72a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.957 23 WARNING octavia.controller.worker.tasks.database_tasks [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:52.960 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:52.983 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool847fcd34-b68d-417c-b258-08ccab3238ca' (9ce24c2a-4d67-49be-88d2-4a38e1caf8dd) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.985 23 WARNING octavia.controller.worker.tasks.database_tasks [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 847fcd34-b68d-417c-b258-08ccab3238ca >2018-07-13 10:06:52.989 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool847fcd34-b68d-417c-b258-08ccab3238ca' (b1d519e5-29c1-4667-a2d3-c95b349dcb8c) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.992 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool847fcd34-b68d-417c-b258-08ccab3238ca' (217d9c2c-6e2e-4f82-b9ab-576c00481d39) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.996 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool847fcd34-b68d-417c-b258-08ccab3238ca' (4fbbfe2d-2814-46c8-9633-c8213b54d2a2) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:52.998 23 WARNING octavia.controller.worker.tasks.database_tasks [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 847fcd34-b68d-417c-b258-08ccab3238ca >2018-07-13 10:06:53.002 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool847fcd34-b68d-417c-b258-08ccab3238ca' (908a92f7-0d29-488b-bf98-8eff6f077cce) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:53.008 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (85779ea1-bc20-4568-9a1d-83ce050e11f9) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:53.015 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (99b6624e-3a16-4b96-b916-fd180065398b) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:53.032 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (9b6a7fa9-29d4-485f-bdd4-1365611326ac) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:53.036 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (a29ebeab-f1fd-41f9-bbed-d2375c6e771f) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:06:53.037 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:06:53.082 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:06:53.124 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:06:53.145 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:53.186 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:53.190 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:06:53.337 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:06:53.457 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:53.553 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group b8b7a564-18a7-4dc6-b5ca-e7e24a5ffac4 from port 353a790f-a191-47aa-aa3c-c038a328e4ec >2018-07-13 10:06:53.638 23 INFO octavia.controller.queue.endpoint [req-3f6717d1-8b53-48ed-9146-39369d1d5aa6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '1d887734-e44c-4e22-8050-6d1996228972'... >2018-07-13 10:06:54.109 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:54.135 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:06:54.176 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:06:54.198 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:54.241 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:54.416 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group b8b7a564-18a7-4dc6-b5ca-e7e24a5ffac4 >2018-07-13 10:06:54.429 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:06:54.460 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:06:54.517 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:54.811 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 47954243-734c-4716-a633-b1e4b9e27cbe from port 40115c56-d940-4407-bcd0-2abe6dd85e9f >2018-07-13 10:06:54.940 23 INFO octavia.controller.queue.endpoint [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f88d70db-20a8-4784-bc0a-d9401225b63a'... >2018-07-13 10:06:55.182 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:55.232 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:06:55.247 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:55.264 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:06:55.302 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:55.489 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 have failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >Neutron server returns request_ids: ['req-1da79f8e-5390-4d50-8c30-43bc45819882'] >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-1da79f8e-5390-4d50-8c30-43bc45819882'] >2018-07-13 10:06:55.518 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:06:55.525 23 WARNING octavia.controller.worker.controller_worker [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (4875dcc2-6a10-4b5c-80df-29eadc6614ee) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470053e950>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_93aa92fb-f6bf-4f38-b2db-1aa4104d464f' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f470051b290>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_93aa92fb-f6bf-4f38-b2db-1aa4104d464f' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f470051b290>}, 'provides': None} > |__Atom 'delete_update_vip_listener_93aa92fb-f6bf-4f38-b2db-1aa4104d464f' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470053e950>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool7efa93ca-1f75-4747-bd34-abdf3082c246' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 1, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f4702f94e50>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool7efa93ca-1f75-4747-bd34-abdf3082c246' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4702f94e50>}, 'provides': None} > |__Atom 'delete_model_object_pool7efa93ca-1f75-4747-bd34-abdf3082c246' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f4702f94e50>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool7efa93ca-1f75-4747-bd34-abdf3082c246' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4702f94e50>}, 'provides': {'member': 1, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool7efa93ca-1f75-4747-bd34-abdf3082c246' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4702f94e50>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470053e950>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470053e950>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 have failed. >2018-07-13 10:06:55.525 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:06:55.525 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:55.525 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:06:55.525 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:55.525 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:55.525 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:55.525 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:06:55.525 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:55.525 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:55.525 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:55.525 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:06:55.525 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 have failed. >2018-07-13 10:06:55.525 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:06:55.538 23 WARNING octavia.controller.worker.controller_worker [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (4875dcc2-6a10-4b5c-80df-29eadc6614ee) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:55.542 23 WARNING octavia.controller.worker.controller_worker [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (eddc26c5-6b05-4343-b0a0-1bb6b98e76c3) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:55.545 23 WARNING octavia.controller.worker.tasks.database_tasks [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:55.554 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 1b509d93-f412-4add-843b-2c0b12107198 from port ee18712e-63af-42d7-888c-a221d493002e >2018-07-13 10:06:55.560 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:06:55.563 23 WARNING octavia.controller.worker.controller_worker [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_93aa92fb-f6bf-4f38-b2db-1aa4104d464f' (8f804aa8-090d-4c79-a6a3-7faf3a72ebb2) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:55.569 23 WARNING octavia.controller.worker.tasks.database_tasks [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id 93aa92fb-f6bf-4f38-b2db-1aa4104d464f >2018-07-13 10:06:55.570 23 WARNING octavia.controller.worker.controller_worker [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_93aa92fb-f6bf-4f38-b2db-1aa4104d464f' (a8077332-5726-49df-853b-626751c92037) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:55.574 23 WARNING octavia.controller.worker.controller_worker [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_93aa92fb-f6bf-4f38-b2db-1aa4104d464f' (91468a7c-e495-4f2c-ade9-35ce96c61b9e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:55.577 23 WARNING octavia.controller.worker.tasks.database_tasks [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:55.596 23 WARNING octavia.controller.worker.controller_worker [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool7efa93ca-1f75-4747-bd34-abdf3082c246' (12d99d14-1987-459b-8844-97fbf1916d2e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:55.598 23 WARNING octavia.controller.worker.tasks.database_tasks [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 7efa93ca-1f75-4747-bd34-abdf3082c246 >2018-07-13 10:06:55.603 23 WARNING octavia.controller.worker.controller_worker [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool7efa93ca-1f75-4747-bd34-abdf3082c246' (d2b659c5-fe4f-4beb-97e7-9185e5981b66) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:55.606 23 WARNING octavia.controller.worker.controller_worker [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool7efa93ca-1f75-4747-bd34-abdf3082c246' (c67e788e-58fa-4573-b8f1-e7e5988b50ac) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:55.609 23 WARNING octavia.controller.worker.controller_worker [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool7efa93ca-1f75-4747-bd34-abdf3082c246' (af139831-742b-4215-93ab-89cfce2a4fb2) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:55.611 23 WARNING octavia.controller.worker.tasks.database_tasks [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 7efa93ca-1f75-4747-bd34-abdf3082c246 >2018-07-13 10:06:55.616 23 WARNING octavia.controller.worker.controller_worker [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool7efa93ca-1f75-4747-bd34-abdf3082c246' (dc11618e-5dee-4033-8083-9b66dc037e24) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:55.619 23 WARNING octavia.controller.worker.controller_worker [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (3fb06bc7-d90e-4f92-80a4-588d31282d22) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:55.622 23 WARNING octavia.controller.worker.controller_worker [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (807d7781-f92e-4118-84ae-7af256d32185) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:55.628 23 WARNING octavia.controller.worker.controller_worker [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (b1dd14f2-9d8b-4476-81f4-ccaef0e86f70) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:55.631 23 WARNING octavia.controller.worker.controller_worker [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (9d08a674-441c-4de5-b6c5-c6accd08ec90) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 have failed. >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 have failed. >2018-07-13 10:06:55.632 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:06:55.678 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 47954243-734c-4716-a633-b1e4b9e27cbe >2018-07-13 10:06:56.059 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-3f6717d1-8b53-48ed-9146-39369d1d5aa6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 85854ea1-c573-47c3-8820-41f4037cd75f from port ab82605c-b562-47b0-b161-39acf99a0e6a >2018-07-13 10:06:56.241 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:56.250 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:06:56.288 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:06:56.303 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:56.315 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:06:56.363 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:56.563 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:06:56.615 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:06:56.772 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-3f6717d1-8b53-48ed-9146-39369d1d5aa6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 85854ea1-c573-47c3-8820-41f4037cd75f >2018-07-13 10:06:57.295 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:57.296 23 INFO octavia.controller.queue.endpoint [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'e0e8f1f8-1a2b-4faa-b133-0620d5901d9e'... >2018-07-13 10:06:57.308 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:06:57.350 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 have failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >Neutron server returns request_ids: ['req-b2a1c24c-1232-4a3a-9558-ffe0861dcbf0'] >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-b2a1c24c-1232-4a3a-9558-ffe0861dcbf0'] >2018-07-13 10:06:57.364 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:06:57.384 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:06:57.399 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:57.499 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (8b81535b-0acc-4fe9-b90c-03d95e516397) transitioned into state 'FAILURE' from state 'RUNNING' >115 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_795b0a1d-50bb-4a9a-af51-42d33f679aff' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f470053e450>}, 'provides': None} > | |__Atom 'delete_listener_in_db_listener_795b0a1d-50bb-4a9a-af51-42d33f679aff' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f470053e450>}, 'provides': None} > | |__Atom 'delete_update_vip_listener_795b0a1d-50bb-4a9a-af51-42d33f679aff' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | |__Flow 'octavia-delete-listener_flow' > | |__Flow 'listener_delete_flow' > | |__Atom 'decrement_pool_quota_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 2, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f47003b6dd0>}, 'provides': None} > | | |__Atom 'delete_pool_in_db_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47003b6dd0>}, 'provides': None} > | | |__Atom 'delete_model_object_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f47003b6dd0>}, 'provides': None} > | | |__Atom 'count_pool_children_for_quota_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47003b6dd0>}, 'provides': {'member': 2, 'HM': 0}} > | | |__Atom 'mark_pool_pending_delete_in_db_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47003b6dd0>}, 'provides': None} > | | |__Flow 'octavia-delete-pool-flow' > | | |__Flow 'pool_delete_flow' > | | |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | | |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > | | |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | | |__Flow 'octavia-delete-loadbalancer-flow' > | |__Atom 'decrement_pool_quota_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 2, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f4700612690>}, 'provides': None} > | | |__Atom 'delete_pool_in_db_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612690>}, 'provides': None} > | | |__Atom 'delete_model_object_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f4700612690>}, 'provides': None} > | | |__Atom 'count_pool_children_for_quota_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612690>}, 'provides': {'member': 2, 'HM': 0}} > | | |__Atom 'mark_pool_pending_delete_in_db_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612690>}, 'provides': None} > | | |__Flow 'octavia-delete-pool-flow' > | | |__Flow 'pool_delete_flow' > | | |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | | |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > | | |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | | |__Flow 'octavia-delete-loadbalancer-flow' > | |__Atom 'decrement_pool_quota_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 2, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f4700612b90>}, 'provides': None} > | |__Atom 'delete_pool_in_db_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612b90>}, 'provides': None} > | |__Atom 'delete_model_object_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f4700612b90>}, 'provides': None} > | |__Atom 'count_pool_children_for_quota_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612b90>}, 'provides': {'member': 2, 'HM': 0}} > | |__Atom 'mark_pool_pending_delete_in_db_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612b90>}, 'provides': None} > | |__Flow 'octavia-delete-pool-flow' > | |__Flow 'pool_delete_flow' > | |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > | |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | |__Flow 'octavia-delete-loadbalancer-flow' > |__Atom 'decrement_listener_quota_listener_9df3cd4f-62e8-43cb-9c38-704292580683' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f4700487cd0>}, 'provides': None} > | |__Atom 'delete_listener_in_db_listener_9df3cd4f-62e8-43cb-9c38-704292580683' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f4700487cd0>}, 'provides': None} > | |__Atom 'delete_update_vip_listener_9df3cd4f-62e8-43cb-9c38-704292580683' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | |__Flow 'octavia-delete-listener_flow' > | |__Flow 'listener_delete_flow' > | |__Atom 'decrement_pool_quota_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 2, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f47003b6dd0>}, 'provides': None} > | | |__Atom 'delete_pool_in_db_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47003b6dd0>}, 'provides': None} > | | |__Atom 'delete_model_object_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f47003b6dd0>}, 'provides': None} > | | |__Atom 'count_pool_children_for_quota_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47003b6dd0>}, 'provides': {'member': 2, 'HM': 0}} > | | |__Atom 'mark_pool_pending_delete_in_db_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47003b6dd0>}, 'provides': None} > | | |__Flow 'octavia-delete-pool-flow' > | | |__Flow 'pool_delete_flow' > | | |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | | |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > | | |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | | |__Flow 'octavia-delete-loadbalancer-flow' > | |__Atom 'decrement_pool_quota_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 2, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f4700612690>}, 'provides': None} > | | |__Atom 'delete_pool_in_db_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612690>}, 'provides': None} > | | |__Atom 'delete_model_object_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f4700612690>}, 'provides': None} > | | |__Atom 'count_pool_children_for_quota_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612690>}, 'provides': {'member': 2, 'HM': 0}} > | | |__Atom 'mark_pool_pending_delete_in_db_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612690>}, 'provides': None} > | | |__Flow 'octavia-delete-pool-flow' > | | |__Flow 'pool_delete_flow' > | | |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | | |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > | | |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | | |__Flow 'octavia-delete-loadbalancer-flow' > | |__Atom 'decrement_pool_quota_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 2, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f4700612b90>}, 'provides': None} > | |__Atom 'delete_pool_in_db_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612b90>}, 'provides': None} > | |__Atom 'delete_model_object_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f4700612b90>}, 'provides': None} > | |__Atom 'count_pool_children_for_quota_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612b90>}, 'provides': {'member': 2, 'HM': 0}} > | |__Atom 'mark_pool_pending_delete_in_db_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612b90>}, 'provides': None} > | |__Flow 'octavia-delete-pool-flow' > | |__Flow 'pool_delete_flow' > | |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > | |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | |__Flow 'octavia-delete-loadbalancer-flow' > |__Atom 'decrement_listener_quota_listener_b6eccc0a-8696-442e-8b4d-cb1cbb234bb0' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47003b6e90>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_b6eccc0a-8696-442e-8b4d-cb1cbb234bb0' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47003b6e90>}, 'provides': None} > |__Atom 'delete_update_vip_listener_b6eccc0a-8696-442e-8b4d-cb1cbb234bb0' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 2, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f47003b6dd0>}, 'provides': None} > | |__Atom 'delete_pool_in_db_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47003b6dd0>}, 'provides': None} > | |__Atom 'delete_model_object_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f47003b6dd0>}, 'provides': None} > | |__Atom 'count_pool_children_for_quota_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47003b6dd0>}, 'provides': {'member': 2, 'HM': 0}} > | |__Atom 'mark_pool_pending_delete_in_db_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47003b6dd0>}, 'provides': None} > | |__Flow 'octavia-delete-pool-flow' > | |__Flow 'pool_delete_flow' > | |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > | |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | |__Flow 'octavia-delete-loadbalancer-flow' > |__Atom 'decrement_pool_quota_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 2, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f4700612690>}, 'provides': None} > | |__Atom 'delete_pool_in_db_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612690>}, 'provides': None} > | |__Atom 'delete_model_object_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f4700612690>}, 'provides': None} > | |__Atom 'count_pool_children_for_quota_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612690>}, 'provides': {'member': 2, 'HM': 0}} > | |__Atom 'mark_pool_pending_delete_in_db_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612690>}, 'provides': None} > | |__Flow 'octavia-delete-pool-flow' > | |__Flow 'pool_delete_flow' > | |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > | |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > | |__Flow 'octavia-delete-loadbalancer-flow' > |__Atom 'decrement_pool_quota_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 2, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f4700612b90>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612b90>}, 'provides': None} > |__Atom 'delete_model_object_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f4700612b90>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612b90>}, 'provides': {'member': 2, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700612b90>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005dcc10>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 have failed. >2018-07-13 10:06:57.499 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:06:57.499 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:57.499 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:06:57.499 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:57.499 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:57.499 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:57.499 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:06:57.499 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:57.499 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:57.499 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:57.499 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:06:57.499 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 have failed. >2018-07-13 10:06:57.499 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:06:57.607 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (8b81535b-0acc-4fe9-b90c-03d95e516397) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:57.644 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:06:57.690 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (831174ab-2828-4792-a388-7c3cd17b7e81) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:57.697 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:06:57.734 23 WARNING octavia.controller.worker.tasks.database_tasks [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:57.760 23 WARNING octavia.controller.worker.tasks.database_tasks [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:57.779 23 WARNING octavia.controller.worker.tasks.database_tasks [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:57.802 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_9df3cd4f-62e8-43cb-9c38-704292580683' (c715d0ea-3f18-46a7-9d32-65bee5ad9f43) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:57.807 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_b6eccc0a-8696-442e-8b4d-cb1cbb234bb0' (0df50a6f-835c-4db0-8e11-f034a323b1ab) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:57.811 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_795b0a1d-50bb-4a9a-af51-42d33f679aff' (cc5986d4-bbbe-4584-9163-4de2f85d39fd) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:57.827 23 WARNING octavia.controller.worker.tasks.database_tasks [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id 9df3cd4f-62e8-43cb-9c38-704292580683 >2018-07-13 10:06:57.833 23 WARNING octavia.controller.worker.tasks.database_tasks [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id 795b0a1d-50bb-4a9a-af51-42d33f679aff >2018-07-13 10:06:57.835 23 WARNING octavia.controller.worker.tasks.database_tasks [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id b6eccc0a-8696-442e-8b4d-cb1cbb234bb0 >2018-07-13 10:06:57.837 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_795b0a1d-50bb-4a9a-af51-42d33f679aff' (dd2b4ca1-3caa-4647-937f-3697d5b69b90) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:57.850 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_9df3cd4f-62e8-43cb-9c38-704292580683' (d6434ff1-f343-46ac-90ca-6cd833dbc52c) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:57.861 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_b6eccc0a-8696-442e-8b4d-cb1cbb234bb0' (7182e120-fdb6-4a87-8c04-da3d036dd3d2) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:57.868 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_795b0a1d-50bb-4a9a-af51-42d33f679aff' (42731e40-5ead-42ad-b4cf-b72440a04ce8) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:57.872 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_9df3cd4f-62e8-43cb-9c38-704292580683' (c19e9f11-d38c-417a-a81d-ef511a5afae0) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:57.877 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_b6eccc0a-8696-442e-8b4d-cb1cbb234bb0' (acc84a39-ae7f-4c6e-a2aa-dc2a0070f19c) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:57.884 23 WARNING octavia.controller.worker.tasks.database_tasks [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:57.916 23 WARNING octavia.controller.worker.tasks.database_tasks [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:57.951 23 WARNING octavia.controller.worker.tasks.database_tasks [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:57.976 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' (9df6c8b8-ec31-4554-a4e9-13fef3372d78) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:57.978 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' (dcb09a3c-3d7d-4cfc-9d7d-535e11d3ca6e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:57.980 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' (e9af445b-0ce0-447d-9ec3-7dc4ef4606f3) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:57.994 23 WARNING octavia.controller.worker.tasks.database_tasks [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 3fb57493-72bb-4b13-aeb2-db0f5959d4e2 >2018-07-13 10:06:58.005 23 WARNING octavia.controller.worker.tasks.database_tasks [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id b9bb0e6b-e1b6-463f-9f93-319870cdc30d >2018-07-13 10:06:58.014 23 WARNING octavia.controller.worker.tasks.database_tasks [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 41fe568c-a01a-4031-97fe-26dd840a6d5a >2018-07-13 10:06:58.023 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' (c7c294c0-e379-4a94-ba45-8b2e7ca938f2) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.034 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' (521d4db5-4db2-4d9e-8a79-360fb0ca4c6a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.042 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' (16e8d5fa-a436-46de-a609-80c6890f49a1) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.061 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' (867ce4d2-6159-41ff-a994-bd3e9268bbf3) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.064 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' (3194aabe-579d-4414-8bb9-930edca709e5) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.066 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' (5ce8cef1-3147-46a9-8d3e-bc0566683b38) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.071 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' (d745d9c9-9e30-45f2-95bd-a648bf82facb) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.073 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' (88fabfeb-6646-4647-b218-2d4af1f003a9) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.081 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' (e6a202cf-5692-4443-a930-bde336698596) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.087 23 WARNING octavia.controller.worker.tasks.database_tasks [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 3fb57493-72bb-4b13-aeb2-db0f5959d4e2 >2018-07-13 10:06:58.095 23 WARNING octavia.controller.worker.tasks.database_tasks [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id b9bb0e6b-e1b6-463f-9f93-319870cdc30d >2018-07-13 10:06:58.099 23 WARNING octavia.controller.worker.tasks.database_tasks [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 41fe568c-a01a-4031-97fe-26dd840a6d5a >2018-07-13 10:06:58.105 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool41fe568c-a01a-4031-97fe-26dd840a6d5a' (75510500-a38e-46c4-af2c-1f21527bf171) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.113 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool3fb57493-72bb-4b13-aeb2-db0f5959d4e2' (2f315374-60c3-4231-b950-720652a3bf18) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.115 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_poolb9bb0e6b-e1b6-463f-9f93-319870cdc30d' (b675ae30-04cb-4357-9d8b-743e4ef9ab0b) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.120 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (0daf68f0-a4fc-413d-8e35-60edb12c1917) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.125 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (1a2b75f1-1568-4fb0-a720-1b9e77bfd0db) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.143 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (739d8693-625c-4448-bc42-e156fa3e9c9f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.149 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (7d58d31b-0733-421a-9ed9-38c7a9d07feb) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 have failed. >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 have failed. >2018-07-13 10:06:58.150 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:06:58.350 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:58.366 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:06:58.402 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 have failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >Neutron server returns request_ids: ['req-261011d0-0f4a-425e-be22-0ecf7ef3ee5e'] >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-261011d0-0f4a-425e-be22-0ecf7ef3ee5e'] >2018-07-13 10:06:58.403 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:06:58.409 23 WARNING octavia.controller.worker.controller_worker [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (052601b8-322b-4d01-927c-27565288eb01) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47004539d0>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_4e02f000-2c35-463d-abc6-6b96ff4d5af7' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47002f3ed0>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_4e02f000-2c35-463d-abc6-6b96ff4d5af7' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47002f3ed0>}, 'provides': None} > |__Atom 'delete_update_vip_listener_4e02f000-2c35-463d-abc6-6b96ff4d5af7' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47004539d0>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool3511bdff-dc5f-434b-961f-000f203188da' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 1, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f47002f3b90>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool3511bdff-dc5f-434b-961f-000f203188da' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47002f3b90>}, 'provides': None} > |__Atom 'delete_model_object_pool3511bdff-dc5f-434b-961f-000f203188da' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f47002f3b90>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool3511bdff-dc5f-434b-961f-000f203188da' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47002f3b90>}, 'provides': {'member': 1, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool3511bdff-dc5f-434b-961f-000f203188da' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47002f3b90>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47004539d0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47004539d0>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 have failed. >2018-07-13 10:06:58.409 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:06:58.409 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:58.409 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:06:58.409 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:58.409 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:58.409 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:58.409 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:06:58.409 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:58.409 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:58.409 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:58.409 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:06:58.409 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 have failed. >2018-07-13 10:06:58.409 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:06:58.418 23 WARNING octavia.controller.worker.controller_worker [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (052601b8-322b-4d01-927c-27565288eb01) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.422 23 WARNING octavia.controller.worker.controller_worker [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (2229e9b6-c8dc-4cfa-9277-d086c9a92e7a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.425 23 WARNING octavia.controller.worker.tasks.database_tasks [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:58.435 23 WARNING octavia.controller.worker.controller_worker [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_4e02f000-2c35-463d-abc6-6b96ff4d5af7' (360ffc11-7b13-4161-814c-8c10cabf17bc) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.438 23 WARNING octavia.controller.worker.tasks.database_tasks [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id 4e02f000-2c35-463d-abc6-6b96ff4d5af7 >2018-07-13 10:06:58.439 23 WARNING octavia.controller.worker.controller_worker [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_4e02f000-2c35-463d-abc6-6b96ff4d5af7' (19170241-eb89-427e-b699-10e0b4af04dc) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.444 23 WARNING octavia.controller.worker.controller_worker [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_4e02f000-2c35-463d-abc6-6b96ff4d5af7' (c65f4089-c6e0-4e03-af29-e36577f47b79) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.445 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:06:58.450 23 WARNING octavia.controller.worker.tasks.database_tasks [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:58.468 23 WARNING octavia.controller.worker.controller_worker [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool3511bdff-dc5f-434b-961f-000f203188da' (a89dbd24-358b-4a9c-84a4-83ae7094b9be) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.468 23 INFO octavia.controller.queue.endpoint [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '75c4425a-0d40-4b6e-a047-05c62c29389d'... >2018-07-13 10:06:58.479 23 WARNING octavia.controller.worker.tasks.database_tasks [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 3511bdff-dc5f-434b-961f-000f203188da >2018-07-13 10:06:58.490 23 WARNING octavia.controller.worker.controller_worker [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool3511bdff-dc5f-434b-961f-000f203188da' (acb120d2-6f52-42e5-bb25-75c90f554f62) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.504 23 WARNING octavia.controller.worker.controller_worker [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool3511bdff-dc5f-434b-961f-000f203188da' (7d453cef-0e59-4b09-9531-0ee4e0407ba4) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.518 23 WARNING octavia.controller.worker.controller_worker [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool3511bdff-dc5f-434b-961f-000f203188da' (5fe0bfc1-4ff2-4cb6-a002-83ffae3478b2) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.527 23 WARNING octavia.controller.worker.tasks.database_tasks [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 3511bdff-dc5f-434b-961f-000f203188da >2018-07-13 10:06:58.538 23 WARNING octavia.controller.worker.controller_worker [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool3511bdff-dc5f-434b-961f-000f203188da' (6a32071d-a848-4342-aa70-8cb42008e6a5) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.546 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group a1777854-a7a3-4fd9-9736-93677404285d from port 5befeea6-395f-48c5-8689-9f1cc982c2df >2018-07-13 10:06:58.552 23 WARNING octavia.controller.worker.controller_worker [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (96149819-108c-4b4d-9de7-11218e34a1bd) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.570 23 WARNING octavia.controller.worker.controller_worker [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (7e1cfb98-2ff9-43f1-b95b-ed04a817b57d) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.596 23 WARNING octavia.controller.worker.controller_worker [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (71dc34d0-2231-42ac-bf6f-c098712b8a23) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:58.646 23 WARNING octavia.controller.worker.controller_worker [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (14112fa2-2ecd-4080-a869-78fa7fea578b) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 have failed. >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 have failed. >2018-07-13 10:06:58.657 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:06:58.724 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:06:58.786 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:06:59.270 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc have failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >Neutron server returns request_ids: ['req-25cf18ae-b282-4787-9441-46157f8973f7'] >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-25cf18ae-b282-4787-9441-46157f8973f7'] >2018-07-13 10:06:59.352 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:06:59.363 23 WARNING octavia.controller.worker.controller_worker [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (41fba647-82c7-4460-be16-906a700429d2) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001df390>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_f287a8f6-01d6-4b84-afad-f6d7c1b8d25b' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47001dfcd0>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_f287a8f6-01d6-4b84-afad-f6d7c1b8d25b' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47001dfcd0>}, 'provides': None} > |__Atom 'delete_update_vip_listener_f287a8f6-01d6-4b84-afad-f6d7c1b8d25b' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001df390>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool072d1c94-5fea-4cb6-9d04-4c56bf4ba2d1' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 1, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f47001dfe10>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool072d1c94-5fea-4cb6-9d04-4c56bf4ba2d1' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47001dfe10>}, 'provides': None} > |__Atom 'delete_model_object_pool072d1c94-5fea-4cb6-9d04-4c56bf4ba2d1' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f47001dfe10>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool072d1c94-5fea-4cb6-9d04-4c56bf4ba2d1' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47001dfe10>}, 'provides': {'member': 1, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool072d1c94-5fea-4cb6-9d04-4c56bf4ba2d1' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47001dfe10>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001df390>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001df390>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc have failed. >2018-07-13 10:06:59.363 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:06:59.363 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:59.363 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:06:59.363 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:59.363 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:59.363 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:59.363 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:06:59.363 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:59.363 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:59.363 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:59.363 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:06:59.363 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc have failed. >2018-07-13 10:06:59.363 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:06:59.393 23 WARNING octavia.controller.worker.controller_worker [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (41fba647-82c7-4460-be16-906a700429d2) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:59.400 23 WARNING octavia.controller.worker.controller_worker [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (d298bbd2-c73c-4081-8d70-7c8f5f4211b7) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:59.403 23 WARNING octavia.controller.worker.tasks.database_tasks [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:59.421 23 WARNING octavia.controller.worker.controller_worker [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_f287a8f6-01d6-4b84-afad-f6d7c1b8d25b' (5ceaf367-d7ad-4ef0-83bb-71c3f5a5b7c2) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:59.424 23 WARNING octavia.controller.worker.tasks.database_tasks [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id f287a8f6-01d6-4b84-afad-f6d7c1b8d25b >2018-07-13 10:06:59.426 23 WARNING octavia.controller.worker.controller_worker [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_f287a8f6-01d6-4b84-afad-f6d7c1b8d25b' (f67c0130-bb60-4050-9a34-9627b7538661) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:59.429 23 WARNING octavia.controller.worker.controller_worker [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_f287a8f6-01d6-4b84-afad-f6d7c1b8d25b' (fb54179f-d418-48f6-b8f9-403512cbc85c) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:59.431 23 WARNING octavia.controller.worker.tasks.database_tasks [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:06:59.448 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:06:59.458 23 WARNING octavia.controller.worker.controller_worker [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool072d1c94-5fea-4cb6-9d04-4c56bf4ba2d1' (b7f74562-6c4d-4e6f-a3d4-ce5ee7c85657) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:59.465 23 WARNING octavia.controller.worker.tasks.database_tasks [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 072d1c94-5fea-4cb6-9d04-4c56bf4ba2d1 >2018-07-13 10:06:59.470 23 WARNING octavia.controller.worker.controller_worker [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool072d1c94-5fea-4cb6-9d04-4c56bf4ba2d1' (3b64b1ff-af50-4b19-8761-37e97a432c26) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:59.473 23 WARNING octavia.controller.worker.controller_worker [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool072d1c94-5fea-4cb6-9d04-4c56bf4ba2d1' (46739e69-8ad7-4c2e-a9aa-6e9fef2c54db) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:59.476 23 WARNING octavia.controller.worker.controller_worker [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool072d1c94-5fea-4cb6-9d04-4c56bf4ba2d1' (db7cc3c7-dbd9-4b5b-89bb-ec4a729365ca) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:59.479 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:06:59.481 23 WARNING octavia.controller.worker.tasks.database_tasks [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 072d1c94-5fea-4cb6-9d04-4c56bf4ba2d1 >2018-07-13 10:06:59.485 23 WARNING octavia.controller.worker.controller_worker [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool072d1c94-5fea-4cb6-9d04-4c56bf4ba2d1' (0252aa4f-968d-43ba-98dc-b7de173bcba9) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:59.488 23 WARNING octavia.controller.worker.controller_worker [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (20b6b3dc-43be-4edd-ab0d-6dd6c374c051) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:59.492 23 WARNING octavia.controller.worker.controller_worker [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (3f9ab8d3-3f63-4075-8652-b6152ede0cfa) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:59.499 23 WARNING octavia.controller.worker.controller_worker [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (4a479c56-1b5d-484f-82ad-a327ce5fb230) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:06:59.504 23 WARNING octavia.controller.worker.controller_worker [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (93ce1ff7-14f1-4424-b94b-e139f6d150d1) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc have failed. >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc have failed. >2018-07-13 10:06:59.504 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:06:59.520 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:06:59.732 23 INFO octavia.controller.queue.endpoint [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '7074d78b-0d2a-4cf5-b662-959897b2702a'... >2018-07-13 10:06:59.782 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:06:59.884 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:07:00.350 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group a5c1da62-575c-4882-95d8-ecd7592aa700 from port b56134ea-cf99-48f4-b40e-83fad7663e7f >2018-07-13 10:07:00.487 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:07:00.533 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:07:00.539 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:07:00.571 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:07:00.628 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 3c169a1e-fbfd-4082-82c0-83912f775359 from port 71ef6aac-6287-465d-b295-de358f49b57a >2018-07-13 10:07:00.836 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:07:00.942 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:07:00.955 23 INFO octavia.controller.queue.endpoint [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '73d65fe4-7ee3-4e25-94c2-07661ec8b3ca'... >2018-07-13 10:07:00.959 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:01.466 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 3c169a1e-fbfd-4082-82c0-83912f775359 >2018-07-13 10:07:01.539 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:07:01.584 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:07:01.593 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:07:01.623 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:07:01.888 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:07:01.998 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:07:02.017 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:02.594 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:07:02.644 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:07:02.673 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:07:02.689 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 have failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >Neutron server returns request_ids: ['req-ab795d48-35b9-44ed-a7a7-375e202d3ff4'] >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-ab795d48-35b9-44ed-a7a7-375e202d3ff4'] >2018-07-13 10:07:02.890 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:07:02.897 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (78b5333d-0b5c-4044-98c9-49278389933f) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470003afd0>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_e465be97-75a2-4f63-857c-1698a7b25ad3' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f470004aa10>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_e465be97-75a2-4f63-857c-1698a7b25ad3' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f470004aa10>}, 'provides': None} > |__Atom 'delete_update_vip_listener_e465be97-75a2-4f63-857c-1698a7b25ad3' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470003afd0>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool2a7b2d05-5523-4275-b30d-c2a6ac349c48' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 1, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f470004a650>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool2a7b2d05-5523-4275-b30d-c2a6ac349c48' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f470004a650>}, 'provides': None} > |__Atom 'delete_model_object_pool2a7b2d05-5523-4275-b30d-c2a6ac349c48' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f470004a650>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool2a7b2d05-5523-4275-b30d-c2a6ac349c48' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f470004a650>}, 'provides': {'member': 1, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool2a7b2d05-5523-4275-b30d-c2a6ac349c48' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f470004a650>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470003afd0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470003afd0>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 have failed. >2018-07-13 10:07:02.897 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:07:02.897 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:07:02.897 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:07:02.897 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:07:02.897 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:07:02.897 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:07:02.897 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:07:02.897 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:07:02.897 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:07:02.897 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:07:02.897 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:07:02.897 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 have failed. >2018-07-13 10:07:02.897 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:07:02.908 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (78b5333d-0b5c-4044-98c9-49278389933f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:02.912 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (29aa7cff-a3fa-4004-9833-f809b43b1915) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:02.914 23 WARNING octavia.controller.worker.tasks.database_tasks [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:07:02.925 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_e465be97-75a2-4f63-857c-1698a7b25ad3' (938b9efb-cfd7-4c48-8bd9-ca1d7d5dcd74) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:02.927 23 WARNING octavia.controller.worker.tasks.database_tasks [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id e465be97-75a2-4f63-857c-1698a7b25ad3 >2018-07-13 10:07:02.928 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_e465be97-75a2-4f63-857c-1698a7b25ad3' (be99587d-09ed-4be9-84ee-b6de7722ea4f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:02.931 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_e465be97-75a2-4f63-857c-1698a7b25ad3' (b64c5521-2f50-4663-93ac-93e4a505d3ca) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:02.934 23 WARNING octavia.controller.worker.tasks.database_tasks [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:07:02.954 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool2a7b2d05-5523-4275-b30d-c2a6ac349c48' (a0a45f1f-9030-45fd-a203-1e60e9c40761) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:02.956 23 WARNING octavia.controller.worker.tasks.database_tasks [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 2a7b2d05-5523-4275-b30d-c2a6ac349c48 >2018-07-13 10:07:02.960 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool2a7b2d05-5523-4275-b30d-c2a6ac349c48' (c91e26a7-0b97-4c39-8858-bf2aa63f6c14) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:02.963 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool2a7b2d05-5523-4275-b30d-c2a6ac349c48' (69da9a4c-3b26-40f7-a367-97c3cadd1b29) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:02.966 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool2a7b2d05-5523-4275-b30d-c2a6ac349c48' (bb9810fc-c9d7-41d4-8d16-3c34b1bdd306) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:02.968 23 WARNING octavia.controller.worker.tasks.database_tasks [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 2a7b2d05-5523-4275-b30d-c2a6ac349c48 >2018-07-13 10:07:02.972 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool2a7b2d05-5523-4275-b30d-c2a6ac349c48' (0047f566-7ccd-490a-ab38-b19712e88d68) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:02.975 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (cad25bef-2466-43a6-8e19-582b46fee489) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:02.977 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (eb8132ed-ddaa-4d01-88e1-52149b002114) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:02.983 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (631cc4c3-513a-45bf-b114-e3ab9d855185) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:02.986 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (06c80430-ac95-42f7-a4f2-80e525f02862) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 have failed. >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 have failed. >2018-07-13 10:07:02.987 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:07:03.057 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:07:03.072 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:03.647 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:07:03.729 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:07:03.752 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:07:03.760 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:07:03.856 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 11eda1b4-3e65-483e-b1e1-cbecb553f530 from port 02beb1aa-ef2c-435c-b4ff-7fffd7e7c651 >2018-07-13 10:07:04.129 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:04.133 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:07:04.698 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 11eda1b4-3e65-483e-b1e1-cbecb553f530 >2018-07-13 10:07:04.735 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:07:04.801 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:07:04.812 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:07:04.828 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:07:05.187 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:07:05.285 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 have failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >Neutron server returns request_ids: ['req-5820257e-efcb-4c6c-a0c2-1354e8168147'] >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-5820257e-efcb-4c6c-a0c2-1354e8168147'] >2018-07-13 10:07:05.803 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:07:05.809 23 WARNING octavia.controller.worker.controller_worker [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (feba6499-829c-4f85-a23b-fcd4463a945b) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700145210>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_c42d1a5a-e6f7-4614-a3f5-940a722bf3bd' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f46e0711650>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_c42d1a5a-e6f7-4614-a3f5-940a722bf3bd' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f46e0711650>}, 'provides': None} > |__Atom 'delete_update_vip_listener_c42d1a5a-e6f7-4614-a3f5-940a722bf3bd' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700145210>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool5900ca7a-c3d8-4c48-a204-76e0e04c0d5c' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 1, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f46e07b21d0>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool5900ca7a-c3d8-4c48-a204-76e0e04c0d5c' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f46e07b21d0>}, 'provides': None} > |__Atom 'delete_model_object_pool5900ca7a-c3d8-4c48-a204-76e0e04c0d5c' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f46e07b21d0>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool5900ca7a-c3d8-4c48-a204-76e0e04c0d5c' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f46e07b21d0>}, 'provides': {'member': 1, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool5900ca7a-c3d8-4c48-a204-76e0e04c0d5c' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f46e07b21d0>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700145210>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700145210>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 have failed. >2018-07-13 10:07:05.809 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:07:05.809 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:07:05.809 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:07:05.809 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:07:05.809 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:07:05.809 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:07:05.809 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:07:05.809 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:07:05.809 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:07:05.809 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:07:05.809 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:07:05.809 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 have failed. >2018-07-13 10:07:05.809 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:07:05.827 23 WARNING octavia.controller.worker.controller_worker [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (feba6499-829c-4f85-a23b-fcd4463a945b) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:05.832 23 WARNING octavia.controller.worker.controller_worker [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (a42df180-cc8d-4b1b-8d0f-9de5985f7425) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:05.839 23 WARNING octavia.controller.worker.tasks.database_tasks [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:07:05.853 23 WARNING octavia.controller.worker.controller_worker [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_c42d1a5a-e6f7-4614-a3f5-940a722bf3bd' (f0aed7fc-8ebd-4915-97ab-d8efde9e933c) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:05.856 23 WARNING octavia.controller.worker.tasks.database_tasks [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id c42d1a5a-e6f7-4614-a3f5-940a722bf3bd >2018-07-13 10:07:05.857 23 WARNING octavia.controller.worker.controller_worker [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_c42d1a5a-e6f7-4614-a3f5-940a722bf3bd' (d4554937-4ca8-4373-9918-212698328268) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:05.860 23 WARNING octavia.controller.worker.controller_worker [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_c42d1a5a-e6f7-4614-a3f5-940a722bf3bd' (f565559b-afd6-4022-bcc9-26d5d7380317) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:05.863 23 WARNING octavia.controller.worker.tasks.database_tasks [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:07:05.877 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:07:05.877 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:07:05.885 23 WARNING octavia.controller.worker.controller_worker [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool5900ca7a-c3d8-4c48-a204-76e0e04c0d5c' (8cc410a0-de6e-4ec5-a1ae-8cb5fa0d9baf) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:05.887 23 WARNING octavia.controller.worker.tasks.database_tasks [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 5900ca7a-c3d8-4c48-a204-76e0e04c0d5c >2018-07-13 10:07:05.891 23 WARNING octavia.controller.worker.controller_worker [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool5900ca7a-c3d8-4c48-a204-76e0e04c0d5c' (b96982ec-56ca-40a9-9bf9-bb02b958f8af) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:05.895 23 WARNING octavia.controller.worker.controller_worker [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool5900ca7a-c3d8-4c48-a204-76e0e04c0d5c' (f914dcce-f061-4b74-8cae-5be4b6e14923) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:05.898 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:07:05.900 23 WARNING octavia.controller.worker.controller_worker [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool5900ca7a-c3d8-4c48-a204-76e0e04c0d5c' (9c89b6c0-119b-433a-a0f6-33d2bafbc12a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:05.903 23 WARNING octavia.controller.worker.tasks.database_tasks [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 5900ca7a-c3d8-4c48-a204-76e0e04c0d5c >2018-07-13 10:07:05.907 23 WARNING octavia.controller.worker.controller_worker [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool5900ca7a-c3d8-4c48-a204-76e0e04c0d5c' (49c367bc-d97d-47c3-bada-115825a62f1f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:05.910 23 WARNING octavia.controller.worker.controller_worker [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (5b3f56c7-112e-43b1-8f0e-e0cc33389d16) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:05.913 23 WARNING octavia.controller.worker.controller_worker [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (e6aa0a4c-0ae2-42a9-a684-b621f69da0cf) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:05.919 23 WARNING octavia.controller.worker.controller_worker [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (5ab8cb22-fbb3-4025-b79b-7f9e307ce64c) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:05.923 23 WARNING octavia.controller.worker.controller_worker [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (7f993431-06e5-4c67-8040-4761d762db9d) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 have failed. >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 have failed. >2018-07-13 10:07:05.923 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:07:06.245 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:07:06.352 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 have failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >Neutron server returns request_ids: ['req-a9a645ab-e4f8-4d6d-9da7-a58d092846e8'] >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-a9a645ab-e4f8-4d6d-9da7-a58d092846e8'] >2018-07-13 10:07:06.900 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:07:06.907 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (1fe19ec7-78c6-4177-a984-dead070d0a25) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e07118d0>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_e72b7093-87c8-473a-bc05-4ba392d9f1b2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f46e0711b10>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_e72b7093-87c8-473a-bc05-4ba392d9f1b2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f46e0711b10>}, 'provides': None} > |__Atom 'delete_update_vip_listener_e72b7093-87c8-473a-bc05-4ba392d9f1b2' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e07118d0>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool6dc397c4-1c7f-4cc3-b0b4-c4e4a937126f' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 1, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f46e0711bd0>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool6dc397c4-1c7f-4cc3-b0b4-c4e4a937126f' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f46e0711bd0>}, 'provides': None} > |__Atom 'delete_model_object_pool6dc397c4-1c7f-4cc3-b0b4-c4e4a937126f' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f46e0711bd0>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool6dc397c4-1c7f-4cc3-b0b4-c4e4a937126f' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f46e0711bd0>}, 'provides': {'member': 1, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool6dc397c4-1c7f-4cc3-b0b4-c4e4a937126f' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f46e0711bd0>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e07118d0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e07118d0>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 have failed. >2018-07-13 10:07:06.907 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:07:06.907 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:07:06.907 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:07:06.907 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:07:06.907 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:07:06.907 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:07:06.907 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:07:06.907 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:07:06.907 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:07:06.907 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:07:06.907 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:07:06.907 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 have failed. >2018-07-13 10:07:06.907 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:07:06.917 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (1fe19ec7-78c6-4177-a984-dead070d0a25) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:06.921 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (98974f60-d2fe-4b74-874d-a38b1911e967) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:06.923 23 WARNING octavia.controller.worker.tasks.database_tasks [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:07:06.935 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_e72b7093-87c8-473a-bc05-4ba392d9f1b2' (264b8a21-cd3f-4b2d-a931-82ab2c08fc9c) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:06.940 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:07:06.942 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:07:06.943 23 WARNING octavia.controller.worker.tasks.database_tasks [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id e72b7093-87c8-473a-bc05-4ba392d9f1b2 >2018-07-13 10:07:06.944 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_e72b7093-87c8-473a-bc05-4ba392d9f1b2' (375dc1c7-bbf7-4d9f-ac37-d7b8d70b403d) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:06.948 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_e72b7093-87c8-473a-bc05-4ba392d9f1b2' (3c90f546-f718-4fcd-a9a4-3002816cac7f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:06.950 23 WARNING octavia.controller.worker.tasks.database_tasks [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:07:06.966 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool6dc397c4-1c7f-4cc3-b0b4-c4e4a937126f' (ebd1eb93-56f9-4b43-9267-ffb5405c5ba2) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:06.969 23 WARNING octavia.controller.worker.tasks.database_tasks [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 6dc397c4-1c7f-4cc3-b0b4-c4e4a937126f >2018-07-13 10:07:06.972 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool6dc397c4-1c7f-4cc3-b0b4-c4e4a937126f' (198f2a73-4ce4-4ddd-a0e5-e1be0466eed8) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:06.975 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool6dc397c4-1c7f-4cc3-b0b4-c4e4a937126f' (f2c88da0-20a6-4b76-ac48-cd8f16845c69) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:06.978 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool6dc397c4-1c7f-4cc3-b0b4-c4e4a937126f' (068b1a73-5831-464d-8590-2d7ee2119904) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:06.980 23 WARNING octavia.controller.worker.tasks.database_tasks [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 6dc397c4-1c7f-4cc3-b0b4-c4e4a937126f >2018-07-13 10:07:06.983 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool6dc397c4-1c7f-4cc3-b0b4-c4e4a937126f' (1566a1f0-9057-49c8-9bcf-759484d1695c) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:06.986 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (f7a9a967-959e-4146-a53f-08cba2539dcc) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:06.989 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (acb4cb3c-feae-4341-ad20-a79cd6494faf) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:06.995 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (eb1641fc-001e-48ce-b558-a5572b3eaebc) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:06.999 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (e8eef3d6-a188-427f-8b07-475479358bcb) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 have failed. >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 have failed. >2018-07-13 10:07:07.000 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:07:07.300 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:07:07.404 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:07.995 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:07:07.999 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 have failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >Neutron server returns request_ids: ['req-f1206845-7125-46cd-b3da-e48c508e3908'] >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-f1206845-7125-46cd-b3da-e48c508e3908'] >2018-07-13 10:07:08.301 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:07:08.307 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (e8a647a0-a620-46e9-b6db-1a29f2a2fcea) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4708423c90>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_696071ef-00cf-4252-9be4-5776e2707d75' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47000adb90>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_696071ef-00cf-4252-9be4-5776e2707d75' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47000adb90>}, 'provides': None} > |__Atom 'delete_update_vip_listener_696071ef-00cf-4252-9be4-5776e2707d75' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4708423c90>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool23fabd71-623f-4678-8844-906f63cd1aac' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 2, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f470066ad90>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool23fabd71-623f-4678-8844-906f63cd1aac' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f470066ad90>}, 'provides': None} > |__Atom 'delete_model_object_pool23fabd71-623f-4678-8844-906f63cd1aac' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f470066ad90>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool23fabd71-623f-4678-8844-906f63cd1aac' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f470066ad90>}, 'provides': {'member': 2, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool23fabd71-623f-4678-8844-906f63cd1aac' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f470066ad90>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4708423c90>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4708423c90>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 have failed. >2018-07-13 10:07:08.307 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:07:08.307 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:07:08.307 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:07:08.307 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:07:08.307 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:07:08.307 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:07:08.307 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:07:08.307 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:07:08.307 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:07:08.307 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:07:08.307 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:07:08.307 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 have failed. >2018-07-13 10:07:08.307 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:07:08.315 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (e8a647a0-a620-46e9-b6db-1a29f2a2fcea) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:08.319 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (359bf62a-b04f-4be1-9512-fffe5a41d903) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:08.321 23 WARNING octavia.controller.worker.tasks.database_tasks [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:07:08.333 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_696071ef-00cf-4252-9be4-5776e2707d75' (c06ae3b5-95bb-4144-bff9-6594b810b079) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:08.336 23 WARNING octavia.controller.worker.tasks.database_tasks [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id 696071ef-00cf-4252-9be4-5776e2707d75 >2018-07-13 10:07:08.337 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_696071ef-00cf-4252-9be4-5776e2707d75' (6fd32914-d1f5-4a23-b216-5758810a15ae) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:08.340 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_696071ef-00cf-4252-9be4-5776e2707d75' (4b3c9c02-e217-460f-9f73-6dfdfcc36116) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:08.343 23 WARNING octavia.controller.worker.tasks.database_tasks [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:07:08.367 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool23fabd71-623f-4678-8844-906f63cd1aac' (106ec4da-0c92-463d-ba10-c36d72944fe1) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:08.370 23 WARNING octavia.controller.worker.tasks.database_tasks [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 23fabd71-623f-4678-8844-906f63cd1aac >2018-07-13 10:07:08.374 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool23fabd71-623f-4678-8844-906f63cd1aac' (c600bf3b-17af-490a-88ef-e82e2a412134) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:08.378 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool23fabd71-623f-4678-8844-906f63cd1aac' (54c424c4-5ecc-476d-a83a-5923f3a2f4ef) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:08.381 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool23fabd71-623f-4678-8844-906f63cd1aac' (473d864a-f156-4417-a441-c23938107e7f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:08.383 23 WARNING octavia.controller.worker.tasks.database_tasks [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 23fabd71-623f-4678-8844-906f63cd1aac >2018-07-13 10:07:08.393 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool23fabd71-623f-4678-8844-906f63cd1aac' (b306a194-546b-4f65-83fe-5c3cdd0f66ad) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:08.395 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (dc78dbd9-543f-4f24-ad76-3882bf62feb2) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:08.398 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (a1fa6e68-31f1-4722-8a16-0145f685030a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:08.405 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (bb99d3fe-d4bb-4d10-a13e-2a461533c725) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:08.415 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (8c1b2900-58d5-4457-8f9c-d9f9e2d94738) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 have failed. >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 have failed. >2018-07-13 10:07:08.416 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:07:08.470 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:09.049 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:07:09.052 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:07:09.524 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:10.111 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:07:10.112 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:07:10.577 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:11.173 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:07:11.177 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:07:11.631 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:12.227 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:07:12.237 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:07:12.690 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 1b509d93-f412-4add-843b-2c0b12107198 have failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >Neutron server returns request_ids: ['req-38b47239-9d94-4273-ad26-a6a3ea00ae9b'] >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-38b47239-9d94-4273-ad26-a6a3ea00ae9b'] >2018-07-13 10:07:13.238 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:07:13.244 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (2970e165-af9e-4cb9-8816-0a37e1de75d1) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47083fe650>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_25914e2f-ae0e-47f0-9b56-5ad8bf9822c0' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47085e1350>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_25914e2f-ae0e-47f0-9b56-5ad8bf9822c0' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47085e1350>}, 'provides': None} > |__Atom 'delete_update_vip_listener_25914e2f-ae0e-47f0-9b56-5ad8bf9822c0' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47083fe650>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool69797cc0-6031-46a6-8844-7dee0625bd8a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 3, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f47005d7250>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool69797cc0-6031-46a6-8844-7dee0625bd8a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47005d7250>}, 'provides': None} > |__Atom 'delete_model_object_pool69797cc0-6031-46a6-8844-7dee0625bd8a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f47005d7250>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool69797cc0-6031-46a6-8844-7dee0625bd8a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47005d7250>}, 'provides': {'member': 3, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool69797cc0-6031-46a6-8844-7dee0625bd8a' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47005d7250>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47083fe650>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47083fe650>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 1b509d93-f412-4add-843b-2c0b12107198 have failed. >2018-07-13 10:07:13.244 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:07:13.244 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:07:13.244 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:07:13.244 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:07:13.244 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:07:13.244 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:07:13.244 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:07:13.244 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:07:13.244 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:07:13.244 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:07:13.244 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:07:13.244 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 1b509d93-f412-4add-843b-2c0b12107198 have failed. >2018-07-13 10:07:13.244 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:07:13.253 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (2970e165-af9e-4cb9-8816-0a37e1de75d1) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:13.257 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (0611d5eb-c930-48b5-87f7-7e397b8b8b84) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:13.259 23 WARNING octavia.controller.worker.tasks.database_tasks [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:07:13.270 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_25914e2f-ae0e-47f0-9b56-5ad8bf9822c0' (c2c90cc7-64d2-4554-ac63-8c056abf1349) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:13.272 23 WARNING octavia.controller.worker.tasks.database_tasks [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id 25914e2f-ae0e-47f0-9b56-5ad8bf9822c0 >2018-07-13 10:07:13.273 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_25914e2f-ae0e-47f0-9b56-5ad8bf9822c0' (674e8bb0-a3ce-4b57-8b53-ff923808eeb7) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:13.276 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_25914e2f-ae0e-47f0-9b56-5ad8bf9822c0' (cfc74250-2a3f-403d-a40e-c276fbdd7b23) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:13.279 23 WARNING octavia.controller.worker.tasks.database_tasks [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:07:13.287 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:07:13.311 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool69797cc0-6031-46a6-8844-7dee0625bd8a' (24e9b4b5-0aaf-48b4-85c6-669b116f2dc3) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:13.314 23 WARNING octavia.controller.worker.tasks.database_tasks [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 69797cc0-6031-46a6-8844-7dee0625bd8a >2018-07-13 10:07:13.317 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool69797cc0-6031-46a6-8844-7dee0625bd8a' (ff11f79b-5782-4132-9854-44ec92cb34db) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:13.320 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool69797cc0-6031-46a6-8844-7dee0625bd8a' (209661e8-3924-4fd0-adad-8e4c11a49a17) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:13.323 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool69797cc0-6031-46a6-8844-7dee0625bd8a' (3939ee06-bc4a-46b4-913f-ca0cc2390841) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:13.325 23 WARNING octavia.controller.worker.tasks.database_tasks [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 69797cc0-6031-46a6-8844-7dee0625bd8a >2018-07-13 10:07:13.329 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool69797cc0-6031-46a6-8844-7dee0625bd8a' (cf023b5b-dc1d-4ecd-8ff2-e1e95092c0c8) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:13.332 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (24735b2c-0d32-412b-aa33-c8e41026142d) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:13.335 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (adaa79a8-043f-44eb-b19e-a14a07a93a60) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:13.342 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (6a827fe8-e52f-42cf-a4b2-021030b98fb1) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:13.345 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (861e3ea3-3742-4c3d-ab84-e7c89a779f40) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 1b509d93-f412-4add-843b-2c0b12107198 have failed. >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 1b509d93-f412-4add-843b-2c0b12107198 have failed. >2018-07-13 10:07:13.346 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:07:13.748 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:14.344 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:07:14.850 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:15.424 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:07:16.111 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group a1777854-a7a3-4fd9-9736-93677404285d have failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >Neutron server returns request_ids: ['req-ee4dd45e-8c82-4a22-9d85-f4136bf2493f'] >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-ee4dd45e-8c82-4a22-9d85-f4136bf2493f'] >2018-07-13 10:07:16.425 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:07:16.431 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (201267e9-ecd2-4b1d-b494-4b234506508f) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700612bd0>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_287a4a6c-a014-4355-a492-75f5352046bb' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f470073b350>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_287a4a6c-a014-4355-a492-75f5352046bb' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f470073b350>}, 'provides': None} > |__Atom 'delete_update_vip_listener_287a4a6c-a014-4355-a492-75f5352046bb' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700612bd0>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool42ae40ee-b444-4d30-8a9f-00c4ac7f2cc1' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 1, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f47006e5790>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool42ae40ee-b444-4d30-8a9f-00c4ac7f2cc1' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47006e5790>}, 'provides': None} > |__Atom 'delete_model_object_pool42ae40ee-b444-4d30-8a9f-00c4ac7f2cc1' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f47006e5790>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool42ae40ee-b444-4d30-8a9f-00c4ac7f2cc1' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47006e5790>}, 'provides': {'member': 1, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool42ae40ee-b444-4d30-8a9f-00c4ac7f2cc1' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47006e5790>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700612bd0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700612bd0>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group a1777854-a7a3-4fd9-9736-93677404285d have failed. >2018-07-13 10:07:16.431 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:07:16.431 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:07:16.431 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:07:16.431 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:07:16.431 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:07:16.431 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:07:16.431 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:07:16.431 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:07:16.431 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:07:16.431 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:07:16.431 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:07:16.431 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group a1777854-a7a3-4fd9-9736-93677404285d have failed. >2018-07-13 10:07:16.431 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:07:16.442 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (201267e9-ecd2-4b1d-b494-4b234506508f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:16.446 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (f4f4c2cf-a913-4cd5-8d55-0cc5e889beb5) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:16.449 23 WARNING octavia.controller.worker.tasks.database_tasks [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:07:16.459 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_287a4a6c-a014-4355-a492-75f5352046bb' (68f9f9af-536d-4c8f-86eb-54f337695625) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:16.461 23 WARNING octavia.controller.worker.tasks.database_tasks [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id 287a4a6c-a014-4355-a492-75f5352046bb >2018-07-13 10:07:16.462 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_287a4a6c-a014-4355-a492-75f5352046bb' (4f9d3b72-22ba-434f-8841-ad35b0fed5a9) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:16.466 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_287a4a6c-a014-4355-a492-75f5352046bb' (6a54b456-53fd-46c8-ac7c-753865baf5c6) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:16.468 23 WARNING octavia.controller.worker.tasks.database_tasks [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:07:16.486 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool42ae40ee-b444-4d30-8a9f-00c4ac7f2cc1' (8d3bf02a-8076-4e99-9e09-dbc5505904a4) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:16.488 23 WARNING octavia.controller.worker.tasks.database_tasks [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 42ae40ee-b444-4d30-8a9f-00c4ac7f2cc1 >2018-07-13 10:07:16.493 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool42ae40ee-b444-4d30-8a9f-00c4ac7f2cc1' (0a13d0e5-e29e-4ff7-9099-b8b8ec96ae2f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:16.498 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool42ae40ee-b444-4d30-8a9f-00c4ac7f2cc1' (d6915b85-5038-496b-afce-9cf0e16c2f8e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:16.502 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool42ae40ee-b444-4d30-8a9f-00c4ac7f2cc1' (486b4825-0fad-4a12-8c91-1b03b2d6f8be) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:16.504 23 WARNING octavia.controller.worker.tasks.database_tasks [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 42ae40ee-b444-4d30-8a9f-00c4ac7f2cc1 >2018-07-13 10:07:16.509 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool42ae40ee-b444-4d30-8a9f-00c4ac7f2cc1' (b606dba8-cbcb-4c68-9e93-ede38951737c) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:16.512 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (826740d4-9f92-4000-be91-17360cc2387a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:16.516 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (3a7d57ca-7960-4aab-a050-e4fd2a912dbc) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:16.522 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (b0b3b167-2880-4bf8-9bb9-4062b21314a1) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:16.526 23 WARNING octavia.controller.worker.controller_worker [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (6aaf24e2-4d0f-4531-9df3-2c81369f10c1) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group a1777854-a7a3-4fd9-9736-93677404285d have failed. >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group a1777854-a7a3-4fd9-9736-93677404285d have failed. >2018-07-13 10:07:16.527 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:07:17.467 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 have failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >Neutron server returns request_ids: ['req-25b219a3-cd87-44d7-af2e-a961872ea219'] >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-25b219a3-cd87-44d7-af2e-a961872ea219'] >2018-07-13 10:07:18.468 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:07:18.474 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (87079859-e912-44c7-b589-2b2cc163ed67) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001eead0>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_b8480229-60d4-4a00-a507-5d50043e7df9' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f46e06a9690>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_b8480229-60d4-4a00-a507-5d50043e7df9' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f46e06a9690>}, 'provides': None} > |__Atom 'delete_update_vip_listener_b8480229-60d4-4a00-a507-5d50043e7df9' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001eead0>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_poolcd8e0312-97c5-411a-947d-3d65ca2e9554' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 1, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f46e06a9d90>}, 'provides': None} > |__Atom 'delete_pool_in_db_poolcd8e0312-97c5-411a-947d-3d65ca2e9554' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f46e06a9d90>}, 'provides': None} > |__Atom 'delete_model_object_poolcd8e0312-97c5-411a-947d-3d65ca2e9554' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f46e06a9d90>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_poolcd8e0312-97c5-411a-947d-3d65ca2e9554' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f46e06a9d90>}, 'provides': {'member': 1, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_poolcd8e0312-97c5-411a-947d-3d65ca2e9554' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f46e06a9d90>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001eead0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001eead0>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 have failed. >2018-07-13 10:07:18.474 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:07:18.474 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:07:18.474 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:07:18.474 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:07:18.474 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:07:18.474 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:07:18.474 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:07:18.474 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:07:18.474 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:07:18.474 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:07:18.474 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:07:18.474 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 have failed. >2018-07-13 10:07:18.474 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:07:18.484 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (87079859-e912-44c7-b589-2b2cc163ed67) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:18.488 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (4891866e-3b0c-45ba-954e-b199b29e36de) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:18.491 23 WARNING octavia.controller.worker.tasks.database_tasks [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:07:18.504 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_b8480229-60d4-4a00-a507-5d50043e7df9' (7b1a2bc6-44db-447c-adfa-0295a835303e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:18.507 23 WARNING octavia.controller.worker.tasks.database_tasks [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id b8480229-60d4-4a00-a507-5d50043e7df9 >2018-07-13 10:07:18.509 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_b8480229-60d4-4a00-a507-5d50043e7df9' (4227f104-9034-4fdf-ba66-b47fce44ebd7) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:18.512 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_b8480229-60d4-4a00-a507-5d50043e7df9' (de134cbc-8792-467d-9ffe-baacf3599f00) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:18.517 23 WARNING octavia.controller.worker.tasks.database_tasks [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:07:18.535 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_poolcd8e0312-97c5-411a-947d-3d65ca2e9554' (4de3d158-1f19-49e9-ab84-5a73ee1d961f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:18.537 23 WARNING octavia.controller.worker.tasks.database_tasks [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id cd8e0312-97c5-411a-947d-3d65ca2e9554 >2018-07-13 10:07:18.541 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_poolcd8e0312-97c5-411a-947d-3d65ca2e9554' (9e201ee7-ba74-472a-a0ee-5a0e72f673c5) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:18.544 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_poolcd8e0312-97c5-411a-947d-3d65ca2e9554' (1b5e8992-a020-4955-96f6-acf9130b50eb) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:18.548 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_poolcd8e0312-97c5-411a-947d-3d65ca2e9554' (7aeac35f-e46a-41db-a2f5-eb70cacd08ad) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:18.550 23 WARNING octavia.controller.worker.tasks.database_tasks [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id cd8e0312-97c5-411a-947d-3d65ca2e9554 >2018-07-13 10:07:18.554 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_poolcd8e0312-97c5-411a-947d-3d65ca2e9554' (e8e471ce-8b95-45ad-bc6d-ec2b53c772ac) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:18.556 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (d5a25aa6-a1dc-4b1e-8479-3fe6b3f75f19) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:18.559 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (ce542d72-be8c-4f91-b7e7-bf2cf56968b3) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:18.566 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (a53dca30-359b-42c5-aee0-a262f0235a0e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:07:18.570 23 WARNING octavia.controller.worker.controller_worker [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (3af99347-d77e-487f-8795-19a0747dab9b) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 have failed. >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 have failed. >2018-07-13 10:07:18.570 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:15:37.510 23 INFO octavia.controller.queue.endpoint [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f88d70db-20a8-4784-bc0a-d9401225b63a'... >2018-07-13 10:15:38.010 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 1b509d93-f412-4add-843b-2c0b12107198 from port ee18712e-63af-42d7-888c-a221d493002e >2018-07-13 10:15:38.487 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:39.538 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:39.547 23 INFO octavia.controller.queue.endpoint [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '7d7fdbfc-7d4c-4986-bc27-09fbc98ee48c'... >2018-07-13 10:15:39.989 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 from port 1dc57ded-d36c-4d25-90ec-fe6cf949d19e >2018-07-13 10:15:40.461 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:40.594 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:41.514 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:41.550 23 INFO octavia.controller.queue.endpoint [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'bf691cc6-68f2-4cb5-8aac-b5c6f75906b3'... >2018-07-13 10:15:41.657 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:42.064 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group c63248dd-e4de-4d1e-a475-db236013fcb2 from port c39aeac3-f770-4cba-a263-2f1962f7002c >2018-07-13 10:15:42.546 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:42.573 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:42.891 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:43.552 23 INFO octavia.controller.queue.endpoint [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '1e238de7-5fce-44f2-900d-5dda8b0d52ca'... >2018-07-13 10:15:43.598 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:43.671 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:43.966 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:44.115 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group f8a6d69f-b472-456d-a908-fb26ce91c32b from port 66dd76a2-f67c-40f0-9874-335486a342ca >2018-07-13 10:15:44.652 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:44.705 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:15:44.730 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:45.027 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:45.489 23 INFO octavia.controller.queue.endpoint [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'd839bfd4-f87e-49b2-a926-6be954ab606a'... >2018-07-13 10:15:45.718 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:45.783 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:45.878 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:15:46.009 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 from port f6e8669b-165d-4314-b21b-6bbb966608f1 >2018-07-13 10:15:46.079 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:46.607 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:15:46.775 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:46.841 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:46.930 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:15:47.138 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:47.470 23 INFO octavia.controller.queue.endpoint [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'cb089d74-7924-4791-a5c6-42321c7e9ffe'... >2018-07-13 10:15:47.667 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:15:47.831 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:47.908 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:47.982 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:15:48.128 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group cbc7992b-dc9b-485d-abee-756b36d1c58a from port 1146b5b0-96aa-4f85-acdf-176bc9810f66 >2018-07-13 10:15:48.207 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:48.721 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:15:48.895 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:48.906 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:15:48.965 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:49.037 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:15:49.260 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:49.386 23 INFO octavia.controller.queue.endpoint [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '7074d78b-0d2a-4cf5-b662-959897b2702a'... >2018-07-13 10:15:49.688 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group a5c1da62-575c-4882-95d8-ecd7592aa700 from port b56134ea-cf99-48f4-b40e-83fad7663e7f >2018-07-13 10:15:49.777 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:15:49.960 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:15:50.008 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:50.024 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:50.089 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:15:50.161 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:15:50.315 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:50.831 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:15:51.019 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:15:51.063 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:51.082 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:51.141 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:15:51.213 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:15:51.358 23 INFO octavia.controller.queue.endpoint [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '3d060eea-2cab-4674-85fa-96d38a3a3b97'... >2018-07-13 10:15:51.374 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:51.877 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 from port 0b4eb23a-5268-4f62-a9a4-b35a72f32053 >2018-07-13 10:15:51.884 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:15:52.073 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:15:52.116 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:52.138 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:52.193 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:15:52.267 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:15:52.430 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:52.485 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:15:52.935 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:15:53.133 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:15:53.168 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:53.196 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:53.248 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:15:53.323 23 INFO octavia.controller.queue.endpoint [req-579303fd-2fa4-4350-8a33-b258f7939f43 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '095a5856-7a21-41fb-9f8e-621d3b27d657'... >2018-07-13 10:15:53.331 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:15:53.491 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:53.542 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:15:54.056 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:15:54.187 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:15:54.229 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:54.253 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:54.302 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:15:54.385 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:15:54.569 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 1b509d93-f412-4add-843b-2c0b12107198 failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:54.609 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:15:55.244 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:15:55.308 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:55.353 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:15:55.426 23 INFO octavia.controller.queue.endpoint [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '7b64a842-9be9-4b7d-a351-9e3c0df2dcbb'... >2018-07-13 10:15:55.490 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:15:55.495 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:55.506 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 1b509d93-f412-4add-843b-2c0b12107198 have failed.: Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >Neutron server returns request_ids: ['req-f886a360-c4a2-4636-94f8-b813015bbcf1'] >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 1b509d93-f412-4add-843b-2c0b12107198 in use. >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-f886a360-c4a2-4636-94f8-b813015bbcf1'] >2018-07-13 10:15:55.571 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:15:55.577 23 WARNING octavia.controller.worker.controller_worker [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (fcfe42d2-5f8a-4058-ba85-3f13329cbd0c) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e0794d90>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e0794d90>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e0794d90>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 1b509d93-f412-4add-843b-2c0b12107198 have failed. >2018-07-13 10:15:55.577 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:15:55.577 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:15:55.577 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:15:55.577 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:15:55.577 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:15:55.577 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:15:55.577 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:15:55.577 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:15:55.577 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:15:55.577 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:15:55.577 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:15:55.577 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 1b509d93-f412-4add-843b-2c0b12107198 have failed. >2018-07-13 10:15:55.577 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:15:55.586 23 WARNING octavia.controller.worker.controller_worker [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (fcfe42d2-5f8a-4058-ba85-3f13329cbd0c) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:15:55.589 23 WARNING octavia.controller.worker.controller_worker [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (f9f0b07d-2d44-4960-a186-9118b1056bd0) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:15:55.592 23 WARNING octavia.controller.worker.controller_worker [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (d0fabacc-5732-4473-a833-9fc4ca4afa42) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:15:55.595 23 WARNING octavia.controller.worker.controller_worker [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (aeef5fcc-fa5f-4edc-ad02-cb7bfef93eb7) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:15:55.602 23 WARNING octavia.controller.worker.controller_worker [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (cd807afc-b142-4160-8f5e-3fe4d9812741) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:15:55.605 23 WARNING octavia.controller.worker.controller_worker [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (10d029dd-09e4-4b79-bdd6-cb88920f1600) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 1b509d93-f412-4add-843b-2c0b12107198 have failed. >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 1b509d93-f412-4add-843b-2c0b12107198 have failed. >2018-07-13 10:15:55.605 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:15:55.717 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:15:55.822 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 71110b7f-f779-4a26-b70d-43f5a8394899 from port 61714dab-74b9-4034-b81d-d0064359f8ee >2018-07-13 10:15:56.143 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-579303fd-2fa4-4350-8a33-b258f7939f43 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group a29dfa43-175a-41eb-a9af-c71d4cabbd52 from port a43e20d7-a5dc-468a-9391-9f7751755ef8 >2018-07-13 10:15:56.307 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:15:56.312 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:15:56.365 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:56.406 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:15:56.545 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:15:56.554 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:56.771 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:15:56.790 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:15:56.873 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-579303fd-2fa4-4350-8a33-b258f7939f43 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group a29dfa43-175a-41eb-a9af-c71d4cabbd52 >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 have failed.: Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >Neutron server returns request_ids: ['req-18a69ffe-7fb8-4881-b92a-17be1e602457'] >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 in use. >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-18a69ffe-7fb8-4881-b92a-17be1e602457'] >2018-07-13 10:15:57.366 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:15:57.371 23 WARNING octavia.controller.worker.controller_worker [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (de875ef7-d912-4551-98ae-b20a7cdb8a63) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001b6110>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001b6110>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001b6110>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 have failed. >2018-07-13 10:15:57.371 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:15:57.371 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:15:57.371 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:15:57.371 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:15:57.371 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:15:57.371 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:15:57.371 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:15:57.371 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:15:57.371 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:15:57.371 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:15:57.371 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:15:57.371 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 have failed. >2018-07-13 10:15:57.371 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:15:57.377 23 WARNING octavia.controller.worker.controller_worker [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (de875ef7-d912-4551-98ae-b20a7cdb8a63) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:15:57.380 23 WARNING octavia.controller.worker.controller_worker [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (bd537d70-ffca-406f-9145-ff9c145a65d4) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:15:57.386 23 WARNING octavia.controller.worker.controller_worker [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (9a444858-28c7-4b3f-be82-c3be4ec882e1) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:15:57.389 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:15:57.390 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:15:57.392 23 WARNING octavia.controller.worker.controller_worker [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (e129a550-d0f9-4cf3-a6a5-fb4355bd2853) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:15:57.400 23 WARNING octavia.controller.worker.controller_worker [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (a56f93d4-0438-4dfb-90b7-f1fc91073df6) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:15:57.402 23 WARNING octavia.controller.worker.controller_worker [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (18321b3f-fe8a-47ce-9cdf-1474d0b2b6f3) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 have failed. >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 have failed. >2018-07-13 10:15:57.403 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:15:57.404 23 INFO octavia.controller.queue.endpoint [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '87758df5-ad27-4e56-95fa-295938682eba'... >2018-07-13 10:15:57.470 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:15:57.600 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:15:57.611 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:57.771 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc from port ef4d6bb6-ddfd-4dfe-8561-8e928cb46da5 >2018-07-13 10:15:57.850 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:15:57.865 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:15:58.447 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:15:58.449 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:15:58.515 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:15:58.521 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:15:58.651 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:15:58.662 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:58.902 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:15:58.923 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:15:59.429 23 INFO octavia.controller.queue.endpoint [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'a796e34c-86bd-426d-909c-5d89897d40d1'... >2018-07-13 10:15:59.546 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:15:59.582 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:15:59.599 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 have failed.: Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >Neutron server returns request_ids: ['req-84c674ab-9937-41f6-9c79-74afc3bc00a9'] >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group c63248dd-e4de-4d1e-a475-db236013fcb2 in use. >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-84c674ab-9937-41f6-9c79-74afc3bc00a9'] >2018-07-13 10:15:59.663 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:15:59.666 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:15:59.669 23 WARNING octavia.controller.worker.controller_worker [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (74ce4720-ff4d-41c5-95f4-01fa3d0f1c09) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e058f0d0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e058f0d0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e058f0d0>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 have failed. >2018-07-13 10:15:59.669 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:15:59.669 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:15:59.669 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:15:59.669 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:15:59.669 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:15:59.669 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:15:59.669 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:15:59.669 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:15:59.669 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:15:59.669 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:15:59.669 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:15:59.669 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 have failed. >2018-07-13 10:15:59.669 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:15:59.675 23 WARNING octavia.controller.worker.controller_worker [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (74ce4720-ff4d-41c5-95f4-01fa3d0f1c09) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:15:59.678 23 WARNING octavia.controller.worker.controller_worker [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (ec2c9a78-04d2-4ca0-837f-cd375cfb4b56) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:15:59.680 23 WARNING octavia.controller.worker.controller_worker [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (5dbb4ada-6201-4b14-93b2-16c3c7315a31) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:15:59.683 23 WARNING octavia.controller.worker.controller_worker [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (dda0e7cc-e690-4865-9199-0d6133961796) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:15:59.689 23 WARNING octavia.controller.worker.controller_worker [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (7d223093-106d-48f8-baaa-8c77a0314bf8) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:15:59.692 23 WARNING octavia.controller.worker.controller_worker [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (c225ae97-043c-4a55-8f99-6a67172f3d0a) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 have failed. >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group c63248dd-e4de-4d1e-a475-db236013fcb2 have failed. >2018-07-13 10:15:59.692 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:15:59.708 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:15:59.978 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:15:59.989 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:16:00.047 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 from port 002c2424-3054-4214-80bf-44c3b25bb442 >2018-07-13 10:16:00.600 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:16:00.637 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:16:00.652 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:00.653 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:16:00.716 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:16:00.759 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:16:01.034 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:16:01.055 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:16:01.431 23 INFO octavia.controller.queue.endpoint [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'be4174e7-7e6f-44e6-9fcd-31d43e1d91f4'... >2018-07-13 10:16:01.657 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:16:01.687 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:16:01.710 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:01.712 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:16:01.732 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 66d1823a-d457-4229-91dc-5a76b4221c45 from port 1cfa4476-be07-48b6-a414-3e3ea8cbf356 >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b have failed.: Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >Neutron server returns request_ids: ['req-76bd8415-e9ae-4dcf-8415-4148d8a000a9'] >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group f8a6d69f-b472-456d-a908-fb26ce91c32b in use. >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-76bd8415-e9ae-4dcf-8415-4148d8a000a9'] >2018-07-13 10:16:01.760 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:01.768 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:16:01.769 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (dfdb8ca5-2947-4d8c-ae92-d509e9512e41) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e0686bd0>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_5be9dd72-243e-406a-8fcd-c3d480d6a972' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f46e0686d50>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_5be9dd72-243e-406a-8fcd-c3d480d6a972' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f46e0686d50>}, 'provides': None} > |__Atom 'delete_update_vip_listener_5be9dd72-243e-406a-8fcd-c3d480d6a972' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e0686bd0>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool075feb82-d47b-465e-90b0-9ab36e09897f' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 0, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f46e0686f50>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool075feb82-d47b-465e-90b0-9ab36e09897f' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f46e0686f50>}, 'provides': None} > |__Atom 'delete_model_object_pool075feb82-d47b-465e-90b0-9ab36e09897f' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f46e0686f50>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool075feb82-d47b-465e-90b0-9ab36e09897f' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f46e0686f50>}, 'provides': {'member': 0, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool075feb82-d47b-465e-90b0-9ab36e09897f' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f46e0686f50>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e0686bd0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e0686bd0>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b have failed. >2018-07-13 10:16:01.769 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:01.769 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:01.769 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:01.769 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:01.769 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:01.769 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:01.769 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:01.769 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:01.769 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:01.769 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:01.769 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:01.769 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b have failed. >2018-07-13 10:16:01.769 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:01.778 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (dfdb8ca5-2947-4d8c-ae92-d509e9512e41) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:01.786 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (ddf328e8-43b2-4f67-a6ef-d82fda2489fa) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:01.792 23 WARNING octavia.controller.worker.tasks.database_tasks [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:16:01.806 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_5be9dd72-243e-406a-8fcd-c3d480d6a972' (57761954-9859-4f0d-abbd-f1f0265230b5) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:01.809 23 WARNING octavia.controller.worker.tasks.database_tasks [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id 5be9dd72-243e-406a-8fcd-c3d480d6a972 >2018-07-13 10:16:01.810 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_5be9dd72-243e-406a-8fcd-c3d480d6a972' (5c1b40cb-1da8-4356-95f8-746abbaa247e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:01.813 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_5be9dd72-243e-406a-8fcd-c3d480d6a972' (42023541-41b3-4531-a635-53f78d2a239e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:01.815 23 WARNING octavia.controller.worker.tasks.database_tasks [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:16:01.824 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool075feb82-d47b-465e-90b0-9ab36e09897f' (8c99f693-49b0-4d58-b288-8f7b5362516f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:01.826 23 WARNING octavia.controller.worker.tasks.database_tasks [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 075feb82-d47b-465e-90b0-9ab36e09897f >2018-07-13 10:16:01.830 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool075feb82-d47b-465e-90b0-9ab36e09897f' (14781fdc-8ba0-4c03-9210-51866e11d921) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:01.833 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool075feb82-d47b-465e-90b0-9ab36e09897f' (1d58f38a-f6b6-445a-8874-5324b22fe18f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:01.837 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool075feb82-d47b-465e-90b0-9ab36e09897f' (93ef625a-b3d3-4cfd-b1c4-546578af7e0a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:01.839 23 WARNING octavia.controller.worker.tasks.database_tasks [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 075feb82-d47b-465e-90b0-9ab36e09897f >2018-07-13 10:16:01.842 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool075feb82-d47b-465e-90b0-9ab36e09897f' (d7bc12bd-e7de-4650-9829-beb97c53fb7e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:01.845 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (3a9ecdef-efd6-45b7-a946-c80a0bb64dc6) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:01.848 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (7e795b18-990e-49db-839d-9d9002bedbcb) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:01.854 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (a7b87fce-ae58-49c4-a398-c4bde59378a5) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:01.859 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (3285c395-a868-46cb-ae12-825871d6fb6f) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b have failed. >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group f8a6d69f-b472-456d-a908-fb26ce91c32b have failed. >2018-07-13 10:16:01.859 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:02.087 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:16:02.133 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:16:02.239 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:02.710 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:16:02.741 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:16:02.764 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:02.769 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:16:02.818 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:16:03.140 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:16:03.187 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:16:03.296 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:03.381 23 INFO octavia.controller.queue.endpoint [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'e0e8f1f8-1a2b-4faa-b133-0620d5901d9e'... >2018-07-13 10:16:03.667 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group a1777854-a7a3-4fd9-9736-93677404285d from port 5befeea6-395f-48c5-8689-9f1cc982c2df >2018-07-13 10:16:03.765 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 have failed.: Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >Neutron server returns request_ids: ['req-0c6eb7af-ee12-4ff4-9049-40aa1cd5e07d'] >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 in use. >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-0c6eb7af-ee12-4ff4-9049-40aa1cd5e07d'] >2018-07-13 10:16:03.770 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:03.775 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (3a165bbd-9df3-4f0a-86fb-953e15143bcf) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e062ce90>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_afb53d9b-aed7-4320-ad51-7ecbf69ea583' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f4700757b90>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_afb53d9b-aed7-4320-ad51-7ecbf69ea583' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f4700757b90>}, 'provides': None} > |__Atom 'delete_update_vip_listener_afb53d9b-aed7-4320-ad51-7ecbf69ea583' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e062ce90>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool5ad310bf-3dc9-4e97-b3b4-7f82344a7e81' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 0, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f46e062ce10>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool5ad310bf-3dc9-4e97-b3b4-7f82344a7e81' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f46e062ce10>}, 'provides': None} > |__Atom 'delete_model_object_pool5ad310bf-3dc9-4e97-b3b4-7f82344a7e81' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f46e062ce10>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool5ad310bf-3dc9-4e97-b3b4-7f82344a7e81' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f46e062ce10>}, 'provides': {'member': 0, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool5ad310bf-3dc9-4e97-b3b4-7f82344a7e81' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f46e062ce10>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e062ce90>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e062ce90>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 have failed. >2018-07-13 10:16:03.775 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:03.775 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:03.775 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:03.775 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:03.775 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:03.775 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:03.775 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:03.775 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:03.775 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:03.775 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:03.775 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:03.775 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 have failed. >2018-07-13 10:16:03.775 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:03.784 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (3a165bbd-9df3-4f0a-86fb-953e15143bcf) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:03.788 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (67e5143f-43b8-4ed9-b2eb-7a736db5e7e9) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:03.790 23 WARNING octavia.controller.worker.tasks.database_tasks [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:16:03.795 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:16:03.802 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_afb53d9b-aed7-4320-ad51-7ecbf69ea583' (04f19df0-c4fe-4cc3-bd00-0331f1e85e18) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:03.804 23 WARNING octavia.controller.worker.tasks.database_tasks [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id afb53d9b-aed7-4320-ad51-7ecbf69ea583 >2018-07-13 10:16:03.805 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_afb53d9b-aed7-4320-ad51-7ecbf69ea583' (77aad18b-77b2-47e6-ab0d-f9f86b82fd9e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:03.809 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_afb53d9b-aed7-4320-ad51-7ecbf69ea583' (e1d85f60-db39-4c72-af88-f0fd23023b16) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:03.811 23 WARNING octavia.controller.worker.tasks.database_tasks [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:16:03.815 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:03.825 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool5ad310bf-3dc9-4e97-b3b4-7f82344a7e81' (c6a76c70-7cce-4730-a1d3-a0dbd70c21e0) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:03.831 23 WARNING octavia.controller.worker.tasks.database_tasks [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 5ad310bf-3dc9-4e97-b3b4-7f82344a7e81 >2018-07-13 10:16:03.835 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool5ad310bf-3dc9-4e97-b3b4-7f82344a7e81' (dbd6a99d-8dcd-4b26-b885-7809b58b5d06) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:03.838 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool5ad310bf-3dc9-4e97-b3b4-7f82344a7e81' (73b841d6-66e2-41df-b9df-a3822fe61f00) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:03.841 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool5ad310bf-3dc9-4e97-b3b4-7f82344a7e81' (cdb5e6fc-40ab-41c8-981b-fa1946f29d8b) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:03.843 23 WARNING octavia.controller.worker.tasks.database_tasks [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 5ad310bf-3dc9-4e97-b3b4-7f82344a7e81 >2018-07-13 10:16:03.847 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool5ad310bf-3dc9-4e97-b3b4-7f82344a7e81' (3ba11afe-4bf9-4024-98a9-0013e6128950) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:03.849 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (159c8bc2-f05d-4060-ad71-c0cfa9869c73) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:03.852 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (6f51e0b0-5951-4c8c-b788-8a208b87d5d9) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:03.858 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (c0a6addf-092b-42b5-8960-9b1eae6090a4) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:03.862 23 WARNING octavia.controller.worker.controller_worker [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (437ed2a7-7e2b-4eb9-97fa-79b81dec8ea6) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 have failed. >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 have failed. >2018-07-13 10:16:03.862 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:03.879 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:16:04.135 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:04.190 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:16:04.240 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:16:04.346 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:04.820 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:16:04.845 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:16:04.868 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:04.940 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:16:05.189 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:05.239 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:16:05.241 23 INFO octavia.controller.queue.endpoint [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'bfc107ff-e9ca-4e49-8153-a3d7c8f86104'... >2018-07-13 10:16:05.299 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:16:05.398 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:05.538 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 from port a8136ee8-d02b-4d7c-a19d-277e7720f7f6 >2018-07-13 10:16:05.872 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:16:05.897 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:16:05.924 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a have failed.: Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >Neutron server returns request_ids: ['req-1bf33433-8c89-46a5-9f56-800c62cb946f'] >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group cbc7992b-dc9b-485d-abee-756b36d1c58a in use. >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-1bf33433-8c89-46a5-9f56-800c62cb946f'] >2018-07-13 10:16:05.941 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:05.947 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (b7479964-e943-49f4-97c2-f63b7e8b7d85) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47006b5410>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_f36e9cc1-abe5-49d4-8fd6-1f8ba80cdbe0' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f470037fe50>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_f36e9cc1-abe5-49d4-8fd6-1f8ba80cdbe0' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f470037fe50>}, 'provides': None} > |__Atom 'delete_update_vip_listener_f36e9cc1-abe5-49d4-8fd6-1f8ba80cdbe0' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47006b5410>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool6814f6a0-887e-4683-8540-ca93f7891043' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 0, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f4702fcac50>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool6814f6a0-887e-4683-8540-ca93f7891043' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4702fcac50>}, 'provides': None} > |__Atom 'delete_model_object_pool6814f6a0-887e-4683-8540-ca93f7891043' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f4702fcac50>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool6814f6a0-887e-4683-8540-ca93f7891043' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4702fcac50>}, 'provides': {'member': 0, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool6814f6a0-887e-4683-8540-ca93f7891043' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4702fcac50>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47006b5410>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47006b5410>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a have failed. >2018-07-13 10:16:05.947 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:05.947 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:05.947 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:05.947 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:05.947 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:05.947 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:05.947 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:05.947 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:05.947 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:05.947 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:05.947 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:05.947 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a have failed. >2018-07-13 10:16:05.947 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:05.957 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (b7479964-e943-49f4-97c2-f63b7e8b7d85) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:05.962 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (84301707-4a90-4f20-a32c-68150ca0757a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:05.965 23 WARNING octavia.controller.worker.tasks.database_tasks [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:16:05.977 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_f36e9cc1-abe5-49d4-8fd6-1f8ba80cdbe0' (09d2cbe9-8d2a-4f5c-b5e1-1f32948572eb) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:05.979 23 WARNING octavia.controller.worker.tasks.database_tasks [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id f36e9cc1-abe5-49d4-8fd6-1f8ba80cdbe0 >2018-07-13 10:16:05.981 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_f36e9cc1-abe5-49d4-8fd6-1f8ba80cdbe0' (77e32bdf-a711-4fc5-8148-13895c5afa15) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:05.984 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_f36e9cc1-abe5-49d4-8fd6-1f8ba80cdbe0' (6dcb8e54-f6bb-46de-af87-e5fd31f6ec87) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:05.987 23 WARNING octavia.controller.worker.tasks.database_tasks [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:16:05.997 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool6814f6a0-887e-4683-8540-ca93f7891043' (c607648a-77a3-418d-a5f1-0ae0febcdcbc) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:05.999 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:06.001 23 WARNING octavia.controller.worker.tasks.database_tasks [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 6814f6a0-887e-4683-8540-ca93f7891043 >2018-07-13 10:16:06.004 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool6814f6a0-887e-4683-8540-ca93f7891043' (ed83a309-b92e-405e-be2d-f74fbfda4ab0) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:06.007 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool6814f6a0-887e-4683-8540-ca93f7891043' (c2b85ab7-e66e-458d-9ba9-7dd1f86b4937) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:06.011 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool6814f6a0-887e-4683-8540-ca93f7891043' (f8dda4e6-bcf6-466b-b4e5-30e474509a2a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:06.013 23 WARNING octavia.controller.worker.tasks.database_tasks [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 6814f6a0-887e-4683-8540-ca93f7891043 >2018-07-13 10:16:06.016 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool6814f6a0-887e-4683-8540-ca93f7891043' (6d635a57-4549-4e7d-8f18-bfc70b736fec) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:06.019 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (685d5ac0-0bfc-4d68-af77-c3df95f689f2) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:06.022 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (68cd5dbc-e6cd-4f1a-a23c-4b7046ddd769) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:06.028 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (2ef995b2-b078-4fa5-b9df-b639ca4a7256) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:06.031 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (6e1d0cf5-240f-4708-9b58-071d0b332173) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a have failed. >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group cbc7992b-dc9b-485d-abee-756b36d1c58a have failed. >2018-07-13 10:16:06.032 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:06.242 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:06.293 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:16:06.349 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:16:06.448 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:06.936 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:16:06.961 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:16:06.977 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:07.050 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:07.143 23 INFO octavia.controller.queue.endpoint [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f1022762-3823-4f64-a8d2-7ea95f24e435'... >2018-07-13 10:16:07.293 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 have failed.: Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >Neutron server returns request_ids: ['req-0fff0866-ec31-4aa3-a77c-53e37cbb4c5e'] >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group a5c1da62-575c-4882-95d8-ecd7592aa700 in use. >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-0fff0866-ec31-4aa3-a77c-53e37cbb4c5e'] >2018-07-13 10:16:07.294 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:07.297 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (4a028d30-2be4-4cce-871c-5d880ed4b5bd) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e057e7d0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e057e7d0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e057e7d0>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 have failed. >2018-07-13 10:16:07.297 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:07.297 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:07.297 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:07.297 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:07.297 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:07.297 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:07.297 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:07.297 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:07.297 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:07.297 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:07.297 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:07.297 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 have failed. >2018-07-13 10:16:07.297 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:07.308 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (4a028d30-2be4-4cce-871c-5d880ed4b5bd) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:07.315 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (8556de5b-c34e-40a5-8ac6-4375fcd26d36) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:07.318 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (15b81967-cd8a-421f-8cd6-1af59036131f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:07.321 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (85b82496-3014-42bc-9287-02dff82a8990) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:07.331 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (7df98bf0-e3ae-428e-835f-dd6042f13fe8) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:07.337 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (93b8187c-7245-4c0f-8831-e64bb14cf0b7) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 have failed. >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group a5c1da62-575c-4882-95d8-ecd7592aa700 have failed. >2018-07-13 10:16:07.338 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:07.399 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:16:07.444 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group e6624c69-2b1d-458b-9671-7797a9f3b290 from port a312ed55-8980-4599-a054-e49823fc209f >2018-07-13 10:16:07.500 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:07.923 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:07.989 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:16:08.016 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:16:08.034 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:08.102 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:08.344 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:08.450 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:16:08.722 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:08.975 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:09.040 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:16:09.068 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:16:09.088 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:09.118 23 INFO octavia.controller.queue.endpoint [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f0d71bce-f757-43bd-942c-28f824b87789'... >2018-07-13 10:16:09.157 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:09.408 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:09.410 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group bc86132c-9e68-4346-a79e-65bc33e1423d from port 4b75aaee-93dd-486f-8061-e439cdbd7960 >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 have failed.: Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >Neutron server returns request_ids: ['req-3dae20f4-4694-4eb3-ab35-0148e2805f17'] >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 in use. >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-3dae20f4-4694-4eb3-ab35-0148e2805f17'] >2018-07-13 10:16:09.451 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:09.457 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (cbc34380-c457-4b7f-8296-db607a9c3ffa) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47083bb610>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_06fe2470-79b4-4bec-a655-c9936c814b8c' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47083bb5d0>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_06fe2470-79b4-4bec-a655-c9936c814b8c' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47083bb5d0>}, 'provides': None} > |__Atom 'delete_update_vip_listener_06fe2470-79b4-4bec-a655-c9936c814b8c' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47083bb610>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool31390257-5b76-4624-930c-729087f94d3c' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 0, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f47083bbcd0>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool31390257-5b76-4624-930c-729087f94d3c' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47083bbcd0>}, 'provides': None} > |__Atom 'delete_model_object_pool31390257-5b76-4624-930c-729087f94d3c' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f47083bbcd0>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool31390257-5b76-4624-930c-729087f94d3c' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47083bbcd0>}, 'provides': {'member': 0, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool31390257-5b76-4624-930c-729087f94d3c' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47083bbcd0>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47083bb610>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47083bb610>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 have failed. >2018-07-13 10:16:09.457 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:09.457 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:09.457 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:09.457 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:09.457 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:09.457 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:09.457 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:09.457 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:09.457 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:09.457 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:09.457 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:09.457 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 have failed. >2018-07-13 10:16:09.457 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:09.478 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (cbc34380-c457-4b7f-8296-db607a9c3ffa) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:09.482 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (ded43c82-d3ba-414b-8136-2f7d42bc2376) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:09.484 23 WARNING octavia.controller.worker.tasks.database_tasks [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:16:09.496 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_06fe2470-79b4-4bec-a655-c9936c814b8c' (86ad8cde-f1aa-4e1c-8a3e-44f8bc816c45) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:09.498 23 WARNING octavia.controller.worker.tasks.database_tasks [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id 06fe2470-79b4-4bec-a655-c9936c814b8c >2018-07-13 10:16:09.499 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_06fe2470-79b4-4bec-a655-c9936c814b8c' (bf1b4e0c-ddf7-447f-acb6-266745facf54) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:09.503 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_06fe2470-79b4-4bec-a655-c9936c814b8c' (aa92e7b2-d170-4a09-87f0-6eff4ed4b995) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:09.505 23 WARNING octavia.controller.worker.tasks.database_tasks [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:16:09.515 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool31390257-5b76-4624-930c-729087f94d3c' (a9f37660-f22b-4962-869c-b71739745049) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:09.517 23 WARNING octavia.controller.worker.tasks.database_tasks [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 31390257-5b76-4624-930c-729087f94d3c >2018-07-13 10:16:09.521 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool31390257-5b76-4624-930c-729087f94d3c' (c7b329ba-c258-408f-98d8-da94bd5b4788) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:09.524 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool31390257-5b76-4624-930c-729087f94d3c' (9c20411c-87da-4bf8-bf55-849c5d1c5b2a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:09.528 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool31390257-5b76-4624-930c-729087f94d3c' (18c16b37-535a-438a-ac46-6a03cb62dc3f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:09.530 23 WARNING octavia.controller.worker.tasks.database_tasks [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 31390257-5b76-4624-930c-729087f94d3c >2018-07-13 10:16:09.534 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool31390257-5b76-4624-930c-729087f94d3c' (ca2ae632-ce9e-458a-b18c-baffe0281cb5) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:09.537 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (1323d9d8-22c9-474a-947e-b6c4274c65de) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:09.539 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (5747b9f2-4b63-46be-a15c-75d87fdd1ed1) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:09.546 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (9800a428-5282-49e5-aba5-97f5e53866cf) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:09.550 23 WARNING octavia.controller.worker.controller_worker [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (2c2aa11b-bdee-4223-9e7b-06dee753ac40) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 have failed. >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 have failed. >2018-07-13 10:16:09.550 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:09.777 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:10.026 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:10.055 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:10.095 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:16:10.140 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:10.147 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:16:10.286 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:10.461 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:10.829 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:11.064 23 INFO octavia.controller.queue.endpoint [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '5771c255-10ba-4377-9afe-8cc71fb28142'... >2018-07-13 10:16:11.079 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:11.107 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:11.162 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:16:11.196 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:11.200 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:16:11.338 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:11.369 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 31a3c3d9-118c-4e41-bd31-66de701df8bf from port b1d1a9fc-741a-443e-bd7c-9b0d06bddfa1 >2018-07-13 10:16:11.515 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:11.818 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:11.877 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:12.131 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:12.161 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:12.213 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:16:12.246 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:12.251 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:16:12.392 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:12.574 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:12.871 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:12.947 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:13.155 23 INFO octavia.controller.queue.endpoint [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '6490007e-8c2a-4655-8bf5-ec0a63a88a58'... >2018-07-13 10:16:13.192 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 have failed.: Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >Neutron server returns request_ids: ['req-9053c2b2-8454-4ca9-81ee-ee197962157b'] >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 71110b7f-f779-4a26-b70d-43f5a8394899 in use. >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-9053c2b2-8454-4ca9-81ee-ee197962157b'] >2018-07-13 10:16:13.214 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:13.219 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:13.224 23 WARNING octavia.controller.worker.controller_worker [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (751576bb-d419-4eab-8f5c-18ad06995ee0) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e06692d0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e06692d0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e06692d0>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 have failed. >2018-07-13 10:16:13.224 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:13.224 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:13.224 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:13.224 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:13.224 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:13.224 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:13.224 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:13.224 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:13.224 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:13.224 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:13.224 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:13.224 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 have failed. >2018-07-13 10:16:13.224 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:13.244 23 WARNING octavia.controller.worker.controller_worker [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (751576bb-d419-4eab-8f5c-18ad06995ee0) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:13.253 23 WARNING octavia.controller.worker.controller_worker [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (3d50331d-f89b-434d-97b6-6c549ae09370) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:13.262 23 WARNING octavia.controller.worker.controller_worker [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (26e88d78-0869-410e-aef9-d24c362a90e3) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:13.271 23 WARNING octavia.controller.worker.controller_worker [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (dc8052f1-5614-47c6-b8b1-a743b38e4e86) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:13.290 23 WARNING octavia.controller.worker.controller_worker [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (87bb0a4e-5057-4f49-aeed-42ab25fedde8) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:13.293 23 WARNING octavia.controller.worker.controller_worker [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (0f47088d-2172-4ca3-ad13-ff583d4d3978) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 have failed. >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 71110b7f-f779-4a26-b70d-43f5a8394899 have failed. >2018-07-13 10:16:13.293 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:13.320 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:13.330 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:16:13.449 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:13.523 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group bad80a9a-daac-428f-8037-6d2419bfd46c from port 76832527-4f07-4b7d-a86c-8159546236ad >2018-07-13 10:16:13.629 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:13.926 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:13.998 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:14.146 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:14.244 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:14.277 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:14.380 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:16:14.384 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:14.503 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:14.679 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:14.983 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:15.072 23 INFO octavia.controller.queue.endpoint [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '008748a6-ba6c-4851-ae15-aed308614837'... >2018-07-13 10:16:15.089 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:15.201 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:15.298 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:15.347 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc have failed.: Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >Neutron server returns request_ids: ['req-f736746d-ba70-4299-9069-d10e3ba8669c'] >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 9afef0da-aa19-4ef4-89ba-415cc5dadafc in use. >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-f736746d-ba70-4299-9069-d10e3ba8669c'] >2018-07-13 10:16:15.381 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:15.385 23 WARNING octavia.controller.worker.controller_worker [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (90440cb0-dca3-4c31-81b3-4f803131d517) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e05aca90>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e05aca90>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e05aca90>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc have failed. >2018-07-13 10:16:15.385 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:15.385 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:15.385 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:15.385 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:15.385 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:15.385 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:15.385 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:15.385 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:15.385 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:15.385 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:15.385 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:15.385 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc have failed. >2018-07-13 10:16:15.385 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:15.408 23 WARNING octavia.controller.worker.controller_worker [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (90440cb0-dca3-4c31-81b3-4f803131d517) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:15.416 23 WARNING octavia.controller.worker.controller_worker [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (b236ef34-c90f-4124-972f-0d038d67fe0d) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:15.425 23 WARNING octavia.controller.worker.controller_worker [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (e055b41b-3f81-40e7-9522-6d0bcddd12ef) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:15.427 23 WARNING octavia.controller.worker.controller_worker [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (94a541e3-7071-45ed-8a59-f7bb06dae36f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:15.436 23 WARNING octavia.controller.worker.controller_worker [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (92a79261-5533-4f57-8c2e-2409793800c2) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:15.442 23 WARNING octavia.controller.worker.controller_worker [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (4fca4ccd-21a0-4e22-afa7-915fc23f9316) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc have failed. >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc have failed. >2018-07-13 10:16:15.442 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:15.450 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:15.554 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:15.600 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 8507debd-a565-40b0-85c8-5f0509f0d522 from port c8863e25-4719-4183-838d-535c81f40ae1 >2018-07-13 10:16:15.730 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:16.034 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:16.142 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:16.166 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:16.255 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:16.349 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:16.397 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:16.501 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:16.607 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:16.783 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:17.000 23 INFO octavia.controller.queue.endpoint [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '51d2eede-a5ab-4b81-a637-f6f078173db5'... >2018-07-13 10:16:17.101 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:17.193 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:17.222 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:17.304 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 from port 54cc38b9-4760-422f-97b0-b580fa562e6b >2018-07-13 10:16:17.313 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:17.408 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:17.453 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 have failed.: Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >Neutron server returns request_ids: ['req-95eaf276-7c77-425e-b07e-9899ac1b8a5c'] >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 in use. >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-95eaf276-7c77-425e-b07e-9899ac1b8a5c'] >2018-07-13 10:16:17.502 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:17.508 23 WARNING octavia.controller.worker.controller_worker [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (0ee6deb3-5f7f-4c72-af59-36172649915b) transitioned into state 'FAILURE' from state 'RUNNING' >17 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001bab50>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_f1ef647a-f00a-46ed-905a-afea5c83b37c' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f46e077ad50>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_f1ef647a-f00a-46ed-905a-afea5c83b37c' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f46e077ad50>}, 'provides': None} > |__Atom 'delete_update_vip_listener_f1ef647a-f00a-46ed-905a-afea5c83b37c' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001bab50>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_poolb8bcef25-5a70-4b64-be06-4e08e8442197' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 0, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f47001b6b50>}, 'provides': None} > |__Atom 'delete_pool_in_db_poolb8bcef25-5a70-4b64-be06-4e08e8442197' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47001b6b50>}, 'provides': None} > |__Atom 'delete_model_object_poolb8bcef25-5a70-4b64-be06-4e08e8442197' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f47001b6b50>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_poolb8bcef25-5a70-4b64-be06-4e08e8442197' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47001b6b50>}, 'provides': {'member': 0, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_poolb8bcef25-5a70-4b64-be06-4e08e8442197' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f47001b6b50>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001bab50>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001bab50>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 have failed. >2018-07-13 10:16:17.508 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:17.508 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:17.508 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:17.508 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:17.508 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:17.508 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:17.508 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:17.508 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:17.508 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:17.508 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:17.508 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:17.508 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 have failed. >2018-07-13 10:16:17.508 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:17.518 23 WARNING octavia.controller.worker.controller_worker [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (0ee6deb3-5f7f-4c72-af59-36172649915b) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:17.521 23 WARNING octavia.controller.worker.controller_worker [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (c92b578f-8f40-41e5-83a5-84fd06aeb7d5) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:17.524 23 WARNING octavia.controller.worker.tasks.database_tasks [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:16:17.535 23 WARNING octavia.controller.worker.controller_worker [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_f1ef647a-f00a-46ed-905a-afea5c83b37c' (70b88312-4d37-4901-b27d-1498ee1fb240) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:17.537 23 WARNING octavia.controller.worker.tasks.database_tasks [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id f1ef647a-f00a-46ed-905a-afea5c83b37c >2018-07-13 10:16:17.539 23 WARNING octavia.controller.worker.controller_worker [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_f1ef647a-f00a-46ed-905a-afea5c83b37c' (6956c669-5df6-4d5c-bce5-4d7c8012ded6) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:17.542 23 WARNING octavia.controller.worker.controller_worker [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_f1ef647a-f00a-46ed-905a-afea5c83b37c' (16fcef22-296e-44ba-8e67-4870619c07ed) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:17.544 23 WARNING octavia.controller.worker.tasks.database_tasks [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:16:17.556 23 WARNING octavia.controller.worker.controller_worker [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_poolb8bcef25-5a70-4b64-be06-4e08e8442197' (3f633c42-9712-481b-bffc-0d77bc402eea) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:17.558 23 WARNING octavia.controller.worker.tasks.database_tasks [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id b8bcef25-5a70-4b64-be06-4e08e8442197 >2018-07-13 10:16:17.562 23 WARNING octavia.controller.worker.controller_worker [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_poolb8bcef25-5a70-4b64-be06-4e08e8442197' (8865503c-36b2-430f-8135-12aaae7d46b5) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:17.565 23 WARNING octavia.controller.worker.controller_worker [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_poolb8bcef25-5a70-4b64-be06-4e08e8442197' (5687abff-b182-408e-839a-0b19c3267481) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:17.569 23 WARNING octavia.controller.worker.controller_worker [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_poolb8bcef25-5a70-4b64-be06-4e08e8442197' (c0ba97e5-7c7c-43f5-832b-e641abb6a9c7) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:17.571 23 WARNING octavia.controller.worker.tasks.database_tasks [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id b8bcef25-5a70-4b64-be06-4e08e8442197 >2018-07-13 10:16:17.575 23 WARNING octavia.controller.worker.controller_worker [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_poolb8bcef25-5a70-4b64-be06-4e08e8442197' (0e537aad-5c8f-4e40-81d0-0588ea1d180f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:17.579 23 WARNING octavia.controller.worker.controller_worker [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (ded5c8b0-672c-470c-b909-5ea7a1cb7b1c) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:17.582 23 WARNING octavia.controller.worker.controller_worker [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (4f809859-1bba-4db7-836a-dfbbde07d8c2) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:17.588 23 WARNING octavia.controller.worker.controller_worker [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (59f2b82d-d184-42a8-a59d-664221086770) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:17.592 23 WARNING octavia.controller.worker.controller_worker [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (04a26e96-9f61-421a-9dfa-280d02b78cad) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 have failed. >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 have failed. >2018-07-13 10:16:17.593 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:17.661 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:17.837 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:17.952 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:18.156 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:18.243 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:18.277 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:18.365 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:18.462 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:18.506 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:18.719 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:18.890 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:18.939 23 INFO octavia.controller.queue.endpoint [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '902e1fa6-1049-469b-a40a-24d84c255f27'... >2018-07-13 10:16:19.139 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:19.214 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 have failed.: Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >Neutron server returns request_ids: ['req-1b52e758-402d-4e2b-b456-2eba7a2bd19f'] >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 66d1823a-d457-4229-91dc-5a76b4221c45 in use. >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-1b52e758-402d-4e2b-b456-2eba7a2bd19f'] >2018-07-13 10:16:19.244 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:19.250 23 WARNING octavia.controller.worker.controller_worker [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (75c750f7-f2a7-4fb9-b196-b5d08f214208) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e05ba790>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e05ba790>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e05ba790>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 have failed. >2018-07-13 10:16:19.250 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:19.250 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:19.250 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:19.250 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:19.250 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:19.250 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:19.250 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:19.250 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:19.250 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:19.250 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:19.250 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:19.250 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 have failed. >2018-07-13 10:16:19.250 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:19.265 23 WARNING octavia.controller.worker.controller_worker [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (75c750f7-f2a7-4fb9-b196-b5d08f214208) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:19.269 23 WARNING octavia.controller.worker.controller_worker [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (1422433f-2400-435e-ab64-f46d71a3f233) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:19.277 23 WARNING octavia.controller.worker.controller_worker [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (6628bdd5-6d1d-4dc7-b65b-bd780d3103a7) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:19.293 23 WARNING octavia.controller.worker.controller_worker [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (5612fc15-e2f4-4f4f-89e8-1c6515ffac82) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:19.313 23 WARNING octavia.controller.worker.controller_worker [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (88de59c4-9f2b-49c2-a157-a8de07af8c3c) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:19.316 23 WARNING octavia.controller.worker.controller_worker [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (bef7bd7c-61be-4873-af01-e6722f1c3806) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 have failed. >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 66d1823a-d457-4229-91dc-5a76b4221c45 have failed. >2018-07-13 10:16:19.316 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:19.353 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:19.416 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:19.418 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group e2b2f47f-237e-4052-b304-646f8141eb07 from port ab096239-6e84-4e2b-8d2d-44141a7a12c5 >2018-07-13 10:16:19.514 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:19.560 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:19.772 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:19.898 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:19.945 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group a1777854-a7a3-4fd9-9736-93677404285d failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:20.194 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:20.267 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:20.405 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:20.469 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:20.567 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:20.614 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:20.829 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:20.928 23 INFO octavia.controller.queue.endpoint [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'ca7a26a8-9a71-43fd-96dc-fe0714d9256d'... >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group a1777854-a7a3-4fd9-9736-93677404285d have failed.: Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >Neutron server returns request_ids: ['req-20538044-cdf4-4761-a5c7-08113cbd6d92'] >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group a1777854-a7a3-4fd9-9736-93677404285d in use. >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-20538044-cdf4-4761-a5c7-08113cbd6d92'] >2018-07-13 10:16:20.946 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:20.976 23 WARNING octavia.controller.worker.controller_worker [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (892cacc6-1245-4cfa-b7e5-f7a7284acb06) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47080c5090>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47080c5090>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47080c5090>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group a1777854-a7a3-4fd9-9736-93677404285d have failed. >2018-07-13 10:16:20.976 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:20.976 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:20.976 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:20.976 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:20.976 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:20.976 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:20.976 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:20.976 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:20.976 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:20.976 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:20.976 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:20.976 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group a1777854-a7a3-4fd9-9736-93677404285d have failed. >2018-07-13 10:16:20.976 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:21.001 23 WARNING octavia.controller.worker.controller_worker [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (892cacc6-1245-4cfa-b7e5-f7a7284acb06) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:21.014 23 WARNING octavia.controller.worker.controller_worker [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (fb84ec19-de62-42ca-b313-22d6d26a419a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:21.026 23 WARNING octavia.controller.worker.controller_worker [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (edecdbbe-1b54-427f-81e1-b9070297d139) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:21.034 23 WARNING octavia.controller.worker.controller_worker [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (b93ee545-7f94-4247-8ffc-8886ae28b3ae) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:21.051 23 WARNING octavia.controller.worker.controller_worker [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (1e268b7c-1a29-49e3-916a-d29c5a68abc5) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:21.060 23 WARNING octavia.controller.worker.controller_worker [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (ebec5445-7742-4d00-b1af-ae8a2398d2fe) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group a1777854-a7a3-4fd9-9736-93677404285d have failed. >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group a1777854-a7a3-4fd9-9736-93677404285d have failed. >2018-07-13 10:16:21.060 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:21.096 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:21.245 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:21.291 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 0f96d132-c29a-49fe-a984-b55dba03acc2 from port 8f959c54-3e2d-4daf-9911-c531cce7b1fc >2018-07-13 10:16:21.320 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:21.463 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:21.520 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:21.620 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:21.667 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:21.770 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:21.883 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:22.154 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:22.297 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:22.383 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:22.523 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:22.578 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:22.673 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:22.720 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:22.825 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 have failed.: Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >Neutron server returns request_ids: ['req-c2f5e0e3-cb7e-4a9b-bf11-42d19d564379'] >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 in use. >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-c2f5e0e3-cb7e-4a9b-bf11-42d19d564379'] >2018-07-13 10:16:22.884 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:22.888 23 WARNING octavia.controller.worker.controller_worker [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (3d06cb0d-9665-46c1-93bc-43044fe1a63f) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700502590>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700502590>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700502590>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 have failed. >2018-07-13 10:16:22.888 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:22.888 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:22.888 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:22.888 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:22.888 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:22.888 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:22.888 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:22.888 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:22.888 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:22.888 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:22.888 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:22.888 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 have failed. >2018-07-13 10:16:22.888 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:22.895 23 WARNING octavia.controller.worker.controller_worker [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (3d06cb0d-9665-46c1-93bc-43044fe1a63f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:22.898 23 WARNING octavia.controller.worker.controller_worker [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (271b24d1-1860-4ae5-ada7-64f0d0cb0ba7) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:22.901 23 WARNING octavia.controller.worker.controller_worker [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (98839451-8d40-409b-9b22-12d5b87e4cad) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:22.903 23 WARNING octavia.controller.worker.controller_worker [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (4c907fea-8085-46b9-b315-1da1d7cece43) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:22.913 23 WARNING octavia.controller.worker.controller_worker [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (134bc733-b7d4-4fbc-9348-d93a000ac668) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:22.915 23 WARNING octavia.controller.worker.controller_worker [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (d496b14a-63d3-4ec5-bdce-c51efc40fe35) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 have failed. >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 have failed. >2018-07-13 10:16:22.916 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:23.208 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:23.350 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:23.435 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:23.577 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:23.629 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:23.732 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:23.773 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:23.878 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:24.266 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:24.403 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:24.484 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:24.635 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:24.682 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 have failed.: Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >Neutron server returns request_ids: ['req-c40cf73c-508a-4f86-bb0c-8b80caacf30d'] >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group e6624c69-2b1d-458b-9671-7797a9f3b290 in use. >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-c40cf73c-508a-4f86-bb0c-8b80caacf30d'] >2018-07-13 10:16:24.733 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:24.736 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (b8e7ba73-0ce5-45e0-99dd-eae82af1ad7c) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47080e3c50>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47080e3c50>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47080e3c50>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 have failed. >2018-07-13 10:16:24.736 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:24.736 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:24.736 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:24.736 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:24.736 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:24.736 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:24.736 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:24.736 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:24.736 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:24.736 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:24.736 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:24.736 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 have failed. >2018-07-13 10:16:24.736 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:24.743 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (b8e7ba73-0ce5-45e0-99dd-eae82af1ad7c) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:24.748 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (784a52c5-4dda-47f3-b5ca-7473a5a95e76) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:24.751 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (8dd7f2d5-8aba-41fb-8200-22c631f69355) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:24.755 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (c345650a-a8e8-4689-a1f9-b1c8aaf3cf83) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:24.763 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (92bdeb85-f8ac-45b5-a372-082895b442b6) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:24.767 23 WARNING octavia.controller.worker.controller_worker [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (19adc8fe-a4d8-490b-b0a5-6ecbb6b82994) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 have failed. >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group e6624c69-2b1d-458b-9671-7797a9f3b290 have failed. >2018-07-13 10:16:24.768 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:24.827 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:24.932 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:25.325 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:25.454 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:25.536 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:25.688 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:25.742 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:25.878 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:25.985 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:26.381 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:26.504 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:26.590 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:26.740 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:26.796 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d have failed.: Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >Neutron server returns request_ids: ['req-849caf7a-f571-4762-91d7-cbcb0fc0b63f'] >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group bc86132c-9e68-4346-a79e-65bc33e1423d in use. >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-849caf7a-f571-4762-91d7-cbcb0fc0b63f'] >2018-07-13 10:16:26.879 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:26.883 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (f0171336-680a-4a03-8b37-ad08be22ff88) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700601990>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700601990>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700601990>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d have failed. >2018-07-13 10:16:26.883 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:26.883 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:26.883 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:26.883 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:26.883 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:26.883 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:26.883 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:26.883 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:26.883 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:26.883 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:26.883 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:26.883 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d have failed. >2018-07-13 10:16:26.883 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:26.889 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (f0171336-680a-4a03-8b37-ad08be22ff88) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:26.892 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (bb96d36d-8f97-4c77-8cbc-41b5082a3f51) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:26.894 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (bf551adc-696c-4e18-94a2-0bcce51fc472) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:26.897 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (70824f3b-cebe-4947-9a3d-041bb9c8774d) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:26.907 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (c988c64c-54ad-4a12-a3bf-273cdd404889) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:26.911 23 WARNING octavia.controller.worker.controller_worker [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (9be70c98-3e14-47ff-a523-fd46174122a1) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d have failed. >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group bc86132c-9e68-4346-a79e-65bc33e1423d have failed. >2018-07-13 10:16:26.911 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:27.039 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:27.444 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:27.557 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:27.648 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:27.795 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:27.850 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:28.095 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:28.498 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:28.612 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf have failed.: Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >Neutron server returns request_ids: ['req-16c6026b-4609-40c9-9bb0-8e6ced534ffe'] >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 31a3c3d9-118c-4e41-bd31-66de701df8bf in use. >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-16c6026b-4609-40c9-9bb0-8e6ced534ffe'] >2018-07-13 10:16:28.649 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:28.652 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (a37ca6ff-89b3-4532-9e90-c9f5c42e6f13) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47080c5fd0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47080c5fd0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47080c5fd0>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf have failed. >2018-07-13 10:16:28.652 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:28.652 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:28.652 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:28.652 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:28.652 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:28.652 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:28.652 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:28.652 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:28.652 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:28.652 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:28.652 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:28.652 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf have failed. >2018-07-13 10:16:28.652 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:28.658 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (a37ca6ff-89b3-4532-9e90-c9f5c42e6f13) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:28.661 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (6957973d-5e24-4db8-87e5-3c3f393b078e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:28.664 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (3eda6d9c-fd1d-4454-a06f-f8e4d1c38ff5) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:28.667 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (4c162023-3c8f-41b5-a891-6e41bb3a8f30) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:28.674 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (cd4adcd9-6a1c-4a40-ac75-65989d8e66d6) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:28.676 23 WARNING octavia.controller.worker.controller_worker [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (6ed3a9b1-bb97-4b72-8c8f-9b8614d7f068) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf have failed. >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 31a3c3d9-118c-4e41-bd31-66de701df8bf have failed. >2018-07-13 10:16:28.677 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:28.896 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:29.067 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:29.150 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:29.551 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:29.668 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:29.948 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:30.121 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:30.202 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:30.607 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:30.721 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:31.000 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c have failed.: Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >Neutron server returns request_ids: ['req-f5589417-24d8-4ef9-82fa-c677a820b063'] >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group bad80a9a-daac-428f-8037-6d2419bfd46c in use. >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-f5589417-24d8-4ef9-82fa-c677a820b063'] >2018-07-13 10:16:31.122 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:31.126 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (222cbfda-5a1a-40e0-b58c-2bb60e8eb3c1) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470074df90>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470074df90>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f470074df90>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c have failed. >2018-07-13 10:16:31.126 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:31.126 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:31.126 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:31.126 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:31.126 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:31.126 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:31.126 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:31.126 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:31.126 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:31.126 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:31.126 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:31.126 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c have failed. >2018-07-13 10:16:31.126 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:31.135 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (222cbfda-5a1a-40e0-b58c-2bb60e8eb3c1) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:31.137 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (5084ee3d-01ca-4823-bca4-4c7714411ef4) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:31.140 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (8b67f30e-31a8-4d05-b1b4-a5337d853302) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:31.142 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (8d5c880a-490a-469f-ac08-6fa99e5e7e3f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:31.149 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (02106352-8ef3-4aa9-a384-a87ef32ad017) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:31.151 23 WARNING octavia.controller.worker.controller_worker [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (b236be33-8d03-4cc8-b495-578a9b1bac94) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c have failed. >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group bad80a9a-daac-428f-8037-6d2419bfd46c have failed. >2018-07-13 10:16:31.152 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:31.254 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:31.665 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:31.775 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:32.053 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:32.307 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:32.717 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:32.821 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 have failed.: Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >Neutron server returns request_ids: ['req-8ad44bed-02e1-4646-815a-cb996190470e'] >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 8507debd-a565-40b0-85c8-5f0509f0d522 in use. >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-8ad44bed-02e1-4646-815a-cb996190470e'] >2018-07-13 10:16:33.054 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:33.057 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (c031dabc-1ab7-468d-af2c-af8f2306b8b0) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47003eb250>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47003eb250>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47003eb250>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 have failed. >2018-07-13 10:16:33.057 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:33.057 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:33.057 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:33.057 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:33.057 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:33.057 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:33.057 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:33.057 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:33.057 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:33.057 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:33.057 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:33.057 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 have failed. >2018-07-13 10:16:33.057 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:33.063 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (c031dabc-1ab7-468d-af2c-af8f2306b8b0) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:33.066 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (2e2d0d15-35e8-42b7-a7ae-a7d3a63128de) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:33.069 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (edef5a27-20d5-42eb-b5c2-36ecd7e9c794) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:33.071 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (e8634ed7-e5ce-49ba-a8d1-03adbbf133b6) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:33.078 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (11b103ea-5277-40eb-a846-9ac114db40d9) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:33.081 23 WARNING octavia.controller.worker.controller_worker [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (6357146c-5fda-4c45-b14b-837a548d8501) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 have failed. >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 8507debd-a565-40b0-85c8-5f0509f0d522 have failed. >2018-07-13 10:16:33.082 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:33.357 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:33.770 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:33.870 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:34.449 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:34.826 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 have failed.: Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >Neutron server returns request_ids: ['req-0392eed8-f66b-4701-a000-19ddb215ff11'] >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 in use. >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-0392eed8-f66b-4701-a000-19ddb215ff11'] >2018-07-13 10:16:34.871 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:34.875 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (549abc91-bb80-4fb7-9359-580a526c8d34) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e05acb50>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e05acb50>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f46e05acb50>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 have failed. >2018-07-13 10:16:34.875 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:34.875 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:34.875 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:34.875 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:34.875 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:34.875 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:34.875 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:34.875 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:34.875 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:34.875 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:34.875 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:34.875 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 have failed. >2018-07-13 10:16:34.875 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:34.881 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (549abc91-bb80-4fb7-9359-580a526c8d34) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:34.884 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (ce283a1c-b9f5-4996-adb6-a5e9aba9ba20) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:34.887 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (f48bdd02-24ae-4268-975d-f6d061abb1cc) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:34.889 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (8ecd50e9-cfa9-4d5b-9ce1-a7ca9cfcbdc3) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:34.896 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (32ae9cb8-366d-4abd-8f83-b0b39707f02c) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:34.900 23 WARNING octavia.controller.worker.controller_worker [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (743187b8-c75d-4c12-bef5-f929790294a2) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 have failed. >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 have failed. >2018-07-13 10:16:34.900 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:35.501 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:35.877 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:36.556 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 have failed.: Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >Neutron server returns request_ids: ['req-96351b9e-a9e3-4ca2-ab6e-32f1d2a932d6'] >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group e2b2f47f-237e-4052-b304-646f8141eb07 in use. >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-96351b9e-a9e3-4ca2-ab6e-32f1d2a932d6'] >2018-07-13 10:16:36.878 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:36.881 23 WARNING octavia.controller.worker.controller_worker [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (d20ce62a-3080-4976-84ed-b1153fa4d6b3) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700576a10>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700576a10>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4700576a10>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 have failed. >2018-07-13 10:16:36.881 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:36.881 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:36.881 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:36.881 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:36.881 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:36.881 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:36.881 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:36.881 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:36.881 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:36.881 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:36.881 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:36.881 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 have failed. >2018-07-13 10:16:36.881 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:36.888 23 WARNING octavia.controller.worker.controller_worker [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (d20ce62a-3080-4976-84ed-b1153fa4d6b3) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:36.890 23 WARNING octavia.controller.worker.controller_worker [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (699ad29d-d133-4eaa-b887-6e5f9289962b) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:36.893 23 WARNING octavia.controller.worker.controller_worker [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (217b11d1-58bc-47d4-8932-7f4cf9f50f03) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:36.896 23 WARNING octavia.controller.worker.controller_worker [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (83ca63b3-d24f-4899-9b52-f646c9c0d0dc) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:36.903 23 WARNING octavia.controller.worker.controller_worker [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (d4aa159b-f70d-47b4-8a00-b3e08f3fc1a1) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:36.906 23 WARNING octavia.controller.worker.controller_worker [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (c6d34b3b-5df1-41a8-98b0-14b82ba3bd85) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 have failed. >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group e2b2f47f-237e-4052-b304-646f8141eb07 have failed. >2018-07-13 10:16:36.907 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:16:37.608 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >Neutron server returns request_ids: ['req-9c38844b-b9a6-44ea-8868-9ebbd7093712'] >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-9c38844b-b9a6-44ea-8868-9ebbd7093712'] >2018-07-13 10:16:38.609 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:16:38.613 23 WARNING octavia.controller.worker.controller_worker [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (43323bfa-0ca8-4733-ae63-16beb4d135f2) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001df750>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001df750>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47001df750>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:16:38.613 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:16:38.613 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:38.613 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:16:38.613 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:38.613 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:38.613 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:38.613 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:16:38.613 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:38.613 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:38.613 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:38.613 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:16:38.613 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:16:38.613 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:16:38.620 23 WARNING octavia.controller.worker.controller_worker [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (43323bfa-0ca8-4733-ae63-16beb4d135f2) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:38.622 23 WARNING octavia.controller.worker.controller_worker [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (cdd9f601-0a1a-49bd-b511-bfc22952d7ca) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:38.625 23 WARNING octavia.controller.worker.controller_worker [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (1a100218-176f-4ab1-ac7e-85b6ce0e2b1d) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:38.628 23 WARNING octavia.controller.worker.controller_worker [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (318183ec-6fe5-442a-b1c5-8ce0d891e8e4) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:38.635 23 WARNING octavia.controller.worker.controller_worker [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (a17ef865-28e6-4ddb-a3c5-65ca44c96101) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:16:38.637 23 WARNING octavia.controller.worker.controller_worker [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (0229b85d-30f3-498d-b871-ada67eaad35b) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:16:38.638 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:17:09.785 23 INFO octavia.controller.queue.endpoint [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'ca7a26a8-9a71-43fd-96dc-fe0714d9256d'... >2018-07-13 10:17:10.069 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 0f96d132-c29a-49fe-a984-b55dba03acc2 from port 8f959c54-3e2d-4daf-9911-c531cce7b1fc >2018-07-13 10:17:10.548 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:11.602 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:12.657 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:13.716 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:14.769 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:15.819 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:16.868 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:17.920 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:18.977 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:20.034 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:21.086 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:22.139 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:23.233 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:24.289 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:25.346 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:26.414 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >Neutron server returns request_ids: ['req-7d803d72-3083-46d7-b3b5-4fc8a82f2a04'] >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-7d803d72-3083-46d7-b3b5-4fc8a82f2a04'] >2018-07-13 10:17:27.415 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:17:27.419 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (67350fd3-fb90-4637-92ea-539a2a5c026e) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4702f97ad0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4702f97ad0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4702f97ad0>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:17:27.419 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:17:27.419 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:17:27.419 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:17:27.419 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:17:27.419 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:17:27.419 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:17:27.419 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:17:27.419 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:17:27.419 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:17:27.419 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:17:27.419 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:17:27.419 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:17:27.419 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:17:27.425 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (67350fd3-fb90-4637-92ea-539a2a5c026e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:17:27.428 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (5384daa7-a835-4d1d-8a32-6883b042295a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:17:27.431 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (373ca286-3d4e-4777-a45c-0c80bf30c796) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:17:27.433 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (91799436-b260-4866-9c93-75aea96b774b) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:17:27.441 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (c51e7c46-ebe8-4479-8224-826e993e3e1e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:17:27.443 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (29274092-789d-47fd-ab11-78c84c007f3c) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:17:27.444 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:24:51.101 23 INFO octavia.controller.queue.endpoint [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'ca7a26a8-9a71-43fd-96dc-fe0714d9256d'... >2018-07-13 10:24:51.909 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 0f96d132-c29a-49fe-a984-b55dba03acc2 from port 8f959c54-3e2d-4daf-9911-c531cce7b1fc >2018-07-13 10:24:52.405 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:24:53.460 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:24:54.513 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:24:55.567 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:24:56.623 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:24:57.675 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:24:58.728 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:24:59.779 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:25:00.845 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:25:01.898 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:25:02.948 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:25:04.002 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:25:05.054 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:25:06.106 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:25:07.167 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:25:08.223 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >Neutron server returns request_ids: ['req-a77c9021-06a6-4a5f-bef2-a31c277bbdb1'] >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-a77c9021-06a6-4a5f-bef2-a31c277bbdb1'] >2018-07-13 10:25:09.224 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:25:09.228 23 WARNING octavia.controller.worker.controller_worker [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (fc5d8135-9229-432f-9a39-a4999ebecd60) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47080c5a50>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47080c5a50>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47080c5a50>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:25:09.228 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:25:09.228 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:25:09.228 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:25:09.228 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:25:09.228 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:25:09.228 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:25:09.228 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:25:09.228 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:25:09.228 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:25:09.228 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:25:09.228 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:25:09.228 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:25:09.228 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:25:09.234 23 WARNING octavia.controller.worker.controller_worker [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (fc5d8135-9229-432f-9a39-a4999ebecd60) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:25:09.237 23 WARNING octavia.controller.worker.controller_worker [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (f6892bbb-84ab-4dd6-9fbd-5425a90edae2) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:25:09.239 23 WARNING octavia.controller.worker.controller_worker [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (2775357a-1441-4767-a929-4c761ea5138e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:25:09.241 23 WARNING octavia.controller.worker.controller_worker [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (8f7d183f-0fa0-4a79-aadb-0d7587ff70f5) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:25:09.249 23 WARNING octavia.controller.worker.controller_worker [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (f283402d-158b-4106-939f-cf62293b372a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:25:09.252 23 WARNING octavia.controller.worker.controller_worker [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (a19e50e9-09c6-4200-9b83-d0977e6e8650) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:25:09.252 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:26:40.079 23 INFO octavia.controller.queue.endpoint [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'ca7a26a8-9a71-43fd-96dc-fe0714d9256d'... >2018-07-13 10:26:40.569 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 0f96d132-c29a-49fe-a984-b55dba03acc2 from port 8f959c54-3e2d-4daf-9911-c531cce7b1fc >2018-07-13 10:26:41.224 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:42.284 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:43.341 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:44.392 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:45.443 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:46.497 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:47.551 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:48.606 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:49.661 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:50.718 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:51.773 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:52.830 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:53.886 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:54.941 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:55.992 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:57.048 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >Neutron server returns request_ids: ['req-64549eac-28b5-4e27-8bb0-fe31f3c3907b'] >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-64549eac-28b5-4e27-8bb0-fe31f3c3907b'] >2018-07-13 10:26:58.049 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:26:58.053 23 WARNING octavia.controller.worker.controller_worker [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (80b22ac0-88b6-4ca6-8c8c-eaa9ec00a4b3) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005551d0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005551d0>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47005551d0>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:26:58.053 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:26:58.053 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:26:58.053 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:26:58.053 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:26:58.053 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:26:58.053 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:26:58.053 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:26:58.053 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:26:58.053 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:26:58.053 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:26:58.053 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:26:58.053 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:26:58.053 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:26:58.060 23 WARNING octavia.controller.worker.controller_worker [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (80b22ac0-88b6-4ca6-8c8c-eaa9ec00a4b3) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:26:58.063 23 WARNING octavia.controller.worker.controller_worker [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (ab79e215-f9a6-42fa-a24d-16a6d92138c1) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:26:58.066 23 WARNING octavia.controller.worker.controller_worker [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (3673ddc6-e74c-427f-b8d4-96cd670ba87a) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:26:58.068 23 WARNING octavia.controller.worker.controller_worker [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (c1130c79-2783-4160-b100-6154468acd53) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:26:58.077 23 WARNING octavia.controller.worker.controller_worker [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (25491b5d-e148-4abf-8235-989edb425620) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:26:58.080 23 WARNING octavia.controller.worker.controller_worker [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (0f4f3798-4251-4b8e-96f8-9276df809d82) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:26:58.081 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:28:25.504 23 INFO octavia.controller.queue.endpoint [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '086161c5-d21c-470b-aeec-4cc56bcaf2fd'... >2018-07-13 10:28:26.537 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group c650b102-b4c9-46e8-9778-2fff80138c15 from port 0846f477-8a02-4e8a-9e8c-d734e922cd53 >2018-07-13 10:28:27.331 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:28.458 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:29.520 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:30.584 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:31.639 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:32.696 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:33.750 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:34.805 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:35.860 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:36.916 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:37.975 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:39.031 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:40.109 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:41.165 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:42.220 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:43.274 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 have failed.: Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >Neutron server returns request_ids: ['req-981d66be-eeb6-4521-b1ec-de36a262366d'] >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group c650b102-b4c9-46e8-9778-2fff80138c15 in use. >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-981d66be-eeb6-4521-b1ec-de36a262366d'] >2018-07-13 10:28:44.275 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:28:44.283 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (91a9f704-c6f8-44e4-b154-0bd460f0b4ad) transitioned into state 'FAILURE' from state 'RUNNING' >33 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4702fda750>}, 'provides': None} > |__Atom 'decrement_listener_quota_listener_6693a673-225f-4a60-8e7e-cf6e149d89ad' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47006398d0>}, 'provides': None} > | |__Atom 'delete_listener_in_db_listener_6693a673-225f-4a60-8e7e-cf6e149d89ad' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f47006398d0>}, 'provides': None} > | |__Atom 'delete_update_vip_listener_6693a673-225f-4a60-8e7e-cf6e149d89ad' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4702fda750>}, 'provides': None} > | |__Flow 'octavia-delete-listener_flow' > | |__Flow 'listener_delete_flow' > | |__Atom 'decrement_pool_quota_pool99e683c7-9811-4783-834f-82077b92b1be' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 3, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f4700639d10>}, 'provides': None} > | |__Atom 'delete_pool_in_db_pool99e683c7-9811-4783-834f-82077b92b1be' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700639d10>}, 'provides': None} > | |__Atom 'delete_model_object_pool99e683c7-9811-4783-834f-82077b92b1be' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f4700639d10>}, 'provides': None} > | |__Atom 'count_pool_children_for_quota_pool99e683c7-9811-4783-834f-82077b92b1be' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700639d10>}, 'provides': {'member': 3, 'HM': 0}} > | |__Atom 'mark_pool_pending_delete_in_db_pool99e683c7-9811-4783-834f-82077b92b1be' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700639d10>}, 'provides': None} > | |__Flow 'octavia-delete-pool-flow' > | |__Flow 'pool_delete_flow' > | |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4702fda750>}, 'provides': None} > | |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > | |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4702fda750>}, 'provides': None} > | |__Flow 'octavia-delete-loadbalancer-flow' > |__Atom 'decrement_listener_quota_listener_907133d2-2ecb-41f4-a144-5b23fc30c975' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f4702fda810>}, 'provides': None} > |__Atom 'delete_listener_in_db_listener_907133d2-2ecb-41f4-a144-5b23fc30c975' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'listener': <octavia.common.data_models.Listener object at 0x7f4702fda810>}, 'provides': None} > |__Atom 'delete_update_vip_listener_907133d2-2ecb-41f4-a144-5b23fc30c975' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4702fda750>}, 'provides': None} > |__Flow 'octavia-delete-listener_flow' > |__Flow 'listener_delete_flow' > |__Atom 'decrement_pool_quota_pool99e683c7-9811-4783-834f-82077b92b1be' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool_child_count': {'member': 3, 'HM': 0}, 'pool': <octavia.common.data_models.Pool object at 0x7f4700639d10>}, 'provides': None} > |__Atom 'delete_pool_in_db_pool99e683c7-9811-4783-834f-82077b92b1be' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700639d10>}, 'provides': None} > |__Atom 'delete_model_object_pool99e683c7-9811-4783-834f-82077b92b1be' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'object': <octavia.common.data_models.Pool object at 0x7f4700639d10>}, 'provides': None} > |__Atom 'count_pool_children_for_quota_pool99e683c7-9811-4783-834f-82077b92b1be' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700639d10>}, 'provides': {'member': 3, 'HM': 0}} > |__Atom 'mark_pool_pending_delete_in_db_pool99e683c7-9811-4783-834f-82077b92b1be' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'pool': <octavia.common.data_models.Pool object at 0x7f4700639d10>}, 'provides': None} > |__Flow 'octavia-delete-pool-flow' > |__Flow 'pool_delete_flow' > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4702fda750>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f4702fda750>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 have failed. >2018-07-13 10:28:44.283 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:28:44.283 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:28:44.283 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:28:44.283 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:28:44.283 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:28:44.283 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:28:44.283 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:28:44.283 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:28:44.283 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:28:44.283 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:28:44.283 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:28:44.283 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 have failed. >2018-07-13 10:28:44.283 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:28:44.293 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (91a9f704-c6f8-44e4-b154-0bd460f0b4ad) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:28:44.298 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (6f130377-b842-4733-98b6-f5d6d4449e29) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:28:44.302 23 WARNING octavia.controller.worker.tasks.database_tasks [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:28:44.313 23 WARNING octavia.controller.worker.tasks.database_tasks [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for listener on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:28:44.322 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_907133d2-2ecb-41f4-a144-5b23fc30c975' (3d3a0ea7-a96d-45f2-a27b-8c4b2ffe0d9c) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:28:44.324 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_listener_quota_listener_6693a673-225f-4a60-8e7e-cf6e149d89ad' (440dfe1b-446c-4300-9583-c2ed6ca430fc) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:28:44.327 23 WARNING octavia.controller.worker.tasks.database_tasks [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id 907133d2-2ecb-41f4-a144-5b23fc30c975 >2018-07-13 10:28:44.328 23 WARNING octavia.controller.worker.tasks.database_tasks [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark listener delete in DB for listener id 6693a673-225f-4a60-8e7e-cf6e149d89ad >2018-07-13 10:28:44.329 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_907133d2-2ecb-41f4-a144-5b23fc30c975' (c0e3e87d-7914-4f0d-abcb-3653c7b45ee4) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:28:44.331 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_listener_in_db_listener_6693a673-225f-4a60-8e7e-cf6e149d89ad' (4f61c96d-f676-475e-bd9e-c0c4d4c35c7f) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:28:44.334 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_6693a673-225f-4a60-8e7e-cf6e149d89ad' (1e3552e1-3d5b-4ad0-93dd-bb80ed493408) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:28:44.336 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_update_vip_listener_907133d2-2ecb-41f4-a144-5b23fc30c975' (c93db3ea-599d-48f5-8399-9b2e29bd53ce) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:28:44.338 23 WARNING octavia.controller.worker.tasks.database_tasks [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting decrement quota for pool on project 293061856e1a4cffbae3ed099cf4f619 Project quota counts may be incorrect. >2018-07-13 10:28:44.369 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'decrement_pool_quota_pool99e683c7-9811-4783-834f-82077b92b1be' (b2447e07-f1be-44e7-a68e-29357a66ca6b) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:28:44.372 23 WARNING octavia.controller.worker.tasks.database_tasks [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting delete in DB for pool id 99e683c7-9811-4783-834f-82077b92b1be >2018-07-13 10:28:44.376 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_pool_in_db_pool99e683c7-9811-4783-834f-82077b92b1be' (41aa8ec9-7d5e-41cd-ba62-b6c7e8281581) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:28:44.379 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'delete_model_object_pool99e683c7-9811-4783-834f-82077b92b1be' (0234e8d7-a98d-4dc3-80bb-25a7bc22e904) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:28:44.382 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'count_pool_children_for_quota_pool99e683c7-9811-4783-834f-82077b92b1be' (ae07ad66-a9c5-4332-8f6e-ee897144d1d1) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:28:44.384 23 WARNING octavia.controller.worker.tasks.database_tasks [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Reverting mark pool pending delete in DB for pool id 99e683c7-9811-4783-834f-82077b92b1be >2018-07-13 10:28:44.387 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'mark_pool_pending_delete_in_db_pool99e683c7-9811-4783-834f-82077b92b1be' (6b4a50c8-a829-4814-9df9-c70f36975cd1) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:28:44.390 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (343b272b-6725-4044-a0ef-4373f85bbf78) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:28:44.393 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (1ef30e11-7c64-4e53-bd00-1098f3bdc8e3) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:28:44.399 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (50359943-5e22-4496-b9a3-dcce29db8eef) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:28:44.404 23 WARNING octavia.controller.worker.controller_worker [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (8b882a8d-3857-4d04-a3a4-26b5d0d02e84) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 have failed. >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group c650b102-b4c9-46e8-9778-2fff80138c15 have failed. >2018-07-13 10:28:44.404 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:28:50.062 23 INFO octavia.controller.queue.endpoint [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'ca7a26a8-9a71-43fd-96dc-fe0714d9256d'... >2018-07-13 10:28:50.346 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 0f96d132-c29a-49fe-a984-b55dba03acc2 from port 8f959c54-3e2d-4daf-9911-c531cce7b1fc >2018-07-13 10:28:51.010 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 1 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:28:52.065 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 2 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:28:53.141 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 3 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:28:54.201 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 4 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:28:55.255 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 5 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:28:56.307 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 6 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:28:57.364 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 7 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:28:58.415 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 8 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:28:59.468 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 9 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:29:00.522 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 10 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:29:01.580 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 11 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:29:02.632 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 12 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:29:03.682 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 13 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:29:04.737 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 14 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:29:05.790 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 15 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:29:06.843 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Attempt 16 to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed.: Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >Neutron server returns request_ids: ['req-a7476918-0af9-41ab-942c-fbd4cd2d791c'] >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Traceback (most recent call last): >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 228, in _delete_vip_security_group >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self.neutron_client.delete_security_group(sec_grp) >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 985, in delete_security_group >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs return self.delete(self.security_group_path % (security_group)) >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 350, in delete >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs headers=headers, params=params) >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 294, in do_request >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs self._handle_fault_response(status_code, replybody, resp) >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs exception_handler_v20(status_code, error_body) >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs request_ids=request_ids) >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Conflict: Security Group 0f96d132-c29a-49fe-a984-b55dba03acc2 in use. >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs Neutron server returns request_ids: ['req-a7476918-0af9-41ab-942c-fbd4cd2d791c'] >2018-07-13 10:29:07.844 23 ERROR octavia.network.drivers.neutron.allowed_address_pairs >2018-07-13 10:29:07.847 23 WARNING octavia.controller.worker.controller_worker [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (8fc6af24-5258-4318-b75f-21ff6894eba9) transitioned into state 'FAILURE' from state 'RUNNING' >5 predecessors (most recent first): > Atom 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47083d2110>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47083d2110>}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'server_group_id': None}, 'provides': None} > |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f47083d2110>}, 'provides': None} > |__Flow 'octavia-delete-loadbalancer-flow': DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:29:07.847 23 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last): >2018-07-13 10:29:07.847 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:29:07.847 23 ERROR octavia.controller.worker.controller_worker result = task.execute(**arguments) >2018-07-13 10:29:07.847 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:29:07.847 23 ERROR octavia.controller.worker.controller_worker self.network_driver.deallocate_vip(vip) >2018-07-13 10:29:07.847 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:29:07.847 23 ERROR octavia.controller.worker.controller_worker self._delete_security_group(vip, port) >2018-07-13 10:29:07.847 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:29:07.847 23 ERROR octavia.controller.worker.controller_worker self._delete_vip_security_group(sec_grp) >2018-07-13 10:29:07.847 23 ERROR octavia.controller.worker.controller_worker File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:29:07.847 23 ERROR octavia.controller.worker.controller_worker raise base.DeallocateVIPException(message) >2018-07-13 10:29:07.847 23 ERROR octavia.controller.worker.controller_worker DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:29:07.847 23 ERROR octavia.controller.worker.controller_worker >2018-07-13 10:29:07.854 23 WARNING octavia.controller.worker.controller_worker [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.DeallocateVIP' (8fc6af24-5258-4318-b75f-21ff6894eba9) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:29:07.857 23 WARNING octavia.controller.worker.controller_worker [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.network_tasks.UnplugVIP' (1dacc60f-71c0-45ca-967a-1690dde5ccfc) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:29:07.861 23 WARNING octavia.controller.worker.controller_worker [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.database_tasks.MarkLBAmphoraeHealthBusy' (c15cdd2c-9a9a-4e03-a050-01a462f1304e) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:29:07.863 23 WARNING octavia.controller.worker.controller_worker [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.compute_tasks.NovaServerGroupDelete' (73e9aaf3-648b-4ab7-812a-5856d109fd76) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:29:07.870 23 WARNING octavia.controller.worker.controller_worker [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Task 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerToErrorOnRevertTask' (9c532d71-ea05-47b9-83b4-a2c6b7e84e65) transitioned into state 'REVERTED' from state 'REVERTING' >2018-07-13 10:29:07.872 23 WARNING octavia.controller.worker.controller_worker [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Flow 'octavia-delete-loadbalancer-flow' (083fef56-0da4-4734-bc1e-678ce0256853) transitioned into state 'REVERTED' from state 'RUNNING' >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Exception during message handling: DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server Traceback (most recent call last): >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/queue/endpoint.py", line 54, in delete_load_balancer >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server self.worker.delete_load_balancer(load_balancer_id, cascade) >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/controller_worker.py", line 307, in delete_load_balancer >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server delete_lb_tf.run() >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 247, in run >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout): >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures) >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 336, in reraise_if_any >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server failures[0].reraise() >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/types/failure.py", line 343, in reraise >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info) >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server result = task.execute(**arguments) >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/controller/worker/tasks/network_tasks.py", line 363, in execute >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server self.network_driver.deallocate_vip(vip) >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 298, in deallocate_vip >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server self._delete_security_group(vip, port) >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 274, in _delete_security_group >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server self._delete_vip_security_group(sec_grp) >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/octavia/network/drivers/neutron/allowed_address_pairs.py", line 244, in _delete_vip_security_group >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server raise base.DeallocateVIPException(message) >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server DeallocateVIPException: All attempts to remove security group 0f96d132-c29a-49fe-a984-b55dba03acc2 have failed. >2018-07-13 10:29:07.873 23 ERROR oslo_messaging.rpc.server >2018-07-13 10:37:36.624 23 INFO octavia.controller.queue.endpoint [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'ca7a26a8-9a71-43fd-96dc-fe0714d9256d'... >2018-07-13 10:37:37.056 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port 8f959c54-3e2d-4daf-9911-c531cce7b1fc cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: 8f959c54-3e2d-4daf-9911-c531cce7b1fc). >2018-07-13 10:37:37.112 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 0f96d132-c29a-49fe-a984-b55dba03acc2 from port 8f959c54-3e2d-4daf-9911-c531cce7b1fc >2018-07-13 10:37:37.269 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 0f96d132-c29a-49fe-a984-b55dba03acc2 >2018-07-13 10:38:01.599 23 INFO octavia.controller.queue.endpoint [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f88d70db-20a8-4784-bc0a-d9401225b63a'... >2018-07-13 10:38:02.054 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port ee18712e-63af-42d7-888c-a221d493002e cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: ee18712e-63af-42d7-888c-a221d493002e). >2018-07-13 10:38:02.107 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 1b509d93-f412-4add-843b-2c0b12107198 from port ee18712e-63af-42d7-888c-a221d493002e >2018-07-13 10:38:02.258 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 1b509d93-f412-4add-843b-2c0b12107198 >2018-07-13 10:38:03.563 23 INFO octavia.controller.queue.endpoint [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '7d7fdbfc-7d4c-4986-bc27-09fbc98ee48c'... >2018-07-13 10:38:03.780 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port 1dc57ded-d36c-4d25-90ec-fe6cf949d19e cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: 1dc57ded-d36c-4d25-90ec-fe6cf949d19e). >2018-07-13 10:38:03.850 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 from port 1dc57ded-d36c-4d25-90ec-fe6cf949d19e >2018-07-13 10:38:04.010 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 1e95a2eb-fe83-4bc1-b85b-de03b05abab3 >2018-07-13 10:38:05.452 23 INFO octavia.controller.queue.endpoint [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'bf691cc6-68f2-4cb5-8aac-b5c6f75906b3'... >2018-07-13 10:38:05.669 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port c39aeac3-f770-4cba-a263-2f1962f7002c cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: c39aeac3-f770-4cba-a263-2f1962f7002c). >2018-07-13 10:38:05.740 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group c63248dd-e4de-4d1e-a475-db236013fcb2 from port c39aeac3-f770-4cba-a263-2f1962f7002c >2018-07-13 10:38:05.891 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group c63248dd-e4de-4d1e-a475-db236013fcb2 >2018-07-13 10:38:07.354 23 INFO octavia.controller.queue.endpoint [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '1e238de7-5fce-44f2-900d-5dda8b0d52ca'... >2018-07-13 10:38:07.574 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port 66dd76a2-f67c-40f0-9874-335486a342ca cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: 66dd76a2-f67c-40f0-9874-335486a342ca). >2018-07-13 10:38:07.642 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group f8a6d69f-b472-456d-a908-fb26ce91c32b from port 66dd76a2-f67c-40f0-9874-335486a342ca >2018-07-13 10:38:07.785 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group f8a6d69f-b472-456d-a908-fb26ce91c32b >2018-07-13 10:38:09.262 23 INFO octavia.controller.queue.endpoint [req-a9c01aec-a1e7-4604-baa2-2d680ac8ce20 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'd839bfd4-f87e-49b2-a926-6be954ab606a'... >2018-07-13 10:38:09.482 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a9c01aec-a1e7-4604-baa2-2d680ac8ce20 - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port f6e8669b-165d-4314-b21b-6bbb966608f1 cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: f6e8669b-165d-4314-b21b-6bbb966608f1). >2018-07-13 10:38:09.552 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a9c01aec-a1e7-4604-baa2-2d680ac8ce20 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 from port f6e8669b-165d-4314-b21b-6bbb966608f1 >2018-07-13 10:38:09.695 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a9c01aec-a1e7-4604-baa2-2d680ac8ce20 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 35f456c9-a962-46cc-9ab5-a0b6ecdb7dc1 >2018-07-13 10:38:11.178 23 INFO octavia.controller.queue.endpoint [req-7dad59d5-74a4-4a87-b48d-aa01dcea9748 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'cb089d74-7924-4791-a5c6-42321c7e9ffe'... >2018-07-13 10:38:11.397 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-7dad59d5-74a4-4a87-b48d-aa01dcea9748 - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port 1146b5b0-96aa-4f85-acdf-176bc9810f66 cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: 1146b5b0-96aa-4f85-acdf-176bc9810f66). >2018-07-13 10:38:11.470 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-7dad59d5-74a4-4a87-b48d-aa01dcea9748 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group cbc7992b-dc9b-485d-abee-756b36d1c58a from port 1146b5b0-96aa-4f85-acdf-176bc9810f66 >2018-07-13 10:38:11.617 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-7dad59d5-74a4-4a87-b48d-aa01dcea9748 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group cbc7992b-dc9b-485d-abee-756b36d1c58a >2018-07-13 10:38:13.084 23 INFO octavia.controller.queue.endpoint [req-ae8024dd-9873-415e-bd08-9b7effc0b9cf - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '7074d78b-0d2a-4cf5-b662-959897b2702a'... >2018-07-13 10:38:13.308 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ae8024dd-9873-415e-bd08-9b7effc0b9cf - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port b56134ea-cf99-48f4-b40e-83fad7663e7f cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: b56134ea-cf99-48f4-b40e-83fad7663e7f). >2018-07-13 10:38:13.377 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ae8024dd-9873-415e-bd08-9b7effc0b9cf - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group a5c1da62-575c-4882-95d8-ecd7592aa700 from port b56134ea-cf99-48f4-b40e-83fad7663e7f >2018-07-13 10:38:13.524 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ae8024dd-9873-415e-bd08-9b7effc0b9cf - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group a5c1da62-575c-4882-95d8-ecd7592aa700 >2018-07-13 10:38:15.001 23 INFO octavia.controller.queue.endpoint [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '3d060eea-2cab-4674-85fa-96d38a3a3b97'... >2018-07-13 10:38:15.218 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port 0b4eb23a-5268-4f62-a9a4-b35a72f32053 cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: 0b4eb23a-5268-4f62-a9a4-b35a72f32053). >2018-07-13 10:38:15.283 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 from port 0b4eb23a-5268-4f62-a9a4-b35a72f32053 >2018-07-13 10:38:15.438 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 91dc12a5-cdd2-4e07-a95b-3e7762619bc3 >2018-07-13 10:38:16.946 23 INFO octavia.controller.queue.endpoint [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '7b64a842-9be9-4b7d-a351-9e3c0df2dcbb'... >2018-07-13 10:38:17.174 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port 61714dab-74b9-4034-b81d-d0064359f8ee cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: 61714dab-74b9-4034-b81d-d0064359f8ee). >2018-07-13 10:38:17.248 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 71110b7f-f779-4a26-b70d-43f5a8394899 from port 61714dab-74b9-4034-b81d-d0064359f8ee >2018-07-13 10:38:17.396 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 71110b7f-f779-4a26-b70d-43f5a8394899 >2018-07-13 10:38:19.087 23 INFO octavia.controller.queue.endpoint [req-56352124-483d-4dbb-971e-d96ee6aa19fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '87758df5-ad27-4e56-95fa-295938682eba'... >2018-07-13 10:38:19.321 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-56352124-483d-4dbb-971e-d96ee6aa19fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port ef4d6bb6-ddfd-4dfe-8561-8e928cb46da5 cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: ef4d6bb6-ddfd-4dfe-8561-8e928cb46da5). >2018-07-13 10:38:19.395 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-56352124-483d-4dbb-971e-d96ee6aa19fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc from port ef4d6bb6-ddfd-4dfe-8561-8e928cb46da5 >2018-07-13 10:38:19.543 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-56352124-483d-4dbb-971e-d96ee6aa19fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 9afef0da-aa19-4ef4-89ba-415cc5dadafc >2018-07-13 10:38:21.048 23 INFO octavia.controller.queue.endpoint [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'a796e34c-86bd-426d-909c-5d89897d40d1'... >2018-07-13 10:38:21.285 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port 002c2424-3054-4214-80bf-44c3b25bb442 cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: 002c2424-3054-4214-80bf-44c3b25bb442). >2018-07-13 10:38:21.359 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 from port 002c2424-3054-4214-80bf-44c3b25bb442 >2018-07-13 10:38:21.505 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 94fe3a02-61f5-4dcb-aa92-0f57b8df88a9 >2018-07-13 10:38:22.918 23 INFO octavia.controller.queue.endpoint [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'be4174e7-7e6f-44e6-9fcd-31d43e1d91f4'... >2018-07-13 10:38:23.156 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port 1cfa4476-be07-48b6-a414-3e3ea8cbf356 cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: 1cfa4476-be07-48b6-a414-3e3ea8cbf356). >2018-07-13 10:38:23.228 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 66d1823a-d457-4229-91dc-5a76b4221c45 from port 1cfa4476-be07-48b6-a414-3e3ea8cbf356 >2018-07-13 10:38:23.374 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 66d1823a-d457-4229-91dc-5a76b4221c45 >2018-07-13 10:38:24.806 23 INFO octavia.controller.queue.endpoint [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'e0e8f1f8-1a2b-4faa-b133-0620d5901d9e'... >2018-07-13 10:38:25.030 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port 5befeea6-395f-48c5-8689-9f1cc982c2df cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: 5befeea6-395f-48c5-8689-9f1cc982c2df). >2018-07-13 10:38:25.106 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group a1777854-a7a3-4fd9-9736-93677404285d from port 5befeea6-395f-48c5-8689-9f1cc982c2df >2018-07-13 10:38:25.254 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group a1777854-a7a3-4fd9-9736-93677404285d >2018-07-13 10:38:26.722 23 INFO octavia.controller.queue.endpoint [req-a9c01aec-a1e7-4604-baa2-2d680ac8ce20 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'bfc107ff-e9ca-4e49-8153-a3d7c8f86104'... >2018-07-13 10:38:26.977 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a9c01aec-a1e7-4604-baa2-2d680ac8ce20 - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port a8136ee8-d02b-4d7c-a19d-277e7720f7f6 cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: a8136ee8-d02b-4d7c-a19d-277e7720f7f6). >2018-07-13 10:38:27.050 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a9c01aec-a1e7-4604-baa2-2d680ac8ce20 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 from port a8136ee8-d02b-4d7c-a19d-277e7720f7f6 >2018-07-13 10:38:27.205 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a9c01aec-a1e7-4604-baa2-2d680ac8ce20 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group f2effde6-7b7a-4153-81a0-b709cbfd9ab7 >2018-07-13 10:38:28.569 23 INFO octavia.controller.queue.endpoint [req-56352124-483d-4dbb-971e-d96ee6aa19fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f1022762-3823-4f64-a8d2-7ea95f24e435'... >2018-07-13 10:38:28.798 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-56352124-483d-4dbb-971e-d96ee6aa19fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port a312ed55-8980-4599-a054-e49823fc209f cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: a312ed55-8980-4599-a054-e49823fc209f). >2018-07-13 10:38:28.875 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-56352124-483d-4dbb-971e-d96ee6aa19fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group e6624c69-2b1d-458b-9671-7797a9f3b290 from port a312ed55-8980-4599-a054-e49823fc209f >2018-07-13 10:38:29.021 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-56352124-483d-4dbb-971e-d96ee6aa19fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group e6624c69-2b1d-458b-9671-7797a9f3b290 >2018-07-13 10:38:30.465 23 INFO octavia.controller.queue.endpoint [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f0d71bce-f757-43bd-942c-28f824b87789'... >2018-07-13 10:38:30.693 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port 4b75aaee-93dd-486f-8061-e439cdbd7960 cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: 4b75aaee-93dd-486f-8061-e439cdbd7960). >2018-07-13 10:38:30.766 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group bc86132c-9e68-4346-a79e-65bc33e1423d from port 4b75aaee-93dd-486f-8061-e439cdbd7960 >2018-07-13 10:38:30.924 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group bc86132c-9e68-4346-a79e-65bc33e1423d >2018-07-13 10:38:32.366 23 INFO octavia.controller.queue.endpoint [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '5771c255-10ba-4377-9afe-8cc71fb28142'... >2018-07-13 10:38:32.588 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port b1d1a9fc-741a-443e-bd7c-9b0d06bddfa1 cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: b1d1a9fc-741a-443e-bd7c-9b0d06bddfa1). >2018-07-13 10:38:32.656 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 31a3c3d9-118c-4e41-bd31-66de701df8bf from port b1d1a9fc-741a-443e-bd7c-9b0d06bddfa1 >2018-07-13 10:38:32.798 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 31a3c3d9-118c-4e41-bd31-66de701df8bf >2018-07-13 10:38:34.202 23 INFO octavia.controller.queue.endpoint [req-a9c01aec-a1e7-4604-baa2-2d680ac8ce20 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '6490007e-8c2a-4655-8bf5-ec0a63a88a58'... >2018-07-13 10:38:34.425 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-a9c01aec-a1e7-4604-baa2-2d680ac8ce20 - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port 76832527-4f07-4b7d-a86c-8159546236ad cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: 76832527-4f07-4b7d-a86c-8159546236ad). >2018-07-13 10:38:34.495 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a9c01aec-a1e7-4604-baa2-2d680ac8ce20 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group bad80a9a-daac-428f-8037-6d2419bfd46c from port 76832527-4f07-4b7d-a86c-8159546236ad >2018-07-13 10:38:34.641 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a9c01aec-a1e7-4604-baa2-2d680ac8ce20 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group bad80a9a-daac-428f-8037-6d2419bfd46c >2018-07-13 10:38:36.059 23 INFO octavia.controller.queue.endpoint [req-df9f6482-93a6-4311-acff-433ab1b9e030 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '008748a6-ba6c-4851-ae15-aed308614837'... >2018-07-13 10:38:36.283 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-df9f6482-93a6-4311-acff-433ab1b9e030 - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port c8863e25-4719-4183-838d-535c81f40ae1 cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: c8863e25-4719-4183-838d-535c81f40ae1). >2018-07-13 10:38:36.353 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-df9f6482-93a6-4311-acff-433ab1b9e030 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 8507debd-a565-40b0-85c8-5f0509f0d522 from port c8863e25-4719-4183-838d-535c81f40ae1 >2018-07-13 10:38:36.496 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-df9f6482-93a6-4311-acff-433ab1b9e030 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 8507debd-a565-40b0-85c8-5f0509f0d522 >2018-07-13 10:38:38.095 23 INFO octavia.controller.queue.endpoint [req-3557d311-5dc1-4bf3-8875-b3b4b52a1d60 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '51d2eede-a5ab-4b81-a637-f6f078173db5'... >2018-07-13 10:38:38.318 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-3557d311-5dc1-4bf3-8875-b3b4b52a1d60 - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port 54cc38b9-4760-422f-97b0-b580fa562e6b cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: 54cc38b9-4760-422f-97b0-b580fa562e6b). >2018-07-13 10:38:38.386 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-3557d311-5dc1-4bf3-8875-b3b4b52a1d60 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 from port 54cc38b9-4760-422f-97b0-b580fa562e6b >2018-07-13 10:38:38.534 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-3557d311-5dc1-4bf3-8875-b3b4b52a1d60 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 9a0994e4-1f00-4d7a-825f-ce257e1d9908 >2018-07-13 10:38:39.938 23 INFO octavia.controller.queue.endpoint [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '902e1fa6-1049-469b-a40a-24d84c255f27'... >2018-07-13 10:38:40.168 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port ab096239-6e84-4e2b-8d2d-44141a7a12c5 cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: ab096239-6e84-4e2b-8d2d-44141a7a12c5). >2018-07-13 10:38:40.238 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group e2b2f47f-237e-4052-b304-646f8141eb07 from port ab096239-6e84-4e2b-8d2d-44141a7a12c5 >2018-07-13 10:38:40.382 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group e2b2f47f-237e-4052-b304-646f8141eb07 >2018-07-13 10:40:09.827 23 INFO octavia.controller.queue.endpoint [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '086161c5-d21c-470b-aeec-4cc56bcaf2fd'... >2018-07-13 10:40:10.063 23 WARNING octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Can't deallocate VIP because the vip port 0846f477-8a02-4e8a-9e8c-d734e922cd53 cannot be found in neutron. Continuing cleanup.: PortNotFound: port not found (port id: 0846f477-8a02-4e8a-9e8c-d734e922cd53). >2018-07-13 10:40:10.137 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group c650b102-b4c9-46e8-9778-2fff80138c15 from port 0846f477-8a02-4e8a-9e8c-d734e922cd53 >2018-07-13 10:40:10.307 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group c650b102-b4c9-46e8-9778-2fff80138c15 >2018-07-13 10:52:32.571 23 INFO octavia.controller.queue.endpoint [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '53cb1689-06e0-449d-8ea0-e528d6430030'... >2018-07-13 10:52:32.690 23 INFO octavia.controller.worker.tasks.database_tasks [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 1b5a0be8-0e73-43d2-8b73-c2115dbb8fa7 >2018-07-13 10:52:32.856 23 INFO octavia.certificates.generator.local [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 10:52:32.856 23 INFO octavia.certificates.generator.local [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 10:52:32.857 23 INFO octavia.certificates.generator.local [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 10:52:32.857 23 INFO octavia.certificates.generator.local [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 10:52:48.685 23 INFO octavia.controller.worker.tasks.database_tasks [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 1b5a0be8-0e73-43d2-8b73-c2115dbb8fa7 with compute id a955c9c4-3d4e-4779-8383-f460d95d48af for load balancer: 53cb1689-06e0-449d-8ea0-e528d6430030 >2018-07-13 10:52:49.036 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Port cffd28e4-4011-4ec2-be8e-4253f511247d already exists. Nothing to be done. >2018-07-13 10:53:03.197 23 INFO octavia.controller.worker.tasks.database_tasks [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 53cb1689-06e0-449d-8ea0-e528d6430030 >2018-07-13 10:53:03.724 23 INFO octavia.controller.queue.endpoint [req-3557d311-5dc1-4bf3-8875-b3b4b52a1d60 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'd792301e-39a3-4f0f-a248-35c9e590b325'... >2018-07-13 10:53:05.217 23 INFO octavia.controller.queue.endpoint [req-6338ec04-531c-48bb-bd0e-c771c9700310 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'a704d507-8f05-48e9-aff7-6bb9b4e48ae8'... >2018-07-13 10:53:06.440 23 INFO octavia.controller.queue.endpoint [req-fa6c93e8-751f-47b3-ba8a-aaab119dd7e6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '912be574-5959-434b-8653-a490ad768a94'... >2018-07-13 10:53:31.686 23 INFO octavia.controller.queue.endpoint [req-7dad59d5-74a4-4a87-b48d-aa01dcea9748 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c0f9a75e-8819-40cc-b1ab-8d7a2a9954ad'... >2018-07-13 10:53:33.058 23 INFO octavia.controller.queue.endpoint [req-c95f27d9-47d2-4577-a0b8-5c10064f20d8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2f188627-4f2e-4df4-8e6a-28fa9b22ef07'... >2018-07-13 10:53:33.944 23 INFO octavia.controller.queue.endpoint [req-37d0eefe-bc17-4853-a4aa-ba9bc1dfdeb4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '18a0b927-5eac-45aa-9bb8-aa543573954d'... >2018-07-13 11:18:28.151 23 INFO octavia.controller.queue.endpoint [req-579303fd-2fa4-4350-8a33-b258f7939f43 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '76206c33-27be-42d7-8a84-7a3b3a1ea935'... >2018-07-13 11:18:28.280 23 INFO octavia.controller.worker.tasks.database_tasks [req-579303fd-2fa4-4350-8a33-b258f7939f43 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id be761f0a-89a3-4903-bfe5-1157e82e9e9a >2018-07-13 11:18:28.428 23 INFO octavia.certificates.generator.local [req-579303fd-2fa4-4350-8a33-b258f7939f43 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 11:18:28.428 23 INFO octavia.certificates.generator.local [req-579303fd-2fa4-4350-8a33-b258f7939f43 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 11:18:28.429 23 INFO octavia.certificates.generator.local [req-579303fd-2fa4-4350-8a33-b258f7939f43 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 11:18:28.429 23 INFO octavia.certificates.generator.local [req-579303fd-2fa4-4350-8a33-b258f7939f43 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 11:18:32.238 23 INFO octavia.controller.queue.endpoint [req-b81f9e78-1339-4d47-a8f1-20d1e9e933b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '7ae9946d-2a49-4c38-af59-02af456b0bb3'... >2018-07-13 11:18:32.365 23 INFO octavia.controller.worker.tasks.database_tasks [req-b81f9e78-1339-4d47-a8f1-20d1e9e933b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id eb3bb584-20df-4cc8-af99-437ff62d2614 >2018-07-13 11:18:32.429 23 INFO octavia.certificates.generator.local [req-b81f9e78-1339-4d47-a8f1-20d1e9e933b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 11:18:32.429 23 INFO octavia.certificates.generator.local [req-b81f9e78-1339-4d47-a8f1-20d1e9e933b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 11:18:32.429 23 INFO octavia.certificates.generator.local [req-b81f9e78-1339-4d47-a8f1-20d1e9e933b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 11:18:32.430 23 INFO octavia.certificates.generator.local [req-b81f9e78-1339-4d47-a8f1-20d1e9e933b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 11:18:39.057 23 INFO octavia.controller.queue.endpoint [req-f5ce284a-05bc-45a9-9523-1cf24c5fcabf - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'ca178c1c-d11b-43fd-9a93-094082201d1e'... >2018-07-13 11:18:39.295 23 INFO octavia.controller.worker.tasks.database_tasks [req-f5ce284a-05bc-45a9-9523-1cf24c5fcabf - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 903a409c-4d37-4468-b671-bdfe9596b179 >2018-07-13 11:18:39.377 23 INFO octavia.certificates.generator.local [req-f5ce284a-05bc-45a9-9523-1cf24c5fcabf - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 11:18:39.378 23 INFO octavia.certificates.generator.local [req-f5ce284a-05bc-45a9-9523-1cf24c5fcabf - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 11:18:39.378 23 INFO octavia.certificates.generator.local [req-f5ce284a-05bc-45a9-9523-1cf24c5fcabf - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 11:18:39.378 23 INFO octavia.certificates.generator.local [req-f5ce284a-05bc-45a9-9523-1cf24c5fcabf - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 11:18:42.174 23 INFO octavia.controller.worker.tasks.database_tasks [req-579303fd-2fa4-4350-8a33-b258f7939f43 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: be761f0a-89a3-4903-bfe5-1157e82e9e9a with compute id ca83a7ab-5163-4de4-a57e-57c463b30b7d for load balancer: 76206c33-27be-42d7-8a84-7a3b3a1ea935 >2018-07-13 11:18:42.997 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-579303fd-2fa4-4350-8a33-b258f7939f43 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 437044a9-e8d2-4538-9d24-cc5c115da1df already exists. Nothing to be done. >2018-07-13 11:18:44.501 23 INFO octavia.controller.worker.tasks.database_tasks [req-b81f9e78-1339-4d47-a8f1-20d1e9e933b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: eb3bb584-20df-4cc8-af99-437ff62d2614 with compute id 23f7c0ce-556a-4065-aa79-a32c1ee51698 for load balancer: 7ae9946d-2a49-4c38-af59-02af456b0bb3 >2018-07-13 11:18:44.789 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b81f9e78-1339-4d47-a8f1-20d1e9e933b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 6702ba5a-94ab-4d01-9fc2-33630974c3fe already exists. Nothing to be done. >2018-07-13 11:18:51.242 23 INFO octavia.controller.worker.tasks.database_tasks [req-f5ce284a-05bc-45a9-9523-1cf24c5fcabf - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 903a409c-4d37-4468-b671-bdfe9596b179 with compute id c383bc0d-80ba-46bb-87f7-4ddae212494b for load balancer: ca178c1c-d11b-43fd-9a93-094082201d1e >2018-07-13 11:18:51.336 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f5ce284a-05bc-45a9-9523-1cf24c5fcabf - 293061856e1a4cffbae3ed099cf4f619 - - -] Port f1ac0421-d0bf-40b1-a0ec-6d39207fcad6 already exists. Nothing to be done. >2018-07-13 11:19:00.315 23 INFO octavia.controller.worker.tasks.database_tasks [req-579303fd-2fa4-4350-8a33-b258f7939f43 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 76206c33-27be-42d7-8a84-7a3b3a1ea935 >2018-07-13 11:19:02.002 23 INFO octavia.controller.worker.tasks.database_tasks [req-b81f9e78-1339-4d47-a8f1-20d1e9e933b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 7ae9946d-2a49-4c38-af59-02af456b0bb3 >2018-07-13 11:19:07.431 23 INFO octavia.controller.queue.endpoint [req-6c5665a4-7e2a-480c-acb4-646d3758d8f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'ab3bc51e-fd34-485e-8698-6ea318521e62'... >2018-07-13 11:19:08.809 23 INFO octavia.controller.worker.tasks.database_tasks [req-f5ce284a-05bc-45a9-9523-1cf24c5fcabf - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: ca178c1c-d11b-43fd-9a93-094082201d1e >2018-07-13 11:19:12.327 23 INFO octavia.controller.queue.endpoint [req-579303fd-2fa4-4350-8a33-b258f7939f43 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '12891088-9081-4fd2-99bb-03dcc8c08c09'... >2018-07-13 11:19:14.700 23 INFO octavia.controller.queue.endpoint [req-11348585-0684-41d3-b921-d778f3fa0ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'a429d88b-8460-4269-bcad-2600e987c477'... >2018-07-13 11:19:18.540 23 INFO octavia.controller.queue.endpoint [req-b3130c6f-d5fa-4993-91ad-34ace678b131 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '41fb28a6-7ea0-4f20-ad0a-23caf7f65591'... >2018-07-13 11:19:18.665 23 INFO octavia.controller.worker.tasks.database_tasks [req-b3130c6f-d5fa-4993-91ad-34ace678b131 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id ad820b50-ef23-4ded-8b91-11f7427ed71b >2018-07-13 11:19:18.743 23 INFO octavia.certificates.generator.local [req-b3130c6f-d5fa-4993-91ad-34ace678b131 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 11:19:18.743 23 INFO octavia.certificates.generator.local [req-b3130c6f-d5fa-4993-91ad-34ace678b131 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 11:19:18.745 23 INFO octavia.controller.queue.endpoint [req-17172840-cfec-4fa8-97a1-5457064b80bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1969b805-7b35-497c-ada0-086bae12174e'... >2018-07-13 11:19:18.745 23 INFO octavia.certificates.generator.local [req-b3130c6f-d5fa-4993-91ad-34ace678b131 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 11:19:18.748 23 INFO octavia.certificates.generator.local [req-b3130c6f-d5fa-4993-91ad-34ace678b131 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 11:19:19.111 23 INFO octavia.controller.queue.endpoint [req-94276c58-d610-4ce3-a6b1-7b329889c4e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '7faaf253-cddf-4c8d-a3a7-b3143834ad4a'... >2018-07-13 11:19:20.109 23 INFO octavia.controller.queue.endpoint [req-c245142a-00cc-492d-8ff8-ad0630094ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'ff640a29-a4f9-470b-9a06-14ee298b22a8'... >2018-07-13 11:19:20.255 23 INFO octavia.controller.queue.endpoint [req-706922e2-5ed6-4c4e-960b-cb73d69288d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '98322bcf-f9d7-4ff2-b241-45b4fe21f890'... >2018-07-13 11:19:20.323 23 INFO octavia.controller.worker.tasks.database_tasks [req-c245142a-00cc-492d-8ff8-ad0630094ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 91b8d882-8fe7-4fd4-b7ba-4a0d89573712 >2018-07-13 11:19:20.347 23 INFO octavia.controller.queue.endpoint [req-56352124-483d-4dbb-971e-d96ee6aa19fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '8f22cab7-5801-4289-aa64-9072a17082e9'... >2018-07-13 11:19:20.525 23 INFO octavia.certificates.generator.local [req-c245142a-00cc-492d-8ff8-ad0630094ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 11:19:20.526 23 INFO octavia.certificates.generator.local [req-c245142a-00cc-492d-8ff8-ad0630094ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 11:19:20.526 23 INFO octavia.certificates.generator.local [req-c245142a-00cc-492d-8ff8-ad0630094ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 11:19:20.527 23 INFO octavia.certificates.generator.local [req-c245142a-00cc-492d-8ff8-ad0630094ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 11:19:25.332 23 INFO octavia.controller.queue.endpoint [req-98f0f4c5-8b44-4021-865f-eb00499c407e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '0ad87dbc-8771-4b1a-b9e4-406b9c86773f'... >2018-07-13 11:19:25.913 23 INFO octavia.controller.queue.endpoint [req-8cb7b355-7ffa-43eb-8cc6-3707167123fa - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1f40da40-f9e5-42bd-8b57-f6d2d61b9829'... >2018-07-13 11:19:27.268 23 INFO octavia.controller.queue.endpoint [req-77b8ace8-a1ab-4a37-bc5b-424f1374f1c7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'bd861035-3d20-43e8-8535-e49eb35ab3dd'... >2018-07-13 11:19:30.162 23 INFO octavia.controller.queue.endpoint [req-f8c03f17-10ec-41c4-bcb2-215352f0f3b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '48b67624-85da-4748-a6d3-17daf8fe6866'... >2018-07-13 11:19:31.705 23 INFO octavia.controller.worker.tasks.database_tasks [req-b3130c6f-d5fa-4993-91ad-34ace678b131 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: ad820b50-ef23-4ded-8b91-11f7427ed71b with compute id 2c43b3db-30cb-4b7d-b279-0bac6a20a198 for load balancer: 41fb28a6-7ea0-4f20-ad0a-23caf7f65591 >2018-07-13 11:19:31.810 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b3130c6f-d5fa-4993-91ad-34ace678b131 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 6797b651-b9b6-48d8-8460-60088e7ca13f already exists. Nothing to be done. >2018-07-13 11:19:31.996 23 INFO octavia.controller.queue.endpoint [req-a9c01aec-a1e7-4604-baa2-2d680ac8ce20 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'bce31d91-ed11-43c8-ab0e-1d90ccc34f74'... >2018-07-13 11:19:32.228 23 INFO octavia.controller.worker.tasks.database_tasks [req-c245142a-00cc-492d-8ff8-ad0630094ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 91b8d882-8fe7-4fd4-b7ba-4a0d89573712 with compute id 96f5c6ca-4192-46f9-b8fe-0430c18127e4 for load balancer: ff640a29-a4f9-470b-9a06-14ee298b22a8 >2018-07-13 11:19:32.327 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-c245142a-00cc-492d-8ff8-ad0630094ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 0a04d703-58af-4be3-a8b5-ebbeff01dc91 already exists. Nothing to be done. >2018-07-13 11:19:34.493 23 INFO octavia.controller.queue.endpoint [req-da143b89-4c06-401e-8ec8-00d89f408b5f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'acbc08de-e4dd-4fe8-96ab-25b9ed89809f'... >2018-07-13 11:19:39.272 23 INFO octavia.controller.queue.endpoint [req-2bb86416-73bf-455e-acf8-324323d61f8c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '19a4b344-8fe4-407d-904b-045a16e5c273'... >2018-07-13 11:19:44.292 23 INFO octavia.controller.queue.endpoint [req-d5bf6cc4-531e-45d6-87cf-66bb24c30cb1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6edb7ba1-82f2-48de-b173-f164079a0724'... >2018-07-13 11:19:49.274 23 INFO octavia.controller.queue.endpoint [req-3f6717d1-8b53-48ed-9146-39369d1d5aa6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4e7c0b8d-b12c-4a05-b36e-3b661211c7c2'... >2018-07-13 11:19:49.517 23 INFO octavia.controller.worker.tasks.database_tasks [req-b3130c6f-d5fa-4993-91ad-34ace678b131 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 41fb28a6-7ea0-4f20-ad0a-23caf7f65591 >2018-07-13 11:19:50.555 23 INFO octavia.controller.worker.tasks.database_tasks [req-c245142a-00cc-492d-8ff8-ad0630094ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: ff640a29-a4f9-470b-9a06-14ee298b22a8 >2018-07-13 11:19:54.073 23 INFO octavia.controller.queue.endpoint [req-27292d77-f043-4bdb-85f5-f6e9b74336c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a9262fbc-b514-460a-a736-decf1778b6fa'... >2018-07-13 11:19:55.472 23 INFO octavia.controller.queue.endpoint [req-eb45fcf4-16c8-44c5-8188-db3c21da29ec - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '81e03309-6524-49d5-8bc8-0a5336649c93'... >2018-07-13 11:19:55.825 23 INFO octavia.controller.queue.endpoint [req-f5ce284a-05bc-45a9-9523-1cf24c5fcabf - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '5da4e6a7-791d-4580-a1dc-7336f949f9c5'... >2018-07-13 11:20:01.167 23 INFO octavia.controller.queue.endpoint [req-12a9d678-bfba-4543-ba3f-46d0c272da86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7501acb6-f4a6-4c88-967d-59a25bb8ee85'... >2018-07-13 11:20:01.342 23 INFO octavia.controller.queue.endpoint [req-f2fa39c8-3586-49ac-a7cd-ba43132b403d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '54f7c4c6-b9d0-4617-87c0-eac4f0e85774'... >2018-07-13 11:20:01.536 23 INFO octavia.controller.queue.endpoint [req-c245142a-00cc-492d-8ff8-ad0630094ff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'd7b4ea0f-e6e6-46fc-b879-b2feb2c47137'... >2018-07-13 11:20:05.926 23 INFO octavia.controller.queue.endpoint [req-a18c9eaa-1417-4cfe-b4c1-862199ac180d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '0dccf6c9-265d-438f-81b3-ede0688bebe6'... >2018-07-13 11:20:06.345 23 INFO octavia.controller.queue.endpoint [req-4d757119-13d8-4b5b-85ed-ce48f6de161e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'bdf15ad0-537c-4802-b9ab-816cf01a6a00'... >2018-07-13 11:20:06.530 23 INFO octavia.controller.queue.endpoint [req-b3130c6f-d5fa-4993-91ad-34ace678b131 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1f2d9194-57ae-4f7d-bc56-ce880f79d4ad'... >2018-07-13 11:20:07.869 23 INFO octavia.controller.queue.endpoint [req-ab3ff424-7745-4e8c-994a-45789de6c3fd - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '96797443-25d5-459b-b0ff-a329d23fc5db'... >2018-07-13 11:20:10.531 23 INFO octavia.controller.queue.endpoint [req-2b1fc236-eccd-4783-a8d7-61362d4a72cd - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'aa19ef19-1264-46b1-90e8-de26be7689e2'... >2018-07-13 11:20:11.792 23 INFO octavia.controller.queue.endpoint [req-31ce264f-4bfe-440e-895e-4fb25fff42a0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8c95b39b-cd79-4619-8940-38297fc56a20'... >2018-07-13 11:20:13.168 23 INFO octavia.controller.queue.endpoint [req-dea0716e-2c2d-41a3-96f6-0782a6911ec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c05c1ae0-33a0-4e6a-8365-be4bf2ae7915'... >2018-07-13 11:20:17.120 23 INFO octavia.controller.queue.endpoint [req-a74e6249-84fe-400a-8429-b6ecfa577886 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '30312d94-f459-4768-bf4c-cfbc055b2791'... >2018-07-13 12:34:48.811 23 INFO octavia.controller.queue.endpoint [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '76206c33-27be-42d7-8a84-7a3b3a1ea935'... >2018-07-13 12:34:50.546 23 INFO octavia.controller.queue.endpoint [req-2212f0d5-51c1-4f21-ba3a-accbd011f9d3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '7ae9946d-2a49-4c38-af59-02af456b0bb3'... >2018-07-13 12:34:51.814 23 INFO octavia.controller.queue.endpoint [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '41fb28a6-7ea0-4f20-ad0a-23caf7f65591'... >2018-07-13 12:34:52.885 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 77fc5a72-e0c6-4484-b99b-fb101d97dc5f from port 437044a9-e8d2-4538-9d24-cc5c115da1df >2018-07-13 12:34:53.062 23 INFO octavia.controller.queue.endpoint [req-f76b7a32-f475-410a-9333-5191433e9344 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'ff640a29-a4f9-470b-9a06-14ee298b22a8'... >2018-07-13 12:34:54.234 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 77fc5a72-e0c6-4484-b99b-fb101d97dc5f >2018-07-13 12:34:54.327 23 INFO octavia.controller.queue.endpoint [req-ae378360-a868-44ac-a1c2-2d49e9f46059 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'ca178c1c-d11b-43fd-9a93-094082201d1e'... >2018-07-13 12:34:54.967 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-2212f0d5-51c1-4f21-ba3a-accbd011f9d3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 9b4d1658-4063-4400-8871-836d6c3a6b55 from port 6702ba5a-94ab-4d01-9fc2-33630974c3fe >2018-07-13 12:34:55.712 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group c7238852-1636-450c-89d1-6717914b935c from port 6797b651-b9b6-48d8-8460-60088e7ca13f >2018-07-13 12:34:55.731 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-2212f0d5-51c1-4f21-ba3a-accbd011f9d3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 9b4d1658-4063-4400-8871-836d6c3a6b55 >2018-07-13 12:34:56.879 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f76b7a32-f475-410a-9333-5191433e9344 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 79391b1a-dbd8-4a84-9bd3-c8d98a59ee92 from port 0a04d703-58af-4be3-a8b5-ebbeff01dc91 >2018-07-13 12:34:57.066 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group c7238852-1636-450c-89d1-6717914b935c >2018-07-13 12:34:57.117 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ae378360-a868-44ac-a1c2-2d49e9f46059 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group a4bf0106-ed96-4ba7-b5bb-17e594ef3f49 from port f1ac0421-d0bf-40b1-a0ec-6d39207fcad6 >2018-07-13 12:34:57.677 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f76b7a32-f475-410a-9333-5191433e9344 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 79391b1a-dbd8-4a84-9bd3-c8d98a59ee92 >2018-07-13 12:34:57.877 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ae378360-a868-44ac-a1c2-2d49e9f46059 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group a4bf0106-ed96-4ba7-b5bb-17e594ef3f49 >2018-07-13 12:42:14.740 23 INFO octavia.controller.queue.endpoint [req-26868b87-7f69-415f-803d-7ef5d0c4f731 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '912be574-5959-434b-8653-a490ad768a94'... >2018-07-13 12:42:15.795 23 INFO octavia.controller.worker.tasks.database_tasks [req-26868b87-7f69-415f-803d-7ef5d0c4f731 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 53cb1689-06e0-449d-8ea0-e528d6430030 >2018-07-13 12:42:16.096 23 INFO octavia.controller.queue.endpoint [req-d9ee6b76-05ec-41b3-bfa2-40a216fa348b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2f188627-4f2e-4df4-8e6a-28fa9b22ef07'... >2018-07-13 12:42:17.102 23 INFO octavia.controller.queue.endpoint [req-354214dc-58de-468c-b8d9-a0ca13f7ee9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '18a0b927-5eac-45aa-9bb8-aa543573954d'... >2018-07-13 12:42:18.440 23 INFO octavia.controller.queue.endpoint [req-3684b1a5-0a99-45eb-b4cb-37db4ac86bdd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c0f9a75e-8819-40cc-b1ab-8d7a2a9954ad'... >2018-07-13 12:42:21.717 23 INFO octavia.controller.queue.endpoint [req-26868b87-7f69-415f-803d-7ef5d0c4f731 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'a704d507-8f05-48e9-aff7-6bb9b4e48ae8'... >2018-07-13 12:42:26.175 23 INFO octavia.controller.worker.tasks.database_tasks [req-26868b87-7f69-415f-803d-7ef5d0c4f731 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 53cb1689-06e0-449d-8ea0-e528d6430030 >2018-07-13 12:42:30.052 23 INFO octavia.controller.queue.endpoint [req-063a0a1f-6d9c-4690-843b-a33c4f981d71 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool 'd792301e-39a3-4f0f-a248-35c9e590b325'... >2018-07-13 12:42:31.182 23 INFO octavia.controller.queue.endpoint [req-26868b87-7f69-415f-803d-7ef5d0c4f731 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '53cb1689-06e0-449d-8ea0-e528d6430030'... >2018-07-13 12:42:33.556 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-26868b87-7f69-415f-803d-7ef5d0c4f731 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 73b80d29-bea7-4c49-832a-e0d13925fb99 from port cffd28e4-4011-4ec2-be8e-4253f511247d >2018-07-13 12:42:34.505 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-26868b87-7f69-415f-803d-7ef5d0c4f731 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 73b80d29-bea7-4c49-832a-e0d13925fb99 >2018-07-13 12:46:27.732 23 INFO octavia.controller.queue.endpoint [req-ae378360-a868-44ac-a1c2-2d49e9f46059 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'f17bf409-7fb7-43ca-9b78-5d4009a0849a'... >2018-07-13 12:46:27.854 23 INFO octavia.controller.worker.tasks.database_tasks [req-ae378360-a868-44ac-a1c2-2d49e9f46059 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 7e64e269-d222-45bf-869e-f20dc26e2122 >2018-07-13 12:46:27.967 23 INFO octavia.certificates.generator.local [req-ae378360-a868-44ac-a1c2-2d49e9f46059 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 12:46:27.967 23 INFO octavia.certificates.generator.local [req-ae378360-a868-44ac-a1c2-2d49e9f46059 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 12:46:27.968 23 INFO octavia.certificates.generator.local [req-ae378360-a868-44ac-a1c2-2d49e9f46059 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 12:46:27.968 23 INFO octavia.certificates.generator.local [req-ae378360-a868-44ac-a1c2-2d49e9f46059 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 12:46:42.405 23 INFO octavia.controller.worker.tasks.database_tasks [req-ae378360-a868-44ac-a1c2-2d49e9f46059 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 7e64e269-d222-45bf-869e-f20dc26e2122 with compute id 7220870e-ead0-4a4c-b4ef-92867728a2c4 for load balancer: f17bf409-7fb7-43ca-9b78-5d4009a0849a >2018-07-13 12:46:42.710 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ae378360-a868-44ac-a1c2-2d49e9f46059 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 485384bd-1fe9-46ae-89d1-22ebfa83f140 already exists. Nothing to be done. >2018-07-13 12:46:59.903 23 INFO octavia.controller.worker.tasks.database_tasks [req-ae378360-a868-44ac-a1c2-2d49e9f46059 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f17bf409-7fb7-43ca-9b78-5d4009a0849a >2018-07-13 12:47:00.801 23 INFO octavia.controller.queue.endpoint [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '5ee7a476-f384-47b0-9d35-f5b22e440cd1'... >2018-07-13 12:47:02.335 23 INFO octavia.controller.queue.endpoint [req-d0693f63-29d0-497a-9b89-2f8d3652dbac - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '13208f8e-3a7b-4ee7-9615-7789d64c43be'... >2018-07-13 12:47:03.630 23 INFO octavia.controller.queue.endpoint [req-2212f0d5-51c1-4f21-ba3a-accbd011f9d3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '4897d048-27c9-4a56-b59f-85785267a29a'... >2018-07-13 12:47:27.975 23 INFO octavia.controller.queue.endpoint [req-b715b469-de27-47f6-84a5-0d2b6ae58943 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd1b7df32-eec9-4cd1-adc7-22cb69374314'... >2018-07-13 12:47:32.095 23 INFO octavia.controller.queue.endpoint [req-e5700bf3-bf5b-46aa-acde-6fa3698f8ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9a7ab23e-17db-476b-a538-4d3482467927'... >2018-07-13 12:47:33.699 23 INFO octavia.controller.queue.endpoint [req-774b32c9-5f6b-4dd8-bfd8-1afe74e44050 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'fff16e7d-26f7-4fd8-88b6-6a9f7448d4f8'... >2018-07-13 12:50:44.946 23 INFO octavia.controller.queue.endpoint [req-ae378360-a868-44ac-a1c2-2d49e9f46059 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '4897d048-27c9-4a56-b59f-85785267a29a'... >2018-07-13 12:50:45.652 23 INFO octavia.controller.worker.tasks.database_tasks [req-ae378360-a868-44ac-a1c2-2d49e9f46059 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f17bf409-7fb7-43ca-9b78-5d4009a0849a >2018-07-13 12:50:47.299 23 INFO octavia.controller.queue.endpoint [req-30bbdd47-87e6-408c-89b9-d54f5e4e7348 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'fff16e7d-26f7-4fd8-88b6-6a9f7448d4f8'... >2018-07-13 12:50:47.941 23 INFO octavia.controller.queue.endpoint [req-30416760-ef69-483f-a028-c5d472aa6b7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '13208f8e-3a7b-4ee7-9615-7789d64c43be'... >2018-07-13 12:50:48.426 23 INFO octavia.controller.worker.tasks.database_tasks [req-30416760-ef69-483f-a028-c5d472aa6b7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f17bf409-7fb7-43ca-9b78-5d4009a0849a >2018-07-13 12:50:49.232 23 INFO octavia.controller.queue.endpoint [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd1b7df32-eec9-4cd1-adc7-22cb69374314'... >2018-07-13 12:50:50.486 23 INFO octavia.controller.queue.endpoint [req-d0fb3757-ffd6-4205-b031-d93ce7b07edc - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9a7ab23e-17db-476b-a538-4d3482467927'... >2018-07-13 12:51:09.128 23 INFO octavia.controller.queue.endpoint [req-47cc8865-d9ee-4335-9490-1bf2cca030a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool '5ee7a476-f384-47b0-9d35-f5b22e440cd1'... >2018-07-13 12:51:10.254 23 INFO octavia.controller.queue.endpoint [req-26868b87-7f69-415f-803d-7ef5d0c4f731 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f17bf409-7fb7-43ca-9b78-5d4009a0849a'... >2018-07-13 12:51:12.179 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-26868b87-7f69-415f-803d-7ef5d0c4f731 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 3774c96f-3281-4553-b826-32ea52808e66 from port 485384bd-1fe9-46ae-89d1-22ebfa83f140 >2018-07-13 12:51:12.882 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-26868b87-7f69-415f-803d-7ef5d0c4f731 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 3774c96f-3281-4553-b826-32ea52808e66 >2018-07-13 12:52:10.953 23 INFO octavia.controller.queue.endpoint [req-bb9ec91d-167c-4c14-8cd2-09267e6a5630 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '07fd8825-cba4-410e-8326-5d7121588486'... >2018-07-13 12:52:11.069 23 INFO octavia.controller.worker.tasks.database_tasks [req-bb9ec91d-167c-4c14-8cd2-09267e6a5630 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 5e64d676-c710-4789-91f2-865566f91898 >2018-07-13 12:52:11.126 23 INFO octavia.certificates.generator.local [req-bb9ec91d-167c-4c14-8cd2-09267e6a5630 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 12:52:11.126 23 INFO octavia.certificates.generator.local [req-bb9ec91d-167c-4c14-8cd2-09267e6a5630 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 12:52:11.126 23 INFO octavia.certificates.generator.local [req-bb9ec91d-167c-4c14-8cd2-09267e6a5630 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 12:52:11.127 23 INFO octavia.certificates.generator.local [req-bb9ec91d-167c-4c14-8cd2-09267e6a5630 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 12:52:25.669 23 INFO octavia.controller.worker.tasks.database_tasks [req-bb9ec91d-167c-4c14-8cd2-09267e6a5630 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 5e64d676-c710-4789-91f2-865566f91898 with compute id a20a30d6-3ae3-43d8-b638-f8db29c2dfff for load balancer: 07fd8825-cba4-410e-8326-5d7121588486 >2018-07-13 12:52:25.996 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-bb9ec91d-167c-4c14-8cd2-09267e6a5630 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port f2623089-9b72-44c6-85c4-be2c4af9ea57 already exists. Nothing to be done. >2018-07-13 12:52:40.044 23 INFO octavia.controller.worker.tasks.database_tasks [req-bb9ec91d-167c-4c14-8cd2-09267e6a5630 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 07fd8825-cba4-410e-8326-5d7121588486 >2018-07-13 12:52:40.994 23 INFO octavia.controller.queue.endpoint [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'ac65abd8-3ba5-4ed8-912a-95b8f5c05d37'... >2018-07-13 12:52:42.565 23 INFO octavia.controller.queue.endpoint [req-43a5f9e7-f24d-4982-ba4f-ba9375f14c21 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'a76963a3-8f46-4f51-be87-ca4ad7201304'... >2018-07-13 12:52:43.762 23 INFO octavia.controller.queue.endpoint [req-26868b87-7f69-415f-803d-7ef5d0c4f731 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'bd7c675c-e46d-4275-9210-6ba43e8159fe'... >2018-07-13 12:53:06.485 23 INFO octavia.controller.queue.endpoint [req-a7a4b981-8a66-4e9e-aaf9-e12c6e89f89f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5e6f8d14-3ab0-4fa7-86ea-75be5f69bfa7'... >2018-07-13 12:53:07.921 23 INFO octavia.controller.queue.endpoint [req-fff29b4b-a0c4-41cc-9962-92c508ceb770 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1c5decbc-a29e-49c0-90ef-a124b195c56c'... >2018-07-13 12:53:08.572 23 INFO octavia.controller.queue.endpoint [req-ea179937-557b-41ec-965e-2ad8c4d418b7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '986b419c-519a-4e74-a969-dbc1ac7656f9'... >2018-07-13 13:18:56.519 23 INFO octavia.controller.queue.endpoint [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '2227df13-a20e-4c62-964f-a284aceeac0f'... >2018-07-13 13:18:56.671 23 INFO octavia.controller.worker.tasks.database_tasks [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 775b9f82-998a-438a-9088-7bbeddab3efa >2018-07-13 13:18:56.809 23 INFO octavia.certificates.generator.local [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 13:18:56.810 23 INFO octavia.certificates.generator.local [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 13:18:56.810 23 INFO octavia.certificates.generator.local [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 13:18:56.811 23 INFO octavia.certificates.generator.local [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 13:19:06.602 23 INFO octavia.controller.queue.endpoint [req-f0e52898-356d-468a-a1c6-1b0031559341 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '96b72288-b432-4d22-844e-d31de75ee1bc'... >2018-07-13 13:19:06.731 23 INFO octavia.controller.worker.tasks.database_tasks [req-f0e52898-356d-468a-a1c6-1b0031559341 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 8030cf4c-843f-42dd-bc4b-9460183c5dce >2018-07-13 13:19:06.837 23 INFO octavia.certificates.generator.local [req-f0e52898-356d-468a-a1c6-1b0031559341 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 13:19:06.838 23 INFO octavia.certificates.generator.local [req-f0e52898-356d-468a-a1c6-1b0031559341 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 13:19:06.838 23 INFO octavia.certificates.generator.local [req-f0e52898-356d-468a-a1c6-1b0031559341 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 13:19:06.838 23 INFO octavia.certificates.generator.local [req-f0e52898-356d-468a-a1c6-1b0031559341 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 13:19:07.759 23 INFO octavia.controller.queue.endpoint [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'aba5b265-31fb-4d1e-a522-d05dc1c8c4c6'... >2018-07-13 13:19:07.875 23 INFO octavia.controller.worker.tasks.database_tasks [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id ed4efd56-352f-40f4-8253-831185482343 >2018-07-13 13:19:07.919 23 INFO octavia.certificates.generator.local [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 13:19:07.920 23 INFO octavia.certificates.generator.local [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 13:19:07.920 23 INFO octavia.certificates.generator.local [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 13:19:07.920 23 INFO octavia.certificates.generator.local [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 13:19:09.307 23 INFO octavia.controller.worker.tasks.database_tasks [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 775b9f82-998a-438a-9088-7bbeddab3efa with compute id 17c19db1-d24a-4bbd-a9c4-46f19cf913d6 for load balancer: 2227df13-a20e-4c62-964f-a284aceeac0f >2018-07-13 13:19:09.616 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 71130bda-fef6-48e6-8dc8-0a3ed02be9fb already exists. Nothing to be done. >2018-07-13 13:19:18.392 23 INFO octavia.controller.worker.tasks.database_tasks [req-f0e52898-356d-468a-a1c6-1b0031559341 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 8030cf4c-843f-42dd-bc4b-9460183c5dce with compute id d072c4c5-3a51-4abe-b337-562f7dc1d8c6 for load balancer: 96b72288-b432-4d22-844e-d31de75ee1bc >2018-07-13 13:19:18.492 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f0e52898-356d-468a-a1c6-1b0031559341 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 66b0b075-98bd-4c80-9869-6e256aa8f042 already exists. Nothing to be done. >2018-07-13 13:19:19.596 23 INFO octavia.controller.worker.tasks.database_tasks [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: ed4efd56-352f-40f4-8253-831185482343 with compute id 843946ed-7e70-4de2-90b2-c45846fd546d for load balancer: aba5b265-31fb-4d1e-a522-d05dc1c8c4c6 >2018-07-13 13:19:19.915 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port ceb4298e-df96-42fa-a59a-93b91e7c2289 already exists. Nothing to be done. >2018-07-13 13:19:25.425 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.6', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.66.137 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470a51d290>, 'Connection to 172.24.0.6 timed out. (connect timeout=10.0)')) >2018-07-13 13:19:35.068 23 INFO octavia.controller.worker.tasks.database_tasks [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 2227df13-a20e-4c62-964f-a284aceeac0f >2018-07-13 13:19:35.844 23 INFO octavia.controller.worker.tasks.database_tasks [req-f0e52898-356d-468a-a1c6-1b0031559341 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 96b72288-b432-4d22-844e-d31de75ee1bc >2018-07-13 13:19:37.644 23 INFO octavia.controller.worker.tasks.database_tasks [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: aba5b265-31fb-4d1e-a522-d05dc1c8c4c6 >2018-07-13 13:19:40.044 23 INFO octavia.controller.queue.endpoint [req-a90e01f5-ea47-4260-986a-c61a08e7e929 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '2f29e0b6-d291-4fdc-9e2d-ae32191ff928'... >2018-07-13 13:19:44.667 23 INFO octavia.controller.queue.endpoint [req-3b22b21d-57fc-4868-963a-b8817297f42c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '3083af8f-9d5f-4021-b66c-bec55ef33ca7'... >2018-07-13 13:19:47.604 23 INFO octavia.controller.queue.endpoint [req-1e11dc90-cb90-403d-a745-a990b561de2b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '7f8ee280-521f-43c2-b86c-3baadce602b1'... >2018-07-13 13:19:47.882 23 INFO octavia.controller.queue.endpoint [req-ae378360-a868-44ac-a1c2-2d49e9f46059 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '85386fdd-da29-4185-8f87-031314410205'... >2018-07-13 13:19:49.819 23 INFO octavia.controller.queue.endpoint [req-d0fb3757-ffd6-4205-b031-d93ce7b07edc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '78703a75-29c4-4571-b7cb-4ff446d39206'... >2018-07-13 13:19:52.800 23 INFO octavia.controller.queue.endpoint [req-d7f00fdf-681f-43e9-835b-5d19451b9204 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'f297c914-244e-467a-b1fc-3c8bdc7f900d'... >2018-07-13 13:19:53.441 23 INFO octavia.controller.queue.endpoint [req-4ddd052a-f2c7-4297-b925-040d224f12a2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '0c170ec3-651c-4f85-8b0f-c815f85016d2'... >2018-07-13 13:19:58.356 23 INFO octavia.controller.queue.endpoint [req-39fe74a7-a2a0-4995-8f67-96ca85da2977 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ec6fcee3-b4e6-4d39-afe9-9378997685c2'... >2018-07-13 13:19:58.528 23 INFO octavia.controller.queue.endpoint [req-63b79789-35b1-4bcc-8a83-3e4288e68525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '2a64141d-884f-471a-87b0-bc87a6d5e9ce'... >2018-07-13 13:20:03.546 23 INFO octavia.controller.queue.endpoint [req-c1d5f971-8b30-4245-9252-94e7870f89a2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0bd7e115-3f23-4993-8445-26195ade4943'... >2018-07-13 13:20:03.814 23 INFO octavia.controller.queue.endpoint [req-223c8eb7-b659-4743-a3b7-b7b72acbdfa1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'befe0327-bf41-490a-99f6-d8ad97efeda8'... >2018-07-13 13:20:04.823 23 INFO octavia.controller.queue.endpoint [req-ae8024dd-9873-415e-bd08-9b7effc0b9cf - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e57a4c58-6cd1-4246-98ea-1cd3e44ea419'... >2018-07-13 13:20:08.602 23 INFO octavia.controller.queue.endpoint [req-f8417853-35a6-4bc0-b256-8d92d88fa0c6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '3c6f0158-c165-4f6b-a2e5-a03915d686f8'... >2018-07-13 13:20:13.720 23 INFO octavia.controller.queue.endpoint [req-9a713546-a251-4bac-8cd8-8cf7c12c3adb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'fdf466ac-425a-4d7c-ab9c-77c6d7713ce5'... >2018-07-13 13:20:19.361 23 INFO octavia.controller.queue.endpoint [req-e5e2fb74-010c-4f8f-9478-b9136f4d0f46 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7ae2f415-75e8-4e5a-8f4b-06b632d32bca'... >2018-07-13 13:20:24.620 23 INFO octavia.controller.queue.endpoint [req-dc9cf3f4-055e-422a-ac33-50bc7e3238db - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e6d13360-9a23-437e-b515-605981536826'... >2018-07-13 13:20:30.299 23 INFO octavia.controller.queue.endpoint [req-e8e35d3d-ba93-425d-9bf0-e9d6eb701860 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '266d253e-7ceb-451d-8f64-1624cf765c6e'... >2018-07-13 13:20:31.847 23 INFO octavia.controller.queue.endpoint [req-6a3d6447-46bd-45c0-b6d0-ba6ab25925ce - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5f8dfa18-4573-4030-be59-51a2d02621ec'... >2018-07-13 13:20:36.895 23 INFO octavia.controller.queue.endpoint [req-a2998f31-e6f4-4e5e-97a1-74eae6518923 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0a1f1879-fb23-4d34-8669-02372a3154d5'... >2018-07-13 13:20:42.111 23 INFO octavia.controller.queue.endpoint [req-49851ba4-b4b6-4a08-bfe0-e136b2c94dcf - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '35fc0d54-7175-4c0a-a456-981c4bf69c9e'... >2018-07-13 14:40:11.487 23 INFO octavia.controller.queue.endpoint [req-8c5f830c-cc96-4f7d-9ac4-bce6487e8790 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'c84219a0-86a8-4d2f-b01f-1c1f1f8dbdab'... >2018-07-13 14:40:11.621 23 INFO octavia.controller.worker.tasks.database_tasks [req-8c5f830c-cc96-4f7d-9ac4-bce6487e8790 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 294ec2bb-bad0-4f3f-a31f-31c23cde20b1 >2018-07-13 14:40:11.923 23 INFO octavia.certificates.generator.local [req-8c5f830c-cc96-4f7d-9ac4-bce6487e8790 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 14:40:11.924 23 INFO octavia.certificates.generator.local [req-8c5f830c-cc96-4f7d-9ac4-bce6487e8790 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 14:40:11.924 23 INFO octavia.certificates.generator.local [req-8c5f830c-cc96-4f7d-9ac4-bce6487e8790 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 14:40:11.925 23 INFO octavia.certificates.generator.local [req-8c5f830c-cc96-4f7d-9ac4-bce6487e8790 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 14:40:27.313 23 INFO octavia.controller.worker.tasks.database_tasks [req-8c5f830c-cc96-4f7d-9ac4-bce6487e8790 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 294ec2bb-bad0-4f3f-a31f-31c23cde20b1 with compute id b21c951f-906b-4fb2-93b2-f7c4cfd01359 for load balancer: c84219a0-86a8-4d2f-b01f-1c1f1f8dbdab >2018-07-13 14:40:28.241 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-8c5f830c-cc96-4f7d-9ac4-bce6487e8790 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port f1c9641c-1027-41bc-802f-f533dfa42b4a already exists. Nothing to be done. >2018-07-13 14:40:45.798 23 INFO octavia.controller.worker.tasks.database_tasks [req-8c5f830c-cc96-4f7d-9ac4-bce6487e8790 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: c84219a0-86a8-4d2f-b01f-1c1f1f8dbdab >2018-07-13 14:40:47.808 23 INFO octavia.controller.queue.endpoint [req-8c5f830c-cc96-4f7d-9ac4-bce6487e8790 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '78384701-c2b6-4877-b24a-1ae8e92c3040'... >2018-07-13 14:40:52.572 23 INFO octavia.controller.queue.endpoint [req-e441e941-9b23-4010-aabe-c9e173c17495 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '470cb2f7-b1b7-4d54-a5b1-92b3278374ed'... >2018-07-13 14:40:57.694 23 INFO octavia.controller.queue.endpoint [req-b1afd888-703d-43a0-a678-ddbd0fa1bd98 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5f8efdda-391a-47c5-af10-72ac08daf966'... >2018-07-13 15:11:12.718 23 INFO octavia.controller.queue.endpoint [req-5f5c7818-ecf6-411d-8f35-d458c6284c7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'd80a0ccd-e3d3-4b71-9622-0a023605ad93'... >2018-07-13 15:11:12.837 23 INFO octavia.controller.worker.tasks.database_tasks [req-5f5c7818-ecf6-411d-8f35-d458c6284c7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 8a6cf06e-3546-4c4c-9e41-7afc58ab1998 >2018-07-13 15:11:12.958 23 INFO octavia.certificates.generator.local [req-5f5c7818-ecf6-411d-8f35-d458c6284c7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 15:11:12.959 23 INFO octavia.certificates.generator.local [req-5f5c7818-ecf6-411d-8f35-d458c6284c7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 15:11:12.960 23 INFO octavia.certificates.generator.local [req-5f5c7818-ecf6-411d-8f35-d458c6284c7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 15:11:12.960 23 INFO octavia.certificates.generator.local [req-5f5c7818-ecf6-411d-8f35-d458c6284c7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 15:11:13.870 23 INFO octavia.controller.queue.endpoint [req-771aea6d-8904-4913-ab35-addb80577ace - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'b6a7cbe5-468a-4097-aadb-52a1e220be0e'... >2018-07-13 15:11:13.988 23 INFO octavia.controller.worker.tasks.database_tasks [req-771aea6d-8904-4913-ab35-addb80577ace - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id c96da80e-72b0-47c5-93ca-640a489a87a9 >2018-07-13 15:11:14.075 23 INFO octavia.certificates.generator.local [req-771aea6d-8904-4913-ab35-addb80577ace - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 15:11:14.076 23 INFO octavia.certificates.generator.local [req-771aea6d-8904-4913-ab35-addb80577ace - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 15:11:14.076 23 INFO octavia.certificates.generator.local [req-771aea6d-8904-4913-ab35-addb80577ace - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 15:11:14.077 23 INFO octavia.certificates.generator.local [req-771aea6d-8904-4913-ab35-addb80577ace - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 15:11:15.092 23 INFO octavia.controller.queue.endpoint [req-b67def7a-5b04-484b-b249-7c39c7fea4f8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '9f0be455-ad0a-4be8-95e2-5ba1942df6cd'... >2018-07-13 15:11:15.205 23 INFO octavia.controller.worker.tasks.database_tasks [req-b67def7a-5b04-484b-b249-7c39c7fea4f8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id c4acfcec-b0f1-467a-8ccd-db33f536e004 >2018-07-13 15:11:15.244 23 INFO octavia.certificates.generator.local [req-b67def7a-5b04-484b-b249-7c39c7fea4f8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 15:11:15.244 23 INFO octavia.certificates.generator.local [req-b67def7a-5b04-484b-b249-7c39c7fea4f8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 15:11:15.245 23 INFO octavia.certificates.generator.local [req-b67def7a-5b04-484b-b249-7c39c7fea4f8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 15:11:15.245 23 INFO octavia.certificates.generator.local [req-b67def7a-5b04-484b-b249-7c39c7fea4f8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 15:11:26.086 23 INFO octavia.controller.worker.tasks.database_tasks [req-5f5c7818-ecf6-411d-8f35-d458c6284c7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 8a6cf06e-3546-4c4c-9e41-7afc58ab1998 with compute id 2ff2d7a0-6fe9-4f28-ae35-5a9a8390a415 for load balancer: d80a0ccd-e3d3-4b71-9622-0a023605ad93 >2018-07-13 15:11:26.386 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-5f5c7818-ecf6-411d-8f35-d458c6284c7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 5aca87d6-5b92-43da-bf9b-52c983c2b315 already exists. Nothing to be done. >2018-07-13 15:11:26.559 23 INFO octavia.controller.worker.tasks.database_tasks [req-771aea6d-8904-4913-ab35-addb80577ace - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: c96da80e-72b0-47c5-93ca-640a489a87a9 with compute id a4976489-69b6-4a95-8548-96809c5ad69c for load balancer: b6a7cbe5-468a-4097-aadb-52a1e220be0e >2018-07-13 15:11:26.852 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-771aea6d-8904-4913-ab35-addb80577ace - 293061856e1a4cffbae3ed099cf4f619 - - -] Port ac76851a-792f-4918-9bf1-ec1181a12e74 already exists. Nothing to be done. >2018-07-13 15:11:27.408 23 INFO octavia.controller.worker.tasks.database_tasks [req-b67def7a-5b04-484b-b249-7c39c7fea4f8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: c4acfcec-b0f1-467a-8ccd-db33f536e004 with compute id f2d2a01d-716b-434d-81eb-ff79ecd9a1ee for load balancer: 9f0be455-ad0a-4be8-95e2-5ba1942df6cd >2018-07-13 15:11:27.706 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b67def7a-5b04-484b-b249-7c39c7fea4f8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 58bb0a3b-c7fa-4773-945b-2f1024f21154 already exists. Nothing to be done. >2018-07-13 15:11:42.199 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-5f5c7818-ecf6-411d-8f35-d458c6284c7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.17', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.176.250 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700544150>, 'Connection to 172.24.0.17 timed out. (connect timeout=10.0)')) >2018-07-13 15:11:42.757 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-771aea6d-8904-4913-ab35-addb80577ace - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.14', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.174.215 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700593ed0>, 'Connection to 172.24.0.14 timed out. (connect timeout=10.0)')) >2018-07-13 15:11:43.576 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-b67def7a-5b04-484b-b249-7c39c7fea4f8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.4', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.90.16 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470064fc50>, 'Connection to 172.24.0.4 timed out. (connect timeout=10.0)')) >2018-07-13 15:11:51.820 23 INFO octavia.controller.worker.tasks.database_tasks [req-5f5c7818-ecf6-411d-8f35-d458c6284c7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: d80a0ccd-e3d3-4b71-9622-0a023605ad93 >2018-07-13 15:11:52.268 23 INFO octavia.controller.worker.tasks.database_tasks [req-771aea6d-8904-4913-ab35-addb80577ace - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: b6a7cbe5-468a-4097-aadb-52a1e220be0e >2018-07-13 15:11:52.965 23 INFO octavia.controller.queue.endpoint [req-9d68a28b-27b8-4930-9278-2267ff70d865 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'aeb0e951-cdcf-48ee-9f25-880420a60b8e'... >2018-07-13 15:11:53.125 23 INFO octavia.controller.worker.tasks.database_tasks [req-b67def7a-5b04-484b-b249-7c39c7fea4f8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 9f0be455-ad0a-4be8-95e2-5ba1942df6cd >2018-07-13 15:11:55.954 23 INFO octavia.controller.queue.endpoint [req-24ed8cad-6827-4c5a-bd84-2b3ea0e9a27f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '8294ff0e-aa8b-4687-9632-070ec01f921c'... >2018-07-13 15:11:57.576 23 INFO octavia.controller.queue.endpoint [req-fd72c32d-a9b3-41c0-b63c-5b89c7299b5e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'a7015b5d-179a-4c28-af68-47c924cae10e'... >2018-07-13 15:11:57.760 23 INFO octavia.controller.queue.endpoint [req-53aff09c-4bea-466e-b152-e0fb976e0e77 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '2c9f99da-4f29-44ee-ab58-e3d9db6b92b0'... >2018-07-13 15:12:01.017 23 INFO octavia.controller.queue.endpoint [req-c1aa99f1-d5b8-4355-9826-32da130db90a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'cfbcffec-3978-4020-bc4d-2de804a07ccd'... >2018-07-13 15:12:02.412 23 INFO octavia.controller.queue.endpoint [req-fed2b4f1-21b8-46c2-be4d-68e74b479c6c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c7630f2f-3ab6-4123-aac9-73b637503cbf'... >2018-07-13 15:12:02.578 23 INFO octavia.controller.queue.endpoint [req-d4f83319-9f12-4c7e-80fa-1aa2896cb0ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '19413518-7e44-48a1-8da1-b5c0eda1073d'... >2018-07-13 15:12:06.255 23 INFO octavia.controller.queue.endpoint [req-b288a65f-353c-46fa-8593-855a8c23d285 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0d4eacb0-9a40-4274-8cce-b4f23274c597'... >2018-07-13 15:12:07.578 23 INFO octavia.controller.queue.endpoint [req-86048595-5d63-48fd-a100-a4658e1ebaa3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5e6b6b87-2445-4b32-8a4f-1f9178c964f7'... >2018-07-13 15:22:23.815 23 INFO octavia.controller.queue.endpoint [req-df9f6482-93a6-4311-acff-433ab1b9e030 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '4aeef5d9-9d62-4f5b-81b9-64941b5e7208'... >2018-07-13 15:22:23.973 23 INFO octavia.controller.worker.tasks.database_tasks [req-df9f6482-93a6-4311-acff-433ab1b9e030 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 21bceb7f-335c-4bad-96b5-20f1450e6c96 >2018-07-13 15:22:24.090 23 INFO octavia.certificates.generator.local [req-df9f6482-93a6-4311-acff-433ab1b9e030 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 15:22:24.091 23 INFO octavia.certificates.generator.local [req-df9f6482-93a6-4311-acff-433ab1b9e030 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 15:22:24.091 23 INFO octavia.certificates.generator.local [req-df9f6482-93a6-4311-acff-433ab1b9e030 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 15:22:24.091 23 INFO octavia.certificates.generator.local [req-df9f6482-93a6-4311-acff-433ab1b9e030 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 15:22:25.086 23 INFO octavia.controller.queue.endpoint [req-d303c9ec-acf1-43c9-9514-799f65976d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '3a3d1d65-53b4-468b-9a7b-7fb8678a3445'... >2018-07-13 15:22:25.225 23 INFO octavia.controller.worker.tasks.database_tasks [req-d303c9ec-acf1-43c9-9514-799f65976d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 5cd39239-3635-4988-812f-218ee17c430e >2018-07-13 15:22:25.450 23 INFO octavia.certificates.generator.local [req-d303c9ec-acf1-43c9-9514-799f65976d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 15:22:25.450 23 INFO octavia.certificates.generator.local [req-d303c9ec-acf1-43c9-9514-799f65976d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 15:22:25.451 23 INFO octavia.certificates.generator.local [req-d303c9ec-acf1-43c9-9514-799f65976d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 15:22:25.451 23 INFO octavia.certificates.generator.local [req-d303c9ec-acf1-43c9-9514-799f65976d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 15:22:36.829 23 INFO octavia.controller.worker.tasks.database_tasks [req-df9f6482-93a6-4311-acff-433ab1b9e030 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 21bceb7f-335c-4bad-96b5-20f1450e6c96 with compute id 34ae669b-3740-43e8-81d6-ba3fa3983b26 for load balancer: 4aeef5d9-9d62-4f5b-81b9-64941b5e7208 >2018-07-13 15:22:37.132 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-df9f6482-93a6-4311-acff-433ab1b9e030 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port a3a56ce7-f42a-4d59-ad23-91ee49fc45cf already exists. Nothing to be done. >2018-07-13 15:22:37.744 23 INFO octavia.controller.worker.tasks.database_tasks [req-d303c9ec-acf1-43c9-9514-799f65976d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 5cd39239-3635-4988-812f-218ee17c430e with compute id 9d73caed-4427-4769-bfa9-2d02f4c33317 for load balancer: 3a3d1d65-53b4-468b-9a7b-7fb8678a3445 >2018-07-13 15:22:37.953 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-d303c9ec-acf1-43c9-9514-799f65976d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port aaa0d017-c324-4a9c-82f3-8aaecfc77cfb already exists. Nothing to be done. >2018-07-13 15:22:52.577 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-df9f6482-93a6-4311-acff-433ab1b9e030 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.18', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.224.161 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700444550>, 'Connection to 172.24.0.18 timed out. (connect timeout=10.0)')) >2018-07-13 15:22:55.655 23 INFO octavia.controller.worker.tasks.database_tasks [req-d303c9ec-acf1-43c9-9514-799f65976d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 3a3d1d65-53b4-468b-9a7b-7fb8678a3445 >2018-07-13 15:23:01.434 23 INFO octavia.controller.queue.endpoint [req-60f987cf-8a2b-49ef-9cec-6b4e5771a8f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '3dc6698e-ab7f-495c-b102-5eff989311cd'... >2018-07-13 15:23:02.160 23 INFO octavia.controller.worker.tasks.database_tasks [req-df9f6482-93a6-4311-acff-433ab1b9e030 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 4aeef5d9-9d62-4f5b-81b9-64941b5e7208 >2018-07-13 15:23:05.470 23 INFO octavia.controller.queue.endpoint [req-b253b405-2622-41a1-a0c3-4b641b4c28ef - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '48361b5c-9bbd-48f7-bd4a-845ebd23985b'... >2018-07-13 15:23:05.863 23 INFO octavia.controller.queue.endpoint [req-4596356d-be0b-468a-9460-f47020c4022c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'eb62c7ef-a516-45e5-8519-e61be654ca8d'... >2018-07-13 15:23:10.273 23 INFO octavia.controller.queue.endpoint [req-bbc8e964-7bc9-461b-973a-30066abe9a1c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '8f3872c0-a09c-4af4-9202-ccf05e0a8f3f'... >2018-07-13 15:23:11.374 23 INFO octavia.controller.queue.endpoint [req-771aea6d-8904-4913-ab35-addb80577ace - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '212f140b-2181-4534-93a8-8bb6dd565cae'... >2018-07-13 15:23:12.708 23 INFO octavia.controller.queue.endpoint [req-26dc442f-c27a-4ed1-b4e7-2e4b04975776 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'da628b32-925c-4579-9ffc-2e8e2703a6c0'... >2018-07-13 15:23:14.838 23 INFO octavia.controller.queue.endpoint [req-e53dcb78-c284-43dc-a319-f76c59e5a1cf - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd5794b3a-d404-4035-8a8b-b3840898e3dc'... >2018-07-13 15:23:16.134 23 INFO octavia.controller.queue.endpoint [req-1976adf6-fee3-4c56-a16e-ca5478cf15d9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7665a2c7-0923-4bbe-aa14-852bb2ffb590'... >2018-07-13 15:23:17.709 23 INFO octavia.controller.queue.endpoint [req-ddfff4ef-52bd-4246-9454-589a9720f14d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd7f81140-2e2a-488a-a1e1-63c85223379e'... >2018-07-13 15:23:21.172 23 INFO octavia.controller.queue.endpoint [req-df9f6482-93a6-4311-acff-433ab1b9e030 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3c61c581-ea0a-4626-92c9-31efe9ece273'... >2018-07-13 16:32:06.370 23 INFO octavia.controller.queue.endpoint [req-f0e52898-356d-468a-a1c6-1b0031559341 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '2227df13-a20e-4c62-964f-a284aceeac0f'... >2018-07-13 16:32:07.637 23 INFO octavia.controller.queue.endpoint [req-a5456773-be13-4244-8382-4cba0baf4ebd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'c84219a0-86a8-4d2f-b01f-1c1f1f8dbdab'... >2018-07-13 16:32:08.888 23 INFO octavia.controller.queue.endpoint [req-4b10da28-5396-47a4-b474-dc607fbe4254 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '96b72288-b432-4d22-844e-d31de75ee1bc'... >2018-07-13 16:32:10.192 23 INFO octavia.controller.queue.endpoint [req-de4aa8e1-7639-4d35-9544-62dd3088cce7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '4aeef5d9-9d62-4f5b-81b9-64941b5e7208'... >2018-07-13 16:32:10.394 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f0e52898-356d-468a-a1c6-1b0031559341 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group ac2f2057-544d-4487-8a23-03ab7f11dce0 from port 71130bda-fef6-48e6-8dc8-0a3ed02be9fb >2018-07-13 16:32:11.030 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a5456773-be13-4244-8382-4cba0baf4ebd - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 24538feb-58d5-4dce-8b24-d551338e1c39 from port f1c9641c-1027-41bc-802f-f533dfa42b4a >2018-07-13 16:32:11.422 23 INFO octavia.controller.queue.endpoint [req-020a1999-2fa4-4a72-b8b9-d1e9217aa8c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '3a3d1d65-53b4-468b-9a7b-7fb8678a3445'... >2018-07-13 16:32:11.593 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f0e52898-356d-468a-a1c6-1b0031559341 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group ac2f2057-544d-4487-8a23-03ab7f11dce0 >2018-07-13 16:32:11.803 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a5456773-be13-4244-8382-4cba0baf4ebd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 24538feb-58d5-4dce-8b24-d551338e1c39 >2018-07-13 16:32:11.955 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-4b10da28-5396-47a4-b474-dc607fbe4254 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group c83ca8aa-beb0-4294-b1c2-cae2af882afd from port 66b0b075-98bd-4c80-9869-6e256aa8f042 >2018-07-13 16:32:12.689 23 INFO octavia.controller.queue.endpoint [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'b6a7cbe5-468a-4097-aadb-52a1e220be0e'... >2018-07-13 16:32:12.720 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-4b10da28-5396-47a4-b474-dc607fbe4254 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group c83ca8aa-beb0-4294-b1c2-cae2af882afd >2018-07-13 16:32:13.125 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-de4aa8e1-7639-4d35-9544-62dd3088cce7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 2fa1b522-2b0c-44c1-8253-59f3a611dd32 from port a3a56ce7-f42a-4d59-ad23-91ee49fc45cf >2018-07-13 16:32:13.841 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-020a1999-2fa4-4a72-b8b9-d1e9217aa8c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 7e5b7e93-5bc5-45e2-98bf-5013a03eb0bb from port aaa0d017-c324-4a9c-82f3-8aaecfc77cfb >2018-07-13 16:32:13.993 23 INFO octavia.controller.queue.endpoint [req-063a0a1f-6d9c-4690-843b-a33c4f981d71 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'd80a0ccd-e3d3-4b71-9622-0a023605ad93'... >2018-07-13 16:32:14.500 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-de4aa8e1-7639-4d35-9544-62dd3088cce7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 2fa1b522-2b0c-44c1-8253-59f3a611dd32 >2018-07-13 16:32:14.814 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-020a1999-2fa4-4a72-b8b9-d1e9217aa8c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 7e5b7e93-5bc5-45e2-98bf-5013a03eb0bb >2018-07-13 16:32:15.322 23 INFO octavia.controller.queue.endpoint [req-041e2b15-f988-4dcf-aa2f-72eeeaea4d0a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '9f0be455-ad0a-4be8-95e2-5ba1942df6cd'... >2018-07-13 16:32:15.657 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 0139c9d4-edbd-4c52-a6ca-f3ed931d4782 from port ac76851a-792f-4918-9bf1-ec1181a12e74 >2018-07-13 16:32:16.684 23 INFO octavia.controller.queue.endpoint [req-de4aa8e1-7639-4d35-9544-62dd3088cce7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'aba5b265-31fb-4d1e-a522-d05dc1c8c4c6'... >2018-07-13 16:32:16.842 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-063a0a1f-6d9c-4690-843b-a33c4f981d71 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 8e4d5d1d-5286-4e26-bb36-229880e04883 from port 5aca87d6-5b92-43da-bf9b-52c983c2b315 >2018-07-13 16:32:16.874 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 0139c9d4-edbd-4c52-a6ca-f3ed931d4782 >2018-07-13 16:32:17.646 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-063a0a1f-6d9c-4690-843b-a33c4f981d71 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 8e4d5d1d-5286-4e26-bb36-229880e04883 >2018-07-13 16:32:18.243 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-041e2b15-f988-4dcf-aa2f-72eeeaea4d0a - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 5a1099ae-7c95-4ef9-9c90-edfff2b90d7d from port 58bb0a3b-c7fa-4773-945b-2f1024f21154 >2018-07-13 16:32:19.275 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-de4aa8e1-7639-4d35-9544-62dd3088cce7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 0ccaef4d-b9a0-4cd0-b8de-4b33b8255e2b from port ceb4298e-df96-42fa-a59a-93b91e7c2289 >2018-07-13 16:32:19.422 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-041e2b15-f988-4dcf-aa2f-72eeeaea4d0a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 5a1099ae-7c95-4ef9-9c90-edfff2b90d7d >2018-07-13 16:32:20.458 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-de4aa8e1-7639-4d35-9544-62dd3088cce7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 0ccaef4d-b9a0-4cd0-b8de-4b33b8255e2b >2018-07-13 16:33:00.380 23 INFO octavia.controller.queue.endpoint [req-5f5c7818-ecf6-411d-8f35-d458c6284c7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5e6f8d14-3ab0-4fa7-86ea-75be5f69bfa7'... >2018-07-13 16:33:01.466 23 INFO octavia.controller.queue.endpoint [req-29945d08-4d9a-4cf3-ab39-a0a388a9f148 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1c5decbc-a29e-49c0-90ef-a124b195c56c'... >2018-07-13 16:33:02.000 23 INFO octavia.controller.queue.endpoint [req-358b1e0e-f1f4-4e79-adfd-0ccd78c7d35f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'bd7c675c-e46d-4275-9210-6ba43e8159fe'... >2018-07-13 16:33:48.502 23 INFO octavia.controller.worker.tasks.database_tasks [req-358b1e0e-f1f4-4e79-adfd-0ccd78c7d35f - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 07fd8825-cba4-410e-8326-5d7121588486 >2018-07-13 16:33:49.439 23 INFO octavia.controller.queue.endpoint [req-824934c7-b4a9-4c83-be16-711872cf5b32 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'a76963a3-8f46-4f51-be87-ca4ad7201304'... >2018-07-13 16:33:49.903 23 INFO octavia.controller.worker.tasks.database_tasks [req-824934c7-b4a9-4c83-be16-711872cf5b32 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 07fd8825-cba4-410e-8326-5d7121588486 >2018-07-13 16:33:50.684 23 INFO octavia.controller.queue.endpoint [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '986b419c-519a-4e74-a969-dbc1ac7656f9'... >2018-07-13 16:34:02.475 23 INFO octavia.controller.queue.endpoint [req-66182594-101b-47c6-8ca8-d69a00a3eedb - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool 'ac65abd8-3ba5-4ed8-912a-95b8f5c05d37'... >2018-07-13 16:34:03.659 23 INFO octavia.controller.queue.endpoint [req-4943ffd5-f457-4e9b-ae2b-cccafae35194 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '07fd8825-cba4-410e-8326-5d7121588486'... >2018-07-13 16:34:06.017 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-4943ffd5-f457-4e9b-ae2b-cccafae35194 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 2681ae6e-2814-4982-9bd0-324f00747077 from port f2623089-9b72-44c6-85c4-be2c4af9ea57 >2018-07-13 16:34:07.450 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-4943ffd5-f457-4e9b-ae2b-cccafae35194 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 2681ae6e-2814-4982-9bd0-324f00747077 >2018-07-13 16:55:08.848 23 INFO octavia.controller.queue.endpoint [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'f8c5d68f-bfd4-447e-8014-42a5b7b31443'... >2018-07-13 16:55:08.961 23 INFO octavia.controller.worker.tasks.database_tasks [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 3c35a546-71e2-4714-9acc-10e6c5a7046f >2018-07-13 16:55:09.056 23 INFO octavia.certificates.generator.local [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 16:55:09.057 23 INFO octavia.certificates.generator.local [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 16:55:09.057 23 INFO octavia.certificates.generator.local [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 16:55:09.057 23 INFO octavia.certificates.generator.local [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 16:55:24.400 23 INFO octavia.controller.worker.tasks.database_tasks [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 3c35a546-71e2-4714-9acc-10e6c5a7046f with compute id 031fa7f3-67cc-4f79-8754-93009084eef1 for load balancer: f8c5d68f-bfd4-447e-8014-42a5b7b31443 >2018-07-13 16:55:24.721 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Port c0610364-66b7-4997-8177-ffafef774f36 already exists. Nothing to be done. >2018-07-13 16:55:42.058 23 INFO octavia.controller.worker.tasks.database_tasks [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f8c5d68f-bfd4-447e-8014-42a5b7b31443 >2018-07-13 16:55:43.005 23 INFO octavia.controller.queue.endpoint [req-f45e6b62-047b-4111-b8bd-e711a23ad061 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'd5597517-399e-4222-a585-d1d334160542'... >2018-07-13 16:55:44.522 23 INFO octavia.controller.queue.endpoint [req-4943ffd5-f457-4e9b-ae2b-cccafae35194 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '54da6b8c-500b-4498-be12-8ab35b6c3357'... >2018-07-13 16:55:46.840 23 INFO octavia.controller.queue.endpoint [req-b72de0ba-f7b9-4297-8b8a-e82688104a2d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'c5f12fd6-320e-4817-b78f-3821d6e94ce0'... >2018-07-13 16:56:12.678 23 INFO octavia.controller.queue.endpoint [req-1873663d-82aa-4196-88b4-b852fe92ccda - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7c59466d-2cd1-4155-ab8b-c084cd409240'... >2018-07-13 16:56:14.391 23 INFO octavia.controller.queue.endpoint [req-f254f654-8f2c-4778-8c68-e66a67248905 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ab195ca8-28ec-48b8-8972-f1270b2a0475'... >2018-07-13 16:56:16.404 23 INFO octavia.controller.queue.endpoint [req-1d5c1172-a7c6-4b04-a135-2d5ca70d05c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b804532d-70e7-49d1-b0b3-c97859e518aa'... >2018-07-13 17:02:43.517 23 INFO octavia.controller.queue.endpoint [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'c5f12fd6-320e-4817-b78f-3821d6e94ce0'... >2018-07-13 17:02:44.232 23 INFO octavia.controller.worker.tasks.database_tasks [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f8c5d68f-bfd4-447e-8014-42a5b7b31443 >2018-07-13 17:02:48.525 23 INFO octavia.controller.queue.endpoint [req-000bcc46-dfa9-4645-a21d-fd0fcc0b9574 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '54da6b8c-500b-4498-be12-8ab35b6c3357'... >2018-07-13 17:02:49.323 23 INFO octavia.controller.worker.tasks.database_tasks [req-000bcc46-dfa9-4645-a21d-fd0fcc0b9574 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f8c5d68f-bfd4-447e-8014-42a5b7b31443 >2018-07-13 17:02:49.895 23 INFO octavia.controller.queue.endpoint [req-f350c186-3cff-4caa-9004-58c56bd4572b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b804532d-70e7-49d1-b0b3-c97859e518aa'... >2018-07-13 17:02:51.028 23 INFO octavia.controller.queue.endpoint [req-f350c186-3cff-4caa-9004-58c56bd4572b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ab195ca8-28ec-48b8-8972-f1270b2a0475'... >2018-07-13 17:02:52.296 23 INFO octavia.controller.queue.endpoint [req-64cc6dcc-f7f2-4b5c-9aa3-c4953ca95f36 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7c59466d-2cd1-4155-ab8b-c084cd409240'... >2018-07-13 17:03:13.807 23 INFO octavia.controller.queue.endpoint [req-a5456773-be13-4244-8382-4cba0baf4ebd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool 'd5597517-399e-4222-a585-d1d334160542'... >2018-07-13 17:03:14.949 23 INFO octavia.controller.queue.endpoint [req-cb3f932e-7c57-48d1-ac95-fd9cbb767db9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f8c5d68f-bfd4-447e-8014-42a5b7b31443'... >2018-07-13 17:03:17.885 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-cb3f932e-7c57-48d1-ac95-fd9cbb767db9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 919153ae-4b97-42b4-983b-0a005bc863b7 from port c0610364-66b7-4997-8177-ffafef774f36 >2018-07-13 17:03:18.593 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-cb3f932e-7c57-48d1-ac95-fd9cbb767db9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 919153ae-4b97-42b4-983b-0a005bc863b7 >2018-07-13 17:04:31.430 23 INFO octavia.controller.queue.endpoint [req-64cc6dcc-f7f2-4b5c-9aa3-c4953ca95f36 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'b0417213-4fd7-4d57-9e84-38ca924ab9b1'... >2018-07-13 17:04:31.561 23 INFO octavia.controller.worker.tasks.database_tasks [req-64cc6dcc-f7f2-4b5c-9aa3-c4953ca95f36 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 0e70708b-841f-4fa0-95c1-02f5fc89207a >2018-07-13 17:04:31.690 23 INFO octavia.certificates.generator.local [req-64cc6dcc-f7f2-4b5c-9aa3-c4953ca95f36 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 17:04:31.691 23 INFO octavia.certificates.generator.local [req-64cc6dcc-f7f2-4b5c-9aa3-c4953ca95f36 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 17:04:31.691 23 INFO octavia.certificates.generator.local [req-64cc6dcc-f7f2-4b5c-9aa3-c4953ca95f36 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 17:04:31.691 23 INFO octavia.certificates.generator.local [req-64cc6dcc-f7f2-4b5c-9aa3-c4953ca95f36 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 17:04:46.028 23 INFO octavia.controller.worker.tasks.database_tasks [req-64cc6dcc-f7f2-4b5c-9aa3-c4953ca95f36 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 0e70708b-841f-4fa0-95c1-02f5fc89207a with compute id 5c547b01-ce57-4865-8d6c-3c52784320c5 for load balancer: b0417213-4fd7-4d57-9e84-38ca924ab9b1 >2018-07-13 17:04:46.337 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-64cc6dcc-f7f2-4b5c-9aa3-c4953ca95f36 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 82df2983-883f-4c04-9578-3ed674e293b2 already exists. Nothing to be done. >2018-07-13 17:05:04.491 23 INFO octavia.controller.worker.tasks.database_tasks [req-64cc6dcc-f7f2-4b5c-9aa3-c4953ca95f36 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: b0417213-4fd7-4d57-9e84-38ca924ab9b1 >2018-07-13 17:05:05.603 23 INFO octavia.controller.queue.endpoint [req-9bd62e14-02f2-4c87-a740-8d24cc968e91 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '961a3cc3-b1e9-46ef-b227-da9329a269b8'... >2018-07-13 17:05:07.132 23 INFO octavia.controller.queue.endpoint [req-8044619f-1115-46a6-8f6e-f0d6b6696756 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'dfe07828-e16f-4392-b379-2570f1a5fbbb'... >2018-07-13 17:05:09.468 23 INFO octavia.controller.queue.endpoint [req-64cc6dcc-f7f2-4b5c-9aa3-c4953ca95f36 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'b8788c23-b918-4c3b-bcd5-a2fcaf296669'... >2018-07-13 17:05:31.600 23 INFO octavia.controller.queue.endpoint [req-9bd62e14-02f2-4c87-a740-8d24cc968e91 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e0010f0e-cf06-4676-8d67-ae71599d2a0b'... >2018-07-13 17:05:33.351 23 INFO octavia.controller.queue.endpoint [req-000bcc46-dfa9-4645-a21d-fd0fcc0b9574 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2eb3f613-4dfc-4281-b14d-94ed0ca4ac5a'... >2018-07-13 17:05:34.938 23 INFO octavia.controller.queue.endpoint [req-a5456773-be13-4244-8382-4cba0baf4ebd - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '709f4de2-24ff-4f76-b410-8e5b1ca6e353'... >2018-07-13 18:16:25.818 23 INFO octavia.controller.queue.endpoint [req-4d84169e-c7b1-4486-b894-35b8ae103538 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2eb3f613-4dfc-4281-b14d-94ed0ca4ac5a'... >2018-07-13 18:16:27.824 23 INFO octavia.controller.queue.endpoint [req-cb3f932e-7c57-48d1-ac95-fd9cbb767db9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e0010f0e-cf06-4676-8d67-ae71599d2a0b'... >2018-07-13 18:16:29.493 23 INFO octavia.controller.queue.endpoint [req-5e52cc3b-bfd6-433e-a65c-f7e631ba6114 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'dfe07828-e16f-4392-b379-2570f1a5fbbb'... >2018-07-13 18:16:31.906 23 INFO octavia.controller.worker.tasks.database_tasks [req-5e52cc3b-bfd6-433e-a65c-f7e631ba6114 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: b0417213-4fd7-4d57-9e84-38ca924ab9b1 >2018-07-13 18:16:32.163 23 INFO octavia.controller.queue.endpoint [req-5d0e0016-4e12-44ea-b1cb-fddd0dc9b6c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '709f4de2-24ff-4f76-b410-8e5b1ca6e353'... >2018-07-13 18:16:32.495 23 INFO octavia.controller.queue.endpoint [req-f0e52898-356d-468a-a1c6-1b0031559341 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'b8788c23-b918-4c3b-bcd5-a2fcaf296669'... >2018-07-13 18:16:33.039 23 INFO octavia.controller.worker.tasks.database_tasks [req-f0e52898-356d-468a-a1c6-1b0031559341 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: b0417213-4fd7-4d57-9e84-38ca924ab9b1 >2018-07-13 18:16:44.697 23 INFO octavia.controller.queue.endpoint [req-61f4be1e-f7af-4813-9b41-ad305b4fc0aa - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool '961a3cc3-b1e9-46ef-b227-da9329a269b8'... >2018-07-13 18:16:45.865 23 INFO octavia.controller.queue.endpoint [req-47cc8865-d9ee-4335-9490-1bf2cca030a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'b0417213-4fd7-4d57-9e84-38ca924ab9b1'... >2018-07-13 18:16:48.321 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-47cc8865-d9ee-4335-9490-1bf2cca030a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group bf1b2591-102a-4028-9915-f6015f5ba9e8 from port 82df2983-883f-4c04-9578-3ed674e293b2 >2018-07-13 18:16:49.252 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-47cc8865-d9ee-4335-9490-1bf2cca030a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group bf1b2591-102a-4028-9915-f6015f5ba9e8 >2018-07-13 18:18:43.663 23 INFO octavia.controller.queue.endpoint [req-67df8a8f-8697-498f-8ecf-6246357e9844 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '9f5c8871-2f8a-41a8-85b3-6eb85ef31433'... >2018-07-13 18:18:43.775 23 INFO octavia.controller.worker.tasks.database_tasks [req-67df8a8f-8697-498f-8ecf-6246357e9844 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 93281b2a-d388-462b-84cb-c3a47db78a58 >2018-07-13 18:18:43.821 23 INFO octavia.certificates.generator.local [req-67df8a8f-8697-498f-8ecf-6246357e9844 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-13 18:18:43.821 23 INFO octavia.certificates.generator.local [req-67df8a8f-8697-498f-8ecf-6246357e9844 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-13 18:18:43.821 23 INFO octavia.certificates.generator.local [req-67df8a8f-8697-498f-8ecf-6246357e9844 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-13 18:18:43.822 23 INFO octavia.certificates.generator.local [req-67df8a8f-8697-498f-8ecf-6246357e9844 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-13 18:18:59.158 23 INFO octavia.controller.worker.tasks.database_tasks [req-67df8a8f-8697-498f-8ecf-6246357e9844 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 93281b2a-d388-462b-84cb-c3a47db78a58 with compute id 37a9d3f3-2798-4422-ba59-6b57fb14f94c for load balancer: 9f5c8871-2f8a-41a8-85b3-6eb85ef31433 >2018-07-13 18:18:59.515 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-67df8a8f-8697-498f-8ecf-6246357e9844 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 7577591f-241a-4929-801b-132da88e9bdd already exists. Nothing to be done. >2018-07-13 18:19:14.743 23 INFO octavia.controller.worker.tasks.database_tasks [req-67df8a8f-8697-498f-8ecf-6246357e9844 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 9f5c8871-2f8a-41a8-85b3-6eb85ef31433 >2018-07-13 18:19:15.718 23 INFO octavia.controller.queue.endpoint [req-67df8a8f-8697-498f-8ecf-6246357e9844 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '3ebb1236-40a2-4eac-9c3a-ee7f18231a2a'... >2018-07-13 18:19:17.219 23 INFO octavia.controller.queue.endpoint [req-971afc58-2642-461e-bf36-33accdafbace - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '5608bffc-0a87-4450-8327-cc778a0c5f77'... >2018-07-13 18:19:18.475 23 INFO octavia.controller.queue.endpoint [req-149273f7-4cea-4187-b74f-ca5d9c559a88 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'e7e24dfd-0564-41ea-bccb-6d2395c0ec75'... >2018-07-13 18:19:44.504 23 INFO octavia.controller.queue.endpoint [req-67df8a8f-8697-498f-8ecf-6246357e9844 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '55335fb6-3853-4099-ba2c-a51f4eff3a6c'... >2018-07-13 18:19:46.072 23 INFO octavia.controller.queue.endpoint [req-f0e52898-356d-468a-a1c6-1b0031559341 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '84a8c90e-908f-449c-ae70-eedfd90ada60'... >2018-07-13 18:19:47.666 23 INFO octavia.controller.queue.endpoint [req-cb7e5ae6-86c1-431e-8d81-cd6558e25dc4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f0c16f3a-1613-4099-a48d-5956f196a6c9'... >2018-07-16 10:27:42.068 23 INFO octavia.controller.queue.endpoint [req-e42a99c9-7515-4f5c-83aa-34e2de7caf53 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f0c16f3a-1613-4099-a48d-5956f196a6c9'... >2018-07-16 10:27:43.070 23 INFO octavia.controller.queue.endpoint [req-66e8746c-7a98-4e90-a110-43e667ed4c53 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '55335fb6-3853-4099-ba2c-a51f4eff3a6c'... >2018-07-16 10:27:44.087 23 INFO octavia.controller.queue.endpoint [req-86b93551-0bcc-468f-8b7c-3e6ddf1a6d83 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '84a8c90e-908f-449c-ae70-eedfd90ada60'... >2018-07-16 10:27:45.688 23 INFO octavia.controller.queue.endpoint [req-9fa48ca2-1f5b-4b09-8fb3-496ecbaf9a51 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '5608bffc-0a87-4450-8327-cc778a0c5f77'... >2018-07-16 10:27:47.171 23 INFO octavia.controller.worker.tasks.database_tasks [req-9fa48ca2-1f5b-4b09-8fb3-496ecbaf9a51 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 9f5c8871-2f8a-41a8-85b3-6eb85ef31433 >2018-07-16 10:27:47.849 23 INFO octavia.controller.queue.endpoint [req-9fa48ca2-1f5b-4b09-8fb3-496ecbaf9a51 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'e7e24dfd-0564-41ea-bccb-6d2395c0ec75'... >2018-07-16 10:27:48.339 23 INFO octavia.controller.worker.tasks.database_tasks [req-9fa48ca2-1f5b-4b09-8fb3-496ecbaf9a51 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 9f5c8871-2f8a-41a8-85b3-6eb85ef31433 >2018-07-16 10:28:13.965 23 INFO octavia.controller.queue.endpoint [req-9fa48ca2-1f5b-4b09-8fb3-496ecbaf9a51 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool '3ebb1236-40a2-4eac-9c3a-ee7f18231a2a'... >2018-07-16 10:28:15.126 23 INFO octavia.controller.queue.endpoint [req-98e6b28b-38f7-4567-a79b-e167a3d806ac - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '9f5c8871-2f8a-41a8-85b3-6eb85ef31433'... >2018-07-16 10:28:18.207 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-98e6b28b-38f7-4567-a79b-e167a3d806ac - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group e9528c52-978f-478e-8e0d-55110a520ba7 from port 7577591f-241a-4929-801b-132da88e9bdd >2018-07-16 10:28:19.032 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-98e6b28b-38f7-4567-a79b-e167a3d806ac - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group e9528c52-978f-478e-8e0d-55110a520ba7 >2018-07-16 10:31:43.092 23 INFO octavia.controller.queue.endpoint [req-9fa48ca2-1f5b-4b09-8fb3-496ecbaf9a51 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '705f8c70-413f-46a8-b633-d37bb7d200c6'... >2018-07-16 10:31:43.223 23 INFO octavia.controller.worker.tasks.database_tasks [req-9fa48ca2-1f5b-4b09-8fb3-496ecbaf9a51 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 8996c845-6055-43f7-b385-6636caa5e60b >2018-07-16 10:31:43.288 23 INFO octavia.certificates.generator.local [req-9fa48ca2-1f5b-4b09-8fb3-496ecbaf9a51 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 10:31:43.289 23 INFO octavia.certificates.generator.local [req-9fa48ca2-1f5b-4b09-8fb3-496ecbaf9a51 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 10:31:43.289 23 INFO octavia.certificates.generator.local [req-9fa48ca2-1f5b-4b09-8fb3-496ecbaf9a51 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 10:31:43.289 23 INFO octavia.certificates.generator.local [req-9fa48ca2-1f5b-4b09-8fb3-496ecbaf9a51 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 10:31:57.896 23 INFO octavia.controller.worker.tasks.database_tasks [req-9fa48ca2-1f5b-4b09-8fb3-496ecbaf9a51 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 8996c845-6055-43f7-b385-6636caa5e60b with compute id 2db299d2-0246-437e-b165-ffd0986e5f2e for load balancer: 705f8c70-413f-46a8-b633-d37bb7d200c6 >2018-07-16 10:31:58.191 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-9fa48ca2-1f5b-4b09-8fb3-496ecbaf9a51 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 015ace02-d8d1-4652-a8c2-91f3881a80d3 already exists. Nothing to be done. >2018-07-16 10:32:16.669 23 INFO octavia.controller.worker.tasks.database_tasks [req-9fa48ca2-1f5b-4b09-8fb3-496ecbaf9a51 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 705f8c70-413f-46a8-b633-d37bb7d200c6 >2018-07-16 10:32:17.213 23 INFO octavia.controller.queue.endpoint [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '35ac9d79-499e-43ee-98fc-b88f7202db55'... >2018-07-16 10:32:18.733 23 INFO octavia.controller.queue.endpoint [req-98e6b28b-38f7-4567-a79b-e167a3d806ac - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'e5e39a70-5ce5-43a8-8407-3bc98ccfdb64'... >2018-07-16 10:32:19.949 23 INFO octavia.controller.queue.endpoint [req-aef804cb-1fdb-42d8-9f48-867d6177a3d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '460b7f03-d357-4adc-9743-60ae0215e993'... >2018-07-16 10:32:43.066 23 INFO octavia.controller.queue.endpoint [req-b79ae3b7-52cc-4b10-841d-ecc63e21eed7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3fe040a3-dfc8-45be-ad8d-b1c7b6d62e41'... >2018-07-16 10:32:44.168 23 INFO octavia.controller.queue.endpoint [req-00153ed7-eebd-4474-9c02-46bd7a43bfad - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'aefb591b-8408-4bc4-bf03-27eea6c3af42'... >2018-07-16 10:32:45.703 23 INFO octavia.controller.queue.endpoint [req-122dc9ec-0b27-4e40-bfcf-72e86bfec5b3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cfb48170-f511-4c75-8b8b-348b51fdbd66'... >2018-07-16 10:58:07.285 23 INFO octavia.controller.queue.endpoint [req-f87e0b83-8641-480a-9a32-b019677d1360 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'ae593c7c-1d58-4379-a810-87bd395fd9a0'... >2018-07-16 10:58:07.400 23 INFO octavia.controller.worker.tasks.database_tasks [req-f87e0b83-8641-480a-9a32-b019677d1360 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 14138d2e-67e5-4dca-9c82-079f6f042bb3 >2018-07-16 10:58:07.508 23 INFO octavia.certificates.generator.local [req-f87e0b83-8641-480a-9a32-b019677d1360 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 10:58:07.508 23 INFO octavia.certificates.generator.local [req-f87e0b83-8641-480a-9a32-b019677d1360 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 10:58:07.509 23 INFO octavia.certificates.generator.local [req-f87e0b83-8641-480a-9a32-b019677d1360 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 10:58:07.509 23 INFO octavia.certificates.generator.local [req-f87e0b83-8641-480a-9a32-b019677d1360 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 10:58:08.251 23 INFO octavia.controller.queue.endpoint [req-4da09c53-ded2-4ca8-b7f3-b8784c290e5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'e86f0eed-de6b-4be0-9e48-7aa60ddeeb06'... >2018-07-16 10:58:08.365 23 INFO octavia.controller.worker.tasks.database_tasks [req-4da09c53-ded2-4ca8-b7f3-b8784c290e5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id eb344558-ac9b-423b-a92b-798f70683fc9 >2018-07-16 10:58:08.509 23 INFO octavia.certificates.generator.local [req-4da09c53-ded2-4ca8-b7f3-b8784c290e5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 10:58:08.510 23 INFO octavia.certificates.generator.local [req-4da09c53-ded2-4ca8-b7f3-b8784c290e5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 10:58:08.510 23 INFO octavia.certificates.generator.local [req-4da09c53-ded2-4ca8-b7f3-b8784c290e5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 10:58:08.511 23 INFO octavia.certificates.generator.local [req-4da09c53-ded2-4ca8-b7f3-b8784c290e5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 10:58:11.822 23 INFO octavia.controller.queue.endpoint [req-4feea02c-f828-4161-9289-738d366f143d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'b19a300b-a4ca-4bbb-9514-c9c0dfa83bd3'... >2018-07-16 10:58:11.939 23 INFO octavia.controller.worker.tasks.database_tasks [req-4feea02c-f828-4161-9289-738d366f143d - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 3df6de29-944d-4ea4-995b-110cc757c623 >2018-07-16 10:58:11.991 23 INFO octavia.certificates.generator.local [req-4feea02c-f828-4161-9289-738d366f143d - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 10:58:11.991 23 INFO octavia.certificates.generator.local [req-4feea02c-f828-4161-9289-738d366f143d - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 10:58:11.992 23 INFO octavia.certificates.generator.local [req-4feea02c-f828-4161-9289-738d366f143d - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 10:58:11.992 23 INFO octavia.certificates.generator.local [req-4feea02c-f828-4161-9289-738d366f143d - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 10:58:19.941 23 INFO octavia.controller.worker.tasks.database_tasks [req-f87e0b83-8641-480a-9a32-b019677d1360 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 14138d2e-67e5-4dca-9c82-079f6f042bb3 with compute id 826294a3-058f-495f-8bf2-a9d9b1822fab for load balancer: ae593c7c-1d58-4379-a810-87bd395fd9a0 >2018-07-16 10:58:20.257 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f87e0b83-8641-480a-9a32-b019677d1360 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 5d4e8671-6a1a-492e-b7d7-004c687d1d0f already exists. Nothing to be done. >2018-07-16 10:58:21.182 23 INFO octavia.controller.worker.tasks.database_tasks [req-4da09c53-ded2-4ca8-b7f3-b8784c290e5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: eb344558-ac9b-423b-a92b-798f70683fc9 with compute id 00584795-ad3f-46d8-955e-56b181e07a64 for load balancer: e86f0eed-de6b-4be0-9e48-7aa60ddeeb06 >2018-07-16 10:58:21.480 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-4da09c53-ded2-4ca8-b7f3-b8784c290e5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 0beaf0ae-ee13-4275-8c2d-789f0b352108 already exists. Nothing to be done. >2018-07-16 10:58:36.251 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-f87e0b83-8641-480a-9a32-b019677d1360 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.10', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.244.248 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47081d6550>, 'Connection to 172.24.0.10 timed out. (connect timeout=10.0)')) >2018-07-16 10:58:37.263 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-4da09c53-ded2-4ca8-b7f3-b8784c290e5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.12', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.79.114 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700446ed0>, 'Connection to 172.24.0.12 timed out. (connect timeout=10.0)')) >2018-07-16 10:58:44.437 23 INFO octavia.controller.worker.tasks.database_tasks [req-4feea02c-f828-4161-9289-738d366f143d - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 3df6de29-944d-4ea4-995b-110cc757c623 with compute id 39247aac-a753-42d2-86ed-44ec5d5dae83 for load balancer: b19a300b-a4ca-4bbb-9514-c9c0dfa83bd3 >2018-07-16 10:58:44.723 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-4feea02c-f828-4161-9289-738d366f143d - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 9fad7d98-b803-40d4-8ab8-4a12696153d1 already exists. Nothing to be done. >2018-07-16 10:58:45.884 23 INFO octavia.controller.worker.tasks.database_tasks [req-f87e0b83-8641-480a-9a32-b019677d1360 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: ae593c7c-1d58-4379-a810-87bd395fd9a0 >2018-07-16 10:58:46.864 23 INFO octavia.controller.worker.tasks.database_tasks [req-4da09c53-ded2-4ca8-b7f3-b8784c290e5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: e86f0eed-de6b-4be0-9e48-7aa60ddeeb06 >2018-07-16 10:58:49.107 23 INFO octavia.controller.queue.endpoint [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '61d640ca-45d1-4941-80a5-25feee424896'... >2018-07-16 10:58:49.228 23 INFO octavia.controller.worker.tasks.database_tasks [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id f06b8558-54f3-4d64-908d-d548ad470f3d >2018-07-16 10:58:49.315 23 INFO octavia.certificates.generator.local [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 10:58:49.315 23 INFO octavia.certificates.generator.local [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 10:58:49.315 23 INFO octavia.certificates.generator.local [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 10:58:49.316 23 INFO octavia.certificates.generator.local [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 10:58:50.058 23 INFO octavia.controller.queue.endpoint [req-39e3ba81-e23a-4445-9517-ab001e2e8e35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '00ee6184-17f2-4b2e-b117-6d3cda065b03'... >2018-07-16 10:58:50.174 23 INFO octavia.controller.worker.tasks.database_tasks [req-39e3ba81-e23a-4445-9517-ab001e2e8e35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 3a6f4435-4ce0-4b11-a8a2-af5d55872a13 >2018-07-16 10:58:50.305 23 INFO octavia.certificates.generator.local [req-39e3ba81-e23a-4445-9517-ab001e2e8e35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 10:58:50.306 23 INFO octavia.certificates.generator.local [req-39e3ba81-e23a-4445-9517-ab001e2e8e35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 10:58:50.307 23 INFO octavia.certificates.generator.local [req-39e3ba81-e23a-4445-9517-ab001e2e8e35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 10:58:50.308 23 INFO octavia.certificates.generator.local [req-39e3ba81-e23a-4445-9517-ab001e2e8e35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 10:58:50.659 23 INFO octavia.controller.queue.endpoint [req-afdee77f-2223-41c5-b901-d79330af27f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'd08dfdbd-3639-4c7c-87a5-852c960117bf'... >2018-07-16 10:58:51.209 23 INFO octavia.controller.queue.endpoint [req-dc5f2111-65ab-4534-b55e-4e61c312e4c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'c5775a91-552f-433f-96d5-3727c8d98135'... >2018-07-16 10:58:56.325 23 INFO octavia.controller.queue.endpoint [req-82e81f40-3951-4022-b135-fe8592052f36 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'b12ebb96-22b2-4542-8a72-a8644b0d59d6'... >2018-07-16 10:58:56.460 23 INFO octavia.controller.queue.endpoint [req-97592c20-b49e-47e0-a649-e2918cdecd02 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '37feffaa-ae82-4de6-92f0-aaa0e0265484'... >2018-07-16 10:59:00.332 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-4feea02c-f828-4161-9289-738d366f143d - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.14', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.5.166 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47005da550>, 'Connection to 172.24.0.14 timed out. (connect timeout=10.0)')) >2018-07-16 10:59:01.227 23 INFO octavia.controller.queue.endpoint [req-36c88125-7b37-4e0a-b166-da207116f67f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '707f0e3f-d48a-4474-b4d6-e8851a933328'... >2018-07-16 10:59:01.692 23 INFO octavia.controller.worker.tasks.database_tasks [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: f06b8558-54f3-4d64-908d-d548ad470f3d with compute id e05c5e28-bc80-48b5-ae97-480ce0a3cb9e for load balancer: 61d640ca-45d1-4941-80a5-25feee424896 >2018-07-16 10:59:01.800 23 INFO octavia.controller.queue.endpoint [req-40b87d7e-2786-4a5c-9445-9cb6f7bf251b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b2abf426-6717-496f-b1f4-26da033b6a7a'... >2018-07-16 10:59:01.808 23 INFO octavia.controller.worker.tasks.database_tasks [req-39e3ba81-e23a-4445-9517-ab001e2e8e35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 3a6f4435-4ce0-4b11-a8a2-af5d55872a13 with compute id b07e2525-f752-4d0a-807a-a5cfa95245a7 for load balancer: 00ee6184-17f2-4b2e-b117-6d3cda065b03 >2018-07-16 10:59:02.080 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-39e3ba81-e23a-4445-9517-ab001e2e8e35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port e282a962-59db-4640-8998-24ede3758afe already exists. Nothing to be done. >2018-07-16 10:59:02.128 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 0f71f14d-e106-4e77-8b33-e2a52c78fb10 already exists. Nothing to be done. >2018-07-16 10:59:03.135 23 INFO octavia.controller.queue.endpoint [req-ee3a779b-8703-4c1a-9714-74ebb4a84097 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'dc527bea-f242-42b1-a3f5-f85a99a7a8ec'... >2018-07-16 10:59:06.941 23 INFO octavia.controller.queue.endpoint [req-5118d01c-5b1a-4ee9-85de-81a26dc493cf - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '420c94c4-726b-433b-afaa-b1dab394f90e'... >2018-07-16 10:59:08.269 23 INFO octavia.controller.queue.endpoint [req-5ebed0d0-06b3-4e71-9ad8-78b4af9994c6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '628f6bc4-394a-4884-83ca-5d706dc9fade'... >2018-07-16 10:59:09.885 23 INFO octavia.controller.worker.tasks.database_tasks [req-4feea02c-f828-4161-9289-738d366f143d - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: b19a300b-a4ca-4bbb-9514-c9c0dfa83bd3 >2018-07-16 10:59:12.152 23 INFO octavia.controller.queue.endpoint [req-ba78af0a-06a0-434d-9ed1-891ead4a8d71 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '41ddc1ab-2d63-436b-9b39-a79a3341c7d1'... >2018-07-16 10:59:17.465 23 INFO octavia.controller.queue.endpoint [req-4b10da28-5396-47a4-b474-dc607fbe4254 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '2763425f-54c7-409a-93f0-7e994bdf2201'... >2018-07-16 10:59:19.453 23 INFO octavia.controller.worker.tasks.database_tasks [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 61d640ca-45d1-4941-80a5-25feee424896 >2018-07-16 10:59:19.561 23 INFO octavia.controller.worker.tasks.database_tasks [req-39e3ba81-e23a-4445-9517-ab001e2e8e35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 00ee6184-17f2-4b2e-b117-6d3cda065b03 >2018-07-16 10:59:21.149 23 INFO octavia.controller.queue.endpoint [req-3669d80b-4f8f-4b74-a781-4cacdadbe865 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'd53ae80b-22a5-4c3a-9d2a-8758cdf2f978'... >2018-07-16 10:59:22.662 23 INFO octavia.controller.queue.endpoint [req-c2b19251-24b3-4818-bd7e-522e64630b15 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '996c5132-1f27-440d-ba24-fe0d64e109e2'... >2018-07-16 10:59:26.278 23 INFO octavia.controller.queue.endpoint [req-713e63ef-058c-469d-8ba8-50b8d74a06ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '836909d1-6757-4443-99d7-3600b9e59c71'... >2018-07-16 10:59:27.236 23 INFO octavia.controller.queue.endpoint [req-27862abf-857b-45b9-b86c-911136545dfe - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '6dfa7ef4-647c-4662-b09c-89f999372f07'... >2018-07-16 10:59:28.147 23 INFO octavia.controller.queue.endpoint [req-d4b16bf7-ba68-41fd-b62d-d8160e581d5e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'bc2c12d6-81f8-47d3-8894-58b6f8579df6'... >2018-07-16 10:59:31.777 23 INFO octavia.controller.queue.endpoint [req-66182594-101b-47c6-8ca8-d69a00a3eedb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c77afd8d-83bf-426b-aefb-e673cd133e36'... >2018-07-16 10:59:32.340 23 INFO octavia.controller.queue.endpoint [req-39e3ba81-e23a-4445-9517-ab001e2e8e35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '312cb2bc-c289-486b-a95d-cfdffb460c5e'... >2018-07-16 10:59:33.137 23 INFO octavia.controller.queue.endpoint [req-616ee0ec-a483-460c-af22-ff8b44188f9c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2fda0334-b009-4a6e-ae5a-cbf00e03d7ad'... >2018-07-16 10:59:34.194 23 INFO octavia.controller.queue.endpoint [req-ff804f4f-ec0d-4f84-8b15-d489aaab8f47 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '8216f9ce-250e-430b-9d9e-a97caed38045'... >2018-07-16 10:59:34.632 23 INFO octavia.controller.queue.endpoint [req-c52ac60a-9974-46b6-9a7a-e21d45921551 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd2772e66-ef39-42ce-b13c-b2a13fae7b97'... >2018-07-16 10:59:37.631 23 INFO octavia.controller.queue.endpoint [req-19014d55-0421-4027-a97a-d500700735dd - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'fc436a55-f613-43be-94d9-35aeb3ac01ab'... >2018-07-16 10:59:39.389 23 INFO octavia.controller.queue.endpoint [req-f659a7c9-998e-44bf-86a9-29c17dcf0cd8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'ee254122-1098-4bae-9f0d-03dc4ce1b595'... >2018-07-16 10:59:40.155 23 INFO octavia.controller.queue.endpoint [req-ed36772d-5571-44aa-9bd3-1b4b4f4402d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '35effd55-c7f7-4635-a051-91e68d1c291e'... >2018-07-16 10:59:43.077 23 INFO octavia.controller.queue.endpoint [req-a98bee67-424e-44fa-bde4-7362d7f69ea2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0071f4fa-ece6-4e40-bf71-d53658c3f6df'... >2018-07-16 10:59:44.375 23 INFO octavia.controller.queue.endpoint [req-babf8887-670e-44e2-ae9e-dc314776c16e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5c26fb45-a163-4f5a-b1a9-f5ed31776a62'... >2018-07-16 10:59:45.522 23 INFO octavia.controller.queue.endpoint [req-f76b7a32-f475-410a-9333-5191433e9344 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c3dc3c0b-78b7-408c-9072-803b464554e9'... >2018-07-16 10:59:48.016 23 INFO octavia.controller.queue.endpoint [req-ea29235e-2a7a-4e22-b0f2-04ad0ea3d234 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b73f2e1d-95c9-4835-9549-961e6b8116d5'... >2018-07-16 10:59:49.624 23 INFO octavia.controller.queue.endpoint [req-b11ae255-3203-441c-a47e-6a0776c70c4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2bbdc922-835a-496b-8c72-6b654c64e5be'... >2018-07-16 10:59:54.413 23 INFO octavia.controller.queue.endpoint [req-2397109f-1b4b-41a8-b94e-347114afe009 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b534f66a-6491-41d2-8ec9-c809135531d9'... >2018-07-16 11:53:50.173 23 INFO octavia.controller.queue.endpoint [req-a04d8773-6a99-4b26-8532-05c56f3e9eef - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '996c5132-1f27-440d-ba24-fe0d64e109e2'... >2018-07-16 11:54:00.557 23 INFO octavia.controller.queue.endpoint [req-d3180368-9088-40bc-967a-e1144fae5a48 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'bc2c12d6-81f8-47d3-8894-58b6f8579df6'... >2018-07-16 11:54:10.490 23 INFO octavia.controller.queue.endpoint [req-f7635156-f3bd-432d-809f-b1df69aa7e51 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2fda0334-b009-4a6e-ae5a-cbf00e03d7ad'... >2018-07-16 11:57:36.906 23 INFO octavia.controller.queue.endpoint [req-2cfbf773-be9a-471e-b265-ae121c73ca38 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd4d0d7ed-3c60-4fa0-aa4c-74b5cb8ba399'... >2018-07-16 11:57:42.463 23 INFO octavia.controller.queue.endpoint [req-79c47db6-5c5b-47b3-a9b8-548041aeb26c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '43bae652-22d9-4383-952b-5489caeda6e1'... >2018-07-16 11:57:47.599 23 INFO octavia.controller.queue.endpoint [req-508f9379-72ad-4a56-ab90-65ed43e15dec - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4f7c7c05-b9b6-45c0-bd80-c81571490bb5'... >2018-07-16 12:10:46.143 23 INFO octavia.controller.queue.endpoint [req-04ffef2c-13e4-4259-8c21-4c5603b0328d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd2772e66-ef39-42ce-b13c-b2a13fae7b97'... >2018-07-16 12:10:56.428 23 INFO octavia.controller.queue.endpoint [req-f350c186-3cff-4caa-9004-58c56bd4572b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '35effd55-c7f7-4635-a051-91e68d1c291e'... >2018-07-16 12:11:07.379 23 INFO octavia.controller.queue.endpoint [req-8c70707d-16cc-47b1-9e82-5d2ebed7ded6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c3dc3c0b-78b7-408c-9072-803b464554e9'... >2018-07-16 12:13:13.149 23 INFO octavia.controller.queue.endpoint [req-47cc8865-d9ee-4335-9490-1bf2cca030a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b2abf426-6717-496f-b1f4-26da033b6a7a'... >2018-07-16 12:13:19.435 23 INFO octavia.controller.queue.endpoint [req-b67def7a-5b04-484b-b249-7c39c7fea4f8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a310613f-8a5b-4c8e-97c2-c08e23e1a0f6'... >2018-07-16 12:14:17.705 23 INFO octavia.controller.queue.endpoint [req-bd8e891e-cc14-44f2-8205-3b0f34b80e93 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'dc527bea-f242-42b1-a3f5-f85a99a7a8ec'... >2018-07-16 12:14:27.537 23 INFO octavia.controller.queue.endpoint [req-4717a700-7e3c-4a16-b26f-ae8b07ed351e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '628f6bc4-394a-4884-83ca-5d706dc9fade'... >2018-07-16 12:28:25.965 23 INFO octavia.controller.queue.endpoint [req-5aef0bb8-2e05-433a-a9e9-a1ec06b0f2c2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a310613f-8a5b-4c8e-97c2-c08e23e1a0f6'... >2018-07-16 12:28:27.450 23 INFO octavia.controller.queue.endpoint [req-2fdbc7a6-dc8e-4fa5-8aaf-de2f2487384c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7f0e72ec-f536-495b-b65a-3925c59ae645'... >2018-07-16 12:29:27.024 23 INFO octavia.controller.queue.endpoint [req-e1569e67-1aa0-42c2-80dd-1e4b1ba949db - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'fabfefc7-0378-49a0-8171-161559f20d30'... >2018-07-16 12:29:29.771 23 INFO octavia.controller.queue.endpoint [req-3a81e875-31a0-499e-a06d-145bdc8ddf61 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd81c0493-e708-4b36-b21b-79c11cd28e9e'... >2018-07-16 12:40:03.580 23 INFO octavia.controller.queue.endpoint [req-a5354776-21c5-4ed2-acbf-87130ab22b74 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd4d0d7ed-3c60-4fa0-aa4c-74b5cb8ba399'... >2018-07-16 12:40:13.963 23 INFO octavia.controller.queue.endpoint [req-6c99b2d1-4775-476e-8a56-d6c74e2f8cc6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '43bae652-22d9-4383-952b-5489caeda6e1'... >2018-07-16 12:40:23.866 23 INFO octavia.controller.queue.endpoint [req-0ab16899-b678-4742-94ca-c6d7506d2982 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4f7c7c05-b9b6-45c0-bd80-c81571490bb5'... >2018-07-16 12:40:29.171 23 INFO octavia.controller.queue.endpoint [req-c94124f6-8584-4e70-872b-8419b8f269f4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'efeed50b-da17-4361-ae14-5681cf2fb2c7'... >2018-07-16 12:40:34.402 23 INFO octavia.controller.queue.endpoint [req-6473758b-b55a-4e9b-9652-7312b7881b59 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3d401ebc-550c-41c6-8585-f8cfe3936482'... >2018-07-16 12:40:39.049 23 INFO octavia.controller.queue.endpoint [req-c9ecf118-5db1-4547-a5dd-31b990777f30 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '908e5790-7d6b-4c74-b2d7-d0bef2917ae4'... >2018-07-16 12:43:22.454 23 INFO octavia.controller.queue.endpoint [req-2b1c5c14-ef66-4740-aca7-6f952d150214 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '7f0e72ec-f536-495b-b65a-3925c59ae645'... >2018-07-16 12:43:25.078 23 INFO octavia.controller.queue.endpoint [req-67147cde-d275-46c2-9bc0-63826134d3ee - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '77c0307f-e808-4cc6-94e7-f0f52b2d6fee'... >2018-07-16 12:44:18.702 23 INFO octavia.controller.queue.endpoint [req-a15b5c4d-75ce-4d10-aeac-7a5ea1feb40b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'fabfefc7-0378-49a0-8171-161559f20d30'... >2018-07-16 12:44:21.336 23 INFO octavia.controller.queue.endpoint [req-052bf2f2-70a6-4a17-9a05-ee48380befb5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd81c0493-e708-4b36-b21b-79c11cd28e9e'... >2018-07-16 12:44:23.206 23 INFO octavia.controller.queue.endpoint [req-88fc24b1-c6ab-402b-9461-c2f3ad66f342 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a1b58ad8-a827-44e9-9423-29fb6b645466'... >2018-07-16 12:44:24.466 23 INFO octavia.controller.queue.endpoint [req-d7eed087-10af-4be7-acba-e82b65318719 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'df103a07-4f7b-4db1-87c3-251a20bcd890'... >2018-07-16 12:58:20.110 23 INFO octavia.controller.queue.endpoint [req-8007d9a8-cb51-4316-b049-1af57a1d8b48 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '77c0307f-e808-4cc6-94e7-f0f52b2d6fee'... >2018-07-16 12:59:14.273 23 INFO octavia.controller.queue.endpoint [req-ea9a0862-5c5f-4da5-9c37-9ec26846b1b5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a1b58ad8-a827-44e9-9423-29fb6b645466'... >2018-07-16 12:59:22.734 23 INFO octavia.controller.queue.endpoint [req-bcc149b4-1bf5-41bc-8399-166e6c5954f9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2e0d6320-e31b-430a-b486-eced9d65a3c9'... >2018-07-16 12:59:53.154 23 INFO octavia.controller.queue.endpoint [req-8c520495-f3f1-44a8-acc1-e98991730d50 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'efeed50b-da17-4361-ae14-5681cf2fb2c7'... >2018-07-16 12:59:58.379 23 INFO octavia.controller.queue.endpoint [req-feb64e15-a13a-4f7b-9348-d102b896272d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c77afd8d-83bf-426b-aefb-e673cd133e36'... >2018-07-16 13:00:02.481 23 INFO octavia.controller.queue.endpoint [req-a3d9b09d-2665-428c-ae93-55bc51f0bca6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '3d401ebc-550c-41c6-8585-f8cfe3936482'... >2018-07-16 13:00:03.574 23 INFO octavia.controller.queue.endpoint [req-24707957-bc6b-41d6-8180-1c5a98396228 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4c7df069-f456-4c6b-bbf8-f7a091e2042c'... >2018-07-16 13:00:11.950 23 INFO octavia.controller.queue.endpoint [req-af9bc4b3-1738-47ba-b9ee-7c426662edd8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '908e5790-7d6b-4c74-b2d7-d0bef2917ae4'... >2018-07-16 13:00:17.999 23 INFO octavia.controller.queue.endpoint [req-b7ef836f-bc5e-466b-90bd-7caa7dc24c3f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '309ea618-5258-48d1-b197-93a53d06a446'... >2018-07-16 13:00:23.266 23 INFO octavia.controller.queue.endpoint [req-763b007f-9b8f-4ba2-b552-23b0329c0a07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e09abc70-356f-4879-8b65-4971d4aeb491'... >2018-07-16 13:00:28.401 23 INFO octavia.controller.queue.endpoint [req-e8f01f1d-a558-4b14-8d15-301ce7e1062e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2e193ffa-ea4c-414a-9f0c-97c37197a36b'... >2018-07-16 13:04:51.040 23 INFO octavia.controller.queue.endpoint [req-070523ad-27a6-43d0-858b-7ef6672a5522 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '566320e4-bdbd-4dac-bd83-e477616b0867'... >2018-07-16 13:04:56.354 23 INFO octavia.controller.queue.endpoint [req-19bce841-4abc-48b8-be97-b82f90d47cc5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '87cfd45b-b893-4c5c-a429-9946a89680a7'... >2018-07-16 13:05:01.305 23 INFO octavia.controller.queue.endpoint [req-bef8e100-672f-435b-9af3-ddaddab2f904 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ac5ad7a5-9d9e-42bf-b1e1-1bd32232fc44'... >2018-07-16 13:12:18.962 23 INFO octavia.controller.queue.endpoint [req-b093e819-0653-463f-aa64-739d9024a627 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'df103a07-4f7b-4db1-87c3-251a20bcd890'... >2018-07-16 13:12:21.065 23 INFO octavia.controller.queue.endpoint [req-e51a97c5-ddc6-4675-9453-784c499206aa - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cf54b549-e2b2-4094-bbb4-b4ec2a0aba78'... >2018-07-16 13:13:27.779 23 INFO octavia.controller.queue.endpoint [req-30cf600c-3356-4c15-b333-a507c6983591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '198da36d-21f9-4b60-a467-e071004b0f35'... >2018-07-16 13:14:40.224 23 INFO octavia.controller.queue.endpoint [req-02a8ad19-c8d7-4372-b665-43aec25782ee - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '309ea618-5258-48d1-b197-93a53d06a446'... >2018-07-16 13:14:49.864 23 INFO octavia.controller.queue.endpoint [req-d0167495-ffd8-4cce-88db-f8fc2d85133b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e09abc70-356f-4879-8b65-4971d4aeb491'... >2018-07-16 13:14:59.766 23 INFO octavia.controller.queue.endpoint [req-9cbd22d1-55a6-40c1-926f-c70f8c536ef2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2e193ffa-ea4c-414a-9f0c-97c37197a36b'... >2018-07-16 13:27:11.727 23 INFO octavia.controller.queue.endpoint [req-3557d311-5dc1-4bf3-8875-b3b4b52a1d60 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cf54b549-e2b2-4094-bbb4-b4ec2a0aba78'... >2018-07-16 13:27:16.422 23 INFO octavia.controller.queue.endpoint [req-8ea632bd-c4a5-4d0f-902d-31e1f487b470 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '16a1d3c9-3101-4551-abf3-29732f4d2313'... >2018-07-16 13:28:21.074 23 INFO octavia.controller.queue.endpoint [req-b37142af-3822-4732-9603-16b22d58d015 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2e0d6320-e31b-430a-b486-eced9d65a3c9'... >2018-07-16 13:28:22.312 23 INFO octavia.controller.queue.endpoint [req-68c66e5e-16da-4e38-a3d6-ca75eb1dad9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '198da36d-21f9-4b60-a467-e071004b0f35'... >2018-07-16 13:28:24.575 23 INFO octavia.controller.queue.endpoint [req-7cefbd54-f7de-466b-9ff5-a749c995342f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '95999b4d-705c-4a22-9446-d338181fff0a'... >2018-07-16 13:28:25.898 23 INFO octavia.controller.queue.endpoint [req-ea6486a6-8a55-45b5-9825-b3fc276220fe - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '14ea8cc4-ea99-434c-9976-07414717aab9'... >2018-07-16 13:42:18.546 23 INFO octavia.controller.queue.endpoint [req-8397969b-a63d-4904-aa51-e296808b28c1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '16a1d3c9-3101-4551-abf3-29732f4d2313'... >2018-07-16 13:42:26.511 23 INFO octavia.controller.queue.endpoint [req-bf21d363-a295-48cd-b175-7a15193550c0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f894576e-d42d-4d0c-b433-f7d8f3e607d9'... >2018-07-16 13:43:13.931 23 INFO octavia.controller.queue.endpoint [req-31856780-d3b8-4db7-bce3-705c865e71d3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '95999b4d-705c-4a22-9446-d338181fff0a'... >2018-07-16 13:43:20.619 23 INFO octavia.controller.queue.endpoint [req-81fea118-2140-4c95-951b-47fa1f624702 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1229ab58-ef09-4e2b-9941-cb0df1c98e46'... >2018-07-16 13:43:22.017 23 INFO octavia.controller.queue.endpoint [req-c83378e0-7b89-4b13-9561-70fb4b18d6e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '14ea8cc4-ea99-434c-9976-07414717aab9'... >2018-07-16 13:43:27.269 23 INFO octavia.controller.queue.endpoint [req-ec1cf87c-4e2a-4833-97b0-08f37b5f779e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'bafd864a-9490-49de-a908-3ee953fbbf67'... >2018-07-16 13:54:07.463 23 INFO octavia.controller.queue.endpoint [req-c5ee13c0-44f8-444b-9297-562c84ea21ed - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4c7df069-f456-4c6b-bbf8-f7a091e2042c'... >2018-07-16 13:54:13.038 23 INFO octavia.controller.queue.endpoint [req-de4aa8e1-7639-4d35-9544-62dd3088cce7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '71554883-8c34-4462-9501-88b8df8c245f'... >2018-07-16 13:54:13.139 23 INFO octavia.controller.queue.endpoint [req-35bf0e5f-d81d-4067-9c73-341ca6f31525 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '566320e4-bdbd-4dac-bd83-e477616b0867'... >2018-07-16 13:54:23.673 23 INFO octavia.controller.queue.endpoint [req-5355832d-f4b0-496c-9951-5fa302d29478 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '87cfd45b-b893-4c5c-a429-9946a89680a7'... >2018-07-16 13:54:34.141 23 INFO octavia.controller.queue.endpoint [req-22472bbe-9c1a-468e-8196-7e0063106d55 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ac5ad7a5-9d9e-42bf-b1e1-1bd32232fc44'... >2018-07-16 13:54:39.955 23 INFO octavia.controller.queue.endpoint [req-3f0e21c5-ad8f-4cbc-a708-9b4eb55a5c04 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1209b539-9ddc-49a8-890f-1ec8aa502cea'... >2018-07-16 13:54:45.641 23 INFO octavia.controller.queue.endpoint [req-a8e7c714-6c97-4496-aba7-1d82dd51dac7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e1ee7f58-a5c2-449e-a3d8-d6d0db1f6ec1'... >2018-07-16 13:54:51.244 23 INFO octavia.controller.queue.endpoint [req-9b1429f9-d77f-46dd-a783-bccec79f8f73 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'bf82daad-fe3c-4dea-b3d0-59c46225ca57'... >2018-07-16 13:55:21.823 23 INFO octavia.controller.queue.endpoint [req-f3027084-2271-4748-a3bf-bd501699f5e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '22ea3db5-9933-473c-861b-55312c39a4af'... >2018-07-16 13:55:27.479 23 INFO octavia.controller.queue.endpoint [req-7a7f8d42-57f6-4fc5-9775-39a43412141a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1ff50f0e-bbcb-48ed-9397-db3244f7d8b4'... >2018-07-16 13:55:32.855 23 INFO octavia.controller.queue.endpoint [req-03e95270-8134-43a1-b5c0-d0b72cb9d759 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5b59d215-7504-4532-91cc-69279dd8b9a1'... >2018-07-16 13:57:20.770 23 INFO octavia.controller.queue.endpoint [req-9f8303a0-11fb-41ca-babb-d53d9502cf59 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f894576e-d42d-4d0c-b433-f7d8f3e607d9'... >2018-07-16 13:57:25.910 23 INFO octavia.controller.queue.endpoint [req-ed69b801-043e-4786-8bff-69671f3d46bc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '94600b30-da5f-4f73-a30b-1895fdedf12d'... >2018-07-16 13:58:26.021 23 INFO octavia.controller.queue.endpoint [req-d59f76e9-e649-4171-b245-9e43815c9c32 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1229ab58-ef09-4e2b-9941-cb0df1c98e46'... >2018-07-16 13:58:27.678 23 INFO octavia.controller.queue.endpoint [req-7670e30c-ade2-4995-a6d9-9af906ae51a2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '737c0b13-b663-48d2-a53c-70e73833e364'... >2018-07-16 14:12:16.582 23 INFO octavia.controller.queue.endpoint [req-b09b4687-8585-4711-b39f-e98a447a4398 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '94600b30-da5f-4f73-a30b-1895fdedf12d'... >2018-07-16 14:12:18.788 23 INFO octavia.controller.queue.endpoint [req-93fbdea5-6678-426f-aa82-776adc530ac5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'bafd864a-9490-49de-a908-3ee953fbbf67'... >2018-07-16 14:12:20.832 23 INFO octavia.controller.queue.endpoint [req-e7a578b5-af91-4b45-92a0-af972509fb87 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c725dbda-fb6d-4b56-af7a-6e9118b79af5'... >2018-07-16 14:12:22.181 23 INFO octavia.controller.queue.endpoint [req-6d34d9a0-2abe-45bd-8ce7-5482d5e7e700 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e6bb862a-4ebb-42eb-a713-ecdf669d0a48'... >2018-07-16 14:13:22.968 23 INFO octavia.controller.queue.endpoint [req-7183ddaf-d009-4d8a-aea5-90b4ad134da6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '737c0b13-b663-48d2-a53c-70e73833e364'... >2018-07-16 14:13:24.564 23 INFO octavia.controller.queue.endpoint [req-1fdb31b4-9cd8-452a-8975-ab02154ddb31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2ce36a04-4c5f-48ad-855d-e7abe3fa5ff6'... >2018-07-16 14:20:40.510 23 INFO octavia.controller.queue.endpoint [req-1e0bbcf3-740b-4e44-ba50-cdeef183060d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '22ea3db5-9933-473c-861b-55312c39a4af'... >2018-07-16 14:20:49.801 23 INFO octavia.controller.queue.endpoint [req-59a82443-d859-416e-b339-ac02bf893992 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1ff50f0e-bbcb-48ed-9397-db3244f7d8b4'... >2018-07-16 14:20:59.818 23 INFO octavia.controller.queue.endpoint [req-f3440296-918e-49fd-9d5f-716be68cce05 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5b59d215-7504-4532-91cc-69279dd8b9a1'... >2018-07-16 14:27:19.652 23 INFO octavia.controller.queue.endpoint [req-4e0650d1-636f-4788-abef-168debb950c1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e6bb862a-4ebb-42eb-a713-ecdf669d0a48'... >2018-07-16 14:27:24.369 23 INFO octavia.controller.queue.endpoint [req-e5ad4d4a-accb-4afa-ad05-25aca610ee15 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '11741b43-ada4-42bd-9ca6-2f16e5f73798'... >2018-07-16 14:27:25.529 23 INFO octavia.controller.queue.endpoint [req-cc5b55e3-7777-4e72-b785-4fc97cbfd512 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c725dbda-fb6d-4b56-af7a-6e9118b79af5'... >2018-07-16 14:27:28.087 23 INFO octavia.controller.queue.endpoint [req-1c41ee0c-96f7-45cf-93a6-6fb06c382fe1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a6afb21b-8098-4157-bf8c-9465bbdb1826'... >2018-07-16 14:42:20.455 23 INFO octavia.controller.queue.endpoint [req-c1feaee4-cb95-43df-ac8c-9b1cab13f269 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '11741b43-ada4-42bd-9ca6-2f16e5f73798'... >2018-07-16 14:42:22.613 23 INFO octavia.controller.queue.endpoint [req-4cb408e1-6a93-48f6-aacf-2ebfe9b4aeb1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'a6afb21b-8098-4157-bf8c-9465bbdb1826'... >2018-07-16 14:42:28.126 23 INFO octavia.controller.queue.endpoint [req-2b0f5a17-d698-4c9f-820b-aee5dc4f5e7d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'dc5c462c-247d-435c-a1c6-97e117b3744a'... >2018-07-16 14:43:11.742 23 INFO octavia.controller.queue.endpoint [req-91354eb2-6bb7-40b9-a220-fa0b88361cb2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '2ce36a04-4c5f-48ad-855d-e7abe3fa5ff6'... >2018-07-16 14:43:18.236 23 INFO octavia.controller.queue.endpoint [req-c741bd5d-b9cc-4dbf-8266-ebe680ad7b97 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4e1d98f3-9e9a-4134-83a5-eebcd8750ffe'... >2018-07-16 14:51:12.495 23 INFO octavia.controller.queue.endpoint [req-62f355f8-9657-4238-9c82-d6d92b01d13d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1209b539-9ddc-49a8-890f-1ec8aa502cea'... >2018-07-16 14:51:22.050 23 INFO octavia.controller.queue.endpoint [req-576896a4-f404-4ac4-8d9f-1f4795edd5b0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e1ee7f58-a5c2-449e-a3d8-d6d0db1f6ec1'... >2018-07-16 14:51:31.820 23 INFO octavia.controller.queue.endpoint [req-f45e6b62-047b-4111-b8bd-e711a23ad061 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'bf82daad-fe3c-4dea-b3d0-59c46225ca57'... >2018-07-16 14:51:40.958 23 INFO octavia.controller.queue.endpoint [req-c711c2d5-6f2d-48d3-8ebf-18d45d619be5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '71554883-8c34-4462-9501-88b8df8c245f'... >2018-07-16 14:51:46.205 23 INFO octavia.controller.queue.endpoint [req-bdbd18be-bef3-4e4c-9408-9d3d1a1e85a2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5e1209d1-0e97-444c-b8c9-bb9b7225fe06'... >2018-07-16 14:53:52.333 23 INFO octavia.controller.queue.endpoint [req-97283283-fc69-4b84-bf9b-72206fb5e972 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '942383f6-bde8-430f-9638-33f22be0fee8'... >2018-07-16 14:53:58.179 23 INFO octavia.controller.queue.endpoint [req-3bb34467-4557-4b91-94ce-8ae9322d570a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b9cde06f-8212-45fb-ab89-560d68d4754b'... >2018-07-16 14:54:03.310 23 INFO octavia.controller.queue.endpoint [req-dd3cff98-acac-4166-9ef4-78f6e8890fef - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '38b99585-7f66-43e8-a018-2b1f78cbda36'... >2018-07-16 14:57:17.938 23 INFO octavia.controller.queue.endpoint [req-67deeb7c-54b5-44a3-996e-2b5741dca4ca - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'dc5c462c-247d-435c-a1c6-97e117b3744a'... >2018-07-16 14:57:20.640 23 INFO octavia.controller.queue.endpoint [req-2dc30901-4fe4-4947-a7f9-ff992436e37f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4d582b7d-5d94-4be0-be07-51232c3f0204'... >2018-07-16 14:57:26.745 23 INFO octavia.controller.queue.endpoint [req-492dd297-0ae4-4217-8051-0061e9ca3e7b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '29df23c6-7d29-4aeb-9e65-73e7622c2cd0'... >2018-07-16 15:12:16.394 23 INFO octavia.controller.queue.endpoint [req-87cbff20-2689-46a9-9de3-8b098a77babd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '29df23c6-7d29-4aeb-9e65-73e7622c2cd0'... >2018-07-16 15:12:18.677 23 INFO octavia.controller.queue.endpoint [req-f55e8bd7-f868-4550-859d-4941df9f9dee - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4e1d98f3-9e9a-4134-83a5-eebcd8750ffe'... >2018-07-16 15:12:23.556 23 INFO octavia.controller.queue.endpoint [req-5f45ac73-7eb9-4b8e-8cb1-a235106d5018 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1742b97c-035b-4cad-9af9-81fe1504ff32'... >2018-07-16 15:12:34.520 23 INFO octavia.controller.queue.endpoint [req-32287428-e493-4e08-9ad1-9a7e4ae82fe2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4d582b7d-5d94-4be0-be07-51232c3f0204'... >2018-07-16 15:18:26.610 23 INFO octavia.controller.queue.endpoint [req-6cce2774-4e9f-44e1-a915-ff838c04a137 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'b19a300b-a4ca-4bbb-9514-c9c0dfa83bd3'... >2018-07-16 15:18:28.401 23 INFO octavia.controller.queue.endpoint [req-38b8c116-d537-4b37-b3e1-814c1ba0b76c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'ae593c7c-1d58-4379-a810-87bd395fd9a0'... >2018-07-16 15:18:29.635 23 INFO octavia.controller.queue.endpoint [req-e9340102-d4fd-4a5f-85b7-eec7bf3e1408 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '61d640ca-45d1-4941-80a5-25feee424896'... >2018-07-16 15:18:29.996 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-6cce2774-4e9f-44e1-a915-ff838c04a137 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 26bbebe3-3765-4a72-b17e-97fdddf9bcdc from port 9fad7d98-b803-40d4-8ab8-4a12696153d1 >2018-07-16 15:18:30.836 23 INFO octavia.controller.queue.endpoint [req-bf0597a5-afc6-4109-a1fd-c895ce268806 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '00ee6184-17f2-4b2e-b117-6d3cda065b03'... >2018-07-16 15:18:31.004 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-38b8c116-d537-4b37-b3e1-814c1ba0b76c - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group f7db09f4-6f20-4d6a-8db9-0b091953a80f from port 5d4e8671-6a1a-492e-b7d7-004c687d1d0f >2018-07-16 15:18:31.064 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-6cce2774-4e9f-44e1-a915-ff838c04a137 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 26bbebe3-3765-4a72-b17e-97fdddf9bcdc >2018-07-16 15:18:32.021 23 INFO octavia.controller.queue.endpoint [req-275aaf2a-4da1-4870-b7ca-37487dd15cb5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'e86f0eed-de6b-4be0-9e48-7aa60ddeeb06'... >2018-07-16 15:18:32.202 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-38b8c116-d537-4b37-b3e1-814c1ba0b76c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group f7db09f4-6f20-4d6a-8db9-0b091953a80f >2018-07-16 15:18:32.448 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-e9340102-d4fd-4a5f-85b7-eec7bf3e1408 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group a9dffc6e-0f1b-4dd2-83d1-20ecc8f15c64 from port 0f71f14d-e106-4e77-8b33-e2a52c78fb10 >2018-07-16 15:18:33.245 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-e9340102-d4fd-4a5f-85b7-eec7bf3e1408 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group a9dffc6e-0f1b-4dd2-83d1-20ecc8f15c64 >2018-07-16 15:18:34.122 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-275aaf2a-4da1-4870-b7ca-37487dd15cb5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group a81014fd-06c9-4295-a307-52d720249501 from port 0beaf0ae-ee13-4275-8c2d-789f0b352108 >2018-07-16 15:18:34.670 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-bf0597a5-afc6-4109-a1fd-c895ce268806 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 16691710-00b2-439e-82f5-c8cebd1fb724 from port e282a962-59db-4640-8998-24ede3758afe >2018-07-16 15:18:34.891 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-275aaf2a-4da1-4870-b7ca-37487dd15cb5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group a81014fd-06c9-4295-a307-52d720249501 >2018-07-16 15:18:35.567 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-bf0597a5-afc6-4109-a1fd-c895ce268806 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 16691710-00b2-439e-82f5-c8cebd1fb724 >2018-07-16 15:19:17.435 23 INFO octavia.controller.queue.endpoint [req-aee47d52-daa8-4c6c-89c7-63ea0b9a7e19 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'e5e39a70-5ce5-43a8-8407-3bc98ccfdb64'... >2018-07-16 15:19:19.501 23 INFO octavia.controller.worker.tasks.database_tasks [req-aee47d52-daa8-4c6c-89c7-63ea0b9a7e19 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 705f8c70-413f-46a8-b633-d37bb7d200c6 >2018-07-16 15:19:19.612 23 INFO octavia.controller.queue.endpoint [req-275aaf2a-4da1-4870-b7ca-37487dd15cb5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '460b7f03-d357-4adc-9743-60ae0215e993'... >2018-07-16 15:19:20.562 23 INFO octavia.controller.worker.tasks.database_tasks [req-275aaf2a-4da1-4870-b7ca-37487dd15cb5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 705f8c70-413f-46a8-b633-d37bb7d200c6 >2018-07-16 15:19:20.951 23 INFO octavia.controller.queue.endpoint [req-38b8c116-d537-4b37-b3e1-814c1ba0b76c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'aefb591b-8408-4bc4-bf03-27eea6c3af42'... >2018-07-16 15:19:21.896 23 INFO octavia.controller.queue.endpoint [req-4da09c53-ded2-4ca8-b7f3-b8784c290e5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '3fe040a3-dfc8-45be-ad8d-b1c7b6d62e41'... >2018-07-16 15:19:23.130 23 INFO octavia.controller.queue.endpoint [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cfb48170-f511-4c75-8b8b-348b51fdbd66'... >2018-07-16 15:19:35.810 23 INFO octavia.controller.queue.endpoint [req-4da09c53-ded2-4ca8-b7f3-b8784c290e5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool '35ac9d79-499e-43ee-98fc-b88f7202db55'... >2018-07-16 15:19:36.948 23 INFO octavia.controller.queue.endpoint [req-296e3546-cb2b-491b-86b6-f6ba900893d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '705f8c70-413f-46a8-b633-d37bb7d200c6'... >2018-07-16 15:19:39.692 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-296e3546-cb2b-491b-86b6-f6ba900893d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group c17e168c-5e49-495c-87ed-b89a02536730 from port 015ace02-d8d1-4652-a8c2-91f3881a80d3 >2018-07-16 15:19:40.416 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-296e3546-cb2b-491b-86b6-f6ba900893d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group c17e168c-5e49-495c-87ed-b89a02536730 >2018-07-16 15:21:22.049 23 INFO octavia.controller.queue.endpoint [req-b40a8be7-cf7a-4d46-9eac-3cbc3de7f8fe - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'e85e0527-55a2-4bf5-97d4-4774abd2926f'... >2018-07-16 15:21:22.184 23 INFO octavia.controller.worker.tasks.database_tasks [req-b40a8be7-cf7a-4d46-9eac-3cbc3de7f8fe - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id d0b5c1a2-6938-4383-9652-6a0114b34a68 >2018-07-16 15:21:22.220 23 INFO octavia.certificates.generator.local [req-b40a8be7-cf7a-4d46-9eac-3cbc3de7f8fe - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 15:21:22.220 23 INFO octavia.certificates.generator.local [req-b40a8be7-cf7a-4d46-9eac-3cbc3de7f8fe - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 15:21:22.220 23 INFO octavia.certificates.generator.local [req-b40a8be7-cf7a-4d46-9eac-3cbc3de7f8fe - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 15:21:22.221 23 INFO octavia.certificates.generator.local [req-b40a8be7-cf7a-4d46-9eac-3cbc3de7f8fe - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 15:21:35.743 23 INFO octavia.controller.worker.tasks.database_tasks [req-b40a8be7-cf7a-4d46-9eac-3cbc3de7f8fe - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: d0b5c1a2-6938-4383-9652-6a0114b34a68 with compute id 817f15d3-9af8-49ce-87cf-fdf99f3e7d82 for load balancer: e85e0527-55a2-4bf5-97d4-4774abd2926f >2018-07-16 15:21:35.847 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b40a8be7-cf7a-4d46-9eac-3cbc3de7f8fe - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 4174f4e3-46ab-4546-854c-c968d6d4067c already exists. Nothing to be done. >2018-07-16 15:21:52.980 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-b40a8be7-cf7a-4d46-9eac-3cbc3de7f8fe - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.3', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.0.1 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47002cc090>, 'Connection to 172.24.0.3 timed out. (connect timeout=10.0)')) >2018-07-16 15:22:02.555 23 INFO octavia.controller.worker.tasks.database_tasks [req-b40a8be7-cf7a-4d46-9eac-3cbc3de7f8fe - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: e85e0527-55a2-4bf5-97d4-4774abd2926f >2018-07-16 15:22:03.397 23 INFO octavia.controller.queue.endpoint [req-ecad9e91-17bb-4f6a-b400-88f4ab96e759 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '516771b0-2fa8-4e3e-ac04-05ba92cc57c7'... >2018-07-16 15:22:04.971 23 INFO octavia.controller.queue.endpoint [req-d40bbe99-7e28-4796-bb33-16b99c7e4c2c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '935a9252-8ab8-4aa8-a264-0f6d71481c9d'... >2018-07-16 15:22:06.205 23 INFO octavia.controller.queue.endpoint [req-1ff96a7a-886b-41b2-ac42-3c3bfc04d6ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '5e18ea2a-a570-4fc7-956a-e4947c88fa71'... >2018-07-16 15:22:27.538 23 INFO octavia.controller.queue.endpoint [req-aee47d52-daa8-4c6c-89c7-63ea0b9a7e19 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f3a4bf5e-c536-4f5d-a4c0-4279fcfa7b66'... >2018-07-16 15:22:29.902 23 INFO octavia.controller.queue.endpoint [req-4da09c53-ded2-4ca8-b7f3-b8784c290e5a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '29606af6-b70e-4a38-9a3b-5fdd57067400'... >2018-07-16 15:22:30.656 23 INFO octavia.controller.queue.endpoint [req-22769cbc-491c-4a0c-8715-917103e4b668 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ad2a6db2-656b-4f28-a43c-4435ff6d75f7'... >2018-07-16 15:49:59.057 23 INFO octavia.controller.queue.endpoint [req-4250c5bd-6f60-4e89-8d11-dadee2555fcf - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'ad49c84b-c318-4468-8d17-81b53781f95a'... >2018-07-16 15:49:59.175 23 INFO octavia.controller.worker.tasks.database_tasks [req-4250c5bd-6f60-4e89-8d11-dadee2555fcf - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 5235fb37-1b1e-4057-8f35-80e6a0a39476 >2018-07-16 15:49:59.327 23 INFO octavia.certificates.generator.local [req-4250c5bd-6f60-4e89-8d11-dadee2555fcf - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 15:49:59.328 23 INFO octavia.certificates.generator.local [req-4250c5bd-6f60-4e89-8d11-dadee2555fcf - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 15:49:59.329 23 INFO octavia.certificates.generator.local [req-4250c5bd-6f60-4e89-8d11-dadee2555fcf - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 15:49:59.329 23 INFO octavia.certificates.generator.local [req-4250c5bd-6f60-4e89-8d11-dadee2555fcf - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 15:50:04.284 23 INFO octavia.controller.queue.endpoint [req-5e52cc3b-bfd6-433e-a65c-f7e631ba6114 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'c0e97665-b905-442a-a6d2-22fc358ed12a'... >2018-07-16 15:50:04.423 23 INFO octavia.controller.worker.tasks.database_tasks [req-5e52cc3b-bfd6-433e-a65c-f7e631ba6114 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 1888b477-14e3-4bc8-abf4-b01c99ce45e6 >2018-07-16 15:50:04.491 23 INFO octavia.certificates.generator.local [req-5e52cc3b-bfd6-433e-a65c-f7e631ba6114 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 15:50:04.492 23 INFO octavia.certificates.generator.local [req-5e52cc3b-bfd6-433e-a65c-f7e631ba6114 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 15:50:04.492 23 INFO octavia.certificates.generator.local [req-5e52cc3b-bfd6-433e-a65c-f7e631ba6114 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 15:50:04.493 23 INFO octavia.certificates.generator.local [req-5e52cc3b-bfd6-433e-a65c-f7e631ba6114 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 15:50:05.493 23 INFO octavia.controller.queue.endpoint [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '90280e1a-f3a3-435e-b51a-0c7c34701447'... >2018-07-16 15:50:05.659 23 INFO octavia.controller.worker.tasks.database_tasks [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id d38ac01c-9608-43b9-9af7-6766e17968ec >2018-07-16 15:50:05.876 23 INFO octavia.certificates.generator.local [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 15:50:05.876 23 INFO octavia.certificates.generator.local [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 15:50:05.877 23 INFO octavia.certificates.generator.local [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 15:50:05.877 23 INFO octavia.certificates.generator.local [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 15:50:12.059 23 INFO octavia.controller.worker.tasks.database_tasks [req-4250c5bd-6f60-4e89-8d11-dadee2555fcf - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 5235fb37-1b1e-4057-8f35-80e6a0a39476 with compute id f994030d-0236-446f-b458-a7c9a506ac56 for load balancer: ad49c84b-c318-4468-8d17-81b53781f95a >2018-07-16 15:50:12.391 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-4250c5bd-6f60-4e89-8d11-dadee2555fcf - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 275af68e-4ce3-49f3-85ae-db180d2ef8de already exists. Nothing to be done. >2018-07-16 15:50:16.976 23 INFO octavia.controller.worker.tasks.database_tasks [req-5e52cc3b-bfd6-433e-a65c-f7e631ba6114 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 1888b477-14e3-4bc8-abf4-b01c99ce45e6 with compute id 44a93759-5257-4c49-b7c2-cf6a74e0e81b for load balancer: c0e97665-b905-442a-a6d2-22fc358ed12a >2018-07-16 15:50:17.811 23 INFO octavia.controller.worker.tasks.database_tasks [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: d38ac01c-9608-43b9-9af7-6766e17968ec with compute id 7b2601d2-d31f-4275-b050-1ed35d10a40f for load balancer: 90280e1a-f3a3-435e-b51a-0c7c34701447 >2018-07-16 15:50:18.637 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-5e52cc3b-bfd6-433e-a65c-f7e631ba6114 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port d72863be-74a9-4658-829d-96e7f8f4fe97 already exists. Nothing to be done. >2018-07-16 15:50:19.165 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port db142026-bc3c-4a19-996b-a2e7aeec8f87 already exists. Nothing to be done. >2018-07-16 15:50:28.220 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-4250c5bd-6f60-4e89-8d11-dadee2555fcf - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.9', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.37.192 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47080826d0>, 'Connection to 172.24.0.9 timed out. (connect timeout=10.0)')) >2018-07-16 15:50:37.828 23 INFO octavia.controller.worker.tasks.database_tasks [req-4250c5bd-6f60-4e89-8d11-dadee2555fcf - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: ad49c84b-c318-4468-8d17-81b53781f95a >2018-07-16 15:50:38.338 23 INFO octavia.controller.worker.tasks.database_tasks [req-5e52cc3b-bfd6-433e-a65c-f7e631ba6114 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: c0e97665-b905-442a-a6d2-22fc358ed12a >2018-07-16 15:50:39.729 23 INFO octavia.controller.worker.tasks.database_tasks [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 90280e1a-f3a3-435e-b51a-0c7c34701447 >2018-07-16 15:50:43.540 23 INFO octavia.controller.queue.endpoint [req-7b12de82-c349-4b70-9ca9-1d9684c38048 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'a37257b6-aad1-470d-a065-aa9ab3371203'... >2018-07-16 15:50:45.632 23 INFO octavia.controller.queue.endpoint [req-8a9db3c5-c6f8-4533-8a5f-32ff061b410b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'a9067532-d04a-4052-9cee-8bf11b23e092'... >2018-07-16 15:50:49.467 23 INFO octavia.controller.queue.endpoint [req-b070c6e3-f4aa-4c32-b2d5-0c51eb40c0ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'ad5c937a-6194-4181-b339-e78d17849aae'... >2018-07-16 15:50:49.586 23 INFO octavia.controller.worker.tasks.database_tasks [req-b070c6e3-f4aa-4c32-b2d5-0c51eb40c0ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 2ec3b21b-c5df-4f48-aa06-ca025806d0be >2018-07-16 15:50:49.643 23 INFO octavia.certificates.generator.local [req-b070c6e3-f4aa-4c32-b2d5-0c51eb40c0ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 15:50:49.644 23 INFO octavia.certificates.generator.local [req-b070c6e3-f4aa-4c32-b2d5-0c51eb40c0ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 15:50:49.644 23 INFO octavia.certificates.generator.local [req-b070c6e3-f4aa-4c32-b2d5-0c51eb40c0ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 15:50:49.644 23 INFO octavia.certificates.generator.local [req-b070c6e3-f4aa-4c32-b2d5-0c51eb40c0ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 15:50:50.620 23 INFO octavia.controller.queue.endpoint [req-ecad9e91-17bb-4f6a-b400-88f4ab96e759 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '668187eb-be49-49ab-9391-619e457aebb0'... >2018-07-16 15:50:50.752 23 INFO octavia.controller.worker.tasks.database_tasks [req-ecad9e91-17bb-4f6a-b400-88f4ab96e759 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 4b691a71-c938-4cde-92cb-389a12984b07 >2018-07-16 15:50:50.776 23 INFO octavia.controller.queue.endpoint [req-b40a8be7-cf7a-4d46-9eac-3cbc3de7f8fe - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '3d0b6d2d-3739-4431-a1f2-a3803ae9a259'... >2018-07-16 15:50:50.893 23 INFO octavia.controller.queue.endpoint [req-ce635437-3676-4958-902d-9d1703cf8799 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'b62e3020-7506-48c5-8ba3-9ea9f03d49b5'... >2018-07-16 15:50:50.900 23 INFO octavia.certificates.generator.local [req-ecad9e91-17bb-4f6a-b400-88f4ab96e759 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 15:50:50.902 23 INFO octavia.certificates.generator.local [req-ecad9e91-17bb-4f6a-b400-88f4ab96e759 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 15:50:50.902 23 INFO octavia.certificates.generator.local [req-ecad9e91-17bb-4f6a-b400-88f4ab96e759 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 15:50:50.903 23 INFO octavia.certificates.generator.local [req-ecad9e91-17bb-4f6a-b400-88f4ab96e759 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 15:50:52.752 23 INFO octavia.controller.queue.endpoint [req-275aaf2a-4da1-4870-b7ca-37487dd15cb5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '31f3faa9-3a06-485e-a2e8-00018ad77371'... >2018-07-16 15:50:55.957 23 INFO octavia.controller.queue.endpoint [req-0e08073a-ebf7-4439-bc12-3bd6dcf4d5d6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'fd9cdda4-8f5e-4b52-a46f-36478de2790a'... >2018-07-16 15:50:56.245 23 INFO octavia.controller.queue.endpoint [req-fde0ec97-0e2f-4f4c-93e7-cf2c6a89ad6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b89d2c38-e08e-43ec-a6ae-f520250386bb'... >2018-07-16 15:50:57.562 23 INFO octavia.controller.queue.endpoint [req-4d58a31e-1405-4ed6-bf1d-a44313ee9142 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '07d4649a-6ef7-4ce2-a335-4157d77c0cd1'... >2018-07-16 15:50:58.045 23 INFO octavia.controller.queue.endpoint [req-f87e0b83-8641-480a-9a32-b019677d1360 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'c2cfb1a3-4860-41e7-a83e-a9094077d41d'... >2018-07-16 15:51:00.990 23 INFO octavia.controller.queue.endpoint [req-e0c23b46-b208-4d8e-afb0-13e1785d5f8a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'fd4d6229-37ce-409f-a22b-2181b2555e75'... >2018-07-16 15:51:01.348 23 INFO octavia.controller.worker.tasks.database_tasks [req-b070c6e3-f4aa-4c32-b2d5-0c51eb40c0ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 2ec3b21b-c5df-4f48-aa06-ca025806d0be with compute id 67369a89-5777-4bb7-b65d-899429bf9084 for load balancer: ad5c937a-6194-4181-b339-e78d17849aae >2018-07-16 15:51:01.449 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-b070c6e3-f4aa-4c32-b2d5-0c51eb40c0ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 654b9509-927b-407f-b37b-6ade01f39256 already exists. Nothing to be done. >2018-07-16 15:51:02.416 23 INFO octavia.controller.queue.endpoint [req-d7aa1024-a916-492d-8b90-0c76d9a58f42 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '534ecab7-c1b6-49a1-9260-6427a91d6f4a'... >2018-07-16 15:51:02.561 23 INFO octavia.controller.worker.tasks.database_tasks [req-ecad9e91-17bb-4f6a-b400-88f4ab96e759 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 4b691a71-c938-4cde-92cb-389a12984b07 with compute id 3954215f-18a7-4733-8c67-f50ce4efcb84 for load balancer: 668187eb-be49-49ab-9391-619e457aebb0 >2018-07-16 15:51:02.808 23 INFO octavia.controller.queue.endpoint [req-4250c5bd-6f60-4e89-8d11-dadee2555fcf - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a55a7410-c4e0-4634-9a1d-15cdad0fc9f8'... >2018-07-16 15:51:02.954 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-ecad9e91-17bb-4f6a-b400-88f4ab96e759 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 43164e77-1b39-4f3e-9c18-38d4fc5fabd4 already exists. Nothing to be done. >2018-07-16 15:51:06.118 23 INFO octavia.controller.queue.endpoint [req-25ef9d4c-6bca-4fa6-9398-3881381f0fa7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'aa651d99-605b-41f9-8e45-6be3a128f552'... >2018-07-16 15:51:11.304 23 INFO octavia.controller.queue.endpoint [req-f38567f6-647f-4780-8cf8-c49a71d5ae2c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'b65406e4-7a89-49dd-9d19-eb02cdcf7335'... >2018-07-16 15:51:16.467 23 INFO octavia.controller.queue.endpoint [req-6c3e9614-6154-4d95-b070-4277e08ad3ed - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '23b53618-e944-4824-979a-e5dbb300f48a'... >2018-07-16 15:51:19.404 23 INFO octavia.controller.worker.tasks.database_tasks [req-b070c6e3-f4aa-4c32-b2d5-0c51eb40c0ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: ad5c937a-6194-4181-b339-e78d17849aae >2018-07-16 15:51:21.139 23 INFO octavia.controller.queue.endpoint [req-ce1e842a-6d29-4079-b075-8684e9e80f74 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '26b30295-b556-4ca4-a272-006327043954'... >2018-07-16 15:51:21.284 23 INFO octavia.controller.worker.tasks.database_tasks [req-ecad9e91-17bb-4f6a-b400-88f4ab96e759 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 668187eb-be49-49ab-9391-619e457aebb0 >2018-07-16 15:51:26.509 23 INFO octavia.controller.queue.endpoint [req-63f1986f-9c34-4e6d-ab14-e1e5e921649a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '11cc1db8-e1c1-4407-a0c6-1993e4fcb57a'... >2018-07-16 15:51:27.908 23 INFO octavia.controller.queue.endpoint [req-5930a11e-9d36-4151-a997-e5141c0d4327 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '204d8191-f5cb-4e19-80e0-6993f26c4505'... >2018-07-16 15:51:28.868 23 INFO octavia.controller.queue.endpoint [req-507efd49-8bb9-463e-adb7-c39e92d4c981 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '04d2c2b5-fc14-41dc-b003-82f1cec72d38'... >2018-07-16 15:51:30.624 23 INFO octavia.controller.queue.endpoint [req-6bd12e30-31ac-4a42-b143-dee57cf3f68c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'ddad4326-ca1e-4402-b2a5-a28004750c95'... >2018-07-16 15:51:33.316 23 INFO octavia.controller.queue.endpoint [req-ecad9e91-17bb-4f6a-b400-88f4ab96e759 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2e5d3615-e98d-4f56-894d-6334af1bf073'... >2018-07-16 15:51:33.709 23 INFO octavia.controller.queue.endpoint [req-dcfdc44f-5781-47c8-850c-63dae2cefe3c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '3cf0b59c-d3f9-4c3f-a621-d28dfeb7d38f'... >2018-07-16 15:51:35.204 23 INFO octavia.controller.queue.endpoint [req-9bfcaa7e-cd9f-43da-95ab-1b5a18987b6a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '99b4c6f6-1aca-41aa-b655-a3ec7d86e39c'... >2018-07-16 15:51:38.511 23 INFO octavia.controller.queue.endpoint [req-1d41618e-4351-4d71-b5f0-416dfaa118b6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '40be4587-679f-44a3-b7a3-2f0d2a658b95'... >2018-07-16 15:51:38.952 23 INFO octavia.controller.queue.endpoint [req-305deb37-6959-4a7f-91de-31370504828f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '34eb5dfc-b3ce-4861-9eb3-ce79bc0f5455'... >2018-07-16 15:51:40.306 23 INFO octavia.controller.queue.endpoint [req-824934c7-b4a9-4c83-be16-711872cf5b32 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1d4674f7-1f04-4eb9-a097-11a7dec6ab7b'... >2018-07-16 15:51:40.537 23 INFO octavia.controller.queue.endpoint [req-bf0597a5-afc6-4109-a1fd-c895ce268806 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '92627274-0084-475e-a05f-4b39b128bede'... >2018-07-16 15:51:41.849 23 INFO octavia.controller.queue.endpoint [req-39536838-ff3d-4705-a8de-c6437f4f2513 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4de8aa73-dff1-4138-9e7f-72ec28f694cb'... >2018-07-16 15:51:47.592 23 INFO octavia.controller.queue.endpoint [req-2159168d-443f-40a2-a59d-e70910c001a3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5a364dc6-a4e8-40b8-8550-cf1ae3e2d8e0'... >2018-07-16 15:51:47.794 23 INFO octavia.controller.queue.endpoint [req-4abdf179-4911-49e8-a9ad-a3e9ae97b04c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '526f1cd6-2cba-466e-81f3-8bc5c97c0a92'... >2018-07-16 16:12:51.005 23 INFO octavia.controller.queue.endpoint [req-093f62f0-0148-4319-afa2-146d2145b239 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'ad49c84b-c318-4468-8d17-81b53781f95a'... >2018-07-16 16:12:52.742 23 INFO octavia.controller.queue.endpoint [req-19f9dcf3-457f-42c8-a1e4-cce6f0d06897 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '90280e1a-f3a3-435e-b51a-0c7c34701447'... >2018-07-16 16:12:53.887 23 INFO octavia.controller.queue.endpoint [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'ad5c937a-6194-4181-b339-e78d17849aae'... >2018-07-16 16:12:54.308 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-093f62f0-0148-4319-afa2-146d2145b239 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group aee127ad-828a-4c33-8d12-12341a892180 from port 275af68e-4ce3-49f3-85ae-db180d2ef8de >2018-07-16 16:12:55.191 23 INFO octavia.controller.queue.endpoint [req-fea62260-67ce-447e-9a5d-1676a13e4b44 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '668187eb-be49-49ab-9391-619e457aebb0'... >2018-07-16 16:12:55.482 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-093f62f0-0148-4319-afa2-146d2145b239 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group aee127ad-828a-4c33-8d12-12341a892180 >2018-07-16 16:12:55.976 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-19f9dcf3-457f-42c8-a1e4-cce6f0d06897 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 55df8fbd-072a-4967-9fd1-a6a746f5f92a from port db142026-bc3c-4a19-996b-a2e7aeec8f87 >2018-07-16 16:12:56.465 23 INFO octavia.controller.queue.endpoint [req-fb229871-d21d-407e-9d97-33c0e0c74420 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'c0e97665-b905-442a-a6d2-22fc358ed12a'... >2018-07-16 16:12:56.753 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-19f9dcf3-457f-42c8-a1e4-cce6f0d06897 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 55df8fbd-072a-4967-9fd1-a6a746f5f92a >2018-07-16 16:12:57.814 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 15cdf772-a4cc-46d0-b583-0d0e9d5bb84d from port 654b9509-927b-407f-b37b-6ade01f39256 >2018-07-16 16:12:57.980 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-fea62260-67ce-447e-9a5d-1676a13e4b44 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 6ecbb09c-5cd3-4223-b26b-5f1010c8f622 from port 43164e77-1b39-4f3e-9c18-38d4fc5fabd4 >2018-07-16 16:12:58.621 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 15cdf772-a4cc-46d0-b583-0d0e9d5bb84d >2018-07-16 16:12:58.774 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-fea62260-67ce-447e-9a5d-1676a13e4b44 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 6ecbb09c-5cd3-4223-b26b-5f1010c8f622 >2018-07-16 16:12:59.888 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-fb229871-d21d-407e-9d97-33c0e0c74420 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 25b9dd18-599e-4048-8577-d95c1ea84955 from port d72863be-74a9-4658-829d-96e7f8f4fe97 >2018-07-16 16:13:01.259 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-fb229871-d21d-407e-9d97-33c0e0c74420 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 25b9dd18-599e-4048-8577-d95c1ea84955 >2018-07-16 16:13:34.927 23 INFO octavia.controller.queue.endpoint [req-093f62f0-0148-4319-afa2-146d2145b239 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f3a4bf5e-c536-4f5d-a4c0-4279fcfa7b66'... >2018-07-16 16:13:36.905 23 INFO octavia.controller.queue.endpoint [req-f307f647-8a1c-4e6d-afad-caf0690d315b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'ad2a6db2-656b-4f28-a43c-4435ff6d75f7'... >2018-07-16 16:13:37.914 23 INFO octavia.controller.queue.endpoint [req-fb229871-d21d-407e-9d97-33c0e0c74420 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '29606af6-b70e-4a38-9a3b-5fdd57067400'... >2018-07-16 16:13:38.493 23 INFO octavia.controller.queue.endpoint [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '935a9252-8ab8-4aa8-a264-0f6d71481c9d'... >2018-07-16 16:14:25.736 23 INFO octavia.controller.worker.tasks.database_tasks [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: e85e0527-55a2-4bf5-97d4-4774abd2926f >2018-07-16 16:14:26.743 23 INFO octavia.controller.queue.endpoint [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '5e18ea2a-a570-4fc7-956a-e4947c88fa71'... >2018-07-16 16:14:27.198 23 INFO octavia.controller.worker.tasks.database_tasks [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: e85e0527-55a2-4bf5-97d4-4774abd2926f >2018-07-16 16:14:27.919 23 INFO octavia.controller.queue.endpoint [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool '516771b0-2fa8-4e3e-ac04-05ba92cc57c7'... >2018-07-16 16:14:29.095 23 INFO octavia.controller.queue.endpoint [req-14e2523c-aa25-47ff-9f2a-636d8e4c0f9c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'e85e0527-55a2-4bf5-97d4-4774abd2926f'... >2018-07-16 16:14:31.111 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-14e2523c-aa25-47ff-9f2a-636d8e4c0f9c - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 41b00113-94b6-4e85-a035-c7fbfdf10e51 from port 4174f4e3-46ab-4546-854c-c968d6d4067c >2018-07-16 16:14:31.983 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-14e2523c-aa25-47ff-9f2a-636d8e4c0f9c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 41b00113-94b6-4e85-a035-c7fbfdf10e51 >2018-07-16 16:18:40.472 23 INFO octavia.controller.queue.endpoint [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '345f7e8a-232d-4059-bb4e-356a628901a0'... >2018-07-16 16:18:40.596 23 INFO octavia.controller.worker.tasks.database_tasks [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 17fe9a1f-3558-494c-8a47-f2cc3d715aea >2018-07-16 16:18:40.829 23 INFO octavia.certificates.generator.local [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 16:18:40.829 23 INFO octavia.certificates.generator.local [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 16:18:40.830 23 INFO octavia.certificates.generator.local [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 16:18:40.830 23 INFO octavia.certificates.generator.local [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 16:18:55.708 23 INFO octavia.controller.worker.tasks.database_tasks [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 17fe9a1f-3558-494c-8a47-f2cc3d715aea with compute id ade4fb7f-7d58-4df5-aab7-c08ab8350fe6 for load balancer: 345f7e8a-232d-4059-bb4e-356a628901a0 >2018-07-16 16:18:56.078 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 143e01db-73ab-455a-8749-1c0745109968 already exists. Nothing to be done. >2018-07-16 16:19:16.957 23 INFO octavia.controller.worker.tasks.database_tasks [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 345f7e8a-232d-4059-bb4e-356a628901a0 >2018-07-16 16:19:17.667 23 INFO octavia.controller.queue.endpoint [req-4dd6c3bc-d67a-4e9b-850a-c939bae54ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'b6a986f5-7b0d-46d6-936c-66dac05375de'... >2018-07-16 16:19:19.232 23 INFO octavia.controller.queue.endpoint [req-90fcc709-610f-40fa-a0c7-bed7c2754679 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '65665ab6-34d7-4f4c-aa6e-eabe0e845b06'... >2018-07-16 16:19:20.430 23 INFO octavia.controller.queue.endpoint [req-ee6d4d8e-b6bb-4391-b158-cdaf57554c07 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'a4abbcbf-ae82-4a7b-8e15-b045299d1261'... >2018-07-16 16:19:45.666 23 INFO octavia.controller.queue.endpoint [req-c7a70755-5616-420a-a661-5a6459135ecd - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e41458fd-6d01-43b3-9144-e2b70e72c5a3'... >2018-07-16 16:19:47.533 23 INFO octavia.controller.queue.endpoint [req-99faf8ed-7e06-4767-b636-be8e62225e95 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'cccb4048-c8e5-4461-8285-1369dbbb2738'... >2018-07-16 16:19:49.000 23 INFO octavia.controller.queue.endpoint [req-03e869a4-a1e4-490e-ad63-16243623270a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f808945d-0beb-4ebf-ad73-4e7b20a52d2d'... >2018-07-16 17:51:30.403 23 INFO octavia.controller.queue.endpoint [req-14e2523c-aa25-47ff-9f2a-636d8e4c0f9c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'a4abbcbf-ae82-4a7b-8e15-b045299d1261'... >2018-07-16 17:51:34.703 23 INFO octavia.controller.worker.tasks.database_tasks [req-14e2523c-aa25-47ff-9f2a-636d8e4c0f9c - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 345f7e8a-232d-4059-bb4e-356a628901a0 >2018-07-16 17:51:35.748 23 INFO octavia.controller.queue.endpoint [req-55d210df-3af0-4937-97e3-6dbde7661d3a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '65665ab6-34d7-4f4c-aa6e-eabe0e845b06'... >2018-07-16 17:51:36.315 23 INFO octavia.controller.worker.tasks.database_tasks [req-55d210df-3af0-4937-97e3-6dbde7661d3a - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 345f7e8a-232d-4059-bb4e-356a628901a0 >2018-07-16 17:51:36.966 23 INFO octavia.controller.queue.endpoint [req-d3c441a5-c426-4f98-9300-de4077ab0b13 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f808945d-0beb-4ebf-ad73-4e7b20a52d2d'... >2018-07-16 17:51:38.848 23 INFO octavia.controller.queue.endpoint [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e41458fd-6d01-43b3-9144-e2b70e72c5a3'... >2018-07-16 17:51:39.056 23 INFO octavia.controller.queue.endpoint [req-d3c441a5-c426-4f98-9300-de4077ab0b13 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'cccb4048-c8e5-4461-8285-1369dbbb2738'... >2018-07-16 17:51:51.628 23 INFO octavia.controller.queue.endpoint [req-14e2523c-aa25-47ff-9f2a-636d8e4c0f9c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool 'b6a986f5-7b0d-46d6-936c-66dac05375de'... >2018-07-16 17:51:52.808 23 INFO octavia.controller.queue.endpoint [req-70f77a6f-d455-4f80-9ff6-0ffe8257061a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '345f7e8a-232d-4059-bb4e-356a628901a0'... >2018-07-16 17:51:55.962 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-70f77a6f-d455-4f80-9ff6-0ffe8257061a - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group fa7b4181-ea79-4322-aa7f-8f50d51e4f29 from port 143e01db-73ab-455a-8749-1c0745109968 >2018-07-16 17:51:56.828 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-70f77a6f-d455-4f80-9ff6-0ffe8257061a - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group fa7b4181-ea79-4322-aa7f-8f50d51e4f29 >2018-07-16 17:52:52.800 23 INFO octavia.controller.queue.endpoint [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'f37ef83d-8382-47cf-a0b7-3eb4a606aee1'... >2018-07-16 17:52:52.917 23 INFO octavia.controller.worker.tasks.database_tasks [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 0dd9b527-79bb-4c26-8b6e-398d00313913 >2018-07-16 17:52:53.110 23 INFO octavia.certificates.generator.local [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 17:52:53.110 23 INFO octavia.certificates.generator.local [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 17:52:53.111 23 INFO octavia.certificates.generator.local [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 17:52:53.111 23 INFO octavia.certificates.generator.local [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 17:53:07.598 23 INFO octavia.controller.worker.tasks.database_tasks [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 0dd9b527-79bb-4c26-8b6e-398d00313913 with compute id 130cdfe2-c696-4b0c-9481-beba0dceddc2 for load balancer: f37ef83d-8382-47cf-a0b7-3eb4a606aee1 >2018-07-16 17:53:07.914 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 739e6876-05a1-45e8-81fe-0dc6ac3bebb7 already exists. Nothing to be done. >2018-07-16 17:53:25.736 23 INFO octavia.controller.worker.tasks.database_tasks [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f37ef83d-8382-47cf-a0b7-3eb4a606aee1 >2018-07-16 17:53:26.881 23 INFO octavia.controller.queue.endpoint [req-9b8fd110-931b-449e-b6dd-7fe11b0189d4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'b9800f1d-c26c-4fd6-9fe0-cbc337ca4c54'... >2018-07-16 17:53:28.448 23 INFO octavia.controller.queue.endpoint [req-b39b41ae-0afb-4be0-894b-3b79401973ff - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '483a6f8f-75ab-4fe5-a93e-369af2e4ceae'... >2018-07-16 17:53:29.648 23 INFO octavia.controller.queue.endpoint [req-8b7ce3dc-ab03-4438-8a73-8a437758b2bb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '6d461b83-39f1-4f2f-9dc7-f1700a0aeecb'... >2018-07-16 17:53:52.340 23 INFO octavia.controller.queue.endpoint [req-19f9dcf3-457f-42c8-a1e4-cce6f0d06897 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9b6d3ae1-4ae6-4690-b2d4-056883ff3e1b'... >2018-07-16 17:53:58.412 23 INFO octavia.controller.queue.endpoint [req-57748b88-87f6-4a24-a557-640e93babb17 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0249dad4-f342-4954-a260-9d3fbe298afc'... >2018-07-16 17:53:59.546 23 INFO octavia.controller.queue.endpoint [req-70f77a6f-d455-4f80-9ff6-0ffe8257061a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '45d87203-c545-472f-8460-5943046a6f56'... >2018-07-16 18:18:45.960 23 INFO octavia.controller.queue.endpoint [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'f822441f-5885-4cca-a771-a0daf05d036a'... >2018-07-16 18:18:46.082 23 INFO octavia.controller.worker.tasks.database_tasks [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id b840d9e3-1cb0-4346-9bcc-d7636a64eb59 >2018-07-16 18:18:46.429 23 INFO octavia.certificates.generator.local [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 18:18:46.429 23 INFO octavia.certificates.generator.local [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 18:18:46.430 23 INFO octavia.certificates.generator.local [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 18:18:46.430 23 INFO octavia.certificates.generator.local [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 18:18:49.551 23 INFO octavia.controller.queue.endpoint [req-61f4be1e-f7af-4813-9b41-ad305b4fc0aa - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '8a027035-451c-4f5e-b72c-294a8847f46e'... >2018-07-16 18:18:49.671 23 INFO octavia.controller.worker.tasks.database_tasks [req-61f4be1e-f7af-4813-9b41-ad305b4fc0aa - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 0892c0da-51f2-44f2-975e-f95848727dd8 >2018-07-16 18:18:49.739 23 INFO octavia.certificates.generator.local [req-61f4be1e-f7af-4813-9b41-ad305b4fc0aa - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 18:18:49.739 23 INFO octavia.certificates.generator.local [req-61f4be1e-f7af-4813-9b41-ad305b4fc0aa - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 18:18:49.739 23 INFO octavia.certificates.generator.local [req-61f4be1e-f7af-4813-9b41-ad305b4fc0aa - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 18:18:49.740 23 INFO octavia.certificates.generator.local [req-61f4be1e-f7af-4813-9b41-ad305b4fc0aa - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 18:18:58.810 23 INFO octavia.controller.worker.tasks.database_tasks [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: b840d9e3-1cb0-4346-9bcc-d7636a64eb59 with compute id c0db1ebf-b0d4-4047-9d46-1bec428f06f1 for load balancer: f822441f-5885-4cca-a771-a0daf05d036a >2018-07-16 18:18:59.103 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 2fcfc295-da62-4c4d-aa99-02e800acb65a already exists. Nothing to be done. >2018-07-16 18:18:59.994 23 INFO octavia.controller.queue.endpoint [req-98fb790a-94ec-4742-abd3-8b76b4c40d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'ba5a5d05-28e6-48b8-a5d2-b89a680a784f'... >2018-07-16 18:19:00.105 23 INFO octavia.controller.worker.tasks.database_tasks [req-98fb790a-94ec-4742-abd3-8b76b4c40d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 54974fbe-ab02-4d80-8198-29c54ad14a46 >2018-07-16 18:19:00.352 23 INFO octavia.certificates.generator.local [req-98fb790a-94ec-4742-abd3-8b76b4c40d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 18:19:00.352 23 INFO octavia.certificates.generator.local [req-98fb790a-94ec-4742-abd3-8b76b4c40d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 18:19:00.353 23 INFO octavia.certificates.generator.local [req-98fb790a-94ec-4742-abd3-8b76b4c40d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 18:19:00.353 23 INFO octavia.certificates.generator.local [req-98fb790a-94ec-4742-abd3-8b76b4c40d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 18:19:01.931 23 INFO octavia.controller.worker.tasks.database_tasks [req-61f4be1e-f7af-4813-9b41-ad305b4fc0aa - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 0892c0da-51f2-44f2-975e-f95848727dd8 with compute id f749bfae-23db-45a1-885b-04c5e120f909 for load balancer: 8a027035-451c-4f5e-b72c-294a8847f46e >2018-07-16 18:19:02.024 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-61f4be1e-f7af-4813-9b41-ad305b4fc0aa - 293061856e1a4cffbae3ed099cf4f619 - - -] Port e29e15b3-25ed-4f8b-8e98-6a83178dee5b already exists. Nothing to be done. >2018-07-16 18:19:12.470 23 INFO octavia.controller.worker.tasks.database_tasks [req-98fb790a-94ec-4742-abd3-8b76b4c40d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 54974fbe-ab02-4d80-8198-29c54ad14a46 with compute id 2e4de12f-9f14-4de8-8899-a505d54b2aed for load balancer: ba5a5d05-28e6-48b8-a5d2-b89a680a784f >2018-07-16 18:19:12.566 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-98fb790a-94ec-4742-abd3-8b76b4c40d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 2202589b-c81e-42f8-90c4-d0365dad31c4 already exists. Nothing to be done. >2018-07-16 18:19:15.033 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.12', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.211.223 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470038d350>, 'Connection to 172.24.0.12 timed out. (connect timeout=10.0)')) >2018-07-16 18:19:19.892 23 INFO octavia.controller.worker.tasks.database_tasks [req-61f4be1e-f7af-4813-9b41-ad305b4fc0aa - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 8a027035-451c-4f5e-b72c-294a8847f46e >2018-07-16 18:19:24.632 23 INFO octavia.controller.worker.tasks.database_tasks [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f822441f-5885-4cca-a771-a0daf05d036a >2018-07-16 18:19:28.184 23 INFO octavia.controller.queue.endpoint [req-9b8fd110-931b-449e-b6dd-7fe11b0189d4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '5fbf76a4-2325-499b-a6f0-e2132b45db85'... >2018-07-16 18:19:30.046 23 INFO octavia.controller.worker.tasks.database_tasks [req-98fb790a-94ec-4742-abd3-8b76b4c40d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: ba5a5d05-28e6-48b8-a5d2-b89a680a784f >2018-07-16 18:19:33.643 23 INFO octavia.controller.queue.endpoint [req-20b3cd33-7587-480a-a30e-1dd3691dc258 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '30bbcc0a-38f5-45ff-b714-547aaf9edffa'... >2018-07-16 18:19:38.525 23 INFO octavia.controller.queue.endpoint [req-b81f9e78-1339-4d47-a8f1-20d1e9e933b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '0aa8e2ef-4db9-41b7-9567-a90b3c0737f9'... >2018-07-16 18:19:38.870 23 INFO octavia.controller.queue.endpoint [req-61f4be1e-f7af-4813-9b41-ad305b4fc0aa - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '15dd4aed-d0c2-40be-bef8-4af45fd46516'... >2018-07-16 18:19:43.057 23 INFO octavia.controller.queue.endpoint [req-98fb790a-94ec-4742-abd3-8b76b4c40d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'be13955a-a02b-430b-929c-b3c9117c28a0'... >2018-07-16 18:19:43.690 23 INFO octavia.controller.queue.endpoint [req-e9340102-d4fd-4a5f-85b7-eec7bf3e1408 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'e595f758-d025-4b3a-97ab-e4c88c1fd652'... >2018-07-16 18:19:44.072 23 INFO octavia.controller.queue.endpoint [req-f60dcb91-4c97-4af6-9c10-5008a15ddf4a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '87acf8d6-98df-4c4f-b08e-f5ccf21e6ff7'... >2018-07-16 18:19:48.433 23 INFO octavia.controller.queue.endpoint [req-083582ec-2710-4a37-bbe3-9b56980eb23e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c383cd2a-5b51-46ab-a36d-8e4ae52f512e'... >2018-07-16 18:19:48.530 23 INFO octavia.controller.queue.endpoint [req-a41f265f-8f2c-4676-ad7f-ddbc19ee7742 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '349fd2f6-bdf3-43aa-a25f-2dac9a73d38e'... >2018-07-16 18:19:49.230 23 INFO octavia.controller.queue.endpoint [req-91398995-864d-44ec-8501-17e014bd6335 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '41ec580e-2843-4c0a-927e-11d6058f020c'... >2018-07-16 18:19:52.898 23 INFO octavia.controller.queue.endpoint [req-ee1f4577-2689-4b5a-b120-b07e6c126969 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd8a3268b-d95b-4e6b-bebd-0d0c4c381327'... >2018-07-16 18:19:54.232 23 INFO octavia.controller.queue.endpoint [req-fd5b650b-640f-4a29-b32c-83f840740ad3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b237c685-2329-4f34-8817-85d154ae07d7'... >2018-07-16 18:19:54.469 23 INFO octavia.controller.queue.endpoint [req-d3c441a5-c426-4f98-9300-de4077ab0b13 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'd0a88d9e-50c3-47de-b7a1-9a96a9651b66'... >2018-07-16 18:19:59.363 23 INFO octavia.controller.queue.endpoint [req-5c56256f-d592-4686-a74c-cab74837dd20 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '65b2dfe4-ff37-4c9d-832a-e430be8c71f0'... >2018-07-16 18:19:59.690 23 INFO octavia.controller.queue.endpoint [req-86cfff33-fa54-4159-8da0-b44fa08c8305 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '041c0a01-d389-401f-9358-214e633daeba'... >2018-07-16 18:20:03.857 23 INFO octavia.controller.queue.endpoint [req-017bea36-0ef3-4b1d-b162-60c1067b105b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '9b69697f-3142-41e0-83e3-e2b13c546d1f'... >2018-07-16 18:20:03.996 23 INFO octavia.controller.worker.tasks.database_tasks [req-017bea36-0ef3-4b1d-b162-60c1067b105b - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id f6e1ea80-6809-4905-872e-e97d7b3246f3 >2018-07-16 18:20:04.165 23 INFO octavia.certificates.generator.local [req-017bea36-0ef3-4b1d-b162-60c1067b105b - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 18:20:04.165 23 INFO octavia.certificates.generator.local [req-017bea36-0ef3-4b1d-b162-60c1067b105b - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 18:20:04.165 23 INFO octavia.certificates.generator.local [req-017bea36-0ef3-4b1d-b162-60c1067b105b - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 18:20:04.166 23 INFO octavia.certificates.generator.local [req-017bea36-0ef3-4b1d-b162-60c1067b105b - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 18:20:04.794 23 INFO octavia.controller.queue.endpoint [req-0d19ab31-3819-410a-a124-556e26a1c251 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '51dfe4ce-65b5-4d14-bebe-e87fe066f594'... >2018-07-16 18:20:04.912 23 INFO octavia.controller.worker.tasks.database_tasks [req-0d19ab31-3819-410a-a124-556e26a1c251 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id db27489a-5156-4dcf-b0bc-3479db5412be >2018-07-16 18:20:05.210 23 INFO octavia.controller.queue.endpoint [req-6748b7c5-68c8-4872-b332-c46e97652ba8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '012a445f-3318-4cf3-9545-9ab7b485fd09'... >2018-07-16 18:20:05.387 23 INFO octavia.certificates.generator.local [req-0d19ab31-3819-410a-a124-556e26a1c251 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-16 18:20:05.387 23 INFO octavia.certificates.generator.local [req-0d19ab31-3819-410a-a124-556e26a1c251 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-16 18:20:05.388 23 INFO octavia.certificates.generator.local [req-0d19ab31-3819-410a-a124-556e26a1c251 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-16 18:20:05.388 23 INFO octavia.certificates.generator.local [req-0d19ab31-3819-410a-a124-556e26a1c251 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-16 18:20:10.829 23 INFO octavia.controller.queue.endpoint [req-c97a1d54-7ecf-4d72-968c-1030a64cc312 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '89c43c1e-adcd-4b75-988e-a9a64d6919f1'... >2018-07-16 18:20:12.431 23 INFO octavia.controller.queue.endpoint [req-0739957f-a5c7-423d-b1c8-c891a8f299a4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '421fd206-5008-46ee-bf85-3c968cb31c23'... >2018-07-16 18:20:16.144 23 INFO octavia.controller.worker.tasks.database_tasks [req-017bea36-0ef3-4b1d-b162-60c1067b105b - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: f6e1ea80-6809-4905-872e-e97d7b3246f3 with compute id b994a7fa-0ffc-4e4c-93f9-82856b79e2fd for load balancer: 9b69697f-3142-41e0-83e3-e2b13c546d1f >2018-07-16 18:20:16.294 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-017bea36-0ef3-4b1d-b162-60c1067b105b - 293061856e1a4cffbae3ed099cf4f619 - - -] Port adcbdda4-ff4a-47a9-8c5f-87d56b78dc17 already exists. Nothing to be done. >2018-07-16 18:20:17.643 23 INFO octavia.controller.queue.endpoint [req-4dd6c3bc-d67a-4e9b-850a-c939bae54ed5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '03503f4e-f0c6-4ef5-acc4-d2561f261265'... >2018-07-16 18:20:18.045 23 INFO octavia.controller.worker.tasks.database_tasks [req-0d19ab31-3819-410a-a124-556e26a1c251 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: db27489a-5156-4dcf-b0bc-3479db5412be with compute id 5a517c86-4a4b-4c58-a9df-b5227393c54d for load balancer: 51dfe4ce-65b5-4d14-bebe-e87fe066f594 >2018-07-16 18:20:18.138 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-0d19ab31-3819-410a-a124-556e26a1c251 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 99b57efb-d803-4b8a-9f07-babfe32625f0 already exists. Nothing to be done. >2018-07-16 18:20:22.756 23 INFO octavia.controller.queue.endpoint [req-5f5bb713-d3ed-4a02-8e36-e804d1be48fb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9b6b8ee1-4c0b-4b4b-b37d-708cf3fd945e'... >2018-07-16 18:20:33.472 23 INFO octavia.controller.worker.tasks.database_tasks [req-017bea36-0ef3-4b1d-b162-60c1067b105b - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 9b69697f-3142-41e0-83e3-e2b13c546d1f >2018-07-16 18:20:35.477 23 INFO octavia.controller.worker.tasks.database_tasks [req-0d19ab31-3819-410a-a124-556e26a1c251 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 51dfe4ce-65b5-4d14-bebe-e87fe066f594 >2018-07-16 18:20:43.732 23 INFO octavia.controller.queue.endpoint [req-357f10cd-4073-45af-a86f-0de5a12729d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '67b0c9e4-86c3-44c0-a3cd-b94e688353cd'... >2018-07-16 18:20:46.151 23 INFO octavia.controller.queue.endpoint [req-19500d17-4e11-491c-ac08-2f6a0b347139 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'fd054fa7-b021-4c0b-8683-268c7a6039be'... >2018-07-16 18:20:48.893 23 INFO octavia.controller.queue.endpoint [req-c17117c4-b5b1-4419-9ed9-8ba18a11428a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '70bf4f8d-1629-46ae-83fc-8b723aee836d'... >2018-07-16 18:20:50.949 23 INFO octavia.controller.queue.endpoint [req-95cbbe44-133c-4f0e-a7f7-595fa53076ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '560f5943-599f-4eec-96b6-285da0ef6d3a'... >2018-07-16 18:20:54.162 23 INFO octavia.controller.queue.endpoint [req-21aef36f-7eff-4dbd-ba62-9c2c43bb7226 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a0249e79-5e8e-4649-a069-7772b0c7ac01'... >2018-07-16 18:20:55.483 23 INFO octavia.controller.queue.endpoint [req-74984cfa-5a75-4a0c-8cd5-9cf9782ed9dc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '27189b9a-2dae-4dee-b8a9-7116726d0e43'... >2018-07-16 18:20:56.401 23 INFO octavia.controller.queue.endpoint [req-017bea36-0ef3-4b1d-b162-60c1067b105b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1d7a12b5-4eeb-4de7-a135-7625c874f663'... >2018-07-16 18:20:57.745 23 INFO octavia.controller.queue.endpoint [req-4e5470fb-62e4-4edc-9952-2ce84a5f642e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f584d911-de96-42e2-a68f-b10d1d9406df'... >2018-07-16 18:21:00.503 23 INFO octavia.controller.queue.endpoint [req-e490a8d0-ff69-4ebd-94e7-1b62212ed2e4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd4abaa89-991b-494b-932e-5687ebb7d509'... >2018-07-16 18:21:02.784 23 INFO octavia.controller.queue.endpoint [req-fd39f2a1-1afa-432a-b260-a8586fcdc934 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0a533be4-917a-4ea7-b59e-d546a7c9ac36'... >2018-07-17 09:28:07.502 23 INFO octavia.controller.queue.endpoint [req-66b92cfe-a4d7-46db-bacb-eeb2ac958e5f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f822441f-5885-4cca-a771-a0daf05d036a'... >2018-07-17 09:28:09.177 23 INFO octavia.controller.queue.endpoint [req-112c5a5d-2873-4b94-8e67-468b8c2dedbe - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '8a027035-451c-4f5e-b72c-294a8847f46e'... >2018-07-17 09:28:10.429 23 INFO octavia.controller.queue.endpoint [req-5e52cc3b-bfd6-433e-a65c-f7e631ba6114 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '9b69697f-3142-41e0-83e3-e2b13c546d1f'... >2018-07-17 09:28:11.290 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-66b92cfe-a4d7-46db-bacb-eeb2ac958e5f - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 214d42e0-3266-4639-b8f9-e925673e2041 from port 2fcfc295-da62-4c4d-aa99-02e800acb65a >2018-07-17 09:28:11.603 23 INFO octavia.controller.queue.endpoint [req-32b969c4-c6fb-44ba-9396-bb54cff77d38 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '51dfe4ce-65b5-4d14-bebe-e87fe066f594'... >2018-07-17 09:28:11.980 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-112c5a5d-2873-4b94-8e67-468b8c2dedbe - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 9cd0bcf0-a4bf-4ab7-b4fd-00914ee77153 from port e29e15b3-25ed-4f8b-8e98-6a83178dee5b >2018-07-17 09:28:12.026 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-66b92cfe-a4d7-46db-bacb-eeb2ac958e5f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 214d42e0-3266-4639-b8f9-e925673e2041 >2018-07-17 09:28:12.853 23 INFO octavia.controller.queue.endpoint [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'ba5a5d05-28e6-48b8-a5d2-b89a680a784f'... >2018-07-17 09:28:12.928 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-112c5a5d-2873-4b94-8e67-468b8c2dedbe - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 9cd0bcf0-a4bf-4ab7-b4fd-00914ee77153 >2018-07-17 09:28:13.165 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-5e52cc3b-bfd6-433e-a65c-f7e631ba6114 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 5b41c660-0c28-4b26-b1fe-89656309fa07 from port adcbdda4-ff4a-47a9-8c5f-87d56b78dc17 >2018-07-17 09:28:14.573 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-32b969c4-c6fb-44ba-9396-bb54cff77d38 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 6604ad7b-6b3d-4a3c-ad82-7bd697145a5e from port 99b57efb-d803-4b8a-9f07-babfe32625f0 >2018-07-17 09:28:14.750 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-5e52cc3b-bfd6-433e-a65c-f7e631ba6114 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 5b41c660-0c28-4b26-b1fe-89656309fa07 >2018-07-17 09:28:15.203 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 002c6b41-6399-4477-bcf5-de901e350ce4 from port 2202589b-c81e-42f8-90c4-d0365dad31c4 >2018-07-17 09:28:15.350 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-32b969c4-c6fb-44ba-9396-bb54cff77d38 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 6604ad7b-6b3d-4a3c-ad82-7bd697145a5e >2018-07-17 09:28:15.963 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 002c6b41-6399-4477-bcf5-de901e350ce4 >2018-07-17 09:28:53.816 23 INFO octavia.controller.queue.endpoint [req-66b92cfe-a4d7-46db-bacb-eeb2ac958e5f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '9b6d3ae1-4ae6-4690-b2d4-056883ff3e1b'... >2018-07-17 09:28:54.709 23 INFO octavia.controller.queue.endpoint [req-5e52cc3b-bfd6-433e-a65c-f7e631ba6114 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '45d87203-c545-472f-8460-5943046a6f56'... >2018-07-17 09:28:55.435 23 INFO octavia.controller.queue.endpoint [req-41a7da44-ab38-425f-bad9-1d958762ccee - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '6d461b83-39f1-4f2f-9dc7-f1700a0aeecb'... >2018-07-17 09:29:44.130 23 INFO octavia.controller.worker.tasks.database_tasks [req-41a7da44-ab38-425f-bad9-1d958762ccee - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f37ef83d-8382-47cf-a0b7-3eb4a606aee1 >2018-07-17 09:29:44.806 23 INFO octavia.controller.queue.endpoint [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '483a6f8f-75ab-4fe5-a93e-369af2e4ceae'... >2018-07-17 09:29:45.287 23 INFO octavia.controller.worker.tasks.database_tasks [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f37ef83d-8382-47cf-a0b7-3eb4a606aee1 >2018-07-17 09:29:46.053 23 INFO octavia.controller.queue.endpoint [req-0601f92f-0828-4997-8c20-97819ef70ae7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '0249dad4-f342-4954-a260-9d3fbe298afc'... >2018-07-17 09:29:57.667 23 INFO octavia.controller.queue.endpoint [req-112c5a5d-2873-4b94-8e67-468b8c2dedbe - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool 'b9800f1d-c26c-4fd6-9fe0-cbc337ca4c54'... >2018-07-17 09:29:58.818 23 INFO octavia.controller.queue.endpoint [req-9d9bc1ab-5cb7-4825-a819-9864bb2988ba - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f37ef83d-8382-47cf-a0b7-3eb4a606aee1'... >2018-07-17 09:30:00.857 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-9d9bc1ab-5cb7-4825-a819-9864bb2988ba - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group c9515ca8-3d91-4d70-8238-972d0d8aa4d2 from port 739e6876-05a1-45e8-81fe-0dc6ac3bebb7 >2018-07-17 09:30:01.566 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-9d9bc1ab-5cb7-4825-a819-9864bb2988ba - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group c9515ca8-3d91-4d70-8238-972d0d8aa4d2 >2018-07-17 09:31:22.173 23 INFO octavia.controller.queue.endpoint [req-0601f92f-0828-4997-8c20-97819ef70ae7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '56f94f26-d186-4780-8591-6afa9dcb2e36'... >2018-07-17 09:31:22.292 23 INFO octavia.controller.worker.tasks.database_tasks [req-0601f92f-0828-4997-8c20-97819ef70ae7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 520c64e4-db37-4da1-b46f-10fbc04e9810 >2018-07-17 09:31:22.338 23 INFO octavia.certificates.generator.local [req-0601f92f-0828-4997-8c20-97819ef70ae7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 09:31:22.338 23 INFO octavia.certificates.generator.local [req-0601f92f-0828-4997-8c20-97819ef70ae7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 09:31:22.338 23 INFO octavia.certificates.generator.local [req-0601f92f-0828-4997-8c20-97819ef70ae7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 09:31:22.339 23 INFO octavia.certificates.generator.local [req-0601f92f-0828-4997-8c20-97819ef70ae7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 09:31:36.320 23 INFO octavia.controller.worker.tasks.database_tasks [req-0601f92f-0828-4997-8c20-97819ef70ae7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 520c64e4-db37-4da1-b46f-10fbc04e9810 with compute id 7edc6087-d33e-4450-a1f2-c7afd12902ad for load balancer: 56f94f26-d186-4780-8591-6afa9dcb2e36 >2018-07-17 09:31:36.409 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-0601f92f-0828-4997-8c20-97819ef70ae7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port ce15866a-7b19-4e66-a834-4fb889380179 already exists. Nothing to be done. >2018-07-17 09:31:53.995 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-0601f92f-0828-4997-8c20-97819ef70ae7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.8', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.0.1 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470822d590>, 'Connection to 172.24.0.8 timed out. (connect timeout=10.0)')) >2018-07-17 09:32:03.731 23 INFO octavia.controller.worker.tasks.database_tasks [req-0601f92f-0828-4997-8c20-97819ef70ae7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 56f94f26-d186-4780-8591-6afa9dcb2e36 >2018-07-17 09:32:04.497 23 INFO octavia.controller.queue.endpoint [req-87e2d6ef-22cf-4d77-a075-128e3a6b716b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '3a3c41fa-4c24-478d-bc62-648d009ed5b6'... >2018-07-17 09:32:06.156 23 INFO octavia.controller.queue.endpoint [req-41a7da44-ab38-425f-bad9-1d958762ccee - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '55decb5f-309e-48ef-bace-509e71ab4845'... >2018-07-17 09:32:07.376 23 INFO octavia.controller.queue.endpoint [req-9d9bc1ab-5cb7-4825-a819-9864bb2988ba - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '4e95bee7-073a-4e9f-bed1-d398f55e2ca2'... >2018-07-17 09:32:32.069 23 INFO octavia.controller.queue.endpoint [req-ccb6a937-f181-4213-8edf-441480cc62ea - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '25ddd572-a842-4cc7-8663-5dc090ac9922'... >2018-07-17 09:32:33.891 23 INFO octavia.controller.queue.endpoint [req-768f2e9b-20bb-4dfc-94d3-934f98a9533e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e0a572c6-43bb-494c-b207-e08772b7a763'... >2018-07-17 09:32:34.843 23 INFO octavia.controller.queue.endpoint [req-ea1fd536-471c-45fe-8924-b684adcc459c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'be669ac1-b662-4f3b-8b73-cf7db865d389'... >2018-07-17 09:58:05.146 23 INFO octavia.controller.queue.endpoint [req-50199a53-9c33-482e-b55a-f3b1e4943196 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'a2ce136b-59ae-4d18-b860-00c21bdf58ab'... >2018-07-17 09:58:05.274 23 INFO octavia.controller.worker.tasks.database_tasks [req-50199a53-9c33-482e-b55a-f3b1e4943196 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 4d587dbd-973b-440d-bc5d-3574835deb20 >2018-07-17 09:58:05.357 23 INFO octavia.certificates.generator.local [req-50199a53-9c33-482e-b55a-f3b1e4943196 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 09:58:05.357 23 INFO octavia.certificates.generator.local [req-50199a53-9c33-482e-b55a-f3b1e4943196 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 09:58:05.358 23 INFO octavia.certificates.generator.local [req-50199a53-9c33-482e-b55a-f3b1e4943196 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 09:58:05.358 23 INFO octavia.certificates.generator.local [req-50199a53-9c33-482e-b55a-f3b1e4943196 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 09:58:07.725 23 INFO octavia.controller.queue.endpoint [req-d23d7124-d8de-468e-bdc6-5dc8e9901ab1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '0da1e31f-d7b8-4a4a-b367-fc1c37fb3502'... >2018-07-17 09:58:07.996 23 INFO octavia.controller.worker.tasks.database_tasks [req-d23d7124-d8de-468e-bdc6-5dc8e9901ab1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 0e779028-7b80-464a-937f-c5a499cc6707 >2018-07-17 09:58:08.162 23 INFO octavia.certificates.generator.local [req-d23d7124-d8de-468e-bdc6-5dc8e9901ab1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 09:58:08.163 23 INFO octavia.certificates.generator.local [req-d23d7124-d8de-468e-bdc6-5dc8e9901ab1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 09:58:08.163 23 INFO octavia.certificates.generator.local [req-d23d7124-d8de-468e-bdc6-5dc8e9901ab1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 09:58:08.164 23 INFO octavia.certificates.generator.local [req-d23d7124-d8de-468e-bdc6-5dc8e9901ab1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 09:58:13.201 23 INFO octavia.controller.queue.endpoint [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'f477721b-6dc4-4e13-a8fa-9b5198afaa21'... >2018-07-17 09:58:13.321 23 INFO octavia.controller.worker.tasks.database_tasks [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 2b9f3ed1-daad-4bd8-ba81-236f142bc900 >2018-07-17 09:58:13.414 23 INFO octavia.certificates.generator.local [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 09:58:13.414 23 INFO octavia.certificates.generator.local [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 09:58:13.414 23 INFO octavia.certificates.generator.local [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 09:58:13.415 23 INFO octavia.certificates.generator.local [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 09:58:18.686 23 INFO octavia.controller.worker.tasks.database_tasks [req-50199a53-9c33-482e-b55a-f3b1e4943196 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 4d587dbd-973b-440d-bc5d-3574835deb20 with compute id 954b2a2d-51c9-4bc4-b70a-7395dc9a902a for load balancer: a2ce136b-59ae-4d18-b860-00c21bdf58ab >2018-07-17 09:58:19.000 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-50199a53-9c33-482e-b55a-f3b1e4943196 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 35a5d6e6-4737-49a7-8776-6bce0570141c already exists. Nothing to be done. >2018-07-17 09:58:20.546 23 INFO octavia.controller.worker.tasks.database_tasks [req-d23d7124-d8de-468e-bdc6-5dc8e9901ab1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 0e779028-7b80-464a-937f-c5a499cc6707 with compute id 0bd24329-33bb-4e10-a823-8b0b370900e0 for load balancer: 0da1e31f-d7b8-4a4a-b367-fc1c37fb3502 >2018-07-17 09:58:20.850 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-d23d7124-d8de-468e-bdc6-5dc8e9901ab1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port f4c0cac2-63e0-4a75-ba83-053fb557228a already exists. Nothing to be done. >2018-07-17 09:58:25.614 23 INFO octavia.controller.worker.tasks.database_tasks [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 2b9f3ed1-daad-4bd8-ba81-236f142bc900 with compute id c4528d53-0a21-4e06-bd1b-9c82c1b437b4 for load balancer: f477721b-6dc4-4e13-a8fa-9b5198afaa21 >2018-07-17 09:58:25.717 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 20b1474a-6bbf-4a19-ae05-6b3242adb8d7 already exists. Nothing to be done. >2018-07-17 09:58:34.580 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-50199a53-9c33-482e-b55a-f3b1e4943196 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.11', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.189.65 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47002ab190>, 'Connection to 172.24.0.11 timed out. (connect timeout=10.0)')) >2018-07-17 09:58:38.557 23 INFO octavia.controller.worker.tasks.database_tasks [req-d23d7124-d8de-468e-bdc6-5dc8e9901ab1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 0da1e31f-d7b8-4a4a-b367-fc1c37fb3502 >2018-07-17 09:58:42.052 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.14', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.217.220 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700487650>, 'Connection to 172.24.0.14 timed out. (connect timeout=10.0)')) >2018-07-17 09:58:44.207 23 INFO octavia.controller.worker.tasks.database_tasks [req-50199a53-9c33-482e-b55a-f3b1e4943196 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: a2ce136b-59ae-4d18-b860-00c21bdf58ab >2018-07-17 09:58:46.153 23 INFO octavia.controller.queue.endpoint [req-c5621ef3-45a1-46b8-a4a3-0aaa2e29a5a4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '4541884c-a3b9-4caa-a268-d2b35749dfb4'... >2018-07-17 09:58:46.281 23 INFO octavia.controller.worker.tasks.database_tasks [req-c5621ef3-45a1-46b8-a4a3-0aaa2e29a5a4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 2983d4fa-b9f1-48f7-bf31-9c7fa9d6263f >2018-07-17 09:58:46.359 23 INFO octavia.certificates.generator.local [req-c5621ef3-45a1-46b8-a4a3-0aaa2e29a5a4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 09:58:46.360 23 INFO octavia.certificates.generator.local [req-c5621ef3-45a1-46b8-a4a3-0aaa2e29a5a4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 09:58:46.360 23 INFO octavia.certificates.generator.local [req-c5621ef3-45a1-46b8-a4a3-0aaa2e29a5a4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 09:58:46.360 23 INFO octavia.certificates.generator.local [req-c5621ef3-45a1-46b8-a4a3-0aaa2e29a5a4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 09:58:46.419 23 INFO octavia.controller.queue.endpoint [req-a399eb58-ff0d-4a4c-81f9-3a09f580345d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '4dc54f20-73a2-4bcc-966d-26de0b68ccc4'... >2018-07-17 09:58:47.647 23 INFO octavia.controller.queue.endpoint [req-1c36b831-ef29-43f2-aa4c-6e15edc1e9f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '9de294b8-5f78-4f37-a94d-8530393dd919'... >2018-07-17 09:58:47.811 23 INFO octavia.controller.worker.tasks.database_tasks [req-1c36b831-ef29-43f2-aa4c-6e15edc1e9f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id e6f0295c-7515-4843-8b7a-849590e9dcf7 >2018-07-17 09:58:47.957 23 INFO octavia.certificates.generator.local [req-1c36b831-ef29-43f2-aa4c-6e15edc1e9f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 09:58:47.958 23 INFO octavia.certificates.generator.local [req-1c36b831-ef29-43f2-aa4c-6e15edc1e9f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 09:58:47.958 23 INFO octavia.certificates.generator.local [req-1c36b831-ef29-43f2-aa4c-6e15edc1e9f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 09:58:47.958 23 INFO octavia.certificates.generator.local [req-1c36b831-ef29-43f2-aa4c-6e15edc1e9f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 09:58:48.072 23 INFO octavia.controller.queue.endpoint [req-20d2eb54-94df-4485-bf76-f255bd3e6a74 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '38b65806-8339-4347-ba9e-6cd2b03a21df'... >2018-07-17 09:58:51.638 23 INFO octavia.controller.worker.tasks.database_tasks [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f477721b-6dc4-4e13-a8fa-9b5198afaa21 >2018-07-17 09:58:52.186 23 INFO octavia.controller.queue.endpoint [req-50199a53-9c33-482e-b55a-f3b1e4943196 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'cc66bba3-aa50-4894-a2de-9e4d81ee34fa'... >2018-07-17 09:58:52.829 23 INFO octavia.controller.queue.endpoint [req-87e2d6ef-22cf-4d77-a075-128e3a6b716b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '51e5ab21-d052-4b48-aedc-183409024c06'... >2018-07-17 09:58:53.698 23 INFO octavia.controller.queue.endpoint [req-57dd9328-97ba-4f7b-812b-2eb48d78a11c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '49dacbf4-97bd-4a11-8a33-c27477531f56'... >2018-07-17 09:58:56.969 23 INFO octavia.controller.queue.endpoint [req-0601f92f-0828-4997-8c20-97819ef70ae7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '5bf9ab1e-d112-46fa-8210-d2005e7f3521'... >2018-07-17 09:58:58.383 23 INFO octavia.controller.queue.endpoint [req-32b969c4-c6fb-44ba-9396-bb54cff77d38 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7ca358a6-48a5-4fd5-a145-fd812e6d2004'... >2018-07-17 09:58:58.774 23 INFO octavia.controller.queue.endpoint [req-30416760-ef69-483f-a028-c5d472aa6b7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '23633b5b-3dd7-4460-8fd0-382354da0fa4'... >2018-07-17 09:58:59.569 23 INFO octavia.controller.worker.tasks.database_tasks [req-c5621ef3-45a1-46b8-a4a3-0aaa2e29a5a4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 2983d4fa-b9f1-48f7-bf31-9c7fa9d6263f with compute id 91d76545-2451-4c38-bd84-d55d6d719ded for load balancer: 4541884c-a3b9-4caa-a268-d2b35749dfb4 >2018-07-17 09:58:59.741 23 INFO octavia.controller.queue.endpoint [req-5a35163a-f4b9-477a-a19b-70701eff53c3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '154b8461-020b-4658-881c-02566104cb43'... >2018-07-17 09:58:59.885 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-c5621ef3-45a1-46b8-a4a3-0aaa2e29a5a4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 4b92a521-f759-46a6-95a3-81bc91bbebf3 already exists. Nothing to be done. >2018-07-17 09:59:00.091 23 INFO octavia.controller.worker.tasks.database_tasks [req-1c36b831-ef29-43f2-aa4c-6e15edc1e9f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: e6f0295c-7515-4843-8b7a-849590e9dcf7 with compute id d9cbb24b-8c13-43e7-a0da-f79819e087b8 for load balancer: 9de294b8-5f78-4f37-a94d-8530393dd919 >2018-07-17 09:59:00.209 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-1c36b831-ef29-43f2-aa4c-6e15edc1e9f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 636696aa-a49b-443f-aea6-87e18463a486 already exists. Nothing to be done. >2018-07-17 09:59:02.562 23 INFO octavia.controller.queue.endpoint [req-1c40afbb-33cd-477a-b593-5dadfc4459d9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1ee8ef50-32c9-44e1-8dd3-74cc166d743a'... >2018-07-17 09:59:03.540 23 INFO octavia.controller.queue.endpoint [req-d23d7124-d8de-468e-bdc6-5dc8e9901ab1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '34003971-e34f-4a75-83b1-7ce3549b1c1a'... >2018-07-17 09:59:04.694 23 INFO octavia.controller.queue.endpoint [req-daabd2cd-efc8-4ebd-80fa-b39e21956455 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '300aaa7c-c6c1-4d9b-9f31-4cd585767b9a'... >2018-07-17 09:59:08.800 23 INFO octavia.controller.queue.endpoint [req-62ee05d6-a9e0-4852-97fd-7dfdb31d5907 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '0d399d3b-c728-404c-a9b8-ebeb9e836394'... >2018-07-17 09:59:14.397 23 INFO octavia.controller.queue.endpoint [req-00d05b60-8c73-40e4-9183-142023527947 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '5d422ed8-f0e5-41c3-9a29-a4a3b8ce6c63'... >2018-07-17 09:59:14.864 23 INFO octavia.controller.worker.tasks.database_tasks [req-c5621ef3-45a1-46b8-a4a3-0aaa2e29a5a4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 4541884c-a3b9-4caa-a268-d2b35749dfb4 >2018-07-17 09:59:16.529 23 INFO octavia.controller.worker.tasks.database_tasks [req-1c36b831-ef29-43f2-aa4c-6e15edc1e9f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 9de294b8-5f78-4f37-a94d-8530393dd919 >2018-07-17 09:59:19.969 23 INFO octavia.controller.queue.endpoint [req-112c5a5d-2873-4b94-8e67-468b8c2dedbe - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3033c85a-e59f-4f79-b43a-68f73c108d8f'... >2018-07-17 09:59:24.046 23 INFO octavia.controller.queue.endpoint [req-8fba3c80-6c76-4c89-8725-9a743b8c431e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '038c250c-6f74-4c2a-ade3-a1ebcbc1a5eb'... >2018-07-17 09:59:25.443 23 INFO octavia.controller.queue.endpoint [req-db17c802-8c00-40cf-992d-4d840a1235f6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9e830434-73c0-4c72-824f-46f38b22fabe'... >2018-07-17 09:59:27.456 23 INFO octavia.controller.queue.endpoint [req-1c36b831-ef29-43f2-aa4c-6e15edc1e9f5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'df86e39e-71ed-4b93-aece-d3e7a4062c37'... >2018-07-17 09:59:28.922 23 INFO octavia.controller.queue.endpoint [req-93a300af-10cd-4af4-a5e9-459c34cc5d88 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'bea7e63b-010c-4371-88ef-471af260c8ba'... >2018-07-17 09:59:30.634 23 INFO octavia.controller.queue.endpoint [req-d75232a1-05fe-4c54-98ec-2cc544502492 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '18871efd-6721-417d-963b-a230e00deed6'... >2018-07-17 09:59:32.046 23 INFO octavia.controller.queue.endpoint [req-6a26b941-bbde-4c9a-bef1-65e3690c8833 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '12aa9ebd-f2ed-415d-beec-a9dc8301fea6'... >2018-07-17 09:59:32.547 23 INFO octavia.controller.queue.endpoint [req-abd95b58-bc20-40c7-8179-9827ba477fcc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '275ab31c-2591-44da-a60b-0d6cf927de00'... >2018-07-17 09:59:34.066 23 INFO octavia.controller.queue.endpoint [req-bba56a6f-154e-412a-b219-117b8c735b05 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5eb6bfea-ef07-4a4c-b2c8-1b62a4b12ed0'... >2018-07-17 09:59:35.387 23 INFO octavia.controller.queue.endpoint [req-d401fe54-a245-42ce-a4cf-07148d699824 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '555ef1da-a63b-433a-9b7c-58854ead07cc'... >2018-07-17 09:59:37.026 23 INFO octavia.controller.queue.endpoint [req-4d4c7f25-4a14-45a7-bac8-2d1ce3ddf82f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '86c39597-8ba8-4398-8f0c-fe4f75812956'... >2018-07-17 09:59:37.879 23 INFO octavia.controller.queue.endpoint [req-62fb5045-bdcf-4a5a-9c6c-1e0b1ff86239 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '76d0d9c7-1d06-442c-a9f5-0525651a6f37'... >2018-07-17 09:59:39.774 23 INFO octavia.controller.queue.endpoint [req-041e2b15-f988-4dcf-aa2f-72eeeaea4d0a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '20e4c22d-ffb2-4457-b149-21a37ed9490c'... >2018-07-17 09:59:42.669 23 INFO octavia.controller.queue.endpoint [req-078aa624-c751-426a-bea0-e3b9e785a5bb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f3993271-4bf2-46e2-ab2e-5370ea278035'... >2018-07-17 09:59:42.897 23 INFO octavia.controller.queue.endpoint [req-2d1244e8-c0fb-4c6d-94eb-dda0490aa11e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '052e0114-e9f8-4016-8d1f-5f6c4ee6b1d0'... >2018-07-17 09:59:44.282 23 INFO octavia.controller.queue.endpoint [req-86bacb5d-9954-4f03-86a1-61e31e2a2bd6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a7defdd6-f2e9-4928-b6a1-3e71c81e4468'... >2018-07-17 10:19:07.686 23 INFO octavia.controller.queue.endpoint [req-1b9d6c49-ccb7-4b4e-b9e3-34834b19d520 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'f477721b-6dc4-4e13-a8fa-9b5198afaa21'... >2018-07-17 10:19:09.357 23 INFO octavia.controller.queue.endpoint [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '0da1e31f-d7b8-4a4a-b367-fc1c37fb3502'... >2018-07-17 10:19:10.491 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-1b9d6c49-ccb7-4b4e-b9e3-34834b19d520 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 476c2764-696f-4e82-8bc2-5495222a7b2e from port 20b1474a-6bbf-4a19-ae05-6b3242adb8d7 >2018-07-17 10:19:10.680 23 INFO octavia.controller.queue.endpoint [req-92e94319-07bc-4f18-a1df-592950a2d20c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '4541884c-a3b9-4caa-a268-d2b35749dfb4'... >2018-07-17 10:19:11.398 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-1b9d6c49-ccb7-4b4e-b9e3-34834b19d520 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 476c2764-696f-4e82-8bc2-5495222a7b2e >2018-07-17 10:19:11.831 23 INFO octavia.controller.queue.endpoint [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '9de294b8-5f78-4f37-a94d-8530393dd919'... >2018-07-17 10:19:12.162 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 9d4596fd-8367-4d1b-8730-a6cca5919afd from port f4c0cac2-63e0-4a75-ba83-053fb557228a >2018-07-17 10:19:12.907 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 9d4596fd-8367-4d1b-8730-a6cca5919afd >2018-07-17 10:19:13.042 23 INFO octavia.controller.queue.endpoint [req-c5621ef3-45a1-46b8-a4a3-0aaa2e29a5a4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'a2ce136b-59ae-4d18-b860-00c21bdf58ab'... >2018-07-17 10:19:13.784 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-92e94319-07bc-4f18-a1df-592950a2d20c - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 858fd926-f667-4271-b4a8-ea0ba7eb50d6 from port 4b92a521-f759-46a6-95a3-81bc91bbebf3 >2018-07-17 10:19:13.798 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 39febb48-0933-4bff-946b-1d4292e35b0f from port 636696aa-a49b-443f-aea6-87e18463a486 >2018-07-17 10:19:14.737 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 39febb48-0933-4bff-946b-1d4292e35b0f >2018-07-17 10:19:15.163 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-92e94319-07bc-4f18-a1df-592950a2d20c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 858fd926-f667-4271-b4a8-ea0ba7eb50d6 >2018-07-17 10:19:15.815 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-c5621ef3-45a1-46b8-a4a3-0aaa2e29a5a4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 516ada84-d2e2-464b-a40a-895be061e503 from port 35a5d6e6-4737-49a7-8776-6bce0570141c >2018-07-17 10:19:16.529 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-c5621ef3-45a1-46b8-a4a3-0aaa2e29a5a4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 516ada84-d2e2-464b-a40a-895be061e503 >2018-07-17 10:20:09.367 23 INFO octavia.controller.queue.endpoint [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '55decb5f-309e-48ef-bace-509e71ab4845'... >2018-07-17 10:20:09.980 23 INFO octavia.controller.worker.tasks.database_tasks [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 56f94f26-d186-4780-8591-6afa9dcb2e36 >2018-07-17 10:20:12.361 23 INFO octavia.controller.queue.endpoint [req-7a18d053-d7d3-4562-8fb5-523803554c22 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '4e95bee7-073a-4e9f-bed1-d398f55e2ca2'... >2018-07-17 10:20:12.862 23 INFO octavia.controller.worker.tasks.database_tasks [req-7a18d053-d7d3-4562-8fb5-523803554c22 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 56f94f26-d186-4780-8591-6afa9dcb2e36 >2018-07-17 10:20:15.891 23 INFO octavia.controller.queue.endpoint [req-92e94319-07bc-4f18-a1df-592950a2d20c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'e0a572c6-43bb-494c-b207-e08772b7a763'... >2018-07-17 10:20:17.162 23 INFO octavia.controller.queue.endpoint [req-b20f7062-c53a-455e-9d28-f5f74d564859 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'be669ac1-b662-4f3b-8b73-cf7db865d389'... >2018-07-17 10:20:17.925 23 INFO octavia.controller.queue.endpoint [req-5738e065-8d8c-4ffc-beee-3b0b25c1996d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '25ddd572-a842-4cc7-8663-5dc090ac9922'... >2018-07-17 10:20:29.591 23 INFO octavia.controller.queue.endpoint [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool '3a3c41fa-4c24-478d-bc62-648d009ed5b6'... >2018-07-17 10:20:30.786 23 INFO octavia.controller.queue.endpoint [req-7a18d053-d7d3-4562-8fb5-523803554c22 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '56f94f26-d186-4780-8591-6afa9dcb2e36'... >2018-07-17 10:20:33.208 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-7a18d053-d7d3-4562-8fb5-523803554c22 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group e6723ce1-a9b9-4060-a0fd-8e771ebf0e2b from port ce15866a-7b19-4e66-a834-4fb889380179 >2018-07-17 10:20:33.914 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-7a18d053-d7d3-4562-8fb5-523803554c22 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group e6723ce1-a9b9-4060-a0fd-8e771ebf0e2b >2018-07-17 10:24:21.019 23 INFO octavia.controller.queue.endpoint [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '287e975b-facc-4c90-9964-c87236b6880b'... >2018-07-17 10:24:21.158 23 INFO octavia.controller.worker.tasks.database_tasks [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 13a06e05-3e85-4cc1-9b33-1c5f399fbd88 >2018-07-17 10:24:21.302 23 INFO octavia.certificates.generator.local [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 10:24:21.302 23 INFO octavia.certificates.generator.local [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 10:24:21.303 23 INFO octavia.certificates.generator.local [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 10:24:21.303 23 INFO octavia.certificates.generator.local [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 10:24:35.788 23 INFO octavia.controller.worker.tasks.database_tasks [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 13a06e05-3e85-4cc1-9b33-1c5f399fbd88 with compute id f214018c-5b0b-4e70-9d65-5a00f5220140 for load balancer: 287e975b-facc-4c90-9964-c87236b6880b >2018-07-17 10:24:36.120 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 81d1c08c-5d59-4863-aa06-b363145c4efb already exists. Nothing to be done. >2018-07-17 10:24:50.630 23 INFO octavia.controller.worker.tasks.database_tasks [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 287e975b-facc-4c90-9964-c87236b6880b >2018-07-17 10:24:51.064 23 INFO octavia.controller.queue.endpoint [req-92e94319-07bc-4f18-a1df-592950a2d20c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '4c3a9771-7972-4998-842a-8cbce05b6017'... >2018-07-17 10:24:52.587 23 INFO octavia.controller.queue.endpoint [req-5dfb6225-2b1c-4bf1-b3e3-01a45ccf7c00 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'ce4861a9-ca7c-429a-b81b-a7cecdcdfbfb'... >2018-07-17 10:24:53.832 23 INFO octavia.controller.queue.endpoint [req-4cb69fd9-e4c2-454c-ad8c-7322d2575502 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'e8a66271-b670-4293-8e9f-3c7ff74eee1b'... >2018-07-17 10:25:16.936 23 INFO octavia.controller.queue.endpoint [req-f98050f7-73e0-4f38-acca-9cf671ade382 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '82a6a8eb-a69f-43e9-96f0-cf54998cb28e'... >2018-07-17 10:25:20.394 23 INFO octavia.controller.queue.endpoint [req-30d9e177-acec-45ef-95f6-4028324e07cd - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '89a8163e-3122-4a7c-ba87-0ba0c2947cd5'... >2018-07-17 10:25:23.525 23 INFO octavia.controller.queue.endpoint [req-c39f691a-7579-4e59-8030-02350b0b49c9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b9265028-5df8-4e38-8db4-54888e5958b6'... >2018-07-17 10:50:31.821 23 INFO octavia.controller.queue.endpoint [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '94aac37b-9356-44fb-a098-c72a02d424eb'... >2018-07-17 10:50:32.088 23 INFO octavia.controller.worker.tasks.database_tasks [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 9e9ba8c5-ac65-4c36-aaf6-4f2bb25f0d66 >2018-07-17 10:50:32.358 23 INFO octavia.certificates.generator.local [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 10:50:32.358 23 INFO octavia.certificates.generator.local [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 10:50:32.358 23 INFO octavia.certificates.generator.local [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 10:50:32.359 23 INFO octavia.certificates.generator.local [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 10:50:32.885 23 INFO octavia.controller.queue.endpoint [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '234e4614-bcfe-4674-b9c4-9435cad6a0b5'... >2018-07-17 10:50:33.035 23 INFO octavia.controller.worker.tasks.database_tasks [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 36802dc8-8851-4141-9bfc-2aa6ac220cb9 >2018-07-17 10:50:33.116 23 INFO octavia.certificates.generator.local [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 10:50:33.117 23 INFO octavia.certificates.generator.local [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 10:50:33.117 23 INFO octavia.certificates.generator.local [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 10:50:33.117 23 INFO octavia.certificates.generator.local [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 10:50:36.185 23 INFO octavia.controller.queue.endpoint [req-296e3546-cb2b-491b-86b6-f6ba900893d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'c3fd2ff5-4976-4e33-b524-bc666b17f10b'... >2018-07-17 10:50:36.398 23 INFO octavia.controller.worker.tasks.database_tasks [req-296e3546-cb2b-491b-86b6-f6ba900893d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 814c2fb2-bce6-40f0-a60e-c731a44f92b0 >2018-07-17 10:50:36.604 23 INFO octavia.certificates.generator.local [req-296e3546-cb2b-491b-86b6-f6ba900893d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 10:50:36.605 23 INFO octavia.certificates.generator.local [req-296e3546-cb2b-491b-86b6-f6ba900893d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 10:50:36.605 23 INFO octavia.certificates.generator.local [req-296e3546-cb2b-491b-86b6-f6ba900893d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 10:50:36.605 23 INFO octavia.certificates.generator.local [req-296e3546-cb2b-491b-86b6-f6ba900893d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 10:50:48.512 23 INFO octavia.controller.worker.tasks.database_tasks [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 9e9ba8c5-ac65-4c36-aaf6-4f2bb25f0d66 with compute id 4be7bc1b-601c-42f0-b429-facd2302d0bd for load balancer: 94aac37b-9356-44fb-a098-c72a02d424eb >2018-07-17 10:50:48.962 23 INFO octavia.controller.worker.tasks.database_tasks [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 36802dc8-8851-4141-9bfc-2aa6ac220cb9 with compute id f21ef3c5-b9b0-4d87-a268-6ea3ef96e049 for load balancer: 234e4614-bcfe-4674-b9c4-9435cad6a0b5 >2018-07-17 10:50:49.358 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 22b1a640-6d50-4083-a195-a1b791ddc861 already exists. Nothing to be done. >2018-07-17 10:50:49.360 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port d16a0f27-f7db-460c-a8fa-44988c23f7dc already exists. Nothing to be done. >2018-07-17 10:50:49.871 23 INFO octavia.controller.worker.tasks.database_tasks [req-296e3546-cb2b-491b-86b6-f6ba900893d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 814c2fb2-bce6-40f0-a60e-c731a44f92b0 with compute id d60a3dbc-797c-4020-b09f-002316ea422c for load balancer: c3fd2ff5-4976-4e33-b524-bc666b17f10b >2018-07-17 10:50:50.184 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-296e3546-cb2b-491b-86b6-f6ba900893d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 28939213-a3d7-45c6-ab35-3209245272bf already exists. Nothing to be done. >2018-07-17 10:51:05.392 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.6', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.210.4 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47080ca590>, 'Connection to 172.24.0.6 timed out. (connect timeout=10.0)')) >2018-07-17 10:51:05.603 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.3', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.42.194 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4708418bd0>, 'Connection to 172.24.0.3 timed out. (connect timeout=10.0)')) >2018-07-17 10:51:08.069 23 INFO octavia.controller.worker.tasks.database_tasks [req-296e3546-cb2b-491b-86b6-f6ba900893d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: c3fd2ff5-4976-4e33-b524-bc666b17f10b >2018-07-17 10:51:15.049 23 INFO octavia.controller.worker.tasks.database_tasks [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 94aac37b-9356-44fb-a098-c72a02d424eb >2018-07-17 10:51:15.232 23 INFO octavia.controller.worker.tasks.database_tasks [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 234e4614-bcfe-4674-b9c4-9435cad6a0b5 >2018-07-17 10:51:16.080 23 INFO octavia.controller.queue.endpoint [req-296e3546-cb2b-491b-86b6-f6ba900893d1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'fc1c5689-7401-4453-b277-a06acfcdcb05'... >2018-07-17 10:51:20.025 23 INFO octavia.controller.queue.endpoint [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '842358f5-0b82-49f8-bfaf-b17a866aaedd'... >2018-07-17 10:51:20.099 23 INFO octavia.controller.queue.endpoint [req-b22985bc-ae7a-4a51-a810-58eb35907940 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '3f88e03c-66ef-41f5-87fa-01a97034d237'... >2018-07-17 10:51:20.243 23 INFO octavia.controller.worker.tasks.database_tasks [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 78c8932b-3604-4954-8d6f-03a7757be5a0 >2018-07-17 10:51:20.446 23 INFO octavia.certificates.generator.local [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 10:51:20.446 23 INFO octavia.certificates.generator.local [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 10:51:20.447 23 INFO octavia.certificates.generator.local [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 10:51:20.447 23 INFO octavia.certificates.generator.local [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 10:51:20.735 23 INFO octavia.controller.queue.endpoint [req-fd93a19f-f036-4488-9f9d-86fe4de651e0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'cbf813bb-ef63-4ac9-8298-b436f3aebf69'... >2018-07-17 10:51:22.152 23 INFO octavia.controller.queue.endpoint [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '9e00b6e0-6846-4637-95ce-aac26c3bd004'... >2018-07-17 10:51:22.287 23 INFO octavia.controller.worker.tasks.database_tasks [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 2658dd97-bf64-42c4-aafd-2c1f7d5537b6 >2018-07-17 10:51:22.387 23 INFO octavia.certificates.generator.local [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 10:51:22.387 23 INFO octavia.certificates.generator.local [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 10:51:22.387 23 INFO octavia.certificates.generator.local [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 10:51:22.388 23 INFO octavia.certificates.generator.local [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 10:51:25.207 23 INFO octavia.controller.queue.endpoint [req-c58e4dee-4dee-407f-9c10-fc1adde63f7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '7f4b0b35-ba8b-4094-a930-6e237ece2cb6'... >2018-07-17 10:51:26.111 23 INFO octavia.controller.queue.endpoint [req-b070c6e3-f4aa-4c32-b2d5-0c51eb40c0ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '85764860-1adc-4408-b2ef-80e5e61bf152'... >2018-07-17 10:51:28.162 23 INFO octavia.controller.queue.endpoint [req-9743f69d-dec0-426a-83c4-1137b8b4e800 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'e8fa96ad-08b0-4a7e-b3f2-2d7c8e5affa7'... >2018-07-17 10:51:29.738 23 INFO octavia.controller.queue.endpoint [req-5f50a30a-8525-49a6-8783-3931640420ba - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '50a4f0d5-c0b9-4997-9411-eea30edad5f8'... >2018-07-17 10:51:31.118 23 INFO octavia.controller.queue.endpoint [req-a737c3d9-503e-4493-a22e-da836dcdd9a0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1e2ada9b-038e-4ca4-85fd-0221960a27ac'... >2018-07-17 10:51:31.997 23 INFO octavia.controller.queue.endpoint [req-0d93d23b-fcd3-4098-8b20-23612dc9ee2e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'bb40f16d-40fd-49b0-b716-ab22e9781841'... >2018-07-17 10:51:32.412 23 INFO octavia.controller.worker.tasks.database_tasks [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 78c8932b-3604-4954-8d6f-03a7757be5a0 with compute id a539146a-41c1-4514-b293-4c4dfd91bd45 for load balancer: 842358f5-0b82-49f8-bfaf-b17a866aaedd >2018-07-17 10:51:32.507 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 23278074-fbc3-4eda-9e01-1ec8403348b2 already exists. Nothing to be done. >2018-07-17 10:51:33.503 23 INFO octavia.controller.queue.endpoint [req-b20f7062-c53a-455e-9d28-f5f74d564859 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'cb3f2ca3-9d89-4c6a-b65f-a70c547bbcb9'... >2018-07-17 10:51:34.122 23 INFO octavia.controller.worker.tasks.database_tasks [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 2658dd97-bf64-42c4-aafd-2c1f7d5537b6 with compute id 5cb0db41-6fd9-431a-837a-a692ee1b56cb for load balancer: 9e00b6e0-6846-4637-95ce-aac26c3bd004 >2018-07-17 10:51:34.217 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 2b48b7ed-7d0f-40be-87aa-96440986f160 already exists. Nothing to be done. >2018-07-17 10:51:36.310 23 INFO octavia.controller.queue.endpoint [req-bf61a74f-0018-4762-b3d5-470c346ee45b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9f2d0864-5e95-4f57-bf88-ddd65f45b8e3'... >2018-07-17 10:51:37.201 23 INFO octavia.controller.queue.endpoint [req-6cce2774-4e9f-44e1-a915-ff838c04a137 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '2b617c46-2c51-4d68-aefe-08324ccf12f9'... >2018-07-17 10:51:38.170 23 INFO octavia.controller.queue.endpoint [req-358b1e0e-f1f4-4e79-adfd-0ccd78c7d35f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '772bcddc-4e26-4da9-a700-b3d0987fa426'... >2018-07-17 10:51:42.381 23 INFO octavia.controller.queue.endpoint [req-2c980232-262f-4f5e-9a40-3bc0ea5bdc98 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'd22d3017-9d10-4313-ac3c-7b56fcc9f64c'... >2018-07-17 10:51:47.413 23 INFO octavia.controller.queue.endpoint [req-b7ad6caa-e0b4-46a9-af61-8a7fb6c9287f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'dbcac8f5-8cbb-4f71-ad58-449a25cc0b95'... >2018-07-17 10:51:51.434 23 INFO octavia.controller.worker.tasks.database_tasks [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 842358f5-0b82-49f8-bfaf-b17a866aaedd >2018-07-17 10:51:52.268 23 INFO octavia.controller.queue.endpoint [req-b4ab1dac-b91d-452c-99c3-6f25e969d367 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'fa3641cb-6494-4b8d-abe2-a749bc6cf517'... >2018-07-17 10:51:53.354 23 INFO octavia.controller.worker.tasks.database_tasks [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 9e00b6e0-6846-4637-95ce-aac26c3bd004 >2018-07-17 10:51:57.172 23 INFO octavia.controller.queue.endpoint [req-020a1999-2fa4-4a72-b8b9-d1e9217aa8c8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'b0a9e65a-a6fa-46d3-a3ec-c52b911f5945'... >2018-07-17 10:51:57.974 23 INFO octavia.controller.queue.endpoint [req-0d19ab31-3819-410a-a124-556e26a1c251 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '629caea4-c806-4c95-ae7f-93a61673876e'... >2018-07-17 10:51:59.386 23 INFO octavia.controller.queue.endpoint [req-1b9d6c49-ccb7-4b4e-b9e3-34834b19d520 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '53b9feb6-21ec-439a-bb3b-d25e4804c1af'... >2018-07-17 10:52:02.836 23 INFO octavia.controller.queue.endpoint [req-7665f5ca-60c8-4e91-8727-8865060d95e2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '61cf9f14-cea2-4c60-a445-3228837f527b'... >2018-07-17 10:52:03.964 23 INFO octavia.controller.queue.endpoint [req-1bba1b82-c41f-44cf-bf25-06e59faa5efb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '78860e9b-afdb-4aa9-9f10-167026b29a61'... >2018-07-17 10:52:05.254 23 INFO octavia.controller.queue.endpoint [req-69c6981c-f122-470d-93a6-6f6baa06f301 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd26141b0-1e48-4c54-a67d-c7f16d960716'... >2018-07-17 10:52:07.387 23 INFO octavia.controller.queue.endpoint [req-1803ae8a-aa4b-4fd4-a1b0-2de8b7ec4591 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '940b0b6a-6681-4e9f-8081-070a57ab4209'... >2018-07-17 10:52:08.790 23 INFO octavia.controller.queue.endpoint [req-eafb1d3d-ca38-406f-ac0a-1a373b6f1330 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '305ca4dd-d27e-4d95-9009-01e1fb948e6e'... >2018-07-17 10:52:09.586 23 INFO octavia.controller.queue.endpoint [req-e3c4427e-a819-474d-bc17-a7ca2950b2e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '3a527b56-43b6-4bb8-a3ae-43f70c15ec1a'... >2018-07-17 10:52:10.547 23 INFO octavia.controller.queue.endpoint [req-4ab07087-855a-4b78-b31b-84ba597a39a3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '00429b7e-e73d-461f-861d-5a33a3de8e52'... >2018-07-17 10:52:13.954 23 INFO octavia.controller.queue.endpoint [req-95aaa938-453f-464d-b3df-f5466614855b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '9ebb42fd-9a65-4313-8192-2cde2aaf05fc'... >2018-07-17 10:52:14.594 23 INFO octavia.controller.queue.endpoint [req-55d4170c-231d-4511-a7f1-e55ba34ac2f1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '55108621-9b13-4877-a272-09285db1f327'... >2018-07-17 10:52:19.177 23 INFO octavia.controller.queue.endpoint [req-0c49e83f-bc2a-4317-b7d8-c9d01bb42b8e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3bfa2a91-2fec-4616-a18f-e16132227e14'... >2018-07-17 10:52:20.465 23 INFO octavia.controller.queue.endpoint [req-e15da143-52b5-434b-9098-54e7f3dfb241 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8dd3814f-5d91-4eb3-ab1e-0a4392df1e0c'... >2018-07-17 10:59:17.531 23 INFO octavia.controller.queue.endpoint [req-007ee782-a7b6-4065-a74f-0197f54fe35d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '234e4614-bcfe-4674-b9c4-9435cad6a0b5'... >2018-07-17 10:59:19.237 23 INFO octavia.controller.queue.endpoint [req-f1acfc24-572c-4fdf-a165-c7b6d6ca24a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '94aac37b-9356-44fb-a098-c72a02d424eb'... >2018-07-17 10:59:20.504 23 INFO octavia.controller.queue.endpoint [req-1a6c55a6-97dd-43cc-bacd-5c2c99c6d18b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '842358f5-0b82-49f8-bfaf-b17a866aaedd'... >2018-07-17 10:59:21.635 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-007ee782-a7b6-4065-a74f-0197f54fe35d - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 67a04ab4-dbd4-4401-b0ed-b61ce458e000 from port 22b1a640-6d50-4083-a195-a1b791ddc861 >2018-07-17 10:59:21.657 23 INFO octavia.controller.queue.endpoint [req-a5e73eee-641c-4481-8212-0859e2dd67d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '9e00b6e0-6846-4637-95ce-aac26c3bd004'... >2018-07-17 10:59:22.886 23 INFO octavia.controller.queue.endpoint [req-df5f6434-f662-4ad9-b5b2-dff420e9a6f4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer 'c3fd2ff5-4976-4e33-b524-bc666b17f10b'... >2018-07-17 10:59:23.668 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f1acfc24-572c-4fdf-a165-c7b6d6ca24a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 9b119191-4f85-4109-9841-082f8d65dcb9 from port d16a0f27-f7db-460c-a8fa-44988c23f7dc >2018-07-17 10:59:23.740 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-007ee782-a7b6-4065-a74f-0197f54fe35d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 67a04ab4-dbd4-4401-b0ed-b61ce458e000 >2018-07-17 10:59:24.747 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-1a6c55a6-97dd-43cc-bacd-5c2c99c6d18b - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group aeb120d9-8ff3-4c24-b8d5-9d68b65166d7 from port 23278074-fbc3-4eda-9e01-1ec8403348b2 >2018-07-17 10:59:25.250 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f1acfc24-572c-4fdf-a165-c7b6d6ca24a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 9b119191-4f85-4109-9841-082f8d65dcb9 >2018-07-17 10:59:26.106 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-1a6c55a6-97dd-43cc-bacd-5c2c99c6d18b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group aeb120d9-8ff3-4c24-b8d5-9d68b65166d7 >2018-07-17 10:59:26.495 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a5e73eee-641c-4481-8212-0859e2dd67d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group e2323cd1-a69a-4f28-877a-27743ec11d3f from port 2b48b7ed-7d0f-40be-87aa-96440986f160 >2018-07-17 10:59:27.561 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-df5f6434-f662-4ad9-b5b2-dff420e9a6f4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 62a47bb6-bf53-42be-96e0-dbd99bc092f2 from port 28939213-a3d7-45c6-ab35-3209245272bf >2018-07-17 10:59:28.102 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a5e73eee-641c-4481-8212-0859e2dd67d5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group e2323cd1-a69a-4f28-877a-27743ec11d3f >2018-07-17 10:59:28.981 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-df5f6434-f662-4ad9-b5b2-dff420e9a6f4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 62a47bb6-bf53-42be-96e0-dbd99bc092f2 >2018-07-17 11:03:40.727 23 INFO octavia.controller.queue.endpoint [req-38d86e3f-9a12-4a99-b046-990872b1fff7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '82a6a8eb-a69f-43e9-96f0-cf54998cb28e'... >2018-07-17 11:03:42.785 23 INFO octavia.controller.queue.endpoint [req-df5f6434-f662-4ad9-b5b2-dff420e9a6f4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '89a8163e-3122-4a7c-ba87-0ba0c2947cd5'... >2018-07-17 11:03:44.018 23 INFO octavia.controller.queue.endpoint [req-06692835-98d9-431d-8e48-ce197d0f2f56 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b9265028-5df8-4e38-8db4-54888e5958b6'... >2018-07-17 11:03:47.387 23 INFO octavia.controller.queue.endpoint [req-5738e065-8d8c-4ffc-beee-3b0b25c1996d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'ce4861a9-ca7c-429a-b81b-a7cecdcdfbfb'... >2018-07-17 11:04:28.201 23 INFO octavia.controller.worker.tasks.database_tasks [req-5738e065-8d8c-4ffc-beee-3b0b25c1996d - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 287e975b-facc-4c90-9964-c87236b6880b >2018-07-17 11:04:28.907 23 INFO octavia.controller.queue.endpoint [req-c3d9c5d4-1fda-4894-a361-3dd9a8611233 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener 'e8a66271-b670-4293-8e9f-3c7ff74eee1b'... >2018-07-17 11:04:32.079 23 INFO octavia.controller.worker.tasks.database_tasks [req-c3d9c5d4-1fda-4894-a361-3dd9a8611233 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 287e975b-facc-4c90-9964-c87236b6880b >2018-07-17 11:04:32.209 23 INFO octavia.controller.queue.endpoint [req-5738e065-8d8c-4ffc-beee-3b0b25c1996d - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool '4c3a9771-7972-4998-842a-8cbce05b6017'... >2018-07-17 11:04:33.373 23 INFO octavia.controller.queue.endpoint [req-c73ec5f0-78a7-4613-a13b-ae70da8506af - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '287e975b-facc-4c90-9964-c87236b6880b'... >2018-07-17 11:04:35.345 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-c73ec5f0-78a7-4613-a13b-ae70da8506af - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 7e598cd0-2908-4b29-8dc2-c4d76338f696 from port 81d1c08c-5d59-4863-aa06-b363145c4efb >2018-07-17 11:04:36.229 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-c73ec5f0-78a7-4613-a13b-ae70da8506af - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 7e598cd0-2908-4b29-8dc2-c4d76338f696 >2018-07-17 11:19:04.752 23 INFO octavia.controller.queue.endpoint [req-007ee782-a7b6-4065-a74f-0197f54fe35d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '78002e9b-2d80-4486-b599-8ed87a460571'... >2018-07-17 11:19:04.892 23 INFO octavia.controller.worker.tasks.database_tasks [req-007ee782-a7b6-4065-a74f-0197f54fe35d - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id aeec8d1b-70ee-42e0-9327-edd837078b46 >2018-07-17 11:19:04.939 23 INFO octavia.certificates.generator.local [req-007ee782-a7b6-4065-a74f-0197f54fe35d - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 11:19:04.940 23 INFO octavia.certificates.generator.local [req-007ee782-a7b6-4065-a74f-0197f54fe35d - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 11:19:04.940 23 INFO octavia.certificates.generator.local [req-007ee782-a7b6-4065-a74f-0197f54fe35d - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 11:19:04.941 23 INFO octavia.certificates.generator.local [req-007ee782-a7b6-4065-a74f-0197f54fe35d - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 11:19:18.642 23 INFO octavia.controller.worker.tasks.database_tasks [req-007ee782-a7b6-4065-a74f-0197f54fe35d - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: aeec8d1b-70ee-42e0-9327-edd837078b46 with compute id f99f8db9-95d9-4db0-8ace-86ae1ff1e45f for load balancer: 78002e9b-2d80-4486-b599-8ed87a460571 >2018-07-17 11:19:18.973 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-007ee782-a7b6-4065-a74f-0197f54fe35d - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 586f02f3-39b0-4db3-b059-396412b734f0 already exists. Nothing to be done. >2018-07-17 11:19:34.669 23 INFO octavia.controller.worker.tasks.database_tasks [req-007ee782-a7b6-4065-a74f-0197f54fe35d - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 78002e9b-2d80-4486-b599-8ed87a460571 >2018-07-17 11:19:35.819 23 INFO octavia.controller.queue.endpoint [req-01fe9aef-fd39-4212-bf9c-5ede40ce60cf - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '0ca0ce7b-58b4-4017-9c20-75dacb4923e1'... >2018-07-17 11:19:37.347 23 INFO octavia.controller.queue.endpoint [req-5738e065-8d8c-4ffc-beee-3b0b25c1996d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '0cac48a3-c48c-411c-ab9f-4e40c9eb0db9'... >2018-07-17 11:19:38.573 23 INFO octavia.controller.queue.endpoint [req-92e94319-07bc-4f18-a1df-592950a2d20c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '37a858e0-b132-4b3f-8e5f-ad7e5cff3897'... >2018-07-17 11:19:59.439 23 INFO octavia.controller.queue.endpoint [req-d303c9ec-acf1-43c9-9514-799f65976d86 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '88c913eb-1b4e-4336-92fe-3224de3a6e1a'... >2018-07-17 11:20:02.987 23 INFO octavia.controller.queue.endpoint [req-191c8386-7fd5-4068-a3b0-b7c24ce0b72d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '31000e70-4074-40e4-9cc2-a5cb90895a76'... >2018-07-17 11:20:03.770 23 INFO octavia.controller.queue.endpoint [req-007ee782-a7b6-4065-a74f-0197f54fe35d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1011c567-96a1-4e70-a8e6-2cc3994882e4'... >2018-07-17 11:33:59.985 23 INFO octavia.controller.queue.endpoint [req-ceab9704-0cd6-4a4e-96f5-9002606c1eba - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '37a858e0-b132-4b3f-8e5f-ad7e5cff3897'... >2018-07-17 11:34:00.818 23 INFO octavia.controller.worker.tasks.database_tasks [req-ceab9704-0cd6-4a4e-96f5-9002606c1eba - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 78002e9b-2d80-4486-b599-8ed87a460571 >2018-07-17 11:34:01.014 23 INFO octavia.controller.queue.endpoint [req-e0541c89-cfdf-4d24-8b00-9b84113c0a96 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting listener '0cac48a3-c48c-411c-ab9f-4e40c9eb0db9'... >2018-07-17 11:34:01.818 23 INFO octavia.controller.worker.tasks.database_tasks [req-e0541c89-cfdf-4d24-8b00-9b84113c0a96 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 78002e9b-2d80-4486-b599-8ed87a460571 >2018-07-17 11:34:02.475 23 INFO octavia.controller.queue.endpoint [req-fea62260-67ce-447e-9a5d-1676a13e4b44 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '88c913eb-1b4e-4336-92fe-3224de3a6e1a'... >2018-07-17 11:34:02.791 23 INFO octavia.controller.queue.endpoint [req-e0541c89-cfdf-4d24-8b00-9b84113c0a96 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '31000e70-4074-40e4-9cc2-a5cb90895a76'... >2018-07-17 11:34:03.743 23 INFO octavia.controller.queue.endpoint [req-ceab9704-0cd6-4a4e-96f5-9002606c1eba - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '1011c567-96a1-4e70-a8e6-2cc3994882e4'... >2018-07-17 11:34:16.411 23 INFO octavia.controller.queue.endpoint [req-426b5a6c-c2c7-4c38-9633-55f7eb4bb4e7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting pool '0ca0ce7b-58b4-4017-9c20-75dacb4923e1'... >2018-07-17 11:34:17.570 23 INFO octavia.controller.queue.endpoint [req-38b8c116-d537-4b37-b3e1-814c1ba0b76c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting load balancer '78002e9b-2d80-4486-b599-8ed87a460571'... >2018-07-17 11:34:20.073 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-38b8c116-d537-4b37-b3e1-814c1ba0b76c - 293061856e1a4cffbae3ed099cf4f619 - - -] Removing security group 67b320e5-93f4-4afd-b911-7690e58b7a21 from port 586f02f3-39b0-4db3-b059-396412b734f0 >2018-07-17 11:34:20.931 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-38b8c116-d537-4b37-b3e1-814c1ba0b76c - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleted security group 67b320e5-93f4-4afd-b911-7690e58b7a21 >2018-07-17 11:57:04.872 23 INFO octavia.controller.queue.endpoint [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '8d50f5b0-7cad-4377-9909-83504b7616e7'... >2018-07-17 11:57:05.000 23 INFO octavia.controller.worker.tasks.database_tasks [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 0aa81b91-7623-46e2-a249-618fe3333586 >2018-07-17 11:57:05.284 23 INFO octavia.certificates.generator.local [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 11:57:05.284 23 INFO octavia.certificates.generator.local [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 11:57:05.285 23 INFO octavia.certificates.generator.local [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 11:57:05.285 23 INFO octavia.certificates.generator.local [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 11:57:22.541 23 INFO octavia.controller.worker.tasks.database_tasks [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 0aa81b91-7623-46e2-a249-618fe3333586 with compute id 19ac2cd7-7645-4d6d-b96e-000005db9e24 for load balancer: 8d50f5b0-7cad-4377-9909-83504b7616e7 >2018-07-17 11:57:23.391 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Port fb0439f2-62c9-4149-b67f-cb8ac0541abb already exists. Nothing to be done. >2018-07-17 11:57:37.775 23 INFO octavia.controller.worker.tasks.database_tasks [req-dbfce9d4-d71c-48f4-866b-07996d17237b - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 8d50f5b0-7cad-4377-9909-83504b7616e7 >2018-07-17 11:57:38.999 23 INFO octavia.controller.queue.endpoint [req-09b5ba61-0eec-4225-817b-dc582b630b7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'e3af10ba-200f-4720-b0a5-ad4c8c9e26e4'... >2018-07-17 11:57:40.604 23 INFO octavia.controller.queue.endpoint [req-8e6c52d7-fa7c-40d5-adc5-3250d2671350 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '3b960283-8d52-4aa9-9cbc-7d52c5e32d45'... >2018-07-17 11:57:41.792 23 INFO octavia.controller.queue.endpoint [req-fea62260-67ce-447e-9a5d-1676a13e4b44 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'ce7f59d5-3f99-4471-bab6-9128d1fcbd33'... >2018-07-17 11:58:05.158 23 INFO octavia.controller.queue.endpoint [req-14e2523c-aa25-47ff-9f2a-636d8e4c0f9c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a1eeeaa7-c120-490f-97a0-86b067996171'... >2018-07-17 11:58:08.470 23 INFO octavia.controller.queue.endpoint [req-96516e89-e3aa-4a3b-9922-d1bfa2e33d5e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b5df3579-5bb9-47f4-b89d-760472247fc0'... >2018-07-17 11:58:09.195 23 INFO octavia.controller.queue.endpoint [req-9527a879-080f-4aba-8a99-cbd9720a4c6e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '70369067-845f-4651-a3b8-97f946171016'... >2018-07-17 12:23:45.449 23 INFO octavia.controller.queue.endpoint [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'd7feacc7-37c5-48b0-9a70-5a784a6069df'... >2018-07-17 12:23:45.577 23 INFO octavia.controller.worker.tasks.database_tasks [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 41dab5c6-7bb3-4e0b-a713-ee7a5df82492 >2018-07-17 12:23:45.819 23 INFO octavia.certificates.generator.local [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 12:23:45.820 23 INFO octavia.certificates.generator.local [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 12:23:45.820 23 INFO octavia.certificates.generator.local [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 12:23:45.821 23 INFO octavia.certificates.generator.local [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 12:23:48.454 23 INFO octavia.controller.queue.endpoint [req-4825a574-8fa3-43f9-aad6-e0d8f27730b6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '855f438d-5937-4d6a-a3ec-0acc1d197e96'... >2018-07-17 12:23:48.576 23 INFO octavia.controller.worker.tasks.database_tasks [req-4825a574-8fa3-43f9-aad6-e0d8f27730b6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id fc8df28b-ae56-461b-924c-82e733ce88d2 >2018-07-17 12:23:48.649 23 INFO octavia.certificates.generator.local [req-4825a574-8fa3-43f9-aad6-e0d8f27730b6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 12:23:48.649 23 INFO octavia.certificates.generator.local [req-4825a574-8fa3-43f9-aad6-e0d8f27730b6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 12:23:48.649 23 INFO octavia.certificates.generator.local [req-4825a574-8fa3-43f9-aad6-e0d8f27730b6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 12:23:48.650 23 INFO octavia.certificates.generator.local [req-4825a574-8fa3-43f9-aad6-e0d8f27730b6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 12:23:58.106 23 INFO octavia.controller.queue.endpoint [req-94ef86ee-0fe1-4041-843d-5c6083381e6b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'd1175de2-31e5-4be6-adda-ae2b9912b84f'... >2018-07-17 12:23:58.220 23 INFO octavia.controller.worker.tasks.database_tasks [req-94ef86ee-0fe1-4041-843d-5c6083381e6b - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 936dae1f-4990-44c5-bee5-419a170b9779 >2018-07-17 12:23:58.585 23 INFO octavia.certificates.generator.local [req-94ef86ee-0fe1-4041-843d-5c6083381e6b - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 12:23:58.585 23 INFO octavia.certificates.generator.local [req-94ef86ee-0fe1-4041-843d-5c6083381e6b - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 12:23:58.586 23 INFO octavia.certificates.generator.local [req-94ef86ee-0fe1-4041-843d-5c6083381e6b - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 12:23:58.586 23 INFO octavia.certificates.generator.local [req-94ef86ee-0fe1-4041-843d-5c6083381e6b - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 12:23:58.696 23 INFO octavia.controller.worker.tasks.database_tasks [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 41dab5c6-7bb3-4e0b-a713-ee7a5df82492 with compute id 0db65952-9e4c-49aa-b2fb-8485ee405af1 for load balancer: d7feacc7-37c5-48b0-9a70-5a784a6069df >2018-07-17 12:23:58.979 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 08786efa-42bc-4b43-a88b-6729354696df already exists. Nothing to be done. >2018-07-17 12:24:01.844 23 INFO octavia.controller.worker.tasks.database_tasks [req-4825a574-8fa3-43f9-aad6-e0d8f27730b6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: fc8df28b-ae56-461b-924c-82e733ce88d2 with compute id 5c801950-40b0-404f-b373-46bccdbd9d1c for load balancer: 855f438d-5937-4d6a-a3ec-0acc1d197e96 >2018-07-17 12:24:01.941 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-4825a574-8fa3-43f9-aad6-e0d8f27730b6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 6066a62b-c11e-4e01-b66a-71d13c8fcc84 already exists. Nothing to be done. >2018-07-17 12:24:10.439 23 INFO octavia.controller.worker.tasks.database_tasks [req-94ef86ee-0fe1-4041-843d-5c6083381e6b - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 936dae1f-4990-44c5-bee5-419a170b9779 with compute id 28872a20-6940-40b2-9567-f12efd81ef5a for load balancer: d1175de2-31e5-4be6-adda-ae2b9912b84f >2018-07-17 12:24:10.537 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-94ef86ee-0fe1-4041-843d-5c6083381e6b - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 7e04ccf6-bb1d-4dc4-bfec-2fb9b65d7466 already exists. Nothing to be done. >2018-07-17 12:24:14.950 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.11', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.238.108 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470043b390>, 'Connection to 172.24.0.11 timed out. (connect timeout=10.0)')) >2018-07-17 12:24:18.049 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-4825a574-8fa3-43f9-aad6-e0d8f27730b6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.7', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.136.198 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470058c690>, 'Connection to 172.24.0.7 timed out. (connect timeout=10.0)')) >2018-07-17 12:24:24.529 23 INFO octavia.controller.worker.tasks.database_tasks [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: d7feacc7-37c5-48b0-9a70-5a784a6069df >2018-07-17 12:24:25.117 23 INFO octavia.controller.queue.endpoint [req-552d2ab9-b63e-40d9-b6a9-aa1514906a3f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '542e732c-37d6-42b0-8c23-7f45cc899142'... >2018-07-17 12:24:27.610 23 INFO octavia.controller.worker.tasks.database_tasks [req-4825a574-8fa3-43f9-aad6-e0d8f27730b6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 855f438d-5937-4d6a-a3ec-0acc1d197e96 >2018-07-17 12:24:27.777 23 INFO octavia.controller.worker.tasks.database_tasks [req-94ef86ee-0fe1-4041-843d-5c6083381e6b - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: d1175de2-31e5-4be6-adda-ae2b9912b84f >2018-07-17 12:24:28.666 23 INFO octavia.controller.queue.endpoint [req-c3d9c5d4-1fda-4894-a361-3dd9a8611233 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '738a4f59-d7a4-4cb6-8245-2ba60915695d'... >2018-07-17 12:24:30.176 23 INFO octavia.controller.queue.endpoint [req-ceab9704-0cd6-4a4e-96f5-9002606c1eba - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'a6aaed33-807c-44aa-8eb3-a756fc80f81f'... >2018-07-17 12:24:34.098 23 INFO octavia.controller.queue.endpoint [req-09b5ba61-0eec-4225-817b-dc582b630b7c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '8cae83a1-c755-4a09-9b7f-e2193e007345'... >2018-07-17 12:24:35.752 23 INFO octavia.controller.queue.endpoint [req-bc803d31-f34a-4624-98bf-903280a12876 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ed65156c-f963-4bc8-98c3-478eb0335d26'... >2018-07-17 12:24:38.608 23 INFO octavia.controller.queue.endpoint [req-2215a677-ee37-4c18-a147-15b9f6e5342a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'dd85ff82-0fd0-414f-985e-6da98343936b'... >2018-07-17 12:24:38.908 23 INFO octavia.controller.queue.endpoint [req-65c0f222-c50c-4480-a21a-0edb07481c6e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '37bd898e-a679-46ca-bc32-773f8d84963b'... >2018-07-17 12:24:43.771 23 INFO octavia.controller.queue.endpoint [req-28675102-a848-4953-b517-95f40a47bf87 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '2c30c8d1-46bf-4eb0-b4e7-22a447d42ac8'... >2018-07-17 12:24:43.915 23 INFO octavia.controller.queue.endpoint [req-426b5a6c-c2c7-4c38-9633-55f7eb4bb4e7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '6a039b5a-251f-46c0-8d28-a894284b8555'... >2018-07-17 12:24:49.171 23 INFO octavia.controller.queue.endpoint [req-5129ee07-1b09-4936-bd1b-8d195bfb2094 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '0d87e9ba-e781-4c85-a868-066244973ef8'... >2018-07-17 12:24:49.706 23 INFO octavia.controller.queue.endpoint [req-c6b2fbb2-5ef2-4195-9d9a-611d45b88bf3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'edd05164-92ef-4cdf-834a-bbaead353565'... >2018-07-17 12:24:51.087 23 INFO octavia.controller.queue.endpoint [req-67f31a3b-0bbc-4f80-83f5-5bd05c0264a2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd20f9daf-edad-4d76-b2aa-88f954aa591f'... >2018-07-17 12:24:53.923 23 INFO octavia.controller.queue.endpoint [req-4434002e-f5ef-414f-a33b-dd206ca49319 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '49783b60-30ae-4553-92f0-efee11924c09'... >2018-07-17 12:24:54.062 23 INFO octavia.controller.worker.tasks.database_tasks [req-4434002e-f5ef-414f-a33b-dd206ca49319 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 91af952c-62e8-4b31-abda-37aae4cdb7ae >2018-07-17 12:24:54.257 23 INFO octavia.certificates.generator.local [req-4434002e-f5ef-414f-a33b-dd206ca49319 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 12:24:54.257 23 INFO octavia.certificates.generator.local [req-4434002e-f5ef-414f-a33b-dd206ca49319 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 12:24:54.258 23 INFO octavia.certificates.generator.local [req-4434002e-f5ef-414f-a33b-dd206ca49319 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 12:24:54.258 23 INFO octavia.certificates.generator.local [req-4434002e-f5ef-414f-a33b-dd206ca49319 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 12:24:54.935 23 INFO octavia.controller.queue.endpoint [req-679c476c-9a12-4f72-82ae-9b8866830eac - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '8998331a-a715-4de9-b89d-c29ea22e3c1c'... >2018-07-17 12:24:55.064 23 INFO octavia.controller.worker.tasks.database_tasks [req-679c476c-9a12-4f72-82ae-9b8866830eac - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id e2bb063d-76ca-41b1-9cd1-f436598a3c02 >2018-07-17 12:24:55.222 23 INFO octavia.controller.queue.endpoint [req-37e227d0-d0ff-4d95-8188-40485c0707bd - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '83e1a93e-7999-4506-be9c-032377153b39'... >2018-07-17 12:24:55.278 23 INFO octavia.certificates.generator.local [req-679c476c-9a12-4f72-82ae-9b8866830eac - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-17 12:24:55.278 23 INFO octavia.certificates.generator.local [req-679c476c-9a12-4f72-82ae-9b8866830eac - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-17 12:24:55.279 23 INFO octavia.certificates.generator.local [req-679c476c-9a12-4f72-82ae-9b8866830eac - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-17 12:24:55.280 23 INFO octavia.certificates.generator.local [req-679c476c-9a12-4f72-82ae-9b8866830eac - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-17 12:24:56.506 23 INFO octavia.controller.queue.endpoint [req-13b2029e-77a4-4c30-9cde-7a3431664037 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f1e61808-5862-4b5c-bd54-e036b348e3ed'... >2018-07-17 12:25:00.825 23 INFO octavia.controller.queue.endpoint [req-b8d0f58e-af50-493c-8974-5d3ee1d3ae39 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'dcba54ca-2102-466e-bd5f-37dbab39ccc4'... >2018-07-17 12:25:05.392 23 INFO octavia.controller.queue.endpoint [req-9391267e-cb07-46ed-b418-5362e76ff552 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '19a1c694-a82b-40ff-b9f5-59a372262c3a'... >2018-07-17 12:25:06.552 23 INFO octavia.controller.worker.tasks.database_tasks [req-4434002e-f5ef-414f-a33b-dd206ca49319 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 91af952c-62e8-4b31-abda-37aae4cdb7ae with compute id e1af0daa-2504-47ff-bf38-82e6bf13571a for load balancer: 49783b60-30ae-4553-92f0-efee11924c09 >2018-07-17 12:25:06.642 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-4434002e-f5ef-414f-a33b-dd206ca49319 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port be6e2ca9-1365-4042-9b99-fb710b248b51 already exists. Nothing to be done. >2018-07-17 12:25:08.332 23 INFO octavia.controller.worker.tasks.database_tasks [req-679c476c-9a12-4f72-82ae-9b8866830eac - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: e2bb063d-76ca-41b1-9cd1-f436598a3c02 with compute id 01c38a62-1b4d-4bf3-8535-52114abc94f5 for load balancer: 8998331a-a715-4de9-b89d-c29ea22e3c1c >2018-07-17 12:25:08.424 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-679c476c-9a12-4f72-82ae-9b8866830eac - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 4a2f7f94-b331-4cec-a633-4d612c6c1fba already exists. Nothing to be done. >2018-07-17 12:25:10.932 23 INFO octavia.controller.queue.endpoint [req-c5efa5fe-7433-4203-83ed-d82aa949f7cb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '259757a7-a765-4ef0-942c-42fd477a3e53'... >2018-07-17 12:25:12.342 23 INFO octavia.controller.queue.endpoint [req-01fe9aef-fd39-4212-bf9c-5ede40ce60cf - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'fcd2d5bd-9e34-447d-ad86-95dc9433ed62'... >2018-07-17 12:25:17.577 23 INFO octavia.controller.queue.endpoint [req-1ecf79c0-eff1-4e7b-8fd3-677567e50c87 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '188e4ccc-cc20-4b70-b5f8-1689f2f0a350'... >2018-07-17 12:25:22.696 23 INFO octavia.controller.queue.endpoint [req-8beee710-1ca3-439d-8aa3-b454a02a311d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '34f65364-e39d-430b-a136-96cb0162feb8'... >2018-07-17 12:25:24.644 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-679c476c-9a12-4f72-82ae-9b8866830eac - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.8', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.172.198 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470065d290>, 'Connection to 172.24.0.8 timed out. (connect timeout=10.0)')) >2018-07-17 12:25:25.029 23 INFO octavia.controller.worker.tasks.database_tasks [req-4434002e-f5ef-414f-a33b-dd206ca49319 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 49783b60-30ae-4553-92f0-efee11924c09 >2018-07-17 12:25:33.846 23 INFO octavia.controller.queue.endpoint [req-94ef86ee-0fe1-4041-843d-5c6083381e6b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'd6a0f5ce-dc47-4930-aeaf-20ec886b047c'... >2018-07-17 12:25:34.258 23 INFO octavia.controller.worker.tasks.database_tasks [req-679c476c-9a12-4f72-82ae-9b8866830eac - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 8998331a-a715-4de9-b89d-c29ea22e3c1c >2018-07-17 12:25:38.945 23 INFO octavia.controller.queue.endpoint [req-18f58095-cb53-42a5-98ce-956eba90171f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'e2786616-b787-437f-b647-8afff88928f7'... >2018-07-17 12:25:44.349 23 INFO octavia.controller.queue.endpoint [req-d9754701-3dee-4f26-83da-990a40486ef5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '97d9daa8-9fe8-4517-8b99-90e98a239d1d'... >2018-07-17 12:25:45.635 23 INFO octavia.controller.queue.endpoint [req-7a18d053-d7d3-4562-8fb5-523803554c22 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd9b7497c-eff8-489e-ad8b-3f48a5963ee6'... >2018-07-17 12:25:46.285 23 INFO octavia.controller.queue.endpoint [req-c25e09b9-e8d6-414c-b515-5baec78b10e1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '0d9b8423-7d06-435d-ba1f-5609f6b9f873'... >2018-07-17 12:25:51.086 23 INFO octavia.controller.queue.endpoint [req-9a935beb-75cd-4955-b6f2-f297f1d421ac - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '71d33c21-cfdb-4e41-939d-2a1827bb7476'... >2018-07-17 12:25:51.551 23 INFO octavia.controller.queue.endpoint [req-f70e43c3-c66c-40a9-bbc5-36b2fed8a14f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '7b988d44-e325-4de7-9d79-dce10537daba'... >2018-07-17 12:25:56.707 23 INFO octavia.controller.queue.endpoint [req-81fa4d4b-c8a2-4b8d-98c1-512bc1fc7969 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'df786ac8-f771-4491-94de-7a09a81dfd10'... >2018-07-17 12:25:58.008 23 INFO octavia.controller.queue.endpoint [req-69f29db7-5e11-4ecd-8dc4-fbfe323ada01 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5a70dd45-36ed-46f9-a65d-44ce2b265776'... >2018-07-17 12:26:03.034 23 INFO octavia.controller.queue.endpoint [req-38b8c116-d537-4b37-b3e1-814c1ba0b76c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c203a5ca-630b-4652-b918-320b952ffdff'... >2018-07-18 02:04:34.874 23 INFO octavia.controller.queue.endpoint [req-c22c70e5-e2df-4579-9a7d-d4eb93901d8f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'd9b7497c-eff8-489e-ad8b-3f48a5963ee6'... >2018-07-18 02:04:51.368 23 INFO octavia.controller.queue.endpoint [req-a9c2add9-c0af-4a54-93b2-539597ef0133 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '97d9daa8-9fe8-4517-8b99-90e98a239d1d'... >2018-07-18 02:04:57.370 23 INFO octavia.controller.queue.endpoint [req-e0541c89-cfdf-4d24-8b00-9b84113c0a96 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '827b8da1-8aee-4378-87c6-f140ecda212a'... >2018-07-18 02:04:59.175 23 INFO octavia.controller.queue.endpoint [req-679c476c-9a12-4f72-82ae-9b8866830eac - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '71d33c21-cfdb-4e41-939d-2a1827bb7476'... >2018-07-18 02:05:04.263 23 INFO octavia.controller.queue.endpoint [req-a38e42e5-edce-4a15-abe2-43b28527caee - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'd8b338b5-dd59-4bb1-8eb7-3f5c68792a05'... >2018-07-18 02:05:06.028 23 INFO octavia.controller.queue.endpoint [req-6462d614-4c54-4ea5-ac75-3fc51f520124 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'fc58be6d-463a-4912-8f9a-2685ce011f6b'... >2018-07-18 05:59:56.459 23 INFO octavia.controller.queue.endpoint [req-52367226-4950-4fc5-8293-f8235af56095 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'eb5bc09f-d90a-4c46-a1a2-cf3677b1c817'... >2018-07-18 05:59:56.582 23 INFO octavia.controller.worker.tasks.database_tasks [req-52367226-4950-4fc5-8293-f8235af56095 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id db499ab8-e85f-4147-9c82-9ea8335087bd >2018-07-18 05:59:56.801 23 INFO octavia.certificates.generator.local [req-52367226-4950-4fc5-8293-f8235af56095 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 05:59:56.801 23 INFO octavia.certificates.generator.local [req-52367226-4950-4fc5-8293-f8235af56095 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 05:59:56.802 23 INFO octavia.certificates.generator.local [req-52367226-4950-4fc5-8293-f8235af56095 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 05:59:56.802 23 INFO octavia.certificates.generator.local [req-52367226-4950-4fc5-8293-f8235af56095 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 06:00:11.487 23 INFO octavia.controller.worker.tasks.database_tasks [req-52367226-4950-4fc5-8293-f8235af56095 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: db499ab8-e85f-4147-9c82-9ea8335087bd with compute id 308fda29-f70b-4c79-b229-1de85fc1ce7d for load balancer: eb5bc09f-d90a-4c46-a1a2-cf3677b1c817 >2018-07-18 06:00:12.307 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-52367226-4950-4fc5-8293-f8235af56095 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 2b2968d2-04f1-4dd0-9066-862fe4627d3b already exists. Nothing to be done. >2018-07-18 06:00:28.204 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-52367226-4950-4fc5-8293-f8235af56095 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.18', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.179.49 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4708425cd0>, 'Connection to 172.24.0.18 timed out. (connect timeout=10.0)')) >2018-07-18 06:00:37.849 23 INFO octavia.controller.worker.tasks.database_tasks [req-52367226-4950-4fc5-8293-f8235af56095 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: eb5bc09f-d90a-4c46-a1a2-cf3677b1c817 >2018-07-18 06:00:51.860 23 INFO octavia.controller.queue.endpoint [req-52367226-4950-4fc5-8293-f8235af56095 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '2d920b88-dd24-4c69-a09b-6595c60835c6'... >2018-07-18 06:00:56.717 23 INFO octavia.controller.queue.endpoint [req-a8cddebb-cbfc-4dee-acf5-57fe78c44480 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'fc4c8077-5fc5-4c2c-aaa9-6d325b0142e8'... >2018-07-18 06:01:02.026 23 INFO octavia.controller.queue.endpoint [req-bd49cc9e-1616-4b60-8b29-04ef18c45c0f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6eeaf292-8971-4251-8085-d77d443fd5bc'... >2018-07-18 06:01:03.360 23 INFO octavia.controller.queue.endpoint [req-3aef6359-e73c-407a-ac51-074d99c709c0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '84ff7406-b37c-475f-90c2-eebd9f7e305a'... >2018-07-18 06:02:18.880 23 INFO octavia.controller.queue.endpoint [req-0a84fb9f-e06d-44a4-b290-b6a1be625fee - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'd706e702-a10d-4db9-8a63-263cff8fbc39'... >2018-07-18 06:02:19.006 23 INFO octavia.controller.worker.tasks.database_tasks [req-0a84fb9f-e06d-44a4-b290-b6a1be625fee - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 64cbeb3c-e1bd-4660-9c85-8f3d39eb1990 >2018-07-18 06:02:19.403 23 INFO octavia.certificates.generator.local [req-0a84fb9f-e06d-44a4-b290-b6a1be625fee - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 06:02:19.404 23 INFO octavia.certificates.generator.local [req-0a84fb9f-e06d-44a4-b290-b6a1be625fee - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 06:02:19.404 23 INFO octavia.certificates.generator.local [req-0a84fb9f-e06d-44a4-b290-b6a1be625fee - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 06:02:19.405 23 INFO octavia.certificates.generator.local [req-0a84fb9f-e06d-44a4-b290-b6a1be625fee - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 06:02:32.254 23 INFO octavia.controller.worker.tasks.database_tasks [req-0a84fb9f-e06d-44a4-b290-b6a1be625fee - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 64cbeb3c-e1bd-4660-9c85-8f3d39eb1990 with compute id b06bb2ed-5b80-4f70-b1ce-c1f4ff617f07 for load balancer: d706e702-a10d-4db9-8a63-263cff8fbc39 >2018-07-18 06:02:32.553 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-0a84fb9f-e06d-44a4-b290-b6a1be625fee - 293061856e1a4cffbae3ed099cf4f619 - - -] Port f33a415c-8c54-4c75-bceb-764cbce81c94 already exists. Nothing to be done. >2018-07-18 06:02:49.778 23 INFO octavia.controller.worker.tasks.database_tasks [req-0a84fb9f-e06d-44a4-b290-b6a1be625fee - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: d706e702-a10d-4db9-8a63-263cff8fbc39 >2018-07-18 06:02:50.753 23 INFO octavia.controller.queue.endpoint [req-0a84fb9f-e06d-44a4-b290-b6a1be625fee - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8151c08b-283f-4f4e-b25e-02fef2b21a2b'... >2018-07-18 06:02:56.849 23 INFO octavia.controller.queue.endpoint [req-7d3ad96d-7ea9-4392-88ac-cc2dd2484221 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'a23551a2-1f41-4747-bbf3-bf508e34ea68'... >2018-07-18 06:03:00.602 23 INFO octavia.controller.queue.endpoint [req-b6a6a54b-3d5d-4a2a-b915-0be0e27e4473 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '84ff7406-b37c-475f-90c2-eebd9f7e305a'... >2018-07-18 06:03:01.654 23 INFO octavia.controller.queue.endpoint [req-f98d156a-5cbd-43a8-a458-8aa4de9ee78b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'de892363-77d2-48ca-995d-ed552ec75332'... >2018-07-18 06:03:07.228 23 INFO octavia.controller.queue.endpoint [req-b039a252-021a-46df-a020-14ffe9e8954c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ec423d13-4629-4b11-bd9d-d83e24d33bd6'... >2018-07-18 06:03:07.356 23 INFO octavia.controller.queue.endpoint [req-0f0f89fd-2115-4af1-a840-e198e3601ec8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '6eeaf292-8971-4251-8085-d77d443fd5bc'... >2018-07-18 06:03:11.953 23 INFO octavia.controller.queue.endpoint [req-38527fb3-8a22-4bdd-9849-4f8d37f80a0f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '984030ef-a79a-4cea-9a3c-d07afde1c4e1'... >2018-07-18 06:03:34.728 23 INFO octavia.controller.queue.endpoint [req-89e53ae3-2733-49d9-9c47-2f56ad6a5c35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'c1bcef5c-ebdc-47db-9b5b-56682f55e72f'... >2018-07-18 06:03:34.840 23 INFO octavia.controller.worker.tasks.database_tasks [req-89e53ae3-2733-49d9-9c47-2f56ad6a5c35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id d281d3b7-086e-414f-93f8-10a82c01700c >2018-07-18 06:03:34.905 23 INFO octavia.certificates.generator.local [req-89e53ae3-2733-49d9-9c47-2f56ad6a5c35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 06:03:34.906 23 INFO octavia.certificates.generator.local [req-89e53ae3-2733-49d9-9c47-2f56ad6a5c35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 06:03:34.906 23 INFO octavia.certificates.generator.local [req-89e53ae3-2733-49d9-9c47-2f56ad6a5c35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 06:03:34.907 23 INFO octavia.certificates.generator.local [req-89e53ae3-2733-49d9-9c47-2f56ad6a5c35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 06:03:48.155 23 INFO octavia.controller.worker.tasks.database_tasks [req-89e53ae3-2733-49d9-9c47-2f56ad6a5c35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: d281d3b7-086e-414f-93f8-10a82c01700c with compute id 510672a8-3a6f-4cd6-ae79-5b19374b01e4 for load balancer: c1bcef5c-ebdc-47db-9b5b-56682f55e72f >2018-07-18 06:03:48.370 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-89e53ae3-2733-49d9-9c47-2f56ad6a5c35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 63cef2e6-424a-4687-8ee4-4e5b8927ca10 already exists. Nothing to be done. >2018-07-18 06:04:06.254 23 INFO octavia.controller.worker.tasks.database_tasks [req-89e53ae3-2733-49d9-9c47-2f56ad6a5c35 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: c1bcef5c-ebdc-47db-9b5b-56682f55e72f >2018-07-18 06:04:10.707 23 INFO octavia.controller.queue.endpoint [req-6d592eb9-a385-4942-bcd5-8e08c4de64e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'c3f0faf2-46cf-416e-8ed5-c4ac742eed6e'... >2018-07-18 06:04:11.157 23 INFO octavia.controller.queue.endpoint [req-c3cfdf22-ec09-4fe0-b309-c864d7af7535 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '984030ef-a79a-4cea-9a3c-d07afde1c4e1'... >2018-07-18 06:04:16.011 23 INFO octavia.controller.queue.endpoint [req-b7a698dd-0da2-480e-9896-319628a0d5ec - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'ab841d1a-0701-4cdf-96fe-cfa91260efe9'... >2018-07-18 06:04:21.572 23 INFO octavia.controller.queue.endpoint [req-52c2c179-b1ac-4572-b46a-421cb40bb38b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4e3222f2-b020-491b-b3aa-5ad0b6f57f97'... >2018-07-18 06:04:21.669 23 INFO octavia.controller.queue.endpoint [req-7a2cbf3a-05f5-4f5d-a7bb-d0b1f941bdfd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '8151c08b-283f-4f4e-b25e-02fef2b21a2b'... >2018-07-18 06:04:26.615 23 INFO octavia.controller.queue.endpoint [req-6a18e402-4e24-46fa-b4c4-e26e6e2080cc - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'bdc06c90-b99f-49e3-aff9-efe34a81d753'... >2018-07-18 06:05:38.071 23 INFO octavia.controller.queue.endpoint [req-ebc0d95d-1ee4-49f9-b4c7-1c40f35e4540 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '95eb82cc-0414-464e-b843-0c2537f9fb30'... >2018-07-18 06:06:56.136 23 INFO octavia.controller.queue.endpoint [req-98f3b0b7-7333-4b41-b4ab-cc9a8a677e15 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '95eb82cc-0414-464e-b843-0c2537f9fb30'... >2018-07-18 06:07:01.272 23 INFO octavia.controller.queue.endpoint [req-032fb5a0-e6ac-4d37-bc54-427b48b3cd6d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '7408939e-0433-44ea-804f-fbed86de8b27'... >2018-07-18 06:07:02.410 23 INFO octavia.controller.queue.endpoint [req-7e46f6c9-3265-48a6-b6fe-915c5687bda9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'bdc06c90-b99f-49e3-aff9-efe34a81d753'... >2018-07-18 06:07:07.456 23 INFO octavia.controller.queue.endpoint [req-93eab25a-4d1a-44d6-bd6f-34602ae4bb32 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '061a4356-3a9a-414c-8c49-68287c78bdc6'... >2018-07-18 06:07:22.614 23 INFO octavia.controller.queue.endpoint [req-78484b50-48f8-4e38-bc4a-ded069137367 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'aaecb681-cb13-46bb-9eee-0e771e025051'... >2018-07-18 06:07:23.544 23 INFO octavia.controller.queue.endpoint [req-e3e87e48-762d-49d9-bc66-30dec0cf5a42 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '4ad4994d-ae58-460c-b3f9-d05ef27e3428'... >2018-07-18 06:09:41.718 23 INFO octavia.controller.queue.endpoint [req-1a6c55a6-97dd-43cc-bacd-5c2c99c6d18b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8d513bfe-5c8a-4a58-84cd-0dd777af692b'... >2018-07-18 06:09:52.503 23 INFO octavia.controller.queue.endpoint [req-b8bb7382-aae2-41c0-be80-b2f383692ebd - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '4ad4994d-ae58-460c-b3f9-d05ef27e3428'... >2018-07-18 06:09:58.938 23 INFO octavia.controller.queue.endpoint [req-d45aaa99-04db-4fe0-aab1-7cc24fa2b9c1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'aaecb681-cb13-46bb-9eee-0e771e025051'... >2018-07-18 06:10:04.522 23 INFO octavia.controller.queue.endpoint [req-9b9bcb2e-6a69-424a-aa16-3eae24d47bec - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3a6f9958-b4a2-49ff-8585-9d543fc1ec7f'... >2018-07-18 06:15:37.202 23 INFO octavia.controller.queue.endpoint [req-bb71040c-4406-4de6-aa6a-eabfae4bb927 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'eec0a1ed-4eb2-42d2-bef9-ecc5cc2c4272'... >2018-07-18 06:15:37.356 23 INFO octavia.controller.worker.tasks.database_tasks [req-bb71040c-4406-4de6-aa6a-eabfae4bb927 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 823a206c-0daa-436b-8d80-9a3d52fec871 >2018-07-18 06:15:37.444 23 INFO octavia.certificates.generator.local [req-bb71040c-4406-4de6-aa6a-eabfae4bb927 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 06:15:37.445 23 INFO octavia.certificates.generator.local [req-bb71040c-4406-4de6-aa6a-eabfae4bb927 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 06:15:37.445 23 INFO octavia.certificates.generator.local [req-bb71040c-4406-4de6-aa6a-eabfae4bb927 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 06:15:37.446 23 INFO octavia.certificates.generator.local [req-bb71040c-4406-4de6-aa6a-eabfae4bb927 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 06:15:38.521 23 INFO octavia.controller.queue.endpoint [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '5735b64d-a600-43b0-a939-c950490e4fce'... >2018-07-18 06:15:38.634 23 INFO octavia.controller.worker.tasks.database_tasks [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 3f985bc8-6e9f-43e7-8c96-df157808a079 >2018-07-18 06:15:38.830 23 INFO octavia.certificates.generator.local [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 06:15:38.830 23 INFO octavia.certificates.generator.local [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 06:15:38.831 23 INFO octavia.certificates.generator.local [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 06:15:38.831 23 INFO octavia.certificates.generator.local [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 06:15:49.996 23 INFO octavia.controller.worker.tasks.database_tasks [req-bb71040c-4406-4de6-aa6a-eabfae4bb927 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 823a206c-0daa-436b-8d80-9a3d52fec871 with compute id 694a88a1-9404-496e-a417-faf20730f859 for load balancer: eec0a1ed-4eb2-42d2-bef9-ecc5cc2c4272 >2018-07-18 06:15:50.296 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-bb71040c-4406-4de6-aa6a-eabfae4bb927 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 5a46c571-0a99-465b-b01e-6a70ed0251cb already exists. Nothing to be done. >2018-07-18 06:15:51.378 23 INFO octavia.controller.worker.tasks.database_tasks [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 3f985bc8-6e9f-43e7-8c96-df157808a079 with compute id 3e9f3f49-33b9-4350-a2aa-5dd230dc0c91 for load balancer: 5735b64d-a600-43b0-a939-c950490e4fce >2018-07-18 06:15:51.724 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port f2eea20c-11cb-4dbd-87f8-c00498163768 already exists. Nothing to be done. >2018-07-18 06:16:06.486 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-bb71040c-4406-4de6-aa6a-eabfae4bb927 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.6', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.228.91 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47004f8e50>, 'Connection to 172.24.0.6 timed out. (connect timeout=10.0)')) >2018-07-18 06:16:07.924 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.22', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.125.110 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f4700540a10>, 'Connection to 172.24.0.22 timed out. (connect timeout=10.0)')) >2018-07-18 06:16:16.074 23 INFO octavia.controller.worker.tasks.database_tasks [req-bb71040c-4406-4de6-aa6a-eabfae4bb927 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: eec0a1ed-4eb2-42d2-bef9-ecc5cc2c4272 >2018-07-18 06:16:17.510 23 INFO octavia.controller.worker.tasks.database_tasks [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 5735b64d-a600-43b0-a939-c950490e4fce >2018-07-18 06:16:18.626 23 INFO octavia.controller.queue.endpoint [req-56c4639f-098f-49dc-9284-3d764aca1bb7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'fea98188-f502-4371-962e-a6def4bc66b5'... >2018-07-18 06:16:20.188 23 INFO octavia.controller.queue.endpoint [req-0ac61f8f-f7fe-4529-a259-42f7c4381be6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '5670c604-3037-4029-8d0b-5026afd42082'... >2018-07-18 06:16:23.994 23 INFO octavia.controller.queue.endpoint [req-172f0da9-8666-49a2-8f70-f8c1ff10e18d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '61d1c792-8bb7-48c5-b8c6-be3ef7f6dd0d'... >2018-07-18 06:16:24.949 23 INFO octavia.controller.queue.endpoint [req-47f79dde-9907-4f7c-acf5-ed5c3ced6a10 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '480a5b1f-a20d-4860-b200-cf75a0551643'... >2018-07-18 06:16:29.242 23 INFO octavia.controller.queue.endpoint [req-78f319ff-8d7b-4bc8-820e-4f1ff623381f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'b2de7fe6-f4b4-401d-ac04-c157bb55c77f'... >2018-07-18 06:16:30.056 23 INFO octavia.controller.queue.endpoint [req-ffb1798b-59df-43b3-9d5b-7cf125c50ac2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5862ab7e-9fd7-4c74-ac69-5748696fe904'... >2018-07-18 06:18:09.827 23 INFO octavia.controller.queue.endpoint [req-75cc0e3a-cba2-4902-964a-d8408ff2e61f - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5862ab7e-9fd7-4c74-ac69-5748696fe904'... >2018-07-18 06:18:09.883 23 INFO octavia.controller.queue.endpoint [req-58cf0f07-f2ec-4d6a-b621-63eef42855a9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'b2de7fe6-f4b4-401d-ac04-c157bb55c77f'... >2018-07-18 06:18:14.575 23 INFO octavia.controller.queue.endpoint [req-b6fb3fac-2268-4d29-a6a6-0ede7a7a1d44 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'e044d330-4add-4eac-91f8-d7d71ef67d66'... >2018-07-18 06:18:14.735 23 INFO octavia.controller.queue.endpoint [req-f1e6e8e4-2e33-4503-9d85-0c45410186ee - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '347b52e8-4d3f-417f-9fb2-7050e0cfd078'... >2018-07-18 06:43:14.152 23 INFO octavia.controller.queue.endpoint [req-19ef637e-3e7f-42e0-aae7-d39910feb584 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '0b50b294-b013-4e74-bc69-27e87a9eaabf'... >2018-07-18 06:43:14.268 23 INFO octavia.controller.worker.tasks.database_tasks [req-19ef637e-3e7f-42e0-aae7-d39910feb584 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id e01d2b3a-b466-46e8-9e26-073bb758898d >2018-07-18 06:43:14.390 23 INFO octavia.certificates.generator.local [req-19ef637e-3e7f-42e0-aae7-d39910feb584 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 06:43:14.391 23 INFO octavia.certificates.generator.local [req-19ef637e-3e7f-42e0-aae7-d39910feb584 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 06:43:14.391 23 INFO octavia.certificates.generator.local [req-19ef637e-3e7f-42e0-aae7-d39910feb584 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 06:43:14.392 23 INFO octavia.certificates.generator.local [req-19ef637e-3e7f-42e0-aae7-d39910feb584 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 06:43:27.089 23 INFO octavia.controller.worker.tasks.database_tasks [req-19ef637e-3e7f-42e0-aae7-d39910feb584 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: e01d2b3a-b466-46e8-9e26-073bb758898d with compute id 7e0377af-2b77-4bac-903e-1e5471add6c7 for load balancer: 0b50b294-b013-4e74-bc69-27e87a9eaabf >2018-07-18 06:43:27.389 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-19ef637e-3e7f-42e0-aae7-d39910feb584 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 153cad6b-9a9d-4ee4-9a26-79c786132d6c already exists. Nothing to be done. >2018-07-18 06:43:44.984 23 INFO octavia.controller.worker.tasks.database_tasks [req-19ef637e-3e7f-42e0-aae7-d39910feb584 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 0b50b294-b013-4e74-bc69-27e87a9eaabf >2018-07-18 06:43:52.509 23 INFO octavia.controller.queue.endpoint [req-e51a3b81-b61c-4065-a953-fe1a71859906 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '3a00c167-4351-49f4-9066-7d362370e969'... >2018-07-18 06:43:57.426 23 INFO octavia.controller.queue.endpoint [req-883eebaa-2072-49da-be1e-d2c12bf8964b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'd2f8171c-b964-4fb0-a55a-e45f2f044bf3'... >2018-07-18 06:44:02.712 23 INFO octavia.controller.queue.endpoint [req-32bdb04a-10c3-45c3-aad0-a6d434dde5ac - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5a02ed73-1361-450c-85cc-5d06a2bbc99d'... >2018-07-18 06:44:20.665 23 INFO octavia.controller.queue.endpoint [req-4af49984-0c80-4d85-95ef-ddba8d78224a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '77310dd4-499d-41a3-84b2-08db665d8ba8'... >2018-07-18 06:44:20.786 23 INFO octavia.controller.worker.tasks.database_tasks [req-4af49984-0c80-4d85-95ef-ddba8d78224a - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 85535077-aaad-4052-86c1-93008248adfa >2018-07-18 06:44:20.837 23 INFO octavia.certificates.generator.local [req-4af49984-0c80-4d85-95ef-ddba8d78224a - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 06:44:20.838 23 INFO octavia.certificates.generator.local [req-4af49984-0c80-4d85-95ef-ddba8d78224a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 06:44:20.838 23 INFO octavia.certificates.generator.local [req-4af49984-0c80-4d85-95ef-ddba8d78224a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 06:44:20.839 23 INFO octavia.certificates.generator.local [req-4af49984-0c80-4d85-95ef-ddba8d78224a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 06:44:33.147 23 INFO octavia.controller.worker.tasks.database_tasks [req-4af49984-0c80-4d85-95ef-ddba8d78224a - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 85535077-aaad-4052-86c1-93008248adfa with compute id cb5a4e2a-a743-4b4c-9989-4d28531e7a92 for load balancer: 77310dd4-499d-41a3-84b2-08db665d8ba8 >2018-07-18 06:44:33.352 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-4af49984-0c80-4d85-95ef-ddba8d78224a - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 4fbaaf52-590c-4476-abf7-5e539f0bc118 already exists. Nothing to be done. >2018-07-18 06:44:50.770 23 INFO octavia.controller.worker.tasks.database_tasks [req-4af49984-0c80-4d85-95ef-ddba8d78224a - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 77310dd4-499d-41a3-84b2-08db665d8ba8 >2018-07-18 06:44:56.190 23 INFO octavia.controller.queue.endpoint [req-870a2ff0-49f5-491a-b813-195a073954de - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '0073c086-4273-4a0f-8be5-92c2c634baa4'... >2018-07-18 06:45:01.081 23 INFO octavia.controller.queue.endpoint [req-de7a63b1-fd5b-470b-9d09-fb8dee19d6ac - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '52eddd9d-1d90-4205-805f-4a6be82a7b5d'... >2018-07-18 06:45:06.324 23 INFO octavia.controller.queue.endpoint [req-7bcf8d45-01fe-457b-9679-efc8a360a99e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c397cc5d-603b-498b-aa27-7c2c247d7458'... >2018-07-18 06:45:26.194 23 INFO octavia.controller.queue.endpoint [req-91a96a27-63f2-4d6d-89a9-87af73deddce - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'd0e9f18e-b809-4c55-ae0e-29914bbe88d4'... >2018-07-18 06:45:26.307 23 INFO octavia.controller.worker.tasks.database_tasks [req-91a96a27-63f2-4d6d-89a9-87af73deddce - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id feccbb36-1409-4a39-a792-aa36de4f1e90 >2018-07-18 06:45:26.432 23 INFO octavia.certificates.generator.local [req-91a96a27-63f2-4d6d-89a9-87af73deddce - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 06:45:26.433 23 INFO octavia.certificates.generator.local [req-91a96a27-63f2-4d6d-89a9-87af73deddce - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 06:45:26.433 23 INFO octavia.certificates.generator.local [req-91a96a27-63f2-4d6d-89a9-87af73deddce - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 06:45:26.434 23 INFO octavia.certificates.generator.local [req-91a96a27-63f2-4d6d-89a9-87af73deddce - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 06:45:39.558 23 INFO octavia.controller.worker.tasks.database_tasks [req-91a96a27-63f2-4d6d-89a9-87af73deddce - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: feccbb36-1409-4a39-a792-aa36de4f1e90 with compute id 93fbcef4-f074-4d82-870d-fea4867d1f63 for load balancer: d0e9f18e-b809-4c55-ae0e-29914bbe88d4 >2018-07-18 06:45:39.883 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-91a96a27-63f2-4d6d-89a9-87af73deddce - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 03978838-7ff8-4267-971e-02899dc6259b already exists. Nothing to be done. >2018-07-18 06:45:57.753 23 INFO octavia.controller.worker.tasks.database_tasks [req-91a96a27-63f2-4d6d-89a9-87af73deddce - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: d0e9f18e-b809-4c55-ae0e-29914bbe88d4 >2018-07-18 06:46:07.282 23 INFO octavia.controller.queue.endpoint [req-bb71040c-4406-4de6-aa6a-eabfae4bb927 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '7a6eff55-0aaa-47ee-aa75-6b2de7d35845'... >2018-07-18 06:46:12.488 23 INFO octavia.controller.queue.endpoint [req-0b72c158-fe94-4da4-805d-587c09a91fb1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '6da3594f-ad6f-4e5f-8100-c53353c6902d'... >2018-07-18 06:46:17.394 23 INFO octavia.controller.queue.endpoint [req-283805c9-7a9c-47b8-8c24-977f11c9d3e7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c27ff692-7f65-4600-a192-e7bb14552324'... >2018-07-18 06:55:18.311 23 INFO octavia.controller.queue.endpoint [req-a8377312-504e-4171-b88f-642395d8ed25 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'dc6c8acb-76fb-43a1-ae5e-af0d21fb8249'... >2018-07-18 06:55:18.432 23 INFO octavia.controller.worker.tasks.database_tasks [req-a8377312-504e-4171-b88f-642395d8ed25 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id a47de902-e227-490e-a046-079079996d9d >2018-07-18 06:55:18.595 23 INFO octavia.certificates.generator.local [req-a8377312-504e-4171-b88f-642395d8ed25 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 06:55:18.595 23 INFO octavia.certificates.generator.local [req-a8377312-504e-4171-b88f-642395d8ed25 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 06:55:18.596 23 INFO octavia.certificates.generator.local [req-a8377312-504e-4171-b88f-642395d8ed25 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 06:55:18.596 23 INFO octavia.certificates.generator.local [req-a8377312-504e-4171-b88f-642395d8ed25 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 06:55:31.519 23 INFO octavia.controller.worker.tasks.database_tasks [req-a8377312-504e-4171-b88f-642395d8ed25 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: a47de902-e227-490e-a046-079079996d9d with compute id 08805912-fad7-41ea-95a4-0d5e9987f015 for load balancer: dc6c8acb-76fb-43a1-ae5e-af0d21fb8249 >2018-07-18 06:55:31.808 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a8377312-504e-4171-b88f-642395d8ed25 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port a237f878-9b89-4d09-9b80-e24ec48f6f3c already exists. Nothing to be done. >2018-07-18 06:55:49.664 23 INFO octavia.controller.worker.tasks.database_tasks [req-a8377312-504e-4171-b88f-642395d8ed25 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: dc6c8acb-76fb-43a1-ae5e-af0d21fb8249 >2018-07-18 06:55:56.678 23 INFO octavia.controller.queue.endpoint [req-a8377312-504e-4171-b88f-642395d8ed25 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '5f2cab65-39c3-4c60-ab07-d61a997dc712'... >2018-07-18 06:56:01.426 23 INFO octavia.controller.queue.endpoint [req-616fdc0d-9b72-49b4-9502-1dee48ac958f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '35debc78-7832-42de-a150-047a990e57f4'... >2018-07-18 06:56:06.996 23 INFO octavia.controller.queue.endpoint [req-19ef637e-3e7f-42e0-aae7-d39910feb584 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6fcd6b0f-0984-4df4-8f61-463e526513cf'... >2018-07-18 07:30:24.432 23 INFO octavia.controller.queue.endpoint [req-d861c770-49ac-484a-ad04-62ab4f118ec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '141661ad-4a80-45a8-b89f-1b75f1d7ff6d'... >2018-07-18 07:30:24.551 23 INFO octavia.controller.worker.tasks.database_tasks [req-d861c770-49ac-484a-ad04-62ab4f118ec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id cc6ad242-df24-421a-9de6-478fe7d86360 >2018-07-18 07:30:24.573 23 INFO octavia.certificates.generator.local [req-d861c770-49ac-484a-ad04-62ab4f118ec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 07:30:24.573 23 INFO octavia.certificates.generator.local [req-d861c770-49ac-484a-ad04-62ab4f118ec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 07:30:24.574 23 INFO octavia.certificates.generator.local [req-d861c770-49ac-484a-ad04-62ab4f118ec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 07:30:24.574 23 INFO octavia.certificates.generator.local [req-d861c770-49ac-484a-ad04-62ab4f118ec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 07:30:41.376 23 INFO octavia.controller.worker.tasks.database_tasks [req-d861c770-49ac-484a-ad04-62ab4f118ec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: cc6ad242-df24-421a-9de6-478fe7d86360 with compute id 6d9e9f3c-034b-465a-94d3-f89ea5f15214 for load balancer: 141661ad-4a80-45a8-b89f-1b75f1d7ff6d >2018-07-18 07:30:42.203 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-d861c770-49ac-484a-ad04-62ab4f118ec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 5bd8f463-b8c2-4231-8857-7ce8a256f053 already exists. Nothing to be done. >2018-07-18 07:30:58.224 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-d861c770-49ac-484a-ad04-62ab4f118ec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.28', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.186.68 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47004530d0>, 'Connection to 172.24.0.28 timed out. (connect timeout=10.0)')) >2018-07-18 07:31:07.909 23 INFO octavia.controller.worker.tasks.database_tasks [req-d861c770-49ac-484a-ad04-62ab4f118ec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 141661ad-4a80-45a8-b89f-1b75f1d7ff6d >2018-07-18 07:31:18.676 23 INFO octavia.controller.queue.endpoint [req-47cbfa62-f089-48bb-8570-6e5b7f0c2fc7 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '3a28ec04-f9fc-4798-8db3-887517a5d370'... >2018-07-18 07:31:23.610 23 INFO octavia.controller.queue.endpoint [req-a7c9d5c4-bf2d-4918-95ff-6448b76209df - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '52fd6d1c-157b-488e-883b-c67be5f72c37'... >2018-07-18 07:31:29.256 23 INFO octavia.controller.queue.endpoint [req-a621caed-2da8-4768-81d4-02a1f8232ca6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5fd385bb-f62a-47aa-bd73-47e9caa62b56'... >2018-07-18 07:31:46.409 23 INFO octavia.controller.queue.endpoint [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'a1e63c6f-f04a-4fdf-a939-8ff499b8f7bc'... >2018-07-18 07:31:46.540 23 INFO octavia.controller.worker.tasks.database_tasks [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id a4efcf30-746f-458d-804a-8c84783dc5b7 >2018-07-18 07:31:46.845 23 INFO octavia.certificates.generator.local [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 07:31:46.845 23 INFO octavia.certificates.generator.local [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 07:31:46.845 23 INFO octavia.certificates.generator.local [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 07:31:46.846 23 INFO octavia.certificates.generator.local [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 07:31:48.413 23 INFO octavia.controller.queue.endpoint [req-c73ec5f0-78a7-4613-a13b-ae70da8506af - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '912323ca-1bb5-4275-852b-c22faa87639d'... >2018-07-18 07:31:48.539 23 INFO octavia.controller.worker.tasks.database_tasks [req-c73ec5f0-78a7-4613-a13b-ae70da8506af - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 88472e19-8cc3-4c81-8454-08bc2054f678 >2018-07-18 07:31:48.684 23 INFO octavia.certificates.generator.local [req-c73ec5f0-78a7-4613-a13b-ae70da8506af - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 07:31:48.684 23 INFO octavia.certificates.generator.local [req-c73ec5f0-78a7-4613-a13b-ae70da8506af - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 07:31:48.685 23 INFO octavia.certificates.generator.local [req-c73ec5f0-78a7-4613-a13b-ae70da8506af - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 07:31:48.685 23 INFO octavia.certificates.generator.local [req-c73ec5f0-78a7-4613-a13b-ae70da8506af - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 07:32:00.442 23 INFO octavia.controller.worker.tasks.database_tasks [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: a4efcf30-746f-458d-804a-8c84783dc5b7 with compute id 628d0e6a-cd82-4412-8661-42b010230689 for load balancer: a1e63c6f-f04a-4fdf-a939-8ff499b8f7bc >2018-07-18 07:32:00.544 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 2094a88a-77cc-4050-ac3c-7d46dd033f44 already exists. Nothing to be done. >2018-07-18 07:32:00.922 23 INFO octavia.controller.worker.tasks.database_tasks [req-c73ec5f0-78a7-4613-a13b-ae70da8506af - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 88472e19-8cc3-4c81-8454-08bc2054f678 with compute id 4c48396f-fbe9-436e-a327-ba0ceeaadb76 for load balancer: 912323ca-1bb5-4275-852b-c22faa87639d >2018-07-18 07:32:01.148 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-c73ec5f0-78a7-4613-a13b-ae70da8506af - 293061856e1a4cffbae3ed099cf4f619 - - -] Port d106f4bb-51b8-49e8-ab7a-3afc371a9279 already exists. Nothing to be done. >2018-07-18 07:32:18.799 23 INFO octavia.controller.worker.tasks.database_tasks [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: a1e63c6f-f04a-4fdf-a939-8ff499b8f7bc >2018-07-18 07:32:19.320 23 INFO octavia.controller.worker.tasks.database_tasks [req-c73ec5f0-78a7-4613-a13b-ae70da8506af - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 912323ca-1bb5-4275-852b-c22faa87639d >2018-07-18 07:32:28.118 23 INFO octavia.controller.queue.endpoint [req-91a96a27-63f2-4d6d-89a9-87af73deddce - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '64231e88-bfd5-4971-a10a-7490f3806b52'... >2018-07-18 07:32:28.430 23 INFO octavia.controller.queue.endpoint [req-cb2aa555-f6a8-414c-b3ec-8ddf8c0aabb1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '30b27239-a63b-46a7-8e9c-40f8c9f006e1'... >2018-07-18 07:32:32.700 23 INFO octavia.controller.queue.endpoint [req-ba85e935-8f69-49d9-bfac-160b22e4240b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '78fd8355-7b8d-42cb-a2bd-ab7de4c836c4'... >2018-07-18 07:32:33.297 23 INFO octavia.controller.queue.endpoint [req-c73ec5f0-78a7-4613-a13b-ae70da8506af - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '533f06cd-f405-4ef6-9754-25ef72568b5f'... >2018-07-18 07:32:37.869 23 INFO octavia.controller.queue.endpoint [req-2f0aec64-abbb-442e-be4d-584d4f005685 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '64d5762e-637c-410e-97d5-c0cd4161826e'... >2018-07-18 07:32:38.122 23 INFO octavia.controller.queue.endpoint [req-1f0ca998-080a-4b3d-80ac-25a1d396d83d - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c7d4dc6f-9d88-4795-9bf2-099c2c04613e'... >2018-07-18 07:32:39.460 23 INFO octavia.controller.queue.endpoint [req-435ceb45-58b7-4280-bd72-45dc29b21482 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '47555933-a363-403b-b13b-5504aab58cb0'... >2018-07-18 07:34:36.353 23 INFO octavia.controller.queue.endpoint [req-d3c381fb-ef89-45f5-bb74-47aadea21b77 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5fd385bb-f62a-47aa-bd73-47e9caa62b56'... >2018-07-18 07:34:40.453 23 INFO octavia.controller.queue.endpoint [req-72d7630f-1a2c-4bd7-9013-6d56ddb2eae3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '30b99b36-49df-4af4-ae8d-12d2a14c8661'... >2018-07-18 07:38:53.574 23 INFO octavia.controller.queue.endpoint [req-f604c296-ad66-4d0f-a66f-a3f982e063e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '63420729-4535-4095-8fea-3b97a47de8a0'... >2018-07-18 07:38:53.694 23 INFO octavia.controller.worker.tasks.database_tasks [req-f604c296-ad66-4d0f-a66f-a3f982e063e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id be352671-4e89-412c-96b5-3eb802260569 >2018-07-18 07:38:53.820 23 INFO octavia.certificates.generator.local [req-f604c296-ad66-4d0f-a66f-a3f982e063e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 07:38:53.821 23 INFO octavia.certificates.generator.local [req-f604c296-ad66-4d0f-a66f-a3f982e063e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 07:38:53.821 23 INFO octavia.certificates.generator.local [req-f604c296-ad66-4d0f-a66f-a3f982e063e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 07:38:53.822 23 INFO octavia.certificates.generator.local [req-f604c296-ad66-4d0f-a66f-a3f982e063e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 07:39:07.480 23 INFO octavia.controller.worker.tasks.database_tasks [req-f604c296-ad66-4d0f-a66f-a3f982e063e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: be352671-4e89-412c-96b5-3eb802260569 with compute id 273f2257-8eb2-4aca-8211-691b04f5a793 for load balancer: 63420729-4535-4095-8fea-3b97a47de8a0 >2018-07-18 07:39:07.862 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f604c296-ad66-4d0f-a66f-a3f982e063e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 660a5727-0f96-471b-ade7-b6f83315c7ff already exists. Nothing to be done. >2018-07-18 07:39:25.501 23 INFO octavia.controller.worker.tasks.database_tasks [req-f604c296-ad66-4d0f-a66f-a3f982e063e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 63420729-4535-4095-8fea-3b97a47de8a0 >2018-07-18 07:39:36.428 23 INFO octavia.controller.queue.endpoint [req-f604c296-ad66-4d0f-a66f-a3f982e063e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'ca2fc5b3-bb2a-45a0-b9f1-d2d9473e9c3f'... >2018-07-18 07:39:41.777 23 INFO octavia.controller.queue.endpoint [req-84753e6d-0db8-452f-ae86-c859206173b5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'e9575494-7240-4f5d-868a-137bca005ee6'... >2018-07-18 07:39:47.532 23 INFO octavia.controller.queue.endpoint [req-3ef6f457-3e13-4d9b-b696-6abe8ade9f13 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'fb5f2c6a-a542-4606-a1e3-85ed5d5f84c6'... >2018-07-18 07:42:23.521 23 INFO octavia.controller.queue.endpoint [req-0beac53d-7ac6-4faa-a6b0-780fc0246ea6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'cbc9c320-2d63-432e-835c-a60afddeff22'... >2018-07-18 07:42:23.636 23 INFO octavia.controller.worker.tasks.database_tasks [req-0beac53d-7ac6-4faa-a6b0-780fc0246ea6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id fb858a05-bb54-494f-9cff-6eefff49b29e >2018-07-18 07:42:23.839 23 INFO octavia.certificates.generator.local [req-0beac53d-7ac6-4faa-a6b0-780fc0246ea6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 07:42:23.839 23 INFO octavia.certificates.generator.local [req-0beac53d-7ac6-4faa-a6b0-780fc0246ea6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 07:42:23.840 23 INFO octavia.certificates.generator.local [req-0beac53d-7ac6-4faa-a6b0-780fc0246ea6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 07:42:23.840 23 INFO octavia.certificates.generator.local [req-0beac53d-7ac6-4faa-a6b0-780fc0246ea6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 07:42:37.776 23 INFO octavia.controller.worker.tasks.database_tasks [req-0beac53d-7ac6-4faa-a6b0-780fc0246ea6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: fb858a05-bb54-494f-9cff-6eefff49b29e with compute id 0114f7ee-04ff-464e-9694-c0b8c0b10694 for load balancer: cbc9c320-2d63-432e-835c-a60afddeff22 >2018-07-18 07:42:38.099 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-0beac53d-7ac6-4faa-a6b0-780fc0246ea6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port b69f746e-6b49-4e90-b84e-88cf7fd6bbad already exists. Nothing to be done. >2018-07-18 07:42:55.813 23 INFO octavia.controller.worker.tasks.database_tasks [req-0beac53d-7ac6-4faa-a6b0-780fc0246ea6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: cbc9c320-2d63-432e-835c-a60afddeff22 >2018-07-18 07:43:02.824 23 INFO octavia.controller.queue.endpoint [req-0beac53d-7ac6-4faa-a6b0-780fc0246ea6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'daee1f10-93eb-4a4e-a15e-59484a48ec2f'... >2018-07-18 07:43:08.632 23 INFO octavia.controller.queue.endpoint [req-682b451a-f4c5-4f53-a90c-b54f275a0b79 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'fa61aa6e-d93c-46cc-b8df-f803e08233fc'... >2018-07-18 07:43:13.902 23 INFO octavia.controller.queue.endpoint [req-2deb7319-4edf-476a-a28b-4bba4b4d0838 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f3db31cb-c2ae-454f-bc4c-514281553148'... >2018-07-18 07:43:17.421 23 INFO octavia.controller.queue.endpoint [req-47ee588f-61d6-4ddc-8ba0-8e458b772399 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2a10f591-a8d4-4dd2-989e-d4a9e11020b6'... >2018-07-18 07:46:30.661 23 INFO octavia.controller.queue.endpoint [req-71bea4ee-3107-42f3-bad4-bf8040f1ba6e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'f0ae20cb-1769-41a6-be38-d33eee3d75d7'... >2018-07-18 07:46:30.783 23 INFO octavia.controller.worker.tasks.database_tasks [req-71bea4ee-3107-42f3-bad4-bf8040f1ba6e - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id e1cdfa3b-5efc-4101-b0b2-d0dcdd088101 >2018-07-18 07:46:30.857 23 INFO octavia.certificates.generator.local [req-71bea4ee-3107-42f3-bad4-bf8040f1ba6e - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 07:46:30.857 23 INFO octavia.certificates.generator.local [req-71bea4ee-3107-42f3-bad4-bf8040f1ba6e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 07:46:30.858 23 INFO octavia.certificates.generator.local [req-71bea4ee-3107-42f3-bad4-bf8040f1ba6e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 07:46:30.858 23 INFO octavia.certificates.generator.local [req-71bea4ee-3107-42f3-bad4-bf8040f1ba6e - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 07:46:43.057 23 INFO octavia.controller.worker.tasks.database_tasks [req-71bea4ee-3107-42f3-bad4-bf8040f1ba6e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: e1cdfa3b-5efc-4101-b0b2-d0dcdd088101 with compute id 1ec2d300-efda-4a39-aca5-70fbda321002 for load balancer: f0ae20cb-1769-41a6-be38-d33eee3d75d7 >2018-07-18 07:46:43.369 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-71bea4ee-3107-42f3-bad4-bf8040f1ba6e - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 99b4c181-ade8-4a44-9cdc-c9343526b305 already exists. Nothing to be done. >2018-07-18 07:47:00.566 23 INFO octavia.controller.worker.tasks.database_tasks [req-71bea4ee-3107-42f3-bad4-bf8040f1ba6e - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: f0ae20cb-1769-41a6-be38-d33eee3d75d7 >2018-07-18 07:47:07.092 23 INFO octavia.controller.queue.endpoint [req-55d210df-3af0-4937-97e3-6dbde7661d3a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '8a0a3334-4209-44bf-9393-8235df2fe1e5'... >2018-07-18 07:47:11.964 23 INFO octavia.controller.queue.endpoint [req-d861c770-49ac-484a-ad04-62ab4f118ec4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'b18b51d2-23fe-42db-82fb-3695b9f34555'... >2018-07-18 07:47:17.183 23 INFO octavia.controller.queue.endpoint [req-a52462c6-74e5-49df-85e9-84d5018766e9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '1fedebb5-d90d-4036-986e-72765e7c9a40'... >2018-07-18 07:47:48.320 23 INFO octavia.controller.queue.endpoint [req-a1f4e81b-a57e-4d8a-988c-e12a5c68b183 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '575b1f3f-b964-4806-a601-6aaf2132ef1f'... >2018-07-18 07:47:48.437 23 INFO octavia.controller.worker.tasks.database_tasks [req-a1f4e81b-a57e-4d8a-988c-e12a5c68b183 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id b8f914ce-aad0-4b1c-b801-e34363dd8831 >2018-07-18 07:47:48.521 23 INFO octavia.certificates.generator.local [req-a1f4e81b-a57e-4d8a-988c-e12a5c68b183 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 07:47:48.522 23 INFO octavia.certificates.generator.local [req-a1f4e81b-a57e-4d8a-988c-e12a5c68b183 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 07:47:48.522 23 INFO octavia.certificates.generator.local [req-a1f4e81b-a57e-4d8a-988c-e12a5c68b183 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 07:47:48.523 23 INFO octavia.certificates.generator.local [req-a1f4e81b-a57e-4d8a-988c-e12a5c68b183 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 07:48:01.126 23 INFO octavia.controller.worker.tasks.database_tasks [req-a1f4e81b-a57e-4d8a-988c-e12a5c68b183 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: b8f914ce-aad0-4b1c-b801-e34363dd8831 with compute id f096c194-fed5-44ac-a142-e3a12537ce2f for load balancer: 575b1f3f-b964-4806-a601-6aaf2132ef1f >2018-07-18 07:48:01.460 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-a1f4e81b-a57e-4d8a-988c-e12a5c68b183 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 74b44765-795f-4fbb-8610-6e0a6f2bd5be already exists. Nothing to be done. >2018-07-18 07:48:19.366 23 INFO octavia.controller.worker.tasks.database_tasks [req-a1f4e81b-a57e-4d8a-988c-e12a5c68b183 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 575b1f3f-b964-4806-a601-6aaf2132ef1f >2018-07-18 07:48:30.692 23 INFO octavia.controller.queue.endpoint [req-0ad5a89d-2997-4711-a928-ceae3e783926 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '05a7d6ec-e597-4e0e-90b8-bd6e26651452'... >2018-07-18 07:48:36.295 23 INFO octavia.controller.queue.endpoint [req-a1f4e81b-a57e-4d8a-988c-e12a5c68b183 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '198dc858-6405-49a5-bbb9-e66375625d59'... >2018-07-18 07:48:41.868 23 INFO octavia.controller.queue.endpoint [req-d1bc66ea-6b1f-421f-a1fe-3b3d704b23cb - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a5abf4a8-aa5d-456d-b904-d01db842bdf3'... >2018-07-18 07:52:06.929 23 INFO octavia.controller.queue.endpoint [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '045c770d-edf7-4963-a710-91c110a15ec2'... >2018-07-18 07:52:07.043 23 INFO octavia.controller.worker.tasks.database_tasks [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id f9478578-67a4-4fff-babd-a9a19d059081 >2018-07-18 07:52:07.148 23 INFO octavia.certificates.generator.local [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 07:52:07.149 23 INFO octavia.certificates.generator.local [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 07:52:07.149 23 INFO octavia.certificates.generator.local [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 07:52:07.150 23 INFO octavia.certificates.generator.local [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 07:52:20.474 23 INFO octavia.controller.worker.tasks.database_tasks [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: f9478578-67a4-4fff-babd-a9a19d059081 with compute id a21d9abc-54f6-496d-9a31-92809e273e9e for load balancer: 045c770d-edf7-4963-a710-91c110a15ec2 >2018-07-18 07:52:20.791 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 20ab0fd3-5123-4928-a75b-a05fa8a1dd73 already exists. Nothing to be done. >2018-07-18 07:52:38.085 23 INFO octavia.controller.worker.tasks.database_tasks [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 045c770d-edf7-4963-a710-91c110a15ec2 >2018-07-18 07:52:44.780 23 INFO octavia.controller.queue.endpoint [req-601d8bc1-46e4-441a-bfcd-5f53affe8982 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '34cbfd70-93af-4d50-bc69-8d27d39cb567'... >2018-07-18 07:52:50.284 23 INFO octavia.controller.queue.endpoint [req-4af49984-0c80-4d85-95ef-ddba8d78224a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '602cea23-1462-41b0-9a1b-c5ec9e01b886'... >2018-07-18 07:52:55.251 23 INFO octavia.controller.queue.endpoint [req-45b0e130-872c-4cd2-a120-d08cbbad5778 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '223186d9-008c-4168-9b49-da1ea96a7f9d'... >2018-07-18 07:55:03.303 23 INFO octavia.controller.queue.endpoint [req-f5cca0ee-b13d-4c83-84a7-14ef7087b990 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '5a7c7158-ac49-4290-a979-ccff02a0b916'... >2018-07-18 07:55:03.432 23 INFO octavia.controller.worker.tasks.database_tasks [req-f5cca0ee-b13d-4c83-84a7-14ef7087b990 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 36f721a7-d02c-4124-888a-a83fbc159698 >2018-07-18 07:55:03.705 23 INFO octavia.certificates.generator.local [req-f5cca0ee-b13d-4c83-84a7-14ef7087b990 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 07:55:03.706 23 INFO octavia.certificates.generator.local [req-f5cca0ee-b13d-4c83-84a7-14ef7087b990 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 07:55:03.706 23 INFO octavia.certificates.generator.local [req-f5cca0ee-b13d-4c83-84a7-14ef7087b990 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 07:55:03.707 23 INFO octavia.certificates.generator.local [req-f5cca0ee-b13d-4c83-84a7-14ef7087b990 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 07:55:16.056 23 INFO octavia.controller.worker.tasks.database_tasks [req-f5cca0ee-b13d-4c83-84a7-14ef7087b990 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 36f721a7-d02c-4124-888a-a83fbc159698 with compute id 3eea9660-9e86-4134-840f-ce084c1903ab for load balancer: 5a7c7158-ac49-4290-a979-ccff02a0b916 >2018-07-18 07:55:16.408 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f5cca0ee-b13d-4c83-84a7-14ef7087b990 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port cd161dce-ed8a-4ffc-a1f9-da3e18fe5980 already exists. Nothing to be done. >2018-07-18 07:55:35.131 23 INFO octavia.controller.worker.tasks.database_tasks [req-f5cca0ee-b13d-4c83-84a7-14ef7087b990 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 5a7c7158-ac49-4290-a979-ccff02a0b916 >2018-07-18 07:55:39.476 23 INFO octavia.controller.queue.endpoint [req-34afbb6b-44da-4c98-8051-5524c741647b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'f9f2d7a5-7858-4238-a9ae-d869961b8fcc'... >2018-07-18 07:55:44.610 23 INFO octavia.controller.queue.endpoint [req-71bea4ee-3107-42f3-bad4-bf8040f1ba6e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'a5400d8d-49da-4001-ba7e-09de7f51608f'... >2018-07-18 07:55:49.204 23 INFO octavia.controller.queue.endpoint [req-5f6c5da3-0a4d-4b69-8ccc-0a0bd176cd9a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '2e5b03d3-ee1e-40af-bd73-d18701aa5e12'... >2018-07-18 07:55:54.563 23 INFO octavia.controller.queue.endpoint [req-997b83e2-9322-4343-97a6-29b9b4778330 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'fd92fca2-1c1e-4193-ac2c-a34dc866092b'... >2018-07-18 07:55:59.261 23 INFO octavia.controller.queue.endpoint [req-f326008e-91db-45e9-a86f-511efb2a8c7e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c9ad55c3-3f88-44fc-8a5c-4f766b1f7514'... >2018-07-18 07:56:04.713 23 INFO octavia.controller.queue.endpoint [req-22026844-34f8-4d88-8280-11bb1604b621 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '0c502075-fd15-4a6b-a896-66a163380183'... >2018-07-18 07:58:29.331 23 INFO octavia.controller.queue.endpoint [req-4b665fda-1274-46b7-abfb-4f9d82c3d815 - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'edd05164-92ef-4cdf-834a-bbaead353565'... >2018-07-18 07:58:36.863 23 INFO octavia.controller.queue.endpoint [req-8a45df29-f635-45b8-a7fd-6cc9e30ed31b - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'de4ce7f0-19f6-436d-a3e5-f0ae28742733'... >2018-07-18 07:59:45.034 23 INFO octavia.controller.queue.endpoint [req-52f463f7-d32b-4478-9598-d9f6033adaca - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'f1e61808-5862-4b5c-bd54-e036b348e3ed'... >2018-07-18 07:59:52.535 23 INFO octavia.controller.queue.endpoint [req-93eeecb1-e2b8-4d8e-a880-aa9b0295e17f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '6326e9cc-924a-4c3c-ba71-0c80c8f1f86b'... >2018-07-18 08:04:52.384 23 INFO octavia.controller.queue.endpoint [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '7ea152de-9a32-43da-ba08-ff2a5f7fcef6'... >2018-07-18 08:04:52.624 23 INFO octavia.controller.worker.tasks.database_tasks [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id d6e6506f-cb40-4e08-a0e9-6395c5729b69 >2018-07-18 08:04:52.764 23 INFO octavia.certificates.generator.local [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 08:04:52.764 23 INFO octavia.certificates.generator.local [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 08:04:52.765 23 INFO octavia.certificates.generator.local [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 08:04:52.765 23 INFO octavia.certificates.generator.local [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 08:05:06.061 23 INFO octavia.controller.worker.tasks.database_tasks [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: d6e6506f-cb40-4e08-a0e9-6395c5729b69 with compute id 018fb685-5277-4169-9204-9456a34d4720 for load balancer: 7ea152de-9a32-43da-ba08-ff2a5f7fcef6 >2018-07-18 08:05:06.371 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port f9064639-2223-4e4a-a577-761eceee3785 already exists. Nothing to be done. >2018-07-18 08:05:23.590 23 INFO octavia.controller.worker.tasks.database_tasks [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 7ea152de-9a32-43da-ba08-ff2a5f7fcef6 >2018-07-18 08:05:33.202 23 INFO octavia.controller.queue.endpoint [req-75b8f650-1ae3-4dcb-98e8-724475de054c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '337a154f-d68e-403a-bbee-c6e6ff099864'... >2018-07-18 08:05:38.797 23 INFO octavia.controller.queue.endpoint [req-3b783196-fe9f-4ede-9c4e-9ae02388b00c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '54c3320c-8a56-4017-8824-a2927711deef'... >2018-07-18 08:05:44.239 23 INFO octavia.controller.queue.endpoint [req-1d743271-3542-45df-a0d8-35c23506be33 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c4163cb9-1399-4c4c-a928-afb51ef6f587'... >2018-07-18 08:06:49.404 23 INFO octavia.controller.queue.endpoint [req-f3924101-dde5-4e54-8ea1-ecc4fb62feef - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '133338ca-8b58-4b32-983c-88a89d0265b4'... >2018-07-18 08:06:49.533 23 INFO octavia.controller.worker.tasks.database_tasks [req-f3924101-dde5-4e54-8ea1-ecc4fb62feef - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 42557f32-e22a-4444-b691-308ebf3f9813 >2018-07-18 08:06:49.596 23 INFO octavia.certificates.generator.local [req-f3924101-dde5-4e54-8ea1-ecc4fb62feef - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 08:06:49.596 23 INFO octavia.certificates.generator.local [req-f3924101-dde5-4e54-8ea1-ecc4fb62feef - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 08:06:49.596 23 INFO octavia.certificates.generator.local [req-f3924101-dde5-4e54-8ea1-ecc4fb62feef - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 08:06:49.597 23 INFO octavia.certificates.generator.local [req-f3924101-dde5-4e54-8ea1-ecc4fb62feef - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 08:06:50.455 23 INFO octavia.controller.queue.endpoint [req-194a7c84-047e-41e4-8a1b-356cbf4481a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'cd97d2ea-3d5e-440e-8bf4-032fbf4c5722'... >2018-07-18 08:06:50.574 23 INFO octavia.controller.worker.tasks.database_tasks [req-194a7c84-047e-41e4-8a1b-356cbf4481a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id a5116b01-941d-42ea-8cd1-ede621b80a71 >2018-07-18 08:06:50.649 23 INFO octavia.certificates.generator.local [req-194a7c84-047e-41e4-8a1b-356cbf4481a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 08:06:50.650 23 INFO octavia.certificates.generator.local [req-194a7c84-047e-41e4-8a1b-356cbf4481a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 08:06:50.650 23 INFO octavia.certificates.generator.local [req-194a7c84-047e-41e4-8a1b-356cbf4481a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 08:06:50.651 23 INFO octavia.certificates.generator.local [req-194a7c84-047e-41e4-8a1b-356cbf4481a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 08:06:51.610 23 INFO octavia.controller.queue.endpoint [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '3595a00a-d988-4514-b734-78e23c600efa'... >2018-07-18 08:06:51.738 23 INFO octavia.controller.worker.tasks.database_tasks [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 032648ee-06eb-495b-a351-91f654097517 >2018-07-18 08:06:51.954 23 INFO octavia.certificates.generator.local [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 08:06:51.954 23 INFO octavia.certificates.generator.local [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 08:06:51.955 23 INFO octavia.certificates.generator.local [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 08:06:51.955 23 INFO octavia.certificates.generator.local [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 08:07:01.622 23 INFO octavia.controller.worker.tasks.database_tasks [req-f3924101-dde5-4e54-8ea1-ecc4fb62feef - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 42557f32-e22a-4444-b691-308ebf3f9813 with compute id efee1fb2-b2c3-4e8b-aa4e-070c795f6416 for load balancer: 133338ca-8b58-4b32-983c-88a89d0265b4 >2018-07-18 08:07:01.722 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f3924101-dde5-4e54-8ea1-ecc4fb62feef - 293061856e1a4cffbae3ed099cf4f619 - - -] Port fc488874-0431-4631-9530-fe838c0c9024 already exists. Nothing to be done. >2018-07-18 08:07:02.085 23 INFO octavia.controller.worker.tasks.database_tasks [req-194a7c84-047e-41e4-8a1b-356cbf4481a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: a5116b01-941d-42ea-8cd1-ede621b80a71 with compute id d1614751-a7dd-48dd-8b91-45547fdcbbf9 for load balancer: cd97d2ea-3d5e-440e-8bf4-032fbf4c5722 >2018-07-18 08:07:02.189 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-194a7c84-047e-41e4-8a1b-356cbf4481a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 6a91600d-9897-4740-b0d0-1e051a6898da already exists. Nothing to be done. >2018-07-18 08:07:03.554 23 INFO octavia.controller.worker.tasks.database_tasks [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 032648ee-06eb-495b-a351-91f654097517 with compute id 9039b8cb-f893-46c0-8566-3661ac754def for load balancer: 3595a00a-d988-4514-b734-78e23c600efa >2018-07-18 08:07:03.837 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 193ead64-baf9-46ff-b798-2b48ac962d08 already exists. Nothing to be done. >2018-07-18 08:07:10.893 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-194a7c84-047e-41e4-8a1b-356cbf4481a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.38', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.50.214 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47001c9190>: Failed to establish a new connection: [Errno 113] No route to host',)) >2018-07-18 08:07:15.901 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-194a7c84-047e-41e4-8a1b-356cbf4481a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.38', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.50.214 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47080bb1d0>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-18 08:07:20.190 23 INFO octavia.controller.worker.tasks.database_tasks [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 3595a00a-d988-4514-b734-78e23c600efa >2018-07-18 08:07:21.381 23 INFO octavia.controller.worker.tasks.database_tasks [req-f3924101-dde5-4e54-8ea1-ecc4fb62feef - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 133338ca-8b58-4b32-983c-88a89d0265b4 >2018-07-18 08:07:25.474 23 INFO octavia.controller.worker.tasks.database_tasks [req-194a7c84-047e-41e4-8a1b-356cbf4481a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: cd97d2ea-3d5e-440e-8bf4-032fbf4c5722 >2018-07-18 08:07:32.025 23 INFO octavia.controller.queue.endpoint [req-fa08ff5f-ecf4-40e1-8828-8c206ecd6324 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'd650b1a8-dde0-4345-8135-181ed4d8681e'... >2018-07-18 08:07:32.391 23 INFO octavia.controller.queue.endpoint [req-f3924101-dde5-4e54-8ea1-ecc4fb62feef - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '8279db7c-b3c9-44f1-a3e1-98e184914714'... >2018-07-18 08:07:32.694 23 INFO octavia.controller.queue.endpoint [req-79c72608-6f3e-454a-a0d0-06e3a0513cb3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '1a1fcf72-8b0e-4a0a-ab78-79449002beec'... >2018-07-18 08:07:37.178 23 INFO octavia.controller.queue.endpoint [req-7e05bcf2-e3e0-4665-8e01-fdb1df0ca37f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '582a2536-1544-4b52-afd9-678d3c3636ed'... >2018-07-18 08:07:37.403 23 INFO octavia.controller.queue.endpoint [req-767f71f7-a5bd-47cf-be57-8581ad0192f9 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '2b427ef4-dd30-4bab-96f4-448b310baadb'... >2018-07-18 08:07:37.640 23 INFO octavia.controller.queue.endpoint [req-62968b0f-71da-43a4-9a4f-32cc28a2369f - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'ff36d42b-1a79-423f-8edc-55519f1e28c6'... >2018-07-18 08:07:42.663 23 INFO octavia.controller.queue.endpoint [req-af666434-f841-4b68-bfff-7910977690c0 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '3d597ccb-46b1-4ab8-a8cb-a383ca5ca270'... >2018-07-18 08:07:42.855 23 INFO octavia.controller.queue.endpoint [req-b509855f-3adc-40fd-ba31-9bef03599734 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '74deb830-bf26-47d2-be42-f5a92d85b568'... >2018-07-18 08:07:43.306 23 INFO octavia.controller.queue.endpoint [req-54161d4e-92fe-4f66-97a8-80d1b037ae9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '337b5bf7-b9f2-49f4-88ef-51622960c7d4'... >2018-07-18 08:09:23.112 23 INFO octavia.controller.queue.endpoint [req-e4d2a103-4021-4911-b1b8-7d99c252e4e5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'bca257ec-2683-41a9-95d7-210a225d860f'... >2018-07-18 08:09:23.232 23 INFO octavia.controller.worker.tasks.database_tasks [req-e4d2a103-4021-4911-b1b8-7d99c252e4e5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 23f53757-4012-45a9-8054-c686352a9350 >2018-07-18 08:09:23.479 23 INFO octavia.certificates.generator.local [req-e4d2a103-4021-4911-b1b8-7d99c252e4e5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 08:09:23.479 23 INFO octavia.certificates.generator.local [req-e4d2a103-4021-4911-b1b8-7d99c252e4e5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 08:09:23.479 23 INFO octavia.certificates.generator.local [req-e4d2a103-4021-4911-b1b8-7d99c252e4e5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 08:09:23.480 23 INFO octavia.certificates.generator.local [req-e4d2a103-4021-4911-b1b8-7d99c252e4e5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 08:09:35.787 23 INFO octavia.controller.worker.tasks.database_tasks [req-e4d2a103-4021-4911-b1b8-7d99c252e4e5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 23f53757-4012-45a9-8054-c686352a9350 with compute id 11a2929b-6fcd-4095-921f-2f1fa563316f for load balancer: bca257ec-2683-41a9-95d7-210a225d860f >2018-07-18 08:09:35.876 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-e4d2a103-4021-4911-b1b8-7d99c252e4e5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 73044f1e-b358-4aa7-ae06-b70e62c56ea2 already exists. Nothing to be done. >2018-07-18 08:09:53.368 23 INFO octavia.controller.worker.tasks.database_tasks [req-e4d2a103-4021-4911-b1b8-7d99c252e4e5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: bca257ec-2683-41a9-95d7-210a225d860f >2018-07-18 08:10:06.960 23 INFO octavia.controller.queue.endpoint [req-afe9b3f6-390c-4746-94b8-8aaa14e27fec - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '6efe62ed-e2f0-44dd-b105-0317d9be6c01'... >2018-07-18 08:10:11.890 23 INFO octavia.controller.queue.endpoint [req-aab1d737-0843-4b58-a3d8-86be7a615eed - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '86a107d8-06ea-4033-9d91-727b4f7c432d'... >2018-07-18 08:10:16.867 23 INFO octavia.controller.queue.endpoint [req-b2fbedb3-a20f-4eb0-9b54-9bb45f7abd99 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '79cc1d94-12c8-4c92-a641-35397770d107'... >2018-07-18 08:12:00.204 23 INFO octavia.controller.queue.endpoint [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '720d0b42-4bde-4e27-ae5f-d8c9c4faf766'... >2018-07-18 08:12:00.333 23 INFO octavia.controller.worker.tasks.database_tasks [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id a0353782-6fea-43f2-b673-7508de8d0cf7 >2018-07-18 08:12:00.410 23 INFO octavia.certificates.generator.local [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 08:12:00.411 23 INFO octavia.certificates.generator.local [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 08:12:00.411 23 INFO octavia.certificates.generator.local [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 08:12:00.412 23 INFO octavia.certificates.generator.local [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 08:12:13.718 23 INFO octavia.controller.worker.tasks.database_tasks [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: a0353782-6fea-43f2-b673-7508de8d0cf7 with compute id df0f8e56-04dc-490f-aee6-25ffd4614f6b for load balancer: 720d0b42-4bde-4e27-ae5f-d8c9c4faf766 >2018-07-18 08:12:13.931 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port bf2c4495-6758-44cf-b476-043c0a3f65cf already exists. Nothing to be done. >2018-07-18 08:12:21.724 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.33', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.18.69 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f470046ea90>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-18 08:12:31.353 23 INFO octavia.controller.worker.tasks.database_tasks [req-f90c72c5-6cd7-42f9-8b38-c819cf65fa31 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 720d0b42-4bde-4e27-ae5f-d8c9c4faf766 >2018-07-18 08:12:43.080 23 INFO octavia.controller.queue.endpoint [req-31d25262-2ecf-4106-afa7-2951d5a53760 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'b72f1ae0-8d13-4caa-91bf-7ea307c80536'... >2018-07-18 08:12:48.182 23 INFO octavia.controller.queue.endpoint [req-76646f48-13a0-4bc7-b312-54253d704fd4 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'f1132581-68ff-4b0f-8f3b-461983760687'... >2018-07-18 08:12:53.083 23 INFO octavia.controller.queue.endpoint [req-e77cfae5-a5b1-41a6-a7aa-7203e9002685 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'a0f2598a-dc46-4a48-a920-ab2200bd12cf'... >2018-07-18 08:15:03.791 23 INFO octavia.controller.queue.endpoint [req-7acaf487-81c5-4ff2-9d42-2868803a10b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '2b4ef8ca-5941-4319-b021-b048b74c089c'... >2018-07-18 08:15:03.922 23 INFO octavia.controller.worker.tasks.database_tasks [req-7acaf487-81c5-4ff2-9d42-2868803a10b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id a3475617-dfa1-4fbb-8ca6-6f842de8bc6b >2018-07-18 08:15:04.048 23 INFO octavia.certificates.generator.local [req-7acaf487-81c5-4ff2-9d42-2868803a10b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 08:15:04.049 23 INFO octavia.certificates.generator.local [req-7acaf487-81c5-4ff2-9d42-2868803a10b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 08:15:04.049 23 INFO octavia.certificates.generator.local [req-7acaf487-81c5-4ff2-9d42-2868803a10b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 08:15:04.049 23 INFO octavia.certificates.generator.local [req-7acaf487-81c5-4ff2-9d42-2868803a10b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 08:15:17.147 23 INFO octavia.controller.worker.tasks.database_tasks [req-7acaf487-81c5-4ff2-9d42-2868803a10b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: a3475617-dfa1-4fbb-8ca6-6f842de8bc6b with compute id c4309362-b57b-496a-ad20-0b111db0771e for load balancer: 2b4ef8ca-5941-4319-b021-b048b74c089c >2018-07-18 08:15:17.504 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-7acaf487-81c5-4ff2-9d42-2868803a10b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port e12ace51-2b7c-4469-aa5e-233aaa5fdd7f already exists. Nothing to be done. >2018-07-18 08:15:35.124 23 INFO octavia.controller.worker.tasks.database_tasks [req-7acaf487-81c5-4ff2-9d42-2868803a10b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 2b4ef8ca-5941-4319-b021-b048b74c089c >2018-07-18 08:15:45.100 23 INFO octavia.controller.queue.endpoint [req-7acaf487-81c5-4ff2-9d42-2868803a10b2 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '4cb42416-1cc9-476e-a2fb-c3a59786bc6e'... >2018-07-18 08:15:50.748 23 INFO octavia.controller.queue.endpoint [req-3a0be580-5d20-4185-a405-363be0a57f4e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '8ab1055d-2db5-4da7-8bcb-9fddfad48290'... >2018-07-18 08:15:56.261 23 INFO octavia.controller.queue.endpoint [req-95b2cbf9-abec-4b34-84a1-6811b35bae91 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '2e122dfb-0692-466f-b62f-6c016f2c8626'... >2018-07-18 08:18:32.083 23 INFO octavia.controller.queue.endpoint [req-21614f4a-8e5f-4461-aa0d-8b11e9b706e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '04ced798-7492-44cb-8ad8-0b70cadb07fe'... >2018-07-18 08:18:32.204 23 INFO octavia.controller.worker.tasks.database_tasks [req-21614f4a-8e5f-4461-aa0d-8b11e9b706e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 15598588-8be7-4954-b840-55891505ffba >2018-07-18 08:18:32.333 23 INFO octavia.certificates.generator.local [req-21614f4a-8e5f-4461-aa0d-8b11e9b706e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 08:18:32.333 23 INFO octavia.certificates.generator.local [req-21614f4a-8e5f-4461-aa0d-8b11e9b706e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 08:18:32.334 23 INFO octavia.certificates.generator.local [req-21614f4a-8e5f-4461-aa0d-8b11e9b706e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 08:18:32.334 23 INFO octavia.certificates.generator.local [req-21614f4a-8e5f-4461-aa0d-8b11e9b706e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 08:18:38.330 23 INFO octavia.controller.queue.endpoint [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer 'de5ac3e7-e0e5-447b-8f91-29d9791badf0'... >2018-07-18 08:18:38.467 23 INFO octavia.controller.worker.tasks.database_tasks [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 8e9118ae-71fd-4847-a1f9-4669431f172d >2018-07-18 08:18:38.556 23 INFO octavia.certificates.generator.local [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 08:18:38.556 23 INFO octavia.certificates.generator.local [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 08:18:38.556 23 INFO octavia.certificates.generator.local [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 08:18:38.557 23 INFO octavia.certificates.generator.local [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 08:18:45.731 23 INFO octavia.controller.worker.tasks.database_tasks [req-21614f4a-8e5f-4461-aa0d-8b11e9b706e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 15598588-8be7-4954-b840-55891505ffba with compute id 2442fdcc-127c-4d48-a6a4-7c69fce1594c for load balancer: 04ced798-7492-44cb-8ad8-0b70cadb07fe >2018-07-18 08:18:46.070 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-21614f4a-8e5f-4461-aa0d-8b11e9b706e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port be410903-ed9f-4cad-9e6e-fdc615f184af already exists. Nothing to be done. >2018-07-18 08:18:50.909 23 INFO octavia.controller.worker.tasks.database_tasks [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 8e9118ae-71fd-4847-a1f9-4669431f172d with compute id 6ac35386-1ca9-4c8e-bd6f-f08538d77699 for load balancer: de5ac3e7-e0e5-447b-8f91-29d9791badf0 >2018-07-18 08:18:51.206 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Port b70dd9e0-e90d-4b49-9657-9f0eea95dcf7 already exists. Nothing to be done. >2018-07-18 08:19:03.909 23 INFO octavia.controller.worker.tasks.database_tasks [req-21614f4a-8e5f-4461-aa0d-8b11e9b706e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 04ced798-7492-44cb-8ad8-0b70cadb07fe >2018-07-18 08:19:09.701 23 INFO octavia.controller.worker.tasks.database_tasks [req-54485ad3-70e9-4ae7-a90c-7d926eb49e75 - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: de5ac3e7-e0e5-447b-8f91-29d9791badf0 >2018-07-18 08:19:16.239 23 INFO octavia.controller.queue.endpoint [req-443ea228-98a0-46ae-81fa-dd56e540c012 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'f5360f1a-dc54-4b6a-b681-618e07e1158d'... >2018-07-18 08:19:17.090 23 INFO octavia.controller.queue.endpoint [req-fda8b7ad-53d5-4bfd-9d71-0a1e06d2cf9e - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '7522e90a-ad57-41bd-8c2e-a6154313189b'... >2018-07-18 08:19:21.348 23 INFO octavia.controller.queue.endpoint [req-d64b7af7-b236-4919-ac49-30973824bfd6 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '78cdd095-29e5-4fc8-a124-eaff4ab98597'... >2018-07-18 08:19:21.550 23 INFO octavia.controller.queue.endpoint [req-2560fa48-b251-4a6c-9f52-8564ad9ed6da - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '3609e3ee-435f-483e-bbf5-68673c7fddbe'... >2018-07-18 08:19:26.753 23 INFO octavia.controller.queue.endpoint [req-913ee56f-efef-435d-b235-fcd138b830ad - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c3fcd49d-47b0-476f-85f9-5fba995c9c6c'... >2018-07-18 08:19:27.020 23 INFO octavia.controller.queue.endpoint [req-cb60f1ff-4ef3-453b-9cac-75c212df6d96 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '8b641ff6-992c-41ad-8e71-7fd9f175ebf3'... >2018-07-18 08:21:36.089 23 INFO octavia.controller.queue.endpoint [req-3d2a7a97-036e-48ea-bcce-09b792b6548c - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '336f1102-c5e3-4ed7-8a9b-9d6eebd9e40e'... >2018-07-18 08:21:36.213 23 INFO octavia.controller.worker.tasks.database_tasks [req-3d2a7a97-036e-48ea-bcce-09b792b6548c - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id 4e65a33d-4c35-4539-a9e8-c24b452cadb4 >2018-07-18 08:21:36.469 23 INFO octavia.certificates.generator.local [req-3d2a7a97-036e-48ea-bcce-09b792b6548c - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 08:21:36.469 23 INFO octavia.certificates.generator.local [req-3d2a7a97-036e-48ea-bcce-09b792b6548c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 08:21:36.470 23 INFO octavia.certificates.generator.local [req-3d2a7a97-036e-48ea-bcce-09b792b6548c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 08:21:36.470 23 INFO octavia.certificates.generator.local [req-3d2a7a97-036e-48ea-bcce-09b792b6548c - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 08:21:48.753 23 INFO octavia.controller.worker.tasks.database_tasks [req-3d2a7a97-036e-48ea-bcce-09b792b6548c - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: 4e65a33d-4c35-4539-a9e8-c24b452cadb4 with compute id 21ae0189-b5df-4778-b0c1-35299453d591 for load balancer: 336f1102-c5e3-4ed7-8a9b-9d6eebd9e40e >2018-07-18 08:21:49.074 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-3d2a7a97-036e-48ea-bcce-09b792b6548c - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 309dd4d6-750a-4c09-b5d2-0ff582f25a02 already exists. Nothing to be done. >2018-07-18 08:21:56.138 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-3d2a7a97-036e-48ea-bcce-09b792b6548c - 293061856e1a4cffbae3ed099cf4f619 - - -] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.44', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.86.181 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f47004f8510>: Failed to establish a new connection: [Errno 111] Connection refused',)) >2018-07-18 08:22:05.726 23 INFO octavia.controller.worker.tasks.database_tasks [req-3d2a7a97-036e-48ea-bcce-09b792b6548c - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 336f1102-c5e3-4ed7-8a9b-9d6eebd9e40e >2018-07-18 08:22:20.316 23 INFO octavia.controller.queue.endpoint [req-0a5410f7-5004-402b-8c58-f21513259527 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'd6df69d8-3611-4299-89d1-12e9f0d9fb73'... >2018-07-18 08:22:25.268 23 INFO octavia.controller.queue.endpoint [req-bf432057-1ee2-452e-9675-b63a8aad45e5 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener '2786ef87-1363-4bfa-b32a-e0ba446ecdea'... >2018-07-18 08:22:30.219 23 INFO octavia.controller.queue.endpoint [req-609e54a9-2370-40cf-b54d-b71140b154aa - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'c316a10d-6557-4cc4-9890-05e94372758e'... >2018-07-18 08:22:35.274 23 INFO octavia.controller.queue.endpoint [req-80565377-276a-4305-b529-948b708ac7b8 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool '2599fe02-1831-4336-982e-0de0537bac12'... >2018-07-18 08:22:40.602 23 INFO octavia.controller.queue.endpoint [req-194a7c84-047e-41e4-8a1b-356cbf4481a1 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '5bf7cf81-957a-40dd-8b51-9d4dd6924e64'... >2018-07-18 08:22:45.544 23 INFO octavia.controller.queue.endpoint [req-2e8542ec-2668-4004-9269-4f021b9caa96 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'c5130dc6-f753-4938-a661-127bd6fdb967'... >2018-07-18 08:23:39.428 23 INFO octavia.controller.queue.endpoint [req-52320ab1-ee42-4ae5-9b1b-9648bd0fb76b - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member '5bf7cf81-957a-40dd-8b51-9d4dd6924e64'... >2018-07-18 08:23:49.371 23 INFO octavia.controller.queue.endpoint [req-d3e5141c-944f-4ddd-977d-81c68f9277ae - 293061856e1a4cffbae3ed099cf4f619 - - -] Deleting member 'c5130dc6-f753-4938-a661-127bd6fdb967'... >2018-07-18 08:23:55.166 23 INFO octavia.controller.queue.endpoint [req-556188d7-ba4b-4126-8cce-bbee08457952 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'ea42e522-8f83-4ec4-9c21-0755be0e6285'... >2018-07-18 08:23:59.928 23 INFO octavia.controller.queue.endpoint [req-326e56bf-d464-45f9-99ec-89f3326765f3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member '19507b7e-2ad1-4045-be67-a7f89335281f'... >2018-07-18 08:26:06.823 23 INFO octavia.controller.queue.endpoint [req-17ae900c-8517-4c94-a1db-02985da92f7a - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating load balancer '7c7b43cb-b02b-4c11-8c7c-251fef99a399'... >2018-07-18 08:26:06.950 23 INFO octavia.controller.worker.tasks.database_tasks [req-17ae900c-8517-4c94-a1db-02985da92f7a - 293061856e1a4cffbae3ed099cf4f619 - - -] Created Amphora in DB with id df3492d1-31f0-41e6-83c1-856138be1100 >2018-07-18 08:26:07.042 23 INFO octavia.certificates.generator.local [req-17ae900c-8517-4c94-a1db-02985da92f7a - 293061856e1a4cffbae3ed099cf4f619 - - -] Signing a certificate request using OpenSSL locally. >2018-07-18 08:26:07.043 23 INFO octavia.certificates.generator.local [req-17ae900c-8517-4c94-a1db-02985da92f7a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Certificate from config. >2018-07-18 08:26:07.043 23 INFO octavia.certificates.generator.local [req-17ae900c-8517-4c94-a1db-02985da92f7a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key from config. >2018-07-18 08:26:07.043 23 INFO octavia.certificates.generator.local [req-17ae900c-8517-4c94-a1db-02985da92f7a - 293061856e1a4cffbae3ed099cf4f619 - - -] Using CA Private Key Passphrase from config. >2018-07-18 08:26:20.212 23 INFO octavia.controller.worker.tasks.database_tasks [req-17ae900c-8517-4c94-a1db-02985da92f7a - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ALLOCATED in DB for amphora: df3492d1-31f0-41e6-83c1-856138be1100 with compute id 912ce712-8215-40de-a90f-ade97a5a20fd for load balancer: 7c7b43cb-b02b-4c11-8c7c-251fef99a399 >2018-07-18 08:26:20.529 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-17ae900c-8517-4c94-a1db-02985da92f7a - 293061856e1a4cffbae3ed099cf4f619 - - -] Port 02d28d78-5e0f-4076-ad7f-1307b22f4088 already exists. Nothing to be done. >2018-07-18 08:26:37.908 23 INFO octavia.controller.worker.tasks.database_tasks [req-17ae900c-8517-4c94-a1db-02985da92f7a - 293061856e1a4cffbae3ed099cf4f619 - - -] Mark ACTIVE in DB for load balancer id: 7c7b43cb-b02b-4c11-8c7c-251fef99a399 >2018-07-18 08:26:49.254 23 INFO octavia.controller.queue.endpoint [req-9e3cefc4-bf07-4b32-91fd-911c18bf1981 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating listener 'a70ed95f-88a5-4e44-ab2d-7922fa903bf4'... >2018-07-18 08:26:54.388 23 INFO octavia.controller.queue.endpoint [req-4434002e-f5ef-414f-a33b-dd206ca49319 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating pool 'd9149cd7-a136-40cf-83a6-0fa74ab105be'... >2018-07-18 08:26:59.975 23 INFO octavia.controller.queue.endpoint [req-21614f4a-8e5f-4461-aa0d-8b11e9b706e3 - 293061856e1a4cffbae3ed099cf4f619 - - -] Creating member 'f6377304-19a7-4d67-9758-67e027245cc9'...
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1602350
:
1459840
|
1459841
|
1459842
|
1459843
|
1460207
|
1460215
|
1460221
| 1460228