Attachment 1485083 Details for Bug 1631234 – Octavia worker logs

Octavia worker logs

worker.log.txt (text/plain), 30.91 KB, created by Jon Uriarte on 2018-09-20 09:25:46 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Jon Uriarte

Created: 2018-09-20 09:25:46 UTC

Size: 30.91 KB

patch

obsolete

>[heat-admin@controller-0 ~]$ cat /var/log/containers/octavia/worker.log
>2018-09-19 14:41:22.304 1 INFO cotyledon._service_manager [-] Caught SIGTERM signal, graceful exiting of master process
>2018-09-19 14:41:22.305 23 INFO cotyledon._service [-] Caught SIGTERM signal, graceful exiting of service ConsumerService(0) [23]
>2018-09-19 14:41:22.306 23 INFO octavia.controller.queue.consumer [-] Stopping consumer...
>2018-09-19 14:41:33.324 1 INFO octavia.common.config [-] Logging enabled!
>2018-09-19 14:41:33.324 1 INFO octavia.common.config [-] /usr/bin/octavia-worker version 2.0.2.dev42
>2018-09-19 14:41:33.339 23 INFO octavia.controller.queue.consumer [-] Starting consumer...
>2018-09-19 14:47:15.024 23 INFO octavia.controller.queue.endpoint [-] Deleting listener '60786c87-9479-492f-9938-43a561f1dc30'...
>2018-09-19 14:47:16.851 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: cdc2d511-a7b3-44ba-9924-22795ede626b
>2018-09-19 14:47:17.022 23 INFO octavia.controller.queue.endpoint [-] Deleting listener '05744236-5eee-471d-a961-ef9aac7d00cf'...
>2018-09-19 14:47:17.491 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: cdc2d511-a7b3-44ba-9924-22795ede626b
>2018-09-19 14:47:18.556 23 INFO octavia.controller.queue.endpoint [-] Deleting member '25ccfa75-2a22-4f55-bc62-8b51050586f7'...
>2018-09-19 14:47:27.328 23 INFO octavia.controller.queue.endpoint [-] Deleting pool 'bc921a0c-2951-490f-9e39-5d11cf0198b8'...
>2018-09-19 14:47:28.630 23 INFO octavia.controller.queue.endpoint [-] Deleting load balancer 'cdc2d511-a7b3-44ba-9924-22795ede626b'...
>2018-09-19 14:47:31.687 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Removing security group 6a536bba-67d3-4679-bf0e-da577b7e92e7 from port 0f4c60e9-e89b-429e-9ca8-0614d4937c14
>2018-09-19 14:47:32.354 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Deleted security group 6a536bba-67d3-4679-bf0e-da577b7e92e7
>2018-09-19 15:02:42.260 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer 'cc4a377e-c4dd-4010-8974-5e999fd595a6'...
>2018-09-19 15:02:42.386 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id 551a8173-3c52-4699-9c88-126014da9110
>2018-09-19 15:02:42.433 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally.
>2018-09-19 15:02:42.434 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config.
>2018-09-19 15:02:42.434 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config.
>2018-09-19 15:02:42.434 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config.
>2018-09-19 15:02:48.410 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer 'e77f6b07-2c8e-4562-a383-898da945c9b7'...
>2018-09-19 15:02:48.555 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id 1476e744-02f8-4359-a385-bd69e0c90d20
>2018-09-19 15:02:48.675 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally.
>2018-09-19 15:02:48.675 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config.
>2018-09-19 15:02:48.675 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config.
>2018-09-19 15:02:48.676 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config.
>2018-09-19 15:02:56.926 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: 551a8173-3c52-4699-9c88-126014da9110 with compute id 09610ecb-c53f-4e1e-b108-6a55c79c2b26 for 
>load balancer: cc4a377e-c4dd-4010-8974-5e999fd595a6
>2018-09-19 15:02:57.280 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port 46dbf720-83ac-4fd6-88c2-e35a5d86486e already exists. Nothing to be done.
>2018-09-19 15:03:01.863 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: 1476e744-02f8-4359-a385-bd69e0c90d20 with compute id 287b8b84-5889-4b86-b901-e4af8dbe5519 for 
>load balancer: e77f6b07-2c8e-4562-a383-898da945c9b7
>2018-09-19 15:03:01.956 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port 62195789-f384-4de5-9800-90a39e027516 already exists. Nothing to be done.
>2018-09-19 15:03:07.358 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.5', port=9443): Max retries e
>xceeded with url: /0.5/plug/vip/192.168.99.12 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7ff7e8017410>: Failed to establish a new connection: [Errno 
>113] No route to host',))
>2018-09-19 15:03:11.709 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.9', port=9443): Max retries e
>xceeded with url: /0.5/plug/vip/172.30.0.1 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7ff7e80222d0>: Failed to establish a new connection: [Errno 113
>] No route to host',))
>2018-09-19 15:03:12.366 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.5', port=9443): Max retries e
>xceeded with url: /0.5/plug/vip/192.168.99.12 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7ff7e8022410>: Failed to establish a new connection: [Errno 
>111] Connection refused',))
>2018-09-19 15:03:16.718 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.9', port=9443): Max retries e
>xceeded with url: /0.5/plug/vip/172.30.0.1 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7ff7e8017090>: Failed to establish a new connection: [Errno 111
>] Connection refused',))
>2018-09-19 15:03:22.111 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: cc4a377e-c4dd-4010-8974-5e999fd595a6
>2018-09-19 15:03:22.788 23 INFO octavia.controller.queue.endpoint [-] Creating listener 'be227f7b-505f-4beb-bbfd-4017f5f26350'...
>2018-09-19 15:03:25.027 23 INFO octavia.controller.queue.endpoint [req-1bc9c1bb-f2e2-420d-a4cf-d6130f74d5df - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating listener 'a0322a8a-f0bd-446e-a834-41532ae45e6b'...
>2018-09-19 15:03:26.362 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: e77f6b07-2c8e-4562-a383-898da945c9b7
>2018-09-19 15:03:26.588 23 INFO octavia.controller.queue.endpoint [-] Creating pool 'e4542959-3437-42bf-bf59-8fe7a3b84d8b'...
>2018-09-19 15:03:27.137 23 INFO octavia.controller.queue.endpoint [-] Creating pool 'a95b4b62-0c94-427d-8644-6921eb7d7f49'...
>2018-09-19 15:03:27.844 23 INFO octavia.controller.queue.endpoint [-] Creating pool '04d54133-5a32-4021-b9dc-f87811935941'...
>2018-09-19 15:03:28.815 23 INFO octavia.controller.queue.endpoint [req-589deebe-0c54-4316-8379-e4cc11ffc201 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating listener '21bf72fd-c5c3-4b7e-a9e5-f1e02c79102e'...
>2018-09-19 15:03:30.116 23 INFO octavia.controller.queue.endpoint [req-20b823c0-26a4-47e9-8a36-02bafc0febeb - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating listener '7c77f393-537f-4415-9af9-b20ce80784ab'...
>2018-09-19 15:03:48.541 23 INFO octavia.controller.queue.endpoint [-] Creating member '2a67eef2-9c24-4970-af3b-2ed179add5cd'...
>2018-09-19 15:03:50.101 23 INFO octavia.controller.queue.endpoint [-] Creating member '44c64ce4-bec9-427e-9e10-7f16a00df7e2'...
>2018-09-19 15:03:50.592 23 INFO octavia.controller.queue.endpoint [req-4a87bfcd-d7aa-4129-b2d4-634044ab71a3 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating member '199c23d2-597d-465e-af20-947adfb4a0d4'...
>2018-09-19 15:38:04.014 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer '986a3e27-1e6a-4d32-8776-9cbe3935a278'...
>2018-09-19 15:38:04.138 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id c0c59a35-2d82-4485-bba5-792e4d985814
>2018-09-19 15:38:04.194 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally.
>2018-09-19 15:38:04.195 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config.
>2018-09-19 15:38:04.195 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config.
>2018-09-19 15:38:04.195 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config.
>2018-09-19 15:38:17.598 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: c0c59a35-2d82-4485-bba5-792e4d985814 with compute id b6009656-513d-431b-81a4-f57d210d83b6 for 
>load balancer: 986a3e27-1e6a-4d32-8776-9cbe3935a278
>2018-09-19 15:38:17.987 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port 3d5bf1ba-0937-44ca-a230-d8150f4bedee already exists. Nothing to be done.
>2018-09-19 15:38:27.669 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.13', port=9443): Max retries 
>exceeded with url: /0.5/plug/vip/172.30.7.21 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7ff7d2ec6950>: Failed to establish a new connection: [Errno 1
>13] No route to host',))
>2018-09-19 15:38:32.676 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.13', port=9443): Max retries 
>exceeded with url: /0.5/plug/vip/172.30.7.21 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7ff7d2ec62d0>: Failed to establish a new connection: [Errno 1
>11] Connection refused',))
>2018-09-19 15:38:42.325 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: 986a3e27-1e6a-4d32-8776-9cbe3935a278
>2018-09-19 15:38:42.974 23 INFO octavia.controller.queue.endpoint [req-d6a4a7c5-1159-4b8c-871a-ee78ceb4c41d - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating listener '7f2a94d9-9eba-422a-ac33-02024e9c6922'...
>2018-09-19 15:38:48.256 23 INFO octavia.controller.queue.endpoint [-] Creating listener '0b60d7d7-04b5-4fcc-b14a-4c88a7b7454a'...
>2018-09-19 15:38:53.377 23 INFO octavia.controller.queue.endpoint [-] Creating listener 'a6c968c0-3176-4949-918d-5694fadce870'...
>2018-09-19 15:38:58.137 23 INFO octavia.controller.queue.endpoint [-] Creating pool '0a2d50cc-37b8-4e7d-9e0f-4e707dcddf32'...
>2018-09-19 15:39:03.379 23 INFO octavia.controller.queue.endpoint [req-bf925ecd-ae07-4766-ac0d-ebacd1dbaeea - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating pool 'f1b7dfb4-5c3f-4c79-a6e9-bc7d8321f62b'...
>2018-09-19 15:39:08.935 23 INFO octavia.controller.queue.endpoint [-] Creating pool '4936d5db-009a-4a4d-8189-e0d896c9258f'...
>2018-09-19 15:39:14.347 23 INFO octavia.controller.queue.endpoint [-] Creating member 'e4b4a222-f6b3-4fd1-9152-7228719ccf55'...
>2018-09-19 15:39:19.244 23 INFO octavia.controller.queue.endpoint [req-e21fe289-3e5c-4ace-a696-87147f466e8a - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating member 'c0667d26-68b4-4eae-ac58-6906d066e32e'...
>2018-09-19 15:39:24.026 23 INFO octavia.controller.queue.endpoint [-] Creating member '9180958d-dfab-4c39-8f1a-6da6e2ff130c'...
>2018-09-19 15:40:14.954 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer '05c98423-fa11-489e-8760-6d6e7b18c77a'...
>2018-09-19 15:40:15.081 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id aba2a605-fb8e-4539-bf68-960093ba5030
>2018-09-19 15:40:15.218 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally.
>2018-09-19 15:40:15.219 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config.
>2018-09-19 15:40:15.219 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config.
>2018-09-19 15:40:15.219 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config.
>2018-09-19 15:40:27.679 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: aba2a605-fb8e-4539-bf68-960093ba5030 with compute id c87563b4-27ea-4d10-ab7b-15fcc60e9359 for 
>load balancer: 05c98423-fa11-489e-8760-6d6e7b18c77a
>2018-09-19 15:40:27.917 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port 6b257f28-e12d-4bab-bc7f-8a618fc6c7d1 already exists. Nothing to be done.
>2018-09-19 15:40:37.943 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.16', port=9443): Max retries 
>exceeded with url: /0.5/plug/vip/172.30.103.68 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7ff7d059d450>: Failed to establish a new connection: [Errno
> 113] No route to host',))
>2018-09-19 15:40:42.950 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.16', port=9443): Max retries 
>exceeded with url: /0.5/plug/vip/172.30.103.68 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7ff7d05c3d50>: Failed to establish a new connection: [Errno
> 111] Connection refused',))
>2018-09-19 15:40:52.547 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: 05c98423-fa11-489e-8760-6d6e7b18c77a
>2018-09-19 15:41:06.063 23 INFO octavia.controller.queue.endpoint [req-de7027b4-d802-4e36-a3da-966283869fd9 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating listener '51d45230-fd2c-4ea8-94d5-24adda9bd91e'...
>2018-09-19 15:41:11.164 23 INFO octavia.controller.queue.endpoint [req-dc57d09c-373a-43fa-81ba-397cbb010c89 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating pool '39719038-f5ef-4cd3-9af7-e8b1b2b76719'...
>2018-09-19 15:41:16.323 23 INFO octavia.controller.queue.endpoint [-] Creating member '1c6552d2-be42-4721-8372-ec9113cde1ba'...                                                                            [65/851]
>2018-09-19 15:41:56.313 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer '6f34d87b-966a-4bee-bc05-9e7953d50250'...
>2018-09-19 15:41:56.554 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id 05fd491b-082c-4b40-bd32-f4b8ac189c9c
>2018-09-19 15:41:56.709 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally.
>2018-09-19 15:41:56.709 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config.
>2018-09-19 15:41:56.709 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config.
>2018-09-19 15:41:56.710 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config.
>2018-09-19 15:42:09.511 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: 05fd491b-082c-4b40-bd32-f4b8ac189c9c with compute id d156fd15-102c-4f51-a386-f3f2d18ed423 for 
>load balancer: 6f34d87b-966a-4bee-bc05-9e7953d50250
>2018-09-19 15:42:09.872 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port 44af1fc0-889f-4d0f-9b71-c533e74d542e already exists. Nothing to be done.
>2018-09-19 15:42:28.647 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: 6f34d87b-966a-4bee-bc05-9e7953d50250
>2018-09-19 15:42:38.477 23 INFO octavia.controller.queue.endpoint [req-a93c6534-04c6-44a1-972a-b3c05530ba95 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating listener '4958b861-f840-4519-8529-e179f684142d'...
>2018-09-19 15:42:44.055 23 INFO octavia.controller.queue.endpoint [-] Creating pool '64be0986-94a7-4bea-834e-8a2005e0182b'...
>2018-09-19 15:42:49.803 23 INFO octavia.controller.queue.endpoint [-] Creating member 'f6270890-2ef7-41ce-9973-3ae9c796c0ce'...
>2018-09-19 15:49:52.496 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer 'c1a75615-86d7-43d4-9f38-2f24df9857a8'...
>2018-09-19 15:49:52.642 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id 8a250e1c-0b54-43ac-bc8d-05b143bf6284
>2018-09-19 15:49:52.843 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally.
>2018-09-19 15:49:52.843 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config.
>2018-09-19 15:49:52.844 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config.
>2018-09-19 15:49:52.845 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config.
>2018-09-19 15:50:07.423 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: 8a250e1c-0b54-43ac-bc8d-05b143bf6284 with compute id 986b0ada-54a6-4541-81ce-593807cac9a9 for 
>load balancer: c1a75615-86d7-43d4-9f38-2f24df9857a8
>2018-09-19 15:50:08.341 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port aa5164f7-f8e8-4162-acfc-b7e9ccd78096 already exists. Nothing to be done.
>2018-09-19 15:50:15.202 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.11', port=9443): Max retries 
>exceeded with url: /0.5/plug/vip/172.30.211.2 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7ff7e81fe110>: Failed to establish a new connection: [Errno 
>111] Connection refused',))
>2018-09-19 15:50:20.209 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.11', port=9443): Max retries 
>exceeded with url: /0.5/plug/vip/172.30.211.2 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7ff7e81feed0>: Failed to establish a new connection: [Errno 
>111] Connection refused',))
>2018-09-19 15:50:29.991 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: c1a75615-86d7-43d4-9f38-2f24df9857a8
>2018-09-19 15:50:34.963 23 INFO octavia.controller.queue.endpoint [-] Creating listener 'eda98d15-8b5c-4fb0-bac0-ec38c0ed74a6'...
>2018-09-19 15:50:40.171 23 INFO octavia.controller.queue.endpoint [-] Creating pool '2f251b09-789f-4c52-b4b3-eadaaddad642'...
>2018-09-19 15:50:45.969 23 INFO octavia.controller.queue.endpoint [req-91320fc3-abcc-433e-9908-53fb6be6022e - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating member 'a9e4d446-5d3e-4150-b043-a0955b5da277'...
>2018-09-19 15:51:11.920 23 INFO octavia.controller.queue.endpoint [req-9d6d4232-4a1d-44ea-8cea-4530f6d51d32 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating load balancer '065a9324-042a-48a3-bf3b-658efe0c7785'
>...
>2018-09-19 15:51:12.079 23 INFO octavia.controller.worker.tasks.database_tasks [req-9d6d4232-4a1d-44ea-8cea-4530f6d51d32 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Created Amphora in DB with id 416cea6a-2fa0-451f
>-aaf8-ef6876ef2795
>2018-09-19 15:51:12.127 23 INFO octavia.certificates.generator.local [req-9d6d4232-4a1d-44ea-8cea-4530f6d51d32 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Signing a certificate request using OpenSSL locally.
>2018-09-19 15:51:12.128 23 INFO octavia.certificates.generator.local [req-9d6d4232-4a1d-44ea-8cea-4530f6d51d32 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Using CA Certificate from config.
>2018-09-19 15:51:12.128 23 INFO octavia.certificates.generator.local [req-9d6d4232-4a1d-44ea-8cea-4530f6d51d32 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Using CA Private Key from config.
>2018-09-19 15:51:12.129 23 INFO octavia.certificates.generator.local [req-9d6d4232-4a1d-44ea-8cea-4530f6d51d32 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Using CA Private Key Passphrase from config.
>2018-09-19 15:51:24.620 23 INFO octavia.controller.worker.tasks.database_tasks [req-9d6d4232-4a1d-44ea-8cea-4530f6d51d32 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Mark ALLOCATED in DB for amphora: 416cea6a-2fa0-
>451f-aaf8-ef6876ef2795 with compute id 7ad0084e-d66f-4232-bec5-b9b4acbb6f9e for load balancer: 065a9324-042a-48a3-bf3b-658efe0c7785
>2018-09-19 15:51:24.959 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-9d6d4232-4a1d-44ea-8cea-4530f6d51d32 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Port f2eea3aa-8d61-458b-b58d-39455ebfb94a
> already exists. Nothing to be done.
>2018-09-19 15:51:35.299 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-9d6d4232-4a1d-44ea-8cea-4530f6d51d32 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Could not connect to instance. Retrying.: C
>onnectionError: HTTPSConnectionPool(host='172.24.0.4', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.203.144 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSCo
>nnection object at 0x7ff7d2f7a810>: Failed to establish a new connection: [Errno 113] No route to host',))
>2018-09-19 15:51:41.311 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-9d6d4232-4a1d-44ea-8cea-4530f6d51d32 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Could not connect to instance. Retrying.: C
>onnectionError: HTTPSConnectionPool(host='172.24.0.4', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.203.144 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSCo
>nnection object at 0x7ff7d0594f90>: Failed to establish a new connection: [Errno 111] Connection refused',))
>2018-09-19 15:51:46.314 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-9d6d4232-4a1d-44ea-8cea-4530f6d51d32 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Could not connect to instance. Retrying.: C
>onnectionError: HTTPSConnectionPool(host='172.24.0.4', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.203.144 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSCo
>nnection object at 0x7ff7d0594b10>: Failed to establish a new connection: [Errno 111] Connection refused',))
>2018-09-19 15:51:56.155 23 INFO octavia.controller.worker.tasks.database_tasks [req-9d6d4232-4a1d-44ea-8cea-4530f6d51d32 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Mark ACTIVE in DB for load balancer id: 065a9324
>-042a-48a3-bf3b-658efe0c7785
>2018-09-19 15:52:06.234 23 INFO octavia.controller.queue.endpoint [-] Creating listener 'c3d50df0-79b9-4867-8144-b9e8c2fe7d2e'...
>2018-09-19 15:52:11.021 23 INFO octavia.controller.queue.endpoint [-] Creating pool '504f5766-98ca-4f5c-9f03-435c481aded7'...
>2018-09-19 15:52:17.179 23 INFO octavia.controller.queue.endpoint [-] Creating member '20116380-a414-4a1d-a616-a01474ab8ba8'...
>2018-09-19 15:52:43.385 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer 'd7ff2739-d11a-4bc1-a3b5-524f8375f262'...
>2018-09-19 15:52:43.534 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id 281d8eda-4743-4c68-a4e8-0007c1403332
>2018-09-19 15:52:43.678 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally.
>2018-09-19 15:52:43.678 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config.
>2018-09-19 15:52:43.679 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config.
>2018-09-19 15:52:43.679 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config.
>2018-09-19 15:52:56.845 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: 281d8eda-4743-4c68-a4e8-0007c1403332 with compute id 18b791d7-2085-420e-9e22-0007a4b96e8c for 
>load balancer: d7ff2739-d11a-4bc1-a3b5-524f8375f262
>2018-09-19 15:52:56.943 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port c962f27a-89bd-412f-af82-7f493578cf13 already exists. Nothing to be done.
>2018-09-19 15:53:05.576 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectionError: HTTPSConnectionPool(host='172.24.0.15', port=9443): Max retries 
>exceeded with url: /0.5/plug/vip/172.30.25.98 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7ff7d052f550>: Failed to establish a new connection: [Errno 
>111] Connection refused',))
>2018-09-19 15:53:15.204 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: d7ff2739-d11a-4bc1-a3b5-524f8375f262
>2018-09-19 15:53:22.704 23 INFO octavia.controller.queue.endpoint [req-2c4513a6-abbf-46fb-936f-707151d0ffd5 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating listener '5ae1086d-2abf-4734-8e6e-f9cd75b0a8ab'...
>2018-09-19 15:53:28.376 23 INFO octavia.controller.queue.endpoint [-] Creating pool '4ce0b33e-1406-4f0a-b9f6-2fddb31306a6'...
>2018-09-19 15:53:33.708 23 INFO octavia.controller.queue.endpoint [-] Creating member '1e689b54-9051-4675-9ae9-7d932ec618ad'...
>2018-09-19 16:01:50.996 23 INFO octavia.controller.queue.endpoint [-] Creating load balancer 'aee71255-c8cd-4761-9686-0ab5f6261c83'...
>2018-09-19 16:01:51.149 23 INFO octavia.controller.worker.tasks.database_tasks [-] Created Amphora in DB with id 5142b711-ead7-44cf-b85c-efa47ef219e2
>2018-09-19 16:01:51.178 23 INFO octavia.certificates.generator.local [-] Signing a certificate request using OpenSSL locally.
>2018-09-19 16:01:51.178 23 INFO octavia.certificates.generator.local [-] Using CA Certificate from config.
>2018-09-19 16:01:51.178 23 INFO octavia.certificates.generator.local [-] Using CA Private Key from config.
>2018-09-19 16:01:51.179 23 INFO octavia.certificates.generator.local [-] Using CA Private Key Passphrase from config.
>2018-09-19 16:02:06.182 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ALLOCATED in DB for amphora: 5142b711-ead7-44cf-b85c-efa47ef219e2 with compute id 7cbb27c3-7e7b-444a-9274-b05ca9d4e176 for 
>load balancer: aee71255-c8cd-4761-9686-0ab5f6261c83
>2018-09-19 16:02:06.462 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [-] Port 74d6ec06-127e-474a-8496-dbb7a0147563 already exists. Nothing to be done.
>2018-09-19 16:02:23.919 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [-] Could not connect to instance. Retrying.: ConnectTimeout: HTTPSConnectionPool(host='172.24.0.8', port=9443): Max retries ex
>ceeded with url: /0.5/plug/vip/172.30.204.230 (Caused by ConnectTimeoutError(<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7ff7d05d8fd0>, 'Connection to 172.24.0.8 timed out. (connect
> timeout=10.0)'))
>2018-09-19 16:02:33.549 23 INFO octavia.controller.worker.tasks.database_tasks [-] Mark ACTIVE in DB for load balancer id: aee71255-c8cd-4761-9686-0ab5f6261c83
>2018-09-19 16:02:35.784 23 INFO octavia.controller.queue.endpoint [-] Creating listener 'b8544f75-e0a3-4bfc-873a-185fe67d5fd1'...
>2018-09-19 16:02:40.784 23 INFO octavia.controller.queue.endpoint [-] Creating pool 'b60a7456-a810-493c-b2b9-05bab35c928d'...
>2018-09-19 16:02:46.137 23 INFO octavia.controller.queue.endpoint [req-2c9585df-d227-4d27-8b48-b9e9c468758b - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating member '371811dd-5fd2-4570-bbce-c8f63ca07cfb'...
>2018-09-19 16:02:47.526 23 INFO octavia.controller.queue.endpoint [req-e289a3b8-6def-4de1-91d7-5f41ab7d1b8e - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating member 'c669dd4e-2ff4-429f-a2cd-b349376dd597'...
>2018-09-19 16:03:09.598 23 INFO octavia.controller.queue.endpoint [req-92b739ff-d109-4799-9aa7-77c75b7aca2b - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating load balancer '073a1b83-49ba-49f0-a1ed-fc32627b0094'
>...
>2018-09-19 16:03:09.760 23 INFO octavia.controller.worker.tasks.database_tasks [req-92b739ff-d109-4799-9aa7-77c75b7aca2b - 3a88df4f83fa44ffada1c3b03e17327b - - -] Created Amphora in DB with id f12a49d6-1f22-42f9
>-8686-a7cab15bdcfc
>2018-09-19 16:03:10.025 23 INFO octavia.certificates.generator.local [req-92b739ff-d109-4799-9aa7-77c75b7aca2b - 3a88df4f83fa44ffada1c3b03e17327b - - -] Signing a certificate request using OpenSSL locally.
>2018-09-19 16:03:10.025 23 INFO octavia.certificates.generator.local [req-92b739ff-d109-4799-9aa7-77c75b7aca2b - 3a88df4f83fa44ffada1c3b03e17327b - - -] Using CA Certificate from config.
>2018-09-19 16:03:10.026 23 INFO octavia.certificates.generator.local [req-92b739ff-d109-4799-9aa7-77c75b7aca2b - 3a88df4f83fa44ffada1c3b03e17327b - - -] Using CA Private Key from config.
>2018-09-19 16:03:10.027 23 INFO octavia.certificates.generator.local [req-92b739ff-d109-4799-9aa7-77c75b7aca2b - 3a88df4f83fa44ffada1c3b03e17327b - - -] Using CA Private Key Passphrase from config.
>2018-09-19 16:03:23.758 23 INFO octavia.controller.worker.tasks.database_tasks [req-92b739ff-d109-4799-9aa7-77c75b7aca2b - 3a88df4f83fa44ffada1c3b03e17327b - - -] Mark ALLOCATED in DB for amphora: f12a49d6-1f22-
>42f9-8686-a7cab15bdcfc with compute id 5302a175-4b2d-49eb-953c-c477f9588246 for load balancer: 073a1b83-49ba-49f0-a1ed-fc32627b0094
>2018-09-19 16:03:23.882 23 INFO octavia.network.drivers.neutron.allowed_address_pairs [req-92b739ff-d109-4799-9aa7-77c75b7aca2b - 3a88df4f83fa44ffada1c3b03e17327b - - -] Port 267c44ab-d90a-47b0-852e-7fd976a78b80
> already exists. Nothing to be done.
>2018-09-19 16:03:33.785 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-92b739ff-d109-4799-9aa7-77c75b7aca2b - 3a88df4f83fa44ffada1c3b03e17327b - - -] Could not connect to instance. Retrying.: C
>onnectionError: HTTPSConnectionPool(host='172.24.0.21', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.222.240 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSC
>onnection object at 0x7ff7e81d5090>: Failed to establish a new connection: [Errno 113] No route to host',))
>2018-09-19 16:03:38.793 23 WARNING octavia.amphorae.drivers.haproxy.rest_api_driver [req-92b739ff-d109-4799-9aa7-77c75b7aca2b - 3a88df4f83fa44ffada1c3b03e17327b - - -] Could not connect to instance. Retrying.: C
>onnectionError: HTTPSConnectionPool(host='172.24.0.21', port=9443): Max retries exceeded with url: /0.5/plug/vip/172.30.222.240 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSC
>onnection object at 0x7ff7e81d5d90>: Failed to establish a new connection: [Errno 111] Connection refused',))
>2018-09-19 16:03:48.448 23 INFO octavia.controller.worker.tasks.database_tasks [req-92b739ff-d109-4799-9aa7-77c75b7aca2b - 3a88df4f83fa44ffada1c3b03e17327b - - -] Mark ACTIVE in DB for load balancer id: 073a1b83
>-49ba-49f0-a1ed-fc32627b0094
>2018-09-19 16:03:51.801 23 INFO octavia.controller.queue.endpoint [req-dcfa80aa-6943-46ba-8a69-fe23006c73a7 - 3a88df4f83fa44ffada1c3b03e17327b - - -] Creating listener 'd7afac29-a823-4593-8178-9f65e902f53e'...
>2018-09-19 16:03:56.983 23 INFO octavia.controller.queue.endpoint [-] Creating pool '368e2bd1-4345-4fc5-bf01-7dd48d2ed4f9'...
>2018-09-19 16:04:01.916 23 INFO octavia.controller.queue.endpoint [-] Creating member '78cae063-bd19-4a85-ab5d-2aa4084ae28d'...
>2018-09-19 16:04:03.271 23 INFO octavia.controller.queue.endpoint [-] Creating member '88102d54-edd8-4f73-aede-786c9e62b06d'...
>2018-09-19 16:04:08.292 23 INFO octavia.controller.queue.endpoint [-] Creating member 'ce2776f4-1e40-4574-8d6d-65e46e0374eb'...
>

Actions: View

Attachments on bug 1631234: 1485083