Bug 1726261 - Amphora loadbalancers fail to create
Summary: Amphora loadbalancers fail to create
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-tripleo-heat-templates
Version: 13.0 (Queens)
Hardware: Unspecified
OS: Unspecified
urgent
urgent
Target Milestone: z8
: 13.0 (Queens)
Assignee: Nir Magnezi
QA Contact: Bruna Bonguardo
URL:
Whiteboard:
Depends On: 1718923 1718936 1718940
Blocks:
TreeView+ depends on / blocked
 
Reported: 2019-07-02 12:53 UTC by Nir Magnezi
Modified: 2019-09-10 14:12 UTC (History)
6 users (show)

Fixed In Version: puppet-octavia-12.4.0-11.el7ost openstack-tripleo-heat-templates-8.3.1-71.el7ost openstack-tripleo-common-8.6.8-13.el7ost
Doc Type: No Doc Update
Doc Text:
Clone Of:
Environment:
Last Closed: 2019-09-03 16:55:34 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack gerrit 669824 0 None None None 2019-07-31 12:29:55 UTC
OpenStack gerrit 669829 0 None None None 2019-07-31 12:29:55 UTC
OpenStack gerrit 669848 0 None None None 2019-07-31 12:29:55 UTC
Red Hat Product Errata RHBA-2019:2624 0 None None None 2019-09-03 16:55:48 UTC

Description Nir Magnezi 2019-07-02 12:53:50 UTC
This bug was initially created as a copy of Bug #1726260

I am copying this bug because: It impacts OSP13.


Description of problem:

Amphora load balancers fail to create.
Worker log show "Fernet key must be 32 url-safe base64-encoded bytes.

Version-Release number of selected component (if applicable):
OSP 15 RHOS_TRUNK-15.0-RHEL-8-20190619.n.1

How reproducible:
100%

Steps to Reproduce:
1. Deploy OSP 15 with Octavia enabled
2. Create loadbalancer


Actual results:

[...]
2019-06-21 03:13:59.870 18 WARNING octavia.controller.worker.controller_worker [-] Task 'STANDALONE-octavia-create-amp-for-lb-subflow-octavia-generate-serverpem' (2b6a2a25-396a-42bf-9f91-0e9fb1014deb) transitioned into state 'FAILURE' from state 'RUNNING'
12 predecessors (most recent first):
  Atom 'STANDALONE-octavia-create-amp-for-lb-subflow-octavia-create-amphora-indb' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {}, 'provides': '7a8d9ce6-e033-4726-aac8-534b80843f1e'}
  |__Flow 'STANDALONE-octavia-create-amp-for-lb-subflow'
     |__Atom 'STANDALONE-octavia-get-amphora-for-lb-subflow-octavia-mapload-balancer-to-amphora' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer_id': '41e00d9d-ad66-4c46-a49d-e8cb852e0d9f', 'flavor': {}}, 'provides': None}
        |__Flow 'STANDALONE-octavia-get-amphora-for-lb-subflow'
           |__Flow 'STANDALONE-octavia-plug-net-subflow'
              |__Atom 'octavia.controller.worker.tasks.network_tasks.GetSubnetFromVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f0ff40f0da0>}, 'provides': <octavia.network.data_models.Subnet object at 0x7f0ff4098208>}
                 |__Atom 'octavia.controller.worker.tasks.network_tasks.UpdateVIPSecurityGroup' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f0ff40f0da0>}, 'provides': None}
                    |__Atom 'octavia.controller.worker.tasks.database_tasks.UpdateVIPAfterAllocation' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer_id': '41e00d9d-ad66-4c46-a49d-e8cb852e0d9f', 'vip': <octavia.common.data_models.Vip object at 0x7f0ff4c033c8>}, 'provides': <octavia.common.data_models.LoadBalancer object at 0x7f0ff40f0da0>}
                       |__Atom 'octavia.controller.worker.tasks.network_tasks.AllocateVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f0ff40f0ef0>}, 'provides': <octavia.common.data_models.Vip object at 0x7f0ff4c033c8>}
                          |__Atom 'reload-lb-before-allocate-vip' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer_id': '41e00d9d-ad66-4c46-a49d-e8cb852e0d9f'}, 'provides': <octavia.common.data_models.LoadBalancer object at 0x7f0ff40f0ef0>}
                             |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerIDToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer_id': '41e00d9d-ad66-4c46-a49d-e8cb852e0d9f'}, 'provides': None}
                                |__Flow 'octavia-create-loadbalancer-flow': ValueError: Fernet key must be 32 url-safe base64-encoded bytes.
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last):
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker   File "/usr/lib/python3.6/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker     result = task.execute(**arguments)
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker   File "/usr/lib/python3.6/site-packages/octavia/controller/worker/tasks/cert_task.py", line 50, in execute
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker     fer = fernet.Fernet(key)
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker   File "/usr/lib64/python3.6/site-packages/cryptography/fernet.py", line 37, in __init__
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker     "Fernet key must be 32 url-safe base64-encoded bytes."
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker ValueError: Fernet key must be 32 url-safe base64-encoded bytes.
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker 
2019-06-21 03:13:59.880 18 DEBUG octavia.controller.worker.controller_worker [-] Task 'STANDALONE-octavia-create-amp-for-lb-subflow-octavia-generate-serverpem' (2b6a2a25-396a-42bf-9f91-0e9fb1014deb) transitioned into state 'REVERTING' from state 'FAILURE' _task_receiver /usr/lib/python3.6/site-packages/taskflow/listeners/logging.py:194
2019-06-21 03:13:59.882 18 WARNING octavia.controller.worker.controller_worker [-] Task 'STANDALONE-octavia-create-amp-for-lb-subflow-octavia-generate-serverpem' (2b6a2a25-396a-42bf-9f91-0e9fb1014deb) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
2019-06-21 03:13:59.884 18 DEBUG octavia.controller.worker.controller_worker [-] Task 'STANDALONE-octavia-create-amp-for-lb-subflow-octavia-create-amphora-indb' (2440e1c3-e310-44cd-8eb9-64a9cd20b85b) transitioned into state 'REVERTING' from state 'SUCCESS' _task_receiver /usr/lib/python3.6/site-packages/taskflow/listeners/logging.py:194
2019-06-21 03:13:59.884 18 WARNING octavia.controller.worker.tasks.database_tasks [-] Reverting create amphora in DB for amp id 7a8d9ce6-e033-4726-aac8-534b80843f1e 
2019-06-21 03:13:59.901 18 WARNING octavia.controller.worker.controller_worker [-] Task 'STANDALONE-octavia-create-amp-for-lb-subflow-octavia-create-amphora-indb' (2440e1c3-e310-44cd-8eb9-64a9cd20b85b) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
[...]

Comment 4 Nir Magnezi 2019-07-02 13:19:20 UTC
need further work, see bug 1726261.

Comment 20 errata-xmlrpc 2019-09-03 16:55:34 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2019:2624


Note You need to log in before you can comment on or make changes to this bug.