Bug 1726260 - Amphora loadbalancers fail to create
Summary: Amphora loadbalancers fail to create
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-tripleo-heat-templates
Version: 14.0 (Rocky)
Hardware: Unspecified
OS: Unspecified
urgent
urgent
Target Milestone: z4
: 14.0 (Rocky)
Assignee: Nir Magnezi
QA Contact: Bruna Bonguardo
URL:
Whiteboard:
Depends On: 1718882 1718896 1718905
Blocks:
TreeView+ depends on / blocked
 
Reported: 2019-07-02 12:50 UTC by Nir Magnezi
Modified: 2019-09-10 14:11 UTC (History)
7 users (show)

Fixed In Version: openstack-tripleo-heat-templates-9.3.1-0.20190513171746.el7ost openstack-tripleo-common-9.5.0-8.el7ost puppet-octavia-13.3.2-0.20190420064723.el7ost
Doc Type: No Doc Update
Doc Text:
Clone Of:
Environment:
Last Closed: 2019-09-03 15:22:42 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack gerrit 669822 0 None None None 2019-07-31 11:16:32 UTC
OpenStack gerrit 669825 0 None None None 2019-07-31 11:16:32 UTC
OpenStack gerrit 669856 0 None None None 2019-07-31 11:16:32 UTC
Red Hat Product Errata RHBA-2019:2617 0 None None None 2019-09-03 15:22:48 UTC

Description Nir Magnezi 2019-07-02 12:50:31 UTC
This bug was initially created as a copy of Bug #1723051

I am copying this bug because: It impacts OSP14.



Description of problem:

Amphora load balancers fail to create.
Worker log show "Fernet key must be 32 url-safe base64-encoded bytes.

Version-Release number of selected component (if applicable):
OSP 15 RHOS_TRUNK-15.0-RHEL-8-20190619.n.1

How reproducible:
100%

Steps to Reproduce:
1. Deploy OSP 15 with Octavia enabled
2. Create loadbalancer


Actual results:

[...]
2019-06-21 03:13:59.870 18 WARNING octavia.controller.worker.controller_worker [-] Task 'STANDALONE-octavia-create-amp-for-lb-subflow-octavia-generate-serverpem' (2b6a2a25-396a-42bf-9f91-0e9fb1014deb) transitioned into state 'FAILURE' from state 'RUNNING'
12 predecessors (most recent first):
  Atom 'STANDALONE-octavia-create-amp-for-lb-subflow-octavia-create-amphora-indb' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {}, 'provides': '7a8d9ce6-e033-4726-aac8-534b80843f1e'}
  |__Flow 'STANDALONE-octavia-create-amp-for-lb-subflow'
     |__Atom 'STANDALONE-octavia-get-amphora-for-lb-subflow-octavia-mapload-balancer-to-amphora' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer_id': '41e00d9d-ad66-4c46-a49d-e8cb852e0d9f', 'flavor': {}}, 'provides': None}
        |__Flow 'STANDALONE-octavia-get-amphora-for-lb-subflow'
           |__Flow 'STANDALONE-octavia-plug-net-subflow'
              |__Atom 'octavia.controller.worker.tasks.network_tasks.GetSubnetFromVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f0ff40f0da0>}, 'provides': <octavia.network.data_models.Subnet object at 0x7f0ff4098208>}
                 |__Atom 'octavia.controller.worker.tasks.network_tasks.UpdateVIPSecurityGroup' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f0ff40f0da0>}, 'provides': None}
                    |__Atom 'octavia.controller.worker.tasks.database_tasks.UpdateVIPAfterAllocation' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer_id': '41e00d9d-ad66-4c46-a49d-e8cb852e0d9f', 'vip': <octavia.common.data_models.Vip object at 0x7f0ff4c033c8>}, 'provides': <octavia.common.data_models.LoadBalancer object at 0x7f0ff40f0da0>}
                       |__Atom 'octavia.controller.worker.tasks.network_tasks.AllocateVIP' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer': <octavia.common.data_models.LoadBalancer object at 0x7f0ff40f0ef0>}, 'provides': <octavia.common.data_models.Vip object at 0x7f0ff4c033c8>}
                          |__Atom 'reload-lb-before-allocate-vip' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer_id': '41e00d9d-ad66-4c46-a49d-e8cb852e0d9f'}, 'provides': <octavia.common.data_models.LoadBalancer object at 0x7f0ff40f0ef0>}
                             |__Atom 'octavia.controller.worker.tasks.lifecycle_tasks.LoadBalancerIDToErrorOnRevertTask' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'loadbalancer_id': '41e00d9d-ad66-4c46-a49d-e8cb852e0d9f'}, 'provides': None}
                                |__Flow 'octavia-create-loadbalancer-flow': ValueError: Fernet key must be 32 url-safe base64-encoded bytes.
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker Traceback (most recent call last):
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker   File "/usr/lib/python3.6/site-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker     result = task.execute(**arguments)
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker   File "/usr/lib/python3.6/site-packages/octavia/controller/worker/tasks/cert_task.py", line 50, in execute
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker     fer = fernet.Fernet(key)
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker   File "/usr/lib64/python3.6/site-packages/cryptography/fernet.py", line 37, in __init__
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker     "Fernet key must be 32 url-safe base64-encoded bytes."
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker ValueError: Fernet key must be 32 url-safe base64-encoded bytes.
2019-06-21 03:13:59.870 18 ERROR octavia.controller.worker.controller_worker 
2019-06-21 03:13:59.880 18 DEBUG octavia.controller.worker.controller_worker [-] Task 'STANDALONE-octavia-create-amp-for-lb-subflow-octavia-generate-serverpem' (2b6a2a25-396a-42bf-9f91-0e9fb1014deb) transitioned into state 'REVERTING' from state 'FAILURE' _task_receiver /usr/lib/python3.6/site-packages/taskflow/listeners/logging.py:194
2019-06-21 03:13:59.882 18 WARNING octavia.controller.worker.controller_worker [-] Task 'STANDALONE-octavia-create-amp-for-lb-subflow-octavia-generate-serverpem' (2b6a2a25-396a-42bf-9f91-0e9fb1014deb) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
2019-06-21 03:13:59.884 18 DEBUG octavia.controller.worker.controller_worker [-] Task 'STANDALONE-octavia-create-amp-for-lb-subflow-octavia-create-amphora-indb' (2440e1c3-e310-44cd-8eb9-64a9cd20b85b) transitioned into state 'REVERTING' from state 'SUCCESS' _task_receiver /usr/lib/python3.6/site-packages/taskflow/listeners/logging.py:194
2019-06-21 03:13:59.884 18 WARNING octavia.controller.worker.tasks.database_tasks [-] Reverting create amphora in DB for amp id 7a8d9ce6-e033-4726-aac8-534b80843f1e 
2019-06-21 03:13:59.901 18 WARNING octavia.controller.worker.controller_worker [-] Task 'STANDALONE-octavia-create-amp-for-lb-subflow-octavia-create-amphora-indb' (2440e1c3-e310-44cd-8eb9-64a9cd20b85b) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
[...]

Comment 21 errata-xmlrpc 2019-09-03 15:22:42 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2019:2617


Note You need to log in before you can comment on or make changes to this bug.