1710453 – tempest.api.compute.servers.test_create_server_multi_nic.ServersTestMultiNic.test_verify_multiple_nics_order[id-0578d144-ed74-43f8-8e57-ab10dbf9b3c2]

Bug 1710453 - tempest.api.compute.servers.test_create_server_multi_nic.ServersTestMultiNic.test_verify_multiple_nics_order[id-0578d144-ed74-43f8-8e57-ab10dbf9b3c2]

Summary: tempest.api.compute.servers.test_create_server_multi_nic.ServersTestMultiNic....

Keywords:
Status:	CLOSED DUPLICATE of bug 1710955
Alias:	None
Product:	Red Hat OpenStack
Classification:	Red Hat
Component:	openstack-neutron
Sub Component:
Version:	15.0 (Stein)
Hardware:	Unspecified
OS:	Unspecified
Priority:	unspecified
Severity:	unspecified
Target Milestone:	beta
Target Release:	---
Assignee:	Bernard Cafarelli
QA Contact:	Roee Agiman
Docs Contact:
URL:
Whiteboard:
Duplicates (1):	1710452 (view as bug list)
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2019-05-15 14:35 UTC by Matthew Booth
Modified:	2019-09-09 17:10 UTC (History)
CC List:	12 users (show)
Fixed In Version:
Doc Type:	If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:	2019-05-20 15:05:47 UTC
Target Upstream Version:
Embargoed:

Attachments	(Terms of Use)

Comment 1 Stephen Finucane 2019-05-16 15:51:04 UTC

Looks like there was an issue with port binding. I can see the following in the nova-compute logs from compute-0 (from '/compute-0/var/log/containers/nova/nova-compute.log' at [1])

```
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager [req-8820e736-57e0-4d85-b171-c7e9c1113d43 fb09d0f59e1b4885a048a849bf809630 50739812d96c49ed8085a9d56a716612 - default default] Instance failed network setup after 1 attempt(s): nova.exception.PortBindingFailed: Binding failed for port e67dcee7-6dd3-47e7-bcc0-82ac02056d23, please check neutron logs for more information.
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager Traceback (most recent call last):
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager   File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 1500, in _allocate_network_async
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager     resource_provider_mapping=resource_provider_mapping)
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager   File "/usr/lib/python3.6/site-packages/nova/network/neutronv2/api.py", line 1122, in allocate_for_instance
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager     bind_host_id, available_macs, requested_ports_dict)
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager   File "/usr/lib/python3.6/site-packages/nova/network/neutronv2/api.py", line 1255, in _update_ports_for_instance
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager     vif.destroy()
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager   File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager     self.force_reraise()
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager   File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager     six.reraise(self.type_, self.value, self.tb)
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager   File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager     raise value
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager   File "/usr/lib/python3.6/site-packages/nova/network/neutronv2/api.py", line 1225, in _update_ports_for_instance
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager     port_client, instance, port_id, port_req_body)
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager   File "/usr/lib/python3.6/site-packages/nova/network/neutronv2/api.py", line 580, in _update_port
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager     _ensure_no_port_binding_failure(port)
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager   File "/usr/lib/python3.6/site-packages/nova/network/neutronv2/api.py", line 250, in _ensure_no_port_binding_failure
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager     raise exception.PortBindingFailed(port_id=port['id'])
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager nova.exception.PortBindingFailed: Binding failed for port e67dcee7-6dd3-47e7-bcc0-82ac02056d23, please check neutron logs for more information.
2019-05-13 15:59:28.089 8 ERROR nova.compute.manager 
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [req-8820e736-57e0-4d85-b171-c7e9c1113d43 fb09d0f59e1b4885a048a849bf809630 50739812d96c49ed8085a9d56a716612 - default default] [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea] Instance failed to spawn: nova.exception.PortBindingFailed: Binding failed for port e67dcee7-6dd3-47e7-bcc0-82ac02056d23, please check neutron logs for more information.
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea] Traceback (most recent call last):
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 2474, in _build_resources
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     yield resources
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 2235, in _build_and_run_instance
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     block_device_info=block_device_info)
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 3166, in spawn
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     mdevs=mdevs)
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/nova/virt/libvirt/driver.py", line 5497, in _get_guest_xml
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     network_info_str = str(network_info)
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/nova/network/model.py", line 570, in __str__
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     return self._sync_wrapper(fn, *args, **kwargs)
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/nova/network/model.py", line 553, in _sync_wrapper
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     self.wait()
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/nova/network/model.py", line 585, in wait
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     self[:] = self._gt.wait()
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/eventlet/greenthread.py", line 180, in wait
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     return self._exit_event.wait()
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/eventlet/event.py", line 125, in wait
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     result = hub.switch()
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/eventlet/hubs/hub.py", line 297, in switch
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     return self.greenlet.switch()
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/eventlet/greenthread.py", line 219, in main
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     result = function(*args, **kwargs)
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/nova/utils.py", line 800, in context_wrapper
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     return func(*args, **kwargs)
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 1517, in _allocate_network_async
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     six.reraise(*exc_info)
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     raise value
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/nova/compute/manager.py", line 1500, in _allocate_network_async
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     resource_provider_mapping=resource_provider_mapping)
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/nova/network/neutronv2/api.py", line 1122, in allocate_for_instance
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     bind_host_id, available_macs, requested_ports_dict)
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/nova/network/neutronv2/api.py", line 1255, in _update_ports_for_instance
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     vif.destroy()
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     self.force_reraise()
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     six.reraise(self.type_, self.value, self.tb)
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     raise value
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/nova/network/neutronv2/api.py", line 1225, in _update_ports_for_instance
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     port_client, instance, port_id, port_req_body)
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/nova/network/neutronv2/api.py", line 580, in _update_port
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     _ensure_no_port_binding_failure(port)
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]   File "/usr/lib/python3.6/site-packages/nova/network/neutronv2/api.py", line 250, in _ensure_no_port_binding_failure
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea]     raise exception.PortBindingFailed(port_id=port['id'])
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea] nova.exception.PortBindingFailed: Binding failed for port e67dcee7-6dd3-47e7-bcc0-82ac02056d23, please check neutron logs for more information.
2019-05-13 15:59:28.091 8 ERROR nova.compute.manager [instance: 8c548050-3f06-464f-aef6-8ac37395b6ea] 
```

Looking at the neutron logs for controller-0 (from '/controller-0/var/log/containers/neutron/l3-agent.log' at [2]), I see a couple of instances of the following:

```
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.linux.utils [-] Rootwrap error running command: ['kill', '-15', '181613']: multiprocessing.managers.RemoteError: 
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent [-] Error while deleting router da792a0c-b616-48b0-bd2c-46b133eeb244: multiprocessing.managers.RemoteError: 
---------------------------------------------------------------------------
Unserializable message: Traceback (most recent call last):
  File "/usr/lib64/python3.6/multiprocessing/managers.py", line 283, in serve_client
    send(msg)
  File "/usr/lib/python3.6/site-packages/oslo_rootwrap/jsonrpc.py", line 128, in send
    s = self.dumps(obj)
  File "/usr/lib/python3.6/site-packages/oslo_rootwrap/jsonrpc.py", line 170, in dumps
    return json.dumps(obj, cls=RpcJSONEncoder).encode('utf-8')
  File "/usr/lib64/python3.6/json/__init__.py", line 238, in dumps
    **kw).encode(obj)
  File "/usr/lib64/python3.6/json/encoder.py", line 199, in encode
    chunks = self.iterencode(o, _one_shot=True)
  File "/usr/lib64/python3.6/json/encoder.py", line 257, in iterencode
    return _iterencode(o, 0)
  File "/usr/lib/python3.6/site-packages/oslo_rootwrap/jsonrpc.py", line 43, in default
    return super(RpcJSONEncoder, self).default(o)
  File "/usr/lib64/python3.6/json/encoder.py", line 180, in default
    o.__class__.__name__)
TypeError: Object of type 'ValueError' is not JSON serializable

---------------------------------------------------------------------------
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent Traceback (most recent call last):
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib/python3.6/site-packages/neutron/agent/l3/agent.py", line 461, in _safe_router_removed
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     self._router_removed(ri, router_id)
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib/python3.6/site-packages/neutron/agent/l3/agent.py", line 483, in _router_removed
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     ri.delete()
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib/python3.6/site-packages/neutron/agent/l3/ha_router.py", line 460, in delete
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     self.destroy_state_change_monitor(self.process_monitor)
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib/python3.6/site-packages/neutron/agent/l3/ha_router.py", line 399, in destroy_state_change_monitor
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     pm.disable(sig=str(int(signal.SIGTERM)))
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib/python3.6/site-packages/neutron/agent/linux/external_process.py", line 109, in disable
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     utils.execute(cmd, run_as_root=self.run_as_root)
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib/python3.6/site-packages/neutron/agent/linux/utils.py", line 122, in execute
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     execute_rootwrap_daemon(cmd, process_input, addl_env))
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib/python3.6/site-packages/neutron/agent/linux/utils.py", line 109, in execute_rootwrap_daemon
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     LOG.error("Rootwrap error running command: %s", cmd)
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     self.force_reraise()
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib/python3.6/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     six.reraise(self.type_, self.value, self.tb)
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib/python3.6/site-packages/six.py", line 693, in reraise
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     raise value
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib/python3.6/site-packages/neutron/agent/linux/utils.py", line 106, in execute_rootwrap_daemon
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     return client.execute(cmd, process_input)
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib/python3.6/site-packages/oslo_rootwrap/client.py", line 154, in execute
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     res = self._run_one_command(proxy, cmd, stdin)
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib/python3.6/site-packages/oslo_rootwrap/client.py", line 139, in _run_one_command
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     res = proxy.run_one_command(cmd, stdin)
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "<string>", line 2, in run_one_command
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib64/python3.6/multiprocessing/managers.py", line 772, in _callmethod
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     raise convert_to_error(kind, result)
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent multiprocessing.managers.RemoteError: 
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent ---------------------------------------------------------------------------
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent Unserializable message: Traceback (most recent call last):
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib64/python3.6/multiprocessing/managers.py", line 283, in serve_client
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     send(msg)
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib/python3.6/site-packages/oslo_rootwrap/jsonrpc.py", line 128, in send
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     s = self.dumps(obj)
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib/python3.6/site-packages/oslo_rootwrap/jsonrpc.py", line 170, in dumps
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     return json.dumps(obj, cls=RpcJSONEncoder).encode('utf-8')
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib64/python3.6/json/__init__.py", line 238, in dumps
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     **kw).encode(obj)
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib64/python3.6/json/encoder.py", line 199, in encode
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     chunks = self.iterencode(o, _one_shot=True)
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib64/python3.6/json/encoder.py", line 257, in iterencode
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     return _iterencode(o, 0)
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib/python3.6/site-packages/oslo_rootwrap/jsonrpc.py", line 43, in default
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     return super(RpcJSONEncoder, self).default(o)
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent   File "/usr/lib64/python3.6/json/encoder.py", line 180, in default
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent     o.__class__.__name__)
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent TypeError: Object of type 'ValueError' is not JSON serializable
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent 
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent ---------------------------------------------------------------------------
2019-05-13 15:53:56.356 115786 ERROR neutron.agent.l3.agent 
2019-05-13 15:53:56.360 115786 INFO neutron.agent.l3.agent [-] Finished a router update for da792a0c-b616-48b0-bd2c-46b133eeb244
```

This doesn't seem to the root cause of the issue but there's clearly _something_ janky here from a neutron perspective.

[1] https://rhos-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/phase2-15_director-rhel-8.0-virthost-3cont_2comp-ipv4-gre-lvm/8/artifact/compute-0.tar.gz
[2] https://rhos-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/phase2-15_director-rhel-8.0-virthost-3cont_2comp-ipv4-gre-lvm/8/artifact/controller-0.tar.gz

Comment 2 Stephen Finucane 2019-05-16 15:57:24 UTC

*** Bug 1710452 has been marked as a duplicate of this bug. ***

Comment 3 Bernard Cafarelli 2019-05-20 15:05:47 UTC


*** This bug has been marked as a duplicate of bug 1710955 ***

Note You need to log in before you can comment on or make changes to this bug.