Bug 1615892

Created attachment 1475842 [details]
/var/log/extra/docker/containers/neutron_ovs_agent/stdout.log

Description of problem:
Log /var/log/extra/docker/containers/neutron_ovs_agent/stdout.log on undercloud reports issue:

Traceback (most recent call last):
  File "/usr/lib64/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib64/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/usr/lib/python2.7/site-packages/neutron/cmd/destroy_patch_ports.py", line 83, in <module>
    main()
  File "/usr/lib/python2.7/site-packages/neutron/cmd/destroy_patch_ports.py", line 78, in main
    port_cleaner = PatchPortCleaner(cfg.CONF)
  File "/usr/lib/python2.7/site-packages/neutron/cmd/destroy_patch_ports.py", line 44, in __init__
    for bridge in mappings.values()]
  File "/usr/lib/python2.7/site-packages/neutron/agent/common/ovs_lib.py", line 218, in __init__
    super(OVSBridge, self).__init__()
  File "/usr/lib/python2.7/site-packages/neutron/agent/common/ovs_lib.py", line 117, in __init__
    self.ovsdb = ovsdb_api.from_config(self)
  File "/usr/lib/python2.7/site-packages/neutron/agent/ovsdb/api.py", line 30, in from_config
    ovsdb_api.interface_map[iface_name or cfg.CONF.OVS.ovsdb_interface])
  File "/usr/lib/python2.7/site-packages/oslo_utils/importutils.py", line 73, in import_module
    __import__(import_str)
  File "/usr/lib/python2.7/site-packages/neutron/agent/ovsdb/impl_idl.py", line 17, in <module>
    from ovsdbapp.backend.ovs_idl import command
  File "/usr/lib/python2.7/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 16, in <module>
    from ovsdbapp.backend.ovs_idl import command as cmd
  File "/usr/lib/python2.7/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 21, in <module>
    from ovsdbapp.backend.ovs_idl import idlutils
  File "/usr/lib/python2.7/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 21, in <module>
    from ovs.db import idl
  File "/usr/lib64/python2.7/site-packages/ovs/db/idl.py", line 25, in <module>
    from ovs.db import custom_index
  File "/usr/lib64/python2.7/site-packages/ovs/db/custom_index.py", line 12, in <module>
    from ovs.compat import sortedcontainers
ImportError: No module named compat

Version-Release number of selected component (if applicable):
OSP14, puddle 2018-08-13.2, topology 1:1:1:1 deployed by InfraRed

Additional info:
UC:
openvswitch-selinux-extra-policy-1.0-5.el7fdp.noarch
openvswitch2.10-2.10.0-0.20180808gitfaf64fb.el7fdp.x86_64
rhosp-openvswitch-2.10-0.1.el7ost.noarch

$ docker ps | grep neutron
0d53240ec8ed        docker-registry.engineering.redhat.com/rhosp14/openstack-ironic-neutron-agent:2018-08-13.1        "kolla_start"            32 minutes ago      Up 32 minutes                                      ironic_neutron_agent
cc6a644cfb77        docker-registry.engineering.redhat.com/rhosp14/openstack-neutron-openvswitch-agent:2018-08-13.1   "kolla_start"            32 minutes ago      Restarting (1) 4 minutes ago                       neutron_ovs_agent
35af59eedf4a        docker-registry.engineering.redhat.com/rhosp14/openstack-neutron-l3-agent:2018-08-13.1            "kolla_start"            32 minutes ago      Up 32 minutes (healthy)                            neutron_l3_agent
d58ce944cecf        docker-registry.engineering.redhat.com/rhosp14/openstack-neutron-dhcp-agent:2018-08-13.1          "kolla_start"            32 minutes ago      Up 32 minutes (healthy)                            neutron_dhcp
cd7e3c1630d4        docker-registry.engineering.redhat.com/rhosp14/openstack-neutron-server:2018-08-13.1              "kolla_start"            32 minutes ago      Up 32 minutes (healthy)                            neutron_api


It sounds to me like this could be related to similar issue in packstack deployments https://bugzilla.redhat.com/show_bug.cgi?id=1614817 . We are possibly missing newest version of python-openvswitch2 package (python-openvswitch2.10-2.10.0-0.20180810git58a7ce6.el7fdp) or related inside openstack-neutron-openvswitch-agent container.