Attachment 899956 Details for Bug 1102040 – gdb python backtrace from stuck neutron-server

gdb python backtrace from stuck neutron-server

file_1102040.txt (text/plain), 11.56 KB, created by Lukas Bezdicka on 2014-05-28 11:31:21 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Lukas Bezdicka

Created: 2014-05-28 11:31:21 UTC

Size: 11.56 KB

patch

obsolete

>(gdb) py-bt
>#2 <built-in method poll of select.poll object at remote 0x2fb2300>
>#4 Frame 0x2c59dd0, for file /usr/lib/python2.7/site-packages/qpid/compat.py, line 80, in select (rlist=set([<...>]), wlist=set([]), xlist=(), timeout=None, fd_count=1, rset=set([<...>]), wset=set([]), xset=set([]), poller=<select.poll at remote 0x2fb2300>, rwset=set([]), ro=<...>, fd_map={6: <...>}, o=<...>)
>    active = poller.poll(timeout)
>#8 Frame 0x2c59ba0, for file /usr/lib/python2.7/site-packages/qpid/selector.py, line 124, in run (self=<Selector(thread=<Thread(_Thread__ident=48760944, _Thread__block=<_Condition(_Verbose__verbose=False, _Condition__lock=<Semaphore(counter=1, _waiters=set([])) at remote 0x30b3350>, acquire=<instancemethod at remote 0x2acdd20>, _Condition__waiters=[], release=<instancemethod at remote 0x2d238c0>) at remote 0x30b3390>, _Thread__name='Thread-1', _Thread__daemonic=True, _Thread__started=<_Event(_Verbose__verbose=False, _Event__flag=True, _Event__cond=<_Condition(_Verbose__verbose=False, _Condition__lock=<Semaphore(counter=1, _waiters=set([])) at remote 0x30b3290>, acquire=<instancemethod at remote 0x2d236e0>, _Condition__waiters=[], release=<instancemethod at remote 0x2acde10>) at remote 0x30b32d0>) at remote 0x30b3250>, _Thread__stderr=<file at remote 0x7f4b5237e1e0>, _Thread__target=<instancemethod at remote 0x2cff730>, _Thread__kwargs={}, _Verbose__verbose=False, _Thread__args=(), _Thread__stopped=False, _Thread...(truncated)
>    rd, wr, ex = select(self.reading, self.writing, (), timeout)
>#13 Frame 0x2c599d0, for file /usr/lib64/python2.7/threading.py, line 764, in run (self=<Thread(_Thread__ident=48760944, _Thread__block=<_Condition(_Verbose__verbose=False, _Condition__lock=<Semaphore(counter=1, _waiters=set([])) at remote 0x30b3350>, acquire=<instancemethod at remote 0x2acdd20>, _Condition__waiters=[], release=<instancemethod at remote 0x2d238c0>) at remote 0x30b3390>, _Thread__name='Thread-1', _Thread__daemonic=True, _Thread__started=<_Event(_Verbose__verbose=False, _Event__flag=True, _Event__cond=<_Condition(_Verbose__verbose=False, _Condition__lock=<Semaphore(counter=1, _waiters=set([])) at remote 0x30b3290>, acquire=<instancemethod at remote 0x2d236e0>, _Condition__waiters=[], release=<instancemethod at remote 0x2acde10>) at remote 0x30b32d0>) at remote 0x30b3250>, _Thread__stderr=<file at remote 0x7f4b5237e1e0>, _Thread__target=<instancemethod at remote 0x2cff730>, _Thread__kwargs={}, _Verbose__verbose=False, _Thread__args=(), _Thread__stopped=False, _Thread__initialized=True) at remote 0x3...(truncated)
>    self.__target(*self.__args, **self.__kwargs)
>#16 Frame 0x2c595a0, for file /usr/lib64/python2.7/threading.py, line 811, in __bootstrap_inner (self=<Thread(_Thread__ident=48760944, _Thread__block=<_Condition(_Verbose__verbose=False, _Condition__lock=<Semaphore(counter=1, _waiters=set([])) at remote 0x30b3350>, acquire=<instancemethod at remote 0x2acdd20>, _Condition__waiters=[], release=<instancemethod at remote 0x2d238c0>) at remote 0x30b3390>, _Thread__name='Thread-1', _Thread__daemonic=True, _Thread__started=<_Event(_Verbose__verbose=False, _Event__flag=True, _Event__cond=<_Condition(_Verbose__verbose=False, _Condition__lock=<Semaphore(counter=1, _waiters=set([])) at remote 0x30b3290>, acquire=<instancemethod at remote 0x2d236e0>, _Condition__waiters=[], release=<instancemethod at remote 0x2acde10>) at remote 0x30b32d0>) at remote 0x30b3250>, _Thread__stderr=<file at remote 0x7f4b5237e1e0>, _Thread__target=<instancemethod at remote 0x2cff730>, _Thread__kwargs={}, _Verbose__verbose=False, _Thread__args=(), _Thread__stopped=False, _Thread__initialized=True)...(truncated)
>    self.run()
>#19 Frame 0x2c593d0, for file /usr/lib64/python2.7/threading.py, line 784, in __bootstrap (self=<Thread(_Thread__ident=48760944, _Thread__block=<_Condition(_Verbose__verbose=False, _Condition__lock=<Semaphore(counter=1, _waiters=set([])) at remote 0x30b3350>, acquire=<instancemethod at remote 0x2acdd20>, _Condition__waiters=[], release=<instancemethod at remote 0x2d238c0>) at remote 0x30b3390>, _Thread__name='Thread-1', _Thread__daemonic=True, _Thread__started=<_Event(_Verbose__verbose=False, _Event__flag=True, _Event__cond=<_Condition(_Verbose__verbose=False, _Condition__lock=<Semaphore(counter=1, _waiters=set([])) at remote 0x30b3290>, acquire=<instancemethod at remote 0x2d236e0>, _Condition__waiters=[], release=<instancemethod at remote 0x2acde10>) at remote 0x30b32d0>) at remote 0x30b3250>, _Thread__stderr=<file at remote 0x7f4b5237e1e0>, _Thread__target=<instancemethod at remote 0x2cff730>, _Thread__kwargs={}, _Verbose__verbose=False, _Thread__args=(), _Thread__stopped=False, _Thread__initialized=True) at re...(truncated)
>    self.__bootstrap_inner()
>#24 Frame 0x30e40d0, for file /usr/lib/python2.7/site-packages/eventlet/green/thread.py, line 27, in __thread_body (func=<instancemethod at remote 0x2d23780>, args=(), kwargs={})
>    func(*args, **kwargs)
>#33 Frame 0x2c40a70, for file /usr/lib/python2.7/site-packages/eventlet/hubs/timer.py, line 56, in __call__ (self=<Timer(seconds=0, tpl=(<built-in method switch of greenlet.greenlet object at remote 0x2e80870>, (<instancemethod at remote 0x2d23780>, (), {}), {}), called=True) at remote 0x30b33d0>, args=(...), cb=<built-in method switch of greenlet.greenlet object at remote 0x2e80870>, kw={...})
>    cb(*args, **kw)
>#43 Frame 0x2c40460, for file /usr/lib/python2.7/site-packages/eventlet/hubs/hub.py, line 346, in fire_timers (self=<Hub(next_timers=[(<float at remote 0x1c21580>, <Timer(seconds=0, tpl=(<instancemethod at remote 0x2d23960>, (), {}), called=False) at remote 0x30b3450>)], clock=<built-in function time>, debug_exceptions=True, debug_blocking_resolution=1, modify=<built-in method modify of select.epoll object at remote 0x7f4b52323678>, listeners={'read': {}, 'write': {}}, debug_blocking=False, running=True, timers_canceled=0, greenlet=<greenlet.greenlet at remote 0x2a25c30>, stopping=False, timers=[], poll=<select.epoll at remote 0x7f4b52323678>, secondaries={'read': {}, 'write': {}}, lclass=<type at remote 0x2c57b50>) at remote 0x2c10d10>, when=<float at remote 0x1c21598>, t=[...], heappop=<built-in function heappop>, next=(<float at remote 0x1c21490>, <Timer(seconds=0, tpl=(<built-in method switch of greenlet.greenlet object at remote 0x2e80870>, (<instancemethod at remote 0x2d23780>, (...), {}), {}), called=True)...(truncated)
>    timer()
>#46 Frame 0x2c40070, for file /usr/lib/python2.7/site-packages/eventlet/hubs/hub.py, line 226, in run (self=<Hub(next_timers=[(<float at remote 0x1c21580>, <Timer(seconds=0, tpl=(<instancemethod at remote 0x2d23960>, (), {}), called=False) at remote 0x30b3450>)], clock=<built-in function time>, debug_exceptions=True, debug_blocking_resolution=1, modify=<built-in method modify of select.epoll object at remote 0x7f4b52323678>, listeners={'read': {}, 'write': {}}, debug_blocking=False, running=True, timers_canceled=0, greenlet=<greenlet.greenlet at remote 0x2a25c30>, stopping=False, timers=[], poll=<select.epoll at remote 0x7f4b52323678>, secondaries={'read': {}, 'write': {}}, lclass=<type at remote 0x2c57b50>) at remote 0x2c10d10>, a=(...), kw={}, wakeup_when=<float at remote 0x1c21490>, sleep_time=<float at remote 0x1c21550>)
>    self.fire_timers(self.clock())
>#67 Frame 0x3075ee0, for file /usr/lib/python2.7/site-packages/neutron/openstack/common/rpc/amqp.py, line 546, in create_connection (conf=<ConfigOpts(_groups={'OVS': <OptGroup(title='OVS options', _opts={'integration_bridge': {'opt': <StrOpt(short=None, name='integration_bridge', dest='integration_bridge', required=False, choices=None, positional=False, default='br-int', secret=False, deprecated_opts=[<DeprecatedOpt(group=None, name=None) at remote 0x2ac3b10>], metavar=None, help=<Message(msgid='Integration bridge to use', domain='neutron', params=None) at remote 0x2ab2830>) at remote 0x2ac3ad0>, 'cli': False}, 'network_vlan_ranges': {'opt': <ListOpt(short=None, name='network_vlan_ranges', dest='network_vlan_ranges', required=False, deprecated_opts=[<DeprecatedOpt(group=None, name=None) at remote 0x2ac36d0>], positional=False, default=[], secret=False, metavar=None, help=<Message(msgid='List of <physical_network>:<vlan_min>:<vlan_max> or <physical_network>', domain='neutron', params=None) at remote 0x2ab2b30>) at...(truncated)
>    return ConnectionContext(conf, connection_pool, pooled=not new)
>#70 Frame 0x1800440, for file /usr/lib/python2.7/site-packages/neutron/openstack/common/rpc/impl_qpid.py, line 772, in create_connection (conf=<ConfigOpts(_groups={'OVS': <OptGroup(title='OVS options', _opts={'integration_bridge': {'opt': <StrOpt(short=None, name='integration_bridge', dest='integration_bridge', required=False, choices=None, positional=False, default='br-int', secret=False, deprecated_opts=[<DeprecatedOpt(group=None, name=None) at remote 0x2ac3b10>], metavar=None, help=<Message(msgid='Integration bridge to use', domain='neutron', params=None) at remote 0x2ab2830>) at remote 0x2ac3ad0>, 'cli': False}, 'network_vlan_ranges': {'opt': <ListOpt(short=None, name='network_vlan_ranges', dest='network_vlan_ranges', required=False, deprecated_opts=[<DeprecatedOpt(group=None, name=None) at remote 0x2ac36d0>], positional=False, default=[], secret=False, metavar=None, help=<Message(msgid='List of <physical_network>:<vlan_min>:<vlan_max> or <physical_network>', domain='neutron', params=None) at remote 0x2ab2b30...(truncated)
>    rpc_amqp.get_connection_pool(conf, Connection))
>#74 Frame 0x2ea8180, for file /usr/lib/python2.7/site-packages/neutron/openstack/common/rpc/__init__.py, line 89, in create_connection (new=True)
>    return _get_impl().create_connection(CONF, new=new)
>#78 Frame 0x2ea7f90, for file /usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/ovs_neutron_plugin.py, line 337, in setup_rpc (self=<OVSNeutronPluginV2(network_vlan_ranges={}, tunnel_type=None, base_binding_dict={'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'ovs_hybrid_plug': True}}, nova_notifier=<Notifier(pending_events=[], nclient=<Client(keypairs=<KeypairManager(api=<...>) at remote 0x2c18d90>, projectid=None, servers=<ServerManager(api=<...>) at remote 0x2c18a50>, volume_types=<VolumeTypeManager(api=<...>) at remote 0x2c18d50>, hypervisors=<HypervisorManager(api=<...>) at remote 0x2c21050>, agents=<AgentsManager(api=<...>) at remote 0x2c18a90>, images=<ImageManager(api=<...>) at remote 0x2c189d0>, fixed_ips=<FixedIPsManager(api=<...>) at remote 0x2c210d0>, networks=<NetworkManager(api=<...>) at remote 0x2c18dd0>, security_groups=<SecurityGroupManager(api=<...>) at remote 0x2c18e90>, flavors=<FlavorManager(api=<...>) at remote 0x2c10d90>, floating_ips_bulk=<FloatingIPBulk...(truncated)
>    self.conn = rpc.create_connection(new=True)
>#81 Frame 0x2b68740, for file /usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/ovs_neutron_plugin.py, line 325, in __init__ (self=<OVSNeutronPluginV2(network_vlan_ranges={}, tunnel_type=None, base_binding_dict={'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'ovs_hybrid_plug': True}}, nova_notifier=<Notifier(pending_events=[], nclient=<Client(keypairs=<KeypairManager(api=<...>) at remote 0x2c18d90>, projectid=None, servers=<ServerManager(api=<...>) at remote 0x2c18a50>, volume_types=<VolumeTypeManager(api=<...>) at remote 0x2c18d50>, hypervisors=<HypervisorManager(api=<...>) at remote 0x2c21050>, agents=<AgentsManager(api=<...>) at remote 0x2c18a90>, images=<ImageManager(api=<...>) at remote 0x2c189d0>, fixed_ips=<FixedIPsManager(api=<...>) at remote 0x2c210d0>, networks=<NetworkManager(api=<...>) at remote 0x2c18dd0>, security_groups=<SecurityGroupManager(api=<...>) at remote 0x2c18e90>, flavors=<Flavo---Type <return> to continue, or q <return> to quit---

Actions: View

Attachments on bug 1102040: 899956 | 900106 | 900480