Bug 1511041
| Summary: | Failed to consume message from queue: 'NoneType' object has no attribute 'itervalues' | ||||||
|---|---|---|---|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | Sai Sindhur Malleni <smalleni> | ||||
| Component: | python-amqp | Assignee: | John Eckersberg <jeckersb> | ||||
| Status: | CLOSED ERRATA | QA Contact: | Udi Shkalim <ushkalim> | ||||
| Severity: | urgent | Docs Contact: | |||||
| Priority: | urgent | ||||||
| Version: | 12.0 (Pike) | CC: | apevec, ekuris, fpercoco, jeckersb, jjoyce, lhh, mkrcmari, oblaut, srevivo, vstinner | ||||
| Target Milestone: | beta | Keywords: | Triaged | ||||
| Target Release: | 12.0 (Pike) | ||||||
| Hardware: | Unspecified | ||||||
| OS: | Unspecified | ||||||
| Whiteboard: | |||||||
| Fixed In Version: | python-amqp-2.1.4-2.el7ost | Doc Type: | If docs needed, set a value | ||||
| Doc Text: | Story Points: | --- | |||||
| Clone Of: | Environment: | ||||||
| Last Closed: | 2017-12-13 22:20:31 UTC | Type: | Bug | ||||
| Regression: | --- | Mount Type: | --- | ||||
| Documentation: | --- | CRM: | |||||
| Verified Versions: | Category: | --- | |||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||
| Embargoed: | |||||||
| Attachments: |
|
||||||
|
Description
Sai Sindhur Malleni
2017-11-08 15:23:43 UTC
Created attachment 1349496 [details] Copy of https://gist.github.com/anonymous/eda3c3589806eddcbff108e76feea29a This looks similar/same as https://bugs.launchpad.net/oslo.messaging/+bug/1504725, adding tracker. Possibly this issue? https://github.com/celery/py-amqp/pull/121 It looks like this bug which was fixed in python-amqp 2.2.0: https://github.com/celery/py-amqp/pull/128 I could reproduce the bug several times on OSP12 containerized deployment, specifically I see the traceback on nova compute log and then I am not able to run an instance on such compute node unless I restart nova compute service/container so in my case it has fatal consequences. I am triggering the problem by running recovery tests which ungracefully reset controller nodes, especially rabbitmq servers which is relevant to the bug I assume. I could reproduce the same issue on OSP-12 with OVN. During HA recovery test, after the system was fully recovered I failed to boot new VM. I left the system for few minutes and after that, I could launch new VM. (In reply to Eran Kuris from comment #6) > I could reproduce the same issue on OSP-12 with OVN. > During HA recovery test, after the system was fully recovered I failed to > boot new VM. > I left the system for few minutes and after that, I could launch new VM. PS I saw this error also on nova-scheduler.log & Neutron server-log. (In reply to Victor Stinner from comment #4) > It looks like this bug which was fixed in python-amqp 2.2.0: > https://github.com/celery/py-amqp/pull/128 +1, this is exactly the problem. Verified on: python-amqp-2.1.4-2.el7ost.noarch Ran HA recovery tests and was able to boot an instance with no reoccurring messages in the logs mentioned Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2017:3462 |