Description of problem: Multiple VM creation in a single go fails with error mentioned in summary The failure is not constant its always random Version-Release number of selected component (if applicable): RHOSP16.2.2 CISCO APIC SDN How reproducible: ALways Steps to Reproduce: 1. Create VM via templates 2. atleast 2 VM creation fails always 3. Actual results: VM creation fails Expected results: VM creation should be completed successfully
To summarise my understanding here. From Cisco's perspective, it seems their investigation shows that the port was configured, added to the DB and then we reached this point at which a message should have been published on the Message bus (RabbitMQ): https://github.com/openstack/neutron/blob/stable/train/neutron/db/provisioning_blocks.py#L140-L145 Which is done by neutron-lib: https://github.com/openstack/neutron-lib/blob/stable/train/neutron_lib/callbacks/registry.py#L59-L60 So assuming that all worked up until that point, then there could have been some issue with RabbitMQ during that time that prevented the message being published or received by Nova. Can you verify if there are any RabbitMQ issues seen during the time of the error? Last time this issue come up, I called out errors that were seen with RMQ as well. So it could be the case here too: https://bugzilla.redhat.com/show_bug.cgi?id=2082009#c4 Adding in PIDONE as FYI if we need to go down the RMQ route.