Bug 1564920 - When trying to power on more than 3 VMs in parallel using vbmc, sometimes default network fails to be found
Summary: When trying to power on more than 3 VMs in parallel using vbmc, sometimes def...
Keywords:
Status: NEW
Alias: None
Product: Virtualization Tools
Classification: Community
Component: libvirt
Version: unspecified
Hardware: Unspecified
OS: Unspecified
low
low
Target Milestone: ---
Assignee: Libvirt Maintainers
QA Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2018-04-08 23:00 UTC by David Hill
Modified: 2018-07-18 15:54 UTC (History)
1 user (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:


Attachments (Terms of Use)

Description David Hill 2018-04-08 23:00:32 UTC
Description of problem:
When trying to power on more than 3 VMs in parallel using vbmc, sometimes default network fails to be found:

2018-04-08 18:53:23,472.472 10009 DEBUG VirtualBMC [-] Power on called for domain control-0-rhosp10
2018-04-08 18:53:23,473.473 10009 DEBUG VirtualBMC [-] 0
2018-04-08 18:53:24,814.814 10014 DEBUG VirtualBMC [-] Get power state called for domain control-1-rhosp10
2018-04-08 18:53:25,752.752 10009 ERROR VirtualBMC [-] Error powering on the domain control-0-rhosp10. Error: Network not found: no network with matching name 'default'
2018-04-08 18:53:25,795.795 9988 ERROR VirtualBMC [-] Error powering on the domain ceph-0-rhosp10. Error: Network not found: no network with matching name 'default'
2018-04-08 18:53:29,216.216 9994 DEBUG VirtualBMC [-] Get power state called for domain ceph-1-rhosp10
2018-04-08 18:53:30,218.218 10004 DEBUG VirtualBMC [-] Get power state called for domain compute-0-rhosp10
2018-04-08 18:53:30,476.476 9999 DEBUG VirtualBMC [-] Get power state called for domain ceph-2-rhosp10
2018-04-08 18:53:30,757.757 10009 DEBUG VirtualBMC [-] 1
2018-04-08 18:53:30,800.800 9988 DEBUG VirtualBMC [-] 1
2018-04-08 18:53:31,523.523 10022 DEBUG VirtualBMC [-] Get power state called for domain control-2-rhosp10
2018-04-08 18:53:31,991.991 10009 DEBUG VirtualBMC [-] Power on called for domain control-0-rhosp10
2018-04-08 18:53:31,992.992 10009 DEBUG VirtualBMC [-] 0
2018-04-08 18:53:31,998.998 10009 DEBUG VirtualBMC [-] 1
2018-04-08 18:53:32,002.002 10009 DEBUG VirtualBMC [-] 2
2018-04-08 18:53:32,384.384 9988 DEBUG VirtualBMC [-] Power on called for domain ceph-0-rhosp10
2018-04-08 18:53:32,384.384 9988 DEBUG VirtualBMC [-] 0
2018-04-08 18:53:32,388.388 9988 DEBUG VirtualBMC [-] 1
2018-04-08 18:53:32,392.392 9988 DEBUG VirtualBMC [-] 2

Adding a retry in virtualbmc solves the problem where ironic won't retry in older RHOSP release but this is not an acceptable fix imho.    I'm using latest rawhide package:

[root@zappa log]# rpm -qi libvirt
Name        : libvirt
Version     : 4.2.0
Release     : 1.fc29
Architecture: x86_64
Install Date: Sun 08 Apr 2018 02:27:58 PM EDT
Group       : Development/Libraries
Size        : 0
License     : LGPLv2+
Signature   : RSA/SHA256, Tue 03 Apr 2018 09:09:23 AM EDT, Key ID a20aa56b429476b4
Source RPM  : libvirt-4.2.0-1.fc29.src.rpm
Build Date  : Tue 03 Apr 2018 08:51:01 AM EDT
Build Host  : buildvm-30.phx2.fedoraproject.org
Relocations : (not relocatable)
Packager    : Fedora Project
Vendor      : Fedora Project
URL         : https://libvirt.org/
Bug URL     : https://bugz.fedoraproject.org/libvirt
Summary     : Library providing a simple virtualization API
Description :
Libvirt is a C toolkit to interact with the virtualization capabilities
of recent versions of Linux (and other OSes). The main package includes
the libvirtd server exporting the virtualization support.


Version-Release number of selected component (if applicable):


How reproducible:
Always

Steps to Reproduce:
1. Try introspection with RHOSP 10 and vbmc
2.
3.

Actual results:
Always fails on one VM or moe

Expected results:
Always succeeds

Additional info:
Adding a retry in vbmc solves the problem ...


Note You need to log in before you can comment on or make changes to this bug.