Attachment 943622 Details for Bug 1149043 – nova-compute.log for one affected instance

nova-compute.log for one affected instance

file_1149043.txt (text/plain), 12.04 KB, created by Dusty Mabe on 2014-10-03 03:02:03 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Dusty Mabe

Created: 2014-10-03 03:02:03 UTC

Size: 12.04 KB

patch

obsolete

>2014-10-02 16:22:25.522 2180 AUDIT nova.compute.manager [req-2cfed036-5d43-43ab-9fcf-6cee12b5eb06 None] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Starting instance...
>2014-10-02 16:22:25.606 2180 AUDIT nova.compute.claims [req-2cfed036-5d43-43ab-9fcf-6cee12b5eb06 None] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Attempting claim: memory 2048 MB, disk 20 GB
>2014-10-02 16:22:25.606 2180 AUDIT nova.compute.claims [req-2cfed036-5d43-43ab-9fcf-6cee12b5eb06 None] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Total memory: 5862 MB, used: 512.00 MB
>2014-10-02 16:22:25.607 2180 AUDIT nova.compute.claims [req-2cfed036-5d43-43ab-9fcf-6cee12b5eb06 None] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] memory limit: 8793.00 MB, free: 8281.00 MB
>2014-10-02 16:22:25.607 2180 AUDIT nova.compute.claims [req-2cfed036-5d43-43ab-9fcf-6cee12b5eb06 None] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Total disk: 95 GB, used: 0.00 GB
>2014-10-02 16:22:25.607 2180 AUDIT nova.compute.claims [req-2cfed036-5d43-43ab-9fcf-6cee12b5eb06 None] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] disk limit not specified, defaulting to unlimited
>2014-10-02 16:22:25.608 2180 AUDIT nova.compute.claims [req-2cfed036-5d43-43ab-9fcf-6cee12b5eb06 None] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Claim successful
>2014-10-02 16:22:26.736 2180 INFO nova.virt.libvirt.driver [req-2cfed036-5d43-43ab-9fcf-6cee12b5eb06 None] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Creating image
>2014-10-02 16:22:31.508 2180 ERROR nova.compute.manager [req-2cfed036-5d43-43ab-9fcf-6cee12b5eb06 None] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Instance failed to spawn
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Traceback (most recent call last):
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2163, in _build_resources
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     yield resources
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2042, in _build_and_run_instance
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     block_device_info=block_device_info)
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2546, in spawn
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     block_device_info)
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4078, in _create_domain_and_network
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     self.plug_vifs(instance, network_info)
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 907, in plug_vifs
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     self.vif_driver.plug(instance, vif)
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/vif.py", line 515, in plug
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     func(instance, vif)
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/vif.py", line 394, in plug_ovs
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     self.plug_ovs_hybrid(instance, vif)
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/vif.py", line 385, in plug_ovs_hybrid
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     linux_net._create_veth_pair(v1_name, v2_name)
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/network/linux_net.py", line 1320, in _create_veth_pair
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     'name', dev2_name, run_as_root=True)
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/utils.py", line 163, in execute
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     return processutils.execute(*cmd, **kwargs)
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/openstack/common/processutils.py", line 200, in execute
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     cmd=' '.join(cmd))
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] ProcessExecutionError: Unexpected error while running command.
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Command: sudo nova-rootwrap /etc/nova/rootwrap.conf ip link add qvb55064258-0a type veth peer name qvo55064258-0a
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Exit code: 255
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Stdout: ''
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Stderr: 'Error: argument "qvb55064258-0a" is wrong: Unknown device\n'
>2014-10-02 16:22:31.508 2180 TRACE nova.compute.manager [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] 
>2014-10-02 16:22:31.510 2180 AUDIT nova.compute.manager [req-2cfed036-5d43-43ab-9fcf-6cee12b5eb06 None] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Terminating instance
>2014-10-02 16:22:31.515 2180 WARNING nova.virt.libvirt.driver [-] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] During wait destroy, instance disappeared.
>2014-10-02 16:22:31.612 2180 ERROR nova.virt.libvirt.vif [req-2cfed036-5d43-43ab-9fcf-6cee12b5eb06 None] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Failed while unplugging vif
>2014-10-02 16:22:31.612 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Traceback (most recent call last):
>2014-10-02 16:22:31.612 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/vif.py", line 537, in unplug_ovs_hybrid
>2014-10-02 16:22:31.612 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     run_as_root=True)
>2014-10-02 16:22:31.612 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/utils.py", line 163, in execute
>2014-10-02 16:22:31.612 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     return processutils.execute(*cmd, **kwargs)
>2014-10-02 16:22:31.612 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/openstack/common/processutils.py", line 200, in execute
>2014-10-02 16:22:31.612 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     cmd=' '.join(cmd))
>2014-10-02 16:22:31.612 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] ProcessExecutionError: Unexpected error while running command.
>2014-10-02 16:22:31.612 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Command: sudo nova-rootwrap /etc/nova/rootwrap.conf brctl delif qbr55064258-0a qvb55064258-0a
>2014-10-02 16:22:31.612 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Exit code: 1
>2014-10-02 16:22:31.612 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Stdout: ''
>2014-10-02 16:22:31.612 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Stderr: 'interface qvb55064258-0a does not exist!\n'
>2014-10-02 16:22:31.612 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] 
>2014-10-02 16:22:31.730 2180 INFO nova.virt.libvirt.driver [req-2cfed036-5d43-43ab-9fcf-6cee12b5eb06 None] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Deleting instance files /var/lib/nova/instances/d9ad23e8-ebf6-4d21-9004-991f893fd500_del
>2014-10-02 16:22:31.730 2180 INFO nova.virt.libvirt.driver [req-2cfed036-5d43-43ab-9fcf-6cee12b5eb06 None] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Deletion of /var/lib/nova/instances/d9ad23e8-ebf6-4d21-9004-991f893fd500_del complete
>2014-10-02 16:40:58.830 2180 AUDIT nova.compute.manager [req-3d0dc117-32d4-4a6d-97c8-95bd1e8ce20c None] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Terminating instance
>2014-10-02 16:40:58.833 2180 WARNING nova.virt.libvirt.driver [-] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] During wait destroy, instance disappeared.
>2014-10-02 16:40:58.962 2180 ERROR nova.virt.libvirt.vif [req-3d0dc117-32d4-4a6d-97c8-95bd1e8ce20c None] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Failed while unplugging vif
>2014-10-02 16:40:58.962 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Traceback (most recent call last):
>2014-10-02 16:40:58.962 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/vif.py", line 537, in unplug_ovs_hybrid
>2014-10-02 16:40:58.962 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     run_as_root=True)
>2014-10-02 16:40:58.962 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/utils.py", line 163, in execute
>2014-10-02 16:40:58.962 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     return processutils.execute(*cmd, **kwargs)
>2014-10-02 16:40:58.962 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]   File "/usr/lib/python2.7/site-packages/nova/openstack/common/processutils.py", line 200, in execute
>2014-10-02 16:40:58.962 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500]     cmd=' '.join(cmd))
>2014-10-02 16:40:58.962 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] ProcessExecutionError: Unexpected error while running command.
>2014-10-02 16:40:58.962 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Command: sudo nova-rootwrap /etc/nova/rootwrap.conf brctl delif qbr55064258-0a qvb55064258-0a
>2014-10-02 16:40:58.962 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Exit code: 1
>2014-10-02 16:40:58.962 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Stdout: ''
>2014-10-02 16:40:58.962 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Stderr: 'interface qvb55064258-0a does not exist!\n'
>2014-10-02 16:40:58.962 2180 TRACE nova.virt.libvirt.vif [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] 
>2014-10-02 16:40:59.107 2180 INFO nova.virt.libvirt.driver [req-3d0dc117-32d4-4a6d-97c8-95bd1e8ce20c None] [instance: d9ad23e8-ebf6-4d21-9004-991f893fd500] Deletion of /var/lib/nova/instances/d9ad23e8-ebf6-4d21-9004-991f893fd500_del complete

Actions: View

Attachments on bug 1149043: 943621 | 943622