Attachment 704148 Details for Bug 891347 – debugging info

debugging info

debugging-notes-891347.txt (text/plain), 5.46 KB, created by Kashyap Chamarthy on 2013-03-01 11:52:12 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Kashyap Chamarthy

Created: 2013-03-01 11:52:12 UTC

Size: 5.46 KB

patch

obsolete

>-> enable both debug & verbose flags (don't forget to unset them back, once debugging is finished)
>#-----------------------#
>[tuser1@interceptor ~(keystone_user1)]$ sudo egrep -i 'verbose|debug' /etc/nova/nova.conf | grep -v ^$ | grep -v ^# 
>debug=true
>verbose=true
>[tuser1@interceptor ~(keystone_user1)]$
>#-----------------------#
>
>
>-> restart all openstack services
>#-----------------------#
>[root@interceptor ~(keystone_admin)]# for j in `for i in $(ls -1 /etc/init.d/openstack-*) ; do $i status | grep running ; done | awk '{print $1}'` ; do service $j restart ; done
>#-----------------------#
>
>
>-> boot another instance; list it
>#-----------------------#
>[tuser1@interceptor ~(keystone_user1)]$ nova boot --flavor 1 --key_name oskey --image 1e6292f9-82bd-4cdb-969e-c863cb1c6692 fed-t3
>
>[tuser1@interceptor ~(keystone_user1)]$ nova list
>+--------------------------------------+-----------+---------+-------------------+
>| ID                                   | Name      | Status  | Networks          |
>+--------------------------------------+-----------+---------+-------------------+
>| 54ed73b5-4628-4dae-87bf-5f59a39f094b | fed-t1    | ACTIVE  | net1=10.65.207.51 |
>| 296dd376-0422-4ce4-81e3-ea8cc38fe015 | fed-t2    | ACTIVE  | net1=10.65.207.50 |
>| 2c6f9b26-9191-4152-82c7-41e5588515f2 | fed-t3    | ACTIVE  | net1=10.65.207.52 |
>| bb494526-e993-4adc-a453-902a5a9f530d | fedora-t8 | SHUTOFF | net1=10.65.207.53 |
>+--------------------------------------+-----------+---------+-------------------+
>[tuser1@interceptor ~(keystone_user1)]$ 
>#-----------------------#
>
>
>-> list using virsh ; get the block device in use ; get info of both the disks (overlay & its backing file) in use to check whether the qcow2 overlay is fully allocated -- seems like not (comparing from its 'virtual size' & 'disk size' - obtained from "qemu-img info" )
>#-----------------------#
>[tuser1@interceptor ~(keystone_user1)]$ sudo virsh list
> Id    Name                           State
>----------------------------------------------------
> 29    instance-00000019              running
> 30    instance-0000001a              running
> 31    instance-0000001b              running
>#-----------------------#
>[tuser1@interceptor ~(keystone_user1)]$ sudo virsh domblklist instance-0000001b
>Target     Source
>------------------------------------------------
>vda        /var/lib/nova/instances/instance-0000001b/disk
>#-----------------------#
>[tuser1@interceptor ~(keystone_user1)]$ sudo qemu-img info /var/lib/nova/instances/instance-0000001b/disk
>image: /var/lib/nova/instances/instance-0000001b/disk
>file format: qcow2
>virtual size: 9.8G (10486808576 bytes)
>disk size: 8.9M
>cluster_size: 65536
>backing file: /var/lib/nova/instances/_base/06a057b9c7b0b27e3b496f53d1e88810a0d1d5d3
>#-----------------------#
>[tuser1@interceptor ~(keystone_user1)]$ sudo qemu-img info /var/lib/nova/instances/_base/06a057b9c7b0b27e3b496f53d1e88810a0d1d5d3
>image: /var/lib/nova/instances/_base/06a057b9c7b0b27e3b496f53d1e88810a0d1d5d3
>file format: raw
>virtual size: 9.8G (10486808576 bytes)
>disk size: 738M
>[tuser1@interceptor ~(keystone_user1)]$ 
>#-----------------------#
>
>
>-> let's grep for the string preallocate in logs. We do get, it's not much meaningful:
>#-----------------------#
>[root@interceptor ~(keystone_admin)]# grep -i preallocate /var/log/nova/*.log
>/var/log/nova/compute.log:2013-03-01 13:53:02 31608 DEBUG nova.service [-] preallocate_images : space wait /usr/lib/python2.6/site-packages/nova/service.py:188
>/var/log/nova/compute.log:2013-03-01 14:39:56 45175 DEBUG nova.service [-] preallocate_images : space wait /usr/lib/python2.6/site-packages/nova/service.py:188
>/var/log/nova/compute.log:2013-03-01 16:42:16 14643 DEBUG nova.service [-] preallocate_images : space wait /usr/lib/python2.6/site-packages/nova/service.py:188
>/var/log/nova/scheduler.log:2013-03-01 13:53:07 31775 DEBUG nova.service [-] preallocate_images : space wait /usr/lib/python2.6/site-packages/nova/service.py:188
>/var/log/nova/scheduler.log:2013-03-01 14:40:01 45343 DEBUG nova.service [-] preallocate_images : space wait /usr/lib/python2.6/site-packages/nova/service.py:188
>/var/log/nova/scheduler.log:2013-03-01 16:42:21 14812 DEBUG nova.service [-] preallocate_images : space wait /usr/lib/python2.6/site-packages/nova/service.py:188
>[root@interceptor ~(keystone_admin)]# 
>#-----------------------#
>
>
>-> let's get some 'context' before the preallocate string in the logs (from "compute.log"), but it isn't much informative:
>#-----------------------#
>013-03-01 13:53:02 31608 DEBUG nova.service [-] quota_injected_file_content_bytes : 10240 wait /usr/lib/python2.6/site-packages/nova/service.py:188
>2013-03-01 13:53:02 31608 DEBUG nova.service [-] running_deleted_instance_action : log wait /usr/lib/python2.6/site-packages/nova/service.py:188
>2013-03-01 13:53:02 31608 DEBUG nova.service [-] console_host : interceptor.lab.eng.pnq.redhat.com wait /usr/lib/python2.6/site-packages/nova/service.py:188
>2013-03-01 13:53:02 31608 DEBUG nova.service [-] preallocate_images : space wait /usr/lib/python2.6/site-packages/nova/service.py:188
>2013-03-01 13:53:02 31608 DEBUG nova.service [-] libvirt_inject_key : FLAG SET  wait /usr/lib/python2.6/site-packages/nova/service.py:186
>2013-03-01 13:53:02 31608 DEBUG nova.service [-] libvirt_ovs_bridge : br-int wait /usr/lib/python2.6/site-packages/nova/service.py:188
>#-----------------------#
>
>
>To summarize, it appears that 'the config entry of 'preallocate_imags' is not being ignored', but for some reason the qcow2 overlay is not preallocated ? 
>
>Agreed ? Am I missing anything else here ?

Actions: View

Attachments on bug 891347: 704148