Bug 1379757 - Non-root disks on Windows instances occasionally go offline
Summary: Non-root disks on Windows instances occasionally go offline
Keywords:
Status: CLOSED DUPLICATE of bug 1375032
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-cinder
Version: 6.0 (Juno)
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: async
: 6.0 (Juno)
Assignee: Eric Harney
QA Contact: nlevinki
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-09-27 15:13 UTC by Jeremy
Modified: 2019-12-16 06:55 UTC (History)
6 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2016-10-06 20:22:14 UTC
Target Upstream Version:


Attachments (Terms of Use)

Description Jeremy 2016-09-27 15:13:17 UTC
Description of problem: Windows instance with 3 volumes attach has a non-root disk go offline .


Version-Release number of selected component (if applicable):
openstack-cinder-2014.2.3-3.el7ost.noarch n

How reproducible:
unknown

Steps to Reproduce:
Steps taken to reproduce the problem
-Create Windows VM from glance image, using cinder drive for boot drive
-create 2 separate cinder volumes, attach to instance
-in instance console, from Windows Disk Management, scan disks, initialize, format disks D and E
-perform one soft reboot (no changes)
-perform one hard reboot (Hard Reboot Instance from OpenStack UI) at 2016-09-26 19:03:24.226+0000
-Instance comes up with D drive offline, C and E drives online


Actual results:
D drive offline

Expected results:
no drives offline

Additional info:
[root@phllcu501 ~(cloud_admin_v2)]# nova show 173efc20-1661-4cc3-9d18-ed7cd532827e
+--------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------+
| Property                             | Value                                                                                                                                            |
+--------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------+
| OS-DCF:diskConfig                    | AUTO                                                                                                                                             |
| OS-EXT-AZ:availability_zone          | labb                                                                                                                                             |
| OS-EXT-SRV-ATTR:host                 | phllsu320                                                                                                                                        |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | phllsu320.edisonqa.sgns.net                                                                                                                      |
| OS-EXT-SRV-ATTR:instance_name        | instance-00001fbd                                                                                                                                |
| OS-EXT-STS:power_state               | 1                                                                                                                                                |
| OS-EXT-STS:task_state                | -                                                                                                                                                |
| OS-EXT-STS:vm_state                  | active                                                                                                                                           |
| OS-SRV-USG:launched_at               | 2016-09-26T18:46:53.000000                                                                                                                       |
| OS-SRV-USG:terminated_at             | -                                                                                                                                                |
| accessIPv4                           |                                                                                                                                                  |
| accessIPv6                           |                                                                                                                                                  |
| config_drive                         |                                                                                                                                                  |
| created                              | 2016-09-26T18:46:24Z                                                                                                                             |
| flavor                               | 2c.8m (107)                                                                                                                                      |
| hostId                               | bb65b129c5d629770a4f7f92c47f993fbedcf87ec2467194bc245303                                                                                         |
| id                                   | 173efc20-1661-4cc3-9d18-ed7cd532827e                                                                                                             |
| image                                | Attempt to boot from volume - no image supplied                                                                                                  |
| key_name                             | -                                                                                                                                                |
| l2p_group1 network                   | 10.0.0.13                                                                                                                                        |
| metadata                             | {}                                                                                                                                               |
| name                                 | case-01709101-vm                                                                                                                                 |
| os-extended-volumes:volumes_attached | [{"id": "34cfa025-313e-44a3-9c61-550dc8e9d1a8"}, {"id": "2817aadd-419e-4838-a38a-608b9e163970"}, {"id": "5af9f2f3-2d9f-4d07-8f9b-4e4d2b38a65f"}] |
| progress                             | 0                                                                                                                                                |
| security_groups                      | default                                                                                                                                          |
| status                               | ACTIVE                                                                                                                                           |
| tenant_id                            | ff3e3074fe6a495fa49cf0885cc58996                                                                                                                 |
| updated                              | 2016-09-26T19:03:24Z                                                                                                                             |
| user_id                              | cd573022e54743f4a39b1b3fc81f37fc                                                                                                                 |
+--------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------+


Problem occurred after the following hard reboot (compute node phllsu320):

2016-09-26 19:03:24.226+0000: starting up libvirt version: 1.2.17, package: 13.el7_2.2 (Red Hat, Inc. <http://bugzilla.redhat.com/bugzilla>, 2015-11-23-07:46:04, x86-019.build.eng.bos.redhat.com), qemu version: 2.3.0 (qemu-kvm-rhev-2.3.0-31.el7_2.7)
LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin QEMU_AUDIO_DRV=none /usr/libexec/qemu-kvm -name instance-00001fbd -S -machine pc-i440fx-rhel7.2.0,accel=kvm,usb=off -cpu SandyBridge,+pdpe1gb,+osxsave,+dca,+pcid,+pdcm,+xtpr,+tm2,+est,+smx,+vmx,+ds_cpl,+monitor,+dtes64,+pbe,+tm,+ht,+ss,+acpi,+ds,+vme -m 8192 -realtime mlock=off -smp 2,sockets=2,cores=1,threads=1 -uuid 173efc20-1661-4cc3-9d18-ed7cd532827e -smbios type=1,manufacturer=Red Hat,product=OpenStack Compute,version=2014.2.3-70.el7ost,serial=735a17bf-8c68-4695-950d-69313e22e133,uuid=173efc20-1661-4cc3-9d18-ed7cd532827e -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/domain-instance-00001fbd/monitor.sock,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=utc,driftfix=slew -global kvm-pit.lost_tick_policy=discard -no-hpet -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive file=/var/lib/nova/mnt/cc9d9c7bda53f3826d1646f60fc0be2f/volume-34cfa025-313e-44a3-9c61-550dc8e9d1a8,if=none,id=drive-virtio-disk0,format=raw,serial=34cfa025-313e-44a3-9c61-550dc8e9d1a8,cache=none -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x4,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -drive file=/var/lib/nova/mnt/fa380ce750fe302af25af001b857615c/volume-2817aadd-419e-4838-a38a-608b9e163970,if=none,id=drive-virtio-disk1,format=raw,serial=2817aadd-419e-4838-a38a-608b9e163970,cache=none -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x5,drive=drive-virtio-disk1,id=virtio-disk1 -drive file=/var/lib/nova/mnt/fa380ce750fe302af25af001b857615c/volume-5af9f2f3-2d9f-4d07-8f9b-4e4d2b38a65f,if=none,id=drive-virtio-disk2,format=raw,serial=5af9f2f3-2d9f-4d07-8f9b-4e4d2b38a65f,cache=none -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk2,id=virtio-disk2 -netdev tap,fd=26,id=hostnet0,vhost=on,vhostfd=54 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=fa:16:3e:f0:e0:b0,bus=pci.0,addr=0x3 -chardev file,id=charserial0,path=/var/lib/nova/instances/173efc20-1661-4cc3-9d18-ed7cd532827e/console.log -device isa-serial,chardev=charserial0,id=serial0 -chardev pty,id=charserial1 -device isa-serial,chardev=charserial1,id=serial1 -device usb-tablet,id=input0 -vnc 0.0.0.0:26 -k en-us -device cirrus-vga,id=video0,bus=pci.0,addr=0x2 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x7 -msg timestamp=on
Domain id=1494 is tainted: high-privileges
char device redirected to /dev/pts/27 (label charserial1)

Comment 5 Jeremy 2016-10-06 19:33:29 UTC
###before reboot
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='none'/>
      <source file='/var/lib/nova/mnt/cc9d9c7bda53f3826d1646f60fc0be2f/volume-bd728351-4c91-4f98-a3a7-db4625b819b5'>
        <seclabel model='selinux' labelskip='yes'/>
      </source>
      <backingStore/>
      <target dev='vda' bus='virtio'/>
      <serial>bd728351-4c91-4f98-a3a7-db4625b819b5</serial>
      <alias name='virtio-disk0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
    </disk>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='none'/>
      <source file='/var/lib/nova/mnt/fa380ce750fe302af25af001b857615c/volume-d89f48f3-d45c-469d-a489-e1dd8b5c1731'>
        <seclabel model='selinux' labelskip='yes'/>
      </source>
      <backingStore/>
      <target dev='vdb' bus='virtio'/>
      <serial>d89f48f3-d45c-469d-a489-e1dd8b5c1731</serial>
      <alias name='virtio-disk1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
    </disk>



###after hard reboot
 <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='none'/>
      <source file='/var/lib/nova/mnt/cc9d9c7bda53f3826d1646f60fc0be2f/volume-bd728351-4c91-4f98-a3a7-db4625b819b5'>
        <seclabel model='selinux' labelskip='yes'/>
      </source>
      <backingStore/>
      <target dev='vda' bus='virtio'/>
      <serial>bd728351-4c91-4f98-a3a7-db4625b819b5</serial>
      <alias name='virtio-disk0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
    </disk>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='none'/>
      <source file='/var/lib/nova/mnt/fa380ce750fe302af25af001b857615c/volume-d89f48f3-d45c-469d-a489-e1dd8b5c1731'>
        <seclabel model='selinux' labelskip='yes'/>
      </source>
      <backingStore/>
      <target dev='vdb' bus='virtio'/>
      <serial>d89f48f3-d45c-469d-a489-e1dd8b5c1731</serial>
      <alias name='virtio-disk1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
    </disk>


### looks the same , the pcs slot changed.

Comment 6 Jeremy 2016-10-06 20:17:05 UTC
The customer confirms the san policy change fix works. But it looks like there are no plans to fix this in nova?

Comment 7 Jeremy 2016-10-06 20:22:14 UTC

*** This bug has been marked as a duplicate of bug 1375032 ***


Note You need to log in before you can comment on or make changes to this bug.