Bug 1653219

Summary: [virtio-win][netkvm]Job "DF - PNP Surprise Remove Device Test (Reliability)" failed with error "Failed to receive IRP_MN_REMOVE_DEVICE after receiving IRP_MN_SURPRISE_REMOVAL" --Win2019
Product: Red Hat Enterprise Linux 8 Reporter: Peixiu Hou <phou>
Component: virtio-winAssignee: Yvugenfi <yvugenfi>
virtio-win sub component: virtio-win-prewhql QA Contact: lijin <lijin>
Status: CLOSED CURRENTRELEASE Docs Contact:
Severity: high    
Priority: unspecified CC: ailan, lijin, yvugenfi
Version: 8.0Keywords: TestBlocker, TestOnly
Target Milestone: rc   
Target Release: 8.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-06-14 00:47:22 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1659244    

Description Peixiu Hou 2018-11-26 09:49:32 UTC
Description of problem:

Run job "DF - PNP Surprise Remove Device Test (Reliability)" failed on win2019 guest.

Failed message as: 

1. Error 11/22/2018 10:17:46.277 AM WDTF_PNP : Result: Failed to receive IRP_MN_REMOVE_DEVICE after receiving IRP_MN_SURPRISE_REMOVAL. Ensure that there are no open handles or references to the test device (in user mode or in kernel mode) preventing IRP_MN_REMOVE_DEVICE from being sent. You may need to terminate any processes or services that may have open user mode handles to this device. ( 80004005 ). 

2. Error 11/22/2018 10:20:56.450 AM WDTF_PNP : Result: Successful , but device not started, ( Status=1806102 (DN_DRIVER_LOADED DN_NEED_RESTART DN_DISABLEABLE DN_REMOVABLE DN_NT_ENUMERATOR DN_NT_DRIVER ) Problem=0 () ).. 

3. Error 11/22/2018 10:23:12.622 AM WDTF_TARGET               :          WDTF.ConcurrentIO.1 SetTarget() ERROR : CWDTFConcurrentIOImpl::SetTarget() Failed to open the EDT device Win32=1 - Incorrect function.
 Win32=1 - Incorrect function.

4. Error 11/22/2018 10:23:12.623 AM WDTF_TARGET               : WDTF.ConcurrentIO.1 SetTarget() ERROR : CWDTFConcurrentIOImpl::SetTarget() Failed to open the EDT device Win32=1 - Incorrect function.
 Win32=1 - Incorrect function.
 Win32=1 - Incorrect function.

5. Error 11/22/2018 10:23:12.626 AM WDTF_PNP : Result: Device is not started. 

Version-Release number of selected component (if applicable):
Guest os: Win2019
kernel-4.18.0-40.el8.x86_64
qemu-kvm-3.0.0-2.module+el8+2208+e41b12e0.x86_64
seabios-bin-1.11.1-2.module+el8+2179+85112f94.noarch
virtio-win-prewhql-162


How reproducible:
100%

Steps to Reproduce:
1. Boot guest up with follows commands:
/usr/libexec/qemu-kvm -name 162NIC201964CQV -enable-kvm -m 6G -smp 8 -uuid 38ba9e79-061e-416c-baae-6ac5df5df188 -nodefconfig -nodefaults -cpu host,hv_time,hv_relaxed,hv_vapic,hv_spinlocks=0x1fff -chardev socket,id=charmonitor,path=/tmp/162NIC201964CQV,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=localtime,driftfix=slew -boot order=cd,menu=on -device piix3-usb-uhci,id=usb -drive file=162NIC201964CQV,if=none,id=drive-ide0-0-0,format=raw,cache=none -device ide-drive,bus=ide.0,unit=0,drive=drive-ide0-0-0,id=ide0-0-0 -drive file=/home/kvm_autotest_root/iso/ISO/Win2019/en_windows_server_2019_x64_dvd_4cb967d8.iso,if=none,media=cdrom,id=drive-ide0-1-0,readonly=on,format=raw -device ide-drive,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 -drive file=162NIC201964CQV.vfd,if=floppy,id=drive-fdc0-0-0,format=raw,cache=none -netdev tap,script=/etc/qemu-ifup1,downscript=no,id=hostnet0 -device e1000,netdev=hostnet0,id=net0,mac=00:52:25:6e:a0:78 -device usb-tablet,id=input0 -vnc 0.0.0.0:2 -vga std -M q35 -device pcie-root-port,bus=pcie.0,id=root1.0,slot=1 -netdev tap,script=/etc/qemu-ifup-private,downscript=no,id=hostnet1,vhost=on,queues=8 -device virtio-net-pci,netdev=hostnet1,id=net1,mac=00:52:57:08:17:5d,bus=root1.0,mq=on,vectors=18

2.Summit the job "DF - PNP Surprise Remove Device Test (Reliability)" on HLK-1809 studio.
3.Check the result on HLK-1809 controller.

Actual results:
Failed

Expected results:
Passed

Additional info:
Tried test with RHEL7.6 released package virtio-win-1.9.6-1.el7.noarch, also hit the same error.

Comment 4 Sameeh Jubran 2018-12-23 11:03:55 UTC
This seems like a bug with HLK 1809, people have the very same complains in the following thread.

https://social.msdn.microsoft.com/Forums/en-US/f64ea64e-a5d7-4d77-b59a-b3a85607f262/dfpnp-surprise-remove-device-test-network-adapter-failure-due-to-open-handles-svr2019hlk1809?forum=whck

We'll open a bug report to Microsoft in order to resolve the issue.

Comment 6 Peixiu Hou 2018-12-25 05:31:39 UTC
Hi all,

Tried with MS provided WDTFNetData.dll file, the job "DF - PNP Surprise Remove Device Test (Reliability)" can be passed on windows server 2019.

WDTFNetData.dll file download location:
https://www.dropbox.com/s/jjfb7yohzvctxj6/WDTFNetData.dll?dl=0

Best Regards~
Peixiu

Comment 7 Yvugenfi@redhat.com 2018-12-25 07:33:48 UTC
(In reply to Peixiu Hou from comment #6)
> Hi all,
> 
> Tried with MS provided WDTFNetData.dll file, the job "DF - PNP Surprise
> Remove Device Test (Reliability)" can be passed on windows server 2019.
> 
> WDTFNetData.dll file download location:
> https://www.dropbox.com/s/jjfb7yohzvctxj6/WDTFNetData.dll?dl=0
> 
> Best Regards~
> Peixiu

Thanks a lot! Great news.

BTW: Are you running tests also on Windows 10 1809? Because we had the same issue in HCK CI environment on Windows 10 1809 as well.

Comment 9 Peixiu Hou 2018-12-25 10:04:18 UTC
(In reply to Yan Vugenfirer from comment #7)
> (In reply to Peixiu Hou from comment #6)
> > Hi all,
> > 
> > Tried with MS provided WDTFNetData.dll file, the job "DF - PNP Surprise
> > Remove Device Test (Reliability)" can be passed on windows server 2019.
> > 
> > WDTFNetData.dll file download location:
> > https://www.dropbox.com/s/jjfb7yohzvctxj6/WDTFNetData.dll?dl=0
> > 
> > Best Regards~
> > Peixiu
> 
> Thanks a lot! Great news.
> 
> BTW: Are you running tests also on Windows 10 1809? Because we had the same
> issue in HCK CI environment on Windows 10 1809 as well.

yes, tried on windows 10-64 1809 guest as well, this job can be passed with new WDTFNetData.dll file.

Best Regards~
Peixiu