Bug 1892800 - NVDIMM: VM hangs in wait for launch for more than 7 minutes before VM is up.
Summary: NVDIMM: VM hangs in wait for launch for more than 7 minutes before VM is up.
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: vdsm
Classification: oVirt
Component: General
Version: 4.40.35
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ovirt-4.4.6
: ---
Assignee: Milan Zamazal
QA Contact: Nisim Simsolo
URL:
Whiteboard:
Depends On: 1894053 1933974
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-10-29 16:35 UTC by Nisim Simsolo
Modified: 2021-05-05 05:36 UTC (History)
3 users (show)

Fixed In Version: vdsm-4.40.60.1
Clone Of:
Environment:
Last Closed: 2021-05-05 05:36:26 UTC
oVirt Team: Virt
Embargoed:
pm-rhel: ovirt-4.4+


Attachments (Terms of Use)
qemu.log (29.62 KB, text/plain)
2020-10-29 16:40 UTC, Nisim Simsolo
no flags Details
engine.log (134.09 KB, application/x-xz)
2020-10-29 16:40 UTC, Nisim Simsolo
no flags Details
vdsm.log (324.85 KB, application/x-xz)
2020-10-29 16:41 UTC, Nisim Simsolo
no flags Details

Description Nisim Simsolo 2020-10-29 16:35:39 UTC
Description of problem:
- When running VM with NVDIMM device attached, the loading time is taking more than 7 minutes till the VM is up. 
- during that time VM state is "wait for launch"
- domstate reason is:
# virsh -r domstate --reason 8
paused (starting up)
- out of 3 times powering off -> running the VM, 2 times it took 10 minutes till the VM goes up, and one time it took 7 minutes.
- When removing NVDIMM device, VM is going up immediately.

Version-Release number of selected component (if applicable):
ovirt-engine-4.4.3.8-0.1.el8ev
vdsm-4.40.35-1.el8ev.x86_64
libvirt-daemon-6.6.0-6.module+el8.3.0+8125+aefcf088.x86_64
qemu-kvm-5.1.0-13.module+el8.3.0+8382+afc3bbea.x86_64

How reproducible:
100%

Steps to Reproduce:
1. Add NVDIMM device to VM.
2. Run VM.
3.

Actual results:
VM is hanging for more than 7 minutes in wait for launch state before it goes up.

Expected results:
Loading time should not be that long.

Additional info:
engine.log, qemu.log and vdsm.log attached:
VM started at: 2020-10-29 12:03:09,906-0400 INFO  (jsonrpc/0) [api.virt] START create(vmParams={'vmId': '2bec1859-c649-47c9-a3ef-27813f633dd0',
VM is up at: 2020-10-29 12:13:24,362-0400 INFO  (libvirt/events) [virt.vm] (vmId='2bec1859-c649-47c9-a3ef-27813f633dd0') CPU running: onResume (vm:5633)

Comment 1 Nisim Simsolo 2020-10-29 16:40:21 UTC
Created attachment 1725106 [details]
qemu.log

Comment 2 Nisim Simsolo 2020-10-29 16:40:59 UTC
Created attachment 1725107 [details]
engine.log

Comment 3 Nisim Simsolo 2020-10-29 16:41:45 UTC
Created attachment 1725108 [details]
vdsm.log

Comment 5 Nisim Simsolo 2021-03-31 19:24:13 UTC
Verified:
ovirt-engine-4.4.5.9-0.1.el8ev
vdsm-4.40.50.10-1.el8ev.x86_64
libvirt-daemon-7.0.0-11.module+el8.4.0+10505+3a8d753f.x86_64
qemu-kvm-5.2.0-14.module+el8.4.0+10425+ad586fa5.x86_64

2xNVDIMM devices for each VM with the next namespaces:
#  ndctl list --namespaces
[
  {
    "dev":"namespace1.0",
    "mode":"raw",
    "size":270582939648,
    "uuid":"3647813f-1850-4ca9-a2ee-e6faabad979e",
    "sector_size":4096,
    "blockdev":"pmem1"
  },
  {
    "dev":"namespace0.0",
    "mode":"raw",
    "size":270582939648,
    "uuid":"e6a7f67b-8f4e-41dc-93bc-4c1201ed1e63",
    "sector_size":4096,
    "blockdev":"pmem0"
  }
]


Verification scenario:
1. Verify VM launches immediately with the next NVDIMM modes:
sector, raw and fsdax
2.Verify VM launches immediately after reboots.
3. Verify VM launches immediately after power off.
4. Verify VM launches immediately after shut down.
5. Verified with RHEL8, Win16 and Win19 VMs.

Comment 6 Sandro Bonazzola 2021-05-05 05:36:26 UTC
This bugzilla is included in oVirt 4.4.6 release, published on May 4th 2021.

Since the problem described in this bug report should be resolved in oVirt 4.4.6 release, it has been closed with a resolution of CURRENT RELEASE.

If the solution does not work for you, please open a new bug report.


Note You need to log in before you can comment on or make changes to this bug.