Created attachment 1009515 [details] logs Description of problem: Live merge while writing to disk causes to fill up the domain (on block domain) Version-Release number of selected component (if applicable): rhevm-3.5.1-0.2.el6ev vdsm-4.16.12-2.el7ev.x86_64 How reproducible: 100% Steps to Reproduce: 1. Create a VM with 1 disk and OS installed 2. Create a snapshot 3. Write a file using dd operation while at the same time delete the snapshot Actual results: The domain fills up and there is not a free space in the domain, although only small part in the domain was used Expected results: The space that was not used should be available Additional info: From engine: 2015-03-30 17:43:02,541 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-60) [322c4ca3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Critical, Low disk space. iSCSI2 domain has 0 GB of free space
Looks like the same runaway libvirt-python issue we know. Adam/Nir - can you take a look please?
Please provide the output of "rpm -qa | grep libvirt" on the host.
In addition, the vdsm log does not have any context during the merge operation you report. Please make sure the attached logs show the state before, during, and after the live merge operation.
(In reply to Nir Soffer from comment #2) > Please provide the output of "rpm -qa | grep libvirt" on the host. libvirt-daemon-1.2.8-15.el7.x86_64 libvirt-daemon-driver-secret-1.2.8-15.el7.x86_64 libvirt-lock-sanlock-1.2.8-15.el7.x86_64 libvirt-daemon-driver-qemu-1.2.8-15.el7.x86_64 libvirt-python-1.2.8-7.el7.x86_64 libvirt-daemon-driver-storage-1.2.8-15.el7.x86_64 libvirt-daemon-kvm-1.2.8-15.el7.x86_64 libvirt-client-1.2.8-15.el7.x86_64 libvirt-daemon-config-nwfilter-1.2.8-15.el7.x86_64 libvirt-daemon-driver-nodedev-1.2.8-15.el7.x86_64 libvirt-daemon-driver-interface-1.2.8-15.el7.x86_64 libvirt-daemon-driver-network-1.2.8-15.el7.x86_64 libvirt-daemon-driver-nwfilter-1.2.8-15.el7.x86_64
(In reply to lkuchlan from comment #4) > libvirt-daemon-1.2.8-15.el7.x86_64 > libvirt-python-1.2.8-7.el7.x86_64 The fix for bug 1177220 requires libvirt-daemon-1.2.8-16.el7_1.2 and libvirt-python-1.2.8-7.el7_1.1 . Can you please update your dependencies and re-run your scenario?
(In reply to Allon Mureinik from comment #5) > (In reply to lkuchlan from comment #4) > > libvirt-daemon-1.2.8-15.el7.x86_64 > > libvirt-python-1.2.8-7.el7.x86_64 > > The fix for bug 1177220 requires libvirt-daemon-1.2.8-16.el7_1.2 and > libvirt-python-1.2.8-7.el7_1.1 . > > Can you please update your dependencies and re-run your scenario? It is not reproduced The live merge passed successfully and the domain did not filled up, although, from engine log, there was ERROR which indicate that there is no storage space
Created attachment 1013651 [details] logs
(In reply to lkuchlan from comment #6) > (In reply to Allon Mureinik from comment #5) > > (In reply to lkuchlan from comment #4) > > > libvirt-daemon-1.2.8-15.el7.x86_64 > > > libvirt-python-1.2.8-7.el7.x86_64 > > > > The fix for bug 1177220 requires libvirt-daemon-1.2.8-16.el7_1.2 and > > libvirt-python-1.2.8-7.el7_1.1 . > > > > Can you please update your dependencies and re-run your scenario? > > It is not reproduced > The live merge passed successfully and the domain did not filled up, > although, from engine log, there was ERROR which indicate that there is no > storage space I see one error message: > Dummy-32::ERROR::2015-04-12 15:46:20,919::storage_mailbox::617::Storage.MailBox.SpmMailMonitor::(_validateMailbox) SPM_MailMonitor: mailbox 1 checksum failed, not clearing mailbox, clearing newMail. Which doesn't seem related. If this is mistaken, please elaborate to what exactly you mean. Moving to MODIFIED so this bug is formally verified against the next official build.
Closed as duplicate after discussing with Yaniv and Aharon *** This bug has been marked as a duplicate of bug 1177220 ***