Description of problem: The volume deletion phase of a Live Merge (snapshot deletion) never completed, leaving the snapshot in a LOCKED state. The merges for two disks completed on the host that the VM was running on. They were both active layer merges, the pivots completed. However, the volume deletions never completed. The engine reported a java exception for both. During this time the SPM switched twice. Version-Release number of selected component (if applicable): RHV 4.2.5 RHEL 7.5 hosts w/vdsm-4.20.35-1 How reproducible: Steps to Reproduce: 1. 2. 3. Actual results: Expected results: Additional info:
Hey Gordon, Did you manage to reproduce this bug?
Hey Gordon, It is impossible to debug this log, the environment was in a huge mess and there were a lot of live merge attempts. Please try to reproduce this issue with clear steps.
This bug has not been marked as blocker for oVirt 4.3.0. Since we are releasing it tomorrow, January 29th, this bug has been re-targeted to 4.3.1.
Reproducing this bug on a none development environment may be difficult. Steps to reproduce: 1. Create a VM with a disk 2. Create a snapshot for the VM that contains the disk 3. Run the VM 4. Delete the snapshot from step 2 5. While the snapshot is deleted (live merge) after the 'MERGE_STATUS' step, block the communication between the engine to the SPM, this should be done before the engine sends the SPM the command to start the deleteImage command. The expected result after the fix: The attempt to delete the volume will fail and a second attempt will take place. If the communication is still blocked, the second attempt will fail too -> snapshot deletion will fail, the snapshot will not remain on 'locked'. If the communication is OK, the second attempt will succeed -> snapshot deletion will succeed
As we discussed in thread mail and is written in the previous comment this bug is almost impossible to verify in QE(none development environment). Eyal S. will verify this bug when it will be merged on master and a cherry-pick will be created. reassigning QA Contact to Eyal to verify on current target milestone(4.3.5) .
For some reason, the verification modification wasn't saved. Verified locally on my dev environment by throwing an exception. steps: 1) Create a VM with a disk 2) Create a snapshot for the VM 3) Run the VM 4) Add an Exception that will throw in - @Override protected void executeCommand() { getParameters().setEntityInfo(new EntityInfo(VdcObjectType.Disk, getParameters().getImageGroupId())); VDSReturnValue vdsReturnValue = null; try { throw new EngineException(); // vdsReturnValue = runVdsCommand(VDSCommandType.DestroyImage, createVDSParameters()); } catch (EngineException e) { log.error("Failed to delete image {}/{}", getParameters().getImageGroupId(), getParameters().getImageList().stream().findFirst().get(), e); if (!getParameters().isLiveMerge()) { throw e; } } .... 5) Remove the created snapshot -> DestroyImageCommand failed, live merge continuing to try until it will succeed. 6) Remove the added Exception -> DestroyImageCommand succeed, snapshot removed. Moving to verify
sync2jira
The documentation text flag should only be set after 'doc text' field is provided. Please provide the documentation text and set the flag to '?' again.
WARN: Bug status (VERIFIED) wasn't changed but the folowing should be fixed: [Found non-acked flags: '{}', ] For more info please contact: rhv-devops: Bug status (VERIFIED) wasn't changed but the folowing should be fixed: [Found non-acked flags: '{}', ] For more info please contact: rhv-devops
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (Important: RHV Manager (ovirt-engine) 4.4 security, bug fix, and enhancement update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHSA-2020:3247