Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.
Bug 1080379 - [RFE][CodeChange] - Provide a new tasks infrastructure without Master File-System persistency
[RFE][CodeChange] - Provide a new tasks infrastructure without Master File-Sy...
Status: CLOSED CURRENTRELEASE
Product: ovirt-engine
Classification: oVirt
Component: RFEs (Show other bugs)
3.5.0
Unspecified Unspecified
medium Severity unspecified (vote)
: ovirt-4.1.0-beta
: ---
Assigned To: Adam Litke
Kevin Alon Goldblatt
https://github.com/rollandf/ovirt-sit...
: CodeChange, FutureFeature
Depends On: 1082498 1082501
Blocks: 1017207 1080372 1080384 1185830 1422115
  Show dependency treegraph
 
Reported: 2014-03-25 06:03 EDT by Federico Simoncelli
Modified: 2017-03-28 14:01 EDT (History)
20 users (show)

See Also:
Fixed In Version:
Doc Type: Enhancement
Doc Text:
Previously, almost all data path operations on the hosts could only be performed on the elected Storage Pool Manager. This could potentially cause bottlenecks. In this release, a new lightweight host jobs management infrastructure was introduced, which enables data path operations to run on any host. In addition, administrators can monitor the progress of Move Disk operations with the aid of a progress indicator.
Story Points: ---
Clone Of:
Environment:
Last Closed: 2017-02-15 09:55:48 EST
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: Storage
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---
rule-engine: ovirt‑4.1+
gklein: testing_plan_complete+
ylavi: planning_ack+
amureini: devel_ack+
ratamir: testing_ack+


Attachments (Terms of Use)


External Trackers
Tracker ID Priority Status Summary Last Updated
oVirt gerrit 44857 None None None Never
oVirt gerrit 45381 None None None Never

  None (edit)
Description Federico Simoncelli 2014-03-25 06:03:00 EDT
Description of problem:
In order to remove the master domain we need to provide a different tasks infrastructure that is not relying on the master file-system persistency.
Comment 1 Barak 2014-03-25 07:36:30 EDT
Fede,

I understand entirely theis FRE although this should be divided into several separate bugs.

1 - vdsm-infra - for the task framework to stop persisting tasks onto the master file system
2 - vdsm-storage - get rid of master file-system (this also related to the reconstruct master flow ... and probably should depend on #1
3 - engine-storage - handle the irsBroker handling on engine according to the new 
flows
4 - infra-engine - add a new interface to enable querying the vdsm for specific objects statuses after failing async task.
5 - storage-engine - utilize #4 for all storage flows

So this RFE is about storage and infra should own some of the tasks as listed above.

Can you please open the appropriate bugs
Comment 2 Federico Simoncelli 2014-03-31 04:21:17 EDT
(In reply to Barak from comment #1)
> Fede,
> 
> I understand entirely theis FRE although this should be divided into several
> separate bugs.
> 
> 1 - vdsm-infra - for the task framework to stop persisting tasks onto the
> master file system

Bug 1082498

> 2 - vdsm-storage - get rid of master file-system (this also related to the
> reconstruct master flow ... and probably should depend on #1

Bug 1082502

> 3 - engine-storage - handle the irsBroker handling on engine according to
> the new 
> flows

Bug 1082503 (note: same as 5 for now)

> 4 - infra-engine - add a new interface to enable querying the vdsm for
> specific objects statuses after failing async task.

Bug 1082501

> 5 - storage-engine - utilize #4 for all storage flows

Bug 1082503 (note: same as 3 for now)

Full dependency tree at:

https://bugzilla.redhat.com/showdependencytree.cgi?id=1080372
Comment 3 Yaniv Lavi 2015-06-15 07:21:18 EDT
Should this be on post? can you add the patches?
Comment 4 Liron Aravot 2015-07-19 10:45:35 EDT
Adam is about to introduce a new jobs infrastructure, the relevant patches should be added to the tracker in this bz. moving the needinfo? on him.
Comment 5 Adam Litke 2015-08-27 10:27:34 EDT
Gerrit patches 45381 and 44857 provide the internal mechanism (based on existing v2v jobs infrastructure).  Yet to be posted are patches to expose an actual API to engine for this.  Those are forthcoming.
Comment 6 Red Hat Bugzilla Rules Engine 2015-12-01 10:41:20 EST
Target release should be placed once a package build is known to fix a issue. Since this bug is not modified, the target version has been reset. Please use target milestone to plan a fix for a oVirt release.
Comment 8 Mike McCune 2016-03-28 18:14:36 EDT
This bug was accidentally moved from POST to MODIFIED via an error in automation, please see mmccune@redhat.com with any questions
Comment 9 Allon Mureinik 2016-11-07 05:38:25 EST
Adam, with the introduction of ./lib/vdsm/jobs.py, shouldn't this be moved to MODIFIED?
Comment 10 Raz Tamir 2016-11-15 10:27:32 EST
Is there any feature page for this RFE?
We need to understand the scope of this and what needs to be covered from QE side
Comment 11 Yaniv Kaul 2016-11-24 09:32:21 EST
(In reply to Raz Tamir from comment #10)
> Is there any feature page for this RFE?
> We need to understand the scope of this and what needs to be covered from QE
> side

I'm changing it to a CodeChange - the interesting thing to test is its use - the move of commands to HSM, which have their own feature pages.
There you'll have plenty to test, including negative scenarios.
Comment 12 Yaniv Lavi 2016-11-30 08:48:37 EST
(In reply to Yaniv Kaul from comment #11)
> (In reply to Raz Tamir from comment #10)
> > Is there any feature page for this RFE?
> > We need to understand the scope of this and what needs to be covered from QE
> > side
> 
> I'm changing it to a CodeChange - the interesting thing to test is its use -
> the move of commands to HSM, which have their own feature pages.
> There you'll have plenty to test, including negative scenarios.

There is engine side changes on progress and tasks that need a feature page. I don't consider this a code change.
Comment 13 Yaniv Kaul 2016-11-30 08:52:50 EST
Adam - any feature page for this?
Comment 14 Yaniv Lavi 2016-12-15 09:02:15 EST
Should this be MODIFIED?
Comment 15 Adam Litke 2016-12-19 09:12:06 EST
As Yaniv Kaul stated, this is infrastructure that can only be tested by way of the flows which use it including: Move disk and cold merge.
Comment 16 Tal Nisan 2017-01-12 08:20:29 EST
Adam, I think we should write a small doc text on that feature
Comment 17 Emma Heftman 2017-01-19 12:01:13 EST
Hi Adam. Can you confirm that this feature is an infrastructure change only, and does not require any updates to the documentation.
Comment 18 Adam Litke 2017-01-19 14:38:00 EST
I've added The requires_doc_text:? flag and proposed some doc text to describe the user-visible aspects of this feature.  Please see the relevant parts of the bug.
Comment 19 Kevin Alon Goldblatt 2017-02-05 10:17:48 EST
Tested the following 4 commands with the new HSM infrastructure:
Cold Move
Cold Merge
Create Cloned VM from Template


Moving to VERIFIED
Comment 21 Raz Tamir 2017-03-27 09:24:13 EDT
Yes it is random

Note You need to log in before you can comment on or make changes to this bug.