Bug 1080379 - [RFE][CodeChange] - Provide a new tasks infrastructure without Master File-System persistency
Summary: [RFE][CodeChange] - Provide a new tasks infrastructure without Master File-Sy...
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: ovirt-engine
Classification: oVirt
Component: RFEs
Version: 3.5.0
Hardware: Unspecified
OS: Unspecified
medium
unspecified
Target Milestone: ovirt-4.1.0-beta
: ---
Assignee: Adam Litke
QA Contact: Kevin Alon Goldblatt
URL: https://github.com/rollandf/ovirt-sit...
Whiteboard:
Depends On: 1082498 1082501
Blocks: 1017207 1080372 1080384 1185830 1422115
TreeView+ depends on / blocked
 
Reported: 2014-03-25 10:03 UTC by Federico Simoncelli
Modified: 2017-03-28 18:01 UTC (History)
20 users (show)

Fixed In Version:
Doc Type: Enhancement
Doc Text:
Previously, almost all data path operations on the hosts could only be performed on the elected Storage Pool Manager. This could potentially cause bottlenecks. In this release, a new lightweight host jobs management infrastructure was introduced, which enables data path operations to run on any host. In addition, administrators can monitor the progress of Move Disk operations with the aid of a progress indicator.
Clone Of:
Environment:
Last Closed: 2017-02-15 14:55:48 UTC
oVirt Team: Storage
Embargoed:
rule-engine: ovirt-4.1+
gklein: testing_plan_complete+
ylavi: planning_ack+
amureini: devel_ack+
ratamir: testing_ack+


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Bugzilla 529086 1 medium CLOSED [RFE] Progress bars missing , everywhere! 2023-12-15 15:44:59 UTC
oVirt gerrit 44857 0 None None None Never
oVirt gerrit 45381 0 None None None Never

Internal Links: 529086

Description Federico Simoncelli 2014-03-25 10:03:00 UTC
Description of problem:
In order to remove the master domain we need to provide a different tasks infrastructure that is not relying on the master file-system persistency.

Comment 1 Barak 2014-03-25 11:36:30 UTC
Fede,

I understand entirely theis FRE although this should be divided into several separate bugs.

1 - vdsm-infra - for the task framework to stop persisting tasks onto the master file system
2 - vdsm-storage - get rid of master file-system (this also related to the reconstruct master flow ... and probably should depend on #1
3 - engine-storage - handle the irsBroker handling on engine according to the new 
flows
4 - infra-engine - add a new interface to enable querying the vdsm for specific objects statuses after failing async task.
5 - storage-engine - utilize #4 for all storage flows

So this RFE is about storage and infra should own some of the tasks as listed above.

Can you please open the appropriate bugs

Comment 2 Federico Simoncelli 2014-03-31 08:21:17 UTC
(In reply to Barak from comment #1)
> Fede,
> 
> I understand entirely theis FRE although this should be divided into several
> separate bugs.
> 
> 1 - vdsm-infra - for the task framework to stop persisting tasks onto the
> master file system

Bug 1082498

> 2 - vdsm-storage - get rid of master file-system (this also related to the
> reconstruct master flow ... and probably should depend on #1

Bug 1082502

> 3 - engine-storage - handle the irsBroker handling on engine according to
> the new 
> flows

Bug 1082503 (note: same as 5 for now)

> 4 - infra-engine - add a new interface to enable querying the vdsm for
> specific objects statuses after failing async task.

Bug 1082501

> 5 - storage-engine - utilize #4 for all storage flows

Bug 1082503 (note: same as 3 for now)

Full dependency tree at:

https://bugzilla.redhat.com/showdependencytree.cgi?id=1080372

Comment 3 Yaniv Lavi 2015-06-15 11:21:18 UTC
Should this be on post? can you add the patches?

Comment 4 Liron Aravot 2015-07-19 14:45:35 UTC
Adam is about to introduce a new jobs infrastructure, the relevant patches should be added to the tracker in this bz. moving the needinfo? on him.

Comment 5 Adam Litke 2015-08-27 14:27:34 UTC
Gerrit patches 45381 and 44857 provide the internal mechanism (based on existing v2v jobs infrastructure).  Yet to be posted are patches to expose an actual API to engine for this.  Those are forthcoming.

Comment 6 Red Hat Bugzilla Rules Engine 2015-12-01 15:41:20 UTC
Target release should be placed once a package build is known to fix a issue. Since this bug is not modified, the target version has been reset. Please use target milestone to plan a fix for a oVirt release.

Comment 8 Mike McCune 2016-03-28 22:14:36 UTC
This bug was accidentally moved from POST to MODIFIED via an error in automation, please see mmccune with any questions

Comment 9 Allon Mureinik 2016-11-07 10:38:25 UTC
Adam, with the introduction of ./lib/vdsm/jobs.py, shouldn't this be moved to MODIFIED?

Comment 10 Raz Tamir 2016-11-15 15:27:32 UTC
Is there any feature page for this RFE?
We need to understand the scope of this and what needs to be covered from QE side

Comment 11 Yaniv Kaul 2016-11-24 14:32:21 UTC
(In reply to Raz Tamir from comment #10)
> Is there any feature page for this RFE?
> We need to understand the scope of this and what needs to be covered from QE
> side

I'm changing it to a CodeChange - the interesting thing to test is its use - the move of commands to HSM, which have their own feature pages.
There you'll have plenty to test, including negative scenarios.

Comment 12 Yaniv Lavi 2016-11-30 13:48:37 UTC
(In reply to Yaniv Kaul from comment #11)
> (In reply to Raz Tamir from comment #10)
> > Is there any feature page for this RFE?
> > We need to understand the scope of this and what needs to be covered from QE
> > side
> 
> I'm changing it to a CodeChange - the interesting thing to test is its use -
> the move of commands to HSM, which have their own feature pages.
> There you'll have plenty to test, including negative scenarios.

There is engine side changes on progress and tasks that need a feature page. I don't consider this a code change.

Comment 13 Yaniv Kaul 2016-11-30 13:52:50 UTC
Adam - any feature page for this?

Comment 14 Yaniv Lavi 2016-12-15 14:02:15 UTC
Should this be MODIFIED?

Comment 15 Adam Litke 2016-12-19 14:12:06 UTC
As Yaniv Kaul stated, this is infrastructure that can only be tested by way of the flows which use it including: Move disk and cold merge.

Comment 16 Tal Nisan 2017-01-12 13:20:29 UTC
Adam, I think we should write a small doc text on that feature

Comment 17 Emma Heftman 2017-01-19 17:01:13 UTC
Hi Adam. Can you confirm that this feature is an infrastructure change only, and does not require any updates to the documentation.

Comment 18 Adam Litke 2017-01-19 19:38:00 UTC
I've added The requires_doc_text:? flag and proposed some doc text to describe the user-visible aspects of this feature.  Please see the relevant parts of the bug.

Comment 19 Kevin Alon Goldblatt 2017-02-05 15:17:48 UTC
Tested the following 4 commands with the new HSM infrastructure:
Cold Move
Cold Merge
Create Cloned VM from Template


Moving to VERIFIED

Comment 21 Raz Tamir 2017-03-27 13:24:13 UTC
Yes it is random


Note You need to log in before you can comment on or make changes to this bug.