Bug 1564119

Summary:	need option 'run all-tests-in-regression' in reviews
Product:	[Community] GlusterFS	Reporter:	Amar Tumballi <atumball>
Component:	project-infrastructure	Assignee:	bugs <bugs>
Status:	CLOSED CURRENTRELEASE	QA Contact:
Severity:	high	Docs Contact:
Priority:	unspecified
Version:	mainline	CC:	amukherj, bugs, gluster-infra, jeff, nigelb, srangana
Target Milestone:	---
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:	Process-Automation
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2018-10-05 06:20:31 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Amar Tumballi 2018-04-05 12:26:11 UTC

# Description of problem:

Today, if a regression test fails regression due to some errors, by default, there is no way for the author to figure out if there are any more tests failing. Most of the times, they have to fix it and send another patch to figure out there is another one which fails. This process continues till all tests pass, or author has to send a patch with changing the 'run-tests.sh' to not fail on failure, and then again send another one disabling that.

The best way is to have an option to run the regression tests with '--exit-on-failures=no' option given a review command called 'run all-tests-in-regression'. 

Not critical about changing the command, but need a announcement on this.

# Additional info:

Search bugs with 'Process-Automation' in Whiteboard for the series of bugs.

Comment 1 Amar Tumballi 2018-05-21 09:29:19 UTC

https://review.gluster.org/#/c/20042 added, and triggered the sample run in https://review.gluster.org/20035 (https://build.gluster.org/job/regression-on-demand-full-run/1/)