Description of problem: When ./run-tests-in-vagrant.sh runs the regression tests, and tests fail, the script does not exit with an error. This makes it impossible for a CI to report the correct result. Version-Release number of selected component (if applicable): 3.8 and mainline How reproducible: 100% Steps to Reproduce: 1. run ./run-tests-in-vagrant.sh --os=centos6 2. see it fail 3. check the return status with: echo $? Actual results: Jenkins notes a return value of 0 as SUCCESS Expected results: the script should exit with a non-zero value Additional info: See the output of this job in the CentOS CI: https://ci.centos.org/view/Gluster/job/gluster_run-tests-in-vagrant/10/console
We have a good set of regression right now, and in last year or so, never had any one using run-tests-with-vagrant.sh. Inclined towards not working on this.