Bug 1313974

Summary: Additional test failures
Product: Red Hat Software Collections Reporter: Pavel Valena <pvalena>
Component: rubygem-railtiesAssignee: Pavel Valena <pvalena>
Status: CLOSED EOL QA Contact: BaseOS QE - Apps <qe-baseos-apps>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: rh-ror42CC: jorton, kanderso, pvalena, vondruch
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-06-14 13:06:17 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Pavel Valena 2016-03-02 18:09:28 UTC
Description of problem:
In RHSCL rh-ror42 are additional failing tests than in Fedora. Test results are also very unstable.

Version-Release number of selected component (if applicable):
rubygem-railties-4.2.5.1-6.el7

How reproducible:
Make a scratch-build of rh-ror42-rubygem-railties with deleted "grep" of the test execution.

Steps to Reproduce:
1. rhpkg co rubygem-railties && cd rubygem-railties && \
git checkout rhscl-2.2-rh-ror42-rhel-7
2. delete " | grep .*" in %check
3. rhpkg scratch-build

Actual results:
Approx. "1111 runs, 2331 assertions, 210 failures, 396 errors, 0"

Expected results:
Ideally "1012 runs, 2433 assertions, 129 failures, 330 errors, 0"

Additional info:
Test suite is very unstable, test results may vary in every run.

Comment 1 Joe Orton 2016-04-07 16:01:34 UTC
Have you identified a fix for this?

Comment 3 Pavel Valena 2016-04-07 16:50:53 UTC
Sorry, no. I have found no fix.

However, I have found out that in Fedora the tests are also very unstable and are disabled since 2015-02-12.

The tests are run (in Fedora/RHSCL) in a fake framework root, which is trying to work around the Bundler usage for the tests.

Additionally, after updating to 4.2.6, the tests do not run at all, due to invalid dependency path(s).

Comment 12 Joe Orton 2019-03-14 11:02:42 UTC
Red Hat does not currently plan to provide any further changes to this collection in a Red Hat Software Collections update release.

This software collection is nearing the retirement date (May 2019) after which customers are encouraged to upgrade to a later release.

Please contact Red Hat Support if you have further questions, or refer to the support lifecycle page for more information. https://access.redhat.com/support/policy/updates/rhscl/

Comment 13 Joe Orton 2019-06-14 13:06:17 UTC
In accordance with the Red Hat Software Collections Product Life Cycle, the support period for this collection has ended.

New bug fix, enhancement, and security errata updates, as well as technical support services will no longer be made available for this collection.

Customers are encouraged to upgrade to a later release.

Please contact Red Hat Support if you have further questions, or refer to the support lifecycle page for more information. https://access.redhat.com/support/policy/updates/rhscl/