Description of problem: When test for the HTS5 for any arch, sometimes the Test Rresult showing after any particular test is completed, sometimes wrong. For example, when tested for ia64-xen system, for hts-core, in gnome-terminal, its showing PASS after test is complete, but if open the results.xml file and observe, it can be seen that the test is actually FAIL. all the g-t screensshot, results.xml, plan.xml, output.log file is attached here with this bug. Not only Core, its happening for other tests too for other archs or the same arch. It includes, network, usb, memory, storage, cdrom testing. Version-Release number of selected component (if applicable): hts-5.0.50.el5 How reproducible: Always Steps to Reproduce: 1. Install the required rpm for hts, and its dependent packages, and follow the hts5 testing steps. 2. Observe the Test result status (PASS or FAIL), showing n gnome-terminal after each test is completed. 3. Open results.xml, file, and see the test result status (PASS or FAIL) Actual results: The test result in both places are not with the same status. Expected results: The test result in both places should be with same status. Additional info: required Files attached to trace the bug.
Created attachment 168444 [details] gnome-terminal-test result-status
Created attachment 168447 [details] results.xml
Created attachment 168449 [details] plan.xml
Created attachment 168451 [details] output.log for core
And prticularly ia64-xen system is giving traceback error in g-t for each tests. Traceback error is shown in the screenshot in comment #1. pls see and suggest any seperate bug needed for this or can mention in this bug iteslf!.
The attachments only indicate this problem for the info test. Can you provide test results showing incorrect reporting for any other tests? Thanks!
Hi Greg Test results got from "hts-submit" is attached in Comment #2. I think you want output.log file for the other hardware components like network, memory, usb, etc, apart from core, which is attached on Comment #4. right? If so, please let me run these tests once again, to collect the files. I will attach those file once test finishes. Can make it by tomorrow! :)
Created attachment 199361 [details] ia64-xen-all-tests-log-and-results Hi Greg I collected the entire results, log files for hts on this ia64-xen system. Its attached right here. Its having a directory namely 'run' under which there are log files for each of the tests.
The only test that shows failures indicated as PASS is the info test. This is fixed in HTS 5.1 R3.
g-t show PASS of info test, not show RESULT of COMPONENT test. `hts print` or `cat /var/log/hts/runs/NUM/COMPONENT/output.log` could show the RESULT of COMPONENT. Think this is not a bug, resolve it.