Hide Forgot
Current TCMS actually doesn't provide required reporting and we have to track additional information outside of TCMS. One of such information is final status of testing. Information held by test case runs doesn't provide this information unfortunately. Even if some particular test case fails overall status can be 'Pass', it depends on predefined testing criteria. Therefore we need new result field to track this information directly in TCMS. This result field should provide these values: - Pass - Fail - Conditional Pass - some teams use similar state to indicate that there were some serious bugs found, however they have reasonable workaround.
Currently, test run only has the completed percentage based on each case's status. as each team has their condition to determine if one test run is passed or failed, this feature needs each team to define the profile for it. Will consider it in tcms 4.0 or later.
(In reply to comment #1) > Currently, test run only has the completed percentage based on each case's > status. > as each team has their condition to determine if one test run is passed or > failed, this feature needs each team to define the profile for it. No, it doesn't. It is enough to extend 'Set To Finished' link with combo box called 'Status' with proposed choices.
(In reply to comment #2) > > No, it doesn't. It is enough to extend 'Set To Finished' link with combo box > called 'Status' with proposed choices. If so, we need the leader/manager to decide if the test run is passed or failed, instead of each tester set it. it can be implemented when we have good permission control in TCMS 4.0.
(In reply to comment #3) > (In reply to comment #2) > > > > No, it doesn't. It is enough to extend 'Set To Finished' link with combo box > > called 'Status' with proposed choices. > If so, we need the leader/manager to decide if the test run is passed or > failed, instead of each tester set it. > > it can be implemented when we have good permission control in TCMS 4.0. Some teams gather this information in external wikis by table cell background color. Implementing what Marian suggested is non-negligible improvement. Access control can be added later IMO.
(In reply to comment #3) > (In reply to comment #2) > > > > No, it doesn't. It is enough to extend 'Set To Finished' link with combo box > > called 'Status' with proposed choices. > If so, we need the leader/manager to decide if the test run is passed or > failed, instead of each tester set it. No we do not need such ACL.