Bug 1378171

Summary:	[RFE] Provide a Testing suite and cluster verification tool
Product:	OpenShift Container Platform	Reporter:	Eric Rich <erich>
Component:	Test Infrastructure	Assignee:	Steve Kuznetsov <skuznets>
Status:	CLOSED WONTFIX	QA Contact:	Junqi Zhao <juzhao>
Severity:	high	Docs Contact:
Priority:	low
Version:	3.4.0	CC:	aos-bugs, asogukpi, bholmes, bleanhar, ccoleman, dmcphers, ejacobs, erich, jeder, jialiu, jokerman, mangirdas.judeikis, mbarrett, mmccomas, mwysocki, nstielau, pcaruana, pep, philfest, skuznets, tcarlin, tiwillia, trankin
Target Milestone:	---	Flags:	erich: needinfo-
Target Release:	4.1.0
Hardware:	All
OS:	Linux
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:	1100052
Clones:	1378175 (view as bug list)		Environment:
Last Closed:	2019-04-30 16:01:19 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Bug Depends On:	1100052, 1369588
Bug Blocks:	1267746

Description Eric Rich 2016-09-21 17:27:44 UTC

+++ This bug was initially created as a clone of Bug #1100052 +++

Description of problem:

There should be a tool or test suite to acceptance test the system, or set of tools) to 'smoke test' the system, going through all the steps to do everything a user could do to ensure everything is working.

Comment 2 Eric Rich 2016-09-21 17:29:29 UTC

Solution https://access.redhat.com/site/solutions/2068843 outline some basic validations but this really need to be improved, with more automation.

Comment 3 Brenton Leanhardt 2016-09-21 17:44:42 UTC

This is related to https://trello.com/c/XJOIoshz/204-5-optionally-run-conformance-tests-post-install.

Comment 4 Steve Kuznetsov 2017-03-06 13:25:59 UTC

I wonder if we want to ship more targeted test binaries in the tests RPM for smoke testing a cluster.

Comment 10 Steve Kuznetsov 2017-08-12 15:56:01 UTC

Today we do have everything that you need to run our conformance tests in the `atomic-openshift-tests` RPM. While running our conformance suite is not the end-all-be-all of validating a cluster post-install, at least that piece is in place and viable as one tool in this toolbox.