Description of problem: machine API e2e testing validations make assumptions that prevent them from running in parallel. Validations should own their own scalable resources and be able to run in parallel so the total e2e time is dramatically reduced. Version-Release number of selected component (if applicable): How reproducible: Steps to Reproduce: 1. 2. 3. Actual results: Tests fail to run in parallel Expected results: Tests can be run in parallel Additional info:
Tested using `make test-e2e` against an 4.4.0-0.nightly-2020-02-03-005212 cluster, tests were run in parallel, execution time is much shorter. [2] ------------------------------ [2] [Feature:Operators] Cluster autoscaler operator should [2] reject invalid ClusterAutoscaler resources early via webhook [2] /Users/houjianwei/go/src/github.com/openshift/cluster-api-actuator-pkg/pkg/e2e/operators/cluster-autoscaler-operator.go:33 [1] Running Suite: Machine Suite [1] ============================ [1] Random Seed: 1580719623 [1] Parallel test node 1/4. [1] [1] [Feature:Operators] Cluster autoscaler operator should [1] reject invalid MachineAutoscaler resources early via webhook [1] /Users/houjianwei/go/src/github.com/openshift/cluster-api-actuator-pkg/pkg/e2e/operators/cluster-autoscaler-operator.go:49 [3] Running Suite: Machine Suite [3] ============================ [3] Random Seed: 1580719623 [3] Parallel test node 3/4. [3] [3] [Feature:Operators] Cluster autoscaler cluster operator status should [3] be available [3] /Users/houjianwei/go/src/github.com/openshift/cluster-api-actuator-pkg/pkg/e2e/operators/cluster-autoscaler-operator.go:90 [4] Running Suite: Machine Suite [4] ============================ [4] Random Seed: 1580719623 [4] Parallel test node 4/4. [3] Running Suite: Machine Suite [3] ============================ [3] Random Seed: 1580717842 [3] Parallel test node 3/4. [3] [2] Running Suite: Machine Suite [2] ============================ [2] Random Seed: 1580717842 [2] Parallel test node 2/4. [2] [1] Running Suite: Machine Suite [1] ============================ [1] Random Seed: 1580717842 [1] Parallel test node 1/4. [1] [1] [Feature:Machines] Managed cluster should [1] have ability to additively reconcile taints from machine to nodes [1] /Users/houjianwei/go/src/github.com/openshift/cluster-api-actuator-pkg/pkg/e2e/infra/infra.go:199 [2] S [4] Running Suite: Machine Suite [4] ============================ [4] Random Seed: 1580717842 [4] Parallel test node 4/4.