Bug 1979554
| Summary: | Latency tests runs on constant oslat version while the cnf-tests image uses the latest | ||
|---|---|---|---|
| Product: | OpenShift Container Platform | Reporter: | Shereen Haj Makhoul <shajmakh> |
| Component: | CNF Platform Validation | Assignee: | Federico Paolinelli <fpaoline> |
| Status: | CLOSED CURRENTRELEASE | QA Contact: | Nikita <nkononov> |
| Severity: | urgent | Docs Contact: | |
| Priority: | unspecified | ||
| Version: | 4.8 | CC: | aos-bugs, bzvonar, grajaiya, mniranja |
| Target Milestone: | --- | ||
| Target Release: | 4.9.0 | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | cnf-tests-container-v4.9.0-3 | Doc Type: | No Doc Update |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2022-08-24 12:52:49 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
| Bug Depends On: | |||
| Bug Blocks: | 1979946 | ||
|
Description
Shereen Haj Makhoul
2021-07-06 12:00:24 UTC
Detailed versions : - oc version Client Version: 4.8.0-0.nightly-2021-06-22-192915 Server Version: 4.8.0-0.nightly-2021-06-29-033219 Kubernetes Version: v1.21.0-rc.0+766a5fe - oc get csv NAME DISPLAY VERSION REPLACES PHASE performance-addon-operator.v4.8.0 Performance Addon Operator 4.8.0 Succeeded [root@ocp-edge41 ~]# Bug's fix Verification: ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ oc version Client Version: 4.8.0-0.nightly-2021-06-22-192915 Server Version: 4.8.0-0.nightly-2021-06-29-033219 Kubernetes Version: v1.21.0-rc.0+766a5fe ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ PAO : performance-addon-operator.v4.8.0 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 1. run the test on with the image that has the fix 4.9.0-3: podman run -v $KUBECONFIG:/root/kubeconfig:Z -e KUBECONFIG=/root/kubeconfig -e IMAGE_REGISTRY=registry-proxy.engineering.redhat.com/rh-osbs -e CNF_TESTS_IMAGE=openshift4-cnf-tests:v4.9.0-3 -e PERF_TEST_PROFILE=performance -e ROLE_WORKER_CNF=worker-cnf -e LATENCY_TEST_RUN=true -e LATENCY_TEST_RUNTIME=10 -e OSLAT_MAXIMUM_LATENCY=20 -e DISCOVERY_MODE=true registry-proxy.engineering.redhat.com/rh-osbs/openshift4-cnf-tests:v4.9.0-3 usr/bin/test-run.sh -ginkgo.focus="\[performance\]\ Latency\ Test" running /usr/bin/validationsuite -ginkgo.focus=\[performance\]\ Latency\ Test I0712 15:40:23.502866 8 request.go:655] Throttling request took 1.043069797s, request: GET:https://api.ocp48.demo.lab.shajmakh:6443/apis/performance.openshift.io/v1?timeout=32s Running Suite: CNF Features e2e validation ========================================== Random Seed: 1626104422 Will run 0 of 36 specs SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS Ran 0 of 36 Specs in 0.001 seconds SUCCESS! -- 0 Passed | 0 Failed | 0 Pending | 36 Skipped PASS Discovery mode enabled, skipping setup running /usr/bin/cnftests -ginkgo.focus=\[performance\]\ Latency\ Test I0712 15:40:26.603112 40 request.go:655] Throttling request took 1.044889973s, request: GET:https://api.ocp48.demo.lab.shajmakh:6443/apis/events.k8s.io/v1beta1?timeout=32s Running Suite: CNF Features e2e integration tests ================================================= Random Seed: 1626104425 Will run 1 of 134 specs SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ • [SLOW TEST:16.531 seconds] [performance] Latency Test /remote-source/app/vendor/github.com/openshift-kni/performance-addon-operators/functests/4_latency/latency.go:76 with the oslat image /remote-source/app/vendor/github.com/openshift-kni/performance-addon-operators/functests/4_latency/latency.go:127 should succeed /remote-source/app/vendor/github.com/openshift-kni/performance-addon-operators/functests/4_latency/latency.go:128 ------------------------------ JUnit report was created: /junit.xml/cnftests-junit.xml Ran 1 of 134 Specs in 44.809 seconds SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 133 Skipped PASS [root@ocp-edge41 ~]# 2.oc logs oslat-b9862 I0712 15:42:00.571508 1 main.go:83] Environment information: /proc/cmdline: BOOT_IMAGE=(hd0,gpt3)/ostree/rhcos-3c8ec880c490645b99e01bb052821294c500c2478a715a00dacdffe87b0825f6/vmlinuz-4.18.0-305.3.1.rt7.75.el8_4.x86_64 random.trust_cpu=on console=tty0 console=ttyS0,115200n8 ignition.platform.id=qemu ostree=/ostree/boot.1/rhcos/3c8ec880c490645b99e01bb052821294c500c2478a715a00dacdffe87b0825f6/0 root=UUID=8e7cc1f7-cbe0-432c-aa91-0b3528ccc7a3 rw rootflags=prjquota skew_tick=1 nohz=on rcu_nocbs=1-3 tuned.non_isolcpus=fffffff1 intel_pstate=disable nosoftlockup tsc=nowatchdog intel_iommu=on iommu=pt isolcpus=managed_irq,1-3 systemd.cpu_affinity=0,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31 default_hugepagesz=1G hugepagesz=1G hugepages=1 + I0712 15:42:00.571653 1 main.go:89] Environment information: kernel version 4.18.0-305.3.1.rt7.75.el8_4.x86_64 I0712 15:42:00.571670 1 main.go:52] Running the oslat command with arguments [--duration 30 --rtprio 1 --cpu-list 2 --cpu-main-thread 1] 3.oc describe pods Name: oslat-b9862 Namespace: performance-addon-operators-testing Priority: 0 Node: ocp48-worker-0.demo.lab.shajmakh/192.168.122.114 Start Time: Mon, 12 Jul 2021 18:41:57 +0300 Labels: <none> Annotations: cpu-load-balancing.crio.io: true k8s.v1.cni.cncf.io/network-status: [{ "name": "openshift-sdn", "interface": "eth0", "ips": [ "10.133.2.99" ], "default": true, "dns": {} }] k8s.v1.cni.cncf.io/networks-status: [{ "name": "openshift-sdn", "interface": "eth0", "ips": [ "10.133.2.99" ], "default": true, "dns": {} }] openshift.io/scc: node-exporter Status: Running IP: 10.133.2.99 IPs: IP: 10.133.2.99 Containers: oslat-runner: Container ID: cri-o://1a9950882618ad74f89ce257dac2e30ffa94c94ca064439a58d6e76e994908f6 Image: registry-proxy.engineering.redhat.com/rh-osbs/openshift4-cnf-tests:v4.9.0-3 Image ID: registry-proxy.engineering.redhat.com/rh-osbs/openshift4-cnf-tests@sha256:ce538168dc34700267f692015479466097d1ded6930949c3ebe201011d4286ea Port: <none> Host Port: <none> Command: /usr/bin/oslat-runner Args: -logtostderr=false -alsologtostderr=true -log_file=/host/oslat.log -runtime=30 State: Running Started: Mon, 12 Jul 2021 18:42:00 +0300 Ready: True Restart Count: 0 Limits: cpu: 2 memory: 1Gi Requests: cpu: 2 memory: 1Gi Environment: <none> Mounts: /host from logs (rw) /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-r7p4t (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: logs: Type: HostPath (bare host directory volume) Path: /var/log HostPathType: Directory kube-api-access-r7p4t: Type: Projected (a volume that contains injected data from multiple sources) TokenExpirationSeconds: 3607 ConfigMapName: kube-root-ca.crt ConfigMapOptional: <nil> DownwardAPI: true ConfigMapName: openshift-service-ca.crt ConfigMapOptional: <nil> QoS Class: Guaranteed Node-Selectors: kubernetes.io/hostname=ocp48-worker-0.demo.lab.shajmakh node-role.kubernetes.io/worker-cnf= Tolerations: node.kubernetes.io/memory-pressure:NoSchedule op=Exists node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 16s default-scheduler Successfully assigned performance-addon-operators-testing/oslat-b9862 to ocp48-worker-0.demo.lab.shajmakh Normal AddedInterface 15s multus Add eth0 [10.133.2.99/23] from openshift-sdn Normal Pulled 15s kubelet Container image "registry-proxy.engineering.redhat.com/rh-osbs/openshift4-cnf-tests:v4.9.0-3" already present on machine Normal Created 14s kubelet Created container oslat-runner Normal Started 14s kubelet Started container oslat-runner ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ As one can notice in the output of the test command , latency test has passed & by describing & logging the pod of the test, one can also see that it started properly & executed oslat with these arg "--duration" instead of "--runtime". Bulk closing of all "CNF Platform Validation" component BZs assigned to CNF Network team members and in VERIFIED status for longer than 1 month. |