Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1986587

Summary:	Latency testing pods should use all cpu balancing, irq balancing etc. annotations
Product:	OpenShift Container Platform	Reporter:	OpenShift BugZilla Robot <openshift-bugzilla-robot>
Component:	CNF Platform Validation	Assignee:	Talor Itzhak <titzhak>
Status:	CLOSED ERRATA	QA Contact:	Niranjan Mallapadi Raghavender <mniranja>
Severity:	high	Docs Contact:
Priority:	unspecified
Version:	4.8	CC:	aos-bugs, shajmakh
Target Milestone:	---
Target Release:	4.8.z
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:	Cause: Latency testing pods were not configured with CPU balancing and IRQ balancing annotations. Consequence: Not disabling the load-balancing results with an additional workload on the pods` CPUs. Fix: Adding the missing annotations that will disable the load-balancing. Result: Disabling the load-balancing reduces the additional workload on the pods` CPUs.	Story Points:	---
Clone Of:		Environment:
Last Closed:	2021-11-30 12:29:56 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1986399
Bug Blocks:	1986589

Description OpenShift BugZilla Robot 2021-07-27 20:20:32 UTC

+++ This bug was initially created as a clone of Bug #1986399 +++

Description of problem:

oslat, cyclictest and hwlatdetect testing pods started using the procedure from https://docs.openshift.com/container-platform/4.7/scalability_and_performance/cnf-performance-addon-operator-for-low-latency-nodes.html#cnf-performing-end-to-end-tests-running-the-latency_tests need to disable cpu balancing and irq balancing on the used cpus.

The procedure is described in:

https://docs.openshift.com/container-platform/4.7/scalability_and_performance/cnf-performance-addon-operator-for-low-latency-nodes.html#performance-addon-operator-disabling-cpu-load-balancing-for-dpdk_cnf-master

and

https://docs.openshift.com/container-platform/4.7/scalability_and_performance/cnf-performance-addon-operator-for-low-latency-nodes.html#disabling_interrupt_processing_for_individual_pods_cnf-master


The annotations are defined in https://github.com/openshift-kni/performance-addon-operators/blob/master/functests/4_latency/latency.go#L272

Notice the annotation used the old value (true) instead of "disable" and there is no annotation for irq handling.


Version-Release number of selected component (if applicable):

master branch, all versions starting with 4.7

Comment 7 Shereen Haj Makhoul 2021-11-23 16:38:28 UTC

Verification
============
image:openshift4-cnf-tests:v4.8.4-2

podman run  -v $KUBECONFIG:/root/kubeconfig:Z -e KUBECONFIG=/root/kubeconfig -e IMAGE_REGISTRY=registry-proxy.engineering.redhat.com/rh-osbs/ -e CNF_TESTS_IMAGE=openshift4-cnf-tests:v4.8.4-2 -e PERF_TEST_PROFILE=performance -e ROLE_WORKER_CNF=worker-cnf -e LATENCY_TEST_RUN=true -e LATENCY_TEST_RUNTIME=20 -e LATENCY_TEST_CPUS=3  -e DISCOVERY_MODE=true registry-proxy.engineering.redhat.com/rh-osbs/openshift4-cnf-tests:v4.8.4-2 usr/bin/test-run.sh -ginkgo.focus="\[performance\]\ Latency\ Test" -ginkgo.v

From Oslat pod description:

Annotations:  cpu-load-balancing.crio.io: disable
              irq-load-balancing.crio.io: disable

As shown above, the annotation are updated now & crio is disabled.

Comment 9 errata-xmlrpc 2021-11-30 12:29:56 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.8.22 low-latency extras update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:4850