Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1986589

Summary:	Latency testing pods should use all cpu balancing, irq balancing etc. annotations
Product:	OpenShift Container Platform	Reporter:	OpenShift BugZilla Robot <openshift-bugzilla-robot>
Component:	CNF Platform Validation	Assignee:	Talor Itzhak <titzhak>
Status:	CLOSED ERRATA	QA Contact:	Niranjan Mallapadi Raghavender <mniranja>
Severity:	high	Docs Contact:
Priority:	unspecified
Version:	4.8	CC:	alukiano, aos-bugs, grajaiya, shajmakh
Target Milestone:	---
Target Release:	4.7.z
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:	Cause: Latency testing pods were not configured with CPU balancing and IRQ balancing annotations. Consequence: Not disabling the load-balancing results with an additional workload on the pods` CPUs. Fix: Adding the missing annotations that will disable the load-balancing. Result: Disabling the load-balancing reduces the additional workload on the pods` CPUs.	Story Points:	---
Clone Of:		Environment:
Last Closed:	2022-02-21 10:19:48 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:	1986587
Bug Blocks:

Description OpenShift BugZilla Robot 2021-07-27 20:22:47 UTC

+++ This bug was initially created as a clone of Bug #1986399 +++

Description of problem:

oslat, cyclictest and hwlatdetect testing pods started using the procedure from https://docs.openshift.com/container-platform/4.7/scalability_and_performance/cnf-performance-addon-operator-for-low-latency-nodes.html#cnf-performing-end-to-end-tests-running-the-latency_tests need to disable cpu balancing and irq balancing on the used cpus.

The procedure is described in:

https://docs.openshift.com/container-platform/4.7/scalability_and_performance/cnf-performance-addon-operator-for-low-latency-nodes.html#performance-addon-operator-disabling-cpu-load-balancing-for-dpdk_cnf-master

and

https://docs.openshift.com/container-platform/4.7/scalability_and_performance/cnf-performance-addon-operator-for-low-latency-nodes.html#disabling_interrupt_processing_for_individual_pods_cnf-master


The annotations are defined in https://github.com/openshift-kni/performance-addon-operators/blob/master/functests/4_latency/latency.go#L272

Notice the annotation used the old value (true) instead of "disable" and there is no annotation for irq handling.


Version-Release number of selected component (if applicable):

master branch, all versions starting with 4.7

Comment 4 Shereen Haj Makhoul 2022-02-16 13:30:18 UTC

Verification:
 
Version:
cnf-tests: cnf-tests-container-v4.7.9-5
pao: registry.redhat.io/openshift4/performance-addon-rhel8-operator@sha256:3985bf8855808bfc6bd48527b9b9337530aaed84dc6aa439c689f498f1f64733

Steps:
podman run -v $(pwd)/:/kubeconfig:Z -e KUBECONFIG=/kubeconfig/kubeconfig -e IMAGE_REGISTRY=registry-proxy.engineering.redhat.com/rh-osbs/ -e CNF_TESTS_IMAGE=openshift4-cnf-tests:v4.7.9-5 -e LATENCY_TEST_RUN=true -e DISCOVERY_MODE=true -e ROLE_WORKER_CNF=worker-cnf -e LATENCY_TEST_CPUS=7 -e LATENCY_TEST_RUNTIME=100 -e MAXIMUM_LATENCY=20 registry-proxy.engineering.redhat.com/rh-osbs/openshift4-cnf-tests:v4.7.9-5  /usr/bin/test-run.sh -ginkgo.v -ginkgo.focus="oslat"

output of pod description:

Annotations:  cpu-load-balancing.crio.io: disable
              irq-load-balancing.crio.io: disable

..
    
Verified successfully.

Comment 6 errata-xmlrpc 2022-02-21 10:19:48 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.7.43 low-latency extras update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:0552