2024586 – Special Resource Operator(SRO) - Empty image in BuildConfig when using RT kernel

Bug 2024586 - Special Resource Operator(SRO) - Empty image in BuildConfig when using RT kernel

Summary: Special Resource Operator(SRO) - Empty image in BuildConfig when using RT kernel

Keywords:
Status:	CLOSED ERRATA
Alias:	None
Product:	OpenShift Container Platform
Classification:	Red Hat
Component:	Special Resource Operator
Sub Component:
Version:	4.10
Hardware:	Unspecified
OS:	Unspecified
Priority:	high
Severity:	high
Target Milestone:	---
Target Release:	4.10.0
Assignee:	Pablo Acevedo
QA Contact:	liqcui
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2021-11-18 12:01 UTC by Pablo Acevedo
Modified:	2022-03-10 16:29 UTC (History)
CC List:	3 users (show)
Fixed In Version:
Doc Type:	If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:	2022-03-10 16:29:22 UTC
Target Upstream Version:
Embargoed:

Attachments	(Terms of Use)

Links
System	ID	Private	Priority	Status	Summary	Last Updated
Github	openshift special-resource-operator pull 80	0	None	open	Bug 2024586: Special Resource Operator(SRO) - Empty image in BuildConfig when using RT kernel	2021-11-19 14:48:01 UTC
Red Hat Product Errata	RHSA-2022:0056	0	None	None	None	2022-03-10 16:29:38 UTC

Description Pablo Acevedo 2021-11-18 12:01:55 UTC

Description of problem:
If a recipe contains a BuildConfig, this will fail to build when trying to use the DTK image as a base, rendered empty from the SRO itself.


Version-Release number of selected component (if applicable):


How reproducible:
Install RT kernel in the nodes so that NFD updates label feature.node.kubernetes.io/kernel-version.full in each node.


Steps to Reproduce:
1. Install SRO and NFD
2. Install RT Kernel
3. Wait until labels are updated, then install simple-kmod SpecialResource

Actual results:
Failure to build kernel module in BuildConfig pod.


Expected results:
Successful build using DTK image with RT kernel headers.

Additional info:

Comment 2 liqcui 2021-12-24 08:24:42 UTC

Verified Result:
[ocpadmin@ec2-18-217-45-133 sro]$ oc get nodes -o wide
NAME                                         STATUS   ROLES              AGE   VERSION           INTERNAL-IP    EXTERNAL-IP   OS-IMAGE                                                        KERNEL-VERSION                         CONTAINER-RUNTIME
ip-10-0-141-177.us-east-2.compute.internal   Ready    worker,worker-rt   60m   v1.22.1+6859754   10.0.141.177   <none>        Red Hat Enterprise Linux CoreOS 410.84.202112230202-0 (Ootpa)   4.18.0-305.30.1.rt7.102.el8_4.x86_64   cri-o://1.23.0-98.rhaos4.10.git9b7f5ae.el8
ip-10-0-159-81.us-east-2.compute.internal    Ready    master             64m   v1.22.1+6859754   10.0.159.81    <none>        Red Hat Enterprise Linux CoreOS 410.84.202112230202-0 (Ootpa)   4.18.0-305.30.1.el8_4.x86_64           cri-o://1.23.0-98.rhaos4.10.git9b7f5ae.el8
ip-10-0-178-54.us-east-2.compute.internal    Ready    worker,worker-rt   60m   v1.22.1+6859754   10.0.178.54    <none>        Red Hat Enterprise Linux CoreOS 410.84.202112230202-0 (Ootpa)   4.18.0-305.30.1.rt7.102.el8_4.x86_64   cri-o://1.23.0-98.rhaos4.10.git9b7f5ae.el8
ip-10-0-187-239.us-east-2.compute.internal   Ready    master             66m   v1.22.1+6859754   10.0.187.239   <none>        Red Hat Enterprise Linux CoreOS 410.84.202112230202-0 (Ootpa)   4.18.0-305.30.1.el8_4.x86_64           cri-o://1.23.0-98.rhaos4.10.git9b7f5ae.el8
ip-10-0-201-31.us-east-2.compute.internal    Ready    worker,worker-rt   57m   v1.22.1+6859754   10.0.201.31    <none>        Red Hat Enterprise Linux CoreOS 410.84.202112230202-0 (Ootpa)   4.18.0-305.30.1.rt7.102.el8_4.x86_64   cri-o://1.23.0-98.rhaos4.10.git9b7f5ae.el8
ip-10-0-217-135.us-east-2.compute.internal   Ready    master             65m   v1.22.1+6859754   10.0.217.135   <none>        Red Hat Enterprise Linux CoreOS 410.84.202112230202-0 (Ootpa)   4.18.0-305.30.1.el8_4.x86_64           cri-o://1.23.0-98.rhaos4.10.git9b7f5ae.el8
[ocpadmin@ec2-18-217-45-133 sro]$ oc get clusterversion
NAME      VERSION                              AVAILABLE   PROGRESSING   SINCE   STATUS
version   4.10.0-0.nightly-2021-12-23-153012   True        False         53m     Cluster version is 4.10.0-0.nightly-2021-12-23-153012

[ocpadmin@ec2-18-217-45-133 sro]$ oc get pods -n simple-kmod
NAME                                                  READY   STATUS      RESTARTS   AGE
simple-kmod-driver-build-46e25a72d3f17f71-1-build     0/1     Completed   0          7m47s
simple-kmod-driver-container-46e25a72d3f17f71-895pj   1/1     Running     0          8m41s
simple-kmod-driver-container-46e25a72d3f17f71-vvh4h   1/1     Running     0          8m41s
simple-kmod-driver-container-46e25a72d3f17f71-zfqzq   1/1     Running     0          8m41s

Starting pod/ip-10-0-141-177us-east-2computeinternal-debug ...
To use host binaries, run `chroot /host`
simple_procfs_kmod     16384  0
simple_kmod            16384  0

Removing debug pod ...
ip-10-0-178-54.us-east-2.compute.internal
Starting pod/ip-10-0-178-54us-east-2computeinternal-debug ...
To use host binaries, run `chroot /host`
simple_procfs_kmod     16384  0
simple_kmod            16384  0

Removing debug pod ...
ip-10-0-201-31.us-east-2.compute.internal
Starting pod/ip-10-0-201-31us-east-2computeinternal-debug ...
To use host binaries, run `chroot /host`
simple_procfs_kmod     16384  0
simple_kmod            16384  0

Removing debug pod ...

 oc logs simple-kmod-driver-build-46e25a72d3f17f71-1-build -n simple-kmod
time="2021-12-24T08:13:48Z" level=info msg="Not using native diff for overlay, this may cause degraded performance for building images: kernel has CONFIG_OVERLAY_FS_REDIRECT_DIR enabled"
I1224 08:13:48.220955       1 defaults.go:102] Defaulting to storage driver "overlay" with options [mountopt=metacopy=on].
Caching blobs under "/var/cache/blobs".
Adding transient rw bind mount for /run/secrets/rhsm
STEP 1/22: FROM quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7eb20f03c406b0df8e99ba9aa6b77bfd64bdf6739248a6b94c232f723a6f99f6
Trying to pull quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7eb20f03c406b0df8e99ba9aa6b77bfd64bdf6739248a6b94c232f723a6f99f6...
Getting image source signatures
Copying blob sha256:eac1b95df832dc9f172fd1f07e7cb50c1929b118a4249ddd02c6318a677b506a
Copying blob sha256:a04b7c0c41a2968b466b90796f12af1c831eb4583030fe29804a2a04ab1bbc92
Copying blob sha256:47aa3ed2034c4f27622b989b26c06087de17067268a19a1b3642a7e2686cd1a3
Copying blob sha256:b5a1417a3d170799acc262f4eab5e88783817d4b39b120205ebe7015dfc02e53
Copying blob sha256:20a5ded15757b92c38add87268f58c4b384a406c6cc7eebb229c0fd140addcc2
Copying config sha256:f38819d5cdce32c8fff8a7e6e1fcb708a026b96184598ed32dad9ddd4af34010
Writing manifest to image destination
Storing signatures
STEP 2/22: WORKDIR /build/
--> e5a369b3eae
STEP 3/22: RUN yum -y install git
Updating Subscription Management repositories.
Unable to read consumer identity
Subscription Manager is operating in container mode.

This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register.

Red Hat Universal Base Image 8 (RPMs) - BaseOS  2.7 MB/s | 796 kB     00:00    
Red Hat Universal Base Image 8 (RPMs) - AppStre  10 MB/s | 2.6 MB     00:00    
Red Hat Universal Base Image 8 (RPMs) - CodeRea  96 kB/s |  16 kB     00:00    
Package git-2.27.0-1.el8.x86_64 is already installed.
Dependencies resolved.
Nothing to do.
Complete!
time="2021-12-24T08:14:27Z" level=warning msg="Adding metacopy option, configured globally"
--> f187202c9f4
STEP 4/22: ARG KMODVER
--> eeb73b19fc1
STEP 5/22: RUN git clone https://github.com/openshift-psap/simple-kmod.git
Cloning into 'simple-kmod'...
time="2021-12-24T08:14:33Z" level=warning msg="Adding metacopy option, configured globally"
--> 365438615a1
STEP 6/22: WORKDIR simple-kmod
--> 63d91fb601a
STEP 7/22: ARG KVER
--> 5cb9f846abf
STEP 8/22: RUN yum install -y make sudo
Updating Subscription Management repositories.
Unable to read consumer identity
Subscription Manager is operating in container mode.

This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register.

Last metadata expiration check: 0:00:14 ago on Fri Dec 24 08:14:26 2021.
Package make-1:4.2.1-10.el8.x86_64 is already installed.
Dependencies resolved.
================================================================================
 Package     Architecture  Version                    Repository           Size
================================================================================
Installing:
 sudo        x86_64        1.8.29-7.el8_4.1           ubi-8-baseos        925 k

Transaction Summary
================================================================================
Install  1 Package

Total download size: 925 k
Installed size: 3.4 M
Downloading Packages:
sudo-1.8.29-7.el8_4.1.x86_64.rpm                4.6 MB/s | 925 kB     00:00    
--------------------------------------------------------------------------------
Total                                           4.5 MB/s | 925 kB     00:00     
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                        1/1 
  Installing       : sudo-1.8.29-7.el8_4.1.x86_64                           1/1 
  Running scriptlet: sudo-1.8.29-7.el8_4.1.x86_64                           1/1 
  Verifying        : sudo-1.8.29-7.el8_4.1.x86_64                           1/1 
Installed products updated.

Installed:
  sudo-1.8.29-7.el8_4.1.x86_64                                                  

Complete!
time="2021-12-24T08:14:42Z" level=warning msg="Adding metacopy option, configured globally"
--> 67c74f660b5
STEP 9/22: RUN make buildprep KVER=${KVER} KMODVER=${KMODVER}
# elfutils-libelf-devel is needed on EL8 systems
sudo yum install -y gcc kernel-{core,devel,modules}-4.18.0-305.30.1.rt7.102.el8_4.x86_64 elfutils-libelf-devel
Updating Subscription Management repositories.
Unable to read consumer identity
Subscription Manager is operating in container mode.

This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register.

Last metadata expiration check: 0:00:24 ago on Fri Dec 24 08:14:26 2021.
Package gcc-8.4.1-1.el8.x86_64 is already installed.
No match for argument: kernel-core-4.18.0-305.30.1.rt7.102.el8_4.x86_64
No match for argument: kernel-devel-4.18.0-305.30.1.rt7.102.el8_4.x86_64
No match for argument: kernel-modules-4.18.0-305.30.1.rt7.102.el8_4.x86_64
Package elfutils-libelf-devel-0.182-3.el8.x86_64 is already installed.
Error: Unable to find a match: kernel-core-4.18.0-305.30.1.rt7.102.el8_4.x86_64 kernel-devel-4.18.0-305.30.1.rt7.102.el8_4.x86_64 kernel-modules-4.18.0-305.30.1.rt7.102.el8_4.x86_64
make: [Makefile:14: buildprep] Error 1 (ignored)
time="2021-12-24T08:14:51Z" level=warning msg="Adding metacopy option, configured globally"
--> 726b728a6cb
STEP 10/22: RUN make all       KVER=${KVER} KMODVER=${KMODVER}
make -C /lib/modules/4.18.0-305.30.1.rt7.102.el8_4.x86_64/build M=/build/simple-kmod EXTRA_CFLAGS=-DKMODVER=\\\"SRO\\\" modules
make[1]: Entering directory '/usr/src/kernels/4.18.0-305.30.1.rt7.102.el8_4.x86_64'
  CC [M]  /build/simple-kmod/simple-kmod.o
  CC [M]  /build/simple-kmod/simple-procfs-kmod.o
  Building modules, stage 2.
  MODPOST 2 modules
  CC      /build/simple-kmod/simple-kmod.mod.o
  LD [M]  /build/simple-kmod/simple-kmod.ko
  CC      /build/simple-kmod/simple-procfs-kmod.mod.o
  LD [M]  /build/simple-kmod/simple-procfs-kmod.ko
make[1]: Leaving directory '/usr/src/kernels/4.18.0-305.30.1.rt7.102.el8_4.x86_64'
gcc -o spkut ./simple-procfs-kmod-userspace-tool.c
time="2021-12-24T08:14:59Z" level=warning msg="Adding metacopy option, configured globally"
--> 66db6d537db
STEP 11/22: RUN make install   KVER=${KVER} KMODVER=${KMODVER}
sudo install -v -m 755 spkut /bin/
'spkut' -> '/bin/spkut'
sudo install -v -m 755 -d /lib/modules/4.18.0-305.30.1.rt7.102.el8_4.x86_64/
sudo install -v -m 644 simple-kmod.ko        /lib/modules/4.18.0-305.30.1.rt7.102.el8_4.x86_64/simple-kmod.ko
'simple-kmod.ko' -> '/lib/modules/4.18.0-305.30.1.rt7.102.el8_4.x86_64/simple-kmod.ko'
sudo install -v -m 644 simple-procfs-kmod.ko /lib/modules/4.18.0-305.30.1.rt7.102.el8_4.x86_64/simple-procfs-kmod.ko
'simple-procfs-kmod.ko' -> '/lib/modules/4.18.0-305.30.1.rt7.102.el8_4.x86_64/simple-procfs-kmod.ko'
sudo depmod -F /lib/modules/4.18.0-305.30.1.rt7.102.el8_4.x86_64/System.map 4.18.0-305.30.1.rt7.102.el8_4.x86_64
time="2021-12-24T08:15:10Z" level=warning msg="Adding metacopy option, configured globally"
--> 3be896807e1
STEP 12/22: WORKDIR /root/kvc-simple-kmod
--> 707a3cf82c1
STEP 13/22: ADD Makefile .
time="2021-12-24T08:15:15Z" level=warning msg="Adding metacopy option, configured globally"
--> 5e071c2c172
STEP 14/22: ADD simple-kmod-lib.sh .
time="2021-12-24T08:15:20Z" level=warning msg="Adding metacopy option, configured globally"
--> 08ed142ff3e
STEP 15/22: ADD simple-kmod-wrapper.sh .
time="2021-12-24T08:15:26Z" level=warning msg="Adding metacopy option, configured globally"
--> 415f49d1d2f
STEP 16/22: ADD simple-kmod.conf .
time="2021-12-24T08:15:31Z" level=warning msg="Adding metacopy option, configured globally"
--> 9a200fdedbd
STEP 17/22: RUN mkdir -p /usr/lib/kvc/
time="2021-12-24T08:15:36Z" level=warning msg="Adding metacopy option, configured globally"
--> c6be0c97fe8
STEP 18/22: RUN mkdir -p /etc/kvc/
time="2021-12-24T08:15:41Z" level=warning msg="Adding metacopy option, configured globally"
--> d52f5bbd776
STEP 19/22: RUN make install
install -v -m 644 simple-kmod-lib.sh /usr//lib/kvc/
'simple-kmod-lib.sh' -> '/usr//lib/kvc/simple-kmod-lib.sh'
install -v -m 644 simple-kmod.conf /etc/kvc/
'simple-kmod.conf' -> '/etc/kvc/simple-kmod.conf'
install -v -m 755 simple-kmod-wrapper.sh /usr//lib/kvc/
'simple-kmod-wrapper.sh' -> '/usr//lib/kvc/simple-kmod-wrapper.sh'
ln -sf ../lib/kvc/simple-kmod-wrapper.sh /usr//bin/spkut
time="2021-12-24T08:15:47Z" level=warning msg="Adding metacopy option, configured globally"
--> 81bf7527942
STEP 20/22: RUN systemctl enable kmods-via-containers@simple-kmod
Created symlink /etc/systemd/system/default.target.wants/kmods-via-containers → /etc/systemd/system/kmods-via-containers@.service.
time="2021-12-24T08:15:52Z" level=warning msg="Adding metacopy option, configured globally"
--> 09fa23cb514
STEP 21/22: ENV "OPENSHIFT_BUILD_NAME"="simple-kmod-driver-build-46e25a72d3f17f71-1" "OPENSHIFT_BUILD_NAMESPACE"="simple-kmod" "OPENSHIFT_BUILD_SOURCE"="https://github.com/openshift-psap/kvc-simple-kmod.git" "OPENSHIFT_BUILD_REFERENCE"="master" "OPENSHIFT_BUILD_COMMIT"="46e84d17fe41349384f6366e1aa99748e4d4c19c"
--> 0678d3512c7
STEP 22/22: LABEL "io.openshift.build.commit.author"="Zvonko Kaiser <zkaiser>" "io.openshift.build.commit.date"="Tue Jun 15 08:20:51 2021 +0000" "io.openshift.build.commit.id"="46e84d17fe41349384f6366e1aa99748e4d4c19c" "io.openshift.build.commit.message"="Adding FROM arg" "io.openshift.build.commit.ref"="master" "io.openshift.build.name"="simple-kmod-driver-build-46e25a72d3f17f71-1" "io.openshift.build.namespace"="simple-kmod" "io.openshift.build.source-location"="https://github.com/openshift-psap/kvc-simple-kmod.git"
COMMIT temp.builder.openshift.io/simple-kmod/simple-kmod-driver-build-46e25a72d3f17f71-1:1fc9206a
--> 3d6a309f537
Successfully tagged temp.builder.openshift.io/simple-kmod/simple-kmod-driver-build-46e25a72d3f17f71-1:1fc9206a
3d6a309f537935ce803c15ba24264ad8ef8f64762da4b818bf1759cd0653db3d

Pushing image image-registry.openshift-image-registry.svc:5000/simple-kmod/simple-kmod-driver-container:v4.18.0-305.30.1.rt7.102.el8_4.x86_64 ...
Getting image source signatures
Copying blob sha256:a04b7c0c41a2968b466b90796f12af1c831eb4583030fe29804a2a04ab1bbc92
Copying blob sha256:20a5ded15757b92c38add87268f58c4b384a406c6cc7eebb229c0fd140addcc2
Copying blob sha256:66c1facdaa394f1f3454d0b34d5a0904bedba0f9679f95e9969102010bddef5c
Copying blob sha256:b5a1417a3d170799acc262f4eab5e88783817d4b39b120205ebe7015dfc02e53
Copying blob sha256:47aa3ed2034c4f27622b989b26c06087de17067268a19a1b3642a7e2686cd1a3
Copying blob sha256:eac1b95df832dc9f172fd1f07e7cb50c1929b118a4249ddd02c6318a677b506a
Copying blob sha256:611ad475264841e2f92b8e0f785850443623a028af74c8729e04811265bbee11
Copying blob sha256:ea851500d54048809680ae0f3752590892811e92e506c6029a987a72e2f8564b
Copying blob sha256:0cbeb95d3b7f79012178ee8a43307bb226de783b268d441805209aa31a385d52
Copying blob sha256:0b20be36ea2e953b20d3fffb27f7ddcfeb349e6faf7e70a31faf81ebf745e4a1
Copying blob sha256:24ce401271a3b9a071dde29311502ef521f5d90df5a2b899099731f6693faa0e
Copying blob sha256:33a568039d18cb32033e6205483531aa20edfd5a3b529a3c11eaa436ec4eef86
Copying blob sha256:6147b59b3d0a34443d3feec46c7a3780df1476b41c1a42c0244ad653a30f827c
Copying blob sha256:fb99ddc2bfe9b25f31cd631f2069299c80432b3c2d932aeca3a4c2c2d074e555
Copying blob sha256:8c69f1c1adb008f9e5dce7b22a7e98acf8acbcfdcba93d5961e7c772f9694827
Copying blob sha256:8c70ff6f514cb065162a662869e9ad3332a7e66e5e1cc3c75438dc0a0e564a7d
Copying blob sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef
Copying blob sha256:38c4c6da675d6b228be2e4bca5cb6b110c3935f29d412dfc2ea3fcb23bec96f9
Copying blob sha256:d14b6c01efcac6790a05eb462d0ff65bb6d563c0fa6d56ab453e70d11cd9641c
Copying config sha256:3d6a309f537935ce803c15ba24264ad8ef8f64762da4b818bf1759cd0653db3d
Writing manifest to image destination
Storing signatures
Successfully pushed image-registry.openshift-image-registry.svc:5000/simple-kmod/simple-kmod-driver-container@sha256:0ce189d20546b0f773ea829acd0c1b157861da1055bc5ec7e8d99a2ef6e1eb12
Push successful

Comment 5 errata-xmlrpc 2022-03-10 16:29:22 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: OpenShift Container Platform 4.10.3 security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:0056

Note You need to log in before you can comment on or make changes to this bug.