RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 2037294 - fwupd regression / Failed to insert 'ipmi_si': No such device
Summary: fwupd regression / Failed to insert 'ipmi_si': No such device
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Linux 8
Classification: Red Hat
Component: fwupd
Version: CentOS Stream
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: rc
: ---
Assignee: Richard Hughes
QA Contact: Eirik Fuller
URL:
Whiteboard:
: 2044789 2052053 (view as bug list)
Depends On:
Blocks: 2065189
TreeView+ depends on / blocked
 
Reported: 2022-01-05 12:00 UTC by Leon Fauster
Modified: 2022-05-10 16:42 UTC (History)
18 users (show)

Fixed In Version: fwupd-1.7.4-2.el8
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 2065189 (view as bug list)
Environment:
Last Closed: 2022-05-10 15:24:15 UTC
Type: Bug
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker RHELPLAN-106865 0 None None None 2022-01-05 12:02:22 UTC
Red Hat Product Errata RHBA-2022:2056 0 None None None 2022-05-10 15:24:31 UTC

Description Leon Fauster 2022-01-05 12:00:11 UTC 
Description of problem:

Since the current update from 

systemd-udev-239-51.el8.x86_64

to

systemd-udev-239-51.el8_5.2.x86_64

following appears after booting

# systemctl list-units --state failed --no-legend
systemd-modules-load.service loaded failed failed Load Kernel Modules                   


# systemctl status systemd-modules-load.service 

● systemd-modules-load.service - Load Kernel Modules
   Loaded: loaded (/usr/lib/systemd/system/systemd-modules-load.service; static; vendor preset: disabled)
   Active: failed (Result: exit-code) since Wed 2022-01-05 12:30:41 CET; 11min ago
     Docs: man:systemd-modules-load.service(8)
           man:modules-load.d(5)
  Process: 1710 ExecStart=/usr/lib/systemd/systemd-modules-load (code=exited, status=1/FAILURE)
 Main PID: 1710 (code=exited, status=1/FAILURE)

Jan 05 12:30:41 work.localdomain systemd[1]: Starting Load Kernel Modules...
Jan 05 12:30:41 work.localdomain systemd-modules-load[1710]: Module 'msr' is builtin
Jan 05 12:30:41 work.localdomain systemd-modules-load[1710]: Failed to insert 'ipmi_si': No such device
Jan 05 12:30:41 work.localdomain systemd[1]: systemd-modules-load.service: Main process exited, code=exited, status=1/FAILURE
Jan 05 12:30:41 work.localdomain systemd[1]: systemd-modules-load.service: Failed with result 'exit-code'.
Jan 05 12:30:41 work.localdomain systemd[1]: Failed to start Load Kernel Modules.





Version-Release number of selected component (if applicable):
systemd-udev-239-51.el8_5.2.x86_64


How reproducible:
Steps to Reproduce:
1. yum update 
2. reboot
3. systemctl list-units --state failed --no-legend
4. systemctl status systemd-modules-load.service 


Actual results:
Failed systemd unit


Expected results:
No failed systemd unit 


Additional info:
Before update no problems.

Booting older kernel does not help. Same failed unit service.
Comment 1 Leon Fauster 2022-01-05 20:08:17 UTC 
With a downgrade from  

fwupd-1.7.1-1.el8.x86_64

to

fwupd-1.5.9-1.el8_4.x86_64 

the above mentioned behavior disappears.

I changed the component from systemd to fwupd
Comment 2 Leon Fauster 2022-01-07 09:54:45 UTC 
The newer fwupd package provides an additional kernel modules config file:


  cat /usr/lib/modules-load.d/fwupd-redfish.conf
  ipmi-si
  ipmi-devintf
Comment 3 Richard Hughes 2022-01-10 12:37:14 UTC 
Does ipmi-si.ko and ipmi-devintf.ko not present for you? Out of interest what kernel is installed?
Comment 4 Leon Fauster 2022-01-10 12:59:10 UTC 
The mentioned failure happened on a cloud instance and on a local workstation with standard kernel kernel-4.18.0-348.7.1.el8_5.x86_64

For both (cloud vm, bare metal):

# rpm -ql kernel-core-4.18.0-348.7.1.el8_5.x86_64 |egrep ipmi.*xz
/lib/modules/4.18.0-348.7.1.el8_5.x86_64/kernel/drivers/acpi/acpi_ipmi.ko.xz
/lib/modules/4.18.0-348.7.1.el8_5.x86_64/kernel/drivers/char/ipmi/ipmi_devintf.ko.xz
/lib/modules/4.18.0-348.7.1.el8_5.x86_64/kernel/drivers/char/ipmi/ipmi_msghandler.ko.xz
/lib/modules/4.18.0-348.7.1.el8_5.x86_64/kernel/drivers/char/ipmi/ipmi_poweroff.ko.xz
/lib/modules/4.18.0-348.7.1.el8_5.x86_64/kernel/drivers/char/ipmi/ipmi_si.ko.xz
/lib/modules/4.18.0-348.7.1.el8_5.x86_64/kernel/drivers/char/ipmi/ipmi_ssif.ko.xz
/lib/modules/4.18.0-348.7.1.el8_5.x86_64/kernel/drivers/char/ipmi/ipmi_watchdog.ko.xz

# lsmod |grep ipmi
ipmi_devintf           20480  0
ipmi_msghandler       110592  1 ipmi_devintf

# modprobe ipmi-si
modprobe: ERROR: could not insert 'ipmi_si': No such device


Someone else reported it also here:

https://forums.centos.org/viewtopic.php?f=54&t=78617
Comment 5 Richard Hughes 2022-01-10 13:56:24 UTC 
Fixed upstream in https://github.com/fwupd/fwupd/pull/4162
Comment 7 Eirik Fuller 2022-02-06 22:21:10 UTC 
*** Bug 2044789 has been marked as a duplicate of this bug. ***
Comment 8 Eirik Fuller 2022-02-08 03:51:19 UTC 
A freshly installed CentOS Stream 8 on a ThinkServer 140 reported the following output.


efuller@TS140 ~]$ rpm -q fwupd
fwupd-1.7.1-1.el8.x86_64
[efuller@TS140 ~]$ systemctl status systemd-modules-load
● systemd-modules-load.service - Load Kernel Modules
   Loaded: loaded (/usr/lib/systemd/system/systemd-modules-load.service; static; vendor preset: disabled)
   Active: failed (Result: exit-code) since Mon 2022-02-07 22:18:59 EST; 1min 5s ago
     Docs: man:systemd-modules-load.service(8)
           man:modules-load.d(5)
  Process: 1492 ExecStart=/usr/lib/systemd/systemd-modules-load (code=exited, status=1/FAILURE)
 Main PID: 1492 (code=exited, status=1/FAILURE)

Feb 07 22:18:59 TS140 systemd[1]: Starting Load Kernel Modules...
Feb 07 22:18:59 TS140 systemd-modules-load[1492]: Module 'msr' is builtin
Feb 07 22:18:59 TS140 systemd-modules-load[1492]: Failed to insert 'ipmi_si': No such device
Feb 07 22:18:59 TS140 systemd[1]: systemd-modules-load.service: Main process exited, code=exited, status=1/FAILURE
Feb 07 22:18:59 TS140 systemd[1]: systemd-modules-load.service: Failed with result 'exit-code'.
Feb 07 22:18:59 TS140 systemd[1]: Failed to start Load Kernel Modules.
[efuller@TS140 ~]$ 


The following command upgraded fwupd to a newer version.


[efuller@TS140 ~]$ sudo dnf -y install fwupd-1.7.4-1.el8.x86_64.rpm 
CentOS Stream 8 - Extras                                                                         23 kB/s |  17 kB     00:00    
Dependencies resolved.
================================================================================================================================
 Package                   Architecture               Version                            Repository                        Size
================================================================================================================================
Upgrading:
 fwupd                     x86_64                     1.7.4-1.el8                        @commandline                     3.4 M

Transaction Summary
================================================================================================================================
Upgrade  1 Package

Total size: 3.4 M
Downloading Packages:
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                                                                        1/1 
  Running scriptlet: fwupd-1.7.4-1.el8.x86_64                                                                               1/1 
  Upgrading        : fwupd-1.7.4-1.el8.x86_64                                                                               1/2 
  Running scriptlet: fwupd-1.7.4-1.el8.x86_64                                                                               1/2 
  Running scriptlet: fwupd-1.7.1-1.el8.x86_64                                                                               2/2 
  Cleanup          : fwupd-1.7.1-1.el8.x86_64                                                                               2/2 
  Running scriptlet: fwupd-1.7.1-1.el8.x86_64                                                                               2/2 
  Verifying        : fwupd-1.7.4-1.el8.x86_64                                                                               1/2 
  Verifying        : fwupd-1.7.1-1.el8.x86_64                                                                               2/2 

Upgraded:
  fwupd-1.7.4-1.el8.x86_64                                                                                                      

Complete!
[efuller@TS140 ~]$ 


After a reboot the same system reported the following output.


[efuller@TS140 ~]$ rpm -q fwupd
fwupd-1.7.4-1.el8.x86_64
[efuller@TS140 ~]$ systemctl status systemd-modules-load
● systemd-modules-load.service - Load Kernel Modules
   Loaded: loaded (/usr/lib/systemd/system/systemd-modules-load.service; static; vendor preset: disabled)
   Active: active (exited) since Mon 2022-02-07 22:31:14 EST; 2min 51s ago
     Docs: man:systemd-modules-load.service(8)
           man:modules-load.d(5)
  Process: 1295 ExecStart=/usr/lib/systemd/systemd-modules-load (code=exited, status=0/SUCCESS)
 Main PID: 1295 (code=exited, status=0/SUCCESS)
    Tasks: 0 (limit: 203392)
   Memory: 0B
   CGroup: /system.slice/systemd-modules-load.service

Feb 07 22:31:14 TS140 systemd-modules-load[1295]: Module 'msr' is builtin
Feb 07 22:31:14 TS140 systemd[1]: Started Load Kernel Modules.
[efuller@TS140 ~]$ dmesg | grep ipmi
[    1.186275] ipmi device interface
[    1.189873] ipmi_si: IPMI System Interface driver
[    1.189910] ipmi_si: Unable to find any System Interface(s)
[efuller@TS140 ~]$ 


The failed attempt to load the ipmi_si module no longer causes a systemd service failure, with the newer fwupd version.
Comment 9 Richard Hughes 2022-02-18 09:06:09 UTC 
*** Bug 2052053 has been marked as a duplicate of this bug. ***
Comment 13 Richard Hughes 2022-03-02 16:45:20 UTC 
> Perhaps a build without such conflicts can pass gating tests.

That failure is a false positive, the fwupd project swallowed up both the dbxtool and fwupdate packages a few years ago, and there are obsoletes+provides in place in the package.
Comment 19 Richard Hughes 2022-03-14 20:44:02 UTC 
Test builds here: http://people.redhat.com/rhughes/packages/fwupd/
Comment 23 Colin Walters 2022-03-21 15:20:24 UTC 
Somewhat related issue re s390x here https://github.com/openshift/os/issues/752 - Richard can you speak to that?
Comment 31 HuijingHei 2022-04-08 08:37:36 UTC 
Thanks Eirik for the confirmation. Fresh install with fwupd-1.7.4-2.el8.x86_64 using latest 8.6, no such issue

[core@cosa-devsh ~]$ rpm -q fwupd
fwupd-1.7.4-2.el8.x86_64
[core@cosa-devsh ~]$ dmesg | grep ipmi
[   10.817486] ipmi device interface
[   10.832478] systemd-modules-load[369]: Inserted module 'ipmi_devintf'

[core@cosa-devsh ~]$ cat /usr/lib/modules-load.d/fwupd-redfish.conf
ipmi-devintf
[core@cosa-devsh ~]$ systemctl status systemd-modules-load.service
● systemd-modules-load.service - Load Kernel Modules
   Loaded: loaded (/usr/lib/systemd/system/systemd-modules-load.service; static; vendor preset: disabled)
   Active: active (exited) since Fri 2022-04-08 08:28:43 UTC; 4min 7s ago
     Docs: man:systemd-modules-load.service(8)
           man:modules-load.d(5)
  Process: 1393 ExecStart=/usr/lib/systemd/systemd-modules-load (code=exited, status=0/SUCCESS)
 Main PID: 1393 (code=exited, status=0/SUCCESS)
    Tasks: 0 (limit: 5554)
   Memory: 0B
   CGroup: /system.slice/systemd-modules-load.service

Apr 08 08:28:42 localhost systemd-modules-load[1393]: Module 'msr' is builtin
Apr 08 08:28:43 localhost systemd[1]: Started Load Kernel Modules.
Comment 34 Eirik Fuller 2022-04-09 17:23:23 UTC 
Tests similar to the tests described in comment 8, with fwupd-1.7.4-2.el8, produced the following results.


[efuller@TS140 ~]$ uname -a
Linux TS140 4.18.0-365.el8.x86_64 #1 SMP Thu Feb 10 16:11:23 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
[efuller@TS140 ~]$ rpm -q fwupd
fwupd-1.7.1-1.el8.x86_64
[efuller@TS140 ~]$ journalctl | grep ipmi
Apr 09 12:43:58 TS140 kernel: ipmi device interface
Apr 09 12:43:58 TS140 kernel: ipmi_si: IPMI System Interface driver
Apr 09 12:43:58 TS140 kernel: ipmi_si: Unable to find any System Interface(s)
Apr 09 12:43:58 TS140 systemd-modules-load[329]: Failed to insert 'ipmi_si': No such device
Apr 09 12:44:25 TS140 kernel: ipmi_si: IPMI System Interface driver
Apr 09 12:44:25 TS140 kernel: ipmi_si: Unable to find any System Interface(s)
Apr 09 12:44:25 TS140 systemd-modules-load[1533]: Failed to insert 'ipmi_si': No such device
Apr 09 12:44:27 TS140 kernel: ipmi_si: IPMI System Interface driver
Apr 09 12:44:27 TS140 kernel: ipmi_si: Unable to find any System Interface(s)
Apr 09 12:44:27 TS140 systemd-modules-load[1647]: Failed to insert 'ipmi_si': No such device
[efuller@TS140 ~]$ sudo dnf -y install ./fwupd-1.7.4-2.el8.x86_64.rpm 
Last metadata expiration check: 0:02:58 ago on Sat 09 Apr 2022 12:50:53 PM EDT.
Dependencies resolved.
================================================================================================================================
 Package                   Architecture               Version                            Repository                        Size
================================================================================================================================
Upgrading:
 fwupd                     x86_64                     1.7.4-2.el8                        @commandline                     3.4 M

Transaction Summary
================================================================================================================================
Upgrade  1 Package

Total size: 3.4 M
Downloading Packages:
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                                                                        1/1 
  Running scriptlet: fwupd-1.7.4-2.el8.x86_64                                                                               1/1 
  Upgrading        : fwupd-1.7.4-2.el8.x86_64                                                                               1/2 
  Running scriptlet: fwupd-1.7.4-2.el8.x86_64                                                                               1/2 
  Running scriptlet: fwupd-1.7.1-1.el8.x86_64                                                                               2/2 
  Cleanup          : fwupd-1.7.1-1.el8.x86_64                                                                               2/2 
  Running scriptlet: fwupd-1.7.1-1.el8.x86_64                                                                               2/2 
  Verifying        : fwupd-1.7.4-2.el8.x86_64                                                                               1/2 
  Verifying        : fwupd-1.7.1-1.el8.x86_64                                                                               2/2 

Upgraded:
  fwupd-1.7.4-2.el8.x86_64                                                                                                      

Complete!
[efuller@TS140 ~]$ 


Multiple failures of the systemd-modules-load service are mentioned in that journalctl output.

The system was rebooted after the fwupd-1.7.4-2.el8 install, with the following results.


[efuller@TS140 ~]$ uname -a
Linux TS140 4.18.0-365.el8.x86_64 #1 SMP Thu Feb 10 16:11:23 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
[efuller@TS140 ~]$ rpm -q fwupd
fwupd-1.7.4-2.el8.x86_64
[efuller@TS140 ~]$ journalctl | grep ipmi
Apr 09 12:55:30 TS140 kernel: ipmi device interface
Apr 09 12:55:30 TS140 kernel: ipmi_si: IPMI System Interface driver
Apr 09 12:55:30 TS140 kernel: ipmi_si: Unable to find any System Interface(s)
Apr 09 12:55:30 TS140 systemd-modules-load[329]: Failed to insert 'ipmi_si': No such device
[efuller@TS140 ~]$ sudo dnf -y upgrade kernel
Last metadata expiration check: 0:06:36 ago on Sat 09 Apr 2022 12:50:53 PM EDT.
Dependencies resolved.
================================================================================================================================
 Package                           Architecture              Version                            Repository                 Size
================================================================================================================================
Installing:
 kernel                            x86_64                    4.18.0-373.el8                     baseos                    8.0 M
Installing dependencies:
 kernel-core                       x86_64                    4.18.0-373.el8                     baseos                     39 M
 kernel-modules                    x86_64                    4.18.0-373.el8                     baseos                     32 M

Transaction Summary
================================================================================================================================
Install  3 Packages

Total download size: 79 M
Installed size: 92 M
Downloading Packages:
(1/3): kernel-4.18.0-373.el8.x86_64.rpm                                                         6.3 MB/s | 8.0 MB     00:01    
(2/3): kernel-modules-4.18.0-373.el8.x86_64.rpm                                                  13 MB/s |  32 MB     00:02    
(3/3): kernel-core-4.18.0-373.el8.x86_64.rpm                                                     12 MB/s |  39 MB     00:03    
--------------------------------------------------------------------------------------------------------------------------------
Total                                                                                            22 MB/s |  79 MB     00:03     
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                                                                        1/1 
  Installing       : kernel-core-4.18.0-373.el8.x86_64                                                                      1/3 
  Running scriptlet: kernel-core-4.18.0-373.el8.x86_64                                                                      1/3 
  Installing       : kernel-modules-4.18.0-373.el8.x86_64                                                                   2/3 
  Running scriptlet: kernel-modules-4.18.0-373.el8.x86_64                                                                   2/3 
  Installing       : kernel-4.18.0-373.el8.x86_64                                                                           3/3 
  Running scriptlet: kernel-core-4.18.0-373.el8.x86_64                                                                      3/3 
  Running scriptlet: kernel-4.18.0-373.el8.x86_64                                                                           3/3 
  Verifying        : kernel-4.18.0-373.el8.x86_64                                                                           1/3 
  Verifying        : kernel-core-4.18.0-373.el8.x86_64                                                                      2/3 
  Verifying        : kernel-modules-4.18.0-373.el8.x86_64                                                                   3/3 

Installed:
  kernel-4.18.0-373.el8.x86_64          kernel-core-4.18.0-373.el8.x86_64          kernel-modules-4.18.0-373.el8.x86_64         

Complete!
[efuller@TS140 ~]$ 


With fwupd-1.7.4-2.el8 the systemd-modules-load service still failed, but just once, due to a lingering reference to ipmi_si in the initramfs image. The subsequent kernel upgrade eliminated that reference, as seen in the following results following another reboot.


[efuller@TS140 ~]$ uname -a
Linux TS140 4.18.0-373.el8.x86_64 #1 SMP Tue Mar 22 15:11:47 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
[efuller@TS140 ~]$ rpm -q fwupd
fwupd-1.7.4-2.el8.x86_64
[efuller@TS140 ~]$ journalctl | grep ipmi
Apr 09 13:00:43 TS140 kernel: ipmi device interface
Apr 09 13:00:43 TS140 systemd-modules-load[323]: Inserted module 'ipmi_devintf'
[efuller@TS140 ~]$ systemctl status systemd-modules-load
● systemd-modules-load.service - Load Kernel Modules
   Loaded: loaded (/usr/lib/systemd/system/systemd-modules-load.service; static; vendor preset: disabled)
   Active: active (exited) since Sat 2022-04-09 13:01:01 EDT; 2min 13s ago
     Docs: man:systemd-modules-load.service(8)
           man:modules-load.d(5)
  Process: 1217 ExecStart=/usr/lib/systemd/systemd-modules-load (code=exited, status=0/SUCCESS)
 Main PID: 1217 (code=exited, status=0/SUCCESS)
    Tasks: 0 (limit: 203401)
   Memory: 0B
   CGroup: /system.slice/systemd-modules-load.service

Apr 09 13:01:00 TS140 systemd-modules-load[1217]: Module 'msr' is builtin
Apr 09 13:01:01 TS140 systemd[1]: Started Load Kernel Modules.
[efuller@TS140 ~]$ 


The journalctl output mentions ipmi_devintf because this fix did not remove it from /usr/lib/modules-load.d/fwupd-redfish.conf, but unlike ipmi_si, ipmi_devintf does not cause a failure.

The kernel upgrade prevented the module load failure in the initramfs image. The dracut command can update existing initramfs images.

In summary, upgrading fwupd to 1.7.4-2.el8 eliminated the ipmi_si requirement, except in the initramfs image. A subsequent kernel upgrade or a manual dracut invocation prevents the earliest module load failure.
Comment 37 errata-xmlrpc 2022-05-10 15:24:15 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (fwupd bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:2056
Note You need to log in before you can comment on or make changes to this bug.