RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1414098 - tuned: RFE: allow profiles to add files to initrd image
Summary: tuned: RFE: allow profiles to add files to initrd image
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Linux 7
Classification: Red Hat
Component: tuned
Version: 7.4
Hardware: Unspecified
OS: Unspecified
high
unspecified
Target Milestone: rc
: ---
Assignee: Jaroslav Škarvada
QA Contact: Tereza Cerna
Lenka Kimlickova
URL:
Whiteboard:
Depends On:
Blocks: 1394932 1394965 1395899
TreeView+ depends on / blocked
 
Reported: 2017-01-17 18:23 UTC by Luiz Capitulino
Modified: 2017-08-01 12:32 UTC (History)
8 users (show)

Fixed In Version: tuned-2.8.0-1.el7
Doc Type: Release Note
Doc Text:
*tuned* now supports initrd overlays *tuned* now supports initrd overlays, which can extend default (Dracut) initrd images. It is supported by the bootloader plugin. The example shows typical usage in the Tuned profile: [bootloader] initrd_add_dir=${i:PROFILE_DIR}/overlay.img This adds the content of the overlay.img directory to the current initrd when the profile is activated.
Clone Of:
Environment:
Last Closed: 2017-08-01 12:32:51 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)
Initial patch (10.22 KB, patch)
2017-02-27 07:39 UTC, Jaroslav Škarvada 		no flags Details | Diff
Show Obsolete (1) View All


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2017:2102 0 normal SHIPPED_LIVE tuned bug fix and enhancement update 2017-08-01 16:07:33 UTC

Description Luiz Capitulino 2017-01-17 18:23:24 UTC 
The cpu-partitioning profile needs tuning parameters to be set at initrd time. Bugs bug 1394965 and bug 1395899 are examples of this.

To make this possible, tuned could implement a initrd module that allows profiles to add to initrd:

 1. Custom configuration files
 2. Scripts to be executed during initrd time

The Linux kernel and grub support the loading of multiple initrd images: when multiple initrd images are specified, they are unpacked on top of each other. This allows for tuned to create a very small initrd image containing only the additional files needed by the profile.

The script bellow is an example of this solution and was used to fix the two BZs mentioned above. It creates an initrd image called tuned-initrd.img containing the system.conf file and a dracut script to be run before udev:

=====
#!/bin/bash

initrd=/boot/tuned-initrd.img
systemd_path=etc/systemd
hook_path=usr/lib/dracut/hooks/pre-udev

tmpdir=$(mktemp -d)
echo $tmpdir

cd $tmpdir
mkdir -p $systemd_path
mkdir -p $hook_path

cp /etc/systemd/system.conf $systemd_path
cp /root/tmp/00-tuned-pre-udev.sh $hook_path

find . | cpio -H newc -o > $initrd
===

Here's the image contents after creation:

[root@rhel73-test boot]# lsinitrd tuned-initrd.img 
Image: tuned-initrd.img: 4.0K
========================================================================
Version: 

Arguments: 
dracut modules:
========================================================================
drwx------   4 root     root            0 Jan 17 12:58 .
drwxr-xr-x   3 root     root            0 Jan 17 12:58 etc
drwxr-xr-x   2 root     root            0 Jan 17 12:58 etc/systemd
-rw-r--r--   1 root     root         1488 Jan 17 12:58 etc/systemd/system.conf
drwxr-xr-x   3 root     root            0 Jan 17 12:58 usr
drwxr-xr-x   3 root     root            0 Jan 17 12:58 usr/lib
drwxr-xr-x   3 root     root            0 Jan 17 12:58 usr/lib/dracut
drwxr-xr-x   3 root     root            0 Jan 17 12:58 usr/lib/dracut/hooks
drwxr-xr-x   2 root     root            0 Jan 17 12:58 usr/lib/dracut/hooks/pre-udev
-rw-r--r--   1 root     root          263 Jan 17 12:58 usr/lib/dracut/hooks/pre-udev/00-tuned-pre-udev.sh
========================================================================
[root@rhel73-test boot]# 

After the image is created, the following line has to be *appended* to each initrd16 line in grub.cfg:

/tuned-initrd.img

Here's an example of the full initrd16 line:

initrd16 /initramfs-3.10.0-542.el7.x86_64.img /tuned-initrd.img

When the profile is disabled, all tuned has to do is to delete the tuned-initrd.img image and update the initrd16 line in grub.cfg.
Comment 3 Jaroslav Škarvada 2017-02-27 07:39:16 UTC 
Created attachment 1257964 [details]
Initial patch

It will also require grub2 patch to support grub2-mkconfig.
Comment 4 Luiz Capitulino 2017-02-28 14:29:04 UTC 
Cool. Do you have an example on how this can be used from profiles? And does RHEL7.4 has the needed grub2 patch?
Comment 5 Jaroslav Škarvada 2017-03-01 13:37:33 UTC 
(In reply to Luiz Capitulino from comment #4)
> Cool. Do you have an example on how this can be used from profiles? And does
> RHEL7.4 has the needed grub2 patch?

Regarding the grub I filled bug 1427899. I think at the moment it's not show stopper for us, just a minor annoyance.

I.e. it should now patch grub.cfg correctly, but if user later runs e.g.:

# grub2-mkconfig -o /boot/grub2/grub.cfg

it will lost the initrd tuning. The bug 1427899 tries to address this problem. Proposed Tuned patch counts with this RFE and if the grub2 RFE patch gets merged it should start working automagically.

Also I didn't introduced new initrd module, but just extended the bootloader module which turned out to be better way.

I will post usage examples later today.
Comment 6 Luiz Capitulino 2017-03-01 14:18:15 UTC 
OK, changing the BZ subject to reflect that.
Comment 7 Jaroslav Škarvada 2017-03-01 15:20:05 UTC 
This is upstream commit adding the functionality:
https://github.com/redhat-performance/tuned/commit/047a7335b02c15d2fa4f347e9c1627a79e3a86a8

I am running regression tests now, but feel free to test, I am going to provide testing Tuned builds today.

How to use it:
The bootloader plugin now supports the following options:
  initrd_add_img=IMAGE
  initrd_add_dir=DIR
  initrd_dst_img=PATHNAME

The 'initrd_add_img' adds initrd overlay named IMAGE. The IMAGE is
added from the current profile directory. If IMAGE begins with '/' it's
taken as absolute path (e.g. initrd_add_img="/root/overlay.img").

The 'initrd_add_dir' creates initrd image from the DIR and then
adds the image as a overlay. The DIR is taken from the current profile
directory. If DIR begins with '/' it's taken as absolute path.

The 'initrd_dst_img' sets the name and location of the resulting initrd
image. Usually it is not needed to set it. By default the location of
initrd images is /boot and the name of the image is taken as a basename
of IMAGE or DIR. This can be overridden by 'initrd_dst_img'. If the PATHNAME doesn't begin with '/' it will set only the image name, not the full path (i.e. it will still use the /boot as a target directory).

Example:
# cd tuned-profile
# mkdir -p tuned-overlay.img/etc
# cd tuned-overlay.img/etc
# touch test.conf

Tuned profile:
[bootloader]
initrd_add_dir=tuned-overlay.img

It will build the initrd image containing the overlay and will add it to the grub.

Regarding /etc/systemd/system.conf and the second related problem I am going to comment in respective bugs.
Comment 8 Jaroslav Škarvada 2017-03-01 15:59:55 UTC 
Functionality should be provided by following (nightly) build:
tuned-2.7.1-1.20170301git1ba523b1.el7

available from the testing repo:
https://jskarvad.fedorapeople.org/tuned/devel/repo/
Comment 9 Luiz Capitulino 2017-03-06 19:14:36 UTC 
This is working like a charm for me. Thanks a lot!
Comment 13 Tereza Cerna 2017-04-12 09:01:51 UTC 
Sorry, I mistook bug and comments #11 and #12 are invalid.
Comment 14 Pei Zhang 2017-04-24 12:29:10 UTC 
Seems no info is needed from me, cancel the needinfo.
Comment 15 Tereza Cerna 2017-05-15 09:02:46 UTC 
Ahoj Jardo,
I see some problem according mentioned behavior from comment #7:

GOOD BEHAVIOR:
==============
# cat /usr/lib/tuned/tuned-profile/tuned.conf 
[bootloader]
initrd_add_dir=/usr/lib/tuned/tuned-profile/tuned-overlay.img
# tuned-adm profile tuned-profile
# cat /var/log/tuned/tuned.log
...
2017-05-15 04:48:12,004 INFO     tuned.profiles.loader: loading profile: tuned-profile
2017-05-15 04:48:12,004 INFO     tuned.daemon.daemon: starting tuning
2017-05-15 04:48:12,007 INFO     tuned.plugins.plugin_bootloader: generating initrd image from directory '/usr/lib/tuned/tuned-profile/tuned-overlay.img'
2017-05-15 04:48:12,014 INFO     tuned.plugins.plugin_bootloader: installing initrd image as '/boot/tuned-overlay.img'
2017-05-15 04:48:12,027 INFO     tuned.daemon.daemon: static tuning from profile 'tuned-profile' applied

>> There is used absolute path to initrd image in tuned.conf and work as expected.

BAD BEHAVIOR:
=============
# cat /usr/lib/tuned/tuned-profile/tuned.conf 
[bootloader]
initrd_add_dir=tuned-overlay.img
# tuned-adm profile tuned-profile
# cat /var/log/tuned/tuned.log
...
2017-05-15 04:54:26,579 INFO     tuned.profiles.loader: loading profile: tuned-profile
2017-05-15 04:54:26,580 INFO     tuned.daemon.daemon: starting tuning
2017-05-15 04:54:26,581 ERROR    tuned.plugins.plugin_bootloader: error: cannot create initrd image, source directory 'tuned-overlay.img' doesn't exist
2017-05-15 04:54:26,581 INFO     tuned.daemon.daemon: static tuning from profile 'tuned-profile' applied

>> There is not used aboslute path to initrd image in tuned.conf and I see ERROR which should not be there.

More info:
==========
# find /usr/lib/tuned/tuned-profile
/usr/lib/tuned/tuned-profile
/usr/lib/tuned/tuned-profile/tuned-overlay.img
/usr/lib/tuned/tuned-profile/tuned-overlay.img/etc
/usr/lib/tuned/tuned-profile/tuned-overlay.img/etc/test.conf
/usr/lib/tuned/tuned-profile/tuned.conf
Comment 16 Jaroslav Škarvada 2017-05-15 09:42:05 UTC 
(In reply to Tereza Cerna from comment #15)
> Ahoj Jardo,
> I see some problem according mentioned behavior from comment #7:
> 
> GOOD BEHAVIOR:
> ==============
> # cat /usr/lib/tuned/tuned-profile/tuned.conf 
> [bootloader]
> initrd_add_dir=/usr/lib/tuned/tuned-profile/tuned-overlay.img
> # tuned-adm profile tuned-profile
> # cat /var/log/tuned/tuned.log
> ...
> 2017-05-15 04:48:12,004 INFO     tuned.profiles.loader: loading profile:
> tuned-profile
> 2017-05-15 04:48:12,004 INFO     tuned.daemon.daemon: starting tuning
> 2017-05-15 04:48:12,007 INFO     tuned.plugins.plugin_bootloader: generating
> initrd image from directory '/usr/lib/tuned/tuned-profile/tuned-overlay.img'
> 2017-05-15 04:48:12,014 INFO     tuned.plugins.plugin_bootloader: installing
> initrd image as '/boot/tuned-overlay.img'
> 2017-05-15 04:48:12,027 INFO     tuned.daemon.daemon: static tuning from
> profile 'tuned-profile' applied
> 
> >> There is used absolute path to initrd image in tuned.conf and work as expected.
> 
> BAD BEHAVIOR:
> =============
> # cat /usr/lib/tuned/tuned-profile/tuned.conf 
> [bootloader]
> initrd_add_dir=tuned-overlay.img
> # tuned-adm profile tuned-profile
> # cat /var/log/tuned/tuned.log
> ...
> 2017-05-15 04:54:26,579 INFO     tuned.profiles.loader: loading profile:
> tuned-profile
> 2017-05-15 04:54:26,580 INFO     tuned.daemon.daemon: starting tuning
> 2017-05-15 04:54:26,581 ERROR    tuned.plugins.plugin_bootloader: error:
> cannot create initrd image, source directory 'tuned-overlay.img' doesn't
> exist
> 2017-05-15 04:54:26,581 INFO     tuned.daemon.daemon: static tuning from
> profile 'tuned-profile' applied
> 
> >> There is not used aboslute path to initrd image in tuned.conf and I see ERROR which should not be there.
> 
> More info:
> ==========
> # find /usr/lib/tuned/tuned-profile
> /usr/lib/tuned/tuned-profile
> /usr/lib/tuned/tuned-profile/tuned-overlay.img
> /usr/lib/tuned/tuned-profile/tuned-overlay.img/etc
> /usr/lib/tuned/tuned-profile/tuned-overlay.img/etc/test.conf
> /usr/lib/tuned/tuned-profile/tuned.conf

Comment 7 is not up-to-date. We changed and consolidated the behaviour, you need to use the internal variable PROFILE_DIR, i.e.:

initrd_add_dir=${i:PROFILE_DIR}/tuned-overlay.img

It simplified the code and improved inheritance functionality. Also it's now clear from where the image is created.
Comment 19 Tereza Cerna 2017-05-24 12:57:33 UTC 
Tested manually and with new test case /CoreOS/tuned/Regression/support-of-initrd-image-in-tuned-profiles.

I tested this bootloader parameters:
  * initrd_add_img
  * initrd_add_dir
  * initrd_dst_img
  * initrd_remove_dir
and basic functionality works well. -> VERIFIED

I found some small problems which were not in specification. See BZ#1454340 and BZ#1455161.
Comment 21 errata-xmlrpc 2017-08-01 12:32:51 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:2102
Note You need to log in before you can comment on or make changes to this bug.