Bug 2022630

Summary: fail to install rhel9 on specific machine with error /dev/root does not exist
Product: Red Hat Enterprise Linux 9 Reporter: Jianlin Shi <jishi>
Component: dracutAssignee: Lukáš Nykrýn <lnykryn>
Status: CLOSED DUPLICATE QA Contact: qe-baseos-daemons
Severity: medium Docs Contact:
Priority: medium    
Version: 9.0CC: cooper, dracut-maint-list, dtardon, liali, mail, msalter, pbunyan, pvalena, sebastian.lipp, whissi, yama, yanghliu, yllam
Target Milestone: rc   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2022-03-21 01:33:23 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Jianlin Shi 2021-11-12 08:34:42 UTC
Description of problem:
fail to install rhel9 on specific machine with error /dev/root does not exist

Version-Release number of selected component (if applicable):
RHEL-9.0.0-20211110.7

How reproducible:
Always

Steps to Reproduce:
job: https://beaker.engineering.redhat.com/jobs/5995296
console log: http://lab-04.rhts.eng.pek2.redhat.com/beaker/logs/recipes/10963+/10963912/console.log

Actual results:
[  327.111697] dracut-initqueue[1476]: Warning: ############# Anaconda installer errors end ###############  
[  328.640486] dracut-initqueue[1476]: Warning: dracut-initqueue: timeout, still waiting for following initqueue hooks:  
[  328.641285] dracut-initqueue[1476]: Warning: /lib/dracut/hooks/initqueue/finished/devexists-\x2fdev\x2froot.sh: "[ -e "/dev/root" ]"  
[  328.642324] dracut-initqueue[1476]: Warning: /lib/dracut/hooks/initqueue/finished/kickstart.sh: "[ -e /tmp/ks.cfg.done ]"  
[  328.643352] dracut-initqueue[1476]: Warning: /lib/dracut/hooks/initqueue/finished/nm.sh: "[ -f /tmp/nm.done ]"  
[  328.644332] dracut-initqueue[1476]: Warning: /lib/dracut/hooks/initqueue/finished/wait_for_settle.sh: "[ -f /tmp/settle.done ]"  
[  328.645687] dracut-initqueue[1476]: Warning: dracut-initqueue: starting timeout scripts  
[  328.645805] dracut-initqueue[1476]: Warning: ############# Anaconda installer errors begin #############  
[  328.645860] dracut-initqueue[1476]: Warning: #                                                         #  
[  328.645906] dracut-initqueue[1476]: Warning: It seems that the boot has failed. Possible causes include  
[  328.645964] dracut-initqueue[1476]: Warning: missing inst.stage2 or inst.repo boot parameters on the  
[  328.646015] dracut-initqueue[1476]: Warning: kernel cmdline. Please verify that you have specified  
[  328.646060] dracut-initqueue[1476]: Warning: inst.stage2 or inst.repo.  
[  328.646135] dracut-initqueue[1476]: Warning: Please also note that the 'inst.' prefix is now mandatory.  
[  328.646167] dracut-initqueue[1476]: Warning: #                                                         #  
[  328.646201] dracut-initqueue[1476]: Warning: ####     Installer errors encountered during boot:     ####  
[  328.646246] dracut-initqueue[1476]: Warning: #                                                         #  
[  328.646282] dracut-initqueue[1476]: /lib/dracut/hooks/initqueue/timeout/50-anaconda-error-reporting.sh: line 19: /run/anaconda/initrd_errors.txt: No such file or directory  
[  328.646317] dracut-initqueue[1476]: Warning: #                                                         #  
[  328.646352] dracut-initqueue[1476]: Warning: ############# Anaconda installer errors end ###############  
[  329.651681] dracut-initqueue[1476]: Warning: Could not boot.  
         Starting         
Dracut Emergency Shell   
...  
Warning: /dev/root does not exisPress Enter for maintenance

Expected results:
installation pass

Additional info:

Comment 1 David Tardon 2021-11-18 09:19:14 UTC
Please add rd.debug to kernel command line and attach /run/initramfs/rdsosreport.txt here.

Comment 2 Jianlin Shi 2021-11-19 07:27:44 UTC
(In reply to David Tardon from comment #1)
> Please add rd.debug to kernel command line and attach
> /run/initramfs/rdsosreport.txt here.

the new job: https://beaker.engineering.redhat.com/recipes/10997847#installation
the console log: https://beaker.engineering.redhat.com/recipes/10997847/logs/console.log

Comment 3 Jianlin Shi 2021-11-24 06:08:08 UTC
Hi David,

any updates on the issue?

Comment 4 LiLiang 2022-01-11 07:45:54 UTC
I also saw the similar issue when installing rhel9 on bare metal aarch systems.

Is this the same problem?

Job: https://beaker.engineering.redhat.com/jobs/6179895

[  168.365449] dracut-initqueue[659]: Warning: dracut-initqueue: timeout, still waiting for following initqueue hooks: 
[  168.400315] dracut-initqueue[659]: Warning: /lib/dracut/hooks/initqueue/finished/devexists-\x2fdev\x2fmapper\x2frhel_gigabyte--r120--01-root.sh: "if ! grep -q After=remote-fs-pre.target /run/systemd/generator/systemd-cryptsetup@*.service 2>/dev/null; then 
[  168.450136] dracut-initqueue[659]:     [ -e "/dev/mapper/rhel_gigabyte--r120--01-root" ] 
[  168.480136] dracut-initqueue[659]: fi" 
[  168.520133] dracut-initqueue[659]: Warning: /lib/dracut/hooks/initqueue/finished/devexists-\x2fdev\x2frhel_gigabyte-r120-01\x2froot.sh: "[ -e "/dev/rhel_gigabyte-r120-01/root" ]" 
[  168.570114] dracut-initqueue[659]: Warning: /lib/dracut/hooks/initqueue/finished/devexists-\x2fdev\x2frhel_gigabyte-r120-01\x2fswap.sh: "[ -e "/dev/rhel_gigabyte-r120-01/swap" ]" 
[  168.620113] dracut-initqueue[659]: Warning: dracut-initqueue: starting timeout scripts 
[  210.270124] dracut-initqueue[659]: Warning: /lib/dracut/hooks/initqueue/finished/devexists-\x2fdev\x2frhel_gigabyte-r120-01\x2froot.sh: "[ -e "/dev/rhel_gigabyte-r120-01/root" ]" 
[  210.320126] dracut-initqueue[659]: Warning: /lib/dracut/hooks/initqueue/finished/devexists-\x2fdev\x2frhel_gigabyte-r120-01\x2fswap.sh: "[ -e "/dev/rhel_gigabyte-r120-01/swap" ]" 
[  210.360121] dracut-initqueue[659]: Warning: dracut-initqueue: starting timeout scripts 
[  210.724237] dracut-initqueue[659]: Warning: dracut-initqueue: timeout, still waiting for following initqueue hooks: 
[  210.760192] dracut-initqueue[659]: Warning: /lib/dracut/hooks/initqueue/finished/devexists-\x2fdev\x2fmapper\x2frhel_gigabyte--r120--01-root.sh: "if ! grep -q After=remote-fs-pre.target /run/systemd/generator/systemd-cryptsetup@*.service 2>/dev/null; then 
[  210.820144] dracut-initqueue[659]:     [ -e "/dev/mapper/rhel_gigabyte--r120--01-root" ] 
[  210.860135] dracut-initqueue[659]: fi" 
[  210.890123] d "[ -e "/dev/rhel_gigabyte-r120-01/root" ]" 
[  210.930127] dracut-initqueue[659]: Warning: /lib/dracut/hooks/initqueue/finished/devexists-\x2fdev\x2frhel_gigabyte-r120-01\x2fswap.sh: "[ -e "/dev/rhel_gigabyte-r120-01/swap" ]" 
[  210.970125] dracut-initqueue[659]: Warning: dracut-initqueue: starting timeout scripts 
[  211.355372] dracut-initqueue[659]: Warning: dracut-initqueue: timeout, still waiting for following initqueue hooks: 
[  211.390217] dracut-initqueue[659]: Warning: /lib/dracut/hooks/initqueue/finished/devexists-\x2fdev\x2fmapper\x2frhel_gigabyte--r120--01-root.sh: "if ! grep -q After=remote-fs-pre.target /run/systemd/generator/systemd-cryptsetup@*.service 2>/dev/null; then 
[  211.450145] dracut-initqueue[659]:     [ -e "/dev/mapper/rhel_gigabyte--r120--01-root" ] 
[  211.480148] dracut-initqueue[659]: fi" 
[  211.510162] dracut-initqueue[659]: Warning: /lib/dracut/hooks/initqueue/finished/devexists-\x2fdev\x2

Comment 5 PaulB 2022-02-02 15:03:32 UTC
All,
See the following BZ:
Bug 2043737 - [RHEL9] Warning: /dev/rhel_gigabyte-r120-${}/swap does not exist
https://bugzilla.redhat.com/show_bug.cgi?id=2043737#c7

Best,
pbunyan

Comment 6 Mark Salter 2022-03-17 17:46:34 UTC
cn88xx machines (gigabyte-120) need the following workarounds on command  line:

arm-smmu.disable_bypass=n
iommu.passthrough=1
initcall_blacklist=gtdt_sbsa_gwdt_init
kpti=0

Comment 7 PaulB 2022-03-21 01:33:23 UTC

*** This bug has been marked as a duplicate of bug 2043737 ***

Comment 8 Łukasz Posadowski 2022-05-31 17:44:58 UTC
I can confirm this issue, when booting installation media from usb stick on Lenovo Idea Pad 5 14ALc05 .

Comment 9 baaash 2022-07-23 00:35:44 UTC
Issue confirmed here too.  Trying to understand the sense in closing this bug as a duplicate of another bug and blocking access to the details of that bug we're referred to.

What's a fella to do?

Comment 10 Thomas Deutschmann 2022-08-14 03:16:18 UTC
FYI: I experienced a similar issue when trying to boot Fedora Server ISO via Peppercon/Raritan/Lantronix remote consoles which I reported in bug #2118028.

In my case the problem was caused by a bug in systemd-udevd and a fix is available, see https://github.com/systemd/systemd/pull/24309

Comment 11 Pavel Valena 2022-08-18 17:15:28 UTC
(In reply to baaash from comment #9)
> Issue confirmed here too.  Trying to understand the sense in closing this
> bug as a duplicate of another bug and blocking access to the details of that
> bug we're referred to.
> 
> What's a fella to do?

It's a kernel but in VERIFIED state. The fix should land in the next release (and C9s).

Comment 12 Pavel Valena 2022-08-18 17:15:58 UTC
(In reply to Pavel Valena from comment #11)
> (In reply to baaash from comment #9)
> > Issue confirmed here too.  Trying to understand the sense in closing this
> > bug as a duplicate of another bug and blocking access to the details of that
> > bug we're referred to.
> > 
> > What's a fella to do?
> 
> It's a kernel but in VERIFIED state. The fix should land in the next release
> (and C9s).

* kernel bug

Comment 13 yllam 2022-08-30 19:00:49 UTC
Is the next release to fixed this issue out yet?  Where can I download the latest release RHEL9 iso image?

Comment 14 Mark Salter 2022-08-31 17:10:45 UTC
The next release is not out yet. The fix is in centos stream and you can work around it in RHEL9 by adding kpti=0 to the kernel command line.