Bug 2427945 - grub2-efi-x64 2.12-50.fc44 boots to GRUB command line (grub>) instead of menu (UEFI, ESP vfat, btrfs root, no separate /boot) [NEEDINFO]
Summary: grub2-efi-x64 2.12-50.fc44 boots to GRUB command line (grub>) instead of menu...
Keywords:
Status: NEW
Alias: None
Product: Fedora
Classification: Fedora
Component: grub2
Version: rawhide
Hardware: Unspecified
OS: Linux
unspecified
medium
Target Milestone: ---
Assignee: Nicolas Frayer
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2026-01-08 15:10 UTC by Mikhail
Modified: 2026-02-09 17:03 UTC (History)
10 users (show)

Fixed In Version:
Clone Of:
Environment:
Last Closed:
Type: ---
Embargoed:
awilliam: needinfo? (obiwankenobi23)
awilliam: needinfo? (joshua)


Attachments (Terms of Use)
boot screen photo (678.16 KB, image/jpeg)
2026-01-08 15:39 UTC, Mikhail
no flags Details
Photo of results `echo $root`, `echo $prefix` and `ls` (884.49 KB, image/jpeg)
2026-01-08 20:09 UTC, Mikhail
no flags Details
Photo of results `echo $root`, `echo $prefix` and `ls` - second computer (701.60 KB, image/jpeg)
2026-01-09 07:48 UTC, Mikhail
no flags Details
frame with error message (597.57 KB, image/jpeg)
2026-01-09 21:23 UTC, Mikhail
no flags Details
video demonstration (16.00 MB, video/mp4)
2026-01-12 21:04 UTC, Mikhail
no flags Details
video demonstration (15.18 MB, video/mp4)
2026-01-13 21:19 UTC, Mikhail
no flags Details
journal (111.84 KB, application/gzip)
2026-01-26 13:15 UTC, Katerina Koukiou
no flags Details

Description Mikhail 2026-01-08 15:10:52 UTC
Summary:
grub2-efi-x64 2.12-50.fc44 upgrade drops to GRUB command line (grub>) instead of showing menu (UEFI, btrfs root, no separate /boot)

Description:
After upgrading grub2 packages from 1:2.12-48.fc44 to 1:2.12-50.fc44 on Fedora rawhide, the system becomes unbootable.
On reboot, shim loads grub, GRUB starts (shows "GRUB version 2.12") but drops directly to the GRUB command line prompt "grub>" (no GRUB menu). Photo attached.

This happens before the kernel is started.

This system uses UEFI, ESP on vfat mounted at /boot/efi, and btrfs root. There is no separate /boot partition.

Repro steps:
1) Start from a working state with grub2-* 1:2.12-48.fc44.
2) Upgrade grub2 packages to 1:2.12-50.fc44 (e.g. `dnf upgrade --refresh`).
   This corresponds to dnf transaction ID 465 (see below).
3) Reboot.

Actual result:
GRUB starts but immediately drops to `grub>` prompt (no menu).

Expected result:
Normal GRUB menu appears and Fedora boots.

dnf history evidence:
- Transaction 465 (2026-01-08 09:48:13): `dnf upgrade --refresh`
  Upgraded grub2-* from 1:2.12-48.fc44 to 1:2.12-50.fc44 (rawhide):
  grub2-common, grub2-tools, grub2-tools-efi, grub2-tools-extra, grub2-tools-minimal,
  grub2-pc, grub2-pc-modules, grub2-efi-x64, grub2-efi-x64-modules, grub2-efi-x64-cdboot,
  grub2-efi-ia32, grub2-efi-ia32-modules, grub2-efi-ia32-cdboot, etc.

Workaround:
Downgrading grub2 back to 1:2.12-48.fc44 restores boot:
- Transaction 468 (2026-01-08 10:44:34): `dnf downgrade grub2` (back to 2.12-48.fc44 from local-repo)
- Transaction 469 (2026-01-08 11:30:05): `dnf reinstall grub2*`

Boot setup:
- UEFI boot entry points to \EFI\fedora\shimx64.efi:
  Boot0000* Fedora ... \EFI\fedora\shimx64.efi
- ESP: /dev/nvme1n1p1 (vfat, UUID=4307-D37D) mounted at /boot/efi
- Root: /dev/nvme1n1p3 (btrfs, UUID=b4996eda-3a45-4f45-ad59-be0bac273396) mounted at /
- /home on separate btrfs device (/dev/nvme0n1)
- No separate /boot partition

ESP stub config:
`/boot/efi/EFI/fedora/grub.cfg` contains:
  search --no-floppy --root-dev-only --fs-uuid --set=dev b4996eda-3a45-4f45-ad59-be0bac273396
  set prefix=($dev)/boot/grub2
  export $prefix
  configfile $prefix/grub.cfg

Main GRUB config exists:
- /boot/grub2/grub.cfg (generated by grub2-mkconfig)

Packages (current working / after downgrade):
- shim-x64-16.1-5.x86_64
- grub2-common-2.12-48.fc44.noarch
- grub2-efi-x64-2.12-48.fc44.x86_64
- grub2-efi-x64-modules-2.12-48.fc44.noarch
- grub2-tools-2.12-48.fc44.x86_64
- grub2-tools-efi-2.12-48.fc44.x86_64
- grub2-tools-minimal-2.12-48.fc44.x86_64
- grub2-tools-extra-2.12-48.fc44.x86_64
- grub2-pc-2.12-48.fc44.x86_64
- grub2-pc-modules-2.12-48.fc44.noarch
- systemd-259-1.fc44.x86_64
- kernels:
  kernel-core-6.18.0-65.fc44.x86_64
  kernel-core-6.18.0-0.rc7.251128ge538109ac71d.62.fc44.x86_64
  kernel-core-6.18.0-0.rc7.251129g19eef1d98eed.63.fc44.x86_64

File ownership / verification:
- rpm -qf /boot/efi/EFI/fedora/shimx64.efi -> shim-x64-16.1-5.x86_64
- rpm -qf /boot/efi/EFI/fedora/grubx64.efi -> grub2-efi-x64-2.12-48.fc44.x86_64
- rpm -V shim-x64 grub2-efi-x64 grub2-common -> no output (no modifications)

Notes / suspicion:
The ESP stub uses `export $prefix`. If grub2-2.12-50 changed script parsing/behavior, this line may now fail and prevent `configfile $prefix/grub.cfg` from being executed, resulting in dropping to the `grub>` prompt. Please advise if this should be `export prefix` or if the stub should be regenerated/updated during the upgrade.

Reproducible: Always

Comment 1 Mikhail 2026-01-08 15:39:29 UTC
Created attachment 2121510 [details]
boot screen photo

Comment 2 Leo Sandoval 2026-01-08 15:58:01 UTC
Hi Mikhail,

I am quite surprise for this issue: we had a 'test day' specially for the this change (well, there are two changes really, [50] and [49]) as you can see here [1]. What we really test on the test day was [49].

Before going into the debugging, can you please go ahead and do your testing asked in [1]? Perhaps you are the unlucky one having old firmware which may be affected by this change. Make sure you add your results onto [2] or directly on this ticket.

(btw, We may close this ticket and instead work on https://bugzilla.redhat.com/show_bug.cgi?id=2263643 , the long standing ticket for this issue, but perhaps this is a different issue)

[1] https://fedoraproject.org/wiki/Test_Day:2025-12-15_GRUB_out_of_memory_verification
[2] https://testdays.fedoraproject.org/testday/11

[50] https://src.fedoraproject.org/rpms/grub2/c/85de859da1331046d29ffda9f1aac33d93da8457?branch=rawhide
[49] https://src.fedoraproject.org/rpms/grub2/c/16cb5b303d06825e8b36b5ca5e195e811d047bd1?branch=rawhide

Comment 3 Marta Lewandowska 2026-01-08 16:20:59 UTC
Mikhail, from the grub prompt, could you also please `echo $root` and `echo $prefix` and perhaps `ls` and post the output of those commands? thanks.
Do you see an error before it fails?

Comment 4 Mikhail 2026-01-08 20:09:32 UTC
Created attachment 2121547 [details]
Photo of results `echo $root`, `echo $prefix` and `ls`

Hi Leo, Marta!

I joined the `Test Day` and my system successfully booted from `05673235-Fedora-Workstation-Live-x86_64-139891207.iso`.

I also added my results to [2]:

- ASUS ROG STRIX B650E-I GAMING WIFI: https://pastebin.com/LyEgRq0q
- ASROCK B650I Lightning WiFi: https://pastebin.com/rjPJMF8f

> Mikhail, from the grub prompt, could you also please echo $root and echo $prefix and perhaps ls and post the output of those commands?

See the attached photo. In short:

- echo $root -> hd1
- echo $prefix -> (hd1)/EFI/fedora
- ls prints repeated errors:
.../grub-core/disk/efi/efidisk.c:grub_efidisk_read:625: failure reading sector ... from 'hd0'/'hd1'

> Do you see an error before it fails?

I did not notice any error message before it drops to the grub> prompt. The errors above only appear when running ls at the GRUB prompt.

Comment 5 Mikhail 2026-01-09 07:48:13 UTC
Created attachment 2121601 [details]
Photo of results `echo $root`, `echo $prefix` and `ls`  - second computer

Small update: I can reproduce the exact same failure on a second machine (ASROCK B650I Lightning WiFi) as well. This looks like a general regression rather than a single-system quirk.

Comment 6 Leo Sandoval 2026-01-09 17:36:22 UTC
Thanks Mikhail for quickly showing us log. 

We do not understand two things: 

1- why on the test day the fix work fine and not this time? 
2- why $prefix has that value which is apparently wrong? 

we believe the partition table being read is wrong so ls is showing those sector errors and showing no partitions.

This is the action plan:

Please start again with a bootable system (grub2-2.12-48), then update first to the -49 scratch (see below)
and boot. Does it boot? it is expected to boot as the test day basically contained this change.
Then try the -50 scratch, update and reboot. Also, before rebooting after an update, make sure you enable the grub debugging
with (we are mostly interested in the log's tail but if you can get more log, better)

  grub2-editenv - set debug=all,-lexer,-scripting

this is done from a running fedora system, not the grub prompt.

Two scratch builds (non signed builds so disable secure boot from the firmware settings, in theory SB is not playing a role here),
- 2.12-49 (OOM Fix)  https://koji.fedoraproject.org/koji/taskinfo?taskID=140906146
- 2.12-50 without the OOM fix (2.12-49) but the -50 change included https://koji.fedoraproject.org/koji/taskinfo?taskID=140906368

Comment 7 Mikhail 2026-01-09 21:23:00 UTC
Created attachment 2121660 [details]
frame with error message

Hi Leo, Marta,

Update on your action plan:

- Starting from a bootable state with grub2-2.12-48, upgrading to the 2.12-49 scratch build (task 140906146) is already enough to reproduce the failure.
- After installing grub2*-1:2.12-49.fc44 and rebooting, the system drops to the `grub>` prompt again (same behavior as with 2.12-50).

I enabled GRUB debugging as requested:
  grub2-editenv - set debug=all,-lexer,-scripting
but it did not add much in practice. The only debug line I managed to capture on video is in the attached screenshot (frame_000121.jpg). My phone can only record at 60 fps, so most of the output scrolls by too fast.

The captured line is:
  .../grub-core/disk/efi/efidisk.c:grub_efidisk_read:625: failure reading ...

So the regression seems to start with the 2.12-49 build already.

Comment 8 Mark Grgurev 2026-01-10 13:58:23 UTC
I'm having the same exact same issue. I actually tried to downgrade my grub2 packages after chrooting in to my install but it says  I already have the lowest version of the package installed so that doesn't appear to be any option for me.

The only thing I can really add is that I was trying to work through the issue with ChatGPT yesterday and at some point after running `insmod btrfs`, `ls` suddenly worked without throwing "failure reading sector 0x0" errors. At that point I was able to point it to the config which brought up the bootloader and I was able to get into my Rawhide install. Within the install I decided to run another 'dnf reinstall grub2*` just to see if something different happened but when I rebooted I wasn't able to get back in. `insmod btrfs` didn't made ls work anymore. Running `insmod nvme` threw up a "failure reading sector 0x0` again but for only one of my drives. On subsequent reboots, that same command produced no errors which makes me think `insmod btrfs` didn't do anything. So whatever is wrong isn't even consistent between boots.

Comment 9 Mikhail 2026-01-10 15:38:39 UTC
> I already have the lowest version of the package installed so that doesn't appear to be any option for me.

If `dnf downgrade grub2*` says “lowest version”, it just means older grub2 is no longer available in your enabled repos.

You can still install an older build directly from Koji:

1) Install koji client:
   sudo dnf install -y koji

2) Download the older Fedora 44 build (example: grub2-2.12-48.fc44):
   mkdir -p ~/koji/grub2-2.12-48 && cd ~/koji/grub2-2.12-48
   koji download-build --arch=x86_64 --arch=noarch grub2-2.12-48.fc44

3) Install/downgrade from the local RPMs:
   sudo dnf downgrade --disablerepo='*' ./*.rpm
   # (or: sudo dnf install --allowerasing --disablerepo='*' ./*.rpm)

Then reboot.

Comment 10 Mark Grgurev 2026-01-10 16:48:33 UTC
Thank you! I didn't know how to find the older packages to install locally or I would have tried earlier. That worked.

Obviously now that I have a way to return to a working state, I can go back to the broken package if you could use additional testing to figure out what the actual issue is.

Comment 11 Joshua Strobl 2026-01-10 20:59:24 UTC
I can confirm I was impacted by this too.

Upgrade  grub2-common-1:2.12-50.fc44.noarch                        Dependency      rawhide
  Upgrade  grub2-tools-minimal-1:2.12-50.fc44.x86_64                 Dependency      rawhide
  Upgrade  grub2-tools-extra-1:2.12-50.fc44.x86_64                   Group           rawhide
  Upgrade  grub2-tools-efi-1:2.12-50.fc44.x86_64                     Group           rawhide
  Upgrade  grub2-tools-1:2.12-50.fc44.x86_64                         Group           rawhide
  Upgrade  grub2-pc-modules-1:2.12-50.fc44.noarch                    Dependency      rawhide
  Upgrade  grub2-pc-1:2.12-50.fc44.x86_64                            Group           rawhide
  Upgrade  grub2-efi-x64-modules-1:2.12-50.fc44.noarch               User            rawhide
  Upgrade  grub2-efi-x64-cdboot-1:2.12-50.fc44.x86_64                Group           rawhide
  Upgrade  grub2-efi-x64-1:2.12-50.fc44.x86_64                       Group           rawhide
  Upgrade  grub2-efi-ia32-modules-1:2.12-50.fc44.noarch              Dependency      rawhide
  Upgrade  grub2-efi-ia32-cdboot-1:2.12-50.fc44.x86_64               Group           rawhide
  Upgrade  grub2-efi-ia32-1:2.12-50.fc44.x86_64                      Group           rawhide

This broke booting on my system, which is a fairly standard installation on a single disk, BTRFS, no encryption:

NAME        MAJ:MIN RM   SIZE RO TYPE MOUNTPOINTS
zram0       251:0    0     8G  0 disk [SWAP]
nvme0n1     259:0    0 953.9G  0 disk 
├─nvme0n1p1 259:1    0   600M  0 part /boot/efi
├─nvme0n1p2 259:2    0     1G  0 part /boot
└─nvme0n1p3 259:3    0 952.3G  0 part /home
                                      /

Comment 12 Adam Williamson 2026-01-11 16:51:13 UTC
I've filed a request to untag the package from Rawhide for now - https://forge.fedoraproject.org/releng/tickets/issues/13157 . Leo will look into this urgently in the coming week. Look out for any info requests.

Comment 13 Marta Lewandowska 2026-01-12 08:47:04 UTC
(In reply to Mark Grgurev from comment #10)
> Thank you! I didn't know how to find the older packages to install locally
> or I would have tried earlier. That worked.
> 
> Obviously now that I have a way to return to a working state, I can go back
> to the broken package if you could use additional testing to figure out what
> the actual issue is.

Hi Mark, I'm glad you were able to get your system back up (thanks Mikhail!) and thank you for volunteering to help test in the future. Could you please do an `lsblk -f` and paste the output so that we know something about your system? I guess you are also using btrfs. Is your /boot btrfs as well?
thanks.

Comment 14 Leo Sandoval 2026-01-12 19:38:25 UTC
Following Marta request but being a bit more general of the info we believe would be useful, please do the following 

Assuming you are on a running rawhide systems, enable grub debug and upgrade to 2.12-50 with the following

$ sudo dnf install -y koji
$ grub2-editenv - set debug=all,-lexer,-scripting
$ grub2-editenv - set pager=1
$ mkdir grub2-2.12-50
$ cd grub2-2.12-50
$ koji download-build --arch=x86_64 --arch=noarch grub2-2.12-50.fc44
$ sudo dnf install *.rpm
$ lsblk -f # place it on a pastebin, never expire
$ sudo reboot   # in the same pastebin as above, place any boot error seeing
$ #optional, just in case your system boots fine and you want to back to stable 'sudo dnf downgrade grub2\*'

Comment 15 Mikhail 2026-01-12 21:04:23 UTC
Created attachment 2121958 [details]
video demonstration

Following your request, I installed grub2-2.12-50.fc44 from Koji with GRUB debug enabled (debug=all,-lexer,-scripting, pager=1) and reproduced the issue again.

> $ lsblk -f # place it on a pastebin, never expire

root@primary-ws ~# lsblk -f
NAME        FSTYPE FSVER LABEL    UUID                                 FSAVAIL FSUSE% MOUNTPOINTS
zram0       swap   1     zram0    1868a0d0-ac55-401b-b589-f856034c9dae                [SWAP]
nvme1n1                                                                               
├─nvme1n1p1 vfat   FAT16          4307-D37D                             469.9M     4% /boot/efi
├─nvme1n1p2 swap   1              49251da1-a5cf-49ab-af4e-6dff17173e89                [SWAP]
└─nvme1n1p3 btrfs        btrfs.37 b4996eda-3a45-4f45-ad59-be0bac273396    194G    37% /
nvme0n1     btrfs                 46ed41f1-2512-4e13-a502-4add0e26a341    5.6T    80% /home
root@primary-ws ~# 


> $ sudo reboot   # in the same pastebin as above, place any boot error seeing

No error messages are shown before it drops to the grub> prompt. Please see the attached video (output_vbr_6.mp4).

Comment 16 Leo Sandoval 2026-01-12 21:52:52 UTC
(In reply to Mikhail from comment #15)
> Created attachment 2121958 [details]
> video demonstration
> 
> Following your request, I installed grub2-2.12-50.fc44 from Koji with GRUB
> debug enabled (debug=all,-lexer,-scripting, pager=1) and reproduced the
> issue again.

how did you enable the logging? using grub2-editenv? In theory a LOT of msgs 
should be printed.

> 
> > $ lsblk -f # place it on a pastebin, never expire
> 
> root@primary-ws ~# lsblk -f
> NAME        FSTYPE FSVER LABEL    UUID                                
> FSAVAIL FSUSE% MOUNTPOINTS
> zram0       swap   1     zram0    1868a0d0-ac55-401b-b589-f856034c9dae      
> [SWAP]
> nvme1n1                                                                     
> 
> ├─nvme1n1p1 vfat   FAT16          4307-D37D                            
> 469.9M     4% /boot/efi
> ├─nvme1n1p2 swap   1              49251da1-a5cf-49ab-af4e-6dff17173e89      
> [SWAP]
> └─nvme1n1p3 btrfs        btrfs.37 b4996eda-3a45-4f45-ad59-be0bac273396   
> 194G    37% /
> nvme0n1     btrfs                 46ed41f1-2512-4e13-a502-4add0e26a341   
> 5.6T    80% /home
> root@primary-ws ~# 
> 
> 
> > $ sudo reboot   # in the same pastebin as above, place any boot error seeing
> 
> No error messages are shown before it drops to the grub> prompt. Please see
> the attached video (output_vbr_6.mp4).

no debug msgs shown which means that either is failing quite soon or debug is not properly
enable for some reason. 

BTW, I tried the same partition setup (btrfs on / and no /boot partition) but on VM and
it worked as expected so this may not be file system related.

Is there a way you can try another filesystem and mount it as root / then proceed with the upgrade?
I just want to rule out btrfs..

Comment 17 Leo Sandoval 2026-01-13 16:42:39 UTC
(In reply to Leo Sandoval from comment #16)
> (In reply to Mikhail from comment #15)
> > Created attachment 2121958 [details]
> > video demonstration
> > 
> > Following your request, I installed grub2-2.12-50.fc44 from Koji with GRUB
> > debug enabled (debug=all,-lexer,-scripting, pager=1) and reproduced the
> > issue again.
> 
> how did you enable the logging? using grub2-editenv? In theory a LOT of msgs 
> should be printed.
> 
> > 
> > > $ lsblk -f # place it on a pastebin, never expire
> > 
> > root@primary-ws ~# lsblk -f
> > NAME        FSTYPE FSVER LABEL    UUID                                
> > FSAVAIL FSUSE% MOUNTPOINTS
> > zram0       swap   1     zram0    1868a0d0-ac55-401b-b589-f856034c9dae      
> > [SWAP]
> > nvme1n1                                                                     
> > 
> > ├─nvme1n1p1 vfat   FAT16          4307-D37D                            
> > 469.9M     4% /boot/efi
> > ├─nvme1n1p2 swap   1              49251da1-a5cf-49ab-af4e-6dff17173e89      
> > [SWAP]
> > └─nvme1n1p3 btrfs        btrfs.37 b4996eda-3a45-4f45-ad59-be0bac273396   
> > 194G    37% /
> > nvme0n1     btrfs                 46ed41f1-2512-4e13-a502-4add0e26a341   
> > 5.6T    80% /home
> > root@primary-ws ~# 
> > 
> > 
> > > $ sudo reboot   # in the same pastebin as above, place any boot error seeing
> > 
> > No error messages are shown before it drops to the grub> prompt. Please see
> > the attached video (output_vbr_6.mp4).
> 
> no debug msgs shown which means that either is failing quite soon or debug
> is not properly
> enable for some reason. 

Ignore my previous comment. The reason of the no-msgs on console is that grub.cfg 
controlled by a btrfs filesystem is obviously not working. Instead, I will share 
a set of rpms with grub instrumented to print msgs.

> 
> BTW, I tried the same partition setup (btrfs on / and no /boot partition)
> but on VM and
> it worked as expected so this may not be file system related.
> 
> Is there a way you can try another filesystem and mount it as root / then
> proceed with the upgrade?
> I just want to rule out btrfs..

Comment 18 Leo Sandoval 2026-01-13 18:47:01 UTC
Mikhail and team, 

can you please do the following

We have two regression [1,2] with the proposed (and merged) fix [3] so unfortunately
this is not yet over: During the test day [TestDay], most testers booted fine the iso
so we merged [3]. During the previous weekend (10-11 Jan 2026), people
found boot issues [1] so [3] was untagged [4]. We are suspecting that this is something
related to the filesystem (btrfs?) and this is why during the test day using
a Live OS did not catch it. Test Day was indeed useful, fix worked but not for all
systems so clearly the fix needs to be revisited.

I ask you the following: From a stable system/grub, can you (RE)INSTALL these instructions:
  
$ sudo dnf install -y koji
$ mkdir tmp & cd tmp
$ koji download-task 140906146 # aka [5], this is just a scratch build just for x86_64, disable SB
$ sudo dnf install *.rpm
$ sudo reboot
  
The fix [5] contains  [3] plus some instrumentation enabling debugging ('debug=all,-lexer,-scripting').
In case of FAILURE (you boot but ended up in the grub prompt instead of the grub menu) please
attach a video recording all the boot process and also in the comment indicate your block/partition/fs
scheme with 'lsblk -f'.

I am also preparing another test-day which will basically do the above steps but I will wait hoping
that we will get enough results here first.

[1] https://bugzilla.redhat.com/show_bug.cgi?id=2427945
[2] https://bugzilla.redhat.com/show_bug.cgi?id=2422881
[3] https://src.fedoraproject.org/rpms/grub2/pull-request/198
[4] https://forge.fedoraproject.org/releng/tickets/issues/13157
[5] https://koji.fedoraproject.org/koji/taskinfo?taskID=141063848
[TestDay] https://fedoraproject.org/wiki/Test_Day:2025-12-15_GRUB_out_of_memory_verification

Comment 19 Mark Grgurev 2026-01-13 19:03:52 UTC
(In reply to Leo Sandoval from comment #14)
> Following Marta request but being a bit more general of the info we believe
> would be useful, please do the following 
> 
> Assuming you are on a running rawhide systems, enable grub debug and upgrade
> to 2.12-50 with the following
> 
> $ sudo dnf install -y koji
> $ grub2-editenv - set debug=all,-lexer,-scripting
> $ grub2-editenv - set pager=1
> $ mkdir grub2-2.12-50
> $ cd grub2-2.12-50
> $ koji download-build --arch=x86_64 --arch=noarch grub2-2.12-50.fc44
> $ sudo dnf install *.rpm
> $ lsblk -f # place it on a pastebin, never expire
> $ sudo reboot   # in the same pastebin as above, place any boot error seeing
> $ #optional, just in case your system boots fine and you want to back to
> stable 'sudo dnf downgrade grub2\*'

I didn't install 2.12-50 again yet. Is that supposed to write debug info to a log file somewhere or show it at boot? Because the only info that was ever shown only flashed by for a split second and scrolled quickly so I wouldn't be able to catch any of that. If it's supposed to write to disk then that won't work because it was only able to access any of the disks after one of the times I rebooted.

Here's the lsblk info though.

NAME        FSTYPE FSVER LABEL    UUID                                 FSAVAIL FSUSE% MOUNTPOINTS
zram0       swap   1     zram0    bafba1a7-e023-4f93-a2cb-75456ad91514                [SWAP]
nvme2n1                                                                               
└─nvme2n1p1 btrfs        Home     12b1c0c9-c464-4f5b-9284-92609ba9f461  367.5G    80% /home
nvme0n1                                                                               
├─nvme0n1p1 vfat   FAT16          13F7-F971                               182M     9% /boot/efi
├─nvme0n1p2 btrfs        fedora   786a165f-7ee8-43aa-b2b7-374ff51e17b6  122.6G    13% /
├─nvme0n1p3                                                                           
└─nvme0n1p4 ntfs         Windows  103E4F3C3E4F1A5C                                    
nvme1n1     btrfs        Projects e8d03978-eba5-4376-a064-018b8560868e    1.6T    55% /run/media/mark/Projects

Comment 20 Leo Sandoval 2026-01-13 19:16:39 UTC
(In reply to Mark Grgurev from comment #19)
> (In reply to Leo Sandoval from comment #14)
> > Following Marta request but being a bit more general of the info we believe
> > would be useful, please do the following 
> > 
> > Assuming you are on a running rawhide systems, enable grub debug and upgrade
> > to 2.12-50 with the following
> > 
> > $ sudo dnf install -y koji
> > $ grub2-editenv - set debug=all,-lexer,-scripting
> > $ grub2-editenv - set pager=1
> > $ mkdir grub2-2.12-50
> > $ cd grub2-2.12-50
> > $ koji download-build --arch=x86_64 --arch=noarch grub2-2.12-50.fc44
> > $ sudo dnf install *.rpm
> > $ lsblk -f # place it on a pastebin, never expire
> > $ sudo reboot   # in the same pastebin as above, place any boot error seeing
> > $ #optional, just in case your system boots fine and you want to back to
> > stable 'sudo dnf downgrade grub2\*'
> 
> I didn't install 2.12-50 again yet. Is that supposed to write debug info to
> a log file somewhere or show it at boot?

grub2-2.12-50.fc44 is the build that was untagged, it has the fix. In the above instructions
I indicated enabling grub's debug but this WILL NOT work as I indicated in comment 17 (https://bugzilla.redhat.com/show_bug.cgi?id=2427945#c17).


> Because the only info that was ever
> shown only flashed by for a split second and scrolled quickly so I wouldn't
> be able to catch any of that. If it's supposed to write to disk then that
> won't work because it was only able to access any of the disks after one of
> the times I rebooted.

Right, so please install the Fedora OS again and follow steps from comment 18 (https://bugzilla.redhat.com/show_bug.cgi?id=2427945#c18)

Sorry for the confusion.

> 
> Here's the lsblk info though.
> 
> NAME        FSTYPE FSVER LABEL    UUID                                
> FSAVAIL FSUSE% MOUNTPOINTS
> zram0       swap   1     zram0    bafba1a7-e023-4f93-a2cb-75456ad91514      
> [SWAP]
> nvme2n1                                                                     
> 
> └─nvme2n1p1 btrfs        Home     12b1c0c9-c464-4f5b-9284-92609ba9f461 
> 367.5G    80% /home
> nvme0n1                                                                     
> 
> ├─nvme0n1p1 vfat   FAT16          13F7-F971                              
> 182M     9% /boot/efi
> ├─nvme0n1p2 btrfs        fedora   786a165f-7ee8-43aa-b2b7-374ff51e17b6 
> 122.6G    13% /
> ├─nvme0n1p3                                                                 
> 
> └─nvme0n1p4 ntfs         Windows  103E4F3C3E4F1A5C                          
> 
> nvme1n1     btrfs        Projects e8d03978-eba5-4376-a064-018b8560868e   
> 1.6T    55% /run/media/mark/Projects

Comment 21 Mikhail 2026-01-13 21:19:22 UTC
Created attachment 2122093 [details]
video demonstration

(In reply to Leo Sandoval from comment #18)
> Mikhail and team, 
> 
> can you please do the following
> 
> We have two regression [1,2] with the proposed (and merged) fix [3] so
> unfortunately
> this is not yet over: During the test day [TestDay], most testers booted
> fine the iso
> so we merged [3]. During the previous weekend (10-11 Jan 2026), people
> found boot issues [1] so [3] was untagged [4]. We are suspecting that this
> is something
> related to the filesystem (btrfs?) and this is why during the test day using
> a Live OS did not catch it. Test Day was indeed useful, fix worked but not
> for all
> systems so clearly the fix needs to be revisited.
> 
> I ask you the following: From a stable system/grub, can you (RE)INSTALL
> these instructions:
>   
> $ sudo dnf install -y koji
> $ mkdir tmp & cd tmp
> $ koji download-task 140906146 # aka [5], this is just a scratch build just

Small correction: the Koji task id for [5] is 141063848 (not 140906146).
I used: koji download-task 141063848

> for x86_64, disable SB
> $ sudo dnf install *.rpm
> $ sudo reboot
>   
> The fix [5] contains  [3] plus some instrumentation enabling debugging
> ('debug=all,-lexer,-scripting').
> In case of FAILURE (you boot but ended up in the grub prompt instead of the
> grub menu) please
> attach a video recording all the boot process and also in the comment
> indicate your block/partition/fs
> scheme with 'lsblk -f'.


Unfortunately the scratch build [5] still drops to the `grub>` prompt (no menu).
Also, printing debug to the screen is not very actionable in this case:
the output is extremely verbose and scrolls too fast, so parts of it are unreadable in real time.
I recorded the whole boot attempt; please see the attached video: output_vbr_8.mp4.
Alternatively, if there is a supported way to capture GRUB debug output externally (console capture),
I can try that — screen output is too fast to read.

Comment 22 Leo Sandoval 2026-01-14 19:57:05 UTC
(In reply to Mikhail from comment #21)
> Created attachment 2122093 [details]
> video demonstration
> 
> (In reply to Leo Sandoval from comment #18)
> > Mikhail and team, 
> > 
> > can you please do the following
> > 
> > We have two regression [1,2] with the proposed (and merged) fix [3] so
> > unfortunately
> > this is not yet over: During the test day [TestDay], most testers booted
> > fine the iso
> > so we merged [3]. During the previous weekend (10-11 Jan 2026), people
> > found boot issues [1] so [3] was untagged [4]. We are suspecting that this
> > is something
> > related to the filesystem (btrfs?) and this is why during the test day using
> > a Live OS did not catch it. Test Day was indeed useful, fix worked but not
> > for all
> > systems so clearly the fix needs to be revisited.
> > 
> > I ask you the following: From a stable system/grub, can you (RE)INSTALL
> > these instructions:
> >   
> > $ sudo dnf install -y koji
> > $ mkdir tmp & cd tmp
> > $ koji download-task 140906146 # aka [5], this is just a scratch build just
> 
> Small correction: the Koji task id for [5] is 141063848 (not 140906146).
> I used: koji download-task 141063848

Right, thanks.


> 
> > for x86_64, disable SB
> > $ sudo dnf install *.rpm
> > $ sudo reboot
> >   
> > The fix [5] contains  [3] plus some instrumentation enabling debugging
> > ('debug=all,-lexer,-scripting').
> > In case of FAILURE (you boot but ended up in the grub prompt instead of the
> > grub menu) please
> > attach a video recording all the boot process and also in the comment
> > indicate your block/partition/fs
> > scheme with 'lsblk -f'.
> 
> 
> Unfortunately the scratch build [5] still drops to the `grub>` prompt (no
> menu).

yes, expected, I just enabled debugging through code.

> Also, printing debug to the screen is not very actionable in this case:
> the output is extremely verbose and scrolls too fast, so parts of it are
> unreadable in real time.
> I recorded the whole boot attempt; please see the attached video:
> output_vbr_8.mp4.
> Alternatively, if there is a supported way to capture GRUB debug output
> externally (console capture),
> I can try that — screen output is too fast to read.

unfortunately there is no other way than recording, e.g. no way to dump it into file.

From the video, the partition table (GPT) is not found (no partitions are found) thus grub
cannot read any file e.g grub.cfg, thus the fallback is to go into the grub prompt.

I'll let you know the next debugging step ASAP.

Comment 23 Leo Sandoval 2026-01-16 19:06:14 UTC
@Mark Grgurev
can your provide the motherboard/brand-model you are using?

So far we got these affected systems

* HW with OOM issues

- Asus ProArt Z790-CREATOR WIFI motherboard
- HP ZBook Fury 16 G9 Mobile Workstation PC/89C6
- Asus ROG MAXIMUS Z690 HERO
- ASUSTeK COMPUTER INC ROG MAXIMUS Z790 HERO

* HW with FS issues since 'OOM fix' (grub2-2.12-50), this ticket

- ASUS ROG STRIX B650E-I GAMING WIFI
- ASROCK B650I Lightning WiFi

Comment 24 Katerina Koukiou 2026-01-26 13:15:24 UTC
With grub2-common-1:2.12-52.fc44.noarch we still see this almost same error in the image refreshes in anaconda-webui CI.

    Jan 26 12:26:46 ibm-p8-kvm-03-guest-02.virt.pnr.lab.eng.rdu2.redhat.com org.fedoraproject.Anaconda.Modules.Storage[6490]: INFO:program:Running in chroot '/mnt/sysroot'... gen_grub_cfgstub /boot/grub2 /boot/efi/EFI/fedora
    org.fedoraproject.Anaconda.Modules.Storage[6490]: INFO:program:grub2-probe: error: ../grub-core/kern/fs.c:grub_fs_probe:123:unknown filesystem.
    Jan 26 12:26:46 ibm-p8-kvm-03-guest-02.virt.pnr.lab.eng.rdu2.redhat.com org.fedoraproject.Anaconda.Modules.Storage[6490]: DEBUG:program:Return code of gen_grub_cfgstub: 1

I am attaching also the journal log of the failing installation.

Comment 25 Katerina Koukiou 2026-01-26 13:15:59 UTC
Created attachment 2123806 [details]
journal

Comment 26 Nicolas Frayer 2026-01-26 13:24:58 UTC
(In reply to Katerina Koukiou from comment #24)
> With grub2-common-1:2.12-52.fc44.noarch we still see this almost same error
> in the image refreshes in anaconda-webui CI.
> 
>     Jan 26 12:26:46 ibm-p8-kvm-03-guest-02.virt.pnr.lab.eng.rdu2.redhat.com
> org.fedoraproject.Anaconda.Modules.Storage[6490]: INFO:program:Running in
> chroot '/mnt/sysroot'... gen_grub_cfgstub /boot/grub2 /boot/efi/EFI/fedora
>     org.fedoraproject.Anaconda.Modules.Storage[6490]:
> INFO:program:grub2-probe: error:
> ../grub-core/kern/fs.c:grub_fs_probe:123:unknown filesystem.
>     Jan 26 12:26:46 ibm-p8-kvm-03-guest-02.virt.pnr.lab.eng.rdu2.redhat.com
> org.fedoraproject.Anaconda.Modules.Storage[6490]: DEBUG:program:Return code
> of gen_grub_cfgstub: 1
> 
> I am attaching also the journal log of the failing installation.

Did you mean to comment on https://bugzilla.redhat.com/show_bug.cgi?id=2429501 instead ? This issue is related to a regression introduced by a fix to fix an OOM issue.

Comment 27 Leo Sandoval 2026-01-26 18:00:36 UTC
Hi team,

we have a new fix [1] and hopefully this time would be the final one. A bit of resume
of this peculiar issue: the OOM issue is seen on those system with limited memory pool
so we try to increase the memory pool for grub_malloc [2] but hit other (unexpected) issues [3] so
[2] was reverted.

Before going into a second test-day for this OOM issue (if needed), I have proposed two testing scenarios below.
For both, please use a tesing HW (NEVER on your working desktop/lap) and DISABLE Secure boot (unsigned GRUB binaries
for the moment) temporaly.

- Option 1: ISO install (for those that cannot install Fedora due to OOM issues)
  0. Disable Secure boot
  1. Download the ISO [5] which contains the fix, flash it on a USB stick
  3. boot with it your HW. In theory the OOM would be seen here on those particular machines where OOM has been observed before
  4. If possible and your time allows, please install Fedora (use 'On the Network' in the Installation Source menu, this is just
     in case the auto-detect installation media fails). The reason we are asking for full installation is that last time we did not
     testers this step and we ended up with [3].
  5. Reboot your new Fedora System
  6. Follow instructions below (Option 2).  
  7. Share your results.

- Option 2: RPM install (for those already running a Fedora rawhide system)
  0. Disable Secure boot
  1. Boot your system
  2. Download the rpms[4], e.g. koji download-task --arch=x86_64 --arch=noarch 141497105
  3. install the rpms, e.g. sudo dnf install *.rpm
  4. Reboot
  5. Share results

[1] https://src.fedoraproject.org/rpms/grub2/pull-request/207
[2] https://src.fedoraproject.org/rpms/grub2/pull-request/198
[3] https://bugzilla.redhat.com/show_bug.cgi?id=2427945
[4] https://koji.fedoraproject.org/koji/taskinfo?taskID=141497105
[5] https://people.redhat.com/lsandova/oom/boot-efi-alloc-on-verifiers.iso

Comment 28 Adam Williamson 2026-01-30 16:30:15 UTC
Ping, folks - any chance you can test the new build? It'd be really useful. Thanks a lot!

Comment 29 Mikhail 2026-01-30 18:30:33 UTC
# dnf history info last..1 | grep -B15 "2.12-53.fc44"
  Replaced mesa-vulkan-drivers-0:26.0.0-1.20260127.01.50a3699.fc44.i686             Group           @System
  Replaced mesa-vulkan-drivers-debuginfo-0:26.0.0-1.20260127.01.50a3699.fc44.x86_64 User            @System

Transaction ID : 615
Begin time     : 2026-01-28 19:56:31
Begin rpmdb    : f4e760a0e01e778b66b5ba38d735f0cbdf65c3d6808cc73de3c230c52ef1c54f
End time       : 2026-01-28 19:56:36
End rpmdb      : 6de584120d5525fd9103e60ccef51bbe042af3e16ddb13946feac362418bb93b
User           : 1000 Mikhail Gavrilov <mikhail>
Status         : Ok
Releasever     : rawhide
Description    : dnf upgrade --refresh --exclude=xdg-desktop-portal
Comment        : 
Packages altered:
  Action   Package                                      Reason     Repository
  Upgrade  grub2-common-1:2.12-53.fc44.noarch           Dependency rawhide
  Upgrade  grub2-tools-minimal-1:2.12-53.fc44.x86_64    Dependency rawhide
  Upgrade  grub2-tools-extra-1:2.12-53.fc44.x86_64      Group      rawhide
  Upgrade  grub2-tools-efi-1:2.12-53.fc44.x86_64        Group      rawhide
  Upgrade  grub2-tools-1:2.12-53.fc44.x86_64            Group      rawhide
  Upgrade  grub2-pc-modules-1:2.12-53.fc44.noarch       Dependency rawhide
  Upgrade  grub2-pc-1:2.12-53.fc44.x86_64               Group      rawhide
  Upgrade  grub2-efi-x64-modules-1:2.12-53.fc44.noarch  User       rawhide
  Upgrade  grub2-efi-x64-cdboot-1:2.12-53.fc44.x86_64   Group      rawhide
  Upgrade  grub2-efi-x64-1:2.12-53.fc44.x86_64          Group      rawhide
  Upgrade  grub2-efi-ia32-modules-1:2.12-53.fc44.noarch User       rawhide
  Upgrade  grub2-efi-ia32-cdboot-1:2.12-53.fc44.x86_64  Group      rawhide
  Upgrade  grub2-efi-ia32-1:2.12-53.fc44.x86_64         Group      rawhide

I’m now on the regular Rawhide update (no scratch build needed):
  grub2-common-2.12-53.fc44.noarch
  grub2-efi-x64-2.12-53.fc44.x86_64
  grub2-efi-x64-modules-2.12-53.fc44.noarch

With 2.12-53 the system boots normally again (GRUB menu shows up, no drop to grub>).
So the issue appears fixed for my setup.
If you still need me to test the scratch/instrumented build, let me know.

Comment 30 Leo Sandoval 2026-01-30 19:12:38 UTC
(In reply to Mikhail from comment #29)
> # dnf history info last..1 | grep -B15 "2.12-53.fc44"
>   Replaced mesa-vulkan-drivers-0:26.0.0-1.20260127.01.50a3699.fc44.i686     
> Group           @System
>   Replaced
> mesa-vulkan-drivers-debuginfo-0:26.0.0-1.20260127.01.50a3699.fc44.x86_64
> User            @System
> 
> Transaction ID : 615
> Begin time     : 2026-01-28 19:56:31
> Begin rpmdb    :
> f4e760a0e01e778b66b5ba38d735f0cbdf65c3d6808cc73de3c230c52ef1c54f
> End time       : 2026-01-28 19:56:36
> End rpmdb      :
> 6de584120d5525fd9103e60ccef51bbe042af3e16ddb13946feac362418bb93b
> User           : 1000 Mikhail Gavrilov <mikhail>
> Status         : Ok
> Releasever     : rawhide
> Description    : dnf upgrade --refresh --exclude=xdg-desktop-portal
> Comment        : 
> Packages altered:
>   Action   Package                                      Reason     Repository
>   Upgrade  grub2-common-1:2.12-53.fc44.noarch           Dependency rawhide
>   Upgrade  grub2-tools-minimal-1:2.12-53.fc44.x86_64    Dependency rawhide
>   Upgrade  grub2-tools-extra-1:2.12-53.fc44.x86_64      Group      rawhide
>   Upgrade  grub2-tools-efi-1:2.12-53.fc44.x86_64        Group      rawhide
>   Upgrade  grub2-tools-1:2.12-53.fc44.x86_64            Group      rawhide
>   Upgrade  grub2-pc-modules-1:2.12-53.fc44.noarch       Dependency rawhide
>   Upgrade  grub2-pc-1:2.12-53.fc44.x86_64               Group      rawhide
>   Upgrade  grub2-efi-x64-modules-1:2.12-53.fc44.noarch  User       rawhide
>   Upgrade  grub2-efi-x64-cdboot-1:2.12-53.fc44.x86_64   Group      rawhide
>   Upgrade  grub2-efi-x64-1:2.12-53.fc44.x86_64          Group      rawhide
>   Upgrade  grub2-efi-ia32-modules-1:2.12-53.fc44.noarch User       rawhide
>   Upgrade  grub2-efi-ia32-cdboot-1:2.12-53.fc44.x86_64  Group      rawhide
>   Upgrade  grub2-efi-ia32-1:2.12-53.fc44.x86_64         Group      rawhide
> 
> I’m now on the regular Rawhide update (no scratch build needed):
>   grub2-common-2.12-53.fc44.noarch
>   grub2-efi-x64-2.12-53.fc44.x86_64
>   grub2-efi-x64-modules-2.12-53.fc44.noarch
> 
> With 2.12-53 the system boots normally again (GRUB menu shows up, no drop to
> grub>).
> So the issue appears fixed for my setup.
> If you still need me to test the scratch/instrumented build, let me know.

yes please, try the scratch/instrumented because Rawhide does not contain the fix
we want to test.

Comment 31 Adam Williamson 2026-01-30 19:23:22 UTC
To be clear: the official -53 build is not the same as the scratch -53 build, it does not have the change we need to test. Sorry about the confusion.

Comment 32 Mikhail 2026-01-30 21:04:49 UTC
I downloaded and installed the scratch RPMs from Koji task 141497105 and forced a reinstall of grub2-* from a local repo:

mikhail@primary-ws ~/r/R/x86_64> koji download-task 141497105 --arch=i686 --arch=x86_64 --arch=noarch
Downloading [1/24]: grub2-tools-2.12-53.fc44.x86_64.rpm
[====================================] 100% 1.83 MiB / 1.83 MiB
Downloading [2/24]: grub2-emu-modules-2.12-53.fc44.x86_64.rpm
[====================================] 100% 3.30 MiB / 3.30 MiB
Downloading [3/24]: grub2-efi-x64-cdboot-2.12-53.fc44.x86_64.rpm
[====================================] 100% 2.12 MiB / 2.12 MiB
Downloading [4/24]: grub2-common-2.12-53.fc44.noarch.rpm
[====================================] 100% 1013.77 KiB / 1013.77 KiB
Downloading [5/24]: grub2-debugsource-2.12-53.fc44.x86_64.rpm
[====================================] 100% 1.33 MiB / 1.33 MiB
Downloading [6/24]: grub2-efi-ia32-2.12-53.fc44.x86_64.rpm
[====================================] 100% 2.07 MiB / 2.07 MiB
Downloading [7/24]: grub2-efi-x64-2.12-53.fc44.x86_64.rpm
[====================================] 100% 2.12 MiB / 2.12 MiB
Downloading [8/24]: grub2-efi-x64-modules-2.12-53.fc44.noarch.rpm
[====================================] 100% 1.08 MiB / 1.08 MiB
Downloading [9/24]: grub2-efi-ia32-cdboot-2.12-53.fc44.x86_64.rpm
[====================================] 100% 2.07 MiB / 2.07 MiB
Downloading [10/24]: grub2-tools-extra-2.12-53.fc44.x86_64.rpm
[====================================] 100% 850.71 KiB / 850.71 KiB
Downloading [11/24]: grub2-emu-debuginfo-2.12-53.fc44.x86_64.rpm
[====================================] 100% 1.84 MiB / 1.84 MiB
Downloading [12/24]: grub2-tools-extra-debuginfo-2.12-53.fc44.x86_64.rpm
[====================================] 100% 1.00 MiB / 1.00 MiB
Downloading [13/24]: grub2-tools-debuginfo-2.12-53.fc44.x86_64.rpm
[====================================] 100% 1.01 MiB / 1.01 MiB
Downloading [14/24]: grub2-tools-minimal-2.12-53.fc44.x86_64.rpm
[====================================] 100% 691.72 KiB / 691.72 KiB
Downloading [15/24]: grub2-xen-x64-modules-2.12-53.fc44.noarch.rpm
[====================================] 100% 849.16 KiB / 849.16 KiB
Downloading [16/24]: grub2-efi-ia32-modules-2.12-53.fc44.noarch.rpm
[====================================] 100% 1.04 MiB / 1.04 MiB
Downloading [17/24]: grub2-tools-minimal-debuginfo-2.12-53.fc44.x86_64.rpm
[====================================] 100% 816.53 KiB / 816.53 KiB
Downloading [18/24]: grub2-pc-modules-2.12-53.fc44.noarch.rpm
[====================================] 100% 1.06 MiB / 1.06 MiB
Downloading [19/24]: grub2-xen_pvh-i386-modules-2.12-53.fc44.noarch.rpm
[====================================] 100% 825.33 KiB / 825.33 KiB
Downloading [20/24]: grub2-tools-efi-2.12-53.fc44.x86_64.rpm
[====================================] 100% 555.67 KiB / 555.67 KiB
Downloading [21/24]: grub2-tools-efi-debuginfo-2.12-53.fc44.x86_64.rpm
[====================================] 100% 620.68 KiB / 620.68 KiB
Downloading [22/24]: grub2-emu-2.12-53.fc44.x86_64.rpm
[====================================] 100% 639.15 KiB / 639.15 KiB
Downloading [23/24]: grub2-debuginfo-2.12-53.fc44.x86_64.rpm
[====================================] 100% 156.96 KiB / 156.96 KiB
Downloading [24/24]: grub2-pc-2.12-53.fc44.x86_64.rpm
[====================================] 100% 15.65 KiB / 15.65 KiB
mikhail@primary-ws ~/r/R/x86_64> createrepo .
Directory walk started
Directory walk done - 24 packages
Temporary output repo path: ./.repodata/
Pool started (with 5 workers)
Pool finished
mikhail@primary-ws ~/r/R/x86_64> koji download-build xdg-desktop-portal-1.20.3-5.fc44  --arch="i686" --arch="x86_64" --arch="noarch" --debuginfo
Downloading [1/8]: xdg-desktop-portal-debuginfo-1.20.3-5.fc44.i686.rpm
[====================================] 100% 1.36 MiB / 1.36 MiB
Downloading [2/8]: xdg-desktop-portal-1.20.3-5.fc44.i686.rpm
[====================================] 100% 498.84 KiB / 498.84 KiB
Downloading [3/8]: xdg-desktop-portal-devel-1.20.3-5.fc44.i686.rpm
[====================================] 100% 8.93 KiB / 8.93 KiB
Downloading [4/8]: xdg-desktop-portal-debugsource-1.20.3-5.fc44.i686.rpm
[====================================] 100% 360.32 KiB / 360.32 KiB
Downloading [5/8]: xdg-desktop-portal-debugsource-1.20.3-5.fc44.x86_64.rpm
[====================================] 100% 360.52 KiB / 360.52 KiB
Downloading [6/8]: xdg-desktop-portal-devel-1.20.3-5.fc44.x86_64.rpm
[====================================] 100% 8.97 KiB / 8.97 KiB
Downloading [7/8]: xdg-desktop-portal-debuginfo-1.20.3-5.fc44.x86_64.rpm
[====================================] 100% 1.50 MiB / 1.50 MiB
Downloading [8/8]: xdg-desktop-portal-1.20.3-5.fc44.x86_64.rpm
[====================================] 100% 482.47 KiB / 482.47 KiB
mikhail@primary-ws ~/r/R/x86_64> createrepo .
Directory walk started
Directory walk done - 32 packages
Temporary output repo path: ./.repodata/
Pool started (with 5 workers)
Pool finished
mikhail@primary-ws ~/r/R/x86_64> createrepo .
Directory walk started
Directory walk done - 32 packages
Temporary output repo path: ./.repodata/
Pool started (with 5 workers)
Pool finished
mikhail@primary-ws ~/r/R/x86_64> 

root@primary-ws ~# dnf reinstall "grub2-*"
Updating and loading repositories:
Repositories loaded.
Package                                 Arch       Version                                Repository              Size
Reinstalling:
 grub2-common                           noarch     1:2.12-53.fc44                         local-repo           6.2 MiB
   replacing grub2-common               noarch     1:2.12-53.fc44                         rawhide              6.2 MiB
 grub2-efi-ia32                         x86_64     1:2.12-53.fc44                         local-repo           5.2 MiB
   replacing grub2-efi-ia32             x86_64     1:2.12-53.fc44                         rawhide              5.2 MiB
 grub2-efi-ia32-cdboot                  x86_64     1:2.12-53.fc44                         local-repo           5.2 MiB
   replacing grub2-efi-ia32-cdboot      x86_64     1:2.12-53.fc44                         rawhide              5.2 MiB
 grub2-efi-ia32-modules                 noarch     1:2.12-53.fc44                         local-repo           3.8 MiB
   replacing grub2-efi-ia32-modules     noarch     1:2.12-53.fc44                         rawhide              3.8 MiB
 grub2-efi-x64                          x86_64     1:2.12-53.fc44                         local-repo           6.2 MiB
   replacing grub2-efi-x64              x86_64     1:2.12-53.fc44                         rawhide              6.2 MiB
 grub2-efi-x64-cdboot                   x86_64     1:2.12-53.fc44                         local-repo           6.2 MiB
   replacing grub2-efi-x64-cdboot       x86_64     1:2.12-53.fc44                         rawhide              6.2 MiB
 grub2-efi-x64-modules                  noarch     1:2.12-53.fc44                         local-repo           5.7 MiB
   replacing grub2-efi-x64-modules      noarch     1:2.12-53.fc44                         rawhide              5.7 MiB
 grub2-pc                               x86_64     1:2.12-53.fc44                         local-repo          31.0   B
   replacing grub2-pc                   x86_64     1:2.12-53.fc44                         rawhide             31.0   B
 grub2-pc-modules                       noarch     1:2.12-53.fc44                         local-repo           3.2 MiB
   replacing grub2-pc-modules           noarch     1:2.12-53.fc44                         rawhide              3.2 MiB
 grub2-tools                            x86_64     1:2.12-53.fc44                         local-repo           7.8 MiB
   replacing grub2-tools                x86_64     1:2.12-53.fc44                         rawhide              7.8 MiB
 grub2-tools-efi                        x86_64     1:2.12-53.fc44                         local-repo           2.6 MiB
   replacing grub2-tools-efi            x86_64     1:2.12-53.fc44                         rawhide              2.6 MiB
 grub2-tools-extra                      x86_64     1:2.12-53.fc44                         local-repo           5.1 MiB
   replacing grub2-tools-extra          x86_64     1:2.12-53.fc44                         rawhide              5.1 MiB
 grub2-tools-minimal                    x86_64     1:2.12-53.fc44                         local-repo           4.1 MiB
   replacing grub2-tools-minimal        x86_64     1:2.12-53.fc44                         rawhide              4.1 MiB

Transaction Summary:
 Reinstalling:      13 packages
 Replacing:         13 packages

Total size of inbound packages is 16 MiB. Need to download 16 MiB.
After this operation, 35 KiB extra will be used (install 61 MiB, remove 61 MiB).
Is this ok [y/N]: y
[ 1/13] grub2-efi-x64-1:2.12-53.fc44.x86_64                                   100% | 151.3 MiB/s |   2.1 MiB |  00m00s
[ 2/13] grub2-tools-1:2.12-53.fc44.x86_64                                     100% | 140.9 MiB/s |   1.8 MiB |  00m00s
[ 3/13] grub2-tools-minimal-1:2.12-53.fc44.x86_64                             100% |  61.4 MiB/s | 691.7 KiB |  00m00s
[ 4/13] grub2-common-1:2.12-53.fc44.noarch                                    100% | 165.0 MiB/s |   1.0 MiB |  00m00s
[ 5/13] grub2-pc-modules-1:2.12-53.fc44.noarch                                100% | 176.7 MiB/s |   1.1 MiB |  00m00s
[ 6/13] grub2-pc-1:2.12-53.fc44.x86_64                                        100% |   3.1 MiB/s |  15.6 KiB |  00m00s
[ 7/13] grub2-efi-ia32-1:2.12-53.fc44.x86_64                                  100% | 188.6 MiB/s |   2.1 MiB |  00m00s
[ 8/13] grub2-tools-extra-1:2.12-53.fc44.x86_64                               100% | 103.8 MiB/s | 850.7 KiB |  00m00s
[ 9/13] grub2-tools-efi-1:2.12-53.fc44.x86_64                                 100% |  67.8 MiB/s | 555.7 KiB |  00m00s
[10/13] grub2-efi-x64-modules-1:2.12-53.fc44.noarch                           100% |  98.6 MiB/s |   1.1 MiB |  00m00s
[11/13] grub2-efi-x64-cdboot-1:2.12-53.fc44.x86_64                            100% | 162.8 MiB/s |   2.1 MiB |  00m00s
[12/13] grub2-efi-ia32-modules-1:2.12-53.fc44.noarch                          100% | 104.0 MiB/s |   1.0 MiB |  00m00s
[13/13] grub2-efi-ia32-cdboot-1:2.12-53.fc44.x86_64                           100% | 259.2 MiB/s |   2.1 MiB |  00m00s
----------------------------------------------------------------------------------------------------------------------
[13/13] Total                                                                 100% | 219.4 MiB/s |  16.5 MiB |  00m00s
Running transaction
[ 1/28] Verify package files                                                  100% | 295.0   B/s |  13.0   B |  00m00s
[ 2/28] Prepare transaction                                                   100% |  88.0   B/s |  26.0   B |  00m00s
[ 3/28] Reinstalling grub2-common-1:2.12-53.fc44.noarch                       100% |  84.5 MiB/s |   6.2 MiB |  00m00s
[ 4/28] Reinstalling grub2-tools-minimal-1:2.12-53.fc44.x86_64                100% |  51.7 MiB/s |   4.1 MiB |  00m00s
[ 5/28] Reinstalling grub2-tools-1:2.12-53.fc44.x86_64                        100% |  67.2 MiB/s |   7.8 MiB |  00m00s
[ 6/28] Reinstalling grub2-pc-modules-1:2.12-53.fc44.noarch                   100% |  19.6 MiB/s |   3.3 MiB |  00m00s
[ 7/28] Reinstalling grub2-pc-1:2.12-53.fc44.x86_64                           100% | 138.7 KiB/s | 568.0   B |  00m00s
[ 8/28] Reinstalling grub2-efi-x64-1:2.12-53.fc44.x86_64                      100% | 156.2 MiB/s |   6.2 MiB |  00m00s
[ 9/28] Reinstalling grub2-efi-ia32-1:2.12-53.fc44.x86_64                     100% | 237.6 MiB/s |   5.2 MiB |  00m00s
[10/28] Reinstalling grub2-tools-extra-1:2.12-53.fc44.x86_64                  100% | 113.3 MiB/s |   5.1 MiB |  00m00s
[11/28] Reinstalling grub2-tools-efi-1:2.12-53.fc44.x86_64                    100% | 102.2 MiB/s |   2.6 MiB |  00m00s
[12/28] Reinstalling grub2-efi-x64-modules-1:2.12-53.fc44.noarch              100% |  40.1 MiB/s |   5.8 MiB |  00m00s
[13/28] Reinstalling grub2-efi-x64-cdboot-1:2.12-53.fc44.x86_64               100% | 223.0 MiB/s |   6.2 MiB |  00m00s
[14/28] Reinstalling grub2-efi-ia32-modules-1:2.12-53.fc44.noarch             100% |  29.5 MiB/s |   3.9 MiB |  00m00s
[15/28] Reinstalling grub2-efi-ia32-cdboot-1:2.12-53.fc44.x86_64              100% | 326.5 MiB/s |   5.2 MiB |  00m00s
[16/28] Removing grub2-pc-1:2.12-53.fc44.x86_64                               100% | 444.0   B/s |   4.0   B |  00m00s
[17/28] Removing grub2-efi-ia32-1:2.12-53.fc44.x86_64                         100% |   1.1 KiB/s |  14.0   B |  00m00s
[18/28] Removing grub2-efi-x64-1:2.12-53.fc44.x86_64                          100% |   1.1 KiB/s |  14.0   B |  00m00s
[19/28] Removing grub2-tools-extra-1:2.12-53.fc44.x86_64                      100% |   2.6 KiB/s |  35.0   B |  00m00s
[20/28] Removing grub2-pc-modules-1:2.12-53.fc44.noarch                       100% |  15.7 KiB/s | 305.0   B |  00m00s
[21/28] Removing grub2-efi-ia32-cdboot-1:2.12-53.fc44.x86_64                  100% |   2.0 KiB/s |   4.0   B |  00m00s
[22/28] Removing grub2-efi-ia32-modules-1:2.12-53.fc44.noarch                 100% |  15.3 KiB/s | 298.0   B |  00m00s
[23/28] Removing grub2-efi-x64-cdboot-1:2.12-53.fc44.x86_64                   100% |   2.0 KiB/s |   4.0   B |  00m00s
[24/28] Removing grub2-efi-x64-modules-1:2.12-53.fc44.noarch                  100% |  12.5 KiB/s | 295.0   B |  00m00s
[25/28] Removing grub2-tools-minimal-1:2.12-53.fc44.x86_64                    100% | 692.0   B/s |  27.0   B |  00m00s
[26/28] Removing grub2-tools-1:2.12-53.fc44.x86_64                            100% | 376.0   B/s |  78.0   B |  00m00s
[27/28] Removing grub2-tools-efi-1:2.12-53.fc44.x86_64                        100% |   1.2 KiB/s |  12.0   B |  00m00s
[28/28] Removing grub2-common-1:2.12-53.fc44.noarch                           100% |  14.0   B/s |  57.0   B |  00m04s
filesystem error: cannot copy: No such file or directory [/usr/lib/sysimage/libdnf5/packages.toml.new] [/usr/lib/sysimage/libdnf5/packages.toml]
root@primary-ws ~ [1]# 

# rpm -q grub2-efi-x64 --qf '%{NAME} %{EPOCH}:%{VERSION}-%{RELEASE}\n  buildhost=%{BUILDHOST}\n  buildtime=%{BUILDTIME:date}\n'
grub2-efi-x64 1:2.12-53.fc44
  buildhost=buildvm-x86-17.rdu3.fedoraproject.org
  buildtime=Fri 23 Jan 2026 10:26:01 PM +05


Is this sufficient to confirm I’m testing the scratch build from task 141497105, or do you need any additional verification?

Comment 33 Adam Williamson 2026-01-30 22:34:17 UTC
That looks right, yeah. Though you can skip creating the localrepo and just do "dnf upgrade/downgrade/reinstall *.rpm" (from a directory containing *only* the packages you want, of course) and it usually works fine.

(also I really should figure out what's going on with that packages.toml.new error, heh)

Comment 34 Mikhail 2026-01-31 00:38:11 UTC
Thanks — yep, makes sense.

In my case I already maintain a local repo for my daily builds, so I just dropped the task 141497105 RPMs there and used `dnf reinstall grub2-*` from that repo. Functionally equivalent to reinstalling `./*.rpm` from a clean directory — just less friction for my workflow.

Let me know if you’d prefer I do the “clean dir + dnf reinstall ./*.rpm” method next time for consistency.

Comment 35 Adam Williamson 2026-01-31 01:25:17 UTC
Nope, makes no difference.

So to be clear - after you switched to the scratch builds, your system still boots fine?

Comment 36 Mikhail 2026-01-31 10:56:12 UTC
Yes — after reinstalling the scratch build RPMs from task 141497105 (grub2-efi-x64/common/… 2.12-53.fc44), the system boots normally (GRUB menu appears; no drop to grub>) on both of my workstations:

- primary-ws: ASUS ROG STRIX B650E-I GAMING WIFI
- secondary-ws: ASRock B650I Lightning WiFi

Comment 37 Leo Sandoval 2026-02-09 17:00:26 UTC
(In reply to Mikhail from comment #36)
> Yes — after reinstalling the scratch build RPMs from task 141497105
> (grub2-efi-x64/common/… 2.12-53.fc44), the system boots normally (GRUB menu
> appears; no drop to grub>) on both of my workstations:
> 
> - primary-ws: ASUS ROG STRIX B650E-I GAMING WIFI
> - secondary-ws: ASRock B650I Lightning WiFi

Thanks for your input, no complains so far for the proposed fix.

Comment 38 Leo Sandoval 2026-02-09 17:03:07 UTC
Team, 

as you may know, today started the test day for the latest fix. In case you want
to participate, please follow instructions on

https://fedoraproject.org/wiki/Test_Day:2026-02-09_GRUB_out_of_memory_fix_verification_part_2

Unfortunately we missed f44 branching but the idea is to merge it ASAP in rawhide, then port it
into supported versions.


Note You need to log in before you can comment on or make changes to this bug.