After upgrading to 2.43.9000-8 and regenerating initramfs, booting results in grub2 loading, but then a blank screen. I can only guess userspace crashes, but unfortunately I can't see any output. Downgrading to 2.43.9000-7 and regenerating the initramfs on the same exact kernel, boot works as expected. I see the emag removals in the changelog, but this is definitely no emag. ;) Happy to try and get more info... Reproducible: Always
The changes in -8 are as follows: - htl: Fix SEM_FAILED type (Samuel Thibault) - io: Use gnulib fts implementation (BZ 22944, BZ 20331) (Adhemerval Zanella) - stdlib: Add internal stdc_rotate_right implementation (Adhemerval Zanella) - AArch64: Remove unused MIDR entries (Wilco Dijkstra) - AArch64: Remove eMAG memset ifunc (Wilco Dijkstra) - AArch64: Remove eMAG memchr ifunc (Wilco Dijkstra) - hurd: Interrupted RPC returning EINTR when server has actually changed state. (Mike Kelly) - hurd: alterations to MSG_EXAMINE interface (intr-msg.h) (Mike Kelly) - malloc: Show hugetlb tunable default in --list-tunables (Wilco Dijkstra) - io: ftw: Use state stack instead of recursion (BZ 33882) (Adhemerval Zanella) - math: Sync sinh from CORE-MATH (Adhemerval Zanella) - testsuite: fix test-narrowing-trap failure on platforms where FE_INVALID is not defined (Xi Ruoyao) - Document CVE-2026-4046 (Siddhesh Poyarekar) - x86_64: Prefer EVEX512 code-path on AMD Zen5 CPUs (Sajan Karumanchi) And there are indeed 3 aarch64 issues. Can you provide more details about your CPU? Are you able to unpack glibc-2.43.9000-8 e.g. rpm2cpio glibc* | cpio -idmv; and then run the unpacked `<path to unpacked>/ld.so --list-diagnostics`? Are you able to run the current glibc version `ld.so --list-diagnostics`?
lscpu: Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 12 On-line CPU(s) list: 0-11 Vendor ID: Qualcomm Model name: Oryon Model: 1 Thread(s) per core: 1 Core(s) per cluster: 12 Socket(s): - Cluster(s): 1 Stepping: 0x2 BogoMIPS: 38.40 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 asimdfhm dit uscat ilrcpc flagm ssbs sb paca pacg dcpodp flagm2 frint i8mm bf16 rng bti ecv afp rpres NUMA node(s): 1 NUMA node0 CPU(s): 0-11 Vulnerability Gather data sampling: Not affected Vulnerability Ghostwrite: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Old microcode: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected glibc-2.43.9000-7: dl_dst_lib="lib64" dl_hwcap=0xffbfffff dl_hwcap2=0x3b6181 dl_hwcap3=0x0 dl_hwcap4=0x0 dl_hwcaps_subdirs="" dl_hwcaps_subdirs_active=0x0 dl_pagesize=0x1000 dl_platform="aarch64" dl_profile_output=0x0 dso.ld="ld-linux-aarch64.so.1" dso.libc="libc.so.6" env_filtered[0x0]="ANTHROPIC_VERTEX_PROJECT_ID" env_filtered[0x1]="CLAUDE_CODE_USE_VERTEX" env_filtered[0x2]="CLOUD_ML_REGION" env_filtered[0x3]="COLORTERM" env_filtered[0x4]="DBUS_SESSION_BUS_ADDRESS" env_filtered[0x5]="DEBUGINFOD_IMA_CERT_PATH" env_filtered[0x6]="DEBUGINFOD_URLS" env_filtered[0x7]="DESKTOP_SESSION" env_filtered[0x8]="DISPLAY" env_filtered[0x9]="EDITOR" env_filtered[0xa]="GDMSESSION" env_filtered[0xb]="GDM_LANG" env_filtered[0xc]="GIO_LAUNCHED_DESKTOP_FILE" env_filtered[0xd]="GIO_LAUNCHED_DESKTOP_FILE_PID" env_filtered[0xe]="GJS_DEBUG_OUTPUT" env_filtered[0xf]="GJS_DEBUG_TOPICS" env_filtered[0x10]="GNOME_SETUP_DISPLAY" env_filtered[0x11]="GPG_TTY" env_filtered[0x12]="GUESTFISH_INIT" env_filtered[0x13]="GUESTFISH_OUTPUT" env_filtered[0x14]="GUESTFISH_PS1" env_filtered[0x15]="GUESTFISH_RESTORE" env_filtered[0x16]="HISTCONTROL" env_filtered[0x17]="HISTSIZE" env_filtered[0x18]="HOME" env_filtered[0x19]="HOSTNAME" env_filtered[0x1a]="INVOCATION_ID" env_filtered[0x1b]="JOURNAL_STREAM" env_filtered[0x1c]="KDEDIRS" env[0x1d]="LANG=en_US.utf8" env_filtered[0x1e]="LESS" env_filtered[0x1f]="LESSOPEN" env_filtered[0x20]="LOGNAME" env_filtered[0x21]="LSCOLORS" env_filtered[0x22]="LS_COLORS" env_filtered[0x23]="MAIL" env_filtered[0x24]="MANAGERPID" env_filtered[0x25]="MANAGERPIDFDID" env_filtered[0x26]="MEMORY_PRESSURE_WATCH" env_filtered[0x27]="MEMORY_PRESSURE_WRITE" env_filtered[0x28]="MOZ_GMP_PATH" env_filtered[0x29]="OLDPWD" env_filtered[0x2a]="PAGER" env[0x2b]="PATH=/home/kevin/.local/bin:/home/kevin/bin:/usr/local/bin:/home/kevin/.local/bin:/home/kevin/bin:/usr/local/bin:/usr/local/bin:/usr/bin" env_filtered[0x2c]="PWD" env_filtered[0x2d]="QT_IM_MODULE" env_filtered[0x2e]="QT_IM_MODULES" env_filtered[0x2f]="SHELL" env_filtered[0x30]="SHLVL" env_filtered[0x31]="SSH_ASKPASS" env_filtered[0x32]="SSH_AUTH_SOCK" env_filtered[0x33]="SYSTEMD_EXEC_PID" env_filtered[0x34]="TERM" env_filtered[0x35]="TERM_PROGRAM" env_filtered[0x36]="TERM_PROGRAM_VERSION" env_filtered[0x37]="TMUX" env_filtered[0x38]="TMUX_PANE" env_filtered[0x39]="USER" env_filtered[0x3a]="USERNAME" env_filtered[0x3b]="WAYLAND_DISPLAY" env_filtered[0x3c]="XAUTHORITY" env_filtered[0x3d]="XDG_CURRENT_DESKTOP" env_filtered[0x3e]="XDG_DATA_DIRS" env_filtered[0x3f]="XDG_MENU_PREFIX" env_filtered[0x40]="XDG_RUNTIME_DIR" env_filtered[0x41]="XDG_SESSION_CLASS" env_filtered[0x42]="XDG_SESSION_DESKTOP" env_filtered[0x43]="XDG_SESSION_EXTRA_DEVICE_ACCESS" env_filtered[0x44]="XDG_SESSION_TYPE" env_filtered[0x45]="XMODIFIERS" env_filtered[0x46]="ZSH" env_filtered[0x47]="_" path.prefix="/usr" path.rtld="/lib/ld-linux-aarch64.so.1" path.sysconfdir="/etc" path.system_dirs[0x0]="/lib64/" path.system_dirs[0x1]="/usr/lib64/" version.release="development" version.version="2.43.9000" auxv[0x0].a_type=0x21 auxv[0x0].a_val=0xffff9f3ec000 auxv[0x1].a_type=0x33 auxv[0x1].a_val=0x1270 auxv[0x2].a_type=0x10 auxv[0x2].a_val=0xffbfffff auxv[0x3].a_type=0x6 auxv[0x3].a_val=0x1000 auxv[0x4].a_type=0x11 auxv[0x4].a_val=0x64 auxv[0x5].a_type=0x3 auxv[0x5].a_val=0xffff9f3a0040 auxv[0x6].a_type=0x4 auxv[0x6].a_val=0x38 auxv[0x7].a_type=0x5 auxv[0x7].a_val=0xa auxv[0x8].a_type=0x7 auxv[0x8].a_val=0x0 auxv[0x9].a_type=0x8 auxv[0x9].a_val=0x0 auxv[0xa].a_type=0x9 auxv[0xa].a_val=0xffff9f3bcc40 auxv[0xb].a_type=0xb auxv[0xb].a_val=0x3e8 auxv[0xc].a_type=0xc auxv[0xc].a_val=0x3e8 auxv[0xd].a_type=0xd auxv[0xd].a_val=0x3e8 auxv[0xe].a_type=0xe auxv[0xe].a_val=0x3e8 auxv[0xf].a_type=0x17 auxv[0xf].a_val=0x0 auxv[0x10].a_type=0x19 auxv[0x10].a_val=0xfffffce87a68 auxv[0x11].a_type=0x1a auxv[0x11].a_val=0x3b6181 auxv[0x12].a_type=0x1d auxv[0x12].a_val=0x0 auxv[0x13].a_type=0x1f auxv[0x13].a_val_string="/usr/bin/ld.so" auxv[0x14].a_type=0xf auxv[0x14].a_val_string="aarch64" auxv[0x15].a_type=0x1b auxv[0x15].a_val=0x21 auxv[0x16].a_type=0x1c auxv[0x16].a_val=0x40 uname.sysname="Linux" uname.nodename="orm.scrye.com" uname.release="7.0.0-0.rc7.260409g7f87a5ea75f0.57.fc45.aarch64" uname.version="#1 SMP PREEMPT_DYNAMIC Thu Apr 9 17:41:30 UTC 2026" uname.machine="aarch64" uname.domainname="(none)" aarch64.cpu_features.bti=0x1 aarch64.cpu_features.midr_el1=0x511f0011 aarch64.cpu_features.mops=0x0 aarch64.cpu_features.mte_state=0x0 aarch64.cpu_features.sve=0x0 aarch64.cpu_features.zva_size=0x40 aarch64.processor[0x0].requested=0x0 aarch64.processor[0x0].observed=0x0 aarch64.processor[0x0].observed_node=0x0 aarch64.processor[0x0].midr_el1=0x512f0011 aarch64.processor[0x0].dczid_el0=0x4 aarch64.processor[0x1].requested=0x1 aarch64.processor[0x1].observed=0x1 aarch64.processor[0x1].observed_node=0x0 aarch64.processor[0x1].midr_el1=0x512f0011 aarch64.processor[0x1].dczid_el0=0x4 aarch64.processor[0x2].requested=0x2 aarch64.processor[0x2].observed=0x2 aarch64.processor[0x2].observed_node=0x0 aarch64.processor[0x2].midr_el1=0x512f0011 aarch64.processor[0x2].dczid_el0=0x4 aarch64.processor[0x3].requested=0x3 aarch64.processor[0x3].observed=0x3 aarch64.processor[0x3].observed_node=0x0 aarch64.processor[0x3].midr_el1=0x512f0011 aarch64.processor[0x3].dczid_el0=0x4 aarch64.processor[0x4].requested=0x4 aarch64.processor[0x4].observed=0x4 aarch64.processor[0x4].observed_node=0x0 aarch64.processor[0x4].midr_el1=0x511f0011 aarch64.processor[0x4].dczid_el0=0x4 aarch64.processor[0x5].requested=0x5 aarch64.processor[0x5].observed=0x5 aarch64.processor[0x5].observed_node=0x0 aarch64.processor[0x5].midr_el1=0x511f0011 aarch64.processor[0x5].dczid_el0=0x4 aarch64.processor[0x6].requested=0x6 aarch64.processor[0x6].observed=0x6 aarch64.processor[0x6].observed_node=0x0 aarch64.processor[0x6].midr_el1=0x511f0011 aarch64.processor[0x6].dczid_el0=0x4 aarch64.processor[0x7].requested=0x7 aarch64.processor[0x7].observed=0x7 aarch64.processor[0x7].observed_node=0x0 aarch64.processor[0x7].midr_el1=0x511f0011 aarch64.processor[0x7].dczid_el0=0x4 aarch64.processor[0x8].requested=0x8 aarch64.processor[0x8].observed=0x8 aarch64.processor[0x8].observed_node=0x0 aarch64.processor[0x8].midr_el1=0x511f0011 aarch64.processor[0x8].dczid_el0=0x4 aarch64.processor[0x9].requested=0x9 aarch64.processor[0x9].observed=0x9 aarch64.processor[0x9].observed_node=0x0 aarch64.processor[0x9].midr_el1=0x511f0011 aarch64.processor[0x9].dczid_el0=0x4 aarch64.processor[0xa].requested=0xa aarch64.processor[0xa].observed=0xa aarch64.processor[0xa].observed_node=0x0 aarch64.processor[0xa].midr_el1=0x511f0011 aarch64.processor[0xa].dczid_el0=0x4 aarch64.processor[0xb].requested=0xb aarch64.processor[0xb].observed=0xb aarch64.processor[0xb].observed_node=0x0 aarch64.processor[0xb].midr_el1=0x511f0011 aarch64.processor[0xb].dczid_el0=0x4 glibc-2.43.9000-8 dl_dst_lib="lib64" dl_hwcap=0xffbfffff dl_hwcap2=0x3b6181 dl_hwcap3=0x0 dl_hwcap4=0x0 dl_hwcaps_subdirs="" dl_hwcaps_subdirs_active=0x0 dl_pagesize=0x1000 dl_platform="aarch64" dl_profile_output=0x0 dso.ld="ld-linux-aarch64.so.1" dso.libc="libc.so.6" env_filtered[0x0]="ANTHROPIC_VERTEX_PROJECT_ID" env_filtered[0x1]="CLAUDE_CODE_USE_VERTEX" env_filtered[0x2]="CLOUD_ML_REGION" env_filtered[0x3]="COLORTERM" env_filtered[0x4]="DBUS_SESSION_BUS_ADDRESS" env_filtered[0x5]="DEBUGINFOD_IMA_CERT_PATH" env_filtered[0x6]="DEBUGINFOD_URLS" env_filtered[0x7]="DESKTOP_SESSION" env_filtered[0x8]="DISPLAY" env_filtered[0x9]="EDITOR" env_filtered[0xa]="GDMSESSION" env_filtered[0xb]="GDM_LANG" env_filtered[0xc]="GIO_LAUNCHED_DESKTOP_FILE" env_filtered[0xd]="GIO_LAUNCHED_DESKTOP_FILE_PID" env_filtered[0xe]="GJS_DEBUG_OUTPUT" env_filtered[0xf]="GJS_DEBUG_TOPICS" env_filtered[0x10]="GNOME_SETUP_DISPLAY" env_filtered[0x11]="GPG_TTY" env_filtered[0x12]="GUESTFISH_INIT" env_filtered[0x13]="GUESTFISH_OUTPUT" env_filtered[0x14]="GUESTFISH_PS1" env_filtered[0x15]="GUESTFISH_RESTORE" env_filtered[0x16]="HISTCONTROL" env_filtered[0x17]="HISTSIZE" env_filtered[0x18]="HOME" env_filtered[0x19]="HOSTNAME" env_filtered[0x1a]="INVOCATION_ID" env_filtered[0x1b]="JOURNAL_STREAM" env_filtered[0x1c]="KDEDIRS" env[0x1d]="LANG=en_US.utf8" env_filtered[0x1e]="LESS" env_filtered[0x1f]="LESSOPEN" env_filtered[0x20]="LOGNAME" env_filtered[0x21]="LSCOLORS" env_filtered[0x22]="LS_COLORS" env_filtered[0x23]="MAIL" env_filtered[0x24]="MANAGERPID" env_filtered[0x25]="MANAGERPIDFDID" env_filtered[0x26]="MEMORY_PRESSURE_WATCH" env_filtered[0x27]="MEMORY_PRESSURE_WRITE" env_filtered[0x28]="MOZ_GMP_PATH" env_filtered[0x29]="OLDPWD" env_filtered[0x2a]="PAGER" env[0x2b]="PATH=/home/kevin/.local/bin:/home/kevin/bin:/usr/local/bin:/home/kevin/.local/bin:/home/kevin/bin:/usr/local/bin:/usr/local/bin:/usr/bin" env_filtered[0x2c]="PWD" env_filtered[0x2d]="QT_IM_MODULE" env_filtered[0x2e]="QT_IM_MODULES" env_filtered[0x2f]="SHELL" env_filtered[0x30]="SHLVL" env_filtered[0x31]="SSH_ASKPASS" env_filtered[0x32]="SSH_AUTH_SOCK" env_filtered[0x33]="SYSTEMD_EXEC_PID" env_filtered[0x34]="TERM" env_filtered[0x35]="TERM_PROGRAM" env_filtered[0x36]="TERM_PROGRAM_VERSION" env_filtered[0x37]="TMUX" env_filtered[0x38]="TMUX_PANE" env_filtered[0x39]="USER" env_filtered[0x3a]="USERNAME" env_filtered[0x3b]="WAYLAND_DISPLAY" env_filtered[0x3c]="XAUTHORITY" env_filtered[0x3d]="XDG_CURRENT_DESKTOP" env_filtered[0x3e]="XDG_DATA_DIRS" env_filtered[0x3f]="XDG_MENU_PREFIX" env_filtered[0x40]="XDG_RUNTIME_DIR" env_filtered[0x41]="XDG_SESSION_CLASS" env_filtered[0x42]="XDG_SESSION_DESKTOP" env_filtered[0x43]="XDG_SESSION_EXTRA_DEVICE_ACCESS" env_filtered[0x44]="XDG_SESSION_TYPE" env_filtered[0x45]="XMODIFIERS" env_filtered[0x46]="ZSH" env_filtered[0x47]="_" path.prefix="/usr" path.rtld="/lib/ld-linux-aarch64.so.1" path.sysconfdir="/etc" path.system_dirs[0x0]="/lib64/" path.system_dirs[0x1]="/usr/lib64/" version.release="development" version.version="2.43.9000" auxv[0x0].a_type=0x21 auxv[0x0].a_val=0xffff96da7000 auxv[0x1].a_type=0x33 auxv[0x1].a_val=0x1270 auxv[0x2].a_type=0x10 auxv[0x2].a_val=0xffbfffff auxv[0x3].a_type=0x6 auxv[0x3].a_val=0x1000 auxv[0x4].a_type=0x11 auxv[0x4].a_val=0x64 auxv[0x5].a_type=0x3 auxv[0x5].a_val=0xffff96d60040 auxv[0x6].a_type=0x4 auxv[0x6].a_val=0x38 auxv[0x7].a_type=0x5 auxv[0x7].a_val=0xa auxv[0x8].a_type=0x7 auxv[0x8].a_val=0x0 auxv[0x9].a_type=0x8 auxv[0x9].a_val=0x0 auxv[0xa].a_type=0x9 auxv[0xa].a_val=0xffff96d7cc80 auxv[0xb].a_type=0xb auxv[0xb].a_val=0x3e8 auxv[0xc].a_type=0xc auxv[0xc].a_val=0x3e8 auxv[0xd].a_type=0xd auxv[0xd].a_val=0x3e8 auxv[0xe].a_type=0xe auxv[0xe].a_val=0x3e8 auxv[0xf].a_type=0x17 auxv[0xf].a_val=0x0 auxv[0x10].a_type=0x19 auxv[0x10].a_val=0xffffdbee0438 auxv[0x11].a_type=0x1a auxv[0x11].a_val=0x3b6181 auxv[0x12].a_type=0x1d auxv[0x12].a_val=0x0 auxv[0x13].a_type=0x1f auxv[0x13].a_val_string="usr/lib/ld-linux-aarch64.so.1" auxv[0x14].a_type=0xf auxv[0x14].a_val_string="aarch64" auxv[0x15].a_type=0x1b auxv[0x15].a_val=0x21 auxv[0x16].a_type=0x1c auxv[0x16].a_val=0x40 uname.sysname="Linux" uname.nodename="orm.scrye.com" uname.release="7.0.0-0.rc7.260409g7f87a5ea75f0.57.fc45.aarch64" uname.version="#1 SMP PREEMPT_DYNAMIC Thu Apr 9 17:41:30 UTC 2026" uname.machine="aarch64" uname.domainname="(none)" aarch64.cpu_features.bti=0x1 aarch64.cpu_features.midr_el1=0x511f0011 aarch64.cpu_features.mops=0x0 aarch64.cpu_features.mte_state=0x0 aarch64.cpu_features.sve=0x0 aarch64.cpu_features.zva_size=0x40 aarch64.processor[0x0].requested=0x0 aarch64.processor[0x0].observed=0x0 aarch64.processor[0x0].observed_node=0x0 aarch64.processor[0x0].midr_el1=0x512f0011 aarch64.processor[0x0].dczid_el0=0x4 aarch64.processor[0x1].requested=0x1 aarch64.processor[0x1].observed=0x1 aarch64.processor[0x1].observed_node=0x0 aarch64.processor[0x1].midr_el1=0x512f0011 aarch64.processor[0x1].dczid_el0=0x4 aarch64.processor[0x2].requested=0x2 aarch64.processor[0x2].observed=0x2 aarch64.processor[0x2].observed_node=0x0 aarch64.processor[0x2].midr_el1=0x512f0011 aarch64.processor[0x2].dczid_el0=0x4 aarch64.processor[0x3].requested=0x3 aarch64.processor[0x3].observed=0x3 aarch64.processor[0x3].observed_node=0x0 aarch64.processor[0x3].midr_el1=0x512f0011 aarch64.processor[0x3].dczid_el0=0x4 aarch64.processor[0x4].requested=0x4 aarch64.processor[0x4].observed=0x4 aarch64.processor[0x4].observed_node=0x0 aarch64.processor[0x4].midr_el1=0x511f0011 aarch64.processor[0x4].dczid_el0=0x4 aarch64.processor[0x5].requested=0x5 aarch64.processor[0x5].observed=0x5 aarch64.processor[0x5].observed_node=0x0 aarch64.processor[0x5].midr_el1=0x511f0011 aarch64.processor[0x5].dczid_el0=0x4 aarch64.processor[0x6].requested=0x6 aarch64.processor[0x6].observed=0x6 aarch64.processor[0x6].observed_node=0x0 aarch64.processor[0x6].midr_el1=0x511f0011 aarch64.processor[0x6].dczid_el0=0x4 aarch64.processor[0x7].requested=0x7 aarch64.processor[0x7].observed=0x7 aarch64.processor[0x7].observed_node=0x0 aarch64.processor[0x7].midr_el1=0x511f0011 aarch64.processor[0x7].dczid_el0=0x4 aarch64.processor[0x8].requested=0x8 aarch64.processor[0x8].observed=0x8 aarch64.processor[0x8].observed_node=0x0 aarch64.processor[0x8].midr_el1=0x511f0011 aarch64.processor[0x8].dczid_el0=0x4 aarch64.processor[0x9].requested=0x9 aarch64.processor[0x9].observed=0x9 aarch64.processor[0x9].observed_node=0x0 aarch64.processor[0x9].midr_el1=0x511f0011 aarch64.processor[0x9].dczid_el0=0x4 aarch64.processor[0xa].requested=0xa aarch64.processor[0xa].observed=0xa aarch64.processor[0xa].observed_node=0x0 aarch64.processor[0xa].midr_el1=0x511f0011 aarch64.processor[0xa].dczid_el0=0x4 aarch64.processor[0xb].requested=0xb aarch64.processor[0xb].observed=0xb aarch64.processor[0xb].observed_node=0x0 aarch64.processor[0xb].midr_el1=0x511f0011 aarch64.processor[0xb].dczid_el0=0x4 diff: 93c93 < auxv[0x0].a_val=0xffffabaf8000 --- > auxv[0x0].a_val=0xffff96da7000 103c103 < auxv[0x5].a_val=0xffffabab0040 --- > auxv[0x5].a_val=0xffff96d60040 113c113 < auxv[0xa].a_val=0xffffabaccc40 --- > auxv[0xa].a_val=0xffff96d7cc80 125c125 < auxv[0x10].a_val=0xffffc7450538 --- > auxv[0x10].a_val=0xffffdbee0438 131c131 < auxv[0x13].a_val_string="/usr/bin/ld.so" --- > auxv[0x13].a_val_string="usr/lib/ld-linux-aarch64.so.1" This is a lenovo slim7x
Here's a data point that may or may not be related. Yesterday's Rawhide images don't boot on Azure because the initramfs suddenly stopped including hv_storvsc. If I boot the images from the 8th, then update glibc, and then run dracut -f it creates an initramfs that's half the size and includes just a couple kernel modules. If I run dracut -f before updating glibc, it rebuilds the initramfs with all the modules it previously included. This happens on x86_64 and aarch64: [root@fedora boot]# lsinitrd initramfs-7.0.0-0.rc7.55.fc45.aarch64.img | grep hv drwxr-xr-x 2 root root 0 Jan 22 00:00 usr/lib/modules/7.0.0-0.rc7.55.fc45.aarch64/kernel/drivers/hv -rw-r--r-- 1 root root 53336 Jan 22 00:00 usr/lib/modules/7.0.0-0.rc7.55.fc45.aarch64/kernel/drivers/hv/hv_vmbus.ko.xz -rw-r--r-- 1 root root 17360 Jan 22 00:00 usr/lib/modules/7.0.0-0.rc7.55.fc45.aarch64/kernel/drivers/scsi/hv_storvsc.ko.xz [root@fedora boot]# lsinitrd initramfs-7.0.0-0.rc7.55.fc45.aarch64.img | grep .*ko.xz | wc -l 1837 [root@fedora boot]# ls -lah total 76M dr-xr-xr-x. 1 root root 560 Apr 8 06:08 . drwxr-xr-x. 1 root root 166 Apr 8 06:08 .. -rw-r--r--. 1 root root 335K Apr 6 00:00 config-7.0.0-0.rc7.55.fc45.aarch64 lrwxrwxrwx. 1 root root 31 Apr 8 06:07 dtb -> dtb-7.0.0-0.rc7.55.fc45.aarch64 drwxr-xr-x. 1 root root 216 Apr 8 06:06 dtb-7.0.0-0.rc7.55.fc45.aarch64 drwx------. 3 root root 16K Jan 1 1970 efi drwx------. 1 root root 52 Apr 8 06:08 grub2 -rw-r--r--. 1 root root 51M Apr 8 06:08 initramfs-7.0.0-0.rc7.55.fc45.aarch64.img drwxr-xr-x. 1 root root 14 Apr 8 06:06 loader -rw-r--r--. 1 root root 11 Apr 8 06:08 mbrid lrwxrwxrwx. 1 root root 51 Apr 8 06:07 symvers-7.0.0-0.rc7.55.fc45.aarch64.xz -> /lib/modules/7.0.0-0.rc7.55.fc45.aarch64/symvers.xz -rw-r--r--. 1 root root 9.2M Apr 6 00:00 System.map-7.0.0-0.rc7.55.fc45.aarch64 -rwxr-xr-x. 1 root root 17M Apr 6 00:00 vmlinuz-7.0.0-0.rc7.55.fc45.aarch64 -rw-r--r--. 1 root root 166 Apr 6 00:00 .vmlinuz-7.0.0-0.rc7.55.fc45.aarch64.hmac [root@fedora boot]# dracut -f -v dracut[I]: Executing: /usr/bin/dracut -f -v dracut[I]: 70bluetooth: Could not find any command of '/usr/lib/bluetooth/bluetoothd /usr/libexec/bluetooth/bluetoothd'! dracut[I]: *** Including module: bash *** dracut[I]: *** Including module: systemd *** dracut[I]: *** Including module: fips *** dracut[I]: *** Including module: fips-crypto-policies *** dracut[I]: *** Including module: systemd-ask-password *** dracut[I]: *** Including module: systemd-battery-check *** dracut[I]: *** Including module: systemd-cryptsetup *** dracut[I]: *** Including module: systemd-initrd *** dracut[I]: *** Including module: systemd-journald *** dracut[I]: *** Including module: systemd-modules-load *** dracut[I]: *** Including module: systemd-pcrphase *** dracut[I]: *** Including module: systemd-sysctl *** dracut[I]: *** Including module: systemd-tmpfiles *** dracut[I]: *** Including module: systemd-udevd *** dracut[I]: *** Including module: i18n *** dracut[I]: *** Including module: btrfs *** dracut[I]: *** Including module: crypt *** dracut[I]: *** Including module: dm *** dracut[I]: *** Including module: fs-lib *** dracut[I]: *** Including module: kernel-modules *** dracut[I]: *** Including module: kernel-modules-extra *** dracut[I]: *** Including module: lvm *** dracut[I]: *** Including module: mdraid *** dracut[I]: *** Including module: nvdimm *** dracut[I]: *** Including module: qemu *** dracut[I]: *** Including module: prefixdevname *** dracut[I]: *** Including module: fido2 *** dracut[I]: *** Including module: pkcs11 *** dracut[I]: *** Including module: tpm2-tss *** dracut[I]: *** Including module: hwdb *** dracut[I]: *** Including module: lunmask *** dracut[I]: *** Including module: resume *** dracut[I]: *** Including module: rootfs-block *** dracut[I]: *** Including module: terminfo *** dracut[I]: *** Including module: udev-rules *** dracut[I]: *** Including module: virtiofs *** dracut[I]: *** Including module: dracut-systemd *** dracut[I]: *** Including module: initqueue *** dracut[I]: *** Including module: usrmount *** dracut[I]: *** Including module: systemd-sysusers *** dracut[I]: *** Including module: base *** dracut[I]: *** Including module: memstrack *** dracut[I]: *** Including module: shell-interpreter *** dracut[I]: *** Including module: shutdown *** dracut[I]: *** Including module: azure-disk *** dracut[I]: *** Including module: azure-unmanaged-sriov *** dracut[I]: *** Including module: walinuxagent *** dracut[I]: *** Including module: openssl *** dracut[I]: *** Including modules done *** dracut[I]: *** Installing kernel module dependencies *** dracut[I]: *** Installing kernel module dependencies done *** dracut[I]: *** Resolving executable dependencies *** dracut[I]: *** Resolving executable dependencies done *** dracut[I]: Could not find 'strip'. Not stripping the initramfs. dracut[I]: *** Store current command line parameters *** dracut[I]: *** Creating image file '/boot/initramfs-7.0.0-0.rc7.55.fc45.aarch64.img.tmp' *** dracut[I]: *** Hardlinking files *** dracut[I]: *** Hardlinking files done *** dracut[I]: Using auto-determined compression method 'zstd' dracut[I]: *** Creating initramfs image file '/boot/initramfs-7.0.0-0.rc7.55.fc45.aarch64.img.tmp' done *** dracut[I]: *** Moving image file '/boot/initramfs-7.0.0-0.rc7.55.fc45.aarch64.img.tmp' to '/boot/initramfs-7.0.0-0.rc7.55.fc45.aarch64.img' *** dracut[I]: *** Moving image file '/boot/initramfs-7.0.0-0.rc7.55.fc45.aarch64.img.tmp' to '/boot/initramfs-7.0.0-0.rc7.55.fc45.aarch64.img' done *** [root@fedora boot]# ls -lah total 76M dr-xr-xr-x. 1 root root 560 Apr 10 14:08 . drwxr-xr-x. 1 root root 166 Apr 8 06:08 .. -rw-r--r--. 1 root root 335K Apr 6 00:00 config-7.0.0-0.rc7.55.fc45.aarch64 lrwxrwxrwx. 1 root root 31 Apr 8 06:07 dtb -> dtb-7.0.0-0.rc7.55.fc45.aarch64 drwxr-xr-x. 1 root root 216 Apr 8 06:06 dtb-7.0.0-0.rc7.55.fc45.aarch64 drwx------. 3 root root 16K Jan 1 1970 efi drwx------. 1 root root 52 Apr 8 06:08 grub2 -rw-------. 1 root root 51M Apr 10 14:08 initramfs-7.0.0-0.rc7.55.fc45.aarch64.img drwxr-xr-x. 1 root root 14 Apr 8 06:06 loader -rw-r--r--. 1 root root 11 Apr 8 06:08 mbrid lrwxrwxrwx. 1 root root 51 Apr 8 06:07 symvers-7.0.0-0.rc7.55.fc45.aarch64.xz -> /lib/modules/7.0.0-0.rc7.55.fc45.aarch64/symvers.xz -rw-r--r--. 1 root root 9.2M Apr 6 00:00 System.map-7.0.0-0.rc7.55.fc45.aarch64 -rwxr-xr-x. 1 root root 17M Apr 6 00:00 vmlinuz-7.0.0-0.rc7.55.fc45.aarch64 -rw-r--r--. 1 root root 166 Apr 6 00:00 .vmlinuz-7.0.0-0.rc7.55.fc45.aarch64.hmac [root@fedora boot]# lsinitrd initramfs-7.0.0-0.rc7.55.fc45.aarch64.img | grep .*ko.xz | wc -l 1837 [root@fedora boot]# dnf update glibc Updating and loading repositories: Fedora rawhide openh264 (From Cisco) - aarch64 100% | 3.9 KiB/s | 2.6 KiB | 00m01s Fedora - Rawhide - Developmental packages for the next Fedora release 100% | 9.0 MiB/s | 20.5 MiB | 00m02s Repositories loaded. Package Arch Version Repository Size Upgrading: glibc aarch64 0:2.43.9000-8.fc45 rawhide 6.4 MiB replacing glibc aarch64 0:2.43.9000-7.fc45 a0d18492d39a44f997c3c9999e625eb6 6.4 MiB glibc-common aarch64 0:2.43.9000-8.fc45 rawhide 1.3 MiB replacing glibc-common aarch64 0:2.43.9000-7.fc45 a0d18492d39a44f997c3c9999e625eb6 1.3 MiB glibc-gconv-extra aarch64 0:2.43.9000-8.fc45 rawhide 18.6 MiB replacing glibc-gconv-extra aarch64 0:2.43.9000-7.fc45 a0d18492d39a44f997c3c9999e625eb6 18.6 MiB glibc-langpack-en aarch64 0:2.43.9000-8.fc45 rawhide 5.7 MiB replacing glibc-langpack-en aarch64 0:2.43.9000-7.fc45 a0d18492d39a44f997c3c9999e625eb6 5.7 MiB glibc-minimal-langpack aarch64 0:2.43.9000-8.fc45 rawhide 0.0 B replacing glibc-minimal-langpack aarch64 0:2.43.9000-7.fc45 a0d18492d39a44f997c3c9999e625eb6 0.0 B Transaction Summary: Upgrading: 5 packages Replacing: 5 packages Total size of inbound packages is 5 MiB. Need to download 5 MiB. After this operation, 856 B extra will be used (install 32 MiB, remove 32 MiB). Is this ok [y/N]: y [1/5] glibc-minimal-langpack-0:2.43.9000-8.fc45.aarch64 100% | 616.3 KiB/s | 93.1 KiB | 00m00s [2/5] glibc-common-0:2.43.9000-8.fc45.aarch64 100% | 2.0 MiB/s | 369.7 KiB | 00m00s [3/5] glibc-0:2.43.9000-8.fc45.aarch64 100% | 6.2 MiB/s | 2.0 MiB | 00m00s [4/5] glibc-langpack-en-0:2.43.9000-8.fc45.aarch64 100% | 3.4 MiB/s | 639.4 KiB | 00m00s [5/5] glibc-gconv-extra-0:2.43.9000-8.fc45.aarch64 100% | 6.6 MiB/s | 1.8 MiB | 00m00s ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- [5/5] Total 100% | 10.8 MiB/s | 4.8 MiB | 00m00s Running transaction Importing OpenPGP key 0xF577861E: UserID : "Fedora (45) <fedora-45-primary>" Fingerprint: 4F50A6114CD5C6976A7F1179655A4B02F577861E From : file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-rawhide-aarch64 Is this ok [y/N]: y The key was successfully imported. Importing OpenPGP key 0x91211FCE: UserID : "Fedora (46) <fedora-46-primary>" Fingerprint: D924B10D3E810DABDD8B56B596E7E91491211FCE From : file:///etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-46-aarch64 Is this ok [y/N]: y The key was successfully imported. [ 1/12] Verify package files 100% | 333.0 B/s | 5.0 B | 00m00s [ 2/12] Prepare transaction 100% | 161.0 B/s | 10.0 B | 00m00s [ 3/12] Upgrading glibc-0:2.43.9000-8.fc45.aarch64 100% | 7.5 MiB/s | 6.5 MiB | 00m01s [ 4/12] Upgrading glibc-common-0:2.43.9000-8.fc45.aarch64 100% | 20.4 MiB/s | 1.3 MiB | 00m00s [ 5/12] Upgrading glibc-langpack-en-0:2.43.9000-8.fc45.aarch64 100% | 25.9 MiB/s | 5.8 MiB | 00m00s [ 6/12] Upgrading glibc-gconv-extra-0:2.43.9000-8.fc45.aarch64 100% | 137.4 MiB/s | 18.7 MiB | 00m00s [ 7/12] Upgrading glibc-minimal-langpack-0:2.43.9000-8.fc45.aarch64 100% | 24.2 KiB/s | 124.0 B | 00m00s [ 8/12] Removing glibc-minimal-langpack-0:2.43.9000-7.fc45.aarch64 100% | 6.5 KiB/s | 100.0 B | 00m00s [ 9/12] Removing glibc-0:2.43.9000-7.fc45.aarch64 100% | 436.0 B/s | 103.0 B | 00m00s [10/12] Removing glibc-langpack-en-0:2.43.9000-7.fc45.aarch64 100% | 70.6 KiB/s | 506.0 B | 00m00s [11/12] Removing glibc-gconv-extra-0:2.43.9000-7.fc45.aarch64 100% | 4.7 KiB/s | 630.0 B | 00m00s [12/12] Removing glibc-common-0:2.43.9000-7.fc45.aarch64 100% | 168.0 B/s | 53.0 B | 00m00s Complete! [root@fedora boot]# dracut -f -v dracut[I]: Executing: /usr/bin/dracut -f -v dracut[I]: 70bluetooth: Could not find any command of '/usr/lib/bluetooth/bluetoothd /usr/libexec/bluetooth/bluetoothd'! dracut[I]: *** Including module: bash *** dracut[I]: *** Including module: systemd *** dracut[I]: *** Including module: fips *** dracut[I]: *** Including module: fips-crypto-policies *** dracut[I]: *** Including module: systemd-ask-password *** dracut[I]: *** Including module: systemd-battery-check *** dracut[I]: *** Including module: systemd-cryptsetup *** dracut[I]: *** Including module: systemd-initrd *** dracut[I]: *** Including module: systemd-journald *** dracut[I]: *** Including module: systemd-modules-load *** dracut[I]: *** Including module: systemd-pcrphase *** dracut[I]: *** Including module: systemd-sysctl *** dracut[I]: *** Including module: systemd-tmpfiles *** dracut[I]: *** Including module: systemd-udevd *** dracut[I]: *** Including module: i18n *** dracut[I]: *** Including module: btrfs *** dracut[I]: *** Including module: crypt *** dracut[I]: *** Including module: dm *** dracut[I]: *** Including module: fs-lib *** dracut[I]: *** Including module: kernel-modules *** dracut[I]: *** Including module: kernel-modules-extra *** dracut[I]: *** Including module: lvm *** dracut[I]: *** Including module: mdraid *** dracut[I]: *** Including module: nvdimm *** dracut[I]: *** Including module: qemu *** dracut[I]: *** Including module: prefixdevname *** dracut[I]: *** Including module: fido2 *** dracut[I]: *** Including module: pkcs11 *** dracut[I]: *** Including module: tpm2-tss *** dracut[I]: *** Including module: hwdb *** dracut[I]: *** Including module: lunmask *** dracut[I]: *** Including module: resume *** dracut[I]: *** Including module: rootfs-block *** dracut[I]: *** Including module: terminfo *** dracut[I]: *** Including module: udev-rules *** dracut[I]: *** Including module: virtiofs *** dracut[I]: *** Including module: dracut-systemd *** dracut[I]: *** Including module: initqueue *** dracut[I]: *** Including module: usrmount *** dracut[I]: *** Including module: systemd-sysusers *** dracut[I]: *** Including module: base *** dracut[I]: *** Including module: memstrack *** dracut[I]: *** Including module: shell-interpreter *** dracut[I]: *** Including module: shutdown *** dracut[I]: *** Including module: azure-disk *** dracut[I]: *** Including module: azure-unmanaged-sriov *** dracut[I]: *** Including module: walinuxagent *** dracut[I]: *** Including module: openssl *** dracut[I]: *** Including modules done *** dracut[I]: *** Installing kernel module dependencies *** dracut[I]: *** Installing kernel module dependencies done *** dracut[I]: *** Resolving executable dependencies *** dracut[I]: *** Resolving executable dependencies done *** dracut[I]: Could not find 'strip'. Not stripping the initramfs. dracut[I]: *** Store current command line parameters *** dracut[I]: *** Creating image file '/boot/initramfs-7.0.0-0.rc7.55.fc45.aarch64.img.tmp' *** dracut[I]: *** Hardlinking files *** dracut[I]: *** Hardlinking files done *** dracut[I]: Using auto-determined compression method 'zstd' dracut[I]: *** Creating initramfs image file '/boot/initramfs-7.0.0-0.rc7.55.fc45.aarch64.img.tmp' done *** dracut[I]: *** Moving image file '/boot/initramfs-7.0.0-0.rc7.55.fc45.aarch64.img.tmp' to '/boot/initramfs-7.0.0-0.rc7.55.fc45.aarch64.img' *** dracut[I]: *** Moving image file '/boot/initramfs-7.0.0-0.rc7.55.fc45.aarch64.img.tmp' to '/boot/initramfs-7.0.0-0.rc7.55.fc45.aarch64.img' done *** [root@fedora boot]# lsinitrd initramfs-7.0.0-0.rc7.55.fc45.aarch64.img | grep .*ko.xz | wc -l 39 [root@fedora boot]# ls -lah total 53M dr-xr-xr-x. 1 root root 560 Apr 10 14:09 . drwxr-xr-x. 1 root root 166 Apr 8 06:08 .. -rw-r--r--. 1 root root 335K Apr 6 00:00 config-7.0.0-0.rc7.55.fc45.aarch64 lrwxrwxrwx. 1 root root 31 Apr 8 06:07 dtb -> dtb-7.0.0-0.rc7.55.fc45.aarch64 drwxr-xr-x. 1 root root 216 Apr 8 06:06 dtb-7.0.0-0.rc7.55.fc45.aarch64 drwx------. 3 root root 16K Jan 1 1970 efi drwx------. 1 root root 52 Apr 8 06:08 grub2 -rw-------. 1 root root 28M Apr 10 14:09 initramfs-7.0.0-0.rc7.55.fc45.aarch64.img drwxr-xr-x. 1 root root 14 Apr 8 06:06 loader -rw-r--r--. 1 root root 11 Apr 8 06:08 mbrid lrwxrwxrwx. 1 root root 51 Apr 8 06:07 symvers-7.0.0-0.rc7.55.fc45.aarch64.xz -> /lib/modules/7.0.0-0.rc7.55.fc45.aarch64/symvers.xz -rw-r--r--. 1 root root 9.2M Apr 6 00:00 System.map-7.0.0-0.rc7.55.fc45.aarch64 -rwxr-xr-x. 1 root root 17M Apr 6 00:00 vmlinuz-7.0.0-0.rc7.55.fc45.aarch64 -rw-r--r--. 1 root root 166 Apr 6 00:00 .vmlinuz-7.0.0-0.rc7.55.fc45.aarch64.hmac [root@fedora boot]#
If file lists change unexpectedly, it's more likely to be about this: - io: Use gnulib fts implementation (BZ 22944, BZ 20331) (Adhemerval Zanella) rather than the aarch64-specific changes. And dracut uses fts, see src/install/dracut-install.c. This could still be a dracut bug rather than an fts bug.
Some discussion on the glibc list: <https://inbox.sourceware.org/libc-alpha/87jyueodvo.fsf@gmail.com/> I'm going to put a patch in place that switches back to the old fts implementation.
Great. I pulled in glibc-2.43.9000-10.fc45.aarch64 and it does resolve the dracut issue. Hopefully nirik was having the same problem.
Yes, seems to fix the blank screen on boot issue here too.
*** Bug 2458109 has been marked as a duplicate of this bug. ***
I fixed the glibc test problem and got an update stable, it's in the latest compose, and all the things that broke in openQA are working again. Closing, please re-open if anything is not actually fixed.
Adam, thanks for pushing this over the finishing line. I don't know yet where the discussion goes in upstream glibc. Do you know why the OpenQA testing did not find this issue during glibc gating? Did we never run dracut with the updated glibc on a file system that exposes the problem? Or did we waive a failure incorrectly?
The update test set doesn't happen to include any tests that were affected by the problem :/ We run ~174 tests on updates (max set, which applies to glibc). We run ~660 tests max per compose. Picking what goes in the update set is a bit of a balance. The more tests we put in, the more resources it takes and the more flakes there are to deal with. I keep gradually expanding it (it was under 70 not long ago, I think), but there will probably always be cases like this. I haven't actually checked, but I *think* all the update tests likely use either btrfs or xfs, because they use base images produced by virt-install with kickstarts that use `autopart` (the ones from https://forge.fedoraproject.org/quality/createhdds ), or they run default installs. I have for some time wanted to set up a mechanism whereby we run an extended set of install tests on *some* updates - the ones that seem particularly likely to break install paths - but I'm a bit stuck in defining that set. "Everything in the installer environment" is probably overkill, but it's hard to pluck out a subset.
Okay, thank you. Agreed that there will always be gaps. We wouldn't have flagged this update as particularly test-worthy, either, had we the option. We wouldn't have guessed that dract used fts in a problematic way. I was just worried we had waived something incorrectly because that did happen in the past.
So, there's something odd here: it seems like ELN is suffering from this bug even though it has glibc-2.43.9000-12. I've checked and the ELN build definitely applied the patches for this - you can see them in https://kojipkgs.fedoraproject.org//packages/glibc/2.43.9000/12.eln156/data/logs/x86_64/build.log . But when we build an initramfs on ELN, it's missing a lot of filesystem- and crypto-related modules, just like in this bug, notably ext4, fat, isofs, jbd2, loop, msdos, squashfs, vfat and zram. Any idea why this would still be happening on ELN?
False alarm, the ELN issue is something else (bad module signatures).