Bug 502957

Summary: mkinitrd-6.0.71-4 not loading modules! Broken crypto!
Product: [Fedora] Fedora Reporter: Michael H. Warfield <mhw>
Component: mkinitrdAssignee: Peter Jones <pjones>
Status: CLOSED NOTABUG QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: urgent Docs Contact:
Priority: low    
Version: 10CC: hdegoede, katzj, pjones, wtogami
Target Milestone: ---   
Target Release: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2009-05-28 13:10:44 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
Requested log file from bash -x run. none

Description Michael H. Warfield 2009-05-27 22:30:09 UTC
Description of problem:

I have a system with and encrypted root.  The recent kernel upgrade resulted in an epic fail.  No video driver (radeon), no dm-mapper, no crypto.  Could not progress past plymouth asking for the password.

Examination of the initrd revealed not a single .ko file in  lib/modules/2.6.27.24-170.2.68.fc10.i686/.  Tried including all the previous .ko files explicitly on the mkinitrd command line.  No joy.  No modules appeared in the resulting initrd file.  Went back and reran this mkinird against the previous kernel.  The resulting initrd file is smaller and contains NO .ko files.

Problem...  mkinitrd was upgraded to 6.0.71-4 back on March 21 and the kernel was upgraded to 2.6.27.21-170.2.56 in April 2 without a problem.  Now it's been upgraded to 2.6.27.24-170.2.68 and it's broken and trying to rebuild the 2.6.27.21-170.2.56 initrd is also broken?!?!  Confused.  Something has changed.


Version-Release number of selected component (if applicable):

mkinitrd 6.0.71-4
kernel 2.6.27.24-170.2.68

How reproducible:

Very.  Tried to recreate the initrd image several times.  No modules are showing up in lib/modules/{rev}

Steps to Reproduce:
1.  Run mkinitrd
2.  Try to boot
3.  Epic fail.  Complains of ioctl errors and no crypto
4.  Reboot to valid config.
5.  Unpack initrd in a temp directory with "zcat {image} | cpio -icvdm"
6.  Examine lib/modules/{kernel-rev}
7.  Observe: Lots of modules.* files.  NO .ko files.

Actual results:

Failure to boot.

Expected results:

Boot.

Additional info:

Verbose output from mkinitrd:

[root@canyon boot]# mkinitrd -v -f /boot/initrd-2.6.27.24-170.2.68.fc10-new.i686.img 2.6.27.24-170.2.68.fc10.i686
Creating initramfs
Found root device mapper/luks-sda3 for /dev/mapper/luks-sda3
Looking for driver for device mapper/luks-sda3
Looking for driver for device sda3
Looking for deps of module scsi:t-0x00
Looking for deps of module pci:v00008086d000027C5sv000017AAsd0000200Dbc01sc06i01
Found swsusp device /sys/block/sda//sda5 for /dev/sda5
Looking for driver for device /sys/block/sda//sda5
Looking for driver for device sda5
Using modules:  dm-crypt aes cbc sha256
Building initrd in /tmp/initrd.r0GoPW
/sbin/nash -> /tmp/initrd.r0GoPW/bin/nash
  /usr/lib/libnash.so.6.0.71 -> /tmp/initrd.r0GoPW/usr/lib/libnash.so.6.0.71
  /usr/lib/libbdevid.so.6.0.71 -> /tmp/initrd.r0GoPW/usr/lib/libbdevid.so.6.0.71
  /lib/libdevmapper.so.1.02 -> /tmp/initrd.r0GoPW/lib/libdevmapper.so.1.02
  /lib/libparted-1.8.so.8 -> /tmp/initrd.r0GoPW/lib/libparted-1.8.so.8
    /lib//libparted-1.8.so.8.0.0 -> /tmp/initrd.r0GoPW/lib//libparted-1.8.so.8.0.0
  /lib/libblkid.so.1 -> /tmp/initrd.r0GoPW/lib/libblkid.so.1
    /lib//libblkid.so.1.0 -> /tmp/initrd.r0GoPW/lib//libblkid.so.1.0
  /lib/libselinux.so.1 -> /tmp/initrd.r0GoPW/lib/libselinux.so.1
  /lib/libsepol.so.1 -> /tmp/initrd.r0GoPW/lib/libsepol.so.1
  /lib/libuuid.so.1 -> /tmp/initrd.r0GoPW/lib/libuuid.so.1
    /lib//libuuid.so.1.2 -> /tmp/initrd.r0GoPW/lib//libuuid.so.1.2
  /lib/libpopt.so.0 -> /tmp/initrd.r0GoPW/lib/libpopt.so.0
    /lib//libpopt.so.0.0.0 -> /tmp/initrd.r0GoPW/lib//libpopt.so.0.0.0
  /lib/libresolv.so.2 -> /tmp/initrd.r0GoPW/lib/libresolv.so.2
    /lib//libresolv-2.9.so -> /tmp/initrd.r0GoPW/lib//libresolv-2.9.so
      /lib/i686/nosegneg/libc.so.6 -> /tmp/initrd.r0GoPW/lib/libc.so.6
        /lib/i686/nosegneg//libc-2.9.so -> /tmp/initrd.r0GoPW/lib//libc-2.9.so
          /lib/ld-linux.so.2 -> /tmp/initrd.r0GoPW/lib/ld-linux.so.2
            /lib//ld-2.9.so -> /tmp/initrd.r0GoPW/lib//ld-2.9.so
  /lib/libdl.so.2 -> /tmp/initrd.r0GoPW/lib/libdl.so.2
    /lib//libdl-2.9.so -> /tmp/initrd.r0GoPW/lib//libdl-2.9.so
  /usr/lib/libelf.so.1 -> /tmp/initrd.r0GoPW/usr/lib/libelf.so.1
    /usr/lib//libelf-0.141.so -> /tmp/initrd.r0GoPW/usr/lib//libelf-0.141.so
  /usr/lib/libdhcp-1.99.so.1 -> /tmp/initrd.r0GoPW/usr/lib/libdhcp-1.99.so.1
    /usr/lib//libdhcp-1.99.so.1.0.7 -> /tmp/initrd.r0GoPW/usr/lib//libdhcp-1.99.so.1.0.7
  /usr/lib/libnl.so.1 -> /tmp/initrd.r0GoPW/usr/lib/libnl.so.1
    /usr/lib//libnl.so.1.1 -> /tmp/initrd.r0GoPW/usr/lib//libnl.so.1.1
  /usr/lib/libdhcp4client-4.0.so.0 -> /tmp/initrd.r0GoPW/usr/lib/libdhcp4client-4.0.so.0
    /usr/lib//libdhcp4client-4.0.so.0.0.0 -> /tmp/initrd.r0GoPW/usr/lib//libdhcp4client-4.0.so.0.0.0
  /usr/lib/libdhcp6client-1.0.so.2 -> /tmp/initrd.r0GoPW/usr/lib/libdhcp6client-1.0.so.2
    /usr/lib//libdhcp6client-1.0.so.2.0.20 -> /tmp/initrd.r0GoPW/usr/lib//libdhcp6client-1.0.so.2.0.20
  /lib/i686/nosegneg/libm.so.6 -> /tmp/initrd.r0GoPW/lib/libm.so.6
    /lib/i686/nosegneg//libm-2.9.so -> /tmp/initrd.r0GoPW/lib//libm-2.9.so
  /lib/libgcc_s.so.1 -> /tmp/initrd.r0GoPW/lib/libgcc_s.so.1
    /lib//libgcc_s-4.3.2-20081105.so.1 -> /tmp/initrd.r0GoPW/lib//libgcc_s-4.3.2-20081105.so.1
/sbin/modprobe -> /tmp/initrd.r0GoPW/bin/modprobe
/sbin/rmmod -> /tmp/initrd.r0GoPW/bin/rmmod
resolving for MODULES
and that has items of dm-crypt aes cbc sha256
Looking for deps of module dm-crypt: crypto_blkcipher 
Looking for deps of module aes: aes_generic crypto_blkcipher padlock-aes aes_generic aes-i586 aes_generic 
Looking for deps of module cbc: crypto_blkcipher 
Looking for deps of module sha256: sha256_generic padlock-sha 
Looking for deps of module aes: aes_generic crypto_blkcipher padlock-aes aes_generic aes-i586 aes_generic 
Looking for deps of module aes_generic
Looking for deps of module aes-i586: aes_generic 
Looking for deps of module cbc: crypto_blkcipher 
Looking for deps of module crypto_blkcipher
Looking for deps of module dm-crypt: crypto_blkcipher 
Looking for deps of module padlock-aes: aes_generic crypto_blkcipher 
Looking for deps of module padlock-sha
Looking for deps of module sha256: sha256_generic padlock-sha 
Looking for deps of module sha256_generic
resolving for availmodules
and that has items of 
/sbin/cryptsetup -> /tmp/initrd.r0GoPW/sbin/cryptsetup
  /lib/libcryptsetup.so.0 -> /tmp/initrd.r0GoPW/lib/libcryptsetup.so.0
    /lib//libcryptsetup.so.0.0.0 -> /tmp/initrd.r0GoPW/lib//libcryptsetup.so.0.0.0
  /lib/libgcrypt.so.11 -> /tmp/initrd.r0GoPW/lib/libgcrypt.so.11
    /lib//libgcrypt.so.11.5.2 -> /tmp/initrd.r0GoPW/lib//libgcrypt.so.11.5.2
  /lib/libgpg-error.so.0 -> /tmp/initrd.r0GoPW/lib/libgpg-error.so.0
    /lib//libgpg-error.so.0.4.0 -> /tmp/initrd.r0GoPW/lib//libgpg-error.so.0.4.0
/etc/sysconfig/keyboard -> /tmp/initrd.r0GoPW/etc/sysconfig/keyboard
/bin/loadkeys -> /tmp/initrd.r0GoPW/bin/loadkeys
/lib/kbd/keymaps/i386/qwerty/us.map.gz -> /tmp/initrd.r0GoPW/lib/kbd/keymaps/i386/qwerty/us.map.gz
/lib/kbd/keymaps/i386/include/qwerty-layout.inc -> /tmp/initrd.r0GoPW/lib/kbd/keymaps/i386/include/qwerty-layout.inc
/lib/kbd/keymaps/include/compose.latin2 -> /tmp/initrd.r0GoPW/lib/kbd/keymaps/include/compose.latin2
/lib/kbd/keymaps/include/compose.latin -> /tmp/initrd.r0GoPW/lib/kbd/keymaps/include/compose.latin
/lib/kbd/keymaps/include/compose.latin4 -> /tmp/initrd.r0GoPW/lib/kbd/keymaps/include/compose.latin4
/lib/kbd/keymaps/include/compose.latin3 -> /tmp/initrd.r0GoPW/lib/kbd/keymaps/include/compose.latin3
/lib/kbd/keymaps/include/compose.8859_8 -> /tmp/initrd.r0GoPW/lib/kbd/keymaps/include/compose.8859_8
/lib/kbd/keymaps/include/compose.8859_7 -> /tmp/initrd.r0GoPW/lib/kbd/keymaps/include/compose.8859_7
/lib/kbd/keymaps/include/compose.latin1 -> /tmp/initrd.r0GoPW/lib/kbd/keymaps/include/compose.latin1
/lib/kbd/keymaps/i386/include/compose.inc -> /tmp/initrd.r0GoPW/lib/kbd/keymaps/i386/include/compose.inc
/lib/kbd/keymaps/i386/include/linux-with-alt-and-altgr.inc -> /tmp/initrd.r0GoPW/lib/kbd/keymaps/i386/include/linux-with-alt-and-altgr.inc
/lib/kbd/keymaps/i386/include/linux-keys-bare.inc -> /tmp/initrd.r0GoPW/lib/kbd/keymaps/i386/include/linux-keys-bare.inc
/lib/kbd/keymaps/i386/include/euro1.map.gz -> /tmp/initrd.r0GoPW/lib/kbd/keymaps/i386/include/euro1.map.gz
/etc/sysconfig/i18n -> /tmp/initrd.r0GoPW/etc/sysconfig/i18n
/bin/setfont -> /tmp/initrd.r0GoPW/bin/setfont
/lib/kbd/consolefonts/latarcyrheb-sun16.psfu.gz -> /tmp/initrd.r0GoPW/lib/kbd/consolefonts/latarcyrheb-sun16.psfu.gz
/lib/udev/console_init -> /tmp/initrd.r0GoPW/lib/udev/console_init
  /lib/libglib-2.0.so.0 -> /tmp/initrd.r0GoPW/lib/libglib-2.0.so.0
    /lib//libglib-2.0.so.0.1800.4 -> /tmp/initrd.r0GoPW/lib//libglib-2.0.so.0.1800.4
probing for modules for drm device card0
Adding graphics device card0
Looking for deps of module pci:v00001002d000071C4sv000017AAsd00002007bc03sc00i00: i2c-core i2c-algo-bit drm radeon 
Adding module i2c-core
Adding module i2c-algo-bit
Adding module drm
Adding module radeon
resolving for GRAPHICSMODS
and that has items of i2c-core i2c-algo-bit drm radeon
Looking for deps of module i2c-core
Looking for deps of module i2c-algo-bit: i2c-core 
Looking for deps of module drm: i2c-core 
Looking for deps of module radeon: i2c-core i2c-algo-bit drm 
/sbin/plymouthd -> /tmp/initrd.r0GoPW/bin/plymouthd
  /lib/libply.so.2 -> /tmp/initrd.r0GoPW/lib/libply.so.2
    /lib//libply.so.2.0.0 -> /tmp/initrd.r0GoPW/lib//libply.so.2.0.0
  /usr/lib/libplybootsplash.so.2 -> /tmp/initrd.r0GoPW/usr/lib/libplybootsplash.so.2
    /usr/lib//libplybootsplash.so.2.0.0 -> /tmp/initrd.r0GoPW/usr/lib//libplybootsplash.so.2.0.0
  /usr/lib/libpng12.so.0 -> /tmp/initrd.r0GoPW/usr/lib/libpng12.so.0
    /usr/lib//libpng12.so.0.35.0 -> /tmp/initrd.r0GoPW/usr/lib//libpng12.so.0.35.0
  /lib/i686/nosegneg/librt.so.1 -> /tmp/initrd.r0GoPW/lib/librt.so.1
    /lib/i686/nosegneg//librt-2.9.so -> /tmp/initrd.r0GoPW/lib//librt-2.9.so
      /lib/i686/nosegneg/libpthread.so.0 -> /tmp/initrd.r0GoPW/lib/libpthread.so.0
        /lib/i686/nosegneg//libpthread-2.9.so -> /tmp/initrd.r0GoPW/lib//libpthread-2.9.so
  /lib/libz.so.1 -> /tmp/initrd.r0GoPW/lib/libz.so.1
    /lib//libz.so.1.2.3 -> /tmp/initrd.r0GoPW/lib//libz.so.1.2.3
/bin/plymouth -> /tmp/initrd.r0GoPW/bin/plymouth
/usr/lib/plymouth/text.so -> /tmp/initrd.r0GoPW/usr/lib/plymouth/text.so
/usr/lib/plymouth/details.so -> /tmp/initrd.r0GoPW/usr/lib/plymouth/details.so
/usr/share/pixmaps/system-logo-white.png -> /tmp/initrd.r0GoPW/usr/share/pixmaps/system-logo-white.png
/etc/system-release -> /tmp/initrd.r0GoPW/etc/system-release
  /etc//fedora-release -> /tmp/initrd.r0GoPW/etc//fedora-release
/usr/lib/plymouth/solar.so -> /tmp/initrd.r0GoPW/usr/lib/plymouth/solar.so
/usr/lib/plymouth/default.so -> /tmp/initrd.r0GoPW/usr/lib/plymouth/default.so
/usr/share/plymouth/solar/box.png -> /tmp/initrd.r0GoPW/usr/share/plymouth/solar/box.png
/usr/share/plymouth/solar/bullet.png -> /tmp/initrd.r0GoPW/usr/share/plymouth/solar/bullet.png
/usr/share/plymouth/solar/entry.png -> /tmp/initrd.r0GoPW/usr/share/plymouth/solar/entry.png
/usr/share/plymouth/solar/lock.png -> /tmp/initrd.r0GoPW/usr/share/plymouth/solar/lock.png
/usr/share/plymouth/solar/progress_bar.png -> /tmp/initrd.r0GoPW/usr/share/plymouth/solar/progress_bar.png
/usr/share/plymouth/solar/star.png -> /tmp/initrd.r0GoPW/usr/share/plymouth/solar/star.png
Adding module scsi_wait_scan
Adding module dm-crypt
Adding module aes
Adding module cbc
Adding module sha256
This initrd uses dynamic shared objects.
Adding dynamic linker configuration files.
/etc/ld.so.conf -> /tmp/initrd.r0GoPW/etc/ld.so.conf
/etc/ld.so.conf.d/mysql-i386.conf -> /tmp/initrd.r0GoPW/etc/ld.so.conf.d/mysql-i386.conf
/etc/ld.so.conf.d/libicu-compat.conf -> /tmp/initrd.r0GoPW/etc/ld.so.conf.d/libicu-compat.conf
/etc/ld.so.conf.d/agnclient-compat.conf -> /tmp/initrd.r0GoPW/etc/ld.so.conf.d/agnclient-compat.conf
/etc/ld.so.conf.d/agns.conf -> /tmp/initrd.r0GoPW/etc/ld.so.conf.d/agns.conf
/etc/ld.so.conf.d/openldap-compat.conf -> /tmp/initrd.r0GoPW/etc/ld.so.conf.d/openldap-compat.conf
/etc/ld.so.conf.d/symav.conf -> /tmp/initrd.r0GoPW/etc/ld.so.conf.d/symav.conf
/etc/ld.so.conf.d/kernel-2.6.27.24-170.2.68.fc10.i686.conf -> /tmp/initrd.r0GoPW/etc/ld.so.conf.d/kernel-2.6.27.24-170.2.68.fc10.i686.conf
/etc/ld.so.conf.d/xulrunner-32.conf -> /tmp/initrd.r0GoPW/etc/ld.so.conf.d/xulrunner-32.conf
/etc/ld.so.conf.d/qt-i386.conf -> /tmp/initrd.r0GoPW/etc/ld.so.conf.d/qt-i386.conf
/etc/ld.so.conf.d/atlas-i386.conf -> /tmp/initrd.r0GoPW/etc/ld.so.conf.d/atlas-i386.conf
/etc/ld.so.conf.d/tix-i386.conf -> /tmp/initrd.r0GoPW/etc/ld.so.conf.d/tix-i386.conf
/etc/ld.so.conf.d/wine-32.conf -> /tmp/initrd.r0GoPW/etc/ld.so.conf.d/wine-32.conf
/etc/ld.so.conf.d/openmotif-compat.conf -> /tmp/initrd.r0GoPW/etc/ld.so.conf.d/openmotif-compat.conf
/etc/ld.so.conf.d/ctapi-i386.conf -> /tmp/initrd.r0GoPW/etc/ld.so.conf.d/ctapi-i386.conf
/etc/ld.so.conf.d/kernel-2.6.27.21-170.2.56.fc10.i686.conf -> /tmp/initrd.r0GoPW/etc/ld.so.conf.d/kernel-2.6.27.21-170.2.56.fc10.i686.conf
Running ldconfig

(Note the last ld.so.conf.d lines...  Wrong verion?  What gives with that?)

Resulting image:

[root@canyon boot]# zcat initrd-2.6.27.24-170.2.68.fc10.i686.img | cpio -itv
drwx------   2 root     root            0 May 27 17:30 sys
lrwxrwxrwx   1 root     root            3 May 27 17:30 sbin -> bin
drwx------   4 root     root            0 May 27 17:30 etc
-rw-r--r--   1 root     root           30 Nov  6  2008 etc/fedora-release
drwx------   2 root     root            0 May 27 17:30 etc/ld.so.conf.d
-rw-r--r--   1 root     root           23 Feb 13  2008 etc/ld.so.conf.d/libicu-compat.conf
-rw-r--r--   1 root     root           15 Mar  7 15:29 etc/ld.so.conf.d/mysql-i386.conf
-rwxr-xr-x   1 root     root           26 Oct  2  2008 etc/ld.so.conf.d/openmotif-compat.conf
-rwxr-xr-x   1 root     root           25 Feb 15  2007 etc/ld.so.conf.d/openldap-compat.conf
-rwxr-xr-x   1 root     root           26 Nov 21  2007 etc/ld.so.conf.d/agnclient-compat.conf
-rw-r--r--   1 root     root           15 Feb 19  2008 etc/ld.so.conf.d/ctapi-i386.conf
-rw-r--r--   1 root     root           20 Oct  8  2008 etc/ld.so.conf.d/qt-i386.conf
-r--r--r--   1 root     root          324 May 20 23:19 etc/ld.so.conf.d/kernel-2.6.27.24-170.2.68.fc10.i686.conf
-rw-r--r--   1 root     root           15 Jan  2  2006 etc/ld.so.conf.d/wine-32.conf
-rw-r--r--   1 root     root           16 Jul 28  2008 etc/ld.so.conf.d/tix-i386.conf
-rw-r--r--   1 root     root          165 May  7 23:37 etc/ld.so.conf.d/symav.conf
-r--r--r--   1 root     root          324 Mar 23 23:51 etc/ld.so.conf.d/kernel-2.6.27.21-170.2.56.fc10.i686.conf
-rw-r--r--   1 root     root           23 Apr 27 08:30 etc/ld.so.conf.d/xulrunner-32.conf
-rw-r--r--   1 root     root           15 May  6  2008 etc/ld.so.conf.d/atlas-i386.conf
-rw-r--r--   1 root     root           14 Mar  9 10:53 etc/ld.so.conf.d/agns.conf
-rw-r--r--   1 root     root           28 Nov 13  2008 etc/ld.so.conf
lrwxrwxrwx   1 root     root           14 May 27 17:30 etc/system-release -> fedora-release
-rw-r--r--   1 root     root         2262 May 27 17:30 etc/ld.so.cache
drwx------   2 root     root            0 May 27 17:30 etc/sysconfig
-rw-r--r--   1 root     root           32 Jun 18  2008 etc/sysconfig/keyboard
-rw-r--r--   1 root     root           47 Jun 18  2008 etc/sysconfig/i18n
drwx------   6 root     root            0 May 27 17:30 lib
-rwxr-xr-x   1 root     root       497040 Jan 30 10:53 lib/libgcrypt.so.11.5.2
lrwxrwxrwx   1 root     root           27 May 27 17:30 lib/libcryptsetup.so.0 -> /lib/libcryptsetup.so.0.0.0
-rwxr-xr-x   1 root     root        95188 Nov 19  2008 lib/libdevmapper.so.1.02
lrwxrwxrwx   1 root     root           26 May 27 17:30 lib/libgpg-error.so.0 -> /lib/libgpg-error.so.0.4.0
lrwxrwxrwx   1 root     root           11 May 27 17:30 lib/libm.so.6 -> libm-2.9.so
-rwxr-xr-x   1 root     root        20460 Dec  8 08:33 lib/libdl-2.9.so
lrwxrwxrwx   1 root     root           17 May 27 17:30 lib/libdl.so.2 -> /lib/libdl-2.9.so
lrwxrwxrwx   1 root     root           27 May 27 17:30 lib/libparted-1.8.so.8 -> /lib/libparted-1.8.so.8.0.0
-rwxr-xr-x   1 root     root       237440 Sep 30  2008 lib/libsepol.so.1
-rwxr-xr-x   1 root     root       431652 Jun  5  2008 lib/libparted-1.8.so.8.0.0
lrwxrwxrwx   1 root     root           20 May 27 17:30 lib/libblkid.so.1 -> /lib/libblkid.so.1.0
-rwxr-xr-x   1 root     root        34904 May 25  2008 lib/libpopt.so.0.0.0
-rwxr-xr-x   1 root     root        79376 Feb 13  2008 lib/libz.so.1.2.3
drwx------   4 root     root            0 May 27 17:30 lib/kbd
drwx------   2 root     root            0 May 27 17:30 lib/kbd/consolefonts
-rw-r--r--   1 root     root        10312 Feb 26  2008 lib/kbd/consolefonts/latarcyrheb-sun16.psfu
drwx------   4 root     root            0 May 27 17:30 lib/kbd/keymaps
drwx------   4 root     root            0 May 27 17:30 lib/kbd/keymaps/i386
drwx------   2 root     root            0 May 27 17:30 lib/kbd/keymaps/i386/qwerty
-rw-r--r--   1 root     root         1973 Feb 26  2008 lib/kbd/keymaps/i386/qwerty/us.map
drwx------   2 root     root            0 May 27 17:30 lib/kbd/keymaps/i386/include
-rw-r--r--   1 root     root          743 Feb 26  2008 lib/kbd/keymaps/i386/include/linux-with-alt-and-altgr.inc
-rw-r--r--   1 root     root          278 Feb 26  2008 lib/kbd/keymaps/i386/include/compose.inc
-rw-r--r--   1 root     root         4346 Feb 26  2008 lib/kbd/keymaps/i386/include/linux-keys-bare.inc
-rw-r--r--   1 root     root          253 Feb 26  2008 lib/kbd/keymaps/i386/include/euro1.map
-rw-r--r--   1 root     root          430 Feb 26  2008 lib/kbd/keymaps/i386/include/qwerty-layout.inc
drwx------   2 root     root            0 May 27 17:30 lib/kbd/keymaps/include
-rw-r--r--   1 root     root         2037 Feb 26  2008 lib/kbd/keymaps/include/compose.latin3
-rw-r--r--   1 root     root         6030 Feb 26  2008 lib/kbd/keymaps/include/compose.latin
-rw-r--r--   1 root     root         3889 Feb 26  2008 lib/kbd/keymaps/include/compose.latin1
-rw-r--r--   1 root     root         2897 Feb 26  2008 lib/kbd/keymaps/include/compose.latin4
-rw-r--r--   1 root     root           23 Feb 26  2008 lib/kbd/keymaps/include/compose.8859_8
-rw-r--r--   1 root     root          517 Feb 26  2008 lib/kbd/keymaps/include/compose.8859_7
-rw-r--r--   1 root     root         3465 Feb 26  2008 lib/kbd/keymaps/include/compose.latin2
-rwxr-xr-x   1 root     root       114200 Mar  2 13:30 lib/libselinux.so.1
-rwxr-xr-x   1 root     root        55224 Nov  5  2008 lib/libgcc_s-4.3.2-20081105.so.1
lrwxrwxrwx   1 root     root           15 May 27 17:30 lib/libply.so.2 -> libply.so.2.0.0
-rwxr-xr-x   1 root     root        46436 Dec  8 08:33 lib/librt-2.9.so
-rwxr-xr-x   1 root     root        13420 Feb 20  2008 lib/libgpg-error.so.0.4.0
-rwxr-xr-x   1 root     root       156948 Dec  8 08:33 lib/ld-2.9.so
-rwxr-xr-x   1 root     root        46796 Apr 11 09:37 lib/libblkid.so.1.0
lrwxrwxrwx   1 root     root           17 May 27 17:30 lib/libpthread.so.0 -> libpthread-2.9.so
lrwxrwxrwx   1 root     root           21 May 27 17:30 lib/libresolv.so.2 -> /lib/libresolv-2.9.so
-rwxr-xr-x   1 root     root        15832 Apr 11 09:37 lib/libuuid.so.1.2
-rwxr-xr-x   1 root     root        55224 Oct 30  2008 lib/libcryptsetup.so.0.0.0
drwx------   2 root     root            0 May 27 17:30 lib/firmware
-rwxr-xr-x   1 root     root       930292 Mar 12 10:04 lib/libglib-2.0.so.0.1800.4
drwx------   3 root     root            0 May 27 17:30 lib/modules
drwx------   2 root     root            0 May 27 17:30 lib/modules/2.6.27.24-170.2.68.fc10.i686
-rw-------   1 root     root           81 May 27 17:30 lib/modules/2.6.27.24-170.2.68.fc10.i686/modules.isapnpmap
-rw-------   1 root     root           49 May 27 17:30 lib/modules/2.6.27.24-170.2.68.fc10.i686/modules.symbols
-rw-------   1 root     root           99 May 27 17:30 lib/modules/2.6.27.24-170.2.68.fc10.i686/modules.pcimap
-rw-------   1 root     root           45 May 27 17:30 lib/modules/2.6.27.24-170.2.68.fc10.i686/modules.alias
-rw-------   1 root     root          189 May 27 17:30 lib/modules/2.6.27.24-170.2.68.fc10.i686/modules.usbmap
-rw-------   1 root     root           69 May 27 17:30 lib/modules/2.6.27.24-170.2.68.fc10.i686/modules.ccwmap
-rw-------   1 root     root           43 May 27 17:30 lib/modules/2.6.27.24-170.2.68.fc10.i686/modules.seriomap
-rw-------   1 root     root           74 May 27 17:30 lib/modules/2.6.27.24-170.2.68.fc10.i686/modules.ofmap
-rw-------   1 root     root            8 May 27 17:30 lib/modules/2.6.27.24-170.2.68.fc10.i686/modules.dep.bin
-rw-------   1 root     root            8 May 27 17:30 lib/modules/2.6.27.24-170.2.68.fc10.i686/modules.alias.bin
-rw-------   1 root     root            8 May 27 17:30 lib/modules/2.6.27.24-170.2.68.fc10.i686/modules.symbols.bin
-rw-------   1 root     root            0 May 27 17:30 lib/modules/2.6.27.24-170.2.68.fc10.i686/modules.dep
-rw-------   1 root     root           73 May 27 17:30 lib/modules/2.6.27.24-170.2.68.fc10.i686/modules.ieee1394map
-rw-------   1 root     root          141 May 27 17:30 lib/modules/2.6.27.24-170.2.68.fc10.i686/modules.inputmap
-rwxr-xr-x   1 root     root        94316 Dec  8 08:33 lib/libresolv-2.9.so
lrwxrwxrwx   1 root     root           11 May 27 17:30 lib/libc.so.6 -> libc-2.9.so
lrwxrwxrwx   1 root     root           28 May 27 17:30 lib/libglib-2.0.so.0 -> /lib/libglib-2.0.so.0.1800.4
-rwxr-xr-x   1 root     root       137876 Dec  8 08:33 lib/libpthread-2.9.so
lrwxrwxrwx   1 root     root           21 May 27 17:30 lib/libpopt.so.0 -> /lib/libpopt.so.0.0.0
lrwxrwxrwx   1 root     root           33 May 27 17:30 lib/libgcc_s.so.1 -> /lib/libgcc_s-4.3.2-20081105.so.1
-rwxr-xr-x   1 root     root      1822668 Dec  8 08:33 lib/libc-2.9.so
lrwxrwxrwx   1 root     root           12 May 27 17:30 lib/librt.so.1 -> librt-2.9.so
lrwxrwxrwx   1 root     root           24 May 27 17:30 lib/libgcrypt.so.11 -> /lib/libgcrypt.so.11.5.2
drwx------   2 root     root            0 May 27 17:30 lib/udev
-rwxr-xr-x   1 root     root        12096 Apr  7 12:04 lib/udev/console_init
lrwxrwxrwx   1 root     root           13 May 27 17:30 lib/libz.so.1 -> libz.so.1.2.3
lrwxrwxrwx   1 root     root           19 May 27 17:30 lib/libuuid.so.1 -> /lib/libuuid.so.1.2
lrwxrwxrwx   1 root     root           14 May 27 17:30 lib/ld-linux.so.2 -> /lib/ld-2.9.so
-rwxr-xr-x   1 root     root        81772 Nov 17  2008 lib/libply.so.2.0.0
-rwxr-xr-x   1 root     root       208276 Dec  8 08:33 lib/libm-2.9.so
drwx------   3 root     root            0 May 27 17:30 dev
crw-------   1 root     root       4,   0 May 27 17:30 dev/systty
crw-------   1 root     root       4,   9 May 27 17:30 dev/tty9
drwx------   2 root     root            0 May 27 17:30 dev/mapper
lrwxrwxrwx   1 root     root            4 May 27 17:30 dev/ram -> ram1
crw-------   1 root     root       4,   4 May 27 17:30 dev/tty4
crw-------   1 root     root       5,   2 May 27 17:30 dev/ptmx
crw-------   1 root     root       4,  66 May 27 17:30 dev/ttyS2
crw-------   1 root     root       4,   2 May 27 17:30 dev/tty2
brw-------   1 root     root       1,   0 May 27 17:30 dev/ram0
crw-------   1 root     root       4,   0 May 27 17:30 dev/tty0
crw-------   1 root     root       4,  65 May 27 17:30 dev/ttyS1
crw-------   1 root     root       4,  67 May 27 17:30 dev/ttyS3
crw-------   1 root     root       4,   8 May 27 17:30 dev/tty8
crw-------   1 root     root       4,  10 May 27 17:30 dev/tty10
crw-------   1 root     root       4,   3 May 27 17:30 dev/tty3
crw-------   1 root     root       1,   3 May 27 17:30 dev/null
crw-------   1 root     root       4,  12 May 27 17:30 dev/tty12
crw-------   1 root     root       5,   1 May 27 17:30 dev/console
crw-------   1 root     root       4,   5 May 27 17:30 dev/tty5
crw-------   1 root     root       4,   6 May 27 17:30 dev/tty6
crw-------   1 root     root       4,   7 May 27 17:30 dev/tty7
crw-------   1 root     root       1,   5 May 27 17:30 dev/zero
crw-------   1 root     root       5,   0 May 27 17:30 dev/tty
crw-------   1 root     root       4,   1 May 27 17:30 dev/tty1
crw-------   1 root     root       4,  64 May 27 17:30 dev/ttyS0
crw-------   1 root     root       4,  11 May 27 17:30 dev/tty11
brw-------   1 root     root       1,   1 May 27 17:30 dev/ram1
drwx------   4 root     root            0 May 27 17:30 usr
drwx------   3 root     root            0 May 27 17:30 usr/lib
lrwxrwxrwx   1 root     root           25 May 27 17:30 usr/lib/libplybootsplash.so.2 -> libplybootsplash.so.2.0.0
lrwxrwxrwx   1 root     root           24 May 27 17:30 usr/lib/libelf.so.1 -> /usr/lib/libelf-0.141.so
lrwxrwxrwx   1 root     root           30 May 27 17:30 usr/lib/libdhcp-1.99.so.1 -> /usr/lib/libdhcp-1.99.so.1.0.7
-rwxr-xr-x   1 root     root        86176 Apr 22  2008 usr/lib/libdhcp-1.99.so.1.0.7
-rwxr-xr-x   1 root     root       162696 Sep 12  2008 usr/lib/libdhcp6client-1.0.so.2.0.20
lrwxrwxrwx   1 root     root           21 May 27 17:30 usr/lib/libnl.so.1 -> /usr/lib/libnl.so.1.1
-rwxr-xr-x   1 root     root       108592 Feb 12 05:45 usr/lib/libnash.so.6.0.71
-rwxr-xr-x   1 root     root        16180 Feb 12 05:45 usr/lib/libbdevid.so.6.0.71
drwx------   2 root     root            0 May 27 17:30 usr/lib/plymouth
-rwxr-xr-x   1 root     root        10344 Nov 17  2008 usr/lib/plymouth/text.so
-rwxr-xr-x   1 root     root         9292 Nov 17  2008 usr/lib/plymouth/details.so
lrwxrwxrwx   1 root     root            8 May 27 17:30 usr/lib/plymouth/default.so -> solar.so
-rwxr-xr-x   1 root     root        29768 Nov 17  2008 usr/lib/plymouth/solar.so
-rwxr-xr-x   1 root     root       158324 Feb 25 14:48 usr/lib/libpng12.so.0.35.0
lrwxrwxrwx   1 root     root           36 May 27 17:30 usr/lib/libdhcp4client-4.0.so.0 -> /usr/lib/libdhcp4client-4.0.so.0.0.0
-rwxr-xr-x   1 root     root       325948 Jun 27  2008 usr/lib/libnl.so.1.1
lrwxrwxrwx   1 root     root           18 May 27 17:30 usr/lib/libpng12.so.0 -> libpng12.so.0.35.0
-rwxr-xr-x   1 root     root       541624 Apr 20 18:57 usr/lib/libdhcp4client-4.0.so.0.0.0
lrwxrwxrwx   1 root     root           37 May 27 17:30 usr/lib/libdhcp6client-1.0.so.2 -> /usr/lib/libdhcp6client-1.0.so.2.0.20
-rwxr-xr-x   1 root     root        93376 Apr 24 16:58 usr/lib/libelf-0.141.so
-rwxr-xr-x   1 root     root        41452 Nov 17  2008 usr/lib/libplybootsplash.so.2.0.0
drwx------   4 root     root            0 May 27 17:30 usr/share
drwx------   3 root     root            0 May 27 17:30 usr/share/plymouth
drwx------   2 root     root            0 May 27 17:30 usr/share/plymouth/solar
-rw-r--r--   1 root     root          246 Nov 17  2008 usr/share/plymouth/solar/progress_bar.png
-rw-r--r--   1 root     root          870 Nov 17  2008 usr/share/plymouth/solar/box.png
-rw-r--r--   1 root     root         1896 Nov 17  2008 usr/share/plymouth/solar/lock.png
-rw-r--r--   1 root     root       355666 Nov 17  2008 usr/share/plymouth/solar/star.png
-rw-r--r--   1 root     root          350 Nov 17  2008 usr/share/plymouth/solar/entry.png
-rw-r--r--   1 root     root          296 Nov 17  2008 usr/share/plymouth/solar/bullet.png
drwx------   2 root     root            0 May 27 17:30 usr/share/pixmaps
-rw-r--r--   1 root     root        78115 Mar 21 20:52 usr/share/pixmaps/system-logo-white.png
drwx------   2 root     root            0 May 27 17:30 sysroot
drwx------   2 root     root            0 May 27 17:30 bin
-rwxr-xr-x   1 root     root        85132 Feb 26  2008 bin/loadkeys
-rwxr-xr-x   1 root     root         9912 Oct 13  2008 bin/rmmod
-rwxr-xr-x   1 root     root        95180 Oct 13  2008 bin/modprobe
-rwxr-xr-x   1 root     root        94892 Feb 12 05:45 bin/nash
-rwxr-xr-x   1 root     root        38408 Nov 17  2008 bin/plymouthd
-rwxr-xr-x   1 root     root        22428 Nov 17  2008 bin/plymouth
-rwxr-xr-x   1 root     root        36332 Feb 26  2008 bin/setfont
-rwxr-xr-x   1 root     root        18480 Oct 30  2008 bin/cryptsetup
drwx------   2 root     root            0 May 27 17:30 proc
-rwx------   1 root     root         2104 May 27 17:30 init
14997 blocks

Note: No modules in lib/modules/{kernel_rev}

Comment 1 Hans de Goede 2009-05-28 07:01:42 UTC
Weird bug.

Can you please run:
bash -x /sbin/mkinitrd -f 
/boot/initrd-2.6.27.24-170.2.68.fc10-new.i686.img 2.6.27.24-170.2.68.fc10.i686 &> log

And the attach the resulting log file? Thank you.

Comment 2 Michael H. Warfield 2009-05-28 12:50:30 UTC
Created attachment 345751 [details]
Requested log file from bash -x run.

Log file, as requested, from running bash -x /sbin/mkinitrd -f /boot/initrd-2.6.27.24-170.2.68.fc10-new.i686.img 2.6.27.24-170.2.68.fc10.i686 &> log

Comment 3 Michael H. Warfield 2009-05-28 13:10:44 UTC
Never mind.  I discovered the problem.  While trying to debug wine and FORCE rpm and rpmbuild to install unstripped binaries, "/usr/bin/strip" had been replaced some time ago with a symlink to "/bin/true" to prevent anything from being stripped.  This had the side effect of screwing up the "installmodule" function in /usr/libexec/initrd-functions.  Self inflicted injury.