Created attachment 985532 [details] photo of boot messages Description of problem: After updating to 3.18.3, my Thinkpad x230 fails to boot. It hangs at the fedora logo. Selecting 3.17.8 from grub allows me to boot. Version-Release number of selected component (if applicable): kernel-3.17.8-300.fc21.x86_64 (and earlier) Works kernel-3.18.3-201.fc21.x86_64 Fails to boot to login screen How reproducible: 3 out of 3 Steps to Reproduce: 1. Select 3.18.3 from grub 2. enter disk encryption password 3. system hangs at fedora logo Actual results: Hang (waited several minutes) Expected results: Login screen Additional info: If I remove "rhgb quiet" from the grub command, I see some error messages: [ TIME ] Timed out waiting for device dev-disk-by\x2duuid-62bae2a7.... [ DEPEND ] Dependency failed for /boot. [ DEPEND ] Dependency failed for Local File Systems ... See attached screen shot. My system has a SATA HDD containing /data, plus an mSATA SSD containing / and /home (encrypted with luks). On a successful boot my 'mount' looks like: sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime,seclabel) proc on /proc type proc (rw,nosuid,nodev,noexec,relatime) devtmpfs on /dev type devtmpfs (rw,nosuid,seclabel,size=6048612k,nr_inodes=1512153,mode=755) securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime) tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev,seclabel) devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,seclabel,gid=5,mode=620,ptmxmode=000) tmpfs on /run type tmpfs (rw,nosuid,nodev,seclabel,mode=755) tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,seclabel,mode=755) cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd) pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime) efivarfs on /sys/firmware/efi/efivars type efivarfs (rw,nosuid,nodev,noexec,relatime) cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset) cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct) cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory) cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices) cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer) cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio) cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio) cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event) cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb) configfs on /sys/kernel/config type configfs (rw,relatime) /dev/sdb5 on / type btrfs (rw,noatime,seclabel,ssd,space_cache) selinuxfs on /sys/fs/selinux type selinuxfs (rw,relatime) systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=28,pgrp=1,timeout=300,minproto=5,maxproto=5,direct) debugfs on /sys/kernel/debug type debugfs (rw,relatime) mqueue on /dev/mqueue type mqueue (rw,relatime,seclabel) tmpfs on /tmp type tmpfs (rw,seclabel) hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,seclabel) binfmt_misc on /proc/sys/fs/binfmt_misc type binfmt_misc (rw,relatime) /dev/sdb2 on /boot type ext4 (rw,relatime,seclabel,data=ordered) /dev/sdb3 on /boot/efi type vfat (rw,relatime,fmask=0077,dmask=0077,codepage=437,iocharset=ascii,shortname=winnt,errors=remount-ro) /dev/sda7 on /data type ext4 (rw,noatime,seclabel,data=ordered) /dev/mapper/luks-090216a3-ccda-473c-8328-cd58387b2818 on /home type btrfs (rw,noatime,seclabel,ssd,space_cache) tmpfs on /run/user/994 type tmpfs (rw,nosuid,nodev,relatime,seclabel,size=1211876k,mode=700,uid=994,gid=992) tmpfs on /run/user/1000 type tmpfs (rw,nosuid,nodev,relatime,seclabel,size=1211876k,mode=700,uid=1000,gid=1000) gvfsd-fuse on /run/user/1000/gvfs type fuse.gvfsd-fuse (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000) fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime) /dev/mmcblk0p1 on /run/media/sam/EOS_DIGITAL type vfat (rw,nosuid,nodev,relatime,uid=1000,gid=1000,fmask=0022,dmask=0077,codepage=437,iocharset=ascii,shortname=mixed,showexec,utf8,flush,errors=remount-ro,uhelper=udisks2) tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,seclabel,size=1211876k,mode=700) lspci 00:00.0 Host bridge: Intel Corporation 3rd Gen Core processor DRAM Controller (rev 09) 00:02.0 VGA compatible controller: Intel Corporation 3rd Gen Core processor Graphics Controller (rev 09) 00:14.0 USB controller: Intel Corporation 7 Series/C210 Series Chipset Family USB xHCI Host Controller (rev 04) 00:16.0 Communication controller: Intel Corporation 7 Series/C210 Series Chipset Family MEI Controller #1 (rev 04) 00:16.3 Serial controller: Intel Corporation 7 Series/C210 Series Chipset Family KT Controller (rev 04) 00:19.0 Ethernet controller: Intel Corporation 82579LM Gigabit Network Connection (rev 04) 00:1a.0 USB controller: Intel Corporation 7 Series/C210 Series Chipset Family USB Enhanced Host Controller #2 (rev 04) 00:1b.0 Audio device: Intel Corporation 7 Series/C210 Series Chipset Family High Definition Audio Controller (rev 04) 00:1c.0 PCI bridge: Intel Corporation 7 Series/C210 Series Chipset Family PCI Express Root Port 1 (rev c4) 00:1c.1 PCI bridge: Intel Corporation 7 Series/C210 Series Chipset Family PCI Express Root Port 2 (rev c4) 00:1c.2 PCI bridge: Intel Corporation 7 Series/C210 Series Chipset Family PCI Express Root Port 3 (rev c4) 00:1d.0 USB controller: Intel Corporation 7 Series/C210 Series Chipset Family USB Enhanced Host Controller #1 (rev 04) 00:1f.0 ISA bridge: Intel Corporation QM77 Express Chipset LPC Controller (rev 04) 00:1f.2 SATA controller: Intel Corporation 7 Series Chipset Family 6-port SATA Controller [AHCI mode] (rev 04) 00:1f.3 SMBus: Intel Corporation 7 Series/C210 Series Chipset Family SMBus Controller (rev 04) 02:00.0 System peripheral: Ricoh Co Ltd MMC/SD Host Controller (rev 07) 03:00.0 Network controller: Intel Corporation Centrino Advanced-N 6205 [Taylor Peak] (rev 34)
Same boot hang on a W530 with mSATA SSD + SATA SSD + SATA HDD
Same issue here on a x220 with SATA SSD and without using LUKS...
Same behaviour with the following Kernel packages: kernel-3.18.5-201.fc21.x86_64 kernel-3.19.0-0.rc7.git0.1.fc22.x86_64 Also regenerating the initramfs for kernel-3.17.8-300.fc21.x86_64 did not result in any problems and regenerating the initramfs for kernel-3.18.3-201.fc21.x86_64 did not result in any problems. I used rd.break=cleanup and saved the log (journalctl -b0 ) to the disk, see the attached log.
Sorry, that should have been: Also regenerating the initramfs for kernel-3.17.8-300.fc21.x86_64 did not result in any problems and regenerating the initramfs for kernel-3.18.3-201.fc21.x86_64 did not solve the problem.
Created attachment 988306 [details] kernel messages
Same here on Thinkpad Edge E420s. I thought i can boot if i unplug the AC power (this sometimes worked) but now i think this has no influence on the error. Maybe the AMD/Intel Graphics switching?
Is this only affecting Thinkpads with SSDs? I have a SSD, too.
two more observations: 1) When disabling SELinux via the kernel command line (selinux=0) the system boots 2) Dropping to the systemd emergency shell (adding emergency to the kernel command line) this can be reproduced. At this point /boot (ext4 in my case) is not mounted and "systemctl start boot.mount" fails with a timeout. At the same time the device can be mounted manually via e.g. "mount UUID=... /mntpnt" journalctl -xe Feb 05 23:51:05 x220 systemd[1]: Expecting device dev-disk-by\x2duuid-3be8f708\x2dad1c\x2d4464\x2d92f1\x2de41d1b94e0e9.device... -- Subject: Unit dev-disk-by\x2duuid-3be8f708\x2dad1c\x2d4464\x2d92f1\x2de41d1b94e0e9.device has begun with start-up -- Defined-By: systemd -- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel -- -- Unit dev-disk-by\x2duuid-3be8f708\x2dad1c\x2d4464\x2d92f1\x2de41d1b94e0e9.device has begun starting up. Feb 05 23:52:35 x220 systemd[1]: Job dev-disk-by\x2duuid-3be8f708\x2dad1c\x2d4464\x2d92f1\x2de41d1b94e0e9.device/start timed out. Feb 05 23:52:35 x220 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-3be8f708\x2dad1c\x2d4464\x2d92f1\x2de41d1b94e0e9.device. -- Subject: Unit dev-disk-by\x2duuid-3be8f708\x2dad1c\x2d4464\x2d92f1\x2de41d1b94e0e9.device has failed -- Defined-By: systemd -- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel -- -- Unit dev-disk-by\x2duuid-3be8f708\x2dad1c\x2d4464\x2d92f1\x2de41d1b94e0e9.device has failed. -- -- The result is timeout. Feb 05 23:52:35 x220 systemd[1]: Dependency failed for /boot. -- Subject: Unit boot.mount has failed -- Defined-By: systemd -- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel -- -- Unit boot.mount has failed. -- -- The result is dependency. Feb 05 23:52:35 x220 systemd[1]: Dependency failed for File System Check on /dev/disk/by-uuid/3be8f708-ad1c-4464-92f1-e41d1b94e0e9. -- Subject: Unit systemd-fsck@dev-disk-by\x2duuid-3be8f708\x2dad1c\x2d4464\x2d92f1\x2de41d1b94e0e9.service has failed -- Defined-By: systemd -- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel -- -- Unit systemd-fsck@dev-disk-by\x2duuid-3be8f708\x2dad1c\x2d4464\x2d92f1\x2de41d1b94e0e9.service has failed. -- -- The result is dependency.
No change with 3.18.5-201.fc21.x86_64 (Be sure to increase installonly_limit in your /etc/yum.conf to avoid older working kernels being uninstalled as new ones are released)
Also I can confirm that booting completes with selinux=0 on 3.18.5. The labelling that occurs on the next 3.17 boot does not fix the issue with further 3.18.5 booting, so i guess that this is not an issue due to a mislabelled file.
Is everyone that is having this problem using btrfs? If so, please provide the mount output like the original reporter did.
I am using btrfs. My mount output: sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime,seclabel) proc on /proc type proc (rw,nosuid,nodev,noexec,relatime) devtmpfs on /dev type devtmpfs (rw,nosuid,seclabel,size=4031012k,nr_inodes=1007753,mode=755) securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime) tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev,seclabel) devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,seclabel,gid=5,mode=620,ptmxmode=000) tmpfs on /run type tmpfs (rw,nosuid,nodev,seclabel,mode=755) tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,seclabel,mode=755) cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd) pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime) cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset) cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct) cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory) cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices) cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer) cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio) cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio) cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event) cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb) configfs on /sys/kernel/config type configfs (rw,relatime) /dev/sda8 on / type btrfs (rw,relatime,seclabel,ssd,space_cache) selinuxfs on /sys/fs/selinux type selinuxfs (rw,relatime) systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=28,pgrp=1,timeout=300,minproto=5,maxproto=5,direct) hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,seclabel) mqueue on /dev/mqueue type mqueue (rw,relatime,seclabel) tmpfs on /tmp type tmpfs (rw,seclabel) debugfs on /sys/kernel/debug type debugfs (rw,relatime) sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime) nfsd on /proc/fs/nfsd type nfsd (rw,relatime) /dev/sda6 on /boot type ext4 (rw,relatime,seclabel,data=ordered) /dev/sda8 on /home type btrfs (rw,relatime,seclabel,ssd,space_cache) tmpfs on /run/user/989 type tmpfs (rw,nosuid,nodev,relatime,seclabel,size=808496k,mode=700,uid=989,gid=985) tmpfs on /run/user/1000 type tmpfs (rw,nosuid,nodev,relatime,seclabel,size=808496k,mode=700,uid=1000,gid=1000)
1) Concerning SELinux Booting with enforcing=0 the same problem occurs, on the dracut emergency shell with SELinux enabled starting boot.mount also times out and there are no messages in audit.log. 2) I am also using BTRFS: sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime,seclabel) proc on /proc type proc (rw,nosuid,nodev,noexec,relatime) devtmpfs on /dev type devtmpfs (rw,nosuid,seclabel,size=4018052k,nr_inodes=1004513,mode=755) securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime) tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev,seclabel) devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,seclabel,gid=5,mode=620,ptmxmode=000) tmpfs on /run type tmpfs (rw,nosuid,nodev,seclabel,mode=755) tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,seclabel,mode=755) cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd) pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime) cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset) cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct) cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory) cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices) cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer) cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio) cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio) cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event) cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb) configfs on /sys/kernel/config type configfs (rw,relatime) /dev/sda3 on / type btrfs (rw,relatime,seclabel,ssd,space_cache) selinuxfs on /sys/fs/selinux type selinuxfs (rw,relatime) systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=28,pgrp=1,timeout=300,minproto=5,maxproto=5,direct) hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,seclabel) mqueue on /dev/mqueue type mqueue (rw,relatime,seclabel) debugfs on /sys/kernel/debug type debugfs (rw,relatime) tmpfs on /tmp type tmpfs (rw,seclabel) sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime) nfsd on /proc/fs/nfsd type nfsd (rw,relatime) /dev/sda1 on /boot type ext4 (rw,relatime,seclabel,data=ordered) /dev/sda3 on /home type btrfs (rw,relatime,seclabel,ssd,space_cache) tmpfs on /run/user/42 type tmpfs (rw,nosuid,nodev,relatime,seclabel,size=805628k,mode=700,uid=42,gid=42) tmpfs on /run/user/1000 type tmpfs (rw,nosuid,nodev,relatime,seclabel,size=805628k,mode=700,uid=1000,gid=1000) gvfsd-fuse on /run/user/1000/gvfs type fuse.gvfsd-fuse (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000) fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime) 3) My system just booted into 3.18.5-201.fc21.x86_64 once, but this did not yield any new information...
(In reply to Josh Boyer from comment #11) > Is everyone that is having this problem using btrfs? > > If so, please provide the mount output like the original reporter did. I have two computers, both affected by the issue, and both uses btrfs, even with 3.18.6-200.fc21.x86_64. One of them uses i915, the other one nouveau or nvidia, so the problem is not graphics related, as some other issues (#118633, #1185791, #1185820) suspects. I can also add that booting to single mode and using 'systemctl isolate graphical.target' always succeds on both box, but about 50% of normal boot fails on one machine, and 90% on the other one. mount output on one machine: sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime,seclabel) proc on /proc type proc (rw,nosuid,nodev,noexec,relatime) devtmpfs on /dev type devtmpfs (rw,nosuid,seclabel,size=5049484k,nr_inodes=1262371,mode=755) securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime) tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev,seclabel) devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,seclabel,gid=5,mode=620,ptmxmode=000) tmpfs on /run type tmpfs (rw,nosuid,nodev,seclabel,mode=755) tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,seclabel,mode=755) cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd) pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime) efivarfs on /sys/firmware/efi/efivars type efivarfs (rw,nosuid,nodev,noexec,relatime) cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset) cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct) cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory) cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices) cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer) cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio) cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio) cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event) cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb) configfs on /sys/kernel/config type configfs (rw,relatime) /dev/sda4 on / type btrfs (rw,relatime,seclabel,ssd,space_cache) selinuxfs on /sys/fs/selinux type selinuxfs (rw,relatime) systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=28,pgrp=1,timeout=300,minproto=5,maxproto=5,direct) mqueue on /dev/mqueue type mqueue (rw,relatime,seclabel) hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,seclabel) debugfs on /sys/kernel/debug type debugfs (rw,relatime) tmpfs on /tmp type tmpfs (rw,seclabel) binfmt_misc on /proc/sys/fs/binfmt_misc type binfmt_misc (rw,relatime) sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime) nfsd on /proc/fs/nfsd type nfsd (rw,relatime) /dev/sda4 on /home type btrfs (rw,relatime,seclabel,ssd,space_cache) /dev/sda2 on /boot type ext4 (rw,relatime,seclabel,data=ordered) /dev/sda1 on /boot/efi type vfat (rw,relatime,fmask=0077,dmask=0077,codepage=437,iocharset=ascii,shortname=winnt,errors=remount-ro) tmpfs on /run/user/1000 type tmpfs (rw,nosuid,nodev,relatime,seclabel,size=1011976k,mode=700,uid=1000,gid=1000) gvfsd-fuse on /run/user/1000/gvfs type fuse.gvfsd-fuse (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000) fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime) mount output on the other one: sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime,seclabel) proc on /proc type proc (rw,nosuid,nodev,noexec,relatime) devtmpfs on /dev type devtmpfs (rw,nosuid,seclabel,size=4069076k,nr_inodes=1017269,mode=755) securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime) tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev,seclabel) devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,seclabel,gid=5,mode=620,ptmxmode=000) tmpfs on /run type tmpfs (rw,nosuid,nodev,seclabel,mode=755) tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,seclabel,mode=755) cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd) pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime) efivarfs on /sys/firmware/efi/efivars type efivarfs (rw,nosuid,nodev,noexec,relatime) cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset) cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct) cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory) cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices) cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer) cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio) cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio) cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event) cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb) configfs on /sys/kernel/config type configfs (rw,relatime) /dev/sdb4 on / type btrfs (rw,relatime,seclabel,ssd,space_cache) selinuxfs on /sys/fs/selinux type selinuxfs (rw,relatime) systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=27,pgrp=1,timeout=300,minproto=5,maxproto=5,direct) hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,seclabel) debugfs on /sys/kernel/debug type debugfs (rw,relatime) tmpfs on /tmp type tmpfs (rw,seclabel) mqueue on /dev/mqueue type mqueue (rw,relatime,seclabel) binfmt_misc on /proc/sys/fs/binfmt_misc type binfmt_misc (rw,relatime) /dev/sda1 on /mnt/storage type ext4 (rw,nosuid,nodev,relatime,seclabel,data=ordered) /dev/sdb4 on /home type btrfs (rw,relatime,seclabel,ssd,space_cache) /dev/sdb2 on /boot type ext4 (rw,relatime,seclabel,data=ordered) /dev/sdb1 on /boot/efi type vfat (rw,relatime,fmask=0077,dmask=0077,codepage=437,iocharset=ascii,shortname=winnt,errors=remount-ro) sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime) nfsd on /proc/fs/nfsd type nfsd (rw,relatime) tmpfs on /run/user/1001 type tmpfs (rw,nosuid,nodev,relatime,seclabel,size=815864k,mode=700,uid=1001,gid=1001) gvfsd-fuse on /run/user/1001/gvfs type fuse.gvfsd-fuse (rw,nosuid,nodev,relatime,user_id=1001,group_id=1001) fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime) tmpfs on /run/user/1000 type tmpfs (rw,nosuid,nodev,relatime,seclabel,size=815864k,mode=700,uid=1000,gid=1000)
problem still exists with kernel-3.18.7-200.fc21.x86_64 and systemd-216-20.fc21.x86_64
Created attachment 992984 [details] Possibly more informative error message
Sometimes I can switch VTs and then there is this error message which may or may not be the actual cause (see attached photo). Transcribing the error message by hand: [ 2.623965] [drm:cpt_set_fifo_underrun_reporting] *ERROR* uncleared pch fifo underrun on pch transcoder A [ 2.623967] [drm:cpt_serr_int_handler] *ERROR* PCH transcoder A FIFO underrun
I am not seeing that drm error and after a quick search I am not sure it is related. Imho we should also file this bug against systemd, because in every situation where I could get access to the system (e.g. emergency shell) the boot volume could be mounted manually just fine. At the moment I am using noauto,x-systemd.device-timeout=0 in /etc/fstab as workaround and mount boot manually when needed. Interestingly enough, once the system is up with these options systemctl start boot.mount works fine.
Same issue on a thinkpad yoga S1, SSD & btrfs. here is the mount output from 3.17.6. All 3.18.x fail to boot, even with selinux=0. sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime,seclabel) proc on /proc type proc (rw,nosuid,nodev,noexec,relatime) devtmpfs on /dev type devtmpfs (rw,nosuid,seclabel,size=4031732k,nr_inodes=1007933,mode=755) securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime) tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev,seclabel) devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,seclabel,gid=5,mode=620,ptmxmode=000) tmpfs on /run type tmpfs (rw,nosuid,nodev,seclabel,mode=755) tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,seclabel,mode=755) cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd) pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime) efivarfs on /sys/firmware/efi/efivars type efivarfs (rw,nosuid,nodev,noexec,relatime) cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset) cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct) cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory) cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices) cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer) cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio) cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio) cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event) cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb) configfs on /sys/kernel/config type configfs (rw,relatime) /dev/sda8 on / type btrfs (rw,relatime,seclabel,ssd,space_cache) selinuxfs on /sys/fs/selinux type selinuxfs (rw,relatime) systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=28,pgrp=1,timeout=300,minproto=5,maxproto=5,direct) tmpfs on /tmp type tmpfs (rw,seclabel) mqueue on /dev/mqueue type mqueue (rw,relatime,seclabel) debugfs on /sys/kernel/debug type debugfs (rw,relatime) hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,seclabel) sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime) nfsd on /proc/fs/nfsd type nfsd (rw,relatime) /dev/sda8 on /home type btrfs (rw,relatime,seclabel,ssd,space_cache) /dev/sda6 on /boot type ext4 (rw,relatime,seclabel,data=ordered) /dev/sda2 on /boot/efi type vfat (rw,relatime,fmask=0077,dmask=0077,codepage=437,iocharset=ascii,shortname=winnt,errors=remount-ro) /dev/sda4 on /mnt/win type fuseblk (rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other,blksize=4096) /dev/sda4 on /home/haliyo/Vidéos type fuseblk (rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other,blksize=4096) /dev/sda4 on /home/haliyo/Documents type fuseblk (rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other,blksize=4096) /dev/sda4 on /home/haliyo/Musique type fuseblk (rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other,blksize=4096) /dev/sda4 on /home/haliyo/Téléchargements type fuseblk (rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other,blksize=4096) /dev/sda4 on /home/haliyo/Images type fuseblk (rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other,blksize=4096) fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime) tmpfs on /run/user/1000 type tmpfs (rw,nosuid,nodev,relatime,seclabel,size=808520k,mode=700,uid=1000,gid=1000) gvfsd-fuse on /run/user/1000/gvfs type fuse.gvfsd-fuse (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000) [
I'm also affected by this bug. 3.17.4 boots just fine, 3.18.6 and 3.18.7 doesn't find the root filesystem and stalls. I'm also using an SSD, a btrfs filesystem and the root is inside a subvolume, it's a desktop ECS computer, however. Using selinux=0 on the kernel command line DOES NOT works around the problem for me. $ cat /proc/mounts rootfs / rootfs rw,seclabel 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=3947372k,nr_inodes=986843,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sdd3 / btrfs rw,seclabel,relatime,ssd,discard,space_cache 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=300,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 tmpfs /tmp tmpfs rw,seclabel 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 /dev/sdd3 /var btrfs rw,seclabel,relatime,ssd,discard,space_cache 0 0 /dev/sdd3 /home btrfs rw,seclabel,relatime,ssd,discard,space_cache 0 0 /dev/sdd3 /mnt/hot btrfs rw,seclabel,relatime,ssd,discard,space_cache 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 /dev/sdc1 /mnt/warm btrfs rw,seclabel,relatime,space_cache 0 0 /dev/mapper/VG_BAK-LV_COLD /mnt/cold btrfs rw,seclabel,relatime,space_cache 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=791704k,mode=700,uid=1000,gid=1000 0 0 gvfsd-fuse /run/user/1000/gvfs fuse.gvfsd-fuse rw,nosuid,nodev,relatime,user_id=1000,group_id=1000 0 0
(In reply to Bernardo Donadio from comment #20) > I'm also affected by this bug. 3.17.4 boots just fine, 3.18.6 and 3.18.7 > doesn't find the root filesystem and stalls. This is slightly different from the original bug (i.e. boot.mount fails for ext4 boot filesystem). Anyway, after some updates the workaround I mentioned in #18 also no longer works, i.e. removing boot from fstab or changing the options as mentioned in #18 the system now hangs due to a timeout for the btrfs root.
After the following updates my system starts more often than before, but booting still fails more than 50% of the time: systemd-216-20.fc21.x86_64 kernel-3.18.8-201.fc21.x86_64 selinux-policy-3.13.1-105.5.fc21.noarch dracut-038-32.git20141216.fc21.x86_64
I am experiencing this same problem on my homebrew machine with an Intel DZ77SL-50K motherboard, Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz, 32GB of RAM. Booting to the previously installed kernel, 3.18.7-200.fc21.x86_64, works fine.
(In reply to David Both from comment #23) > I am experiencing this same problem on my homebrew machine with an Intel > DZ77SL-50K motherboard, Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz, 32GB of > RAM. Booting to the previously installed kernel, 3.18.7-200.fc21.x86_64, > works fine. You're booting fine with 3.18.7 (notice the eigthteen here) and getting stuck with 3.18.3 (again, eigthteen)? Because if there's no typo, I think this is a different issue here. As far as I can tell, the problem that I'm having was introduced between the 3.17-3.18 cycle.
(In reply to Bernardo Donadio from comment #24) > (In reply to David Both from comment #23) > > I am experiencing this same problem on my homebrew machine with an Intel > > DZ77SL-50K motherboard, Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz, 32GB of > > RAM. Booting to the previously installed kernel, 3.18.7-200.fc21.x86_64, > > works fine. > > You're booting fine with 3.18.7 (notice the eigthteen here) and getting > stuck with 3.18.3 (again, eigthteen)? > > Because if there's no typo, I think this is a different issue here. > > As far as I can tell, the problem that I'm having was introduced between the > 3.17-3.18 cycle. The failing kernel is 3.18.8-201.fc21 and 3.18.7-200.fc21.x86_64 works fine. Let me know if I need to open a new bug. Before we do anything else, let me see if I can reproduce in VirtualBox.
(In reply to David Both from comment #25) > (In reply to Bernardo Donadio from comment #24) > > (In reply to David Both from comment #23) > > > I am experiencing this same problem on my homebrew machine with an Intel > > > DZ77SL-50K motherboard, Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz, 32GB of > > > RAM. Booting to the previously installed kernel, 3.18.7-200.fc21.x86_64, > > > works fine. > > > > You're booting fine with 3.18.7 (notice the eigthteen here) and getting > > stuck with 3.18.3 (again, eigthteen)? > > > > Because if there's no typo, I think this is a different issue here. > > > > As far as I can tell, the problem that I'm having was introduced between the > > 3.17-3.18 cycle. > > > The failing kernel is 3.18.8-201.fc21 and 3.18.7-200.fc21.x86_64 works fine. > Let me know if I need to open a new bug. Before we do anything else, let me > see if I can reproduce in VirtualBox. I found no issue booting to the 3.18.8-201.fc21 in a VirtualBox VM.
It seems resolved for me, at least last 5-6 boots were successful, with no fails. That's how: First I've upgraded to 3.18.9-200.fc21.x86_64 which did not solve the problem. Then Ive discovered that there were bios & ssd firmware updates from lenovo that I applied. Also, I've found out from Live that btrfs check gave a 'nbytes wrong' error as in bug 1037963, that I've fixed by mv'ing the culprit file out and back. Then increased the partition size, did btrfs balance and scrub, rebuild grub and initramfs. It seems to behave nicely ever since. The randomness of the bug would point to a buggy firmware, so I guess that's what fixed it. Maybe related to the fs errors. This is on a Thinkpad Yoga S1, the SSD is a SAMSUNG MZ7TD256HAFV-000L9, its current firmware is DXT04L6Q, updated from DXT02L6Q Hope this helps.
This bug is also resolved for me with the 3.18.9-200.fc21.x86_64 kernel.
Still present here with 3.18.9, clean btrfs filesystem and latest bios. The only good news (considering that nobody really cares to fix this) is that f22 alpha works fine here.
f22 alpha fixed the issue here, too.
Same here, after 3.17.8 all kernel versions just hang , although occasionally it will boot, but I can't find any pattern, besides that setting the plymouth there to 'details' improves the chance of successful boot. I am using macbook pro, and have a single btrfs filesystem, with selinux mode set to permissive.
*** Bug 1207618 has been marked as a duplicate of this bug. ***
*** Bug 1196756 has been marked as a duplicate of this bug. ***
This bug is just all over the place and all systems using BTRFS in fstab are screwed. According to a comment at bug 1212600 linking the BTRFS wiki, this is fixed in kernel v3.19.5+ so I think we should seriously think about creating a critical kernel update for this bug. https://btrfs.wiki.kernel.org/index.php/Gotchas
The kernel update is already filed. It would be excellent if you could test and provide feedback. https://admin.fedoraproject.org/updates/kernel-3.19.5-200.fc21
kernel-3.19.5-200.fc21 does NOT fix the issue for me. Still unable to load the root btrfs filesystem.
I'm pretty sure, the problem is related to systemd-readahead services in combination with btrfs. This feature has been dropped by systemd 219. This explains that fedora 22 alpha works. As already proposed for bug 1192913: A short term solution is to disable all services related to readahead. They can be listed e.g. by systemctl list-unit-files | grep systemd-readahead. A long term solution for fedora 21 might be to disable systemd-readahead by a systemd patch.
Just did some testing and * 3.19.5-200.fc21.x86_64 does not fix the issue * Removing systemd readahead does fix the issue (systemctl disable systemd-readahead-collect.service systemd-readahead-replay.service systemd-readahead-done.timer)
Yes removing the systemd readahead fixes the issue for me too (but slows down boot a noticeable bit indeed).
*********** MASS BUG UPDATE ************** We apologize for the inconvenience. There is a large number of bugs to go through and several of them have gone stale. Due to this, we are doing a mass bug update across all of the Fedora 21 kernel bugs. Fedora 21 has now been rebased to 3.19.5-200.fc21. Please test this kernel update (or newer) and let us know if you issue has been resolved or if it is still present with the newer kernel. If you have moved on to Fedora 22, and are still experiencing this issue, please change the version to Fedora 22. If you experience different issues, please open a new bug report for those.
This bug has resolved for me since the 3.18.9-200.fc21.x86_64 kernel. It is still resolved with 3.19.5-200.fc21.x86_64. I have tried BTRFS in the past but definitely not with Fedora 21, so BTRFS would not have been a factor for me. I use EXT4 and two NFS mounts. ix2nas:/BothsPhotos /home/dboth/Pictures nfs defaults 0 0 ix2nas:/SharedDocs /home/dboth/SharedDocs nfs defaults 0 0 Thanks to all for your work on this.
This message is a reminder that Fedora 21 is nearing its end of life. Approximately 4 (four) weeks from now Fedora will stop maintaining and issuing updates for Fedora 21. It is Fedora's policy to close all bug reports from releases that are no longer maintained. At that time this bug will be closed as EOL if it remains open with a Fedora 'version' of '21'. Package Maintainer: If you wish for this bug to remain open because you plan to fix it in a currently maintained version, simply change the 'version' to a later Fedora version. Thank you for reporting this issue and we are sorry that we were not able to fix it before Fedora 21 is end of life. If you would still like to see this bug fixed and are able to reproduce it against a later version of Fedora, you are encouraged change the 'version' to a later Fedora version prior this bug is closed as described in the policy above. Although we aim to fix as many bugs as possible during every release's lifetime, sometimes those efforts are overtaken by events. Often a more recent Fedora release includes newer upstream software that fixes bugs or makes them obsolete.
Fedora 21 changed to end-of-life (EOL) status on 2015-12-01. Fedora 21 is no longer maintained, which means that it will not receive any further security or bug fix updates. As a result we are closing this bug. If you can reproduce this bug against a currently maintained version of Fedora please feel free to reopen this bug against that version. If you are unable to reopen this bug, please file a new report against the current release. If you experience problems, please add a comment to this bug. Thank you for reporting this bug and we are sorry it could not be fixed.