Bug 1960937

Summary: Only a blinking cursor at the upper left corner upon start of gdm
Product: [Fedora] Fedora Reporter: Sampson Fung <sampsonfung>
Component: gdmAssignee: Ray Strode [halfline] <rstrode>
Status: CLOSED ERRATA QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: urgent Docs Contact:
Priority: unspecified    
Version: 34CC: 5, alexander, caillon+fedoraproject, gnome-sig, jadahl, mclasen, naderkhalid, philip.wyett, ptalbert, rhbugs, rhughes, rstrode
Target Milestone: ---   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-06-03 01:01:11 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
journalctl -b --no-pager none

Description Sampson Fung 2021-05-16 16:59:35 UTC
Created attachment 1783789 [details]
journalctl -b --no-pager

Description of problem:
GDM failed to start.  Screen is hanging in text mode, all black with only one blinking cursor.

Version-Release number of selected component (if applicable):
gdm-40.0-1.fc34.x86_64
● ostree://fedora:fedora/34/x86_64/silverblue
                   Version: 34.20210516.0 (2021-05-16T01:45:21Z)
                BaseCommit: acae8e2a7ffb947539e8b533b74a26278334ae9c63b45f3ef5ff80415715f8ca
              GPGSignature: Valid signature by 8C5BA6990BDB26E19F2A1A801161AE6945719A39
           LayeredPackages: i3 sway


How reproducible:
100% after upgrading to the latest Silverblue 34

Steps to Reproduce:
1. Install Silverblue Rawhide
ostree://fedora:fedora/rawhide/x86_64/silverblue
                   Version: Rawhide.20210511.n.2 (2021-05-11T23:30:14Z)
                    Commit: 46bc42198d7ba01dca6b126b6e210bbf31b2aad3ef5d31754ccac5e6194c9e9c
              GPGSignature: Valid signature by 787EA6AE1147EEE56C40B30CDB4639719867C58F
2.  Rebase to Silverblue 34
3.  Reboot then GDM failed to start

Actual results:
GDM failed to start once rebased to Silverblue 34, while Silverblue Rawhide.20210511.n.2 worked OK.

Expected results:
GDM start normally

Additional info:

Comment 1 Sampson Fung 2021-05-17 18:44:36 UTC
After manually bisect the OSTree commits, for Silverblue Rawhide, 

● ostree://fedora:fedora/rawhide/x86_64/silverblue
                   Version: Rawhide.20210513.n.0 (2021-05-13T06:06:02Z)
                    Commit: a20dcca277db19444d7072c658aa1ead3d3d2b895a91f91b7007c39d0f687511
              GPGSignature: Valid signature by 787EA6AE1147EEE56C40B30CDB4639719867C58F
                    Pinned: yes

  ostree://fedora:fedora/rawhide/x86_64/silverblue
                   Version: Rawhide.20210514.n.0 (2021-05-14T06:04:28Z)
                    Commit: 49fa46896e4ac009dc476f4149eb1ce526acd6fe40a54020391ccfe4de8d8b4f
              GPGSignature: Valid signature by 787EA6AE1147EEE56C40B30CDB4639719867C58F
                    Pinned: yes

Rawhide.20210513.n.0 last known good
Rawhide.20210514.n.0 first known bad

Comment 2 Sampson Fung 2021-05-17 20:06:36 UTC
For Silverblue 34

ostree://fedora:fedora/34/x86_64/silverblue
                   Version: 34.20210513.0 (2021-05-13T00:46:10Z)
                    Commit: 0a791a0478306d9462880703af5c235b8142371e09e9ec079e04fb29845748c6
              GPGSignature: Valid signature by 8C5BA6990BDB26E19F2A1A801161AE6945719A39

  ostree://fedora:fedora/34/x86_64/silverblue
                   Version: 34.20210514.0 (2021-05-14T17:29:31Z)
                    Commit: 3d7ee56bc58dd5fd534e6b1966c90e52a1f4f5651d967fadd0f79c385af6c149
              GPGSignature: Valid signature by 8C5BA6990BDB26E19F2A1A801161AE6945719A39
                    Pinned: yes



34.20210513.0 last known good
34.20210514.0 first known bad

Comment 3 Jonas Ådahl 2021-05-19 09:22:05 UTC
Looks like the radeon driver doesn't handle modifiers.

Comment 4 Sampson Fung 2021-05-20 15:56:09 UTC
Also testing with Fedora 34 Workstation.

GOLD release is working fine.

Same problem once updated to latest

rpm -qa | egrep -i "gnome-session|mutter"
gnome-session-40.1.1-1.fc34.x86_64
mutter-40.1-1.fc34.x86_64
gnome-session-xsession-40.1.1-1.fc34.x86_64
gnome-session-wayland-session-40.1.1-1.fc34.x86_64
gdm-40.0-1.fc34.x86_64

00:01.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Kaveri [Radeon R7 Graphics] (pro
g-if 00 [VGA controller])
	Subsystem: Gigabyte Technology Co., Ltd Device d000
	Flags: bus master, fast devsel, latency 0, IRQ 49, IOMMU group 0
	Memory at c0000000 (64-bit, prefetchable) [size=256M]
	Memory at d0000000 (64-bit, prefetchable) [size=8M]
	I/O ports at f000 [size=256]
	Memory at feb00000 (32-bit, non-prefetchable) [size=256K]
	Expansion ROM at 000c0000 [disabled] [size=128K]
	Capabilities: <access denied>
	Kernel driver in use: radeon
	Kernel modules: radeon, amdgpu

Comment 5 Sampson Fung 2021-05-20 18:25:59 UTC
(In reply to Jonas Ådahl from comment #3)
> Looks like the radeon driver doesn't handle modifiers.

Thank you very much for your hints!  GDM started OK with amdgpu driver.

I switched over to use amdgpu driver by using below kernel parameters:
$ cat /proc/cmdline 
BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.11.21-300.fc34.x86_64 root=UUID=bda68cec-a76d-4e6a-be52-fefcff9f76a6 ro rootflags=subvol=root amdgpu.dc=0 radeon.cik_support=0 radeon.si_support=0 amdgpu.cik_support=1

$ sudo lspci -v
00:01.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Kaveri [Radeon R7 Graphics] (prog-if 00 [VGA cont
roller])
	Subsystem: Gigabyte Technology Co., Ltd Device d000
	Flags: bus master, fast devsel, latency 0, IRQ 48, IOMMU group 0
	Memory at c0000000 (64-bit, prefetchable) [size=256M]
	Memory at d0000000 (64-bit, prefetchable) [size=8M]
	I/O ports at f000 [size=256]
	Memory at feb00000 (32-bit, non-prefetchable) [size=256K]
	Expansion ROM at 000c0000 [disabled] [size=128K]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [270] Secondary PCI Express
	Capabilities: [2b0] Address Translation Service (ATS)
	Capabilities: [2c0] Page Request Interface (PRI)
	Capabilities: [2d0] Process Address Space ID (PASID)
	Kernel driver in use: amdgpu
	Kernel modules: radeon, amdgpu

Comment 6 Sampson Fung 2021-05-23 01:24:32 UTC
(In reply to Sampson Fung from comment #5)
> (In reply to Jonas Ådahl from comment #3)
> > Looks like the radeon driver doesn't handle modifiers.
> 
> Thank you very much for your hints!  GDM started OK with amdgpu driver.
> 
> I switched over to use amdgpu driver by using below kernel parameters:
> $ cat /proc/cmdline 
> BOOT_IMAGE=(hd0,gpt2)/vmlinuz-5.11.21-300.fc34.x86_64
> root=UUID=bda68cec-a76d-4e6a-be52-fefcff9f76a6 ro rootflags=subvol=root
> amdgpu.dc=0 radeon.cik_support=0 radeon.si_support=0 amdgpu.cik_support=1
> 
> $ sudo lspci -v
> 00:01.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI]
> Kaveri [Radeon R7 Graphics] (prog-if 00 [VGA cont
> roller])
> 	Subsystem: Gigabyte Technology Co., Ltd Device d000
> 	Flags: bus master, fast devsel, latency 0, IRQ 48, IOMMU group 0
> 	Memory at c0000000 (64-bit, prefetchable) [size=256M]
> 	Memory at d0000000 (64-bit, prefetchable) [size=8M]
> 	I/O ports at f000 [size=256]
> 	Memory at feb00000 (32-bit, non-prefetchable) [size=256K]
> 	Expansion ROM at 000c0000 [disabled] [size=128K]
> 	Capabilities: [48] Vendor Specific Information: Len=08 <?>
> 	Capabilities: [50] Power Management version 3
> 	Capabilities: [58] Express Root Complex Integrated Endpoint, MSI 00
> 	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
> 	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
> 	Capabilities: [270] Secondary PCI Express
> 	Capabilities: [2b0] Address Translation Service (ATS)
> 	Capabilities: [2c0] Page Request Interface (PRI)
> 	Capabilities: [2d0] Process Address Space ID (PASID)
> 	Kernel driver in use: amdgpu
> 	Kernel modules: radeon, amdgpu

amdgpu avoid this gdm hanging issues for me, but then sound over hdmi is not working .  https://bugzilla.redhat.com/show_bug.cgi?id=1963026

Comment 7 Sampson Fung 2021-05-23 07:16:19 UTC
In compare when using KDE

Deployments:
● ostree://fedora:fedora/rawhide/x86_64/kinoite
                   Version: Rawhide.20210522.n.1 (2021-05-22T18:26:11Z)
                BaseCommit: 8a915542daaff13a2d1d6c328f261080de00a5445988157ad62b6e6f329c339e
              GPGSignature: Valid signature by 787EA6AE1147EEE56C40B30CDB4639719867C58F
           LayeredPackages: gnome-tweaks hdparm iotop sg3_utils smartmontools sway terminator


radeon is working fine, hdmi sound also normal.

00:01.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Kaveri [Radeon R7 Graphics] (prog-if 00 [VGA controller])
        Subsystem: Gigabyte Technology Co., Ltd Device d000
        Flags: bus master, fast devsel, latency 0, IRQ 46, IOMMU group 0
        Memory at f8000000 (64-bit, prefetchable) [size=64M]
        Memory at fc000000 (64-bit, prefetchable) [size=8M]
        I/O ports at f000 [size=256]
        Memory at feb00000 (32-bit, non-prefetchable) [size=256K]
        Expansion ROM at 000c0000 [disabled] [size=128K]
        Capabilities: [48] Vendor Specific Information: Len=08 <?>
        Capabilities: [50] Power Management version 3
        Capabilities: [58] Express Root Complex Integrated Endpoint, MSI 00
        Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
        Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
        Capabilities: [270] Secondary PCI Express
        Capabilities: [2b0] Address Translation Service (ATS)
        Capabilities: [2c0] Page Request Interface (PRI)
        Capabilities: [2d0] Process Address Space ID (PASID)
        Kernel driver in use: radeon
        Kernel modules: radeon, amdgpu

Comment 8 5 2021-05-25 15:00:44 UTC
since I also run Kaveri and Radeon, this bug is not so nice to hear about !

Comment 9 naderkhalid 2021-05-26 13:14:43 UTC
Since this is related to amdgpu and the blank blinking cursor, then this maybe relevant:

https://bugzilla.redhat.com/show_bug.cgi?id=1964480

Comment 10 Sampson Fung 2021-05-26 16:25:14 UTC
(In reply to naderkhalid from comment #9)
> Since this is related to amdgpu and the blank blinking cursor, then this
> maybe relevant:
> 
> https://bugzilla.redhat.com/show_bug.cgi?id=1964480

In my case, GDM is hanging with radeon but OK with amdgpu.

Comment 11 naderkhalid 2021-05-26 20:18:34 UTC
In 1964480 I'm getting the cursor on blank screen even though I'm using amdgpu kernel driver.
It eventually worked after resetting the amdgpu driver.
I guess then the 2 issues are different even though they share some symptoms.

Comment 12 Jonas Ådahl 2021-05-26 20:32:39 UTC
Try adding

DRIVERS=="radeon", SUBSYSTEM=="drm", TAG+="mutter-device-disable-kms-modifiers"

to /usr/lib/udev/rules.d/61-mutter.rules and remoot.

Comment 13 Sampson Fung 2021-05-27 00:05:17 UTC
(In reply to Jonas Ådahl from comment #12)
> Try adding
> 
> DRIVERS=="radeon", SUBSYSTEM=="drm",
> TAG+="mutter-device-disable-kms-modifiers"
> 
> to /usr/lib/udev/rules.d/61-mutter.rules and remoot.

As I am using Silverblue, where /usr is readonly.

How can I have this rule change under Silverblue?

Comment 14 Sampson Fung 2021-05-27 00:23:40 UTC
(In reply to Jonas Ådahl from comment #12)
> Try adding
> 
> DRIVERS=="radeon", SUBSYSTEM=="drm",
> TAG+="mutter-device-disable-kms-modifiers"
> 
> to /usr/lib/udev/rules.d/61-mutter.rules and remoot.

Thank you very much!

I am able to login Gnome via GDM after your suggested change!

Comment 15 Sampson Fung 2021-05-27 00:25:38 UTC
(In reply to Sampson Fung from comment #13)
> (In reply to Jonas Ådahl from comment #12)
> > Try adding
> > 
> > DRIVERS=="radeon", SUBSYSTEM=="drm",
> > TAG+="mutter-device-disable-kms-modifiers"
> > 
> > to /usr/lib/udev/rules.d/61-mutter.rules and remoot.
> 
> As I am using Silverblue, where /usr is readonly.
> 
> How can I have this rule change under Silverblue?

I find the solution at:
https://www.reddit.com/r/Fedora/comments/ctagcc/how_do_i_edit_udev_rules_on_silverblue/exjqovp?utm_source=share&utm_medium=web2x&context=3

cp /usr/lib/udev/rules.d/61-mutter.rules /etc/udev/rules.d
then edit /etc/udev/rules.d/61-mutter.rules

Comment 16 Fedora Update System 2021-06-01 16:23:07 UTC
FEDORA-2021-895047c304 has been submitted as an update to Fedora 34. https://bodhi.fedoraproject.org/updates/FEDORA-2021-895047c304

Comment 17 Fedora Update System 2021-06-02 01:41:23 UTC
FEDORA-2021-895047c304 has been pushed to the Fedora 34 testing repository.
Soon you'll be able to install the update with the following command:
`sudo dnf upgrade --enablerepo=updates-testing --advisory=FEDORA-2021-895047c304`
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2021-895047c304

See also https://fedoraproject.org/wiki/QA:Updates_Testing for more information on how to test updates.

Comment 18 Sampson Fung 2021-06-02 06:54:51 UTC
(In reply to Fedora Update System from comment #17)
> FEDORA-2021-895047c304 has been pushed to the Fedora 34 testing repository.
> Soon you'll be able to install the update with the following command:
> `sudo dnf upgrade --enablerepo=updates-testing
> --advisory=FEDORA-2021-895047c304`
> You can provide feedback for this update here:
> https://bodhi.fedoraproject.org/updates/FEDORA-2021-895047c304
> 
> See also https://fedoraproject.org/wiki/QA:Updates_Testing for more
> information on how to test updates.

Do not work for me.

Comment 19 Jonas Ådahl 2021-06-02 08:16:49 UTC
(In reply to Sampson Fung from comment #18)
> (In reply to Fedora Update System from comment #17)
> > FEDORA-2021-895047c304 has been pushed to the Fedora 34 testing repository.
> > Soon you'll be able to install the update with the following command:
> > `sudo dnf upgrade --enablerepo=updates-testing
> > --advisory=FEDORA-2021-895047c304`
> > You can provide feedback for this update here:
> > https://bodhi.fedoraproject.org/updates/FEDORA-2021-895047c304
> > 
> > See also https://fedoraproject.org/wiki/QA:Updates_Testing for more
> > information on how to test updates.
> 
> Do not work for me.

Did you reboot after? What does 'udevadm info /dev/dri/card0' say? The fix is identical to what you verified works in https://bugzilla.redhat.com/show_bug.cgi?id=1960937#c14.

Comment 20 Sampson Fung 2021-06-02 10:31:43 UTC
(In reply to Jonas Ådahl from comment #19)
> (In reply to Sampson Fung from comment #18)
> > (In reply to Fedora Update System from comment #17)
> > > FEDORA-2021-895047c304 has been pushed to the Fedora 34 testing repository.
> > > Soon you'll be able to install the update with the following command:
> > > `sudo dnf upgrade --enablerepo=updates-testing
> > > --advisory=FEDORA-2021-895047c304`
> > > You can provide feedback for this update here:
> > > https://bodhi.fedoraproject.org/updates/FEDORA-2021-895047c304
> > > 
> > > See also https://fedoraproject.org/wiki/QA:Updates_Testing for more
> > > information on how to test updates.
> > 
> > Do not work for me.
> 
> Did you reboot after? What does 'udevadm info /dev/dri/card0' say? The fix
> is identical to what you verified works in
> https://bugzilla.redhat.com/show_bug.cgi?id=1960937#c14.

I am sorry - my previous test on the update has errors on undoing your suggested changes.  I only comment out the "radeon" line, but not removing the custom rule file.

This time, it works

1.  Remove /etc/udev/rules.d/61-mutters.rules # to remove any manually overrides

2.  Install the update by rpm-ostree override, reboot.

3.  sudo udevadm info /dev/dri/card0
P: /devices/pci0000:00/0000:00:01.0/drm/card0
N: dri/card0
L: 0
S: dri/by-path/pci-0000:00:01.0-card
E: DEVPATH=/devices/pci0000:00/0000:00:01.0/drm/card0
E: DEVNAME=/dev/dri/card0
E: DEVTYPE=drm_minor
E: MAJOR=226
E: MINOR=0
E: SUBSYSTEM=drm
E: USEC_INITIALIZED=7486543
E: ID_PATH=pci-0000:00:01.0
E: ID_PATH_TAG=pci-0000_00_01_0
E: ID_FOR_SEAT=drm-pci-0000_00_01_0
E: DEVLINKS=/dev/dri/by-path/pci-0000:00:01.0-card
E: TAGS=:mutter-device-disable-kms-modifiers:master-of-seat:uaccess:seat:
E: CURRENT_TAGS=:mutter-device-disable-kms-modifiers:master-of-seat:uaccess:seat:

I am sorry for the confusion caused.

Thank you very much for your help!

Comment 21 Jonas Ådahl 2021-06-02 12:42:49 UTC
Thanks for testing again!

Comment 22 Fedora Update System 2021-06-03 01:01:11 UTC
FEDORA-2021-895047c304 has been pushed to the Fedora 34 stable repository.
If problem still persists, please make note of it in this bug report.