1. Please describe the problem: When connecting the network cable, the kernel prints a stacktrace refering to the e1000e network driver, see below. 2. What is the Version-Release number of the kernel: Can consistently reproduce with 6.8.6-300.fc40.x86_64 and 6.9.0-0.rc5.44.fc41.x86_64 3. Did it work previously in Fedora? If so, what kernel version did the issue *first* appear? Old kernels are available for download at https://koji.fedoraproject.org/koji/packageinfo?packageID=8 : Worked fine with kernel-6.8.0-0.rc7.55.fc40.1.x86_64 4. Can you reproduce this issue? If so, please provide the steps to reproduce the issue below: Happens as soon as the cable is connected / the interface is activated on boot. 5. Does this problem occur with the latest Rawhide kernel? To install the Rawhide kernel, run ``sudo dnf install fedora-repos-rawhide`` followed by ``sudo dnf update --enablerepo=rawhide kernel``: Yes 6. Are you running any modules that not shipped with directly Fedora's kernel?: Yes with 6.8.6-300.fc40.x86_64 (virtualbox), no with 6.9.0-0.rc5.44.fc41.x86_64 7. Please attach the kernel logs. You can get the complete kernel log for a boot with ``journalctl --no-hostname -k > dmesg.txt``. If the issue occurred on a previous boot, use the journalctl ``-b`` flag. Apr 24 11:18:56 PC4 kernel: </TASK> Apr 24 11:18:56 PC4 kernel: ret_from_fork_asm+0x1b/0x30 Apr 24 11:18:56 PC4 kernel: ? __pfx_kthread+0x10/0x10 Apr 24 11:18:56 PC4 kernel: ret_from_fork+0x31/0x50 Apr 24 11:18:56 PC4 kernel: ? __pfx_kthread+0x10/0x10 Apr 24 11:18:56 PC4 kernel: kthread+0xe5/0x120 Apr 24 11:18:56 PC4 kernel: ? __pfx_worker_thread+0x10/0x10 Apr 24 11:18:56 PC4 kernel: worker_thread+0x273/0x3c0 Apr 24 11:18:56 PC4 kernel: process_one_work+0x16d/0x330 Apr 24 11:18:56 PC4 kernel: e1000_watchdog_task+0xe5/0xaa0 [e1000e] Apr 24 11:18:56 PC4 kernel: e1000e_update_stats+0x51a/0x720 [e1000e] Apr 24 11:18:56 PC4 kernel: e1000e_read_phy_reg_mdic+0x87/0x280 [e1000e] Apr 24 11:18:56 PC4 kernel: usleep_range_state+0x67/0x90 Apr 24 11:18:56 PC4 kernel: ? __pfx_hrtimer_wakeup+0x10/0x10 Apr 24 11:18:56 PC4 kernel: schedule_hrtimeout_range_clock+0xe7/0x1e0 Apr 24 11:18:56 PC4 kernel: schedule+0x32/0xd0 Apr 24 11:18:56 PC4 kernel: ? ttwu_do_activate+0x64/0x220 Apr 24 11:18:56 PC4 kernel: __schedule+0x10aa/0x1530 Apr 24 11:18:56 PC4 kernel: __schedule_bug+0x56/0x70 Apr 24 11:18:56 PC4 kernel: dump_stack_lvl+0x6a/0x90 Apr 24 11:18:56 PC4 kernel: <TASK> Apr 24 11:18:56 PC4 kernel: Call Trace: Apr 24 11:18:56 PC4 kernel: Workqueue: events e1000_watchdog_task [e1000e] Apr 24 11:18:56 PC4 kernel: Hardware name: LENOVO 20FXS0Y200/20FXS0Y200, BIOS R07ET93W (2.33 ) 05/31/2021 Apr 24 11:18:56 PC4 kernel: CPU: 0 PID: 128 Comm: kworker/0:2 Tainted: G OE 6.8.6-300.fc40.x86_64 #1 Apr 24 11:18:56 PC4 kernel: think_lmi thinkpad_acpi wmi_bmof i2c_i801 firmware_attributes_class e1000e ledtrig_audio platform_profile mei_me i2c_smbus snd_timer mei rfkill intel_pch_thermal snd s> Apr 24 11:18:56 PC4 kernel: Modules linked in: vboxnetadp(OE) vboxnetflt(OE) vboxdrv(OE) nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft> Apr 24 11:18:56 PC4 kernel: BUG: scheduling while atomic: kworker/0:2/128/0x00000002 Apr 24 11:23:37 PC4 kernel: </TASK> Apr 24 11:23:37 PC4 kernel: ret_from_fork_asm+0x1a/0x30 Apr 24 11:23:37 PC4 kernel: ? __pfx_kthread+0x10/0x10 Apr 24 11:23:37 PC4 kernel: ret_from_fork+0x31/0x50 Apr 24 11:23:37 PC4 kernel: ? __pfx_kthread+0x10/0x10 Apr 24 11:23:37 PC4 kernel: kthread+0xcf/0x100 Apr 24 11:23:37 PC4 kernel: ? __pfx_worker_thread+0x10/0x10 Apr 24 11:23:37 PC4 kernel: worker_thread+0x26a/0x3b0 Apr 24 11:23:37 PC4 kernel: process_one_work+0x186/0x340 Apr 24 11:23:37 PC4 kernel: e1000_watchdog_task+0xd1/0x6e0 [e1000e] Apr 24 11:23:37 PC4 kernel: e1000e_update_stats+0x51a/0x720 [e1000e] Apr 24 11:23:37 PC4 kernel: e1000e_read_phy_reg_mdic+0x93/0x280 [e1000e] Apr 24 11:23:37 PC4 kernel: usleep_range_state+0x65/0x90 Apr 24 11:23:37 PC4 kernel: ? __pfx_hrtimer_wakeup+0x10/0x10 Apr 24 11:23:37 PC4 kernel: schedule_hrtimeout_range_clock+0xdf/0x1d0 Apr 24 11:23:37 PC4 kernel: schedule+0x28/0x110 Apr 24 11:23:37 PC4 kernel: ? kick_pool+0x70/0x170 Apr 24 11:23:37 PC4 kernel: ? try_to_wake_up+0x249/0x700 Apr 24 11:23:37 PC4 kernel: __schedule+0x1130/0x17e0 Apr 24 11:23:37 PC4 kernel: __schedule_bug.cold+0x42/0x4e Apr 24 11:23:37 PC4 kernel: dump_stack_lvl+0x5d/0x80 Apr 24 11:23:37 PC4 kernel: <TASK> Apr 24 11:23:37 PC4 kernel: Call Trace: Apr 24 11:23:37 PC4 kernel: Workqueue: events e1000_watchdog_task [e1000e] Apr 24 11:23:37 PC4 kernel: Hardware name: LENOVO 20FXS0Y200/20FXS0Y200, BIOS R07ET93W (2.33 ) 05/31/2021 Apr 24 11:23:37 PC4 kernel: CPU: 0 PID: 299 Comm: kworker/0:2 Tainted: G OE ------- --- 6.9.0-0.rc5.44.fc41.x86_64 #1 Apr 24 11:23:37 PC4 kernel: intel_uncore think_lmi snd_pcm firmware_attributes_class i2c_i801 e1000e thinkpad_acpi wmi_bmof i2c_smbus snd_timer platform_profile mei_me rfkill mei intel_pch_thermal snd soundcore joydev fuse loop nfnetli> Apr 24 11:23:37 PC4 kernel: Modules linked in: nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vboxnetadp(OE)> Apr 24 11:23:37 PC4 kernel: BUG: scheduling while atomic: kworker/0:2/299/0x00000002 Apr 24 11:23:37 PC4 kernel: e1000e 0000:00:1f.6 enp0s31f6: NIC Link is Up 100 Mbps Half Duplex, Flow Control: Rx/Tx Reproducible: Always
I found the same issue upgrading to fedora 40. As long I have Ethernet unplugged, no problems at all, however as soon as I plug in the networking cable I do get issues and the system completely hangs, not recovering after hours, no chance to get it back w/o reboot. [ 865.623919] e1000e 0000:00:1f.6 enp0s31f6: NIC Link is Up 1000 Mbps Half Duplex, Flow Control: None [ 865.623941] BUG: scheduling while atomic: kworker/2:2/4434/0x00000002 [ 865.623943] Modules linked in: rfcomm snd_seq_dummy snd_hrtimer nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip_set nf_tables qrtr bnep snd_sof_pci_intel_skl snd_sof_intel_hda_common soundwire_intel snd_sof_intel_hda_mlink soundwire_cadence snd_sof_intel_hda snd_sof_pci snd_sof_xtensa_dsp snd_sof snd_sof_utils soundwire_generic_allocation soundwire_bus snd_soc_avs snd_soc_hda_codec snd_soc_skl snd_soc_hdac_hda rmi_smbus snd_hda_ext_core rmi_core intel_rapl_msr jc42 snd_hda_codec_hdmi intel_rapl_common snd_soc_sst_ipc snd_soc_sst_dsp intel_uncore_frequency snd_soc_acpi_intel_match sunrpc snd_soc_acpi intel_uncore_frequency_common snd_soc_core snd_ctl_led snd_hda_codec_realtek snd_hda_codec_generic snd_compress intel_pmc_core_pltdrv ac97_bus snd_pcm_dmaengine intel_pmc_core mei_wdt intel_vsec snd_hda_intel pmt_telemetry mei_hdcp mei_pxp pmt_class ee1004 snd_intel_dspcfg iTCO_wdt [ 865.623980] snd_intel_sdw_acpi intel_tcc_cooling intel_pmc_bxt iTCO_vendor_support snd_hda_codec x86_pkg_temp_thermal intel_powerclamp coretemp iwlmvm kvm_intel snd_hda_core mac80211 kvm libarc4 snd_hwdep uvcvideo irqbypass binfmt_misc iwlwifi uvc snd_seq videobuf2_vmalloc rapl btusb intel_cstate snd_seq_device videobuf2_memops videobuf2_v4l2 btrtl intel_uncore btintel videobuf2_common btbcm cfg80211 btmtk vfat pcspkr videodev snd_pcm think_lmi fat intel_wmi_thunderbolt bluetooth wmi_bmof firmware_attributes_class mei_me i2c_i801 snd_timer mei intel_pch_thermal i2c_smbus mc thinkpad_acpi intel_xhci_usb_role_switch ledtrig_audio platform_profile rfkill snd soundcore acpi_pad joydev loop nfnetlink zram dm_crypt i915 i2c_algo_bit crct10dif_pclmul crc32_pclmul crc32c_intel drm_buddy polyval_clmulni nvme ttm polyval_generic uas drm_display_helper ghash_clmulni_intel nvme_core sha512_ssse3 sha256_ssse3 ucsi_acpi typec_ucsi nvme_auth usb_storage sha1_ssse3 e1000e typec cec video wmi serio_raw ip6_tables ip_tables fuse [ 865.624031] CPU: 2 PID: 4434 Comm: kworker/2:2 Not tainted 6.8.7-300.fc40.x86_64 #1 [ 865.624033] Hardware name: LENOVO 20HGS22D04/20HGS22D04, BIOS N1WET74W (1.53 ) 02/26/2024 [ 865.624034] Workqueue: events e1000_watchdog_task [e1000e] [ 865.624051] Call Trace: [ 865.624053] <TASK> [ 865.624055] dump_stack_lvl+0x6a/0x90 [ 865.624059] __schedule_bug+0x56/0x70 [ 865.624062] __schedule+0x10a7/0x1530 [ 865.624065] ? ktime_get+0x3c/0xa0 [ 865.624067] ? lapic_next_deadline+0x2c/0x40 [ 865.624070] ? hrtimer_start_range_ns+0x267/0x350 [ 865.624072] schedule+0x32/0xd0 [ 865.624075] schedule_hrtimeout_range_clock+0xe7/0x1e0 [ 865.624078] ? __pfx_hrtimer_wakeup+0x10/0x10 [ 865.624081] usleep_range_state+0x67/0x90 [ 865.624083] e1000e_read_phy_reg_mdic+0x87/0x280 [e1000e] [ 865.624097] e1000e_update_stats+0x51a/0x720 [e1000e] [ 865.624110] e1000_watchdog_task+0xe5/0xaa0 [e1000e] [ 865.624122] process_one_work+0x16d/0x330 [ 865.624125] worker_thread+0x273/0x3c0 [ 865.624127] ? __pfx_worker_thread+0x10/0x10 [ 865.624129] kthread+0xe5/0x120 [ 865.624131] ? __pfx_kthread+0x10/0x10 [ 865.624132] ret_from_fork+0x31/0x50 [ 865.624135] ? __pfx_kthread+0x10/0x10 [ 865.624136] ret_from_fork_asm+0x1b/0x30 [ 865.624140] </TASK> [ 892.684154] watchdog: BUG: soft lockup - CPU#2 stuck for 26s! [kworker/2:3:291] [ 892.684160] Modules linked in: rfcomm snd_seq_dummy snd_hrtimer nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip_set nf_tables qrtr bnep snd_sof_pci_intel_skl snd_sof_intel_hda_common soundwire_intel snd_sof_intel_hda_mlink soundwire_cadence snd_sof_intel_hda snd_sof_pci snd_sof_xtensa_dsp snd_sof snd_sof_utils soundwire_generic_allocation soundwire_bus snd_soc_avs snd_soc_hda_codec snd_soc_skl snd_soc_hdac_hda rmi_smbus snd_hda_ext_core rmi_core intel_rapl_msr jc42 snd_hda_codec_hdmi intel_rapl_common snd_soc_sst_ipc snd_soc_sst_dsp intel_uncore_frequency snd_soc_acpi_intel_match sunrpc snd_soc_acpi intel_uncore_frequency_common snd_soc_core snd_ctl_led snd_hda_codec_realtek snd_hda_codec_generic snd_compress intel_pmc_core_pltdrv ac97_bus snd_pcm_dmaengine intel_pmc_core mei_wdt intel_vsec snd_hda_intel pmt_telemetry mei_hdcp mei_pxp pmt_class ee1004 snd_intel_dspcfg iTCO_wdt [ 892.684198] snd_intel_sdw_acpi intel_tcc_cooling intel_pmc_bxt iTCO_vendor_support snd_hda_codec x86_pkg_temp_thermal intel_powerclamp coretemp iwlmvm kvm_intel snd_hda_core mac80211 kvm libarc4 snd_hwdep uvcvideo irqbypass binfmt_misc iwlwifi uvc snd_seq videobuf2_vmalloc rapl btusb intel_cstate snd_seq_device videobuf2_memops videobuf2_v4l2 btrtl intel_uncore btintel videobuf2_common btbcm cfg80211 btmtk vfat pcspkr videodev snd_pcm think_lmi fat intel_wmi_thunderbolt bluetooth wmi_bmof firmware_attributes_class mei_me i2c_i801 snd_timer mei intel_pch_thermal i2c_smbus mc thinkpad_acpi intel_xhci_usb_role_switch ledtrig_audio platform_profile rfkill snd soundcore acpi_pad joydev loop nfnetlink zram dm_crypt i915 i2c_algo_bit crct10dif_pclmul crc32_pclmul crc32c_intel drm_buddy polyval_clmulni nvme ttm polyval_generic uas drm_display_helper ghash_clmulni_intel nvme_core sha512_ssse3 sha256_ssse3 ucsi_acpi typec_ucsi nvme_auth usb_storage sha1_ssse3 e1000e typec cec video wmi serio_raw ip6_tables ip_tables fuse [ 892.684247] CPU: 2 PID: 291 Comm: kworker/2:3 Tainted: G W 6.8.7-300.fc40.x86_64 #1 [ 892.684250] Hardware name: LENOVO 20HGS22D04/20HGS22D04, BIOS N1WET74W (1.53 ) 02/26/2024 [ 892.684251] Workqueue: events linkwatch_event [ 892.684255] RIP: 0010:native_queued_spin_lock_slowpath+0x6e/0x2b0 [ 892.684259] Code: 77 77 f0 0f ba 2b 08 0f 92 c2 8b 03 0f b6 d2 c1 e2 08 30 e4 09 d0 3d ff 00 00 00 77 53 85 c0 74 10 0f b6 03 84 c0 74 09 f3 90 <0f> b6 03 84 c0 75 f7 b8 01 00 00 00 66 89 03 5b 5d 41 5c 41 5d c3 [ 892.684261] RSP: 0018:ffffa965c04f3bc0 EFLAGS: 00000202 [ 892.684263] RAX: 0000000000000001 RBX: ffff96a1c1c6f428 RCX: 0000000000000000 [ 892.684264] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff96a1c1c6f428 [ 892.684265] RBP: ffff96a285338138 R08: 0000000000000000 R09: 0000000000000000 [ 892.684266] R10: ffff96a285338200 R11: 0000000000000010 R12: ffff96a1c1c6f428 [ 892.684267] R13: ffff96a285338000 R14: ffffa965c04f3c97 R15: ffffa965c04f3cb8 [ 892.684268] FS: 0000000000000000(0000) GS:ffff96a706500000(0000) knlGS:0000000000000000 [ 892.684270] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 892.684271] CR2: 00007f04c3e30008 CR3: 0000000491422005 CR4: 00000000003706f0 [ 892.684272] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 892.684273] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 892.684274] Call Trace: [ 892.684276] <IRQ> [ 892.684278] ? watchdog_timer_fn+0x1ea/0x270 [ 892.684281] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 892.684283] ? __hrtimer_run_queues+0x12f/0x2a0 [ 892.684287] ? hrtimer_interrupt+0xf8/0x230 [ 892.684290] ? __sysvec_apic_timer_interrupt+0x4a/0x140 [ 892.684292] ? sysvec_apic_timer_interrupt+0x6d/0x90 [ 892.684295] </IRQ> [ 892.684296] <TASK> [ 892.684296] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 892.684301] ? native_queued_spin_lock_slowpath+0x6e/0x2b0 [ 892.684304] _raw_spin_lock+0x29/0x30 [ 892.684307] e1000e_get_stats64+0x22/0x120 [e1000e] [ 892.684323] dev_get_stats+0x5d/0x110 [ 892.684325] rtnl_fill_stats+0x3b/0x130 [ 892.684328] rtnl_fill_ifinfo+0x83d/0x1550 [ 892.684330] ? __kmalloc_node_track_caller+0x300/0x440 [ 892.684332] ? __alloc_skb+0x8a/0x1a0 [ 892.684335] rtmsg_ifinfo_build_skb+0xae/0x110 [ 892.684338] rtmsg_ifinfo+0x3c/0x90 [ 892.684340] netdev_state_change+0x89/0x90 [ 892.684343] linkwatch_do_dev+0x4f/0x60 [ 892.684345] __linkwatch_run_queue+0xdf/0x220 [ 892.684347] linkwatch_event+0x31/0x40 [ 892.684349] process_one_work+0x16d/0x330 [ 892.684352] worker_thread+0x273/0x3c0 [ 892.684354] ? __pfx_worker_thread+0x10/0x10 [ 892.684356] kthread+0xe5/0x120 [ 892.684358] ? __pfx_kthread+0x10/0x10 [ 892.684360] ret_from_fork+0x31/0x50 [ 892.684362] ? __pfx_kthread+0x10/0x10 [ 892.684364] ret_from_fork_asm+0x1b/0x30 [ 892.684367] </TASK> [ 920.683834] watchdog: BUG: soft lockup - CPU#2 stuck for 52s! [kworker/2:3:291] [ 920.683839] Modules linked in: rfcomm snd_seq_dummy snd_hrtimer nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip_set nf_tables qrtr bnep snd_sof_pci_intel_skl snd_sof_intel_hda_common soundwire_intel snd_sof_intel_hda_mlink soundwire_cadence snd_sof_intel_hda snd_sof_pci snd_sof_xtensa_dsp snd_sof snd_sof_utils soundwire_generic_allocation soundwire_bus snd_soc_avs snd_soc_hda_codec snd_soc_skl snd_soc_hdac_hda rmi_smbus snd_hda_ext_core rmi_core intel_rapl_msr jc42 snd_hda_codec_hdmi intel_rapl_common snd_soc_sst_ipc snd_soc_sst_dsp intel_uncore_frequency snd_soc_acpi_intel_match sunrpc snd_soc_acpi intel_uncore_frequency_common snd_soc_core snd_ctl_led snd_hda_codec_realtek snd_hda_codec_generic snd_compress intel_pmc_core_pltdrv ac97_bus snd_pcm_dmaengine intel_pmc_core mei_wdt intel_vsec snd_hda_intel pmt_telemetry mei_hdcp mei_pxp pmt_class ee1004 snd_intel_dspcfg iTCO_wdt [ 920.683877] snd_intel_sdw_acpi intel_tcc_cooling intel_pmc_bxt iTCO_vendor_support snd_hda_codec x86_pkg_temp_thermal intel_powerclamp coretemp iwlmvm kvm_intel snd_hda_core mac80211 kvm libarc4 snd_hwdep uvcvideo irqbypass binfmt_misc iwlwifi uvc snd_seq videobuf2_vmalloc rapl btusb intel_cstate snd_seq_device videobuf2_memops videobuf2_v4l2 btrtl intel_uncore btintel videobuf2_common btbcm cfg80211 btmtk vfat pcspkr videodev snd_pcm think_lmi fat intel_wmi_thunderbolt bluetooth wmi_bmof firmware_attributes_class mei_me i2c_i801 snd_timer mei intel_pch_thermal i2c_smbus mc thinkpad_acpi intel_xhci_usb_role_switch ledtrig_audio platform_profile rfkill snd soundcore acpi_pad joydev loop nfnetlink zram dm_crypt i915 i2c_algo_bit crct10dif_pclmul crc32_pclmul crc32c_intel drm_buddy polyval_clmulni nvme ttm polyval_generic uas drm_display_helper ghash_clmulni_intel nvme_core sha512_ssse3 sha256_ssse3 ucsi_acpi typec_ucsi nvme_auth usb_storage sha1_ssse3 e1000e typec cec video wmi serio_raw ip6_tables ip_tables fuse [ 920.683926] CPU: 2 PID: 291 Comm: kworker/2:3 Tainted: G W L 6.8.7-300.fc40.x86_64 #1 [ 920.683929] Hardware name: LENOVO 20HGS22D04/20HGS22D04, BIOS N1WET74W (1.53 ) 02/26/2024 [ 920.683930] Workqueue: events linkwatch_event [ 920.683934] RIP: 0010:native_queued_spin_lock_slowpath+0x6e/0x2b0 [ 920.683939] Code: 77 77 f0 0f ba 2b 08 0f 92 c2 8b 03 0f b6 d2 c1 e2 08 30 e4 09 d0 3d ff 00 00 00 77 53 85 c0 74 10 0f b6 03 84 c0 74 09 f3 90 <0f> b6 03 84 c0 75 f7 b8 01 00 00 00 66 89 03 5b 5d 41 5c 41 5d c3 [ 920.683940] RSP: 0018:ffffa965c04f3bc0 EFLAGS: 00000202 [ 920.683942] RAX: 0000000000000001 RBX: ffff96a1c1c6f428 RCX: 0000000000000000 [ 920.683943] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff96a1c1c6f428 [ 920.683944] RBP: ffff96a285338138 R08: 0000000000000000 R09: 0000000000000000 [ 920.683945] R10: ffff96a285338200 R11: 0000000000000010 R12: ffff96a1c1c6f428 [ 920.683946] R13: ffff96a285338000 R14: ffffa965c04f3c97 R15: ffffa965c04f3cb8 [ 920.683947] FS: 0000000000000000(0000) GS:ffff96a706500000(0000) knlGS:0000000000000000 [ 920.683949] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 920.683950] CR2: 00007f04c3e30008 CR3: 0000000491422005 CR4: 00000000003706f0 [ 920.683951] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 920.683952] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 920.683953] Call Trace: [ 920.683954] <IRQ> [ 920.683956] ? watchdog_timer_fn+0x1ea/0x270 [ 920.683959] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 920.683961] ? __hrtimer_run_queues+0x12f/0x2a0 [ 920.683964] ? hrtimer_interrupt+0xf8/0x230 [ 920.683967] ? __sysvec_apic_timer_interrupt+0x4a/0x140 [ 920.683970] ? sysvec_apic_timer_interrupt+0x6d/0x90 [ 920.683972] </IRQ> [ 920.683973] <TASK> [ 920.683974] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 920.683978] ? native_queued_spin_lock_slowpath+0x6e/0x2b0 [ 920.683981] _raw_spin_lock+0x29/0x30 [ 920.683984] e1000e_get_stats64+0x22/0x120 [e1000e] [ 920.684000] dev_get_stats+0x5d/0x110 [ 920.684002] rtnl_fill_stats+0x3b/0x130 [ 920.684005] rtnl_fill_ifinfo+0x83d/0x1550 [ 920.684006] ? __kmalloc_node_track_caller+0x300/0x440 [ 920.684009] ? __alloc_skb+0x8a/0x1a0 [ 920.684012] rtmsg_ifinfo_build_skb+0xae/0x110 [ 920.684015] rtmsg_ifinfo+0x3c/0x90 [ 920.684017] netdev_state_change+0x89/0x90 [ 920.684020] linkwatch_do_dev+0x4f/0x60 [ 920.684022] __linkwatch_run_queue+0xdf/0x220 [ 920.684024] linkwatch_event+0x31/0x40 [ 920.684026] process_one_work+0x16d/0x330 [ 920.684029] worker_thread+0x273/0x3c0 [ 920.684031] ? __pfx_worker_thread+0x10/0x10 [ 920.684033] kthread+0xe5/0x120 [ 920.684035] ? __pfx_kthread+0x10/0x10 [ 920.684037] ret_from_fork+0x31/0x50 [ 920.684039] ? __pfx_kthread+0x10/0x10 [ 920.684040] ret_from_fork_asm+0x1b/0x30 [ 920.684044] </TASK> [ 925.624220] rcu: INFO: rcu_preempt self-detected stall on CPU [ 925.624224] rcu: 2-....: (59999 ticks this GP) idle=7e2c/1/0x4000000000000000 softirq=46890/46890 fqs=14988 [ 925.624228] rcu: (t=60000 jiffies g=70265 q=15887 ncpus=4) [ 925.624230] CPU: 2 PID: 291 Comm: kworker/2:3 Tainted: G W L 6.8.7-300.fc40.x86_64 #1 [ 925.624232] Hardware name: LENOVO 20HGS22D04/20HGS22D04, BIOS N1WET74W (1.53 ) 02/26/2024 [ 925.624233] Workqueue: events linkwatch_event [ 925.624238] RIP: 0010:native_queued_spin_lock_slowpath+0x6e/0x2b0 [ 925.624242] Code: 77 77 f0 0f ba 2b 08 0f 92 c2 8b 03 0f b6 d2 c1 e2 08 30 e4 09 d0 3d ff 00 00 00 77 53 85 c0 74 10 0f b6 03 84 c0 74 09 f3 90 <0f> b6 03 84 c0 75 f7 b8 01 00 00 00 66 89 03 5b 5d 41 5c 41 5d c3 [ 925.624244] RSP: 0018:ffffa965c04f3bc0 EFLAGS: 00000202 [ 925.624246] RAX: 0000000000000001 RBX: ffff96a1c1c6f428 RCX: 0000000000000000 [ 925.624247] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff96a1c1c6f428 [ 925.624248] RBP: ffff96a285338138 R08: 0000000000000000 R09: 0000000000000000 [ 925.624249] R10: ffff96a285338200 R11: 0000000000000010 R12: ffff96a1c1c6f428 [ 925.624250] R13: ffff96a285338000 R14: ffffa965c04f3c97 R15: ffffa965c04f3cb8 [ 925.624251] FS: 0000000000000000(0000) GS:ffff96a706500000(0000) knlGS:0000000000000000 [ 925.624253] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 925.624254] CR2: 00007f04c3e30008 CR3: 0000000491422005 CR4: 00000000003706f0 [ 925.624255] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 925.624256] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 925.624257] Call Trace: [ 925.624258] <IRQ> [ 925.624259] ? rcu_dump_cpu_stacks+0xc4/0x100 [ 925.624263] ? rcu_sched_clock_irq+0x31d/0x1010 [ 925.624265] ? notifier_call_chain+0x5a/0xd0 [ 925.624268] ? timekeeping_update+0xe0/0x130 [ 925.624270] ? timekeeping_advance+0x378/0x5a0 [ 925.624272] ? update_process_times+0x74/0xb0 [ 925.624274] ? tick_sched_handle+0x21/0x60 [ 925.624276] ? tick_nohz_highres_handler+0x6f/0x90 [ 925.624278] ? __pfx_tick_nohz_highres_handler+0x10/0x10 [ 925.624279] ? __hrtimer_run_queues+0x12f/0x2a0 [ 925.624282] ? hrtimer_interrupt+0xf8/0x230 [ 925.624285] ? __sysvec_apic_timer_interrupt+0x4a/0x140 [ 925.624288] ? sysvec_apic_timer_interrupt+0x6d/0x90 [ 925.624290] </IRQ> [ 925.624291] <TASK> [ 925.624292] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 925.624296] ? native_queued_spin_lock_slowpath+0x6e/0x2b0 [ 925.624299] _raw_spin_lock+0x29/0x30 [ 925.624303] e1000e_get_stats64+0x22/0x120 [e1000e] [ 925.624318] dev_get_stats+0x5d/0x110 [ 925.624321] rtnl_fill_stats+0x3b/0x130 [ 925.624323] rtnl_fill_ifinfo+0x83d/0x1550 [ 925.624325] ? __kmalloc_node_track_caller+0x300/0x440 [ 925.624328] ? __alloc_skb+0x8a/0x1a0 [ 925.624331] rtmsg_ifinfo_build_skb+0xae/0x110 [ 925.624334] rtmsg_ifinfo+0x3c/0x90 [ 925.624336] netdev_state_change+0x89/0x90 [ 925.624338] linkwatch_do_dev+0x4f/0x60 [ 925.624340] __linkwatch_run_queue+0xdf/0x220 [ 925.624342] linkwatch_event+0x31/0x40 [ 925.624344] process_one_work+0x16d/0x330 [ 925.624347] worker_thread+0x273/0x3c0 [ 925.624350] ? __pfx_worker_thread+0x10/0x10 [ 925.624351] kthread+0xe5/0x120 [ 925.624353] ? __pfx_kthread+0x10/0x10 [ 925.624355] ret_from_fork+0x31/0x50 [ 925.624357] ? __pfx_kthread+0x10/0x10 [ 925.624359] ret_from_fork_asm+0x1b/0x30 [ 925.624362] </TASK> [ 952.683469] watchdog: BUG: soft lockup - CPU#2 stuck for 82s! [kworker/2:3:291] [ 952.683474] Modules linked in: rfcomm snd_seq_dummy snd_hrtimer nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip_set nf_tables qrtr bnep snd_sof_pci_intel_skl snd_sof_intel_hda_common soundwire_intel snd_sof_intel_hda_mlink soundwire_cadence snd_sof_intel_hda snd_sof_pci snd_sof_xtensa_dsp snd_sof snd_sof_utils soundwire_generic_allocation soundwire_bus snd_soc_avs snd_soc_hda_codec snd_soc_skl snd_soc_hdac_hda rmi_smbus snd_hda_ext_core rmi_core intel_rapl_msr jc42 snd_hda_codec_hdmi intel_rapl_common snd_soc_sst_ipc snd_soc_sst_dsp intel_uncore_frequency snd_soc_acpi_intel_match sunrpc snd_soc_acpi intel_uncore_frequency_common snd_soc_core snd_ctl_led snd_hda_codec_realtek snd_hda_codec_generic snd_compress intel_pmc_core_pltdrv ac97_bus snd_pcm_dmaengine intel_pmc_core mei_wdt intel_vsec snd_hda_intel pmt_telemetry mei_hdcp mei_pxp pmt_class ee1004 snd_intel_dspcfg iTCO_wdt [ 952.683511] snd_intel_sdw_acpi intel_tcc_cooling intel_pmc_bxt iTCO_vendor_support snd_hda_codec x86_pkg_temp_thermal intel_powerclamp coretemp iwlmvm kvm_intel snd_hda_core mac80211 kvm libarc4 snd_hwdep uvcvideo irqbypass binfmt_misc iwlwifi uvc snd_seq videobuf2_vmalloc rapl btusb intel_cstate snd_seq_device videobuf2_memops videobuf2_v4l2 btrtl intel_uncore btintel videobuf2_common btbcm cfg80211 btmtk vfat pcspkr videodev snd_pcm think_lmi fat intel_wmi_thunderbolt bluetooth wmi_bmof firmware_attributes_class mei_me i2c_i801 snd_timer mei intel_pch_thermal i2c_smbus mc thinkpad_acpi intel_xhci_usb_role_switch ledtrig_audio platform_profile rfkill snd soundcore acpi_pad joydev loop nfnetlink zram dm_crypt i915 i2c_algo_bit crct10dif_pclmul crc32_pclmul crc32c_intel drm_buddy polyval_clmulni nvme ttm polyval_generic uas drm_display_helper ghash_clmulni_intel nvme_core sha512_ssse3 sha256_ssse3 ucsi_acpi typec_ucsi nvme_auth usb_storage sha1_ssse3 e1000e typec cec video wmi serio_raw ip6_tables ip_tables fuse [ 952.683562] CPU: 2 PID: 291 Comm: kworker/2:3 Tainted: G W L 6.8.7-300.fc40.x86_64 #1 [ 952.683564] Hardware name: LENOVO 20HGS22D04/20HGS22D04, BIOS N1WET74W (1.53 ) 02/26/2024 [ 952.683565] Workqueue: events linkwatch_event [ 952.683569] RIP: 0010:native_queued_spin_lock_slowpath+0x6c/0x2b0 [ 952.683574] Code: 00 00 77 77 f0 0f ba 2b 08 0f 92 c2 8b 03 0f b6 d2 c1 e2 08 30 e4 09 d0 3d ff 00 00 00 77 53 85 c0 74 10 0f b6 03 84 c0 74 09 <f3> 90 0f b6 03 84 c0 75 f7 b8 01 00 00 00 66 89 03 5b 5d 41 5c 41 [ 952.683575] RSP: 0018:ffffa965c04f3bc0 EFLAGS: 00000202 [ 952.683577] RAX: 0000000000000001 RBX: ffff96a1c1c6f428 RCX: 0000000000000000 [ 952.683578] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff96a1c1c6f428 [ 952.683579] RBP: ffff96a285338138 R08: 0000000000000000 R09: 0000000000000000 [ 952.683580] R10: ffff96a285338200 R11: 0000000000000010 R12: ffff96a1c1c6f428 [ 952.683581] R13: ffff96a285338000 R14: ffffa965c04f3c97 R15: ffffa965c04f3cb8 [ 952.683582] FS: 0000000000000000(0000) GS:ffff96a706500000(0000) knlGS:0000000000000000 [ 952.683584] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 952.683585] CR2: 00007f04c3e30008 CR3: 0000000491422005 CR4: 00000000003706f0 [ 952.683586] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 952.683587] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 952.683588] Call Trace: [ 952.683589] <IRQ> [ 952.683591] ? watchdog_timer_fn+0x1ea/0x270 [ 952.683593] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 952.683595] ? __hrtimer_run_queues+0x12f/0x2a0 [ 952.683599] ? hrtimer_interrupt+0xf8/0x230 [ 952.683602] ? __sysvec_apic_timer_interrupt+0x4a/0x140 [ 952.683605] ? sysvec_apic_timer_interrupt+0x6d/0x90 [ 952.683607] </IRQ> [ 952.683608] <TASK> [ 952.683609] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 952.683613] ? native_queued_spin_lock_slowpath+0x6c/0x2b0 [ 952.683616] _raw_spin_lock+0x29/0x30 [ 952.683619] e1000e_get_stats64+0x22/0x120 [e1000e] [ 952.683635] dev_get_stats+0x5d/0x110 [ 952.683637] rtnl_fill_stats+0x3b/0x130 [ 952.683640] rtnl_fill_ifinfo+0x83d/0x1550 [ 952.683642] ? __kmalloc_node_track_caller+0x300/0x440 [ 952.683644] ? __alloc_skb+0x8a/0x1a0 [ 952.683647] rtmsg_ifinfo_build_skb+0xae/0x110 [ 952.683650] rtmsg_ifinfo+0x3c/0x90 [ 952.683652] netdev_state_change+0x89/0x90 [ 952.683655] linkwatch_do_dev+0x4f/0x60 [ 952.683657] __linkwatch_run_queue+0xdf/0x220 [ 952.683659] linkwatch_event+0x31/0x40 [ 952.683661] process_one_work+0x16d/0x330 [ 952.683663] worker_thread+0x273/0x3c0 [ 952.683666] ? __pfx_worker_thread+0x10/0x10 [ 952.683668] kthread+0xe5/0x120 [ 952.683670] ? __pfx_kthread+0x10/0x10 [ 952.683671] ret_from_fork+0x31/0x50 [ 952.683674] ? __pfx_kthread+0x10/0x10 [ 952.683675] ret_from_fork_asm+0x1b/0x30 [ 952.683679] </TASK> [ 980.683149] watchdog: BUG: soft lockup - CPU#2 stuck for 108s! [kworker/2:3:291] [ 980.683154] Modules linked in: rfcomm snd_seq_dummy snd_hrtimer nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip_set nf_tables qrtr bnep snd_sof_pci_intel_skl snd_sof_intel_hda_common soundwire_intel snd_sof_intel_hda_mlink soundwire_cadence snd_sof_intel_hda snd_sof_pci snd_sof_xtensa_dsp snd_sof snd_sof_utils soundwire_generic_allocation soundwire_bus snd_soc_avs snd_soc_hda_codec snd_soc_skl snd_soc_hdac_hda rmi_smbus snd_hda_ext_core rmi_core intel_rapl_msr jc42 snd_hda_codec_hdmi intel_rapl_common snd_soc_sst_ipc snd_soc_sst_dsp intel_uncore_frequency snd_soc_acpi_intel_match sunrpc snd_soc_acpi intel_uncore_frequency_common snd_soc_core snd_ctl_led snd_hda_codec_realtek snd_hda_codec_generic snd_compress intel_pmc_core_pltdrv ac97_bus snd_pcm_dmaengine intel_pmc_core mei_wdt intel_vsec snd_hda_intel pmt_telemetry mei_hdcp mei_pxp pmt_class ee1004 snd_intel_dspcfg iTCO_wdt [ 980.683192] snd_intel_sdw_acpi intel_tcc_cooling intel_pmc_bxt iTCO_vendor_support snd_hda_codec x86_pkg_temp_thermal intel_powerclamp coretemp iwlmvm kvm_intel snd_hda_core mac80211 kvm libarc4 snd_hwdep uvcvideo irqbypass binfmt_misc iwlwifi uvc snd_seq videobuf2_vmalloc rapl btusb intel_cstate snd_seq_device videobuf2_memops videobuf2_v4l2 btrtl intel_uncore btintel videobuf2_common btbcm cfg80211 btmtk vfat pcspkr videodev snd_pcm think_lmi fat intel_wmi_thunderbolt bluetooth wmi_bmof firmware_attributes_class mei_me i2c_i801 snd_timer mei intel_pch_thermal i2c_smbus mc thinkpad_acpi intel_xhci_usb_role_switch ledtrig_audio platform_profile rfkill snd soundcore acpi_pad joydev loop nfnetlink zram dm_crypt i915 i2c_algo_bit crct10dif_pclmul crc32_pclmul crc32c_intel drm_buddy polyval_clmulni nvme ttm polyval_generic uas drm_display_helper ghash_clmulni_intel nvme_core sha512_ssse3 sha256_ssse3 ucsi_acpi typec_ucsi nvme_auth usb_storage sha1_ssse3 e1000e typec cec video wmi serio_raw ip6_tables ip_tables fuse [ 980.683244] CPU: 2 PID: 291 Comm: kworker/2:3 Tainted: G W L 6.8.7-300.fc40.x86_64 #1 [ 980.683246] Hardware name: LENOVO 20HGS22D04/20HGS22D04, BIOS N1WET74W (1.53 ) 02/26/2024 [ 980.683247] Workqueue: events linkwatch_event [ 980.683251] RIP: 0010:native_queued_spin_lock_slowpath+0x6e/0x2b0 [ 980.683255] Code: 77 77 f0 0f ba 2b 08 0f 92 c2 8b 03 0f b6 d2 c1 e2 08 30 e4 09 d0 3d ff 00 00 00 77 53 85 c0 74 10 0f b6 03 84 c0 74 09 f3 90 <0f> b6 03 84 c0 75 f7 b8 01 00 00 00 66 89 03 5b 5d 41 5c 41 5d c3 [ 980.683257] RSP: 0018:ffffa965c04f3bc0 EFLAGS: 00000202 [ 980.683259] RAX: 0000000000000001 RBX: ffff96a1c1c6f428 RCX: 0000000000000000 [ 980.683260] RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff96a1c1c6f428 [ 980.683261] RBP: ffff96a285338138 R08: 0000000000000000 R09: 0000000000000000 [ 980.683262] R10: ffff96a285338200 R11: 0000000000000010 R12: ffff96a1c1c6f428 [ 980.683263] R13: ffff96a285338000 R14: ffffa965c04f3c97 R15: ffffa965c04f3cb8 [ 980.683264] FS: 0000000000000000(0000) GS:ffff96a706500000(0000) knlGS:0000000000000000 [ 980.683265] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 980.683267] CR2: 00007f04c3e30008 CR3: 0000000491422005 CR4: 00000000003706f0 [ 980.683268] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 980.683269] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [ 980.683270] Call Trace: [ 980.683272] <IRQ> [ 980.683274] ? watchdog_timer_fn+0x1ea/0x270 [ 980.683277] ? __pfx_watchdog_timer_fn+0x10/0x10 [ 980.683279] ? __hrtimer_run_queues+0x12f/0x2a0 [ 980.683283] ? hrtimer_interrupt+0xf8/0x230 [ 980.683286] ? __sysvec_apic_timer_interrupt+0x4a/0x140 [ 980.683288] ? sysvec_apic_timer_interrupt+0x6d/0x90 [ 980.683291] </IRQ> [ 980.683292] <TASK> [ 980.683293] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 980.683297] ? native_queued_spin_lock_slowpath+0x6e/0x2b0 [ 980.683300] _raw_spin_lock+0x29/0x30 [ 980.683303] e1000e_get_stats64+0x22/0x120 [e1000e] [ 980.683319] dev_get_stats+0x5d/0x110 [ 980.683321] rtnl_fill_stats+0x3b/0x130 [ 980.683324] rtnl_fill_ifinfo+0x83d/0x1550 [ 980.683325] ? __kmalloc_node_track_caller+0x300/0x440 [ 980.683328] ? __alloc_skb+0x8a/0x1a0 [ 980.683331] rtmsg_ifinfo_build_skb+0xae/0x110 [ 980.683334] rtmsg_ifinfo+0x3c/0x90 [ 980.683336] netdev_state_change+0x89/0x90 [ 980.683339] linkwatch_do_dev+0x4f/0x60 [ 980.683341] __linkwatch_run_queue+0xdf/0x220 [ 980.683343] linkwatch_event+0x31/0x40 [ 980.683345] process_one_work+0x16d/0x330 [ 980.683348] worker_thread+0x273/0x3c0 [ 980.683350] ? __pfx_worker_thread+0x10/0x10 [ 980.683352] kthread+0xe5/0x120 [ 980.683354] ? __pfx_kthread+0x10/0x10 [ 980.683356] ret_from_fork+0x31/0x50 [ 980.683358] ? __pfx_kthread+0x10/0x10 [ 980.683360] ret_from_fork_asm+0x1b/0x30 [ 980.683363] </TASK> #
I think this is a dupe of [bug 2276325], and the likely fix is stated there.
So... sounds like the fix is in the works. If not, some more observations. If the interface is DOWN (ifconfig <eth> down), plugging in the Ethernet cable doesn't cause a bug. Removing the cable never generates the bug. Plugging in the cable and turning on the interface (ifconfig <eth> up) doesn't generate the bug. You can run the interface full manual (ifconfig <eth> <IP> <netmask> up) with no issues. If you have the interface UP and plug the cable in, you get the issue. kworker uses 100% of the CPU. ifconfig hangs (also with 100% CPU). Network Manager hangs. But. If you do (cable plugged in) ifconfig <eth> <IP> <netmask> up ping <blah> --- ping works (unplug cable) (wait a few seconds) (plug cable in) ping <blah> -- still works Even though kworker shows 100% CPU and ifconfig hangs. And yeah, this worked with 6.8.4. 6.8.6 seemed to sometimes hang, sometimes work. 6.8.8 consistently failed.
I have the same problem on my Thinkpad T480s even without an ethernet cable plugged in. After running for several hours my laptop sounds a loud beep, repeated several times at 10s of seconds intervals. The kernel log is very similar to the one in the previous post. The system gradually becomes less responsive and finally becomes catatonic and requires a reboot. I'm currently running kernel 6.8.8.