Login
Log in using an SSO provider:
Fedora Account System
Red Hat Associate
Red Hat Customer
Login using a Red Hat Bugzilla account
Forgot Password
Create an Account
Red Hat Bugzilla – Attachment 1980616 Details for
Bug 2227438
[abrt] entry_SYSCALL_64_after_hwframe: watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ksoftirqd/0:15]
Home
New
Search
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh89 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
[?]
This site requires JavaScript to be enabled to function correctly, please enable it.
File: dmesg
dmesg (text/plain), 271.84 KB, created by
Sylvain Arth
on 2023-07-29 17:20:03 UTC
(
hide
)
Description:
File: dmesg
Filename:
MIME Type:
Creator:
Sylvain Arth
Created:
2023-07-29 17:20:03 UTC
Size:
271.84 KB
patch
obsolete
>[1291249.066685] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1291249.066688] RIP: 0033:0x7f700188be9c >[1291250.590891] Code: 89 4c 24 1c e8 45 97 f7 ff 44 8b 54 24 1c 8b 3c 24 45 31 c9 89 c5 48 8b 54 24 10 48 8b 74 24 08 45 31 c0 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 34 89 ef 48 89 04 24 e8 91 97 f7 ff 48 8b 04 >[1291250.768928] RSP: 002b:00007f70003fd7b0 EFLAGS: 00000246 ORIG_RAX: 000000000000002c >[1291250.768942] RAX: ffffffffffffffda RBX: 00007f70003fd8a0 RCX: 00007f700188be9c >[1291250.768945] RDX: 0000000000000064 RSI: 00007f70003fd8a0 RDI: 0000000000000003 >[1291250.768947] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 >[1291250.768950] R10: 0000000000004000 R11: 0000000000000246 R12: 00000000002b7b7d >[1291250.768952] R13: 00007f70003fdcf0 R14: 0000000000000064 R15: 0000000000000000 >[1291250.768963] </TASK> >[1291428.862842] rcu: INFO: rcu_preempt self-detected stall on CPU >[1291428.862854] rcu: 0-...!: (618 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277433/113277433 fqs=1 >[1291428.862862] rcu: (t=241477 jiffies g=128827697 q=101 ncpus=1) >[1291428.862866] rcu: rcu_preempt kthread timer wakeup didn't happen for 168850 jiffies! g128827697 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1291428.862870] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940846 >[1291428.862872] rcu: rcu_preempt kthread starved for 168853 jiffies! g128827697 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1291428.862876] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1291428.862878] rcu: RCU grace-period kthread stack dump: >[1291428.862880] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1291428.862886] Call Trace: >[1291428.862889] <TASK> >[1291428.862897] __schedule+0x449/0x1480 >[1291428.862909] ? psi_group_change+0x168/0x400 >[1291428.862915] ? lock_timer_base+0x61/0x80 >[1291428.862922] schedule+0x5e/0xd0 >[1291428.862926] schedule_timeout+0x98/0x160 >[1291428.862932] ? __pfx_process_timeout+0x10/0x10 >[1291428.862935] rcu_gp_fqs_loop+0x141/0x520 >[1291428.862941] ? __note_gp_changes+0x153/0x1a0 >[1291428.862945] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1291428.862947] rcu_gp_kthread+0xea/0x1e0 >[1291428.862951] kthread+0xde/0x110 >[1291428.862956] ? __pfx_kthread+0x10/0x10 >[1291428.862959] ret_from_fork+0x2c/0x50 >[1291428.862966] </TASK> >[1291428.862968] rcu: Stack dump where RCU GP kthread last ran: >[1291428.862971] CPU: 0 PID: 389 Comm: btrfs-transacti Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1291428.862975] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1291428.862977] RIP: 0010:finish_task_switch.isra.0+0x96/0x2d0 >[1291428.862983] Code: 45 34 00 00 00 00 0f 1f 44 00 00 49 8b 9c 24 20 0a 00 00 48 85 db 0f 85 aa 00 00 00 4c 89 e7 e8 10 f6 ff ff fb 0f 1f 44 00 00 <65> 48 8b 04 25 80 32 03 00 66 90 4d 85 f6 74 21 65 48 8b 04 25 80 >[1291428.862986] RSP: 0018:ffffb5d8008238c0 EFLAGS: 00010282 >[1291428.862990] RAX: ffff99a16330a740 RBX: 0000000000000000 RCX: 0000000000000002 >[1291428.862992] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff99a21ac33ac0 >[1291428.862994] RBP: ffffb5d8008238e8 R08: 0000000000000000 R09: 0000000000000000 >[1291428.862996] R10: 0000000000000001 R11: 0000000000000110 R12: ffff99a21ac33ac0 >[1291428.862998] R13: ffff99a16330a740 R14: 0000000000000000 R15: 0000000000000402 >[1291428.863001] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1291428.863004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1291428.863006] CR2: 000055cc0c779b48 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1291428.863011] Call Trace: >[1291428.863013] <IRQ> >[1291428.863015] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1291428.863019] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1291428.863023] ? blk_queue_exit+0x12/0x50 >[1291428.863029] ? timekeeping_update+0xdd/0x130 >[1291428.863033] ? timekeeping_advance+0x377/0x590 >[1291428.863037] ? update_process_times+0x74/0xb0 >[1291428.863041] ? tick_sched_handle+0x22/0x60 >[1291428.863045] ? tick_sched_timer+0x67/0x80 >[1291428.863048] ? __pfx_tick_sched_timer+0x10/0x10 >[1291428.863052] ? __hrtimer_run_queues+0x112/0x2b0 >[1291428.863056] ? hrtimer_interrupt+0xf8/0x230 >[1291428.863060] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1291428.863064] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1291428.863069] </IRQ> >[1291428.863070] <TASK> >[1291428.863072] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1291428.863080] ? finish_task_switch.isra.0+0x96/0x2d0 >[1291428.863085] __schedule+0x451/0x1480 >[1291428.863110] ? btrfs_verify_level_key+0xc4/0x180 >[1291428.863118] __cond_resched+0x36/0x50 >[1291428.863122] down_write+0x12/0x60 >[1291428.863125] __btrfs_tree_lock+0x1b/0x90 >[1291428.863130] btrfs_search_slot+0x646/0xc90 >[1291428.863136] ? alloc_extent_state+0x1a/0xb0 >[1291428.863140] lookup_inline_extent_backref+0x173/0x790 >[1291428.863147] lookup_extent_backref+0x41/0xd0 >[1291428.863152] __btrfs_free_extent+0x116/0x1150 >[1291428.863157] __btrfs_run_delayed_refs+0x7ee/0x1220 >[1291428.863162] btrfs_run_delayed_refs+0x6f/0x1f0 >[1291428.863166] btrfs_start_dirty_block_groups+0x3c1/0x5b0 >[1291428.863170] btrfs_commit_transaction+0xb5/0xf00 >[1291428.863175] ? start_transaction+0xc5/0x5c0 >[1291428.863178] transaction_kthread+0x141/0x1b0 >[1291428.863182] ? __pfx_transaction_kthread+0x10/0x10 >[1291428.863184] kthread+0xde/0x110 >[1291428.863188] ? __pfx_kthread+0x10/0x10 >[1291428.863191] ret_from_fork+0x2c/0x50 >[1291428.863196] </TASK> >[1291428.863206] CPU: 0 PID: 389 Comm: btrfs-transacti Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1291428.863209] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1291428.863211] RIP: 0010:finish_task_switch.isra.0+0x96/0x2d0 >[1291428.863216] Code: 45 34 00 00 00 00 0f 1f 44 00 00 49 8b 9c 24 20 0a 00 00 48 85 db 0f 85 aa 00 00 00 4c 89 e7 e8 10 f6 ff ff fb 0f 1f 44 00 00 <65> 48 8b 04 25 80 32 03 00 66 90 4d 85 f6 74 21 65 48 8b 04 25 80 >[1291428.863219] RSP: 0018:ffffb5d8008238c0 EFLAGS: 00010282 >[1291428.863221] RAX: ffff99a16330a740 RBX: 0000000000000000 RCX: 0000000000000002 >[1291428.863223] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff99a21ac33ac0 >[1291428.863225] RBP: ffffb5d8008238e8 R08: 0000000000000000 R09: 0000000000000000 >[1291428.863227] R10: 0000000000000001 R11: 0000000000000110 R12: ffff99a21ac33ac0 >[1291428.863229] R13: ffff99a16330a740 R14: 0000000000000000 R15: 0000000000000402 >[1291428.863231] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1291428.863234] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1291428.863236] CR2: 000055cc0c779b48 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1291428.863240] Call Trace: >[1291428.863242] <IRQ> >[1291428.863243] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1291428.863247] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1291428.863250] ? blk_queue_exit+0x12/0x50 >[1291428.863254] ? timekeeping_update+0xdd/0x130 >[1291428.863258] ? timekeeping_advance+0x377/0x590 >[1291428.863262] ? update_process_times+0x74/0xb0 >[1291428.863265] ? tick_sched_handle+0x22/0x60 >[1291428.863268] ? tick_sched_timer+0x67/0x80 >[1291428.863272] ? __pfx_tick_sched_timer+0x10/0x10 >[1291428.863275] ? __hrtimer_run_queues+0x112/0x2b0 >[1291428.863279] ? hrtimer_interrupt+0xf8/0x230 >[1291428.863282] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1291428.863286] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1291428.863289] </IRQ> >[1291428.863291] <TASK> >[1291428.863292] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1291428.863297] ? finish_task_switch.isra.0+0x96/0x2d0 >[1291428.863301] __schedule+0x451/0x1480 >[1291428.863305] ? btrfs_verify_level_key+0xc4/0x180 >[1291428.863310] __cond_resched+0x36/0x50 >[1291428.863314] down_write+0x12/0x60 >[1291428.863317] __btrfs_tree_lock+0x1b/0x90 >[1291428.863320] btrfs_search_slot+0x646/0xc90 >[1291428.863324] ? alloc_extent_state+0x1a/0xb0 >[1291428.863327] lookup_inline_extent_backref+0x173/0x790 >[1291428.863333] lookup_extent_backref+0x41/0xd0 >[1291428.863337] __btrfs_free_extent+0x116/0x1150 >[1291428.863342] __btrfs_run_delayed_refs+0x7ee/0x1220 >[1291428.863347] btrfs_run_delayed_refs+0x6f/0x1f0 >[1291428.863350] btrfs_start_dirty_block_groups+0x3c1/0x5b0 >[1291428.863354] btrfs_commit_transaction+0xb5/0xf00 >[1291428.863358] ? start_transaction+0xc5/0x5c0 >[1291428.863361] transaction_kthread+0x141/0x1b0 >[1291428.863365] ? __pfx_transaction_kthread+0x10/0x10 >[1291428.863368] kthread+0xde/0x110 >[1291428.863371] ? __pfx_kthread+0x10/0x10 >[1291428.863374] ret_from_fork+0x2c/0x50 >[1291428.863379] </TASK> >[1291548.740769] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ksoftirqd/0:15] >[1291548.740782] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1291548.740860] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1291548.740864] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1291548.740867] RIP: 0010:e1000_clean+0x134/0x990 [e1000] >[1291548.740885] Code: 56 1e 01 54 24 08 48 8b 16 8b 7e 20 01 7c 24 18 48 85 d2 74 07 8b 7a 70 01 7c 24 10 48 8b 3c 24 ba 40 00 00 00 e8 ac fc ff ff <41> c7 44 24 0c 00 00 00 00 45 39 6e 14 75 92 4d 89 f4 83 c5 01 31 >[1291548.740888] RSP: 0018:ffffb5d800083d58 EFLAGS: 00010283 >[1291548.740891] RAX: 000000000000000d RBX: 00000000000000dc RCX: 0000000000000000 >[1291548.740894] RDX: 000000000000000e RSI: ffffe06280264600 RDI: ffff99a1c03d5c00 >[1291548.740896] RBP: 0000000000000000 R08: 0000000000000296 R09: 00000000800c000b >[1291548.740898] R10: ffff99a1c8f8ec70 R11: 0000000000000000 R12: ffff99a0c1117dc0 >[1291548.740901] R13: 00000000000000dd R14: ffff99a1c7e42800 R15: 00000000000000dc >[1291548.740903] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1291548.740906] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1291548.740908] CR2: 00007f6da09410c6 CR3: 0000000102da4000 CR4: 00000000000106f0 >[1291548.740912] Call Trace: >[1291548.740915] <IRQ> >[1291548.740920] ? watchdog_timer_fn+0x1a8/0x210 >[1291548.740927] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1291548.740932] ? __hrtimer_run_queues+0x112/0x2b0 >[1291548.740937] ? hrtimer_interrupt+0xf8/0x230 >[1291548.740941] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1291548.740946] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1291548.740952] </IRQ> >[1291548.740954] <TASK> >[1291548.740955] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1291548.740963] ? e1000_clean+0x134/0x990 [e1000] >[1291548.740976] ? e1000_clean+0x134/0x990 [e1000] >[1291548.740989] ? __pfx_writeout_period+0x10/0x10 >[1291548.740994] __napi_poll+0x2b/0x1c0 >[1291548.741000] net_rx_action+0x29f/0x350 >[1291548.741004] __do_softirq+0xd4/0x2c8 >[1291548.741010] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1291548.741014] run_ksoftirqd+0x2c/0x40 >[1291548.741019] smpboot_thread_fn+0xdc/0x1d0 >[1291548.741023] kthread+0xde/0x110 >[1291548.741027] ? __pfx_kthread+0x10/0x10 >[1291548.741030] ret_from_fork+0x2c/0x50 >[1291548.741037] </TASK> >[1291584.507675] watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [rtkit-daemon:2849664] >[1291584.507704] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1291584.507834] CPU: 0 PID: 2849664 Comm: rtkit-daemon Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1291584.507839] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1291584.507842] RIP: 0010:e1000_xmit_frame+0xd3a/0xfc0 [e1000] >[1291584.507862] Code: 48 8b 83 00 04 00 00 f6 80 90 00 00 00 03 0f 84 ac f9 ff ff 48 8b 3c 24 41 0f b7 45 2a 41 8b 55 18 48 03 87 48 0e 00 00 89 10 <e9> 91 f9 ff ff 31 c9 eb 84 31 f6 48 89 ef e8 e3 c1 a1 c3 e9 e1 fe >[1291584.507964] RSP: 0018:ffffb5d800003a68 EFLAGS: 00010286 >[1291584.507968] RAX: ffffb5d800883818 RBX: ffff99a1c8f8e000 RCX: 0000000000000009 >[1291584.507974] RDX: 0000000000000009 RSI: ffff99a1c7e42800 RDI: ffff99a1c8f8e000 >[1291584.507977] RBP: ffff99a1c8eed400 R08: ffff99a1c8f8e000 R09: 000000000392ca02 >[1291584.507980] R10: 0000000000000000 R11: 000000000392ca57 R12: 0000000000000008 >[1291584.507987] R13: ffff99a1c7e42800 R14: 0000000000000008 R15: 0000000000000000 >[1291584.507991] FS: 00007f70003fe6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1291584.507996] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1291584.508064] CR2: 00007f6da09410c6 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1291584.508256] Call Trace: >[1291584.508307] <IRQ> >[1291584.508317] ? watchdog_timer_fn+0x1a8/0x210 >[1291584.508383] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1291584.508450] ? __hrtimer_run_queues+0x112/0x2b0 >[1291584.508503] ? hrtimer_interrupt+0xf8/0x230 >[1291584.508517] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1291584.508566] ? sysvec_apic_timer_interrupt+0x39/0x90 >[1291584.508635] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1291584.508696] ? e1000_xmit_frame+0xd3a/0xfc0 [e1000] >[1291584.508874] ? e1000_xmit_frame+0xd05/0xfc0 [e1000] >[1291584.508923] ? netif_skb_features+0x151/0x2e0 >[1291584.508933] dev_hard_start_xmit+0x67/0x1d0 >[1291584.508942] sch_direct_xmit+0xa4/0x380 >[1291584.508955] __dev_queue_xmit+0x96e/0xdc0 >[1291584.508964] ? selinux_ip_postroute+0x60/0x410 >[1291584.508976] ? eth_header+0x2a/0xc0 >[1291584.509000] ip6_finish_output2+0x1d4/0x6f0 >[1291584.509014] ? nf_hook_slow+0x45/0xc0 >[1291584.509025] ip6_finish_output+0x1c5/0x320 >[1291584.509034] ndisc_send_skb+0x1cd/0x300 >[1291584.509043] ndisc_send_ns+0x70/0xc0 >[1291584.509054] ndisc_solicit+0x14a/0x190 >[1291584.509064] neigh_probe+0x51/0x70 >[1291584.509071] neigh_timer_handler+0x231/0x320 >[1291584.509081] ? __pfx_neigh_timer_handler+0x10/0x10 >[1291584.509091] call_timer_fn+0x27/0x130 >[1291584.509100] ? __pfx_neigh_timer_handler+0x10/0x10 >[1291584.509110] __run_timers+0x222/0x2c0 >[1291584.509119] run_timer_softirq+0x1d/0x40 >[1291584.509129] __do_softirq+0xd4/0x2c8 >[1291584.509144] __irq_exit_rcu+0xbe/0xf0 >[1291584.509157] sysvec_apic_timer_interrupt+0x72/0x90 >[1291584.758080] </IRQ> >[1291584.758092] <TASK> >[1291584.758094] asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1291584.758106] RIP: 0010:__fget_light+0x22/0x100 >[1291584.758114] Code: 90 90 90 90 90 90 90 90 0f 1f 44 00 00 41 56 65 48 8b 04 25 80 32 03 00 41 55 41 54 41 89 f4 55 89 fd 53 48 8b 90 00 0c 00 00 <8b> 0a 83 f9 01 0f 84 84 00 00 00 4c 8b a8 00 0c 00 00 41 89 ee e8 >[1291584.758118] RSP: 0018:ffffb5d8067bba10 EFLAGS: 00010202 >[1291584.758122] RAX: ffff99a104fc0000 RBX: ffffb5d8067bbabc RCX: 0000000000000002 >[1291584.758125] RDX: ffff99a0d2109080 RSI: 0000000000004000 RDI: 0000000000000007 >[1291584.758128] RBP: 0000000000000007 R08: 0000000000000000 R09: 0000000000000000 >[1291584.758131] R10: 0000000000000001 R11: 0000000000000110 R12: 0000000000004000 >[1291584.758133] R13: 0000000000000000 R14: 0000000000000000 R15: ffffb5d8067bbaac >[1291584.758140] do_sys_poll+0x290/0x600 >[1291584.758148] ? __pfx_pollwake+0x10/0x10 >[1291584.758153] ? __pfx_pollwake+0x10/0x10 >[1291584.758162] __x64_sys_poll+0xbb/0x150 >[1291584.758166] do_syscall_64+0x5f/0x90 >[1291584.758172] ? syscall_exit_to_user_mode+0x1b/0x40 >[1291584.758176] ? do_syscall_64+0x6b/0x90 >[1291584.758180] ? do_syscall_64+0x6b/0x90 >[1291584.758185] ? syscall_exit_to_user_mode+0x1b/0x40 >[1291584.758188] ? do_syscall_64+0x6b/0x90 >[1291584.758191] ? do_syscall_64+0x6b/0x90 >[1291584.758196] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1291584.758200] RIP: 0033:0x7f700187d21f >[1291585.542928] Code: 54 24 1c 48 89 74 24 10 48 89 7c 24 08 e8 b9 83 f8 ff 8b 54 24 1c 48 8b 74 24 10 41 89 c0 48 8b 7c 24 08 b8 07 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 31 44 89 c7 89 44 24 08 e8 0d 84 f8 ff 8b 44 >[1291585.825312] RSP: 002b:00007f70003fdda0 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 >[1291585.825328] RAX: ffffffffffffffda RBX: 431bde82d7b634db RCX: 00007f700187d21f >[1291585.825331] RDX: 0000000000002710 RSI: 0000000000000002 RDI: 00007f70003fde00 >[1291585.825334] RBP: 000000002c13898d R08: 0000000000000000 R09: 0000000000000000 >[1291585.825336] R10: 0000000000004000 R11: 0000000000000293 R12: 00007f70003fddf0 >[1291585.825338] R13: 000000000013b7b1 R14: 000000004d058e4b R15: 000000004d058e4b >[1291585.825369] </TASK> >[1291613.513236] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: >[1291613.513251] rcu: (detected by 0, t=426131 jiffies, g=128827697, q=258 ncpus=1) >[1291613.513255] rcu: All QSes seen, last rcu_preempt kthread activity 179875 (5586969287-5586789412), jiffies_till_next_fqs=3, root ->qsmask 0x0 >[1291613.513260] rcu: rcu_preempt kthread starved for 179875 jiffies! g128827697 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0 >[1291613.513264] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1291613.513266] rcu: RCU grace-period kthread stack dump: >[1291613.513269] task:rcu_preempt state:R running task stack:0 pid:16 ppid:2 flags:0x00004000 >[1291613.513277] Call Trace: >[1291613.513280] <TASK> >[1291613.513290] __schedule+0x449/0x1480 >[1291613.513307] ? lock_timer_base+0x61/0x80 >[1291613.513317] schedule+0x5e/0xd0 >[1291613.513322] schedule_timeout+0x98/0x160 >[1291613.513326] ? __pfx_process_timeout+0x10/0x10 >[1291613.513330] rcu_gp_fqs_loop+0x141/0x520 >[1291613.513341] ? __note_gp_changes+0x153/0x1a0 >[1291613.513345] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1291613.513348] rcu_gp_kthread+0xea/0x1e0 >[1291613.513351] kthread+0xde/0x110 >[1291613.513357] ? __pfx_kthread+0x10/0x10 >[1291613.513360] ret_from_fork+0x2c/0x50 >[1291613.513367] </TASK> >[1291613.513369] rcu: Stack dump where RCU GP kthread last ran: >[1291613.513372] CPU: 0 PID: 1299115 Comm: kworker/0:2 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1291613.513376] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1291613.513380] Workqueue: events e1000_watchdog [e1000] >[1291613.513398] RIP: 0010:_raw_spin_unlock_irqrestore+0x1d/0x40 >[1291613.513403] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 c6 07 00 0f 1f 00 f7 c6 00 02 00 00 74 06 fb 0f 1f 44 00 00 <65> ff 0d d4 17 08 7c 74 05 e9 85 1a 00 00 0f 1f 44 00 00 e9 7b 1a >[1291613.513406] RSP: 0018:ffffb5d80583fe18 EFLAGS: 00010206 >[1291613.513410] RAX: 0000000000000000 RBX: ffff99a1c8f8e9c0 RCX: 0000000000000000 >[1291613.513412] RDX: 0000000000027080 RSI: 0000000000000246 RDI: ffff99a1c8f8ebdc >[1291613.513459] RBP: ffff99a1c8f8ee48 R08: 0000000000000000 R09: 0000000000026fd8 >[1291613.513462] R10: 0000000000000007 R11: 00000000000000ce R12: ffff99a1c8f8ebdc >[1291613.513465] R13: 0000000000000246 R14: ffff99a1c8f8ee48 R15: ffff99a1c8f8f270 >[1291613.513467] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1291613.513470] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1291613.513472] CR2: 00007f6da09410c6 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1291613.513478] Call Trace: >[1291613.513480] <IRQ> >[1291613.513482] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1291613.513488] ? rcu_sched_clock_irq+0xda7/0x1150 >[1291613.513493] ? update_process_times+0x74/0xb0 >[1291613.513497] ? tick_sched_handle+0x22/0x60 >[1291613.513502] ? tick_sched_timer+0x67/0x80 >[1291613.513505] ? __pfx_tick_sched_timer+0x10/0x10 >[1291613.513509] ? __hrtimer_run_queues+0x112/0x2b0 >[1291613.513512] ? hrtimer_interrupt+0xf8/0x230 >[1291613.513517] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1291613.513521] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1291613.513527] </IRQ> >[1291613.513528] <TASK> >[1291613.513530] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1291613.513567] ? _raw_spin_unlock_irqrestore+0x1d/0x40 >[1291613.513573] e1000_update_stats+0x743/0x7d0 [e1000] >[1291613.513589] e1000_watchdog+0x8c/0x590 [e1000] >[1291613.513603] ? psi_avgs_work+0xbe/0xd0 >[1291613.513608] process_one_work+0x1c8/0x3c0 >[1291613.513612] worker_thread+0x51/0x390 >[1291613.513615] ? __pfx_worker_thread+0x10/0x10 >[1291613.513618] kthread+0xde/0x110 >[1291613.513621] ? __pfx_kthread+0x10/0x10 >[1291613.513630] ret_from_fork+0x2c/0x50 >[1291613.513637] </TASK> >[1291685.314706] rcu: INFO: rcu_preempt self-detected stall on CPU >[1291685.314740] rcu: 0-...!: (1012 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277435/113277435 fqs=0 >[1291685.314750] rcu: (t=60008 jiffies g=128827701 q=274 ncpus=1) >[1291685.314753] rcu: rcu_preempt kthread timer wakeup didn't happen for 60005 jiffies! g128827701 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1291685.314758] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940848 >[1291685.314760] rcu: rcu_preempt kthread starved for 60008 jiffies! g128827701 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1291685.314785] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1291685.314819] rcu: RCU grace-period kthread stack dump: >[1291685.314857] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1291685.314996] Call Trace: >[1291685.315000] <TASK> >[1291685.315087] __schedule+0x449/0x1480 >[1291685.315170] ? lock_timer_base+0x61/0x80 >[1291685.315199] schedule+0x5e/0xd0 >[1291685.315239] schedule_timeout+0x98/0x160 >[1291685.315280] ? __pfx_process_timeout+0x10/0x10 >[1291685.315319] rcu_gp_fqs_loop+0x141/0x520 >[1291685.315346] ? __note_gp_changes+0x153/0x1a0 >[1291685.315355] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1291685.315358] rcu_gp_kthread+0xea/0x1e0 >[1291685.315364] kthread+0xde/0x110 >[1291685.315370] ? __pfx_kthread+0x10/0x10 >[1291685.315375] ret_from_fork+0x2c/0x50 >[1291685.315386] </TASK> >[1291685.315387] rcu: Stack dump where RCU GP kthread last ran: >[1291685.315390] CPU: 0 PID: 1327 Comm: gmain Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1291685.315396] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1291685.315398] RIP: 0010:kmem_cache_alloc+0xfe/0x340 >[1291685.315409] Code: 83 78 10 00 48 8b 38 0f 84 b8 01 00 00 48 85 ff 0f 84 af 01 00 00 8b 45 28 4c 8b 45 00 48 8b 9d b8 00 00 00 48 01 f8 48 89 c1 <48> 33 18 48 0f c9 48 31 cb 41 f6 c0 0f 0f 85 f0 01 00 00 48 8d 8a >[1291685.315415] RSP: 0018:ffffb5d803833d28 EFLAGS: 00010286 >[1291685.315419] RAX: ffff99a0e3006800 RBX: ad53174871c8cbb2 RCX: ffff99a0e3006800 >[1291685.315423] RDX: 000008a9d27d0000 RSI: 0000000000000cc0 RDI: ffff99a0e3006000 >[1291685.315426] RBP: ffff99a1c0204800 R08: 000000000003b290 R09: 000055815a308840 >[1291685.315430] R10: 0000000000000008 R11: 0000000000000000 R12: 0000000000000000 >[1291685.315432] R13: 0000000000000cc0 R14: 0000000000001000 R15: ffffffff834613db >[1291685.315436] FS: 00007f16595fe6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1291685.315439] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1291685.315442] CR2: 00007f7d29aaf818 CR3: 0000000102d2e000 CR4: 00000000000106f0 >[1291685.315447] Call Trace: >[1291685.315449] <IRQ> >[1291685.315452] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1291685.315457] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1291685.315463] ? sched_slice+0x87/0x140 >[1291685.315468] ? timekeeping_update+0xdd/0x130 >[1291685.315475] ? timekeeping_advance+0x377/0x590 >[1291685.315481] ? update_process_times+0x74/0xb0 >[1291685.315489] ? tick_sched_handle+0x22/0x60 >[1291685.315496] ? tick_sched_timer+0x67/0x80 >[1291685.315501] ? __pfx_tick_sched_timer+0x10/0x10 >[1291685.315509] ? __hrtimer_run_queues+0x112/0x2b0 >[1291685.315514] ? hrtimer_interrupt+0xf8/0x230 >[1291685.315520] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1291685.315526] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1291685.315533] </IRQ> >[1291685.315534] <TASK> >[1291685.315535] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1291685.315540] ? getname_flags.part.0+0x2b/0x1c0 >[1291685.315548] ? kmem_cache_alloc+0xfe/0x340 >[1291685.315552] ? kmem_cache_alloc+0x59/0x340 >[1291685.315556] getname_flags.part.0+0x2b/0x1c0 >[1291685.315561] user_path_at_empty+0x24/0x60 >[1291685.315566] inotify_find_inode+0x24/0x80 >[1291685.315573] __x64_sys_inotify_add_watch+0xc5/0x150 >[1291685.315578] do_syscall_64+0x5f/0x90 >[1291685.315617] ? __rseq_handle_notify_resume+0xa5/0x4e0 >[1291685.315624] ? switch_fpu_return+0x50/0xe0 >[1291685.315629] ? exit_to_user_mode_prepare+0x142/0x1f0 >[1291685.315634] ? syscall_exit_to_user_mode+0x1b/0x40 >[1291685.315638] ? do_syscall_64+0x6b/0x90 >[1291685.315642] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1291685.315646] RIP: 0033:0x7f166788203b >[1291685.587180] Code: f0 ff ff 73 01 c3 48 8b 0d f2 5d 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 fe 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d c5 5d 0c 00 f7 d8 64 89 01 48 >[1291685.587186] RSP: 002b:00007f16595fdb08 EFLAGS: 00000202 ORIG_RAX: 00000000000000fe >[1291685.587192] RAX: ffffffffffffffda RBX: 000055815a308860 RCX: 00007f166788203b >[1291685.587196] RDX: 0000000001002fce RSI: 000055815a308840 RDI: 0000000000000008 >[1291685.587199] RBP: 00007f16595fdb34 R08: 0007542706f63729 R09: 0000000000000001 >[1291685.587201] R10: 00007fff043df080 R11: 0000000000000202 R12: 0000000000000000 >[1291685.587221] R13: 00007f1667d032a8 R14: 0000000000000000 R15: 000055815a2e8030 >[1291685.587235] </TASK> >[1291685.587275] CPU: 0 PID: 1327 Comm: gmain Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1291685.587281] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1291685.587283] RIP: 0010:kmem_cache_alloc+0xfe/0x340 >[1291685.587293] Code: 83 78 10 00 48 8b 38 0f 84 b8 01 00 00 48 85 ff 0f 84 af 01 00 00 8b 45 28 4c 8b 45 00 48 8b 9d b8 00 00 00 48 01 f8 48 89 c1 <48> 33 18 48 0f c9 48 31 cb 41 f6 c0 0f 0f 85 f0 01 00 00 48 8d 8a >[1291685.587296] RSP: 0018:ffffb5d803833d28 EFLAGS: 00010286 >[1291685.587298] RAX: ffff99a0e3006800 RBX: ad53174871c8cbb2 RCX: ffff99a0e3006800 >[1291685.587300] RDX: 000008a9d27d0000 RSI: 0000000000000cc0 RDI: ffff99a0e3006000 >[1291685.587302] RBP: ffff99a1c0204800 R08: 000000000003b290 R09: 000055815a308840 >[1291685.587303] R10: 0000000000000008 R11: 0000000000000000 R12: 0000000000000000 >[1291685.587337] R13: 0000000000000cc0 R14: 0000000000001000 R15: ffffffff834613db >[1291685.587342] FS: 00007f16595fe6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1291685.587348] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1291685.587351] CR2: 00007f7d29aaf818 CR3: 0000000102d2e000 CR4: 00000000000106f0 >[1291685.587355] Call Trace: >[1291685.587359] <IRQ> >[1291685.587362] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1291685.587392] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1291685.587397] ? sched_slice+0x87/0x140 >[1291685.587403] ? timekeeping_update+0xdd/0x130 >[1291685.587409] ? timekeeping_advance+0x377/0x590 >[1291685.587413] ? update_process_times+0x74/0xb0 >[1291685.587417] ? tick_sched_handle+0x22/0x60 >[1291685.587439] ? tick_sched_timer+0x67/0x80 >[1291685.587442] ? __pfx_tick_sched_timer+0x10/0x10 >[1291685.587446] ? __hrtimer_run_queues+0x112/0x2b0 >[1291685.587450] ? hrtimer_interrupt+0xf8/0x230 >[1291685.587454] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1291685.587459] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1291685.587466] </IRQ> >[1291685.587467] <TASK> >[1291685.587468] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1291685.587473] ? getname_flags.part.0+0x2b/0x1c0 >[1291685.587498] ? kmem_cache_alloc+0xfe/0x340 >[1291685.587501] ? kmem_cache_alloc+0x59/0x340 >[1291685.587505] getname_flags.part.0+0x2b/0x1c0 >[1291685.587509] user_path_at_empty+0x24/0x60 >[1291685.587513] inotify_find_inode+0x24/0x80 >[1291685.587519] __x64_sys_inotify_add_watch+0xc5/0x150 >[1291685.587523] do_syscall_64+0x5f/0x90 >[1291685.587553] ? __rseq_handle_notify_resume+0xa5/0x4e0 >[1291685.587560] ? switch_fpu_return+0x50/0xe0 >[1291685.587564] ? exit_to_user_mode_prepare+0x142/0x1f0 >[1291685.587570] ? syscall_exit_to_user_mode+0x1b/0x40 >[1291685.587573] ? do_syscall_64+0x6b/0x90 >[1291685.587577] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1291685.587599] RIP: 0033:0x7f166788203b >[1291685.587666] Code: f0 ff ff 73 01 c3 48 8b 0d f2 5d 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 0f 1f 84 00 00 00 00 00 f3 0f 1e fa b8 fe 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d c5 5d 0c 00 f7 d8 64 89 01 48 >[1291685.587669] RSP: 002b:00007f16595fdb08 EFLAGS: 00000202 ORIG_RAX: 00000000000000fe >[1291685.587673] RAX: ffffffffffffffda RBX: 000055815a308860 RCX: 00007f166788203b >[1291685.587675] RDX: 0000000001002fce RSI: 000055815a308840 RDI: 0000000000000008 >[1291685.587677] RBP: 00007f16595fdb34 R08: 0007542706f63729 R09: 0000000000000001 >[1291685.587679] R10: 00007fff043df080 R11: 0000000000000202 R12: 0000000000000000 >[1291685.587680] R13: 00007f1667d032a8 R14: 0000000000000000 R15: 000055815a2e8030 >[1291685.587684] </TASK> >[1291847.765384] watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [btrfs-transacti:389] >[1291847.765398] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1291847.765481] CPU: 0 PID: 389 Comm: btrfs-transacti Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1291847.765485] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1291847.765488] RIP: 0010:_raw_spin_unlock_irqrestore+0x1d/0x40 >[1291847.765499] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 c6 07 00 0f 1f 00 f7 c6 00 02 00 00 74 06 fb 0f 1f 44 00 00 <65> ff 0d d4 17 08 7c 74 05 e9 85 1a 00 00 0f 1f 44 00 00 e9 7b 1a >[1291847.765503] RSP: 0018:ffffb5d800823618 EFLAGS: 00010206 >[1291847.765506] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff99a1c0aec828 >[1291847.765509] RDX: ffff99a1c0af6040 RSI: 0000000000000293 RDI: ffff99a1c7069d80 >[1291847.765511] RBP: 0000000000000293 R08: 0000000000000001 R09: 0000000000001000 >[1291847.765535] R10: 0000000110beafff R11: 0000000000000000 R12: ffff99a1c0af4000 >[1291847.765537] R13: ffff99a1c3d11000 R14: ffff99a1c0c97000 R15: 0000000000000000 >[1291847.765540] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1291847.765542] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1291847.765545] CR2: 00007f2cfcda3738 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1291847.765549] Call Trace: >[1291847.765553] <IRQ> >[1291847.765560] ? watchdog_timer_fn+0x1a8/0x210 >[1291847.765568] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1291847.765572] ? __hrtimer_run_queues+0x112/0x2b0 >[1291847.765577] ? hrtimer_interrupt+0xf8/0x230 >[1291847.765582] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1291847.765587] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1291847.765592] </IRQ> >[1291847.765593] <TASK> >[1291847.765595] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1291847.765602] ? _raw_spin_unlock_irqrestore+0x1d/0x40 >[1291847.765606] ata_scsi_queuecmd+0x53/0x80 >[1291847.765612] scsi_queue_rq+0x389/0xc80 >[1291847.765618] blk_mq_dispatch_rq_list+0x2f6/0x880 >[1291847.765624] ? bfq_dispatch_request+0xf0/0x1230 >[1291847.765629] blk_mq_do_dispatch_sched+0x324/0x3c0 >[1291847.765635] __blk_mq_sched_dispatch_requests+0xec/0x130 >[1291847.765639] blk_mq_sched_dispatch_requests+0x34/0x60 >[1291847.765643] __blk_mq_run_hw_queue+0x70/0x90 >[1291847.765647] blk_mq_sched_insert_requests+0x73/0x170 >[1291847.765651] blk_mq_flush_plug_list+0x137/0x300 >[1291847.765656] blk_add_rq_to_plug+0xa4/0x150 >[1291847.765659] blk_mq_submit_bio+0x370/0x5e0 >[1291847.765664] __submit_bio+0xf5/0x180 >[1291847.765669] submit_bio_noacct_nocheck+0x332/0x370 >[1291847.765673] __btrfs_submit_bio+0x89/0x140 >[1291847.765679] btrfs_submit_chunk+0x150/0x4c0 >[1291847.765684] btrfs_submit_bio+0x1a/0x30 >[1291847.765687] submit_one_bio+0x61/0x1b0 >[1291847.765692] btree_write_cache_pages+0x85e/0x8d0 >[1291847.765697] ? filemap_get_folios_tag+0x1c4/0x220 >[1291847.765702] ? __pfx_end_bio_extent_buffer_writepage+0x10/0x10 >[1291847.765708] do_writepages+0xd2/0x1e0 >[1291847.765713] ? merge_state.part.0+0x46/0x100 >[1291847.765717] filemap_fdatawrite_wbc+0x63/0x90 >[1291847.765721] __filemap_fdatawrite_range+0x5c/0x80 >[1291847.765726] btrfs_write_marked_extents+0x72/0x150 >[1291847.765731] btrfs_write_and_wait_transaction+0x70/0xf0 >[1291847.765735] btrfs_commit_transaction+0x8c4/0xf00 >[1291847.765739] ? start_transaction+0xc5/0x5c0 >[1291847.765743] transaction_kthread+0x141/0x1b0 >[1291847.765747] ? __pfx_transaction_kthread+0x10/0x10 >[1291847.765750] kthread+0xde/0x110 >[1291847.765755] ? __pfx_kthread+0x10/0x10 >[1291847.765758] ret_from_fork+0x2c/0x50 >[1291847.765765] </TASK> >[1291868.068118] rcu: INFO: rcu_preempt self-detected stall on CPU >[1291868.068131] rcu: 0-...!: (412 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277437/113277437 fqs=0 >[1291868.068138] rcu: (t=60639 jiffies g=128827709 q=491 ncpus=1) >[1291868.068142] rcu: rcu_preempt kthread timer wakeup didn't happen for 60636 jiffies! g128827709 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1291868.068146] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940850 >[1291868.068148] rcu: rcu_preempt kthread starved for 60639 jiffies! g128827709 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1291868.068151] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1291868.068153] rcu: RCU grace-period kthread stack dump: >[1291868.068154] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1291868.068160] Call Trace: >[1291868.068163] <TASK> >[1291868.068170] __schedule+0x449/0x1480 >[1291868.068181] ? lock_timer_base+0x61/0x80 >[1291868.068189] schedule+0x5e/0xd0 >[1291868.068193] schedule_timeout+0x98/0x160 >[1291868.068198] ? __pfx_process_timeout+0x10/0x10 >[1291868.068202] rcu_gp_fqs_loop+0x141/0x520 >[1291868.068208] ? __note_gp_changes+0x153/0x1a0 >[1291868.068211] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1291868.068214] rcu_gp_kthread+0xea/0x1e0 >[1291868.068217] kthread+0xde/0x110 >[1291868.068222] ? __pfx_kthread+0x10/0x10 >[1291868.068226] ret_from_fork+0x2c/0x50 >[1291868.068233] </TASK> >[1291868.068234] rcu: Stack dump where RCU GP kthread last ran: >[1291868.068237] CPU: 0 PID: 389 Comm: btrfs-transacti Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1291868.068244] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1291868.068248] RIP: 0010:_raw_spin_unlock_irqrestore+0x1d/0x40 >[1291868.068253] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 c6 07 00 0f 1f 00 f7 c6 00 02 00 00 74 06 fb 0f 1f 44 00 00 <65> ff 0d d4 17 08 7c 74 05 e9 85 1a 00 00 0f 1f 44 00 00 e9 7b 1a >[1291868.068256] RSP: 0018:ffffb5d800823618 EFLAGS: 00010206 >[1291868.068260] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff99a1c0aec828 >[1291868.068262] RDX: ffff99a1c0af6040 RSI: 0000000000000293 RDI: ffff99a1c7069d80 >[1291868.068265] RBP: 0000000000000293 R08: 0000000000000001 R09: 0000000000001000 >[1291868.068267] R10: 000000011197dfff R11: 0000000000000000 R12: ffff99a1c0af4000 >[1291868.068269] R13: ffff99a1c3d11000 R14: ffff99a1c0c97000 R15: 0000000000000000 >[1291868.068271] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1291868.068274] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1291868.068276] CR2: 00007f2cfcda3738 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1291868.068281] Call Trace: >[1291868.068283] <IRQ> >[1291868.068285] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1291868.068289] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1291868.068293] ? sched_slice+0x87/0x140 >[1291868.068297] ? timekeeping_update+0xdd/0x130 >[1291868.068302] ? timekeeping_advance+0x377/0x590 >[1291868.068306] ? update_process_times+0x74/0xb0 >[1291868.068309] ? tick_sched_handle+0x22/0x60 >[1291868.068314] ? tick_sched_timer+0x67/0x80 >[1291868.068317] ? __pfx_tick_sched_timer+0x10/0x10 >[1291868.068321] ? __hrtimer_run_queues+0x112/0x2b0 >[1291868.068325] ? hrtimer_interrupt+0xf8/0x230 >[1291868.068329] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1291868.068333] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1291868.068338] </IRQ> >[1291868.068339] <TASK> >[1291868.068341] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1291868.068348] ? _raw_spin_unlock_irqrestore+0x1d/0x40 >[1291868.068352] ata_scsi_queuecmd+0x53/0x80 >[1291868.068358] scsi_queue_rq+0x389/0xc80 >[1291868.068363] blk_mq_dispatch_rq_list+0x2f6/0x880 >[1291868.068369] ? bfq_dispatch_request+0xf0/0x1230 >[1291868.068374] blk_mq_do_dispatch_sched+0x324/0x3c0 >[1291868.068379] __blk_mq_sched_dispatch_requests+0xec/0x130 >[1291868.068383] blk_mq_sched_dispatch_requests+0x34/0x60 >[1291868.068387] __blk_mq_run_hw_queue+0x70/0x90 >[1291868.068390] blk_mq_sched_insert_requests+0x73/0x170 >[1291868.068394] blk_mq_flush_plug_list+0x137/0x300 >[1291868.068399] blk_add_rq_to_plug+0xa4/0x150 >[1291868.068402] blk_mq_submit_bio+0x370/0x5e0 >[1291868.068407] __submit_bio+0xf5/0x180 >[1291868.068411] submit_bio_noacct_nocheck+0x332/0x370 >[1291868.068415] __btrfs_submit_bio+0x89/0x140 >[1291868.068421] btrfs_submit_chunk+0x150/0x4c0 >[1291868.068426] btrfs_submit_bio+0x1a/0x30 >[1291868.068429] submit_one_bio+0x61/0x1b0 >[1291868.068434] btree_write_cache_pages+0x85e/0x8d0 >[1291868.068439] ? filemap_get_folios_tag+0x1c4/0x220 >[1291868.068444] ? __pfx_end_bio_extent_buffer_writepage+0x10/0x10 >[1291868.068450] do_writepages+0xd2/0x1e0 >[1291868.068454] ? merge_state.part.0+0x46/0x100 >[1291868.068458] filemap_fdatawrite_wbc+0x63/0x90 >[1291868.068462] __filemap_fdatawrite_range+0x5c/0x80 >[1291868.068466] btrfs_write_marked_extents+0x72/0x150 >[1291868.068471] btrfs_write_and_wait_transaction+0x70/0xf0 >[1291868.068475] btrfs_commit_transaction+0x8c4/0xf00 >[1291868.068479] ? start_transaction+0xc5/0x5c0 >[1291868.068484] transaction_kthread+0x141/0x1b0 >[1291868.068487] ? __pfx_transaction_kthread+0x10/0x10 >[1291868.068490] kthread+0xde/0x110 >[1291868.068493] ? __pfx_kthread+0x10/0x10 >[1291868.068497] ret_from_fork+0x2c/0x50 >[1291868.068502] </TASK> >[1291868.068513] CPU: 0 PID: 389 Comm: btrfs-transacti Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1291868.068516] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1291868.068518] RIP: 0010:_raw_spin_unlock_irqrestore+0x1d/0x40 >[1291868.068522] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 c6 07 00 0f 1f 00 f7 c6 00 02 00 00 74 06 fb 0f 1f 44 00 00 <65> ff 0d d4 17 08 7c 74 05 e9 85 1a 00 00 0f 1f 44 00 00 e9 7b 1a >[1291868.068525] RSP: 0018:ffffb5d800823618 EFLAGS: 00010206 >[1291868.068528] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff99a1c0aec828 >[1291868.068530] RDX: ffff99a1c0af6040 RSI: 0000000000000293 RDI: ffff99a1c7069d80 >[1291868.068532] RBP: 0000000000000293 R08: 0000000000000001 R09: 0000000000001000 >[1291868.068534] R10: 000000011197dfff R11: 0000000000000000 R12: ffff99a1c0af4000 >[1291868.068535] R13: ffff99a1c3d11000 R14: ffff99a1c0c97000 R15: 0000000000000000 >[1291868.068538] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1291868.068540] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1291868.068542] CR2: 00007f2cfcda3738 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1291868.068544] Call Trace: >[1291868.068546] <IRQ> >[1291868.068547] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1291868.068551] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1291868.068554] ? sched_slice+0x87/0x140 >[1291868.068558] ? timekeeping_update+0xdd/0x130 >[1291868.068562] ? timekeeping_advance+0x377/0x590 >[1291868.068566] ? update_process_times+0x74/0xb0 >[1291868.068569] ? tick_sched_handle+0x22/0x60 >[1291868.068573] ? tick_sched_timer+0x67/0x80 >[1291868.068576] ? __pfx_tick_sched_timer+0x10/0x10 >[1291868.068579] ? __hrtimer_run_queues+0x112/0x2b0 >[1291868.068583] ? hrtimer_interrupt+0xf8/0x230 >[1291868.068587] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1291868.068590] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1291868.068594] </IRQ> >[1291868.068596] <TASK> >[1291868.068597] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1291868.068602] ? _raw_spin_unlock_irqrestore+0x1d/0x40 >[1291868.068606] ata_scsi_queuecmd+0x53/0x80 >[1291868.068610] scsi_queue_rq+0x389/0xc80 >[1291868.068614] blk_mq_dispatch_rq_list+0x2f6/0x880 >[1291868.068652] ? bfq_dispatch_request+0xf0/0x1230 >[1291868.068660] blk_mq_do_dispatch_sched+0x324/0x3c0 >[1291868.068665] __blk_mq_sched_dispatch_requests+0xec/0x130 >[1291868.068668] blk_mq_sched_dispatch_requests+0x34/0x60 >[1291868.068672] __blk_mq_run_hw_queue+0x70/0x90 >[1291868.068675] blk_mq_sched_insert_requests+0x73/0x170 >[1291868.068679] blk_mq_flush_plug_list+0x137/0x300 >[1291868.068683] blk_add_rq_to_plug+0xa4/0x150 >[1291868.068687] blk_mq_submit_bio+0x370/0x5e0 >[1291868.068691] __submit_bio+0xf5/0x180 >[1291868.068695] submit_bio_noacct_nocheck+0x332/0x370 >[1291868.068699] __btrfs_submit_bio+0x89/0x140 >[1291868.068703] btrfs_submit_chunk+0x150/0x4c0 >[1291868.068708] btrfs_submit_bio+0x1a/0x30 >[1291868.068711] submit_one_bio+0x61/0x1b0 >[1291868.068714] btree_write_cache_pages+0x85e/0x8d0 >[1291868.068718] ? filemap_get_folios_tag+0x1c4/0x220 >[1291868.068722] ? __pfx_end_bio_extent_buffer_writepage+0x10/0x10 >[1291868.068727] do_writepages+0xd2/0x1e0 >[1291868.068731] ? merge_state.part.0+0x46/0x100 >[1291868.068735] filemap_fdatawrite_wbc+0x63/0x90 >[1291868.068738] __filemap_fdatawrite_range+0x5c/0x80 >[1291868.068742] btrfs_write_marked_extents+0x72/0x150 >[1291868.068746] btrfs_write_and_wait_transaction+0x70/0xf0 >[1291868.068750] btrfs_commit_transaction+0x8c4/0xf00 >[1291868.068754] ? start_transaction+0xc5/0x5c0 >[1291868.068757] transaction_kthread+0x141/0x1b0 >[1291868.068761] ? __pfx_transaction_kthread+0x10/0x10 >[1291868.068763] kthread+0xde/0x110 >[1291868.068767] ? __pfx_kthread+0x10/0x10 >[1291868.068770] ret_from_fork+0x2c/0x50 >[1291868.068775] </TASK> >[1291891.779891] watchdog: BUG: soft lockup - CPU#0 stuck for 62s! [btrfs-transacti:389] >[1291891.779902] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1291891.779999] CPU: 0 PID: 389 Comm: btrfs-transacti Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1291891.780004] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1291891.780007] RIP: 0010:_raw_spin_unlock_irqrestore+0x1d/0x40 >[1291891.780017] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 c6 07 00 0f 1f 00 f7 c6 00 02 00 00 74 06 fb 0f 1f 44 00 00 <65> ff 0d d4 17 08 7c 74 05 e9 85 1a 00 00 0f 1f 44 00 00 e9 7b 1a >[1291891.780021] RSP: 0018:ffffb5d800823618 EFLAGS: 00010206 >[1291891.780024] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff99a1c0aec828 >[1291891.780027] RDX: ffff99a1c0af6040 RSI: 0000000000000293 RDI: ffff99a1c7069d80 >[1291891.780029] RBP: 0000000000000293 R08: 0000000000000001 R09: 0000000000001000 >[1291891.780032] R10: 00000000b62d0fff R11: 0000000000000000 R12: ffff99a1c0af4000 >[1291891.780034] R13: ffff99a1c3d11000 R14: ffff99a1c0c97000 R15: 0000000000000000 >[1291891.780036] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1291891.780039] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1291891.780041] CR2: 00007f2cfcda3738 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1291891.780045] Call Trace: >[1291891.780049] <IRQ> >[1291891.780055] ? watchdog_timer_fn+0x1a8/0x210 >[1291891.780061] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1291891.780065] ? __hrtimer_run_queues+0x112/0x2b0 >[1291891.780071] ? hrtimer_interrupt+0xf8/0x230 >[1291891.780075] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1291891.780079] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1291891.780084] </IRQ> >[1291891.780086] <TASK> >[1291891.780087] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1291891.780095] ? _raw_spin_unlock_irqrestore+0x1d/0x40 >[1291891.780099] ata_scsi_queuecmd+0x53/0x80 >[1291891.780105] scsi_queue_rq+0x389/0xc80 >[1291891.780111] blk_mq_dispatch_rq_list+0x2f6/0x880 >[1291891.780117] ? bfq_dispatch_request+0xf0/0x1230 >[1291891.780123] blk_mq_do_dispatch_sched+0x324/0x3c0 >[1291891.780128] __blk_mq_sched_dispatch_requests+0xec/0x130 >[1291891.780132] blk_mq_sched_dispatch_requests+0x34/0x60 >[1291891.780135] __blk_mq_run_hw_queue+0x70/0x90 >[1291891.780139] blk_mq_sched_insert_requests+0x73/0x170 >[1291891.780143] blk_mq_flush_plug_list+0x137/0x300 >[1291891.780147] blk_add_rq_to_plug+0xa4/0x150 >[1291891.780151] blk_mq_submit_bio+0x370/0x5e0 >[1291891.780180] __submit_bio+0xf5/0x180 >[1291891.780185] submit_bio_noacct_nocheck+0x332/0x370 >[1291891.780189] __btrfs_submit_bio+0x89/0x140 >[1291891.780195] btrfs_submit_chunk+0x150/0x4c0 >[1291891.780200] btrfs_submit_bio+0x1a/0x30 >[1291891.780203] submit_one_bio+0x61/0x1b0 >[1291891.780208] btree_write_cache_pages+0x85e/0x8d0 >[1291891.780212] ? filemap_get_folios_tag+0x1c4/0x220 >[1291891.780217] ? __pfx_end_bio_extent_buffer_writepage+0x10/0x10 >[1291891.780222] do_writepages+0xd2/0x1e0 >[1291891.780227] ? merge_state.part.0+0x46/0x100 >[1291891.780250] filemap_fdatawrite_wbc+0x63/0x90 >[1291891.780254] __filemap_fdatawrite_range+0x5c/0x80 >[1291891.780258] btrfs_write_marked_extents+0x72/0x150 >[1291891.780263] btrfs_write_and_wait_transaction+0x70/0xf0 >[1291891.780267] btrfs_commit_transaction+0x8c4/0xf00 >[1291891.780271] ? start_transaction+0xc5/0x5c0 >[1291891.780275] transaction_kthread+0x141/0x1b0 >[1291891.780279] ? __pfx_transaction_kthread+0x10/0x10 >[1291891.780282] kthread+0xde/0x110 >[1291891.780287] ? __pfx_kthread+0x10/0x10 >[1291891.780290] ret_from_fork+0x2c/0x50 >[1291891.780297] </TASK> >[1291959.633743] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ksoftirqd/0:15] >[1291959.633754] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1291959.633827] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1291959.633832] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1291959.633834] RIP: 0010:vbg_req_perform+0x2c/0x40 [vboxguest] >[1291959.633845] Code: 1f 00 0f 1f 44 00 00 b8 00 00 00 80 48 01 f0 72 21 48 c7 c2 00 00 00 80 48 2b 15 e7 3e 4f c4 48 01 d0 0f b7 57 08 ef 0f ae f0 <8b> 46 0c e9 fc 3f b0 c3 48 8b 15 c5 ca b7 c4 eb e4 0f 1f 00 90 90 >[1291959.633847] RSP: 0018:ffffb5d800083db0 EFLAGS: 00010207 >[1291959.633850] RAX: 0000000001114000 RBX: ffff99a1c3d66298 RCX: 0000000000000000 >[1291959.633852] RDX: 000000000000d040 RSI: ffff99a0c1114000 RDI: ffff99a1c3d66028 >[1291959.633854] RBP: ffff99a1c3d66298 R08: ffff99a1c004f028 R09: ffffffff8505d6e0 >[1291959.633856] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffc04abd60 >[1291959.633858] R13: ffff99a1c3d66298 R14: ffffb5d800083e10 R15: ffff99a21ac21e80 >[1291959.633860] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1291959.633862] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1291959.633864] CR2: 000055a3e8f80e30 CR3: 00000000455c2000 CR4: 00000000000106f0 >[1291959.633876] Call Trace: >[1291959.633883] <IRQ> >[1291959.633888] ? watchdog_timer_fn+0x1a8/0x210 >[1291959.633897] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1291959.633903] ? __hrtimer_run_queues+0x112/0x2b0 >[1291959.633910] ? hrtimer_interrupt+0xf8/0x230 >[1291959.633915] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1291959.633920] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1291959.633927] </IRQ> >[1291959.633929] <TASK> >[1291959.633931] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1291959.633936] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1291959.633946] ? vbg_req_perform+0x2c/0x40 [vboxguest] >[1291959.633953] vbg_heartbeat_timer+0x1d/0x40 [vboxguest] >[1291959.633960] call_timer_fn+0x27/0x130 >[1291959.633982] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1291959.633992] __run_timers+0x222/0x2c0 >[1291959.633996] run_timer_softirq+0x1d/0x40 >[1291959.633999] __do_softirq+0xd4/0x2c8 >[1291959.634005] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1291959.634009] run_ksoftirqd+0x2c/0x40 >[1291959.634014] smpboot_thread_fn+0xdc/0x1d0 >[1291959.634017] kthread+0xde/0x110 >[1291959.634021] ? __pfx_kthread+0x10/0x10 >[1291959.634024] ret_from_fork+0x2c/0x50 >[1291959.634031] </TASK> >[1291987.661397] watchdog: BUG: soft lockup - CPU#0 stuck for 48s! [ksoftirqd/0:15] >[1291987.661408] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1291987.661503] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1291987.661508] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1291987.661511] RIP: 0010:vbg_req_perform+0x2c/0x40 [vboxguest] >[1291987.661523] Code: 1f 00 0f 1f 44 00 00 b8 00 00 00 80 48 01 f0 72 21 48 c7 c2 00 00 00 80 48 2b 15 e7 3e 4f c4 48 01 d0 0f b7 57 08 ef 0f ae f0 <8b> 46 0c e9 fc 3f b0 c3 48 8b 15 c5 ca b7 c4 eb e4 0f 1f 00 90 90 >[1291987.661527] RSP: 0018:ffffb5d800083db0 EFLAGS: 00010207 >[1291987.661530] RAX: 0000000001114000 RBX: ffff99a1c3d66298 RCX: 0000000000000000 >[1291987.661533] RDX: 000000000000d040 RSI: ffff99a0c1114000 RDI: ffff99a1c3d66028 >[1291987.661535] RBP: ffff99a1c3d66298 R08: ffff99a21ac33468 R09: ffffffff8505d6e0 >[1291987.661537] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffc04abd60 >[1291987.661539] R13: ffff99a1c3d66298 R14: ffffb5d800083e10 R15: ffff99a21ac21e80 >[1291987.661542] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1291987.661545] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1291987.661547] CR2: 000055a3e8f80e30 CR3: 00000000455c2000 CR4: 00000000000106f0 >[1291987.661551] Call Trace: >[1291987.661555] <IRQ> >[1291987.661561] ? watchdog_timer_fn+0x1a8/0x210 >[1291987.661569] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1291987.661573] ? __hrtimer_run_queues+0x112/0x2b0 >[1291987.661578] ? hrtimer_interrupt+0xf8/0x230 >[1291987.661582] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1291987.661587] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1291987.661593] </IRQ> >[1291987.661594] <TASK> >[1291987.661596] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1291987.661601] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1291987.661610] ? vbg_req_perform+0x2c/0x40 [vboxguest] >[1291987.661618] vbg_heartbeat_timer+0x1d/0x40 [vboxguest] >[1291987.661625] call_timer_fn+0x27/0x130 >[1291987.661629] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1291987.661635] __run_timers+0x222/0x2c0 >[1291987.661640] run_timer_softirq+0x1d/0x40 >[1291987.661642] __do_softirq+0xd4/0x2c8 >[1291987.661648] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1291987.661652] run_ksoftirqd+0x2c/0x40 >[1291987.661657] smpboot_thread_fn+0xdc/0x1d0 >[1291987.661660] kthread+0xde/0x110 >[1291987.661665] ? __pfx_kthread+0x10/0x10 >[1291987.661668] ret_from_fork+0x2c/0x50 >[1291987.661675] </TASK> >[1291990.036030] rcu: INFO: rcu_preempt self-detected stall on CPU >[1291990.036040] rcu: 0-...!: (13618 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277438/113277438 fqs=0 >[1291990.036048] rcu: (t=60008 jiffies g=128827713 q=559 ncpus=1) >[1291990.036051] rcu: rcu_preempt kthread starved for 60008 jiffies! g128827713 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0 >[1291990.036056] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1291990.036057] rcu: RCU grace-period kthread stack dump: >[1291990.036059] task:rcu_preempt state:R running task stack:0 pid:16 ppid:2 flags:0x00004000 >[1291990.036066] Call Trace: >[1291990.036069] <TASK> >[1291990.036076] __schedule+0x449/0x1480 >[1291990.036086] ? lock_timer_base+0x61/0x80 >[1291990.036094] schedule+0x5e/0xd0 >[1291990.036098] schedule_timeout+0x98/0x160 >[1291990.036102] ? __pfx_process_timeout+0x10/0x10 >[1291990.036106] rcu_gp_fqs_loop+0x141/0x520 >[1291990.036111] ? __note_gp_changes+0x153/0x1a0 >[1291990.036115] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1291990.036118] rcu_gp_kthread+0xea/0x1e0 >[1291990.036121] kthread+0xde/0x110 >[1291990.036126] ? __pfx_kthread+0x10/0x10 >[1291990.036129] ret_from_fork+0x2c/0x50 >[1291990.036136] </TASK> >[1291990.036138] rcu: Stack dump where RCU GP kthread last ran: >[1291990.036140] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1291990.036145] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1291990.036147] RIP: 0010:neigh_fill_info+0xa6/0x380 >[1291990.036153] Code: 87 bc 00 00 00 49 89 fc 83 f8 1b 7e bc 48 89 f3 89 d6 89 ca 44 89 c1 41 b8 0c 00 00 00 e8 92 e0 06 00 48 89 c5 48 85 c0 74 9f <48> 8b 93 50 01 00 00 8b 83 88 00 00 00 be 01 00 00 00 4c 89 e7 48 >[1291990.036156] RSP: 0018:ffffb5d800083ce8 EFLAGS: 00010282 >[1291990.036160] RAX: ffff99a0c7db6280 RBX: ffff99a0c651da00 RCX: 0000000000000000 >[1291990.036162] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff99a0c7db629c >[1291990.036164] RBP: ffff99a0c7db6280 R08: 000000000000000c R09: ffff99a0c7db629c >[1291990.036166] R10: 0000000000000000 R11: 0000000000000000 R12: ffff99a1ce542600 >[1291990.036168] R13: 000000014d082055 R14: ffffffff86b65e80 R15: ffff99a0c651da00 >[1291990.036171] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1291990.036174] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1291990.036176] CR2: 000055a3e8f80e30 CR3: 00000000455c2000 CR4: 00000000000106f0 >[1291990.036180] Call Trace: >[1291990.036182] <IRQ> >[1291990.036184] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1291990.036189] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1291990.036192] ? sched_slice+0x87/0x140 >[1291990.036197] ? timekeeping_update+0xdd/0x130 >[1291990.036201] ? timekeeping_advance+0x377/0x590 >[1291990.036206] ? update_process_times+0x74/0xb0 >[1291990.036209] ? tick_sched_handle+0x22/0x60 >[1291990.036213] ? tick_sched_timer+0x67/0x80 >[1291990.036217] ? __pfx_tick_sched_timer+0x10/0x10 >[1291990.036220] ? __hrtimer_run_queues+0x112/0x2b0 >[1291990.036224] ? hrtimer_interrupt+0xf8/0x230 >[1291990.036228] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1291990.036232] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1291990.036238] </IRQ> >[1291990.036239] <TASK> >[1291990.036240] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1291990.036248] ? neigh_fill_info+0xa6/0x380 >[1291990.036251] ? neigh_fill_info+0x9e/0x380 >[1291990.036255] ? __alloc_skb+0xde/0x1a0 >[1291990.036259] __neigh_notify+0x5b/0xc0 >[1291990.036263] neigh_timer_handler+0xe2/0x320 >[1291990.036267] ? __pfx_neigh_timer_handler+0x10/0x10 >[1291990.036270] call_timer_fn+0x27/0x130 >[1291990.036274] ? __pfx_neigh_timer_handler+0x10/0x10 >[1291990.036277] __run_timers+0x222/0x2c0 >[1291990.036281] run_timer_softirq+0x1d/0x40 >[1291990.036284] __do_softirq+0xd4/0x2c8 >[1291990.036289] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1291990.036293] run_ksoftirqd+0x2c/0x40 >[1291990.036298] smpboot_thread_fn+0xdc/0x1d0 >[1291990.036301] kthread+0xde/0x110 >[1291990.036304] ? __pfx_kthread+0x10/0x10 >[1291990.036308] ret_from_fork+0x2c/0x50 >[1291990.036313] </TASK> >[1291990.036315] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1291990.036318] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1291990.036320] RIP: 0010:neigh_fill_info+0xa6/0x380 >[1291990.036323] Code: 87 bc 00 00 00 49 89 fc 83 f8 1b 7e bc 48 89 f3 89 d6 89 ca 44 89 c1 41 b8 0c 00 00 00 e8 92 e0 06 00 48 89 c5 48 85 c0 74 9f <48> 8b 93 50 01 00 00 8b 83 88 00 00 00 be 01 00 00 00 4c 89 e7 48 >[1291990.036326] RSP: 0018:ffffb5d800083ce8 EFLAGS: 00010282 >[1291990.036329] RAX: ffff99a0c7db6280 RBX: ffff99a0c651da00 RCX: 0000000000000000 >[1291990.036331] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff99a0c7db629c >[1291990.036333] RBP: ffff99a0c7db6280 R08: 000000000000000c R09: ffff99a0c7db629c >[1291990.036335] R10: 0000000000000000 R11: 0000000000000000 R12: ffff99a1ce542600 >[1291990.036337] R13: 000000014d082055 R14: ffffffff86b65e80 R15: ffff99a0c651da00 >[1291990.036339] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1291990.036341] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1291990.036343] CR2: 000055a3e8f80e30 CR3: 00000000455c2000 CR4: 00000000000106f0 >[1291990.036346] Call Trace: >[1291990.036347] <IRQ> >[1291990.036349] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1291990.036353] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1291990.036356] ? sched_slice+0x87/0x140 >[1291990.036360] ? timekeeping_update+0xdd/0x130 >[1291990.036364] ? timekeeping_advance+0x377/0x590 >[1291990.036368] ? update_process_times+0x74/0xb0 >[1291990.036371] ? tick_sched_handle+0x22/0x60 >[1291990.036375] ? tick_sched_timer+0x67/0x80 >[1291990.036378] ? __pfx_tick_sched_timer+0x10/0x10 >[1291990.036381] ? __hrtimer_run_queues+0x112/0x2b0 >[1291990.036385] ? hrtimer_interrupt+0xf8/0x230 >[1291990.036389] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1291990.036393] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1291990.036396] </IRQ> >[1291990.036398] <TASK> >[1291990.036399] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1291990.036404] ? neigh_fill_info+0xa6/0x380 >[1291990.036408] ? neigh_fill_info+0x9e/0x380 >[1291990.036411] ? __alloc_skb+0xde/0x1a0 >[1291990.036415] __neigh_notify+0x5b/0xc0 >[1291990.036418] neigh_timer_handler+0xe2/0x320 >[1291990.036422] ? __pfx_neigh_timer_handler+0x10/0x10 >[1291990.036425] call_timer_fn+0x27/0x130 >[1291990.036428] ? __pfx_neigh_timer_handler+0x10/0x10 >[1291990.036431] __run_timers+0x222/0x2c0 >[1291990.036436] run_timer_softirq+0x1d/0x40 >[1291990.036438] __do_softirq+0xd4/0x2c8 >[1291990.036443] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1291990.036445] run_ksoftirqd+0x2c/0x40 >[1291990.036449] smpboot_thread_fn+0xdc/0x1d0 >[1291990.036452] kthread+0xde/0x110 >[1291990.036455] ? __pfx_kthread+0x10/0x10 >[1291990.036458] ret_from_fork+0x2c/0x50 >[1291990.036464] </TASK> >[1292061.211332] rcu: INFO: rcu_preempt self-detected stall on CPU >[1292061.211344] rcu: 0-...!: (1149 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277440/113277440 fqs=0 >[1292061.211351] rcu: (t=61204 jiffies g=128827717 q=822 ncpus=1) >[1292061.211354] rcu: rcu_preempt kthread timer wakeup didn't happen for 61201 jiffies! g128827717 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1292061.211359] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940853 >[1292061.211361] rcu: rcu_preempt kthread starved for 61204 jiffies! g128827717 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1292061.211364] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1292061.211366] rcu: RCU grace-period kthread stack dump: >[1292061.211368] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1292061.211390] Call Trace: >[1292061.211393] <TASK> >[1292061.211400] __schedule+0x449/0x1480 >[1292061.211412] ? lock_timer_base+0x61/0x80 >[1292061.211420] schedule+0x5e/0xd0 >[1292061.211424] schedule_timeout+0x98/0x160 >[1292061.211429] ? __pfx_process_timeout+0x10/0x10 >[1292061.211433] rcu_gp_fqs_loop+0x141/0x520 >[1292061.211455] ? __note_gp_changes+0x153/0x1a0 >[1292061.211460] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1292061.211463] rcu_gp_kthread+0xea/0x1e0 >[1292061.211466] kthread+0xde/0x110 >[1292061.211471] ? __pfx_kthread+0x10/0x10 >[1292061.211475] ret_from_fork+0x2c/0x50 >[1292061.211482] </TASK> >[1292061.211483] rcu: Stack dump where RCU GP kthread last ran: >[1292061.211486] CPU: 0 PID: 2849664 Comm: rtkit-daemon Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1292061.211490] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1292061.211492] RIP: 0010:__fget_light+0x22/0x100 >[1292061.211499] Code: 90 90 90 90 90 90 90 90 0f 1f 44 00 00 41 56 65 48 8b 04 25 80 32 03 00 41 55 41 54 41 89 f4 55 89 fd 53 48 8b 90 00 0c 00 00 <8b> 0a 83 f9 01 0f 84 84 00 00 00 4c 8b a8 00 0c 00 00 41 89 ee e8 >[1292061.211517] RSP: 0018:ffffb5d8067bba80 EFLAGS: 00010202 >[1292061.211522] RAX: ffff99a104fc0000 RBX: ffffb5d8067bbb2c RCX: 0000000000000002 >[1292061.211524] RDX: ffff99a0d2109080 RSI: 0000000000004000 RDI: 0000000000000007 >[1292061.211527] RBP: 0000000000000007 R08: 0000000000000000 R09: 0000000000000000 >[1292061.211529] R10: 0000000000000001 R11: 0000000000000110 R12: 0000000000004000 >[1292061.211531] R13: 0000000000000000 R14: 0000000000000000 R15: ffffb5d8067bbb1c >[1292061.211533] FS: 00007f70003fe6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1292061.211536] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1292061.211538] CR2: 00007f1eaa0abc30 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1292061.211542] Call Trace: >[1292061.211544] <IRQ> >[1292061.211547] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1292061.211552] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1292061.211556] ? timekeeping_update+0xdd/0x130 >[1292061.211560] ? timekeeping_advance+0x377/0x590 >[1292061.211564] ? update_process_times+0x74/0xb0 >[1292061.211585] ? tick_sched_handle+0x22/0x60 >[1292061.211590] ? tick_sched_timer+0x67/0x80 >[1292061.211593] ? __pfx_tick_sched_timer+0x10/0x10 >[1292061.211597] ? __hrtimer_run_queues+0x112/0x2b0 >[1292061.211600] ? hrtimer_interrupt+0xf8/0x230 >[1292061.211605] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1292061.211609] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1292061.211615] </IRQ> >[1292061.211616] <TASK> >[1292061.211617] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1292061.211626] ? __fget_light+0x22/0x100 >[1292061.211629] do_sys_poll+0x290/0x600 >[1292061.211654] ? __pfx_pollwake+0x10/0x10 >[1292061.211660] ? __pfx_pollwake+0x10/0x10 >[1292061.211667] ? ktime_get_ts64+0x4a/0xe0 >[1292061.211671] __x64_sys_poll+0xbb/0x150 >[1292061.211674] do_syscall_64+0x5f/0x90 >[1292061.211679] ? do_syscall_64+0x6b/0x90 >[1292061.211683] ? exit_to_user_mode_prepare+0x142/0x1f0 >[1292061.211688] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1292061.211692] RIP: 0033:0x7f700187d21f >[1292061.211886] Code: 54 24 1c 48 89 74 24 10 48 89 7c 24 08 e8 b9 83 f8 ff 8b 54 24 1c 48 8b 74 24 10 41 89 c0 48 8b 7c 24 08 b8 07 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 31 44 89 c7 89 44 24 08 e8 0d 84 f8 ff 8b 44 >[1292061.211906] RSP: 002b:00007f70003fdda0 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 >[1292061.211911] RAX: ffffffffffffffda RBX: 431bde82d7b634db RCX: 00007f700187d21f >[1292061.211913] RDX: 0000000000002710 RSI: 0000000000000002 RDI: 00007f70003fde00 >[1292061.211915] RBP: 000000000d050d07 R08: 0000000000000000 R09: 0000000000000000 >[1292061.211917] R10: 0000000000004000 R11: 0000000000000293 R12: 00007f70003fddf0 >[1292061.211919] R13: 000000000013b9be R14: 000000004d0d8f0a R15: 000000004d0d8f0a >[1292061.211924] </TASK> >[1292061.211931] CPU: 0 PID: 2849664 Comm: rtkit-daemon Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1292061.211934] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1292061.211936] RIP: 0010:__fget_light+0x22/0x100 >[1292061.211941] Code: 90 90 90 90 90 90 90 90 0f 1f 44 00 00 41 56 65 48 8b 04 25 80 32 03 00 41 55 41 54 41 89 f4 55 89 fd 53 48 8b 90 00 0c 00 00 <8b> 0a 83 f9 01 0f 84 84 00 00 00 4c 8b a8 00 0c 00 00 41 89 ee e8 >[1292061.211943] RSP: 0018:ffffb5d8067bba80 EFLAGS: 00010202 >[1292061.211946] RAX: ffff99a104fc0000 RBX: ffffb5d8067bbb2c RCX: 0000000000000002 >[1292061.211948] RDX: ffff99a0d2109080 RSI: 0000000000004000 RDI: 0000000000000007 >[1292061.211950] RBP: 0000000000000007 R08: 0000000000000000 R09: 0000000000000000 >[1292061.211952] R10: 0000000000000001 R11: 0000000000000110 R12: 0000000000004000 >[1292061.211954] R13: 0000000000000000 R14: 0000000000000000 R15: ffffb5d8067bbb1c >[1292061.211956] FS: 00007f70003fe6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1292061.211974] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1292061.211977] CR2: 00007f1eaa0abc30 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1292061.211980] Call Trace: >[1292061.211982] <IRQ> >[1292061.211985] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1292061.211989] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1292061.211993] ? timekeeping_update+0xdd/0x130 >[1292061.211997] ? timekeeping_advance+0x377/0x590 >[1292061.212001] ? update_process_times+0x74/0xb0 >[1292061.212004] ? tick_sched_handle+0x22/0x60 >[1292061.212039] ? tick_sched_timer+0x67/0x80 >[1292061.212043] ? __pfx_tick_sched_timer+0x10/0x10 >[1292061.212046] ? __hrtimer_run_queues+0x112/0x2b0 >[1292061.212050] ? hrtimer_interrupt+0xf8/0x230 >[1292061.212054] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1292061.212057] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1292061.212061] </IRQ> >[1292061.212062] <TASK> >[1292061.212064] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1292061.212068] ? __fget_light+0x22/0x100 >[1292061.212072] do_sys_poll+0x290/0x600 >[1292061.212079] ? __pfx_pollwake+0x10/0x10 >[1292061.212083] ? __pfx_pollwake+0x10/0x10 >[1292061.212107] ? ktime_get_ts64+0x4a/0xe0 >[1292061.212112] __x64_sys_poll+0xbb/0x150 >[1292061.212115] do_syscall_64+0x5f/0x90 >[1292061.212119] ? do_syscall_64+0x6b/0x90 >[1292061.212123] ? exit_to_user_mode_prepare+0x142/0x1f0 >[1292061.212127] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1292061.212130] RIP: 0033:0x7f700187d21f >[1292061.212136] Code: 54 24 1c 48 89 74 24 10 48 89 7c 24 08 e8 b9 83 f8 ff 8b 54 24 1c 48 8b 74 24 10 41 89 c0 48 8b 7c 24 08 b8 07 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 31 44 89 c7 89 44 24 08 e8 0d 84 f8 ff 8b 44 >[1292061.212138] RSP: 002b:00007f70003fdda0 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 >[1292061.212141] RAX: ffffffffffffffda RBX: 431bde82d7b634db RCX: 00007f700187d21f >[1292061.212144] RDX: 0000000000002710 RSI: 0000000000000002 RDI: 00007f70003fde00 >[1292061.212145] RBP: 000000000d050d07 R08: 0000000000000000 R09: 0000000000000000 >[1292061.212147] R10: 0000000000004000 R11: 0000000000000293 R12: 00007f70003fddf0 >[1292061.212149] R13: 000000000013b9be R14: 000000004d0d8f0a R15: 000000004d0d8f0a >[1292061.212167] </TASK> >[1292241.572127] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: >[1292241.572140] rcu: (detected by 0, t=241570 jiffies, g=128827717, q=1005 ncpus=1) >[1292241.572144] rcu: All QSes seen, last rcu_preempt kthread activity 180366 (5587597362-5587416996), jiffies_till_next_fqs=3, root ->qsmask 0x0 >[1292241.572149] rcu: rcu_preempt kthread starved for 180366 jiffies! g128827717 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0 >[1292241.572153] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1292241.572155] rcu: RCU grace-period kthread stack dump: >[1292241.572157] task:rcu_preempt state:R running task stack:0 pid:16 ppid:2 flags:0x00004000 >[1292241.572164] Call Trace: >[1292241.572167] <TASK> >[1292241.572175] __schedule+0x449/0x1480 >[1292241.572186] ? lock_timer_base+0x61/0x80 >[1292241.572195] schedule+0x5e/0xd0 >[1292241.572199] schedule_timeout+0x98/0x160 >[1292241.572203] ? __pfx_process_timeout+0x10/0x10 >[1292241.572207] rcu_gp_fqs_loop+0x141/0x520 >[1292241.572213] ? __note_gp_changes+0x153/0x1a0 >[1292241.572217] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1292241.572219] rcu_gp_kthread+0xea/0x1e0 >[1292241.572223] kthread+0xde/0x110 >[1292241.572228] ? __pfx_kthread+0x10/0x10 >[1292241.572232] ret_from_fork+0x2c/0x50 >[1292241.572239] </TASK> >[1292241.572240] rcu: Stack dump where RCU GP kthread last ran: >[1292241.572243] CPU: 0 PID: 1254698 Comm: kworker/0:0H Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1292241.572247] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1292241.572252] Workqueue: kblockd blk_mq_run_work_fn >[1292241.572258] RIP: 0010:_raw_spin_unlock_irqrestore+0x1d/0x40 >[1292241.572262] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 c6 07 00 0f 1f 00 f7 c6 00 02 00 00 74 06 fb 0f 1f 44 00 00 <65> ff 0d d4 17 08 7c 74 05 e9 85 1a 00 00 0f 1f 44 00 00 e9 7b 1a >[1292241.572265] RSP: 0018:ffffb5d8057dfc40 EFLAGS: 00010206 >[1292241.572268] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff99a1c0aec828 >[1292241.572270] RDX: ffff99a1c0af6040 RSI: 0000000000000293 RDI: ffff99a1c7069d80 >[1292241.572273] RBP: 0000000000000293 R08: 0000000000000001 R09: 0000000000001000 >[1292241.572275] R10: 000000007ca2dfff R11: 0000000000000000 R12: ffff99a1c0af4000 >[1292241.572277] R13: ffff99a1c3d11000 R14: ffff99a1c0c97000 R15: 0000000000000000 >[1292241.572279] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1292241.572282] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1292241.572284] CR2: 00007f7d29601270 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1292241.572289] Call Trace: >[1292241.572291] <IRQ> >[1292241.572293] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1292241.572297] ? rcu_sched_clock_irq+0xda7/0x1150 >[1292241.572302] ? update_process_times+0x74/0xb0 >[1292241.572305] ? tick_sched_handle+0x22/0x60 >[1292241.572310] ? tick_sched_timer+0x67/0x80 >[1292241.572313] ? __pfx_tick_sched_timer+0x10/0x10 >[1292241.572317] ? __hrtimer_run_queues+0x112/0x2b0 >[1292241.572321] ? hrtimer_interrupt+0xf8/0x230 >[1292241.572325] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1292241.572329] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1292241.572334] </IRQ> >[1292241.572336] <TASK> >[1292241.572337] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1292241.572345] ? _raw_spin_unlock_irqrestore+0x1d/0x40 >[1292241.572348] ata_scsi_queuecmd+0x53/0x80 >[1292241.572356] scsi_queue_rq+0x389/0xc80 >[1292241.572361] blk_mq_dispatch_rq_list+0x2f6/0x880 >[1292241.572365] ? bfq_dispatch_request+0xf0/0x1230 >[1292241.572371] blk_mq_do_dispatch_sched+0x324/0x3c0 >[1292241.572376] ? xa_find_after+0xd4/0x130 >[1292241.572381] __blk_mq_sched_dispatch_requests+0xec/0x130 >[1292241.572385] blk_mq_sched_dispatch_requests+0x34/0x60 >[1292241.572409] __blk_mq_run_hw_queue+0x70/0x90 >[1292241.572413] process_one_work+0x1c8/0x3c0 >[1292241.572417] worker_thread+0x51/0x390 >[1292241.572420] ? __pfx_worker_thread+0x10/0x10 >[1292241.572423] kthread+0xde/0x110 >[1292241.572426] ? __pfx_kthread+0x10/0x10 >[1292241.572430] ret_from_fork+0x2c/0x50 >[1292241.572435] </TASK> >[1292311.810534] watchdog: BUG: soft lockup - CPU#0 stuck for 24s! [kworker/0:0H:1254698] >[1292311.810551] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1292311.810989] CPU: 0 PID: 1254698 Comm: kworker/0:0H Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1292311.810994] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1292311.810998] Workqueue: kblockd blk_mq_run_work_fn >[1292311.811007] RIP: 0010:_raw_spin_unlock_irqrestore+0x1d/0x40 >[1292311.811015] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 c6 07 00 0f 1f 00 f7 c6 00 02 00 00 74 06 fb 0f 1f 44 00 00 <65> ff 0d d4 17 08 7c 74 05 e9 85 1a 00 00 0f 1f 44 00 00 e9 7b 1a >[1292311.811018] RSP: 0018:ffffb5d8057dfc40 EFLAGS: 00010206 >[1292311.811022] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff99a1c0aec828 >[1292311.811024] RDX: ffff99a1c0af6040 RSI: 0000000000000293 RDI: ffff99a1c7069d80 >[1292311.811027] RBP: 0000000000000293 R08: 0000000000000001 R09: 0000000000001000 >[1292311.811029] R10: 00000000c0cd1fff R11: 0000000000000000 R12: ffff99a1c0af4000 >[1292311.811031] R13: ffff99a1c3d11000 R14: ffff99a1c0c97000 R15: 0000000000000000 >[1292311.811033] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1292311.811037] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1292311.811039] CR2: 00007f7d29601270 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1292311.811043] Call Trace: >[1292311.811047] <IRQ> >[1292311.811054] ? watchdog_timer_fn+0x1a8/0x210 >[1292311.811062] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1292311.811065] ? __hrtimer_run_queues+0x112/0x2b0 >[1292311.811073] ? hrtimer_interrupt+0xf8/0x230 >[1292311.811077] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1292311.811083] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1292311.811088] </IRQ> >[1292311.811090] <TASK> >[1292311.811091] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1292311.811100] ? _raw_spin_unlock_irqrestore+0x1d/0x40 >[1292311.811105] ata_scsi_queuecmd+0x53/0x80 >[1292311.811112] scsi_queue_rq+0x389/0xc80 >[1292311.811119] blk_mq_dispatch_rq_list+0x2f6/0x880 >[1292311.811124] ? bfq_dispatch_request+0xf0/0x1230 >[1292311.811129] blk_mq_do_dispatch_sched+0x324/0x3c0 >[1292311.811136] __blk_mq_sched_dispatch_requests+0xec/0x130 >[1292311.811140] blk_mq_sched_dispatch_requests+0x34/0x60 >[1292311.811144] __blk_mq_run_hw_queue+0x70/0x90 >[1292311.811147] process_one_work+0x1c8/0x3c0 >[1292311.811153] worker_thread+0x51/0x390 >[1292311.811156] ? __pfx_worker_thread+0x10/0x10 >[1292311.811159] kthread+0xde/0x110 >[1292311.811164] ? __pfx_kthread+0x10/0x10 >[1292311.811168] ret_from_fork+0x2c/0x50 >[1292311.811175] </TASK> >[1292326.402586] rcu: INFO: rcu_preempt self-detected stall on CPU >[1292326.402602] rcu: 0-...!: (145 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277441/113277441 fqs=0 >[1292326.402610] rcu: (t=61011 jiffies g=128827721 q=1006 ncpus=1) >[1292326.402614] rcu: rcu_preempt kthread timer wakeup didn't happen for 61008 jiffies! g128827721 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1292326.402619] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940854 >[1292326.402622] rcu: rcu_preempt kthread starved for 61011 jiffies! g128827721 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1292326.402626] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1292326.402627] rcu: RCU grace-period kthread stack dump: >[1292326.402629] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1292326.402637] Call Trace: >[1292326.402640] <TASK> >[1292326.402647] __schedule+0x449/0x1480 >[1292326.402658] ? lock_timer_base+0x61/0x80 >[1292326.402666] schedule+0x5e/0xd0 >[1292326.402671] schedule_timeout+0x98/0x160 >[1292326.402677] ? __pfx_process_timeout+0x10/0x10 >[1292326.402682] rcu_gp_fqs_loop+0x141/0x520 >[1292326.402687] ? __note_gp_changes+0x153/0x1a0 >[1292326.402691] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1292326.402693] rcu_gp_kthread+0xea/0x1e0 >[1292326.402697] kthread+0xde/0x110 >[1292326.402702] ? __pfx_kthread+0x10/0x10 >[1292326.402706] ret_from_fork+0x2c/0x50 >[1292326.402714] </TASK> >[1292326.402715] rcu: Stack dump where RCU GP kthread last ran: >[1292326.402718] CPU: 0 PID: 1254698 Comm: kworker/0:0H Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1292326.402722] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1292326.402726] Workqueue: kblockd blk_mq_run_work_fn >[1292326.402732] RIP: 0010:_raw_spin_unlock_irqrestore+0x1d/0x40 >[1292326.402737] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 c6 07 00 0f 1f 00 f7 c6 00 02 00 00 74 06 fb 0f 1f 44 00 00 <65> ff 0d d4 17 08 7c 74 05 e9 85 1a 00 00 0f 1f 44 00 00 e9 7b 1a >[1292326.402740] RSP: 0018:ffffb5d8057dfc40 EFLAGS: 00010206 >[1292326.402744] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff99a1c0aec828 >[1292326.402746] RDX: ffff99a1c0af6040 RSI: 0000000000000293 RDI: ffff99a1c7069d80 >[1292326.402749] RBP: 0000000000000293 R08: 0000000000000001 R09: 0000000000001000 >[1292326.402752] R10: 0000000064539fff R11: 0000000000000000 R12: ffff99a1c0af4000 >[1292326.402754] R13: ffff99a1c3d11000 R14: ffff99a1c0c97000 R15: 0000000000000000 >[1292326.402756] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1292326.402760] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1292326.402763] CR2: 00007f7d29601270 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1292326.402769] Call Trace: >[1292326.402770] <IRQ> >[1292326.402773] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1292326.402778] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1292326.402783] ? sched_slice+0x87/0x140 >[1292326.402788] ? timekeeping_update+0xdd/0x130 >[1292326.402793] ? timekeeping_advance+0x377/0x590 >[1292326.402798] ? update_process_times+0x74/0xb0 >[1292326.402802] ? tick_sched_handle+0x22/0x60 >[1292326.402807] ? tick_sched_timer+0x67/0x80 >[1292326.402811] ? __pfx_tick_sched_timer+0x10/0x10 >[1292326.402814] ? __hrtimer_run_queues+0x112/0x2b0 >[1292326.402820] ? hrtimer_interrupt+0xf8/0x230 >[1292326.402825] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1292326.402829] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1292326.402834] </IRQ> >[1292326.402835] <TASK> >[1292326.402837] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1292326.402845] ? _raw_spin_unlock_irqrestore+0x1d/0x40 >[1292326.402848] ata_scsi_queuecmd+0x53/0x80 >[1292326.402854] scsi_queue_rq+0x389/0xc80 >[1292326.402859] blk_mq_dispatch_rq_list+0x2f6/0x880 >[1292326.402864] ? bfq_dispatch_request+0xf0/0x1230 >[1292326.402870] blk_mq_do_dispatch_sched+0x324/0x3c0 >[1292326.402877] __blk_mq_sched_dispatch_requests+0xec/0x130 >[1292326.402881] blk_mq_sched_dispatch_requests+0x34/0x60 >[1292326.402885] __blk_mq_run_hw_queue+0x70/0x90 >[1292326.402888] process_one_work+0x1c8/0x3c0 >[1292326.402893] worker_thread+0x51/0x390 >[1292326.402897] ? __pfx_worker_thread+0x10/0x10 >[1292326.402900] kthread+0xde/0x110 >[1292326.402904] ? __pfx_kthread+0x10/0x10 >[1292326.402908] ret_from_fork+0x2c/0x50 >[1292326.402914] </TASK> >[1292326.719917] CPU: 0 PID: 1254698 Comm: kworker/0:0H Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1292326.719933] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1292326.719938] Workqueue: kblockd blk_mq_run_work_fn >[1292326.719996] RIP: 0010:_raw_spin_unlock_irqrestore+0x1d/0x40 >[1292326.720007] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 c6 07 00 0f 1f 00 f7 c6 00 02 00 00 74 06 fb 0f 1f 44 00 00 <65> ff 0d d4 17 08 7c 74 05 e9 85 1a 00 00 0f 1f 44 00 00 e9 7b 1a >[1292326.720036] RSP: 0018:ffffb5d8057dfc40 EFLAGS: 00010206 >[1292326.720039] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff99a1c0aec828 >[1292326.720058] RDX: ffff99a1c0af6040 RSI: 0000000000000293 RDI: ffff99a1c7069d80 >[1292326.720061] RBP: 0000000000000293 R08: 0000000000000001 R09: 0000000000001000 >[1292326.720064] R10: 0000000064539fff R11: 0000000000000000 R12: ffff99a1c0af4000 >[1292326.720066] R13: ffff99a1c3d11000 R14: ffff99a1c0c97000 R15: 0000000000000000 >[1292326.720069] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1292326.720072] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1292326.720094] CR2: 00007f7d29601270 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1292326.720098] Call Trace: >[1292326.720102] <IRQ> >[1292326.720109] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1292326.720117] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1292326.720121] ? sched_slice+0x87/0x140 >[1292326.720127] ? timekeeping_update+0xdd/0x130 >[1292326.720132] ? timekeeping_advance+0x377/0x590 >[1292326.720136] ? update_process_times+0x74/0xb0 >[1292326.720161] ? tick_sched_handle+0x22/0x60 >[1292326.720167] ? tick_sched_timer+0x67/0x80 >[1292326.720170] ? __pfx_tick_sched_timer+0x10/0x10 >[1292326.720173] ? __hrtimer_run_queues+0x112/0x2b0 >[1292326.720177] ? hrtimer_interrupt+0xf8/0x230 >[1292326.720180] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1292326.720185] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1292326.720191] </IRQ> >[1292326.720193] <TASK> >[1292326.720194] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1292326.720202] ? _raw_spin_unlock_irqrestore+0x1d/0x40 >[1292326.720228] ata_scsi_queuecmd+0x53/0x80 >[1292326.720235] scsi_queue_rq+0x389/0xc80 >[1292326.720240] blk_mq_dispatch_rq_list+0x2f6/0x880 >[1292326.720245] ? bfq_dispatch_request+0xf0/0x1230 >[1292326.720251] blk_mq_do_dispatch_sched+0x324/0x3c0 >[1292326.720256] __blk_mq_sched_dispatch_requests+0xec/0x130 >[1292326.720260] blk_mq_sched_dispatch_requests+0x34/0x60 >[1292326.720263] __blk_mq_run_hw_queue+0x70/0x90 >[1292326.720267] process_one_work+0x1c8/0x3c0 >[1292326.720295] worker_thread+0x51/0x390 >[1292326.720299] ? __pfx_worker_thread+0x10/0x10 >[1292326.720302] kthread+0xde/0x110 >[1292326.720305] ? __pfx_kthread+0x10/0x10 >[1292326.720309] ret_from_fork+0x2c/0x50 >[1292326.720316] </TASK> >[1292499.673972] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ksoftirqd/0:15] >[1292499.673999] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1292499.674078] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1292499.674083] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1292499.674086] RIP: 0010:vbg_req_perform+0x2c/0x40 [vboxguest] >[1292499.674099] Code: 1f 00 0f 1f 44 00 00 b8 00 00 00 80 48 01 f0 72 21 48 c7 c2 00 00 00 80 48 2b 15 e7 3e 4f c4 48 01 d0 0f b7 57 08 ef 0f ae f0 <8b> 46 0c e9 fc 3f b0 c3 48 8b 15 c5 ca b7 c4 eb e4 0f 1f 00 90 90 >[1292499.674102] RSP: 0018:ffffb5d800083db0 EFLAGS: 00010207 >[1292499.674105] RAX: 0000000001114000 RBX: ffff99a1c3d66298 RCX: 0000000000000000 >[1292499.674108] RDX: 000000000000d040 RSI: ffff99a0c1114000 RDI: ffff99a1c3d66028 >[1292499.674110] RBP: ffff99a1c3d66298 R08: ffff99a21ac33468 R09: ffff99a21ac21ea8 >[1292499.674112] R10: 0000000000000001 R11: 00000000451b76d7 R12: ffffffffc04abd60 >[1292499.674114] R13: ffff99a1c3d66298 R14: ffffb5d800083e10 R15: ffff99a21ac21e80 >[1292499.674117] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1292499.674120] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1292499.674122] CR2: 000036fe26cfb000 CR3: 0000000114354000 CR4: 00000000000106f0 >[1292499.674126] Call Trace: >[1292499.674129] <IRQ> >[1292499.674134] ? watchdog_timer_fn+0x1a8/0x210 >[1292499.674142] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1292499.674146] ? __hrtimer_run_queues+0x112/0x2b0 >[1292499.674152] ? hrtimer_interrupt+0xf8/0x230 >[1292499.674156] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1292499.674161] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1292499.674167] </IRQ> >[1292499.674168] <TASK> >[1292499.674170] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1292499.674175] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1292499.674185] ? vbg_req_perform+0x2c/0x40 [vboxguest] >[1292499.674192] vbg_heartbeat_timer+0x1d/0x40 [vboxguest] >[1292499.674199] call_timer_fn+0x27/0x130 >[1292499.674203] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1292499.674210] __run_timers+0x222/0x2c0 >[1292499.674214] run_timer_softirq+0x1d/0x40 >[1292499.674217] __do_softirq+0xd4/0x2c8 >[1292499.674223] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1292499.674228] run_ksoftirqd+0x2c/0x40 >[1292499.674233] smpboot_thread_fn+0xdc/0x1d0 >[1292499.674236] kthread+0xde/0x110 >[1292499.674240] ? __pfx_kthread+0x10/0x10 >[1292499.674243] ret_from_fork+0x2c/0x50 >[1292499.674250] </TASK> >[1292576.495571] rcu: INFO: rcu_preempt self-detected stall on CPU >[1292576.495582] rcu: 0-...!: (276 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277443/113277443 fqs=0 >[1292576.495589] rcu: (t=62234 jiffies g=128827729 q=1462 ncpus=1) >[1292576.495593] rcu: rcu_preempt kthread timer wakeup didn't happen for 62231 jiffies! g128827729 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1292576.495598] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940856 >[1292576.495601] rcu: rcu_preempt kthread starved for 62234 jiffies! g128827729 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1292576.495605] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1292576.495607] rcu: RCU grace-period kthread stack dump: >[1292576.495609] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1292576.495616] Call Trace: >[1292576.495619] <TASK> >[1292576.495626] __schedule+0x449/0x1480 >[1292576.495637] ? lock_timer_base+0x61/0x80 >[1292576.495645] schedule+0x5e/0xd0 >[1292576.495650] schedule_timeout+0x98/0x160 >[1292576.495655] ? __pfx_process_timeout+0x10/0x10 >[1292576.495659] rcu_gp_fqs_loop+0x141/0x520 >[1292576.495665] ? __note_gp_changes+0x153/0x1a0 >[1292576.495669] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1292576.495672] rcu_gp_kthread+0xea/0x1e0 >[1292576.495676] kthread+0xde/0x110 >[1292576.495682] ? __pfx_kthread+0x10/0x10 >[1292576.495687] ret_from_fork+0x2c/0x50 >[1292576.495694] </TASK> >[1292576.495697] rcu: Stack dump where RCU GP kthread last ran: >[1292576.495700] CPU: 0 PID: 2849664 Comm: rtkit-daemon Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1292576.495705] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1292576.495708] RIP: 0010:finish_task_switch.isra.0+0x96/0x2d0 >[1292576.495715] Code: 45 34 00 00 00 00 0f 1f 44 00 00 49 8b 9c 24 20 0a 00 00 48 85 db 0f 85 aa 00 00 00 4c 89 e7 e8 10 f6 ff ff fb 0f 1f 44 00 00 <65> 48 8b 04 25 80 32 03 00 66 90 4d 85 f6 74 21 65 48 8b 04 25 80 >[1292576.495718] RSP: 0018:ffffb5d8067bb960 EFLAGS: 00010282 >[1292576.495722] RAX: ffff99a1c0372740 RBX: 0000000000000000 RCX: 0000000000000002 >[1292576.495725] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff99a21ac33ac0 >[1292576.495728] RBP: ffffb5d8067bb988 R08: 0000000000000000 R09: 0000000000000000 >[1292576.495730] R10: 0000000000000001 R11: 0000000000000110 R12: ffff99a21ac33ac0 >[1292576.495732] R13: ffff99a1c0372740 R14: ffff99a206cc8f00 R15: 0000000000000001 >[1292576.495735] FS: 00007f70003fe6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1292576.495738] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1292576.495742] CR2: 000036fe26cfb000 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1292576.495746] Call Trace: >[1292576.495748] <IRQ> >[1292576.495750] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1292576.495774] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1292576.495781] ? kvm_clock_read+0x14/0x30 >[1292576.495787] ? kvm_sched_clock_read+0x9/0x20 >[1292576.495790] ? sched_clock_cpu+0xf/0x190 >[1292576.495795] ? timekeeping_update+0xdd/0x130 >[1292576.495802] ? timekeeping_advance+0x377/0x590 >[1292576.495806] ? update_process_times+0x74/0xb0 >[1292576.495809] ? tick_sched_handle+0x22/0x60 >[1292576.495814] ? tick_sched_timer+0x67/0x80 >[1292576.495817] ? __pfx_tick_sched_timer+0x10/0x10 >[1292576.495820] ? __hrtimer_run_queues+0x112/0x2b0 >[1292576.495824] ? hrtimer_interrupt+0xf8/0x230 >[1292576.495828] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1292576.495832] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1292576.495836] </IRQ> >[1292576.495838] <TASK> >[1292576.495839] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1292576.495845] ? finish_task_switch.isra.0+0x96/0x2d0 >[1292576.495850] __schedule+0x451/0x1480 >[1292576.495854] ? timerqueue_add+0x66/0xb0 >[1292576.495859] schedule+0x5e/0xd0 >[1292576.495862] schedule_hrtimeout_range_clock+0xbe/0x130 >[1292576.495866] ? __pfx_hrtimer_wakeup+0x10/0x10 >[1292576.495870] do_sys_poll+0x500/0x600 >[1292576.495879] ? __pfx_pollwake+0x10/0x10 >[1292576.495884] ? __pfx_pollwake+0x10/0x10 >[1292576.495893] __x64_sys_poll+0xbb/0x150 >[1292576.495896] do_syscall_64+0x5f/0x90 >[1292576.495902] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1292576.495905] RIP: 0033:0x7f700187d21f >[1292576.815239] Code: 54 24 1c 48 89 74 24 10 48 89 7c 24 08 e8 b9 83 f8 ff 8b 54 24 1c 48 8b 74 24 10 41 89 c0 48 8b 7c 24 08 b8 07 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 31 44 89 c7 89 44 24 08 e8 0d 84 f8 ff 8b 44 >[1292576.815245] RSP: 002b:00007f70003fdda0 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 >[1292576.815250] RAX: ffffffffffffffda RBX: 431bde82d7b634db RCX: 00007f700187d21f >[1292576.815253] RDX: 0000000000002710 RSI: 0000000000000002 RDI: 00007f70003fde00 >[1292576.815255] RBP: 000000001c634482 R08: 0000000000000000 R09: 0000000000000000 >[1292576.815258] R10: 0000000000004000 R11: 0000000000000293 R12: 00007f70003fddf0 >[1292576.815260] R13: 000000000013bbc3 R14: 000000004d157394 R15: 000000004d157394 >[1292576.815268] </TASK> >[1292576.815357] CPU: 0 PID: 2849664 Comm: rtkit-daemon Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1292576.815364] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1292576.815366] RIP: 0010:finish_task_switch.isra.0+0x96/0x2d0 >[1292576.815375] Code: 45 34 00 00 00 00 0f 1f 44 00 00 49 8b 9c 24 20 0a 00 00 48 85 db 0f 85 aa 00 00 00 4c 89 e7 e8 10 f6 ff ff fb 0f 1f 44 00 00 <65> 48 8b 04 25 80 32 03 00 66 90 4d 85 f6 74 21 65 48 8b 04 25 80 >[1292576.815378] RSP: 0018:ffffb5d8067bb960 EFLAGS: 00010282 >[1292576.815381] RAX: ffff99a1c0372740 RBX: 0000000000000000 RCX: 0000000000000002 >[1292576.815383] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff99a21ac33ac0 >[1292576.815385] RBP: ffffb5d8067bb988 R08: 0000000000000000 R09: 0000000000000000 >[1292576.815387] R10: 0000000000000001 R11: 0000000000000110 R12: ffff99a21ac33ac0 >[1292576.815389] R13: ffff99a1c0372740 R14: ffff99a206cc8f00 R15: 0000000000000001 >[1292576.815392] FS: 00007f70003fe6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1292576.815395] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1292576.815397] CR2: 000036fe26cfb000 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1292576.815401] Call Trace: >[1292576.815404] <IRQ> >[1292576.815407] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1292576.815413] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1292576.815417] ? kvm_clock_read+0x14/0x30 >[1292576.815423] ? kvm_sched_clock_read+0x9/0x20 >[1292576.815427] ? sched_clock_cpu+0xf/0x190 >[1292576.815432] ? timekeeping_update+0xdd/0x130 >[1292576.815437] ? timekeeping_advance+0x377/0x590 >[1292576.815442] ? update_process_times+0x74/0xb0 >[1292576.815446] ? tick_sched_handle+0x22/0x60 >[1292576.815451] ? tick_sched_timer+0x67/0x80 >[1292576.815454] ? __pfx_tick_sched_timer+0x10/0x10 >[1292576.815457] ? __hrtimer_run_queues+0x112/0x2b0 >[1292576.815462] ? hrtimer_interrupt+0xf8/0x230 >[1292576.815466] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1292576.815471] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1292576.815475] </IRQ> >[1292576.815476] <TASK> >[1292576.815477] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1292576.815483] ? finish_task_switch.isra.0+0x96/0x2d0 >[1292576.815488] __schedule+0x451/0x1480 >[1292576.815494] ? timerqueue_add+0x66/0xb0 >[1292576.815499] schedule+0x5e/0xd0 >[1292576.815503] schedule_hrtimeout_range_clock+0xbe/0x130 >[1292576.815507] ? __pfx_hrtimer_wakeup+0x10/0x10 >[1292576.815511] do_sys_poll+0x500/0x600 >[1292576.815520] ? __pfx_pollwake+0x10/0x10 >[1292576.815525] ? __pfx_pollwake+0x10/0x10 >[1292576.815534] __x64_sys_poll+0xbb/0x150 >[1292576.815538] do_syscall_64+0x5f/0x90 >[1292576.815543] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1292576.815547] RIP: 0033:0x7f700187d21f >[1292576.815552] Code: 54 24 1c 48 89 74 24 10 48 89 7c 24 08 e8 b9 83 f8 ff 8b 54 24 1c 48 8b 74 24 10 41 89 c0 48 8b 7c 24 08 b8 07 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 31 44 89 c7 89 44 24 08 e8 0d 84 f8 ff 8b 44 >[1292576.815555] RSP: 002b:00007f70003fdda0 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 >[1292576.815558] RAX: ffffffffffffffda RBX: 431bde82d7b634db RCX: 00007f700187d21f >[1292576.815560] RDX: 0000000000002710 RSI: 0000000000000002 RDI: 00007f70003fde00 >[1292576.815562] RBP: 000000001c634482 R08: 0000000000000000 R09: 0000000000000000 >[1292576.815564] R10: 0000000000004000 R11: 0000000000000293 R12: 00007f70003fddf0 >[1292576.815566] R13: 000000000013bbc3 R14: 000000004d157394 R15: 000000004d157394 >[1292576.815570] </TASK> >[1292756.944112] rcu: INFO: rcu_preempt self-detected stall on CPU >[1292756.944123] rcu: 0-...!: (1761 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277443/113277443 fqs=1 >[1292756.944131] rcu: (t=242687 jiffies g=128827729 q=1590 ncpus=1) >[1292756.944135] rcu: rcu_preempt kthread starved for 180133 jiffies! g128827729 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0 >[1292756.944139] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1292756.944141] rcu: RCU grace-period kthread stack dump: >[1292756.944143] task:rcu_preempt state:R running task stack:0 pid:16 ppid:2 flags:0x00004000 >[1292756.944150] Call Trace: >[1292756.944152] <TASK> >[1292756.944160] __schedule+0x449/0x1480 >[1292756.944171] ? lock_timer_base+0x61/0x80 >[1292756.944179] schedule+0x5e/0xd0 >[1292756.944183] schedule_timeout+0x98/0x160 >[1292756.944188] ? __pfx_process_timeout+0x10/0x10 >[1292756.944191] rcu_gp_fqs_loop+0x141/0x520 >[1292756.944197] ? __note_gp_changes+0x153/0x1a0 >[1292756.944201] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1292756.944204] rcu_gp_kthread+0xea/0x1e0 >[1292756.944207] kthread+0xde/0x110 >[1292756.944212] ? __pfx_kthread+0x10/0x10 >[1292756.944215] ret_from_fork+0x2c/0x50 >[1292756.944222] </TASK> >[1292756.944224] rcu: Stack dump where RCU GP kthread last ran: >[1292756.944227] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1292756.944231] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1292756.944233] RIP: 0010:e1000_xmit_frame+0xd3a/0xfc0 [e1000] >[1292756.944252] Code: 48 8b 83 00 04 00 00 f6 80 90 00 00 00 03 0f 84 ac f9 ff ff 48 8b 3c 24 41 0f b7 45 2a 41 8b 55 18 48 03 87 48 0e 00 00 89 10 <e9> 91 f9 ff ff 31 c9 eb 84 31 f6 48 89 ef e8 e3 c1 a1 c3 e9 e1 fe >[1292756.944256] RSP: 0018:ffffb5d800083b38 EFLAGS: 00010286 >[1292756.944259] RAX: ffffb5d800883818 RBX: ffff99a1c8f8e000 RCX: 000000000000007e >[1292756.944262] RDX: 000000000000007e RSI: ffff99a1c7e42800 RDI: ffff99a1c8f8e000 >[1292756.944264] RBP: ffff99a1c9ba5f00 R08: ffff99a1c8f8e000 R09: 0000000007db6a02 >[1292756.944266] R10: 0000000000000000 R11: 0000000007db6a3d R12: 000000000000007d >[1292756.944268] R13: ffff99a1c7e42800 R14: 000000000000007d R15: 0000000000000000 >[1292756.944271] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1292756.944273] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1292756.944276] CR2: 00007f18bb7b4000 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1292756.944280] Call Trace: >[1292756.944282] <IRQ> >[1292756.944284] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1292756.944288] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1292756.944291] ? sched_slice+0x87/0x140 >[1292756.944296] ? timekeeping_update+0xdd/0x130 >[1292756.944300] ? timekeeping_advance+0x377/0x590 >[1292756.944305] ? update_process_times+0x74/0xb0 >[1292756.944308] ? tick_sched_handle+0x22/0x60 >[1292756.944313] ? tick_sched_timer+0x67/0x80 >[1292756.944316] ? __pfx_tick_sched_timer+0x10/0x10 >[1292756.944319] ? __hrtimer_run_queues+0x112/0x2b0 >[1292756.944323] ? hrtimer_interrupt+0xf8/0x230 >[1292756.944327] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1292756.944332] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1292756.944337] </IRQ> >[1292756.944338] <TASK> >[1292756.944339] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1292756.944347] ? e1000_xmit_frame+0xd3a/0xfc0 [e1000] >[1292756.944361] ? e1000_xmit_frame+0xd05/0xfc0 [e1000] >[1292756.944374] ? netif_skb_features+0x151/0x2e0 >[1292756.944379] dev_hard_start_xmit+0x67/0x1d0 >[1292756.944383] sch_direct_xmit+0xa4/0x380 >[1292756.944388] __dev_queue_xmit+0x96e/0xdc0 >[1292756.944392] ? arp_create+0x132/0x3f0 >[1292756.944397] arp_solicit+0x11f/0x300 >[1292756.944401] ? kmem_cache_alloc+0x17b/0x340 >[1292756.944407] neigh_probe+0x51/0x70 >[1292756.944411] neigh_timer_handler+0x231/0x320 >[1292756.944415] ? __pfx_neigh_timer_handler+0x10/0x10 >[1292756.944418] call_timer_fn+0x27/0x130 >[1292756.944421] ? __pfx_neigh_timer_handler+0x10/0x10 >[1292756.944425] __run_timers+0x222/0x2c0 >[1292756.944429] run_timer_softirq+0x1d/0x40 >[1292756.944432] __do_softirq+0xd4/0x2c8 >[1292756.944437] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1292756.944440] run_ksoftirqd+0x2c/0x40 >[1292756.944445] smpboot_thread_fn+0xdc/0x1d0 >[1292756.944448] kthread+0xde/0x110 >[1292756.944451] ? __pfx_kthread+0x10/0x10 >[1292756.944455] ret_from_fork+0x2c/0x50 >[1292756.944460] </TASK> >[1292756.944462] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1292756.944466] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1292756.944467] RIP: 0010:e1000_xmit_frame+0xd3a/0xfc0 [e1000] >[1292756.944481] Code: 48 8b 83 00 04 00 00 f6 80 90 00 00 00 03 0f 84 ac f9 ff ff 48 8b 3c 24 41 0f b7 45 2a 41 8b 55 18 48 03 87 48 0e 00 00 89 10 <e9> 91 f9 ff ff 31 c9 eb 84 31 f6 48 89 ef e8 e3 c1 a1 c3 e9 e1 fe >[1292756.944484] RSP: 0018:ffffb5d800083b38 EFLAGS: 00010286 >[1292756.944486] RAX: ffffb5d800883818 RBX: ffff99a1c8f8e000 RCX: 000000000000007e >[1292756.944488] RDX: 000000000000007e RSI: ffff99a1c7e42800 RDI: ffff99a1c8f8e000 >[1292756.944490] RBP: ffff99a1c9ba5f00 R08: ffff99a1c8f8e000 R09: 0000000007db6a02 >[1292756.944492] R10: 0000000000000000 R11: 0000000007db6a3d R12: 000000000000007d >[1292756.944494] R13: ffff99a1c7e42800 R14: 000000000000007d R15: 0000000000000000 >[1292756.944496] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1292756.944499] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1292756.944501] CR2: 00007f18bb7b4000 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1292756.944503] Call Trace: >[1292756.944505] <IRQ> >[1292756.944506] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1292756.944510] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1292756.944513] ? sched_slice+0x87/0x140 >[1292756.944517] ? timekeeping_update+0xdd/0x130 >[1292756.944521] ? timekeeping_advance+0x377/0x590 >[1292756.944525] ? update_process_times+0x74/0xb0 >[1292756.944529] ? tick_sched_handle+0x22/0x60 >[1292756.944532] ? tick_sched_timer+0x67/0x80 >[1292756.944535] ? __pfx_tick_sched_timer+0x10/0x10 >[1292756.944538] ? __hrtimer_run_queues+0x112/0x2b0 >[1292756.944542] ? hrtimer_interrupt+0xf8/0x230 >[1292756.944546] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1292756.944549] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1292756.944553] </IRQ> >[1292756.944554] <TASK> >[1292756.944556] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1292756.944561] ? e1000_xmit_frame+0xd3a/0xfc0 [e1000] >[1292756.944574] ? e1000_xmit_frame+0xd05/0xfc0 [e1000] >[1292756.944588] ? netif_skb_features+0x151/0x2e0 >[1292756.944591] dev_hard_start_xmit+0x67/0x1d0 >[1292756.944594] sch_direct_xmit+0xa4/0x380 >[1292756.944598] __dev_queue_xmit+0x96e/0xdc0 >[1292756.944601] ? arp_create+0x132/0x3f0 >[1292756.944605] arp_solicit+0x11f/0x300 >[1292756.944609] ? kmem_cache_alloc+0x17b/0x340 >[1292756.944613] neigh_probe+0x51/0x70 >[1292756.944615] neigh_timer_handler+0x231/0x320 >[1292756.944619] ? __pfx_neigh_timer_handler+0x10/0x10 >[1292756.944622] call_timer_fn+0x27/0x130 >[1292756.944625] ? __pfx_neigh_timer_handler+0x10/0x10 >[1292756.944628] __run_timers+0x222/0x2c0 >[1292756.944632] run_timer_softirq+0x1d/0x40 >[1292756.944635] __do_softirq+0xd4/0x2c8 >[1292756.944639] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1292756.944642] run_ksoftirqd+0x2c/0x40 >[1292756.944645] smpboot_thread_fn+0xdc/0x1d0 >[1292756.944648] kthread+0xde/0x110 >[1292756.944651] ? __pfx_kthread+0x10/0x10 >[1292756.944655] ret_from_fork+0x2c/0x50 >[1292756.944660] </TASK> >[1292786.983218] watchdog: BUG: soft lockup - CPU#0 stuck for 36s! [ksoftirqd/0:15] >[1292786.983230] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1292786.983317] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1292786.983326] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1292786.983329] RIP: 0010:ip6_finish_output2+0xf2/0x6f0 >[1292786.983341] Code: 3f 04 00 00 41 8b 46 18 48 89 d9 41 8b 7c 24 04 41 8b 74 24 0c 4c 8b 0d e4 d5 41 01 48 c1 e9 20 41 8b 54 24 08 48 31 d9 31 c8 <41> 8b 49 10 41 0f af 41 0c 0f af cf 01 c8 41 8b 49 18 0f af ce 01 >[1292786.983344] RSP: 0018:ffffb5d800083b40 EFLAGS: 00010202 >[1292786.983348] RAX: 0000000037077b5e RBX: ffff99a1c8f8e000 RCX: ffff99a1370779a1 >[1292786.983351] RDX: 0000000001000000 RSI: 00000000020000ff RDI: 0000000000000000 >[1292786.983353] RBP: ffff99a1c13fc100 R08: ffffffff86b65e80 R09: ffff99a0df0d5200 >[1292786.983356] R10: ffff99a1c798a000 R11: 0000000000000004 R12: ffff99a1c8110528 >[1292786.983358] R13: ffff99a181a76b00 R14: ffff99a1c8110510 R15: ffff99a1c0c0dc80 >[1292786.983360] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1292786.983363] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1292786.983365] CR2: 00007f18bb7b4000 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1292786.983369] Call Trace: >[1292786.983376] <IRQ> >[1292786.983384] ? watchdog_timer_fn+0x1a8/0x210 >[1292786.983393] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1292786.983397] ? __hrtimer_run_queues+0x112/0x2b0 >[1292786.983403] ? hrtimer_interrupt+0xf8/0x230 >[1292786.983407] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1292786.983412] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1292786.983418] </IRQ> >[1292786.983419] <TASK> >[1292786.983421] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1292786.983428] ? ip6_finish_output2+0xf2/0x6f0 >[1292786.983432] ? nf_hook_slow+0x45/0xc0 >[1292786.983439] ip6_finish_output+0x1c5/0x320 >[1292786.983443] ndisc_send_skb+0x1cd/0x300 >[1292786.983449] ndisc_send_ns+0x70/0xc0 >[1292786.983453] ndisc_solicit+0xde/0x190 >[1292786.983457] neigh_probe+0x51/0x70 >[1292786.983461] neigh_timer_handler+0x231/0x320 >[1292786.983465] ? __pfx_neigh_timer_handler+0x10/0x10 >[1292786.983469] call_timer_fn+0x27/0x130 >[1292786.983473] ? __pfx_neigh_timer_handler+0x10/0x10 >[1292786.983476] __run_timers+0x222/0x2c0 >[1292786.983480] run_timer_softirq+0x1d/0x40 >[1292786.983483] __do_softirq+0xd4/0x2c8 >[1292786.983489] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1292786.983493] run_ksoftirqd+0x2c/0x40 >[1292786.983499] smpboot_thread_fn+0xdc/0x1d0 >[1292786.983502] kthread+0xde/0x110 >[1292786.983506] ? __pfx_kthread+0x10/0x10 >[1292786.983510] ret_from_fork+0x2c/0x50 >[1292786.983517] </TASK> >[1292846.473147] watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [btrfs-transacti:389] >[1292846.473159] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1292846.473238] CPU: 0 PID: 389 Comm: btrfs-transacti Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1292846.473242] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1292846.473245] RIP: 0010:_raw_spin_unlock_irqrestore+0x1d/0x40 >[1292846.473255] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 c6 07 00 0f 1f 00 f7 c6 00 02 00 00 74 06 fb 0f 1f 44 00 00 <65> ff 0d d4 17 08 7c 74 05 e9 85 1a 00 00 0f 1f 44 00 00 e9 7b 1a >[1292846.473258] RSP: 0018:ffffb5d800823a70 EFLAGS: 00010206 >[1292846.473262] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff99a1c0aec828 >[1292846.473264] RDX: ffff99a1c0af6040 RSI: 0000000000000293 RDI: ffff99a1c7069d80 >[1292846.473267] RBP: 0000000000000293 R08: 0000000000000001 R09: 0000000000001000 >[1292846.473269] R10: 0000000111965fff R11: 0000000000000000 R12: ffff99a1c0af4000 >[1292846.473271] R13: ffff99a1c3d11000 R14: ffff99a1c0c97000 R15: 0000000000000000 >[1292846.473274] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1292846.473277] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1292846.473279] CR2: 00007f18bb7b4000 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1292846.473283] Call Trace: >[1292846.473287] <IRQ> >[1292846.473293] ? watchdog_timer_fn+0x1a8/0x210 >[1292846.473300] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1292846.473304] ? __hrtimer_run_queues+0x112/0x2b0 >[1292846.473309] ? hrtimer_interrupt+0xf8/0x230 >[1292846.473313] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1292846.473318] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1292846.473323] </IRQ> >[1292846.473324] <TASK> >[1292846.473326] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1292846.473333] ? _raw_spin_unlock_irqrestore+0x1d/0x40 >[1292846.473337] ata_scsi_queuecmd+0x53/0x80 >[1292846.473344] scsi_queue_rq+0x389/0xc80 >[1292846.473349] blk_mq_dispatch_rq_list+0x2f6/0x880 >[1292846.473355] ? bfq_dispatch_request+0xf0/0x1230 >[1292846.473360] blk_mq_do_dispatch_sched+0x324/0x3c0 >[1292846.473366] __blk_mq_sched_dispatch_requests+0xec/0x130 >[1292846.473370] blk_mq_sched_dispatch_requests+0x34/0x60 >[1292846.473374] __blk_mq_run_hw_queue+0x70/0x90 >[1292846.473378] blk_mq_sched_insert_requests+0x73/0x170 >[1292846.473381] ? wbc_detach_inode+0x176/0x220 >[1292846.473386] blk_mq_flush_plug_list+0x137/0x300 >[1292846.473391] __blk_flush_plug+0x106/0x160 >[1292846.473395] ? btrfs_write_marked_extents+0xb3/0x150 >[1292846.473400] blk_finish_plug+0x29/0x40 >[1292846.473404] btrfs_write_and_wait_transaction+0x7b/0xf0 >[1292846.473409] btrfs_commit_transaction+0x8c4/0xf00 >[1292846.473412] ? start_transaction+0xc5/0x5c0 >[1292846.473416] transaction_kthread+0x141/0x1b0 >[1292846.473421] ? __pfx_transaction_kthread+0x10/0x10 >[1292846.473423] kthread+0xde/0x110 >[1292846.473429] ? __pfx_kthread+0x10/0x10 >[1292846.473432] ret_from_fork+0x2c/0x50 >[1292846.473439] </TASK> >[1292870.637568] rcu: INFO: rcu_preempt self-detected stall on CPU >[1292870.637580] rcu: 0-...!: (249 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277444/113277444 fqs=0 >[1292870.637587] rcu: (t=60033 jiffies g=128827733 q=1657 ncpus=1) >[1292870.637590] rcu: rcu_preempt kthread timer wakeup didn't happen for 60030 jiffies! g128827733 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1292870.637594] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940857 >[1292870.637597] rcu: rcu_preempt kthread starved for 60033 jiffies! g128827733 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1292870.637601] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1292870.637602] rcu: RCU grace-period kthread stack dump: >[1292870.637604] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1292870.637610] Call Trace: >[1292870.637613] <TASK> >[1292870.637619] __schedule+0x449/0x1480 >[1292870.637630] ? lock_timer_base+0x61/0x80 >[1292870.637638] schedule+0x5e/0xd0 >[1292870.637641] schedule_timeout+0x98/0x160 >[1292870.637646] ? __pfx_process_timeout+0x10/0x10 >[1292870.637650] rcu_gp_fqs_loop+0x141/0x520 >[1292870.637655] ? __note_gp_changes+0x153/0x1a0 >[1292870.637658] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1292870.637661] rcu_gp_kthread+0xea/0x1e0 >[1292870.637664] kthread+0xde/0x110 >[1292870.637670] ? __pfx_kthread+0x10/0x10 >[1292870.637673] ret_from_fork+0x2c/0x50 >[1292870.637681] </TASK> >[1292870.637682] rcu: Stack dump where RCU GP kthread last ran: >[1292870.637685] CPU: 0 PID: 593 Comm: btrfs-transacti Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1292870.637689] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1292870.637692] RIP: 0010:__btrfs_submit_bio+0x59/0x140 >[1292870.637699] Code: 80 01 00 00 0f 85 93 00 00 00 45 8b 74 24 28 49 89 7c 24 18 45 85 f6 0f 8e a2 00 00 00 49 8d 6c 24 48 44 89 f0 45 31 ed eb 3f <48> c7 43 38 20 d7 6a 83 48 89 6b 40 48 8b 45 08 48 89 de 41 83 c5 >[1292870.637702] RSP: 0018:ffffb5d80099ba50 EFLAGS: 00010246 >[1292870.637705] RAX: 0000000000000001 RBX: ffff99a0c75180a8 RCX: 0000000000000000 >[1292870.637708] RDX: ffff99a1c5fca740 RSI: ffff99a1c7181220 RDI: ffff99a1c5fca740 >[1292870.637710] RBP: ffff99a1c5503d58 R08: ffff99a16330a7d0 R09: 0000000000000000 >[1292870.637712] R10: 000000000078013c R11: 0000000000000110 R12: ffff99a1c5503d00 >[1292870.637715] R13: 0000000000000001 R14: 0000000000000002 R15: ffff99a1c4e58d68 >[1292870.637717] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1292870.637720] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1292870.637723] CR2: 00007f18bb7b4000 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1292870.637727] Call Trace: >[1292870.637729] <IRQ> >[1292870.637732] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1292870.637737] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1292870.637740] ? sched_slice+0x87/0x140 >[1292870.637746] ? timekeeping_update+0xdd/0x130 >[1292870.637757] ? timekeeping_advance+0x377/0x590 >[1292870.637762] ? update_process_times+0x74/0xb0 >[1292870.637765] ? tick_sched_handle+0x22/0x60 >[1292870.637770] ? tick_sched_timer+0x67/0x80 >[1292870.637773] ? __pfx_tick_sched_timer+0x10/0x10 >[1292870.637777] ? __hrtimer_run_queues+0x112/0x2b0 >[1292870.637780] ? hrtimer_interrupt+0xf8/0x230 >[1292870.637784] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1292870.637789] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1292870.637794] </IRQ> >[1292870.637795] <TASK> >[1292870.637797] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1292870.637803] ? __btrfs_submit_bio+0x59/0x140 >[1292870.637807] btrfs_submit_chunk+0x150/0x4c0 >[1292870.637811] btrfs_submit_bio+0x1a/0x30 >[1292870.637815] submit_one_bio+0x61/0x1b0 >[1292870.637819] btree_write_cache_pages+0x85e/0x8d0 >[1292870.637823] ? filemap_get_folios_tag+0x1c4/0x220 >[1292870.637829] ? __pfx_end_bio_extent_buffer_writepage+0x10/0x10 >[1292870.637834] do_writepages+0xd2/0x1e0 >[1292870.637839] ? merge_state.part.0+0x46/0x100 >[1292870.637843] filemap_fdatawrite_wbc+0x63/0x90 >[1292870.637847] __filemap_fdatawrite_range+0x5c/0x80 >[1292870.637856] btrfs_write_marked_extents+0x72/0x150 >[1292870.637863] btrfs_write_and_wait_transaction+0x70/0xf0 >[1292870.637867] btrfs_commit_transaction+0x8c4/0xf00 >[1292870.637871] ? start_transaction+0xc5/0x5c0 >[1292870.637875] transaction_kthread+0x141/0x1b0 >[1292870.637879] ? __pfx_transaction_kthread+0x10/0x10 >[1292870.637882] kthread+0xde/0x110 >[1292870.637885] ? __pfx_kthread+0x10/0x10 >[1292870.637888] ret_from_fork+0x2c/0x50 >[1292870.637894] </TASK> >[1292870.637908] CPU: 0 PID: 593 Comm: btrfs-transacti Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1292870.637913] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1292870.637915] RIP: 0010:__btrfs_submit_bio+0x59/0x140 >[1292870.637920] Code: 80 01 00 00 0f 85 93 00 00 00 45 8b 74 24 28 49 89 7c 24 18 45 85 f6 0f 8e a2 00 00 00 49 8d 6c 24 48 44 89 f0 45 31 ed eb 3f <48> c7 43 38 20 d7 6a 83 48 89 6b 40 48 8b 45 08 48 89 de 41 83 c5 >[1292870.637922] RSP: 0018:ffffb5d80099ba50 EFLAGS: 00010246 >[1292870.637925] RAX: 0000000000000001 RBX: ffff99a0c75180a8 RCX: 0000000000000000 >[1292870.637927] RDX: ffff99a1c5fca740 RSI: ffff99a1c7181220 RDI: ffff99a1c5fca740 >[1292870.637929] RBP: ffff99a1c5503d58 R08: ffff99a16330a7d0 R09: 0000000000000000 >[1292870.637931] R10: 000000000078013c R11: 0000000000000110 R12: ffff99a1c5503d00 >[1292870.637933] R13: 0000000000000001 R14: 0000000000000002 R15: ffff99a1c4e58d68 >[1292870.637935] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1292870.637937] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1292870.637939] CR2: 00007f18bb7b4000 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1292870.637942] Call Trace: >[1292870.637943] <IRQ> >[1292870.637945] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1292870.637949] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1292870.637952] ? sched_slice+0x87/0x140 >[1292870.637956] ? timekeeping_update+0xdd/0x130 >[1292870.637960] ? timekeeping_advance+0x377/0x590 >[1292870.637968] ? update_process_times+0x74/0xb0 >[1292870.637974] ? tick_sched_handle+0x22/0x60 >[1292870.637977] ? tick_sched_timer+0x67/0x80 >[1292870.637980] ? __pfx_tick_sched_timer+0x10/0x10 >[1292870.637984] ? __hrtimer_run_queues+0x112/0x2b0 >[1292870.637987] ? hrtimer_interrupt+0xf8/0x230 >[1292870.637991] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1292870.637994] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1292870.637998] </IRQ> >[1292870.637999] <TASK> >[1292870.638001] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1292870.638006] ? __btrfs_submit_bio+0x59/0x140 >[1292870.638010] btrfs_submit_chunk+0x150/0x4c0 >[1292870.638015] btrfs_submit_bio+0x1a/0x30 >[1292870.638019] submit_one_bio+0x61/0x1b0 >[1292870.638022] btree_write_cache_pages+0x85e/0x8d0 >[1292870.638026] ? filemap_get_folios_tag+0x1c4/0x220 >[1292870.638030] ? __pfx_end_bio_extent_buffer_writepage+0x10/0x10 >[1292870.638036] do_writepages+0xd2/0x1e0 >[1292870.638040] ? merge_state.part.0+0x46/0x100 >[1292870.638043] filemap_fdatawrite_wbc+0x63/0x90 >[1292870.638047] __filemap_fdatawrite_range+0x5c/0x80 >[1292870.638054] btrfs_write_marked_extents+0x72/0x150 >[1292870.638061] btrfs_write_and_wait_transaction+0x70/0xf0 >[1292870.638065] btrfs_commit_transaction+0x8c4/0xf00 >[1292870.638068] ? start_transaction+0xc5/0x5c0 >[1292870.638073] transaction_kthread+0x141/0x1b0 >[1292870.638076] ? __pfx_transaction_kthread+0x10/0x10 >[1292870.638079] kthread+0xde/0x110 >[1292870.638082] ? __pfx_kthread+0x10/0x10 >[1292870.638086] ret_from_fork+0x2c/0x50 >[1292870.638091] </TASK> >[1293050.848202] rcu: INFO: rcu_preempt self-detected stall on CPU >[1293050.848215] rcu: 0-...!: (2853 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277444/113277444 fqs=1 >[1293050.848223] rcu: (t=240248 jiffies g=128827733 q=1718 ncpus=1) >[1293050.848227] rcu: rcu_preempt kthread timer wakeup didn't happen for 168847 jiffies! g128827733 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1293050.848231] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940857 >[1293050.848234] rcu: rcu_preempt kthread starved for 168850 jiffies! g128827733 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1293050.848237] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1293050.848239] rcu: RCU grace-period kthread stack dump: >[1293050.848241] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1293050.848247] Call Trace: >[1293050.848250] <TASK> >[1293050.848257] __schedule+0x449/0x1480 >[1293050.848268] ? lock_timer_base+0x61/0x80 >[1293050.848277] schedule+0x5e/0xd0 >[1293050.848281] schedule_timeout+0x98/0x160 >[1293050.848285] ? __pfx_process_timeout+0x10/0x10 >[1293050.848289] rcu_gp_fqs_loop+0x141/0x520 >[1293050.848294] ? __note_gp_changes+0x153/0x1a0 >[1293050.848298] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1293050.848301] rcu_gp_kthread+0xea/0x1e0 >[1293050.848305] kthread+0xde/0x110 >[1293050.848310] ? __pfx_kthread+0x10/0x10 >[1293050.848314] ret_from_fork+0x2c/0x50 >[1293050.848321] </TASK> >[1293050.848323] rcu: Stack dump where RCU GP kthread last ran: >[1293050.848325] CPU: 0 PID: 2849664 Comm: rtkit-daemon Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293050.848330] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293050.848332] RIP: 0010:finish_task_switch.isra.0+0x96/0x2d0 >[1293050.848338] Code: 45 34 00 00 00 00 0f 1f 44 00 00 49 8b 9c 24 20 0a 00 00 48 85 db 0f 85 aa 00 00 00 4c 89 e7 e8 10 f6 ff ff fb 0f 1f 44 00 00 <65> 48 8b 04 25 80 32 03 00 66 90 4d 85 f6 74 21 65 48 8b 04 25 80 >[1293050.848342] RSP: 0018:ffffb5d8067bb860 EFLAGS: 00010282 >[1293050.848345] RAX: ffff99a10526a740 RBX: 0000000000000000 RCX: 0000000000000002 >[1293050.848348] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff99a21ac33ac0 >[1293050.848350] RBP: ffffb5d8067bb888 R08: 0000000000000000 R09: 0000000000000000 >[1293050.848352] R10: 0000000000000001 R11: 0000000000000030 R12: ffff99a21ac33ac0 >[1293050.848354] R13: ffff99a10526a740 R14: 0000000000000000 R15: 0000000000000000 >[1293050.848356] FS: 00007f70003fe6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293050.848359] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293050.848362] CR2: 00007f19c7576000 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1293050.848366] Call Trace: >[1293050.848368] <IRQ> >[1293050.848369] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1293050.848374] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1293050.848378] ? update_rt_rq_load_avg+0x23b/0x2b0 >[1293050.848383] ? timekeeping_update+0xdd/0x130 >[1293050.848389] ? timekeeping_advance+0x377/0x590 >[1293050.848393] ? update_process_times+0x74/0xb0 >[1293050.848397] ? tick_sched_handle+0x22/0x60 >[1293050.848402] ? tick_sched_timer+0x67/0x80 >[1293050.848405] ? __pfx_tick_sched_timer+0x10/0x10 >[1293050.848409] ? __hrtimer_run_queues+0x112/0x2b0 >[1293050.848413] ? hrtimer_interrupt+0xf8/0x230 >[1293050.848417] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293050.848456] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293050.848463] </IRQ> >[1293050.848465] <TASK> >[1293050.848467] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293050.848473] ? finish_task_switch.isra.0+0x96/0x2d0 >[1293050.848479] __schedule+0x451/0x1480 >[1293050.848483] ? psi_group_change+0x168/0x400 >[1293050.848487] ? timerqueue_add+0x66/0xb0 >[1293050.848492] schedule+0x5e/0xd0 >[1293050.848496] schedule_hrtimeout_range_clock+0xbe/0x130 >[1293050.848500] ? __pfx_hrtimer_wakeup+0x10/0x10 >[1293050.848504] do_sys_poll+0x500/0x600 >[1293050.848514] ? __pfx_pollwake+0x10/0x10 >[1293050.848519] ? __pfx_pollwake+0x10/0x10 >[1293050.848527] ? ktime_get_ts64+0x4a/0xe0 >[1293050.848531] __x64_sys_poll+0xbb/0x150 >[1293050.848535] do_syscall_64+0x5f/0x90 >[1293050.848541] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293050.848544] ? do_syscall_64+0x6b/0x90 >[1293050.848548] ? do_syscall_64+0x6b/0x90 >[1293050.848553] ? __irq_exit_rcu+0x4b/0xf0 >[1293050.848558] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1293050.848562] RIP: 0033:0x7f700187d21f >[1293052.104510] Code: 54 24 1c 48 89 74 24 10 48 89 7c 24 08 e8 b9 83 f8 ff 8b 54 24 1c 48 8b 74 24 10 41 89 c0 48 8b 7c 24 08 b8 07 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 31 44 89 c7 89 44 24 08 e8 0d 84 f8 ff 8b 44 >[1293052.104562] RSP: 002b:00007f70003fdda0 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 >[1293052.104569] RAX: ffffffffffffffda RBX: 431bde82d7b634db RCX: 00007f700187d21f >[1293052.104572] RDX: 0000000000002710 RSI: 0000000000000002 RDI: 00007f70003fde00 >[1293052.104574] RBP: 000000002a77f5ca R08: 0000000000000000 R09: 0000000000000000 >[1293052.104577] R10: 0000000000004000 R11: 0000000000000293 R12: 00007f70003fddf0 >[1293052.104579] R13: 000000000013bd9c R14: 000000004d1cac28 R15: 000000004d1cac28 >[1293052.104590] </TASK> >[1293053.908632] CPU: 0 PID: 2849664 Comm: rtkit-daemon Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293053.908978] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293054.383729] RIP: 0010:finish_task_switch.isra.0+0x96/0x2d0 >[1293054.383785] Code: 45 34 00 00 00 00 0f 1f 44 00 00 49 8b 9c 24 20 0a 00 00 48 85 db 0f 85 aa 00 00 00 4c 89 e7 e8 10 f6 ff ff fb 0f 1f 44 00 00 <65> 48 8b 04 25 80 32 03 00 66 90 4d 85 f6 74 21 65 48 8b 04 25 80 >[1293054.383789] RSP: 0018:ffffb5d8067bb860 EFLAGS: 00010282 >[1293054.383793] RAX: ffff99a10526a740 RBX: 0000000000000000 RCX: 0000000000000002 >[1293054.383796] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff99a21ac33ac0 >[1293054.383798] RBP: ffffb5d8067bb888 R08: 0000000000000000 R09: 0000000000000000 >[1293054.383844] R10: 0000000000000001 R11: 0000000000000030 R12: ffff99a21ac33ac0 >[1293054.383846] R13: ffff99a10526a740 R14: 0000000000000000 R15: 0000000000000000 >[1293054.383849] FS: 00007f70003fe6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293054.383852] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293054.383854] CR2: 00007f19c7576000 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1293054.383857] Call Trace: >[1293054.383861] <IRQ> >[1293054.383868] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1293054.383875] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1293054.383880] ? update_rt_rq_load_avg+0x23b/0x2b0 >[1293054.383884] ? timekeeping_update+0xdd/0x130 >[1293054.383892] ? timekeeping_advance+0x377/0x590 >[1293054.383896] ? update_process_times+0x74/0xb0 >[1293054.383900] ? tick_sched_handle+0x22/0x60 >[1293054.383905] ? tick_sched_timer+0x67/0x80 >[1293054.383908] ? __pfx_tick_sched_timer+0x10/0x10 >[1293054.383911] ? __hrtimer_run_queues+0x112/0x2b0 >[1293054.383915] ? hrtimer_interrupt+0xf8/0x230 >[1293054.383919] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293054.383924] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293054.383930] </IRQ> >[1293054.383932] <TASK> >[1293054.383934] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293054.383940] ? finish_task_switch.isra.0+0x96/0x2d0 >[1293054.383945] __schedule+0x451/0x1480 >[1293054.383950] ? psi_group_change+0x168/0x400 >[1293054.383954] ? timerqueue_add+0x66/0xb0 >[1293054.383958] schedule+0x5e/0xd0 >[1293054.383962] schedule_hrtimeout_range_clock+0xbe/0x130 >[1293054.383966] ? __pfx_hrtimer_wakeup+0x10/0x10 >[1293054.383970] do_sys_poll+0x500/0x600 >[1293054.383979] ? __pfx_pollwake+0x10/0x10 >[1293054.383983] ? __pfx_pollwake+0x10/0x10 >[1293054.383992] ? ktime_get_ts64+0x4a/0xe0 >[1293054.383995] __x64_sys_poll+0xbb/0x150 >[1293054.383998] do_syscall_64+0x5f/0x90 >[1293054.384010] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293054.384013] ? do_syscall_64+0x6b/0x90 >[1293054.384017] ? do_syscall_64+0x6b/0x90 >[1293054.384021] ? __irq_exit_rcu+0x4b/0xf0 >[1293054.384026] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1293054.384030] RIP: 0033:0x7f700187d21f >[1293055.731478] Code: 54 24 1c 48 89 74 24 10 48 89 7c 24 08 e8 b9 83 f8 ff 8b 54 24 1c 48 8b 74 24 10 41 89 c0 48 8b 7c 24 08 b8 07 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 31 44 89 c7 89 44 24 08 e8 0d 84 f8 ff 8b 44 >[1293055.731491] RSP: 002b:00007f70003fdda0 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 >[1293055.731497] RAX: ffffffffffffffda RBX: 431bde82d7b634db RCX: 00007f700187d21f >[1293055.731500] RDX: 0000000000002710 RSI: 0000000000000002 RDI: 00007f70003fde00 >[1293055.731502] RBP: 000000002a77f5ca R08: 0000000000000000 R09: 0000000000000000 >[1293055.731504] R10: 0000000000004000 R11: 0000000000000293 R12: 00007f70003fddf0 >[1293055.731507] R13: 000000000013bd9c R14: 000000004d1cac28 R15: 000000004d1cac28 >[1293055.731517] </TASK> >[1293093.286462] watchdog: BUG: soft lockup - CPU#0 stuck for 24s! [kworker/0:0H:1254698] >[1293093.286475] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1293093.286564] CPU: 0 PID: 1254698 Comm: kworker/0:0H Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293093.286570] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293093.286576] Workqueue: kblockd blk_mq_run_work_fn >[1293093.286586] RIP: 0010:_raw_spin_unlock_irqrestore+0x1d/0x40 >[1293093.286594] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 c6 07 00 0f 1f 00 f7 c6 00 02 00 00 74 06 fb 0f 1f 44 00 00 <65> ff 0d d4 17 08 7c 74 05 e9 85 1a 00 00 0f 1f 44 00 00 e9 7b 1a >[1293093.286598] RSP: 0018:ffffb5d8057dfc40 EFLAGS: 00010206 >[1293093.286603] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff99a1c0aec828 >[1293093.286606] RDX: ffff99a1c0af6040 RSI: 0000000000000293 RDI: ffff99a1c7069d80 >[1293093.286608] RBP: 0000000000000293 R08: 0000000000000001 R09: 0000000000001000 >[1293093.286610] R10: 00000000ace0afff R11: 0000000000000000 R12: ffff99a1c0af4000 >[1293093.286613] R13: ffff99a1c3d11000 R14: ffff99a1c0c97000 R15: 0000000000000000 >[1293093.286616] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293093.286619] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293093.286621] CR2: 00007f19c7576000 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1293093.286626] Call Trace: >[1293093.286630] <IRQ> >[1293093.286637] ? watchdog_timer_fn+0x1a8/0x210 >[1293093.286644] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1293093.286649] ? __hrtimer_run_queues+0x112/0x2b0 >[1293093.286654] ? hrtimer_interrupt+0xf8/0x230 >[1293093.286659] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293093.286663] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293093.286669] </IRQ> >[1293093.286670] <TASK> >[1293093.286672] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293093.286680] ? _raw_spin_unlock_irqrestore+0x1d/0x40 >[1293093.286685] ata_scsi_queuecmd+0x53/0x80 >[1293093.286691] scsi_queue_rq+0x389/0xc80 >[1293093.286697] blk_mq_dispatch_rq_list+0x2f6/0x880 >[1293093.286702] ? bfq_dispatch_request+0xf0/0x1230 >[1293093.286708] blk_mq_do_dispatch_sched+0x324/0x3c0 >[1293093.286714] __blk_mq_sched_dispatch_requests+0xec/0x130 >[1293093.286719] blk_mq_sched_dispatch_requests+0x34/0x60 >[1293093.286723] __blk_mq_run_hw_queue+0x70/0x90 >[1293093.286727] process_one_work+0x1c8/0x3c0 >[1293093.286733] worker_thread+0x51/0x390 >[1293093.286737] ? __pfx_worker_thread+0x10/0x10 >[1293093.286741] kthread+0xde/0x110 >[1293093.286745] ? __pfx_kthread+0x10/0x10 >[1293093.286749] ret_from_fork+0x2c/0x50 >[1293093.286757] </TASK> >[1293172.036740] watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [journal-offline:1299915] >[1293172.036754] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1293172.036837] CPU: 0 PID: 1299915 Comm: journal-offline Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293172.036841] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293172.036844] RIP: 0010:_raw_spin_unlock_irqrestore+0x1d/0x40 >[1293172.036855] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 c6 07 00 0f 1f 00 f7 c6 00 02 00 00 74 06 fb 0f 1f 44 00 00 <65> ff 0d d4 17 08 7c 74 05 e9 85 1a 00 00 0f 1f 44 00 00 e9 7b 1a >[1293172.036858] RSP: 0018:ffffb5d8062834a8 EFLAGS: 00010206 >[1293172.036862] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff99a1c0aec828 >[1293172.036864] RDX: ffff99a1c0af6040 RSI: 0000000000000293 RDI: ffff99a1c7069d80 >[1293172.036866] RBP: 0000000000000293 R08: 0000000000000001 R09: 0000000000001000 >[1293172.036868] R10: 00000000528ecfff R11: 0000000000000000 R12: ffff99a1c0af4000 >[1293172.036872] R13: ffff99a1c3d11000 R14: ffff99a1c0c97000 R15: 0000000000000000 >[1293172.036875] FS: 00007f1eb8ea56c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293172.036877] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293172.036880] CR2: 00007f1eb673f2a8 CR3: 000000010736e000 CR4: 00000000000106f0 >[1293172.036884] Call Trace: >[1293172.036888] <IRQ> >[1293172.036895] ? watchdog_timer_fn+0x1a8/0x210 >[1293172.036903] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1293172.036908] ? __hrtimer_run_queues+0x112/0x2b0 >[1293172.036913] ? hrtimer_interrupt+0xf8/0x230 >[1293172.036918] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293172.036923] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293172.036928] </IRQ> >[1293172.036929] <TASK> >[1293172.036931] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293172.036940] ? _raw_spin_unlock_irqrestore+0x1d/0x40 >[1293172.036945] ata_scsi_queuecmd+0x53/0x80 >[1293172.036951] scsi_queue_rq+0x389/0xc80 >[1293172.036957] blk_mq_dispatch_rq_list+0x2f6/0x880 >[1293172.036964] ? bfq_dispatch_request+0xf0/0x1230 >[1293172.036969] blk_mq_do_dispatch_sched+0x324/0x3c0 >[1293172.036974] ? read_block_for_search+0x1f7/0x340 >[1293172.036979] __blk_mq_sched_dispatch_requests+0xec/0x130 >[1293172.036983] blk_mq_sched_dispatch_requests+0x34/0x60 >[1293172.036986] __blk_mq_run_hw_queue+0x70/0x90 >[1293172.036990] blk_mq_sched_insert_requests+0x73/0x170 >[1293172.036995] blk_mq_flush_plug_list+0x137/0x300 >[1293172.037000] blk_add_rq_to_plug+0xa4/0x150 >[1293172.037003] blk_mq_submit_bio+0x370/0x5e0 >[1293172.037058] __submit_bio+0xf5/0x180 >[1293172.037063] submit_bio_noacct_nocheck+0x332/0x370 >[1293172.037069] __btrfs_submit_bio+0x89/0x140 >[1293172.037076] btrfs_submit_chunk+0x150/0x4c0 >[1293172.037081] btrfs_submit_bio+0x1a/0x30 >[1293172.037086] submit_one_bio+0x61/0x1b0 >[1293172.037091] submit_extent_page+0x13b/0x340 >[1293172.037095] ? rmap_walk_file+0x1c1/0x1d0 >[1293172.037100] ? __pfx_invalid_mkclean_vma+0x10/0x10 >[1293172.037107] __extent_writepage_io.constprop.0+0x243/0x540 >[1293172.037113] __extent_writepage+0x124/0x440 >[1293172.037117] extent_write_cache_pages+0x163/0x3f0 >[1293172.037123] extent_writepages+0x5e/0x120 >[1293172.037128] ? __pfx_end_bio_extent_writepage+0x10/0x10 >[1293172.037133] do_writepages+0xd2/0x1e0 >[1293172.037141] filemap_fdatawrite_wbc+0x63/0x90 >[1293172.037147] __filemap_fdatawrite_range+0x5c/0x80 >[1293172.037153] start_ordered_ops.constprop.0+0x73/0xd0 >[1293172.037160] btrfs_sync_file+0xc0/0x560 >[1293172.037164] ? __seccomp_filter+0x32a/0x4f0 >[1293172.037170] __x64_sys_fsync+0x3b/0x70 >[1293172.037176] do_syscall_64+0x5f/0x90 >[1293172.037182] ? exit_to_user_mode_prepare+0x142/0x1f0 >[1293172.037188] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1293172.037192] RIP: 0033:0x7f1eb9924c6a >[1293172.108572] Code: 00 00 0f 05 48 3d 00 f0 ff ff 77 44 c3 0f 1f 00 48 83 ec 18 89 7c 24 0c e8 63 59 f8 ff 8b 7c 24 0c 89 c2 b8 4a 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 36 89 d7 89 44 24 0c e8 c3 59 f8 ff 8b 44 24 >[1293172.108578] RSP: 002b:00007f1eb8ea4a40 EFLAGS: 00000293 ORIG_RAX: 000000000000004a >[1293172.108582] RAX: ffffffffffffffda RBX: 000055de71181cc0 RCX: 00007f1eb9924c6a >[1293172.108584] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000046 >[1293172.108587] RBP: 000055de711e7a20 R08: 0000000000000000 R09: 00007f1eb8ea56c0 >[1293172.108589] R10: 0000000000000105 R11: 0000000000000293 R12: 000055de7047b940 >[1293172.108591] R13: 0000000000000002 R14: 00007ffe8e053c30 R15: 00007f1eb86a5000 >[1293172.108598] </TASK> >[1293247.988455] rcu: INFO: rcu_preempt self-detected stall on CPU >[1293247.988472] rcu: 0-...!: (231 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277445/113277445 fqs=0 >[1293247.988480] rcu: (t=63747 jiffies g=128827737 q=1948 ncpus=1) >[1293247.988485] rcu: rcu_preempt kthread timer wakeup didn't happen for 63744 jiffies! g128827737 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1293247.988490] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940859 >[1293247.988492] rcu: rcu_preempt kthread starved for 63747 jiffies! g128827737 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1293247.988496] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1293247.988498] rcu: RCU grace-period kthread stack dump: >[1293247.988500] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1293247.988508] Call Trace: >[1293247.988512] <TASK> >[1293247.988522] __schedule+0x449/0x1480 >[1293247.988538] ? lock_timer_base+0x61/0x80 >[1293247.988548] schedule+0x5e/0xd0 >[1293247.988552] schedule_timeout+0x98/0x160 >[1293247.988559] ? __pfx_process_timeout+0x10/0x10 >[1293247.988563] rcu_gp_fqs_loop+0x141/0x520 >[1293247.988572] ? __note_gp_changes+0x153/0x1a0 >[1293247.988576] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1293247.988579] rcu_gp_kthread+0xea/0x1e0 >[1293247.988584] kthread+0xde/0x110 >[1293247.988592] ? __pfx_kthread+0x10/0x10 >[1293247.988596] ret_from_fork+0x2c/0x50 >[1293247.988605] </TASK> >[1293247.988607] rcu: Stack dump where RCU GP kthread last ran: >[1293247.988611] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293247.988616] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293247.988618] RIP: 0010:vbg_req_perform+0x2c/0x40 [vboxguest] >[1293247.988636] Code: 1f 00 0f 1f 44 00 00 b8 00 00 00 80 48 01 f0 72 21 48 c7 c2 00 00 00 80 48 2b 15 e7 3e 4f c4 48 01 d0 0f b7 57 08 ef 0f ae f0 <8b> 46 0c e9 fc 3f b0 c3 48 8b 15 c5 ca b7 c4 eb e4 0f 1f 00 90 90 >[1293247.988639] RSP: 0018:ffffb5d800083db0 EFLAGS: 00010207 >[1293247.988644] RAX: 0000000001114000 RBX: ffff99a1c3d66298 RCX: ffff99a21ac21e80 >[1293247.988647] RDX: 000000000000d040 RSI: ffff99a0c1114000 RDI: ffff99a1c3d66028 >[1293247.988650] RBP: ffff99a1c3d66298 R08: 000000000000002d R09: ffff99a21ac21ea8 >[1293247.988651] R10: 0000000000000005 R11: 0000000000000110 R12: ffffffffc04abd60 >[1293247.988654] R13: ffff99a1c3d66298 R14: ffffb5d800083e10 R15: ffff99a21ac21e80 >[1293247.988657] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293247.988660] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293247.988663] CR2: 00007f1eb673f2a8 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1293247.988668] Call Trace: >[1293247.988671] <IRQ> >[1293247.988673] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1293247.988680] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1293247.988684] ? sched_slice+0x87/0x140 >[1293247.988690] ? timekeeping_update+0xdd/0x130 >[1293247.988695] ? timekeeping_advance+0x377/0x590 >[1293247.988701] ? update_process_times+0x74/0xb0 >[1293247.988706] ? tick_sched_handle+0x22/0x60 >[1293247.988713] ? tick_sched_timer+0x67/0x80 >[1293247.988717] ? __pfx_tick_sched_timer+0x10/0x10 >[1293247.988722] ? __hrtimer_run_queues+0x112/0x2b0 >[1293247.988727] ? hrtimer_interrupt+0xf8/0x230 >[1293247.988732] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293247.988738] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293247.988745] </IRQ> >[1293247.988747] <TASK> >[1293247.988749] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293247.988756] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1293247.988769] ? vbg_req_perform+0x2c/0x40 [vboxguest] >[1293247.988779] vbg_heartbeat_timer+0x1d/0x40 [vboxguest] >[1293247.988787] call_timer_fn+0x27/0x130 >[1293247.988791] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1293247.988799] __run_timers+0x222/0x2c0 >[1293247.988805] run_timer_softirq+0x1d/0x40 >[1293247.988809] __do_softirq+0xd4/0x2c8 >[1293247.988815] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1293247.988820] run_ksoftirqd+0x2c/0x40 >[1293247.988827] smpboot_thread_fn+0xdc/0x1d0 >[1293247.988831] kthread+0xde/0x110 >[1293247.988835] ? __pfx_kthread+0x10/0x10 >[1293247.988840] ret_from_fork+0x2c/0x50 >[1293247.988847] </TASK> >[1293249.746666] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293249.746681] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293249.746685] RIP: 0010:vbg_req_perform+0x2c/0x40 [vboxguest] >[1293249.746700] Code: 1f 00 0f 1f 44 00 00 b8 00 00 00 80 48 01 f0 72 21 48 c7 c2 00 00 00 80 48 2b 15 e7 3e 4f c4 48 01 d0 0f b7 57 08 ef 0f ae f0 <8b> 46 0c e9 fc 3f b0 c3 48 8b 15 c5 ca b7 c4 eb e4 0f 1f 00 90 90 >[1293249.746704] RSP: 0018:ffffb5d800083db0 EFLAGS: 00010207 >[1293249.746708] RAX: 0000000001114000 RBX: ffff99a1c3d66298 RCX: ffff99a21ac21e80 >[1293249.746711] RDX: 000000000000d040 RSI: ffff99a0c1114000 RDI: ffff99a1c3d66028 >[1293249.746713] RBP: ffff99a1c3d66298 R08: 000000000000002d R09: ffff99a21ac21ea8 >[1293249.746716] R10: 0000000000000005 R11: 0000000000000110 R12: ffffffffc04abd60 >[1293249.746718] R13: ffff99a1c3d66298 R14: ffffb5d800083e10 R15: ffff99a21ac21e80 >[1293249.746721] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293249.746724] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293249.746726] CR2: 00007f1eb673f2a8 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1293249.746731] Call Trace: >[1293249.746735] <IRQ> >[1293249.746742] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1293249.746751] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1293249.746755] ? sched_slice+0x87/0x140 >[1293249.746780] ? timekeeping_update+0xdd/0x130 >[1293249.746786] ? timekeeping_advance+0x377/0x590 >[1293249.746790] ? update_process_times+0x74/0xb0 >[1293249.746794] ? tick_sched_handle+0x22/0x60 >[1293249.746799] ? tick_sched_timer+0x67/0x80 >[1293249.746802] ? __pfx_tick_sched_timer+0x10/0x10 >[1293249.746805] ? __hrtimer_run_queues+0x112/0x2b0 >[1293249.746809] ? hrtimer_interrupt+0xf8/0x230 >[1293249.746813] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293249.746818] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293249.746824] </IRQ> >[1293249.746826] <TASK> >[1293249.746827] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293249.746833] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1293249.746843] ? vbg_req_perform+0x2c/0x40 [vboxguest] >[1293249.746850] vbg_heartbeat_timer+0x1d/0x40 [vboxguest] >[1293249.746857] call_timer_fn+0x27/0x130 >[1293249.746861] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1293249.746868] __run_timers+0x222/0x2c0 >[1293249.746872] run_timer_softirq+0x1d/0x40 >[1293249.746875] __do_softirq+0xd4/0x2c8 >[1293249.746881] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1293249.746885] run_ksoftirqd+0x2c/0x40 >[1293249.746892] smpboot_thread_fn+0xdc/0x1d0 >[1293249.746895] kthread+0xde/0x110 >[1293249.746900] ? __pfx_kthread+0x10/0x10 >[1293249.746904] ret_from_fork+0x2c/0x50 >[1293249.746911] </TASK> >[1293332.658999] rcu: INFO: rcu_preempt self-detected stall on CPU >[1293332.659014] rcu: 0-...!: (527 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277446/113277446 fqs=0 >[1293332.659021] rcu: (t=60026 jiffies g=128827741 q=3425 ncpus=1) >[1293332.659024] rcu: rcu_preempt kthread timer wakeup didn't happen for 60023 jiffies! g128827741 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1293332.659028] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940859 >[1293332.659031] rcu: rcu_preempt kthread starved for 60026 jiffies! g128827741 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1293332.659034] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1293332.659035] rcu: RCU grace-period kthread stack dump: >[1293332.659037] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1293332.659043] Call Trace: >[1293332.659045] <TASK> >[1293332.659052] __schedule+0x449/0x1480 >[1293332.659065] ? lock_timer_base+0x61/0x80 >[1293332.659073] schedule+0x5e/0xd0 >[1293332.659077] schedule_timeout+0x98/0x160 >[1293332.659081] ? __pfx_process_timeout+0x10/0x10 >[1293332.659085] rcu_gp_fqs_loop+0x141/0x520 >[1293332.659109] ? __note_gp_changes+0x153/0x1a0 >[1293332.659114] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1293332.659116] rcu_gp_kthread+0xea/0x1e0 >[1293332.659120] kthread+0xde/0x110 >[1293332.659125] ? __pfx_kthread+0x10/0x10 >[1293332.659129] ret_from_fork+0x2c/0x50 >[1293332.659137] </TASK> >[1293332.659138] rcu: Stack dump where RCU GP kthread last ran: >[1293332.659142] CPU: 0 PID: 1299933 Comm: Indexed~ #14075 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293332.659147] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293332.659149] RIP: 0010:clear_page_rep+0xb/0x20 >[1293332.659154] Code: 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa b9 00 02 00 00 31 c0 <f3> 48 ab e9 4d 41 02 00 66 66 2e 0f 1f 84 00 00 00 00 00 66 90 90 >[1293332.659157] RSP: 0000:ffffb5d8062f3bd8 EFLAGS: 00010246 >[1293332.659161] RAX: 0000000000000000 RBX: ffffe06280c93780 RCX: 0000000000000200 >[1293332.659164] RDX: ffffe06280c93780 RSI: ffffe06280c937c0 RDI: ffff99a0f24de000 >[1293332.659166] RBP: 0000000000000040 R08: 0000000000001000 R09: 00000000000ff000 >[1293332.659168] R10: 0000000000000000 R11: 0000000000000981 R12: 0000000000000000 >[1293332.659170] R13: 0000000000140dca R14: 0000000000000000 R15: 0000000000000001 >[1293332.659173] FS: 00007f43b2af96c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293332.659176] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293332.659178] CR2: 00007f43b2aedf78 CR3: 00000000484d6000 CR4: 00000000000106f0 >[1293332.659183] Call Trace: >[1293332.659185] <IRQ> >[1293332.659187] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1293332.659192] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1293332.659196] ? sched_slice+0x87/0x140 >[1293332.659200] ? timekeeping_update+0xdd/0x130 >[1293332.659204] ? timekeeping_advance+0x377/0x590 >[1293332.659209] ? update_process_times+0x74/0xb0 >[1293332.659212] ? tick_sched_handle+0x22/0x60 >[1293332.659216] ? tick_sched_timer+0x67/0x80 >[1293332.659219] ? __pfx_tick_sched_timer+0x10/0x10 >[1293332.659222] ? __hrtimer_run_queues+0x112/0x2b0 >[1293332.659226] ? hrtimer_interrupt+0xf8/0x230 >[1293332.659231] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293332.659237] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293332.659241] </IRQ> >[1293332.659243] <TASK> >[1293332.659244] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293332.659251] ? clear_page_rep+0xb/0x20 >[1293332.659254] post_alloc_hook+0x102/0x160 >[1293332.659320] get_page_from_freelist+0x775/0x1960 >[1293332.659325] ? update_load_avg+0x7e/0x780 >[1293332.659330] __alloc_pages+0xf8/0x250 >[1293332.659334] __folio_alloc+0x1b/0x50 >[1293332.659338] ? policy_node+0x51/0x70 >[1293332.659342] vma_alloc_folio+0xa0/0x390 >[1293332.659348] __handle_mm_fault+0x9d4/0xf90 >[1293332.659352] ? __rseq_handle_notify_resume+0xa5/0x4e0 >[1293332.659359] handle_mm_fault+0x11e/0x310 >[1293332.659362] do_user_addr_fault+0x195/0x600 >[1293332.659369] exc_page_fault+0x74/0x170 >[1293332.659373] asm_exc_page_fault+0x26/0x30 >[1293332.659378] RIP: 0033:0x7f43f55918dd >[1293332.659510] Code: 01 00 00 4c 8b 7f 10 64 48 8b 04 25 28 00 00 00 48 89 84 24 48 01 00 00 31 c0 48 8d 05 cc 48 00 00 66 48 0f 6e c0 66 0f 6c c1 <c7> 84 24 a8 00 00 00 00 00 00 00 c7 84 24 ac 00 00 00 00 00 00 00 >[1293332.659514] RSP: 002b:00007f43b2aeded0 EFLAGS: 00010246 >[1293332.659517] RAX: 00007f43f55961a0 RBX: 00007f43b2aef1a0 RCX: 0000000000000000 >[1293332.659519] RDX: 00007f43f55c5690 RSI: 00007f435b2f48d0 RDI: 00007f43b2aef1a0 >[1293332.659521] RBP: 00007f435b2f48d0 R08: 0000000000000000 R09: 0000000000000001 >[1293332.659523] R10: 00007f435b2f4050 R11: 0000000000000000 R12: 0000000000000001 >[1293332.659525] R13: 00007f43b2aef1a0 R14: 00007f435b2ee910 R15: 00007f435b2ee910 >[1293332.659529] </TASK> >[1293332.659629] CPU: 0 PID: 1299933 Comm: Indexed~ #14075 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293332.659635] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293332.659637] RIP: 0010:clear_page_rep+0xb/0x20 >[1293332.659642] Code: 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa b9 00 02 00 00 31 c0 <f3> 48 ab e9 4d 41 02 00 66 66 2e 0f 1f 84 00 00 00 00 00 66 90 90 >[1293332.659645] RSP: 0000:ffffb5d8062f3bd8 EFLAGS: 00010246 >[1293332.659648] RAX: 0000000000000000 RBX: ffffe06280c93780 RCX: 0000000000000200 >[1293332.659651] RDX: ffffe06280c93780 RSI: ffffe06280c937c0 RDI: ffff99a0f24de000 >[1293332.659654] RBP: 0000000000000040 R08: 0000000000001000 R09: 00000000000ff000 >[1293332.659656] R10: 0000000000000000 R11: 0000000000000981 R12: 0000000000000000 >[1293332.659657] R13: 0000000000140dca R14: 0000000000000000 R15: 0000000000000001 >[1293332.659660] FS: 00007f43b2af96c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293332.659662] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293332.659664] CR2: 00007f43b2aedf78 CR3: 00000000484d6000 CR4: 00000000000106f0 >[1293332.659668] Call Trace: >[1293332.659670] <IRQ> >[1293332.659673] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1293332.659677] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1293332.659680] ? sched_slice+0x87/0x140 >[1293332.659684] ? timekeeping_update+0xdd/0x130 >[1293332.659689] ? timekeeping_advance+0x377/0x590 >[1293332.659693] ? update_process_times+0x74/0xb0 >[1293332.659697] ? tick_sched_handle+0x22/0x60 >[1293332.659700] ? tick_sched_timer+0x67/0x80 >[1293332.659704] ? __pfx_tick_sched_timer+0x10/0x10 >[1293332.659707] ? __hrtimer_run_queues+0x112/0x2b0 >[1293332.659711] ? hrtimer_interrupt+0xf8/0x230 >[1293332.659715] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293332.659718] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293332.659722] </IRQ> >[1293332.659723] <TASK> >[1293332.659725] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293332.659730] ? clear_page_rep+0xb/0x20 >[1293332.659733] post_alloc_hook+0x102/0x160 >[1293332.659737] get_page_from_freelist+0x775/0x1960 >[1293332.659743] ? update_load_avg+0x7e/0x780 >[1293332.659747] __alloc_pages+0xf8/0x250 >[1293332.659752] __folio_alloc+0x1b/0x50 >[1293332.659756] ? policy_node+0x51/0x70 >[1293332.659760] vma_alloc_folio+0xa0/0x390 >[1293332.659765] __handle_mm_fault+0x9d4/0xf90 >[1293332.659768] ? __rseq_handle_notify_resume+0xa5/0x4e0 >[1293332.659774] handle_mm_fault+0x11e/0x310 >[1293332.659778] do_user_addr_fault+0x195/0x600 >[1293332.659783] exc_page_fault+0x74/0x170 >[1293332.659788] asm_exc_page_fault+0x26/0x30 >[1293332.659791] RIP: 0033:0x7f43f55918dd >[1293332.659797] Code: 01 00 00 4c 8b 7f 10 64 48 8b 04 25 28 00 00 00 48 89 84 24 48 01 00 00 31 c0 48 8d 05 cc 48 00 00 66 48 0f 6e c0 66 0f 6c c1 <c7> 84 24 a8 00 00 00 00 00 00 00 c7 84 24 ac 00 00 00 00 00 00 00 >[1293332.659801] RSP: 002b:00007f43b2aeded0 EFLAGS: 00010246 >[1293332.659804] RAX: 00007f43f55961a0 RBX: 00007f43b2aef1a0 RCX: 0000000000000000 >[1293332.659806] RDX: 00007f43f55c5690 RSI: 00007f435b2f48d0 RDI: 00007f43b2aef1a0 >[1293332.659808] RBP: 00007f435b2f48d0 R08: 0000000000000000 R09: 0000000000000001 >[1293332.659810] R10: 00007f435b2f4050 R11: 0000000000000000 R12: 0000000000000001 >[1293332.659811] R13: 00007f43b2aef1a0 R14: 00007f435b2ee910 R15: 00007f435b2ee910 >[1293332.659815] </TASK> >[1293473.179851] rcu: INFO: rcu_preempt self-detected stall on CPU >[1293473.179863] rcu: 0-...!: (324 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277447/113277447 fqs=0 >[1293473.179870] rcu: (t=60346 jiffies g=128827745 q=3618 ncpus=1) >[1293473.179874] rcu: rcu_preempt kthread timer wakeup didn't happen for 60343 jiffies! g128827745 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1293473.179878] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940861 >[1293473.179881] rcu: rcu_preempt kthread starved for 60346 jiffies! g128827745 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1293473.179884] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1293473.179886] rcu: RCU grace-period kthread stack dump: >[1293473.179888] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1293473.179895] Call Trace: >[1293473.179898] <TASK> >[1293473.179905] __schedule+0x449/0x1480 >[1293473.179935] ? lock_timer_base+0x61/0x80 >[1293473.179944] schedule+0x5e/0xd0 >[1293473.179948] schedule_timeout+0x98/0x160 >[1293473.179952] ? __pfx_process_timeout+0x10/0x10 >[1293473.179956] rcu_gp_fqs_loop+0x141/0x520 >[1293473.179962] ? __note_gp_changes+0x153/0x1a0 >[1293473.179965] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1293473.179968] rcu_gp_kthread+0xea/0x1e0 >[1293473.179971] kthread+0xde/0x110 >[1293473.179976] ? __pfx_kthread+0x10/0x10 >[1293473.179980] ret_from_fork+0x2c/0x50 >[1293473.179987] </TASK> >[1293473.179989] rcu: Stack dump where RCU GP kthread last ran: >[1293473.179992] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293473.179996] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293473.179998] RIP: 0010:vbg_req_perform+0x2c/0x40 [vboxguest] >[1293473.180010] Code: 1f 00 0f 1f 44 00 00 b8 00 00 00 80 48 01 f0 72 21 48 c7 c2 00 00 00 80 48 2b 15 e7 3e 4f c4 48 01 d0 0f b7 57 08 ef 0f ae f0 <8b> 46 0c e9 fc 3f b0 c3 48 8b 15 c5 ca b7 c4 eb e4 0f 1f 00 90 90 >[1293473.180013] RSP: 0018:ffffb5d800083db0 EFLAGS: 00010207 >[1293473.180017] RAX: 0000000001114000 RBX: ffff99a1c3d66298 RCX: 0000000000000100 >[1293473.180019] RDX: 000000000000d040 RSI: ffff99a0c1114000 RDI: ffff99a1c3d66028 >[1293473.180022] RBP: ffff99a1c3d66298 R08: ffffffff8499d260 R09: ffff99a21ac21ea8 >[1293473.180024] R10: 0000000000000003 R11: 0000000000000110 R12: ffffffffc04abd60 >[1293473.180026] R13: ffff99a1c3d66298 R14: ffffb5d800083e10 R15: ffff99a21ac21e80 >[1293473.180028] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293473.180031] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293473.180033] CR2: 00007f435aef9000 CR3: 00000000455c2000 CR4: 00000000000106f0 >[1293473.180037] Call Trace: >[1293473.180039] <IRQ> >[1293473.180041] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1293473.180046] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1293473.180049] ? sched_slice+0x87/0x140 >[1293473.180054] ? timekeeping_update+0xdd/0x130 >[1293473.180059] ? timekeeping_advance+0x377/0x590 >[1293473.180063] ? update_process_times+0x74/0xb0 >[1293473.180066] ? tick_sched_handle+0x22/0x60 >[1293473.180071] ? tick_sched_timer+0x67/0x80 >[1293473.180074] ? __pfx_tick_sched_timer+0x10/0x10 >[1293473.180078] ? __hrtimer_run_queues+0x112/0x2b0 >[1293473.180082] ? hrtimer_interrupt+0xf8/0x230 >[1293473.180086] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293473.180091] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293473.180096] </IRQ> >[1293473.180097] <TASK> >[1293473.180099] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293473.180105] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1293473.180115] ? vbg_req_perform+0x2c/0x40 [vboxguest] >[1293473.180122] vbg_heartbeat_timer+0x1d/0x40 [vboxguest] >[1293473.180129] call_timer_fn+0x27/0x130 >[1293473.180132] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1293473.180139] __run_timers+0x222/0x2c0 >[1293473.180144] run_timer_softirq+0x1d/0x40 >[1293473.180146] __do_softirq+0xd4/0x2c8 >[1293473.180152] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1293473.180155] run_ksoftirqd+0x2c/0x40 >[1293473.180161] smpboot_thread_fn+0xdc/0x1d0 >[1293473.180164] kthread+0xde/0x110 >[1293473.180167] ? __pfx_kthread+0x10/0x10 >[1293473.180171] ret_from_fork+0x2c/0x50 >[1293473.180176] </TASK> >[1293473.180188] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293473.180191] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293473.180193] RIP: 0010:vbg_req_perform+0x2c/0x40 [vboxguest] >[1293473.180200] Code: 1f 00 0f 1f 44 00 00 b8 00 00 00 80 48 01 f0 72 21 48 c7 c2 00 00 00 80 48 2b 15 e7 3e 4f c4 48 01 d0 0f b7 57 08 ef 0f ae f0 <8b> 46 0c e9 fc 3f b0 c3 48 8b 15 c5 ca b7 c4 eb e4 0f 1f 00 90 90 >[1293473.180204] RSP: 0018:ffffb5d800083db0 EFLAGS: 00010207 >[1293473.180206] RAX: 0000000001114000 RBX: ffff99a1c3d66298 RCX: 0000000000000100 >[1293473.180208] RDX: 000000000000d040 RSI: ffff99a0c1114000 RDI: ffff99a1c3d66028 >[1293473.180210] RBP: ffff99a1c3d66298 R08: ffffffff8499d260 R09: ffff99a21ac21ea8 >[1293473.180212] R10: 0000000000000003 R11: 0000000000000110 R12: ffffffffc04abd60 >[1293473.180214] R13: ffff99a1c3d66298 R14: ffffb5d800083e10 R15: ffff99a21ac21e80 >[1293473.180216] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293473.180219] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293473.180221] CR2: 00007f435aef9000 CR3: 00000000455c2000 CR4: 00000000000106f0 >[1293473.180223] Call Trace: >[1293473.180225] <IRQ> >[1293473.180226] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1293473.180230] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1293473.180234] ? sched_slice+0x87/0x140 >[1293473.180237] ? timekeeping_update+0xdd/0x130 >[1293473.180241] ? timekeeping_advance+0x377/0x590 >[1293473.180245] ? update_process_times+0x74/0xb0 >[1293473.180249] ? tick_sched_handle+0x22/0x60 >[1293473.180252] ? tick_sched_timer+0x67/0x80 >[1293473.180255] ? __pfx_tick_sched_timer+0x10/0x10 >[1293473.180259] ? __hrtimer_run_queues+0x112/0x2b0 >[1293473.180263] ? hrtimer_interrupt+0xf8/0x230 >[1293473.180267] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293473.180270] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293473.180274] </IRQ> >[1293473.180275] <TASK> >[1293473.180276] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293473.180280] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1293473.180288] ? vbg_req_perform+0x2c/0x40 [vboxguest] >[1293473.180295] vbg_heartbeat_timer+0x1d/0x40 [vboxguest] >[1293473.180301] call_timer_fn+0x27/0x130 >[1293473.180305] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1293473.180311] __run_timers+0x222/0x2c0 >[1293473.180315] run_timer_softirq+0x1d/0x40 >[1293473.180318] __do_softirq+0xd4/0x2c8 >[1293473.180323] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1293473.180325] run_ksoftirqd+0x2c/0x40 >[1293473.180329] smpboot_thread_fn+0xdc/0x1d0 >[1293473.180332] kthread+0xde/0x110 >[1293473.180335] ? __pfx_kthread+0x10/0x10 >[1293473.180400] ret_from_fork+0x2c/0x50 >[1293473.180407] </TASK> >[1293499.685887] watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [ksoftirqd/0:15] >[1293499.685901] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1293499.685982] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293499.685986] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293499.685990] RIP: 0010:vbg_req_perform+0x2c/0x40 [vboxguest] >[1293499.686002] Code: 1f 00 0f 1f 44 00 00 b8 00 00 00 80 48 01 f0 72 21 48 c7 c2 00 00 00 80 48 2b 15 e7 3e 4f c4 48 01 d0 0f b7 57 08 ef 0f ae f0 <8b> 46 0c e9 fc 3f b0 c3 48 8b 15 c5 ca b7 c4 eb e4 0f 1f 00 90 90 >[1293499.686006] RSP: 0018:ffffb5d800083db0 EFLAGS: 00010207 >[1293499.686009] RAX: 0000000001114000 RBX: ffff99a1c3d66298 RCX: 0000000000000000 >[1293499.686012] RDX: 000000000000d040 RSI: ffff99a0c1114000 RDI: ffff99a1c3d66028 >[1293499.686014] RBP: ffff99a1c3d66298 R08: ffff99a21ac33468 R09: ffffffff8505d6e0 >[1293499.686017] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffc04abd60 >[1293499.686019] R13: ffff99a1c3d66298 R14: ffffb5d800083e10 R15: ffff99a21ac21e80 >[1293499.686021] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293499.686024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293499.686027] CR2: 00007f435aef9000 CR3: 00000000455c2000 CR4: 00000000000106f0 >[1293499.686030] Call Trace: >[1293499.686034] <IRQ> >[1293499.686040] ? watchdog_timer_fn+0x1a8/0x210 >[1293499.686048] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1293499.686052] ? __hrtimer_run_queues+0x112/0x2b0 >[1293499.686058] ? hrtimer_interrupt+0xf8/0x230 >[1293499.686062] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293499.686067] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293499.686075] </IRQ> >[1293499.686077] <TASK> >[1293499.686079] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293499.686085] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1293499.686095] ? vbg_req_perform+0x2c/0x40 [vboxguest] >[1293499.686103] vbg_heartbeat_timer+0x1d/0x40 [vboxguest] >[1293499.686110] call_timer_fn+0x27/0x130 >[1293499.686115] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1293499.686122] __run_timers+0x222/0x2c0 >[1293499.686126] run_timer_softirq+0x1d/0x40 >[1293499.686129] __do_softirq+0xd4/0x2c8 >[1293499.686136] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1293499.686140] run_ksoftirqd+0x2c/0x40 >[1293499.686145] smpboot_thread_fn+0xdc/0x1d0 >[1293499.686149] kthread+0xde/0x110 >[1293499.686153] ? __pfx_kthread+0x10/0x10 >[1293499.686157] ret_from_fork+0x2c/0x50 >[1293499.686165] </TASK> >[1293565.552647] rcu: INFO: rcu_preempt self-detected stall on CPU >[1293565.552660] rcu: 0-...!: (437 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277448/113277448 fqs=0 >[1293565.552667] rcu: (t=61675 jiffies g=128827749 q=3729 ncpus=1) >[1293565.552670] rcu: rcu_preempt kthread timer wakeup didn't happen for 61672 jiffies! g128827749 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1293565.552674] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940861 >[1293565.552677] rcu: rcu_preempt kthread starved for 61675 jiffies! g128827749 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1293565.552680] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1293565.552682] rcu: RCU grace-period kthread stack dump: >[1293565.552684] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1293565.552691] Call Trace: >[1293565.552694] <TASK> >[1293565.552701] __schedule+0x449/0x1480 >[1293565.552714] ? lock_timer_base+0x61/0x80 >[1293565.552721] schedule+0x5e/0xd0 >[1293565.552725] schedule_timeout+0x98/0x160 >[1293565.552753] ? __pfx_process_timeout+0x10/0x10 >[1293565.552758] rcu_gp_fqs_loop+0x141/0x520 >[1293565.552764] ? __note_gp_changes+0x153/0x1a0 >[1293565.552768] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1293565.552770] rcu_gp_kthread+0xea/0x1e0 >[1293565.552773] kthread+0xde/0x110 >[1293565.552778] ? __pfx_kthread+0x10/0x10 >[1293565.552782] ret_from_fork+0x2c/0x50 >[1293565.552789] </TASK> >[1293565.552792] rcu: Stack dump where RCU GP kthread last ran: >[1293565.552794] CPU: 0 PID: 2849664 Comm: rtkit-daemon Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293565.552799] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293565.552802] RIP: 0010:finish_task_switch.isra.0+0x96/0x2d0 >[1293565.552808] Code: 45 34 00 00 00 00 0f 1f 44 00 00 49 8b 9c 24 20 0a 00 00 48 85 db 0f 85 aa 00 00 00 4c 89 e7 e8 10 f6 ff ff fb 0f 1f 44 00 00 <65> 48 8b 04 25 80 32 03 00 66 90 4d 85 f6 74 21 65 48 8b 04 25 80 >[1293565.552811] RSP: 0018:ffffb5d8067bb8a0 EFLAGS: 00010282 >[1293565.552814] RAX: ffff99a1cac7a740 RBX: 0000000000000000 RCX: 0000000000000002 >[1293565.552816] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff99a21ac33ac0 >[1293565.552818] RBP: ffffb5d8067bb8c8 R08: 0000000000000000 R09: 0000000000000000 >[1293565.552820] R10: 0000000000000001 R11: 0000000000000030 R12: ffff99a21ac33ac0 >[1293565.552822] R13: ffff99a1cac7a740 R14: 0000000000000000 R15: 0000000000000000 >[1293565.552849] FS: 00007f70003fe6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293565.552853] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293565.552855] CR2: 00007f435aef9000 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1293565.552859] Call Trace: >[1293565.552861] <IRQ> >[1293565.552864] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1293565.552871] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1293565.552876] ? sched_slice+0x87/0x140 >[1293565.552880] ? timekeeping_update+0xdd/0x130 >[1293565.552884] ? timekeeping_advance+0x377/0x590 >[1293565.552889] ? update_process_times+0x74/0xb0 >[1293565.552892] ? tick_sched_handle+0x22/0x60 >[1293565.552897] ? tick_sched_timer+0x67/0x80 >[1293565.552899] ? __pfx_tick_sched_timer+0x10/0x10 >[1293565.552904] ? __hrtimer_run_queues+0x112/0x2b0 >[1293565.552908] ? hrtimer_interrupt+0xf8/0x230 >[1293565.552913] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293565.552919] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293565.552924] </IRQ> >[1293565.552925] <TASK> >[1293565.552927] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293565.552934] ? finish_task_switch.isra.0+0x96/0x2d0 >[1293565.552940] __schedule+0x451/0x1480 >[1293565.552944] ? psi_task_switch+0xd6/0x230 >[1293565.552948] ? finish_task_switch.isra.0+0x90/0x2d0 >[1293565.552952] ? timerqueue_add+0x66/0xb0 >[1293565.552957] schedule+0x5e/0xd0 >[1293565.552960] schedule_hrtimeout_range_clock+0xbe/0x130 >[1293565.552964] ? __pfx_hrtimer_wakeup+0x10/0x10 >[1293565.552968] do_sys_poll+0x500/0x600 >[1293565.552978] ? __pfx_pollwake+0x10/0x10 >[1293565.552983] ? __pfx_pollwake+0x10/0x10 >[1293565.552991] ? ktime_get_ts64+0x4a/0xe0 >[1293565.552995] __x64_sys_poll+0xbb/0x150 >[1293565.552999] do_syscall_64+0x5f/0x90 >[1293565.553005] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293565.553008] ? do_syscall_64+0x6b/0x90 >[1293565.553011] ? __irq_exit_rcu+0x4b/0xf0 >[1293565.553016] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1293565.553020] RIP: 0033:0x7f700187d21f >[1293565.553230] Code: 54 24 1c 48 89 74 24 10 48 89 7c 24 08 e8 b9 83 f8 ff 8b 54 24 1c 48 8b 74 24 10 41 89 c0 48 8b 7c 24 08 b8 07 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 31 44 89 c7 89 44 24 08 e8 0d 84 f8 ff 8b 44 >[1293565.553236] RSP: 002b:00007f70003fdda0 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 >[1293565.553240] RAX: ffffffffffffffda RBX: 431bde82d7b634db RCX: 00007f700187d21f >[1293565.553242] RDX: 0000000000002710 RSI: 0000000000000002 RDI: 00007f70003fde00 >[1293565.553244] RBP: 000000000af394de R08: 0000000000000000 R09: 0000000000000000 >[1293565.553245] R10: 0000000000004000 R11: 0000000000000293 R12: 00007f70003fddf0 >[1293565.553247] R13: 000000000013bfa1 R14: 000000004d248d9f R15: 000000004d248d9f >[1293565.553253] </TASK> >[1293565.553325] CPU: 0 PID: 2849664 Comm: rtkit-daemon Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293565.553330] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293565.553332] RIP: 0010:finish_task_switch.isra.0+0x96/0x2d0 >[1293565.553338] Code: 45 34 00 00 00 00 0f 1f 44 00 00 49 8b 9c 24 20 0a 00 00 48 85 db 0f 85 aa 00 00 00 4c 89 e7 e8 10 f6 ff ff fb 0f 1f 44 00 00 <65> 48 8b 04 25 80 32 03 00 66 90 4d 85 f6 74 21 65 48 8b 04 25 80 >[1293565.553341] RSP: 0018:ffffb5d8067bb8a0 EFLAGS: 00010282 >[1293565.553345] RAX: ffff99a1cac7a740 RBX: 0000000000000000 RCX: 0000000000000002 >[1293565.553348] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff99a21ac33ac0 >[1293565.553351] RBP: ffffb5d8067bb8c8 R08: 0000000000000000 R09: 0000000000000000 >[1293565.553352] R10: 0000000000000001 R11: 0000000000000030 R12: ffff99a21ac33ac0 >[1293565.553354] R13: ffff99a1cac7a740 R14: 0000000000000000 R15: 0000000000000000 >[1293565.553357] FS: 00007f70003fe6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293565.553359] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293565.553442] CR2: 00007f435aef9000 CR3: 000000002ef94000 CR4: 00000000000106f0 >[1293565.553447] Call Trace: >[1293565.553449] <IRQ> >[1293565.553452] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1293565.553457] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1293565.553460] ? sched_slice+0x87/0x140 >[1293565.553464] ? timekeeping_update+0xdd/0x130 >[1293565.553468] ? timekeeping_advance+0x377/0x590 >[1293565.553473] ? update_process_times+0x74/0xb0 >[1293565.553476] ? tick_sched_handle+0x22/0x60 >[1293565.553479] ? tick_sched_timer+0x67/0x80 >[1293565.553483] ? __pfx_tick_sched_timer+0x10/0x10 >[1293565.553486] ? __hrtimer_run_queues+0x112/0x2b0 >[1293565.553491] ? hrtimer_interrupt+0xf8/0x230 >[1293565.553495] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293565.553498] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293565.553503] </IRQ> >[1293565.553505] <TASK> >[1293565.553507] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293565.553512] ? finish_task_switch.isra.0+0x96/0x2d0 >[1293565.553517] __schedule+0x451/0x1480 >[1293565.553521] ? psi_task_switch+0xd6/0x230 >[1293565.553525] ? finish_task_switch.isra.0+0x90/0x2d0 >[1293565.553529] ? timerqueue_add+0x66/0xb0 >[1293565.553533] schedule+0x5e/0xd0 >[1293565.553536] schedule_hrtimeout_range_clock+0xbe/0x130 >[1293565.553541] ? __pfx_hrtimer_wakeup+0x10/0x10 >[1293565.553544] do_sys_poll+0x500/0x600 >[1293565.553552] ? __pfx_pollwake+0x10/0x10 >[1293565.553556] ? __pfx_pollwake+0x10/0x10 >[1293565.553565] ? ktime_get_ts64+0x4a/0xe0 >[1293565.553569] __x64_sys_poll+0xbb/0x150 >[1293565.553572] do_syscall_64+0x5f/0x90 >[1293565.553578] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293565.553581] ? do_syscall_64+0x6b/0x90 >[1293565.553585] ? __irq_exit_rcu+0x4b/0xf0 >[1293565.553589] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1293565.553593] RIP: 0033:0x7f700187d21f >[1293565.553603] Code: 54 24 1c 48 89 74 24 10 48 89 7c 24 08 e8 b9 83 f8 ff 8b 54 24 1c 48 8b 74 24 10 41 89 c0 48 8b 7c 24 08 b8 07 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 31 44 89 c7 89 44 24 08 e8 0d 84 f8 ff 8b 44 >[1293565.553606] RSP: 002b:00007f70003fdda0 EFLAGS: 00000293 ORIG_RAX: 0000000000000007 >[1293565.553609] RAX: ffffffffffffffda RBX: 431bde82d7b634db RCX: 00007f700187d21f >[1293565.553612] RDX: 0000000000002710 RSI: 0000000000000002 RDI: 00007f70003fde00 >[1293565.553614] RBP: 000000000af394de R08: 0000000000000000 R09: 0000000000000000 >[1293565.553615] R10: 0000000000004000 R11: 0000000000000293 R12: 00007f70003fddf0 >[1293565.553619] R13: 000000000013bfa1 R14: 000000004d248d9f R15: 000000004d248d9f >[1293565.553623] </TASK> >[1293655.659541] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [f2b/observer:2353] >[1293655.659571] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1293655.659650] CPU: 0 PID: 2353 Comm: f2b/observer Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293655.659654] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293655.659657] RIP: 0010:avtab_search_node+0xbc/0x130 >[1293655.659667] Code: 31 c8 69 c0 6b ca eb 85 41 89 c1 41 c1 e9 0d 44 31 c8 69 c0 35 ae b2 c2 41 89 c1 41 c1 e9 10 44 31 c8 23 42 10 48 8b 12 48 98 <48> 8b 04 c2 48 85 c0 74 35 41 0f b7 50 06 66 81 e2 ff 7f 41 89 d0 >[1293655.659672] RSP: 0018:ffffb5d803ae3910 EFLAGS: 00010206 >[1293655.659676] RAX: 0000000000002b9f RBX: ffff99a1cd570b88 RCX: 0000000000000973 >[1293655.659678] RDX: ffff99a0e2540000 RSI: 0000000000000859 RDI: 0000000000000007 >[1293655.659680] RBP: ffffb5d803ae39a8 R08: ffffb5d803ae39a8 R09: 0000000000008ed9 >[1293655.659683] R10: ffff99a212510000 R11: 0000000000000002 R12: ffffb5d803ae3a90 >[1293655.659685] R13: ffffb5d803ae3b14 R14: 0000000000000858 R15: 0000000000000973 >[1293655.659688] FS: 00007f3200ee46c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293655.659691] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293655.659693] CR2: 00007f43b2d3ac48 CR3: 0000000122ee4000 CR4: 00000000000106f0 >[1293655.659698] Call Trace: >[1293655.659702] <IRQ> >[1293655.659709] ? watchdog_timer_fn+0x1a8/0x210 >[1293655.659716] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1293655.659720] ? __hrtimer_run_queues+0x112/0x2b0 >[1293655.659725] ? hrtimer_interrupt+0xf8/0x230 >[1293655.659730] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293655.659735] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293655.659741] </IRQ> >[1293655.659743] <TASK> >[1293655.659744] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293655.659754] ? avtab_search_node+0xbc/0x130 >[1293655.659758] cond_compute_av+0x3a/0xd0 >[1293655.659764] context_struct_compute_av+0x27a/0x4d0 >[1293655.659771] security_compute_av+0x11a/0x2c0 >[1293655.659775] avc_compute_av.isra.0+0x58/0x200 >[1293655.659781] avc_has_perm_noaudit+0xe6/0x120 >[1293655.659786] selinux_inode_permission+0x136/0x1b0 >[1293655.659791] security_inode_permission+0x3e/0x60 >[1293655.659796] link_path_walk.part.0.constprop.0+0xd0/0x380 >[1293655.659800] ? path_init+0x287/0x3c0 >[1293655.659804] path_lookupat+0x3e/0x190 >[1293655.659807] filename_lookup+0xe8/0x1f0 >[1293655.659813] vfs_statx+0x9e/0x180 >[1293655.659820] vfs_fstatat+0x55/0x70 >[1293655.659824] __do_sys_newfstatat+0x3f/0x80 >[1293655.659830] do_syscall_64+0x5f/0x90 >[1293655.659836] ? __x64_sys_pread64+0xa8/0xd0 >[1293655.659840] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293655.659843] ? do_syscall_64+0x6b/0x90 >[1293655.659846] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293655.659849] ? do_syscall_64+0x6b/0x90 >[1293655.659852] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293655.659854] ? do_syscall_64+0x6b/0x90 >[1293655.659858] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1293655.659863] RIP: 0033:0x7f321071d77e >[1293656.052650] Code: 48 89 f2 b9 00 01 00 00 48 89 fe bf 9c ff ff ff e9 07 00 00 00 0f 1f 80 00 00 00 00 f3 0f 1e fa 41 89 ca b8 06 01 00 00 0f 05 <3d> 00 f0 ff ff 77 0b 31 c0 c3 0f 1f 84 00 00 00 00 00 48 8b 15 79 >[1293656.052656] RSP: 002b:00007f3200ee3218 EFLAGS: 00000246 ORIG_RAX: 0000000000000106 >[1293656.052660] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f321071d77e >[1293656.052663] RDX: 00007f3200ee3220 RSI: 00005601047ceaeb RDI: 00000000ffffff9c >[1293656.052665] RBP: 00007f3200ee32e8 R08: 0000000000000000 R09: 0000000000000000 >[1293656.052667] R10: 0000000000000000 R11: 0000000000000246 R12: 00005601047ce7a8 >[1293656.052669] R13: 0000000000000000 R14: 00005601047ce7a8 R15: 0000000000000012 >[1293656.052680] </TASK> >[1293802.461590] rcu: INFO: rcu_preempt self-detected stall on CPU >[1293802.461600] rcu: 0-...!: (2035 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277449/113277449 fqs=0 >[1293802.461607] rcu: (t=60101 jiffies g=128827753 q=3830 ncpus=1) >[1293802.461611] rcu: rcu_preempt kthread timer wakeup didn't happen for 60098 jiffies! g128827753 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1293802.461614] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940862 >[1293802.461615] rcu: rcu_preempt kthread starved for 60101 jiffies! g128827753 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1293802.461618] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1293802.461619] rcu: RCU grace-period kthread stack dump: >[1293802.461621] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1293802.461626] Call Trace: >[1293802.461628] <TASK> >[1293802.461634] __schedule+0x449/0x1480 >[1293802.461643] ? lock_timer_base+0x61/0x80 >[1293802.461650] schedule+0x5e/0xd0 >[1293802.461653] schedule_timeout+0x98/0x160 >[1293802.461656] ? __pfx_process_timeout+0x10/0x10 >[1293802.461659] rcu_gp_fqs_loop+0x141/0x520 >[1293802.461664] ? __note_gp_changes+0x153/0x1a0 >[1293802.461666] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1293802.461668] rcu_gp_kthread+0xea/0x1e0 >[1293802.461671] kthread+0xde/0x110 >[1293802.461675] ? __pfx_kthread+0x10/0x10 >[1293802.461677] ret_from_fork+0x2c/0x50 >[1293802.461683] </TASK> >[1293802.461684] rcu: Stack dump where RCU GP kthread last ran: >[1293802.461686] CPU: 0 PID: 2144 Comm: isc-net-0000 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293802.461690] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293802.461691] RIP: 0010:putname+0x13/0x60 >[1293802.461697] Code: c4 e8 01 a3 b3 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 48 81 ff 00 f0 ff ff 77 45 53 <8b> 47 10 48 89 fb 85 c0 7e 38 83 e8 01 89 47 10 75 21 48 8b 37 48 >[1293802.461699] RSP: 0018:ffffb5d8038c3e50 EFLAGS: 00010287 >[1293802.461701] RAX: ffff99a1c22b8a00 RBX: 000000000000002b RCX: 0000001a00000000 >[1293802.461703] RDX: ffff99a1ef8e7000 RSI: ffff99a1c9aebb00 RDI: ffff99a0e3004000 >[1293802.461704] RBP: ffff99a1c9aebb00 R08: 0000000000000000 R09: ffff99a1c43f9cc8 >[1293802.461706] R10: ffffb5d8038c3e60 R11: ffff99a1c9aebb10 R12: ffff99a0e3004000 >[1293802.461707] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 >[1293802.461709] FS: 00007f193cdff6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293802.461711] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293802.461713] CR2: 00007f43b2d3ac48 CR3: 000000010ae28000 CR4: 00000000000106f0 >[1293802.461716] Call Trace: >[1293802.461717] <IRQ> >[1293802.461719] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1293802.461722] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1293802.461725] ? sched_slice+0x87/0x140 >[1293802.461728] ? timekeeping_update+0xdd/0x130 >[1293802.461733] ? timekeeping_advance+0x377/0x590 >[1293802.461737] ? update_process_times+0x74/0xb0 >[1293802.461739] ? tick_sched_handle+0x22/0x60 >[1293802.461743] ? tick_sched_timer+0x67/0x80 >[1293802.461745] ? __pfx_tick_sched_timer+0x10/0x10 >[1293802.461748] ? __hrtimer_run_queues+0x112/0x2b0 >[1293802.461751] ? hrtimer_interrupt+0xf8/0x230 >[1293802.461754] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293802.461758] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293802.461762] </IRQ> >[1293802.461763] <TASK> >[1293802.461764] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293802.461768] ? putname+0x13/0x60 >[1293802.461771] do_sys_openat2+0x9b/0x170 >[1293802.461776] __x64_sys_openat+0x6e/0xa0 >[1293802.461779] do_syscall_64+0x5f/0x90 >[1293802.461783] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293802.461785] ? do_syscall_64+0x6b/0x90 >[1293802.461788] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293802.461790] ? do_syscall_64+0x6b/0x90 >[1293802.461793] ? exit_to_user_mode_prepare+0x142/0x1f0 >[1293802.461797] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1293802.461799] RIP: 0033:0x7f193f31dfb0 >[1293802.877394] Code: 48 89 44 24 20 75 97 44 89 54 24 0c e8 29 c6 f8 ff 44 8b 54 24 0c 89 da 48 89 ee 41 89 c0 bf 9c ff ff ff b8 01 01 00 00 0f 05 <48> 3d 00 f0 ff ff 77 38 44 89 c7 89 44 24 0c e8 7c c6 f8 ff 8b 44 >[1293802.877415] RSP: 002b:00007f193cdf8ac0 EFLAGS: 00000293 ORIG_RAX: 0000000000000101 >[1293802.877421] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f193f31dfb0 >[1293802.877424] RDX: 0000000000000000 RSI: 00007f193bcb4960 RDI: 00000000ffffff9c >[1293802.877427] RBP: 00007f193bcb4960 R08: 0000000000000000 R09: 0000000000000001 >[1293802.877429] R10: 0000000000000000 R11: 0000000000000293 R12: 00007f193bcb4960 >[1293802.877432] R13: 00007f193fe82cc5 R14: 0000000000000001 R15: 00007f193bcb4960 >[1293802.877476] </TASK> >[1293802.936127] CPU: 0 PID: 2144 Comm: isc-net-0000 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293802.936140] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293802.936143] RIP: 0010:putname+0x13/0x60 >[1293802.936152] Code: c4 e8 01 a3 b3 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 48 81 ff 00 f0 ff ff 77 45 53 <8b> 47 10 48 89 fb 85 c0 7e 38 83 e8 01 89 47 10 75 21 48 8b 37 48 >[1293802.936155] RSP: 0018:ffffb5d8038c3e50 EFLAGS: 00010287 >[1293802.936159] RAX: ffff99a1c22b8a00 RBX: 000000000000002b RCX: 0000001a00000000 >[1293802.936161] RDX: ffff99a1ef8e7000 RSI: ffff99a1c9aebb00 RDI: ffff99a0e3004000 >[1293802.936163] RBP: ffff99a1c9aebb00 R08: 0000000000000000 R09: ffff99a1c43f9cc8 >[1293802.936165] R10: ffffb5d8038c3e60 R11: ffff99a1c9aebb10 R12: ffff99a0e3004000 >[1293802.936167] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 >[1293802.936170] FS: 00007f193cdff6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293802.936173] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293802.936175] CR2: 00007f43b2d3ac48 CR3: 000000010ae28000 CR4: 00000000000106f0 >[1293802.936179] Call Trace: >[1293802.936183] <IRQ> >[1293802.936248] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1293802.936258] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1293802.936263] ? sched_slice+0x87/0x140 >[1293802.936269] ? timekeeping_update+0xdd/0x130 >[1293802.936276] ? timekeeping_advance+0x377/0x590 >[1293802.936281] ? update_process_times+0x74/0xb0 >[1293802.936284] ? tick_sched_handle+0x22/0x60 >[1293802.936289] ? tick_sched_timer+0x67/0x80 >[1293802.936293] ? __pfx_tick_sched_timer+0x10/0x10 >[1293802.936296] ? __hrtimer_run_queues+0x112/0x2b0 >[1293802.936301] ? hrtimer_interrupt+0xf8/0x230 >[1293802.936305] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293802.936309] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293802.936315] </IRQ> >[1293802.936317] <TASK> >[1293802.936319] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293802.936325] ? putname+0x13/0x60 >[1293802.936329] do_sys_openat2+0x9b/0x170 >[1293802.936335] __x64_sys_openat+0x6e/0xa0 >[1293802.936340] do_syscall_64+0x5f/0x90 >[1293802.936345] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293802.936348] ? do_syscall_64+0x6b/0x90 >[1293802.936352] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293802.936355] ? do_syscall_64+0x6b/0x90 >[1293802.936358] ? exit_to_user_mode_prepare+0x142/0x1f0 >[1293802.936362] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1293802.936366] RIP: 0033:0x7f193f31dfb0 >[1293803.419035] Code: 48 89 44 24 20 75 97 44 89 54 24 0c e8 29 c6 f8 ff 44 8b 54 24 0c 89 da 48 89 ee 41 89 c0 bf 9c ff ff ff b8 01 01 00 00 0f 05 <48> 3d 00 f0 ff ff 77 38 44 89 c7 89 44 24 0c e8 7c c6 f8 ff 8b 44 >[1293803.419041] RSP: 002b:00007f193cdf8ac0 EFLAGS: 00000293 ORIG_RAX: 0000000000000101 >[1293803.419046] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f193f31dfb0 >[1293803.419049] RDX: 0000000000000000 RSI: 00007f193bcb4960 RDI: 00000000ffffff9c >[1293803.419051] RBP: 00007f193bcb4960 R08: 0000000000000000 R09: 0000000000000001 >[1293803.419053] R10: 0000000000000000 R11: 0000000000000293 R12: 00007f193bcb4960 >[1293803.419055] R13: 00007f193fe82cc5 R14: 0000000000000001 R15: 00007f193bcb4960 >[1293803.419065] </TASK> >[1293863.615823] watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [ksoftirqd/0:15] >[1293863.615837] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1293863.615922] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293863.615927] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293863.615930] RIP: 0010:vbg_req_perform+0x2c/0x40 [vboxguest] >[1293863.615945] Code: 1f 00 0f 1f 44 00 00 b8 00 00 00 80 48 01 f0 72 21 48 c7 c2 00 00 00 80 48 2b 15 e7 3e 4f c4 48 01 d0 0f b7 57 08 ef 0f ae f0 <8b> 46 0c e9 fc 3f b0 c3 48 8b 15 c5 ca b7 c4 eb e4 0f 1f 00 90 90 >[1293863.615948] RSP: 0018:ffffb5d800083db0 EFLAGS: 00010207 >[1293863.615951] RAX: 0000000001114000 RBX: ffff99a1c3d66298 RCX: ffff99a21ac21e80 >[1293863.615954] RDX: 000000000000d040 RSI: ffff99a0c1114000 RDI: ffff99a1c3d66028 >[1293863.615957] RBP: ffff99a1c3d66298 R08: 000000000000010c R09: ffff99a21ac21ea8 >[1293863.615959] R10: 0000000000000004 R11: 0000000000000000 R12: ffffffffc04abd60 >[1293863.615962] R13: ffff99a1c3d66298 R14: ffffb5d800083e10 R15: ffff99a21ac21e80 >[1293863.615964] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293863.615967] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293863.615970] CR2: 0000555795f9aa58 CR3: 000000004910c000 CR4: 00000000000106f0 >[1293863.615975] Call Trace: >[1293863.615979] <IRQ> >[1293863.615985] ? watchdog_timer_fn+0x1a8/0x210 >[1293863.615994] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1293863.615998] ? __hrtimer_run_queues+0x112/0x2b0 >[1293863.616004] ? hrtimer_interrupt+0xf8/0x230 >[1293863.616008] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293863.616013] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293863.616019] </IRQ> >[1293863.616021] <TASK> >[1293863.616022] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293863.616027] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1293863.616038] ? vbg_req_perform+0x2c/0x40 [vboxguest] >[1293863.616045] vbg_heartbeat_timer+0x1d/0x40 [vboxguest] >[1293863.616053] call_timer_fn+0x27/0x130 >[1293863.616057] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1293863.616064] __run_timers+0x222/0x2c0 >[1293863.616069] run_timer_softirq+0x1d/0x40 >[1293863.616073] __do_softirq+0xd4/0x2c8 >[1293863.616079] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1293863.616083] run_ksoftirqd+0x2c/0x40 >[1293863.616089] smpboot_thread_fn+0xdc/0x1d0 >[1293863.616092] kthread+0xde/0x110 >[1293863.616097] ? __pfx_kthread+0x10/0x10 >[1293863.616101] ret_from_fork+0x2c/0x50 >[1293863.616109] </TASK> >[1293869.926639] rcu: INFO: rcu_preempt self-detected stall on CPU >[1293869.926653] rcu: 0-...!: (11740 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277450/113277450 fqs=0 >[1293869.926661] rcu: (t=60037 jiffies g=128827757 q=3806 ncpus=1) >[1293869.926665] rcu: rcu_preempt kthread starved for 60037 jiffies! g128827757 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0 >[1293869.926669] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1293869.926671] rcu: RCU grace-period kthread stack dump: >[1293869.926673] task:rcu_preempt state:R running task stack:0 pid:16 ppid:2 flags:0x00004000 >[1293869.926696] Call Trace: >[1293869.926700] <TASK> >[1293869.926708] __schedule+0x449/0x1480 >[1293869.926720] ? lock_timer_base+0x61/0x80 >[1293869.926729] schedule+0x5e/0xd0 >[1293869.926734] schedule_timeout+0x98/0x160 >[1293869.926740] ? __pfx_process_timeout+0x10/0x10 >[1293869.926761] rcu_gp_fqs_loop+0x141/0x520 >[1293869.926768] ? __note_gp_changes+0x153/0x1a0 >[1293869.926771] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1293869.926774] rcu_gp_kthread+0xea/0x1e0 >[1293869.926777] kthread+0xde/0x110 >[1293869.926783] ? __pfx_kthread+0x10/0x10 >[1293869.926787] ret_from_fork+0x2c/0x50 >[1293869.926799] </TASK> >[1293869.926801] rcu: Stack dump where RCU GP kthread last ran: >[1293869.926804] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293869.926830] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293869.926832] RIP: 0010:vbg_req_perform+0x2c/0x40 [vboxguest] >[1293869.926845] Code: 1f 00 0f 1f 44 00 00 b8 00 00 00 80 48 01 f0 72 21 48 c7 c2 00 00 00 80 48 2b 15 e7 3e 4f c4 48 01 d0 0f b7 57 08 ef 0f ae f0 <8b> 46 0c e9 fc 3f b0 c3 48 8b 15 c5 ca b7 c4 eb e4 0f 1f 00 90 90 >[1293869.926849] RSP: 0018:ffffb5d800083db0 EFLAGS: 00010207 >[1293869.926852] RAX: 0000000001114000 RBX: ffff99a1c3d66298 RCX: ffff99a21ac21e80 >[1293869.926855] RDX: 000000000000d040 RSI: ffff99a0c1114000 RDI: ffff99a1c3d66028 >[1293869.926857] RBP: ffff99a1c3d66298 R08: 000000000000010e R09: ffff99a21ac21ea8 >[1293869.926859] R10: 0000000000000005 R11: 0000000000000000 R12: ffffffffc04abd60 >[1293869.926861] R13: ffff99a1c3d66298 R14: ffffb5d800083e10 R15: ffff99a21ac21e80 >[1293869.926864] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293869.926867] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293869.926869] CR2: 0000555795f9aa58 CR3: 000000004910c000 CR4: 00000000000106f0 >[1293869.926888] Call Trace: >[1293869.926891] <IRQ> >[1293869.926893] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1293869.926898] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1293869.926901] ? sched_slice+0x87/0x140 >[1293869.926907] ? timekeeping_update+0xdd/0x130 >[1293869.926911] ? timekeeping_advance+0x377/0x590 >[1293869.926915] ? update_process_times+0x74/0xb0 >[1293869.926919] ? tick_sched_handle+0x22/0x60 >[1293869.926924] ? tick_sched_timer+0x67/0x80 >[1293869.926927] ? __pfx_tick_sched_timer+0x10/0x10 >[1293869.926930] ? __hrtimer_run_queues+0x112/0x2b0 >[1293869.926934] ? hrtimer_interrupt+0xf8/0x230 >[1293869.926954] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293869.926977] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293869.926982] </IRQ> >[1293869.926984] <TASK> >[1293869.926985] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293869.926991] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1293869.927001] ? vbg_req_perform+0x2c/0x40 [vboxguest] >[1293869.927026] vbg_heartbeat_timer+0x1d/0x40 [vboxguest] >[1293869.927033] call_timer_fn+0x27/0x130 >[1293869.927037] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1293869.927043] __run_timers+0x222/0x2c0 >[1293869.927048] run_timer_softirq+0x1d/0x40 >[1293869.927050] __do_softirq+0xd4/0x2c8 >[1293869.927055] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1293869.927059] run_ksoftirqd+0x2c/0x40 >[1293869.927064] smpboot_thread_fn+0xdc/0x1d0 >[1293869.927082] kthread+0xde/0x110 >[1293869.927088] ? __pfx_kthread+0x10/0x10 >[1293869.927091] ret_from_fork+0x2c/0x50 >[1293869.927096] </TASK> >[1293869.927099] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293869.927102] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293869.927104] RIP: 0010:vbg_req_perform+0x2c/0x40 [vboxguest] >[1293869.927112] Code: 1f 00 0f 1f 44 00 00 b8 00 00 00 80 48 01 f0 72 21 48 c7 c2 00 00 00 80 48 2b 15 e7 3e 4f c4 48 01 d0 0f b7 57 08 ef 0f ae f0 <8b> 46 0c e9 fc 3f b0 c3 48 8b 15 c5 ca b7 c4 eb e4 0f 1f 00 90 90 >[1293869.927115] RSP: 0018:ffffb5d800083db0 EFLAGS: 00010207 >[1293869.927118] RAX: 0000000001114000 RBX: ffff99a1c3d66298 RCX: ffff99a21ac21e80 >[1293869.927120] RDX: 000000000000d040 RSI: ffff99a0c1114000 RDI: ffff99a1c3d66028 >[1293869.927122] RBP: ffff99a1c3d66298 R08: 000000000000010e R09: ffff99a21ac21ea8 >[1293869.927124] R10: 0000000000000005 R11: 0000000000000000 R12: ffffffffc04abd60 >[1293869.927125] R13: ffff99a1c3d66298 R14: ffffb5d800083e10 R15: ffff99a21ac21e80 >[1293869.927128] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293869.927130] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293869.927148] CR2: 0000555795f9aa58 CR3: 000000004910c000 CR4: 00000000000106f0 >[1293869.927152] Call Trace: >[1293869.927154] <IRQ> >[1293869.927156] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1293869.927161] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1293869.927164] ? sched_slice+0x87/0x140 >[1293869.927168] ? timekeeping_update+0xdd/0x130 >[1293869.927172] ? timekeeping_advance+0x377/0x590 >[1293869.927176] ? update_process_times+0x74/0xb0 >[1293869.927179] ? tick_sched_handle+0x22/0x60 >[1293869.927182] ? tick_sched_timer+0x67/0x80 >[1293869.927185] ? __pfx_tick_sched_timer+0x10/0x10 >[1293869.927188] ? __hrtimer_run_queues+0x112/0x2b0 >[1293869.927192] ? hrtimer_interrupt+0xf8/0x230 >[1293869.927211] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293869.927217] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293869.927221] </IRQ> >[1293869.927222] <TASK> >[1293869.927223] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293869.927227] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1293869.927235] ? vbg_req_perform+0x2c/0x40 [vboxguest] >[1293869.927242] vbg_heartbeat_timer+0x1d/0x40 [vboxguest] >[1293869.927249] call_timer_fn+0x27/0x130 >[1293869.927252] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1293869.927258] __run_timers+0x222/0x2c0 >[1293869.927277] run_timer_softirq+0x1d/0x40 >[1293869.927283] __do_softirq+0xd4/0x2c8 >[1293869.927287] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1293869.927290] run_ksoftirqd+0x2c/0x40 >[1293869.927294] smpboot_thread_fn+0xdc/0x1d0 >[1293869.927296] kthread+0xde/0x110 >[1293869.927299] ? __pfx_kthread+0x10/0x10 >[1293869.927303] ret_from_fork+0x2c/0x50 >[1293869.927308] </TASK> >[1293949.208846] rcu: INFO: rcu_preempt self-detected stall on CPU >[1293949.208858] rcu: 0-...!: (1739 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277451/113277451 fqs=0 >[1293949.208866] rcu: (t=60104 jiffies g=128827761 q=3859 ncpus=1) >[1293949.208870] rcu: rcu_preempt kthread timer wakeup didn't happen for 60101 jiffies! g128827761 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1293949.208874] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940864 >[1293949.208876] rcu: rcu_preempt kthread starved for 60104 jiffies! g128827761 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1293949.208880] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1293949.208882] rcu: RCU grace-period kthread stack dump: >[1293949.208884] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1293949.208890] Call Trace: >[1293949.208892] <TASK> >[1293949.208900] __schedule+0x449/0x1480 >[1293949.208910] ? lock_timer_base+0x61/0x80 >[1293949.208918] schedule+0x5e/0xd0 >[1293949.208922] schedule_timeout+0x98/0x160 >[1293949.208927] ? __pfx_process_timeout+0x10/0x10 >[1293949.208930] rcu_gp_fqs_loop+0x141/0x520 >[1293949.208936] ? __note_gp_changes+0x153/0x1a0 >[1293949.208940] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1293949.208943] rcu_gp_kthread+0xea/0x1e0 >[1293949.208946] kthread+0xde/0x110 >[1293949.208952] ? __pfx_kthread+0x10/0x10 >[1293949.208955] ret_from_fork+0x2c/0x50 >[1293949.208962] </TASK> >[1293949.208964] rcu: Stack dump where RCU GP kthread last ran: >[1293949.208967] CPU: 0 PID: 1299939 Comm: Thread (pooled) Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293949.208971] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293949.280535] RIP: 0010:may_open+0x20/0x170 >[1293949.348951] Code: 90 90 90 90 90 90 90 90 90 90 0f 1f 44 00 00 41 54 55 53 48 83 ec 08 48 8b 46 08 4c 8b 60 30 4d 85 e4 0f 84 3b 01 00 00 89 cd <41> 0f b7 0c 24 48 89 fb 66 81 e1 00 f0 66 81 f9 00 60 0f 84 f8 00 >[1293949.348966] RSP: 0018:ffffb5d807307c00 EFLAGS: 00010282 >[1293949.348971] RAX: ffff99a1eb3a7840 RBX: ffffffff851e9960 RCX: 0000000000008000 >[1293949.348974] RDX: 0000000000000004 RSI: ffffb5d807307cd0 RDI: ffffffff851e9960 >[1293949.348977] RBP: 0000000000008000 R08: 0000000000000141 R09: 000000007862646b >[1293949.348979] R10: 0000000000000004 R11: 0000000000000002 R12: ffff99a0ea967c10 >[1293949.348981] R13: 0000000000008000 R14: ffffb5d807307cd0 R15: ffff99a1c2dba500 >[1293949.348984] FS: 00007f57f53ff6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293949.348987] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293949.348990] CR2: 00007f3f0982cf10 CR3: 00000000484dc000 CR4: 00000000000106f0 >[1293949.348993] Call Trace: >[1293949.496420] <IRQ> >[1293949.496466] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1293949.496479] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1293949.496483] ? sched_slice+0x87/0x140 >[1293949.496489] ? timekeeping_update+0xdd/0x130 >[1293949.496494] ? timekeeping_advance+0x377/0x590 >[1293949.496499] ? update_process_times+0x74/0xb0 >[1293949.496502] ? tick_sched_handle+0x22/0x60 >[1293949.496506] ? tick_sched_timer+0x67/0x80 >[1293949.496509] ? __pfx_tick_sched_timer+0x10/0x10 >[1293949.496512] ? __hrtimer_run_queues+0x112/0x2b0 >[1293949.496516] ? hrtimer_interrupt+0xf8/0x230 >[1293949.496520] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293949.496524] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293949.496530] </IRQ> >[1293949.496531] <TASK> >[1293949.496533] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293949.496541] ? may_open+0x20/0x170 >[1293949.496546] path_openat+0x9a1/0x1110 >[1293949.496550] ? schedule+0x5e/0xd0 >[1293949.496556] do_filp_open+0xb3/0x160 >[1293949.496562] do_sys_openat2+0xaf/0x170 >[1293949.496567] __x64_sys_openat+0x6e/0xa0 >[1293949.496571] do_syscall_64+0x5f/0x90 >[1293949.496577] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293949.496580] ? do_syscall_64+0x6b/0x90 >[1293949.496584] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293949.496588] ? do_syscall_64+0x6b/0x90 >[1293949.496591] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293949.496593] ? do_syscall_64+0x6b/0x90 >[1293949.496597] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293949.496600] ? do_syscall_64+0x6b/0x90 >[1293949.496604] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1293949.496608] RIP: 0033:0x7f582471dfb0 >[1293950.252717] Code: 48 89 44 24 20 75 97 44 89 54 24 0c e8 29 c6 f8 ff 44 8b 54 24 0c 89 da 48 89 ee 41 89 c0 bf 9c ff ff ff b8 01 01 00 00 0f 05 <48> 3d 00 f0 ff ff 77 38 44 89 c7 89 44 24 0c e8 7c c6 f8 ff 8b 44 >[1293950.252731] RSP: 002b:00007f57f53fe910 EFLAGS: 00000293 ORIG_RAX: 0000000000000101 >[1293950.252736] RAX: ffffffffffffffda RBX: 0000000000080000 RCX: 00007f582471dfb0 >[1293950.252739] RDX: 0000000000080000 RSI: 00007f57ec003878 RDI: 00000000ffffff9c >[1293950.252741] RBP: 00007f57ec003878 R08: 0000000000000000 R09: 0000000000000000 >[1293950.252744] R10: 0000000000000000 R11: 0000000000000293 R12: 00007f57ec003310 >[1293950.252746] R13: 00007f57f53fe9a8 R14: 00007f57ec003330 R15: 00007f57f4bff000 >[1293950.291309] </TASK> >[1293950.848399] CPU: 0 PID: 1299939 Comm: Thread (pooled) Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1293950.848415] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1293950.885295] RIP: 0010:may_open+0x20/0x170 >[1293950.957893] Code: 90 90 90 90 90 90 90 90 90 90 0f 1f 44 00 00 41 54 55 53 48 83 ec 08 48 8b 46 08 4c 8b 60 30 4d 85 e4 0f 84 3b 01 00 00 89 cd <41> 0f b7 0c 24 48 89 fb 66 81 e1 00 f0 66 81 f9 00 60 0f 84 f8 00 >[1293950.957909] RSP: 0018:ffffb5d807307c00 EFLAGS: 00010282 >[1293950.957914] RAX: ffff99a1eb3a7840 RBX: ffffffff851e9960 RCX: 0000000000008000 >[1293950.957917] RDX: 0000000000000004 RSI: ffffb5d807307cd0 RDI: ffffffff851e9960 >[1293950.957920] RBP: 0000000000008000 R08: 0000000000000141 R09: 000000007862646b >[1293950.957923] R10: 0000000000000004 R11: 0000000000000002 R12: ffff99a0ea967c10 >[1293950.957925] R13: 0000000000008000 R14: ffffb5d807307cd0 R15: ffff99a1c2dba500 >[1293950.957928] FS: 00007f57f53ff6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1293950.957932] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1293950.957934] CR2: 00007f3f0982cf10 CR3: 00000000484dc000 CR4: 00000000000106f0 >[1293950.957939] Call Trace: >[1293951.214490] <IRQ> >[1293951.424636] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1293951.424701] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1293951.424708] ? sched_slice+0x87/0x140 >[1293951.424714] ? timekeeping_update+0xdd/0x130 >[1293951.424719] ? timekeeping_advance+0x377/0x590 >[1293951.424724] ? update_process_times+0x74/0xb0 >[1293951.424727] ? tick_sched_handle+0x22/0x60 >[1293951.424732] ? tick_sched_timer+0x67/0x80 >[1293951.424735] ? __pfx_tick_sched_timer+0x10/0x10 >[1293951.424738] ? __hrtimer_run_queues+0x112/0x2b0 >[1293951.424742] ? hrtimer_interrupt+0xf8/0x230 >[1293951.424746] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1293951.424751] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1293951.424757] </IRQ> >[1293951.424784] <TASK> >[1293951.424789] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1293951.424798] ? may_open+0x20/0x170 >[1293951.424803] path_openat+0x9a1/0x1110 >[1293951.424808] ? schedule+0x5e/0xd0 >[1293951.424813] do_filp_open+0xb3/0x160 >[1293951.424819] do_sys_openat2+0xaf/0x170 >[1293951.424824] __x64_sys_openat+0x6e/0xa0 >[1293951.424828] do_syscall_64+0x5f/0x90 >[1293951.424833] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293951.424836] ? do_syscall_64+0x6b/0x90 >[1293951.424840] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293951.424843] ? do_syscall_64+0x6b/0x90 >[1293951.424847] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293951.424849] ? do_syscall_64+0x6b/0x90 >[1293951.424853] ? syscall_exit_to_user_mode+0x1b/0x40 >[1293951.424855] ? do_syscall_64+0x6b/0x90 >[1293951.424859] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1293951.424863] RIP: 0033:0x7f582471dfb0 >[1293951.635410] Code: 48 89 44 24 20 75 97 44 89 54 24 0c e8 29 c6 f8 ff 44 8b 54 24 0c 89 da 48 89 ee 41 89 c0 bf 9c ff ff ff b8 01 01 00 00 0f 05 <48> 3d 00 f0 ff ff 77 38 44 89 c7 89 44 24 0c e8 7c c6 f8 ff 8b 44 >[1293951.635417] RSP: 002b:00007f57f53fe910 EFLAGS: 00000293 ORIG_RAX: 0000000000000101 >[1293951.635421] RAX: ffffffffffffffda RBX: 0000000000080000 RCX: 00007f582471dfb0 >[1293951.635424] RDX: 0000000000080000 RSI: 00007f57ec003878 RDI: 00000000ffffff9c >[1293951.635427] RBP: 00007f57ec003878 R08: 0000000000000000 R09: 0000000000000000 >[1293951.635429] R10: 0000000000000000 R11: 0000000000000293 R12: 00007f57ec003310 >[1293951.635431] R13: 00007f57f53fe9a8 R14: 00007f57ec003330 R15: 00007f57f4bff000 >[1293951.635439] </TASK> >[1294007.583857] watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [ksoftirqd/0:15] >[1294007.583869] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1294007.584017] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294007.584022] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294007.584027] RIP: 0010:vbg_req_perform+0x2c/0x40 [vboxguest] >[1294007.584041] Code: 1f 00 0f 1f 44 00 00 b8 00 00 00 80 48 01 f0 72 21 48 c7 c2 00 00 00 80 48 2b 15 e7 3e 4f c4 48 01 d0 0f b7 57 08 ef 0f ae f0 <8b> 46 0c e9 fc 3f b0 c3 48 8b 15 c5 ca b7 c4 eb e4 0f 1f 00 90 90 >[1294007.584044] RSP: 0018:ffffb5d800083db0 EFLAGS: 00010207 >[1294007.584048] RAX: 0000000001114000 RBX: ffff99a1c3d66298 RCX: ffff99a21ac21e80 >[1294007.584050] RDX: 000000000000d040 RSI: ffff99a0c1114000 RDI: ffff99a1c3d66028 >[1294007.584053] RBP: ffff99a1c3d66298 R08: 000000000000002a R09: ffff99a21ac21ea8 >[1294007.584055] R10: 0000000000000006 R11: 0000000000000000 R12: ffffffffc04abd60 >[1294007.584057] R13: ffff99a1c3d66298 R14: ffffb5d800083e10 R15: ffff99a21ac21e80 >[1294007.584060] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294007.584062] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294007.584064] CR2: 00007f3f0982cf10 CR3: 0000000114354000 CR4: 00000000000106f0 >[1294007.584068] Call Trace: >[1294007.584072] <IRQ> >[1294007.584077] ? watchdog_timer_fn+0x1a8/0x210 >[1294007.584085] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1294007.584094] ? __hrtimer_run_queues+0x112/0x2b0 >[1294007.584100] ? hrtimer_interrupt+0xf8/0x230 >[1294007.584104] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294007.584109] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294007.584115] </IRQ> >[1294007.584116] <TASK> >[1294007.584118] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294007.584123] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1294007.584133] ? vbg_req_perform+0x2c/0x40 [vboxguest] >[1294007.584140] vbg_heartbeat_timer+0x1d/0x40 [vboxguest] >[1294007.584147] call_timer_fn+0x27/0x130 >[1294007.584151] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1294007.584157] __run_timers+0x222/0x2c0 >[1294007.584162] run_timer_softirq+0x1d/0x40 >[1294007.584165] __do_softirq+0xd4/0x2c8 >[1294007.584171] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1294007.584175] run_ksoftirqd+0x2c/0x40 >[1294007.584180] smpboot_thread_fn+0xdc/0x1d0 >[1294007.584184] kthread+0xde/0x110 >[1294007.584188] ? __pfx_kthread+0x10/0x10 >[1294007.584191] ret_from_fork+0x2c/0x50 >[1294007.584203] </TASK> >[1294035.572835] watchdog: BUG: soft lockup - CPU#0 stuck for 47s! [ksoftirqd/0:15] >[1294035.572846] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1294035.572917] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294035.572922] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294035.572925] RIP: 0010:e1000_clean_rx_irq+0x1cd/0x500 [e1000] >[1294035.572959] Code: 41 81 e5 ff 0f 66 41 89 86 98 00 00 00 66 45 89 ae 9a 00 00 00 49 8d bc 24 b0 02 00 00 4c 89 f6 e8 38 43 a7 c3 83 7c 24 14 10 <41> c6 47 0c 00 0f 84 1d 01 00 00 c6 44 24 34 01 f6 43 0c 01 0f 84 >[1294035.572963] RSP: 0018:ffffb5d800083cd0 EFLAGS: 00010283 >[1294035.572966] RAX: 0000000000000003 RBX: ffff99a0c111a4b0 RCX: 000000008010000c >[1294035.572969] RDX: 0000000000000000 RSI: ffff99a1ce4e2800 RDI: ffff99a1c02f2740 >[1294035.572971] RBP: ffffb5d8030dd4a0 R08: 0000000000000000 R09: 000000008010000c >[1294035.572974] R10: ffff99a1fb5a5800 R11: 0000000108110782 R12: ffff99a1c8f8e9c0 >[1294035.572976] R13: 0000000000000000 R14: ffff99a1ce4e2c00 R15: ffff99a0c111a4a0 >[1294035.572978] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294035.572981] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294035.572983] CR2: 00007f3f0982cf10 CR3: 0000000114354000 CR4: 00000000000106f0 >[1294035.572987] Call Trace: >[1294035.572990] <IRQ> >[1294035.572995] ? watchdog_timer_fn+0x1a8/0x210 >[1294035.573003] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1294035.573007] ? __hrtimer_run_queues+0x112/0x2b0 >[1294035.573012] ? hrtimer_interrupt+0xf8/0x230 >[1294035.573016] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294035.573020] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294035.573026] </IRQ> >[1294035.573028] <TASK> >[1294035.573029] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294035.573036] ? e1000_clean_rx_irq+0x1cd/0x500 [e1000] >[1294035.573051] e1000_clean+0x28c/0x990 [e1000] >[1294035.573065] ? __queue_work+0x1dd/0x440 >[1294035.573069] ? __pfx_writeout_period+0x10/0x10 >[1294035.573073] ? __pfx_delayed_work_timer_fn+0x10/0x10 >[1294035.573077] __napi_poll+0x2b/0x1c0 >[1294035.573082] net_rx_action+0x29f/0x350 >[1294035.573086] __do_softirq+0xd4/0x2c8 >[1294035.573091] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1294035.573095] run_ksoftirqd+0x2c/0x40 >[1294035.573100] smpboot_thread_fn+0xdc/0x1d0 >[1294035.573103] kthread+0xde/0x110 >[1294035.573107] ? __pfx_kthread+0x10/0x10 >[1294035.573110] ret_from_fork+0x2c/0x50 >[1294035.573133] </TASK> >[1294108.746710] rcu: INFO: rcu_preempt self-detected stall on CPU >[1294108.746738] rcu: 0-...!: (5889 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277452/113277452 fqs=0 >[1294108.746746] rcu: (t=60014 jiffies g=128827765 q=3896 ncpus=1) >[1294108.746750] rcu: rcu_preempt kthread timer wakeup didn't happen for 60011 jiffies! g128827765 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1294108.746754] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940865 >[1294108.746756] rcu: rcu_preempt kthread starved for 60014 jiffies! g128827765 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1294108.746760] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1294108.746761] rcu: RCU grace-period kthread stack dump: >[1294108.746763] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1294108.746769] Call Trace: >[1294108.746772] <TASK> >[1294108.746779] __schedule+0x449/0x1480 >[1294108.746791] ? lock_timer_base+0x61/0x80 >[1294108.746799] schedule+0x5e/0xd0 >[1294108.746803] schedule_timeout+0x98/0x160 >[1294108.746808] ? __pfx_process_timeout+0x10/0x10 >[1294108.746812] rcu_gp_fqs_loop+0x141/0x520 >[1294108.746818] ? __note_gp_changes+0x153/0x1a0 >[1294108.746821] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1294108.746824] rcu_gp_kthread+0xea/0x1e0 >[1294108.746827] kthread+0xde/0x110 >[1294108.746833] ? __pfx_kthread+0x10/0x10 >[1294108.746887] ret_from_fork+0x2c/0x50 >[1294108.746895] </TASK> >[1294108.746897] rcu: Stack dump where RCU GP kthread last ran: >[1294108.746899] CPU: 0 PID: 1010085 Comm: sssd_be Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294108.746903] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294108.746905] RIP: 0010:do_epoll_wait+0x15b/0x7d0 >[1294108.746910] Code: 0f 84 ad 02 00 00 48 8b 01 48 0b 41 08 0f 85 f3 05 00 00 48 c7 44 24 28 00 00 00 00 bb 01 00 00 00 48 c7 44 24 40 00 00 00 00 <49> 8b 54 24 50 4d 8d 54 24 50 41 bf 01 00 00 00 49 39 d2 0f 84 a0 >[1294108.746913] RSP: 0018:ffffb5d803b9bd40 EFLAGS: 00010246 >[1294108.746916] RAX: ffffb5d803b9bd88 RBX: 0000000000000000 RCX: 0000000225c17d03 >[1294108.746918] RDX: 0004999efd0dac34 RSI: 0000000000000001 RDI: 0000000002293c34 >[1294108.746920] RBP: ffff99a1d9000300 R08: 00000000000f4240 R09: 0018d35199c09b91 >[1294108.746922] R10: 0000000000000000 R11: 0000000000000000 R12: ffff99a0cd2b3f00 >[1294108.746923] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000 >[1294108.746925] FS: 00007f8416c308c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294108.746928] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294108.746930] CR2: 00007f3f0982cf10 CR3: 000000011143a000 CR4: 00000000000106f0 >[1294108.746934] Call Trace: >[1294108.746939] <IRQ> >[1294108.746941] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1294108.746945] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1294108.746948] ? sched_slice+0x87/0x140 >[1294108.746954] ? timekeeping_update+0xdd/0x130 >[1294108.746958] ? timekeeping_advance+0x377/0x590 >[1294108.746962] ? update_process_times+0x74/0xb0 >[1294108.746965] ? tick_sched_handle+0x22/0x60 >[1294108.746969] ? tick_sched_timer+0x67/0x80 >[1294108.746972] ? __pfx_tick_sched_timer+0x10/0x10 >[1294108.746975] ? __hrtimer_run_queues+0x112/0x2b0 >[1294108.746979] ? hrtimer_interrupt+0xf8/0x230 >[1294108.746985] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294108.746989] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294108.746995] </IRQ> >[1294108.746996] <TASK> >[1294108.746997] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294108.747033] ? do_epoll_wait+0x15b/0x7d0 >[1294108.747038] ? fpu__restore_sig+0x75/0x90 >[1294108.747043] ? restore_sigcontext+0x16f/0x1d0 >[1294108.747048] __x64_sys_epoll_wait+0x73/0x110 >[1294108.747052] do_syscall_64+0x5f/0x90 >[1294108.747057] ? __do_sys_rt_sigreturn+0xe1/0xf0 >[1294108.747061] ? syscall_exit_to_user_mode+0x1b/0x40 >[1294108.747064] ? do_syscall_64+0x6b/0x90 >[1294108.747067] ? syscall_exit_to_user_mode+0x1b/0x40 >[1294108.747070] ? do_syscall_64+0x6b/0x90 >[1294108.747073] ? __do_sys_rt_sigreturn+0xe1/0xf0 >[1294108.747076] ? syscall_exit_to_user_mode+0x1b/0x40 >[1294108.747079] ? do_syscall_64+0x6b/0x90 >[1294108.747083] ? do_syscall_64+0x6b/0x90 >[1294108.747086] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1294108.747090] RIP: 0033:0x7f8417173157 >[1294108.816365] Code: 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa 80 3d ad f4 0c 00 00 41 89 ca 74 10 b8 e8 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 59 c3 48 83 ec 28 89 54 24 18 48 89 74 24 10 >[1294108.816369] RSP: 002b:00007ffd75f20f18 EFLAGS: 00000202 ORIG_RAX: 00000000000000e8 >[1294108.816374] RAX: ffffffffffffffda RBX: 0000000000002710 RCX: 00007f8417173157 >[1294108.816376] RDX: 0000000000000001 RSI: 00007ffd75f20f4c RDI: 0000000000000003 >[1294108.816379] RBP: 000055ca478f9180 R08: 000757acae212259 R09: 000055ca478f9370 >[1294108.816381] R10: 0000000000002710 R11: 0000000000000202 R12: 00007f84173a0ee0 >[1294108.816383] R13: 00007ffd75f21380 R14: 000055ca473082d8 R15: 00007f8417428000 >[1294108.816391] </TASK> >[1294108.816435] CPU: 0 PID: 1010085 Comm: sssd_be Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294108.816442] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294108.816444] RIP: 0010:do_epoll_wait+0x15b/0x7d0 >[1294108.816453] Code: 0f 84 ad 02 00 00 48 8b 01 48 0b 41 08 0f 85 f3 05 00 00 48 c7 44 24 28 00 00 00 00 bb 01 00 00 00 48 c7 44 24 40 00 00 00 00 <49> 8b 54 24 50 4d 8d 54 24 50 41 bf 01 00 00 00 49 39 d2 0f 84 a0 >[1294108.816456] RSP: 0018:ffffb5d803b9bd40 EFLAGS: 00010246 >[1294108.816459] RAX: ffffb5d803b9bd88 RBX: 0000000000000000 RCX: 0000000225c17d03 >[1294108.816461] RDX: 0004999efd0dac34 RSI: 0000000000000001 RDI: 0000000002293c34 >[1294108.816463] RBP: ffff99a1d9000300 R08: 00000000000f4240 R09: 0018d35199c09b91 >[1294108.816465] R10: 0000000000000000 R11: 0000000000000000 R12: ffff99a0cd2b3f00 >[1294108.816467] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000 >[1294108.816470] FS: 00007f8416c308c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294108.816473] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294108.816475] CR2: 00007f3f0982cf10 CR3: 000000011143a000 CR4: 00000000000106f0 >[1294108.816479] Call Trace: >[1294108.816482] <IRQ> >[1294108.816485] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1294108.816492] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1294108.816495] ? sched_slice+0x87/0x140 >[1294108.816501] ? timekeeping_update+0xdd/0x130 >[1294108.816505] ? timekeeping_advance+0x377/0x590 >[1294108.816510] ? update_process_times+0x74/0xb0 >[1294108.816513] ? tick_sched_handle+0x22/0x60 >[1294108.816518] ? tick_sched_timer+0x67/0x80 >[1294108.816521] ? __pfx_tick_sched_timer+0x10/0x10 >[1294108.816524] ? __hrtimer_run_queues+0x112/0x2b0 >[1294108.816528] ? hrtimer_interrupt+0xf8/0x230 >[1294108.816533] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294108.816537] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294108.816577] </IRQ> >[1294108.816579] <TASK> >[1294108.816581] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294108.816587] ? do_epoll_wait+0x15b/0x7d0 >[1294108.816591] ? fpu__restore_sig+0x75/0x90 >[1294108.816595] ? restore_sigcontext+0x16f/0x1d0 >[1294108.816599] __x64_sys_epoll_wait+0x73/0x110 >[1294108.816603] do_syscall_64+0x5f/0x90 >[1294108.816607] ? __do_sys_rt_sigreturn+0xe1/0xf0 >[1294108.816610] ? syscall_exit_to_user_mode+0x1b/0x40 >[1294108.816612] ? do_syscall_64+0x6b/0x90 >[1294108.816615] ? syscall_exit_to_user_mode+0x1b/0x40 >[1294108.816618] ? do_syscall_64+0x6b/0x90 >[1294108.816621] ? __do_sys_rt_sigreturn+0xe1/0xf0 >[1294108.816624] ? syscall_exit_to_user_mode+0x1b/0x40 >[1294108.816627] ? do_syscall_64+0x6b/0x90 >[1294108.816633] ? do_syscall_64+0x6b/0x90 >[1294108.816637] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1294108.816640] RIP: 0033:0x7f8417173157 >[1294108.816650] Code: 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa 80 3d ad f4 0c 00 00 41 89 ca 74 10 b8 e8 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 59 c3 48 83 ec 28 89 54 24 18 48 89 74 24 10 >[1294108.816653] RSP: 002b:00007ffd75f20f18 EFLAGS: 00000202 ORIG_RAX: 00000000000000e8 >[1294108.816655] RAX: ffffffffffffffda RBX: 0000000000002710 RCX: 00007f8417173157 >[1294108.816657] RDX: 0000000000000001 RSI: 00007ffd75f20f4c RDI: 0000000000000003 >[1294108.816659] RBP: 000055ca478f9180 R08: 000757acae212259 R09: 000055ca478f9370 >[1294108.816661] R10: 0000000000002710 R11: 0000000000000202 R12: 00007f84173a0ee0 >[1294108.816662] R13: 00007ffd75f21380 R14: 000055ca473082d8 R15: 00007f8417428000 >[1294108.816666] </TASK> >[1294288.760205] rcu: INFO: rcu_preempt self-detected stall on CPU >[1294288.760216] rcu: 0-...!: (24044 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277452/113277452 fqs=1 >[1294288.760223] rcu: (t=240032 jiffies g=128827765 q=3922 ncpus=1) >[1294288.760227] rcu: rcu_preempt kthread timer wakeup didn't happen for 179844 jiffies! g128827765 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1294288.760231] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940865 >[1294288.760234] rcu: rcu_preempt kthread starved for 179847 jiffies! g128827765 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1294288.760237] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1294288.760239] rcu: RCU grace-period kthread stack dump: >[1294288.760241] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1294288.760247] Call Trace: >[1294288.760250] <TASK> >[1294288.760258] __schedule+0x449/0x1480 >[1294288.760268] ? lock_timer_base+0x61/0x80 >[1294288.760276] schedule+0x5e/0xd0 >[1294288.760306] schedule_timeout+0x98/0x160 >[1294288.760311] ? __pfx_process_timeout+0x10/0x10 >[1294288.760315] rcu_gp_fqs_loop+0x141/0x520 >[1294288.760321] ? __note_gp_changes+0x153/0x1a0 >[1294288.760324] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1294288.760327] rcu_gp_kthread+0xea/0x1e0 >[1294288.760330] kthread+0xde/0x110 >[1294288.760335] ? __pfx_kthread+0x10/0x10 >[1294288.760339] ret_from_fork+0x2c/0x50 >[1294288.760346] </TASK> >[1294288.760347] rcu: Stack dump where RCU GP kthread last ran: >[1294288.760350] CPU: 0 PID: 27 Comm: kcompactd0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294288.760354] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294288.760357] RIP: 0010:_raw_spin_lock+0x17/0x30 >[1294288.760362] Code: 00 66 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 65 ff 05 98 11 08 7c 31 c0 ba 01 00 00 00 <3e> 0f b1 17 75 05 e9 3e 14 00 00 89 c6 e8 97 01 00 00 90 e9 31 14 >[1294288.760365] RSP: 0018:ffffb5d8000e3c28 EFLAGS: 00010246 >[1294288.760369] RAX: 0000000000000000 RBX: ffffe06280623440 RCX: 0000000000000000 >[1294288.760372] RDX: 0000000000000001 RSI: 000000000000000c RDI: ffff99a0d88d1010 >[1294288.760374] RBP: ffff99a0d88d1000 R08: 0000000000000001 R09: 0000000000623440 >[1294288.760376] R10: 0000000000000001 R11: 0000000000000030 R12: ffff99a0d88d1010 >[1294288.760378] R13: 00000000000188d1 R14: 0000000000000000 R15: ffffb5d8000e3df0 >[1294288.760381] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294288.760383] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294288.760385] CR2: 00007f436bf73000 CR3: 00000000484ac000 CR4: 00000000000106f0 >[1294288.760390] Call Trace: >[1294288.760392] <IRQ> >[1294288.760394] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1294288.760399] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1294288.760402] ? sched_slice+0x87/0x140 >[1294288.760408] ? timekeeping_update+0xdd/0x130 >[1294288.760412] ? timekeeping_advance+0x377/0x590 >[1294288.760417] ? update_process_times+0x74/0xb0 >[1294288.760421] ? tick_sched_handle+0x22/0x60 >[1294288.760425] ? tick_sched_timer+0x67/0x80 >[1294288.760429] ? __pfx_tick_sched_timer+0x10/0x10 >[1294288.760432] ? __hrtimer_run_queues+0x112/0x2b0 >[1294288.760437] ? hrtimer_interrupt+0xf8/0x230 >[1294288.760441] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294288.760446] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294288.760451] </IRQ> >[1294288.760453] <TASK> >[1294288.760454] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294288.760462] ? _raw_spin_lock+0x17/0x30 >[1294288.760466] z3fold_page_isolate+0x5e/0x160 >[1294288.760473] isolate_movable_page+0x9d/0x130 >[1294288.760478] isolate_migratepages_block+0xbd0/0x1680 >[1294288.760485] compact_zone+0x38e/0xde0 >[1294288.760489] ? __compaction_suitable+0x3a/0xb0 >[1294288.760493] proactive_compact_node+0x87/0xe0 >[1294288.760498] kcompactd+0x357/0x430 >[1294288.760502] ? __pfx_autoremove_wake_function+0x10/0x10 >[1294288.760507] ? __pfx_kcompactd+0x10/0x10 >[1294288.760510] kthread+0xde/0x110 >[1294288.760514] ? __pfx_kthread+0x10/0x10 >[1294288.760517] ret_from_fork+0x2c/0x50 >[1294288.760523] </TASK> >[1294288.760535] CPU: 0 PID: 27 Comm: kcompactd0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294288.760539] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294288.760540] RIP: 0010:_raw_spin_lock+0x17/0x30 >[1294288.760545] Code: 00 66 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 0f 1f 44 00 00 65 ff 05 98 11 08 7c 31 c0 ba 01 00 00 00 <3e> 0f b1 17 75 05 e9 3e 14 00 00 89 c6 e8 97 01 00 00 90 e9 31 14 >[1294288.760548] RSP: 0018:ffffb5d8000e3c28 EFLAGS: 00010246 >[1294288.760550] RAX: 0000000000000000 RBX: ffffe06280623440 RCX: 0000000000000000 >[1294288.760552] RDX: 0000000000000001 RSI: 000000000000000c RDI: ffff99a0d88d1010 >[1294288.760554] RBP: ffff99a0d88d1000 R08: 0000000000000001 R09: 0000000000623440 >[1294288.760556] R10: 0000000000000001 R11: 0000000000000030 R12: ffff99a0d88d1010 >[1294288.760558] R13: 00000000000188d1 R14: 0000000000000000 R15: ffffb5d8000e3df0 >[1294288.760560] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294288.760562] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294288.760566] CR2: 00007f436bf73000 CR3: 00000000484ac000 CR4: 00000000000106f0 >[1294288.760568] Call Trace: >[1294288.760569] <IRQ> >[1294288.760571] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1294288.760575] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1294288.760578] ? sched_slice+0x87/0x140 >[1294288.760581] ? timekeeping_update+0xdd/0x130 >[1294288.760585] ? timekeeping_advance+0x377/0x590 >[1294288.760590] ? update_process_times+0x74/0xb0 >[1294288.760593] ? tick_sched_handle+0x22/0x60 >[1294288.760597] ? tick_sched_timer+0x67/0x80 >[1294288.760600] ? __pfx_tick_sched_timer+0x10/0x10 >[1294288.760603] ? __hrtimer_run_queues+0x112/0x2b0 >[1294288.760607] ? hrtimer_interrupt+0xf8/0x230 >[1294288.760611] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294288.760615] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294288.760619] </IRQ> >[1294288.760620] <TASK> >[1294288.760622] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294288.760626] ? _raw_spin_lock+0x17/0x30 >[1294288.760630] z3fold_page_isolate+0x5e/0x160 >[1294288.760635] isolate_movable_page+0x9d/0x130 >[1294288.760638] isolate_migratepages_block+0xbd0/0x1680 >[1294288.760643] compact_zone+0x38e/0xde0 >[1294288.760647] ? __compaction_suitable+0x3a/0xb0 >[1294288.760651] proactive_compact_node+0x87/0xe0 >[1294288.760657] kcompactd+0x357/0x430 >[1294288.760660] ? __pfx_autoremove_wake_function+0x10/0x10 >[1294288.760664] ? __pfx_kcompactd+0x10/0x10 >[1294288.760668] kthread+0xde/0x110 >[1294288.760671] ? __pfx_kthread+0x10/0x10 >[1294288.760675] ret_from_fork+0x2c/0x50 >[1294288.760680] </TASK> >[1294367.588359] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ksoftirqd/0:15] >[1294367.588371] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1294367.588447] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294367.588451] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294367.588454] RIP: 0010:kmem_cache_free+0x122/0x3b0 >[1294367.588464] Code: 03 15 2a b5 5a 01 48 29 d0 8b 55 20 89 c1 48 0f af d1 0f b6 4d 24 48 c1 ea 20 29 d0 d3 e8 0f b6 4d 25 01 d0 d3 e8 48 8d 34 c6 <4c> 8b 36 4d 85 f6 74 76 48 c7 06 00 00 00 00 8b 75 18 4c 89 f7 48 >[1294367.588467] RSP: 0018:ffffb5d800083a38 EFLAGS: 00010212 >[1294367.588471] RAX: 0000000000000007 RBX: ffff99a1cb06e700 RCX: 0000000000000007 >[1294367.588473] RDX: 0000000000000000 RSI: ffff99a0cb1253b8 RDI: 0000000000002000 >[1294367.588476] RBP: ffff99a1c03d5c00 R08: ffffb5d800083801 R09: ffffffff86b65e80 >[1294367.588478] R10: 0000000000000001 R11: 0000000000000000 R12: ffffe062842c1b80 >[1294367.588479] R13: ffffffff83e2b679 R14: ffff99a1ca9d5400 R15: ffff99a1cd349460 >[1294367.588482] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294367.588485] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294367.588487] CR2: 00005586b5bd78c0 CR3: 000000012d2e0000 CR4: 00000000000106f0 >[1294367.588491] Call Trace: >[1294367.588495] <IRQ> >[1294367.588500] ? watchdog_timer_fn+0x1a8/0x210 >[1294367.588506] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1294367.588510] ? __hrtimer_run_queues+0x112/0x2b0 >[1294367.588515] ? hrtimer_interrupt+0xf8/0x230 >[1294367.588519] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294367.588524] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294367.588530] </IRQ> >[1294367.588531] <TASK> >[1294367.588533] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294367.588537] ? arp_process+0x309/0x960 >[1294367.588544] ? kmem_cache_free+0x122/0x3b0 >[1294367.588548] ? kmem_cache_free+0x19/0x3b0 >[1294367.588551] arp_process+0x309/0x960 >[1294367.588556] ? __skb_clone+0x29/0x110 >[1294367.588561] ? arp_rcv+0x78/0x1f0 >[1294367.588565] __netif_receive_skb_core.constprop.0+0x3b8/0xf70 >[1294367.588570] ? ip_list_rcv+0x13d/0x170 >[1294367.588575] __netif_receive_skb_list_core+0x13a/0x2c0 >[1294367.588579] netif_receive_skb_list_internal+0x1d1/0x310 >[1294367.588583] napi_gro_receive+0xd0/0x210 >[1294367.588589] e1000_clean_rx_irq+0x1c8/0x500 [e1000] >[1294367.588605] e1000_clean+0x28c/0x990 [e1000] >[1294367.588619] ? __pfx_delayed_work_timer_fn+0x10/0x10 >[1294367.588624] __napi_poll+0x2b/0x1c0 >[1294367.588628] net_rx_action+0x29f/0x350 >[1294367.588632] __do_softirq+0xd4/0x2c8 >[1294367.588637] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1294367.588641] run_ksoftirqd+0x2c/0x40 >[1294367.588646] smpboot_thread_fn+0xdc/0x1d0 >[1294367.588649] kthread+0xde/0x110 >[1294367.588653] ? __pfx_kthread+0x10/0x10 >[1294367.588656] ret_from_fork+0x2c/0x50 >[1294367.588663] </TASK> >[1294453.618235] rcu: INFO: rcu_preempt self-detected stall on CPU >[1294453.618246] rcu: 0-...!: (847 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277453/113277453 fqs=0 >[1294453.618253] rcu: (t=60017 jiffies g=128827769 q=3960 ncpus=1) >[1294453.618257] rcu: rcu_preempt kthread timer wakeup didn't happen for 60014 jiffies! g128827769 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1294453.618261] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940866 >[1294453.618263] rcu: rcu_preempt kthread starved for 60017 jiffies! g128827769 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1294453.618266] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1294453.618268] rcu: RCU grace-period kthread stack dump: >[1294453.618269] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1294453.618275] Call Trace: >[1294453.618278] <TASK> >[1294453.618285] __schedule+0x449/0x1480 >[1294453.618297] ? lock_timer_base+0x61/0x80 >[1294453.618305] schedule+0x5e/0xd0 >[1294453.618308] schedule_timeout+0x98/0x160 >[1294453.618313] ? __pfx_process_timeout+0x10/0x10 >[1294453.618316] rcu_gp_fqs_loop+0x141/0x520 >[1294453.618322] ? __note_gp_changes+0x153/0x1a0 >[1294453.618326] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1294453.618329] rcu_gp_kthread+0xea/0x1e0 >[1294453.618332] kthread+0xde/0x110 >[1294453.618337] ? __pfx_kthread+0x10/0x10 >[1294453.618341] ret_from_fork+0x2c/0x50 >[1294453.618348] </TASK> >[1294453.618350] rcu: Stack dump where RCU GP kthread last ran: >[1294453.618352] CPU: 0 PID: 389 Comm: btrfs-transacti Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294453.618356] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294453.618358] RIP: 0010:__blk_rq_map_sg+0x79/0x4e0 >[1294453.618365] Code: 48 8b 01 49 89 fb 31 f6 48 c7 44 24 58 00 00 00 00 49 89 cf 48 c7 44 24 60 00 00 00 00 48 89 54 24 20 4c 89 64 24 50 49 89 dc <41> 8b 4c 24 2c 41 8b 6c 24 28 45 8b 54 24 30 89 4c 24 2c 85 ed 0f >[1294453.618368] RSP: 0018:ffffb5d800823508 EFLAGS: 00010246 >[1294453.618372] RAX: 0000000000000000 RBX: ffff99a0c996b300 RCX: ffffb5d8008235b8 >[1294453.618374] RDX: ffff99a1c7900a88 RSI: 0000000000000000 RDI: ffff99a1c7181220 >[1294453.618376] RBP: ffff99a1c3d11000 R08: ffffb5d800823490 R09: ffffb5d8008235b8 >[1294453.618378] R10: ffff99a1c7900a88 R11: ffff99a1c7181220 R12: ffff99a0c996b300 >[1294453.618381] R13: ffff99a1c7900a28 R14: ffff99a1c7900840 R15: ffffb5d8008235b8 >[1294453.618383] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294453.618386] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294453.618388] CR2: 00005586b5bd78c0 CR3: 000000013b57e000 CR4: 00000000000106f0 >[1294453.618393] Call Trace: >[1294453.618412] <IRQ> >[1294453.618415] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1294453.618420] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1294453.618424] ? sched_slice+0x87/0x140 >[1294453.618429] ? timekeeping_update+0xdd/0x130 >[1294453.618433] ? timekeeping_advance+0x377/0x590 >[1294453.618437] ? update_process_times+0x74/0xb0 >[1294453.618440] ? tick_sched_handle+0x22/0x60 >[1294453.618445] ? tick_sched_timer+0x67/0x80 >[1294453.618448] ? __pfx_tick_sched_timer+0x10/0x10 >[1294453.618451] ? __hrtimer_run_queues+0x112/0x2b0 >[1294453.618455] ? hrtimer_interrupt+0xf8/0x230 >[1294453.618459] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294453.618463] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294453.618468] </IRQ> >[1294453.618470] <TASK> >[1294453.618471] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294453.618480] ? __blk_rq_map_sg+0x79/0x4e0 >[1294453.618484] ? __sg_alloc_table+0x76/0x180 >[1294453.618488] scsi_alloc_sgtables+0xaf/0x3e0 >[1294453.618494] sd_init_command+0x14c/0xa70 >[1294453.618499] scsi_queue_rq+0x885/0xc80 >[1294453.618504] blk_mq_dispatch_rq_list+0x2f6/0x880 >[1294453.618509] ? bfq_dispatch_request+0xf0/0x1230 >[1294453.618515] blk_mq_do_dispatch_sched+0x324/0x3c0 >[1294453.618520] __blk_mq_sched_dispatch_requests+0xec/0x130 >[1294453.618524] blk_mq_sched_dispatch_requests+0x34/0x60 >[1294453.618527] __blk_mq_run_hw_queue+0x70/0x90 >[1294453.618530] blk_mq_sched_insert_requests+0x73/0x170 >[1294453.618537] blk_mq_flush_plug_list+0x137/0x300 >[1294453.618544] blk_add_rq_to_plug+0xa4/0x150 >[1294453.618548] blk_mq_submit_bio+0x370/0x5e0 >[1294453.618552] __submit_bio+0xf5/0x180 >[1294453.618557] submit_bio_noacct_nocheck+0x332/0x370 >[1294453.618561] __btrfs_submit_bio+0x89/0x140 >[1294453.618567] btrfs_submit_chunk+0x150/0x4c0 >[1294453.618572] btrfs_submit_bio+0x1a/0x30 >[1294453.618575] submit_one_bio+0x61/0x1b0 >[1294453.618580] btree_write_cache_pages+0x85e/0x8d0 >[1294453.618585] ? __pfx_end_bio_extent_buffer_writepage+0x10/0x10 >[1294453.618590] do_writepages+0xd2/0x1e0 >[1294453.618596] ? merge_state.part.0+0x46/0x100 >[1294453.618600] filemap_fdatawrite_wbc+0x63/0x90 >[1294453.618604] __filemap_fdatawrite_range+0x5c/0x80 >[1294453.618609] btrfs_write_marked_extents+0x72/0x150 >[1294453.618614] btrfs_write_and_wait_transaction+0x70/0xf0 >[1294453.618618] btrfs_commit_transaction+0x8c4/0xf00 >[1294453.618622] ? start_transaction+0xc5/0x5c0 >[1294453.618626] transaction_kthread+0x141/0x1b0 >[1294453.618630] ? __pfx_transaction_kthread+0x10/0x10 >[1294453.618633] kthread+0xde/0x110 >[1294453.618636] ? __pfx_kthread+0x10/0x10 >[1294453.618639] ret_from_fork+0x2c/0x50 >[1294453.618645] </TASK> >[1294453.618656] CPU: 0 PID: 389 Comm: btrfs-transacti Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294453.618659] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294453.618661] RIP: 0010:__blk_rq_map_sg+0x79/0x4e0 >[1294453.618665] Code: 48 8b 01 49 89 fb 31 f6 48 c7 44 24 58 00 00 00 00 49 89 cf 48 c7 44 24 60 00 00 00 00 48 89 54 24 20 4c 89 64 24 50 49 89 dc <41> 8b 4c 24 2c 41 8b 6c 24 28 45 8b 54 24 30 89 4c 24 2c 85 ed 0f >[1294453.618668] RSP: 0018:ffffb5d800823508 EFLAGS: 00010246 >[1294453.618671] RAX: 0000000000000000 RBX: ffff99a0c996b300 RCX: ffffb5d8008235b8 >[1294453.618673] RDX: ffff99a1c7900a88 RSI: 0000000000000000 RDI: ffff99a1c7181220 >[1294453.618675] RBP: ffff99a1c3d11000 R08: ffffb5d800823490 R09: ffffb5d8008235b8 >[1294453.618677] R10: ffff99a1c7900a88 R11: ffff99a1c7181220 R12: ffff99a0c996b300 >[1294453.618679] R13: ffff99a1c7900a28 R14: ffff99a1c7900840 R15: ffffb5d8008235b8 >[1294453.618681] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294453.618683] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294453.618685] CR2: 00005586b5bd78c0 CR3: 000000013b57e000 CR4: 00000000000106f0 >[1294453.618690] Call Trace: >[1294453.618692] <IRQ> >[1294453.618693] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1294453.618698] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1294453.618701] ? sched_slice+0x87/0x140 >[1294453.618705] ? timekeeping_update+0xdd/0x130 >[1294453.618709] ? timekeeping_advance+0x377/0x590 >[1294453.618713] ? update_process_times+0x74/0xb0 >[1294453.618716] ? tick_sched_handle+0x22/0x60 >[1294453.618719] ? tick_sched_timer+0x67/0x80 >[1294453.618722] ? __pfx_tick_sched_timer+0x10/0x10 >[1294453.618726] ? __hrtimer_run_queues+0x112/0x2b0 >[1294453.618730] ? hrtimer_interrupt+0xf8/0x230 >[1294453.618734] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294453.618737] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294453.618741] </IRQ> >[1294453.618742] <TASK> >[1294453.618763] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294453.618769] ? __blk_rq_map_sg+0x79/0x4e0 >[1294453.618774] ? __sg_alloc_table+0x76/0x180 >[1294453.618778] scsi_alloc_sgtables+0xaf/0x3e0 >[1294453.618782] sd_init_command+0x14c/0xa70 >[1294453.618786] scsi_queue_rq+0x885/0xc80 >[1294453.618789] blk_mq_dispatch_rq_list+0x2f6/0x880 >[1294453.618793] ? bfq_dispatch_request+0xf0/0x1230 >[1294453.618797] blk_mq_do_dispatch_sched+0x324/0x3c0 >[1294453.618802] __blk_mq_sched_dispatch_requests+0xec/0x130 >[1294453.618806] blk_mq_sched_dispatch_requests+0x34/0x60 >[1294453.618809] __blk_mq_run_hw_queue+0x70/0x90 >[1294453.618812] blk_mq_sched_insert_requests+0x73/0x170 >[1294453.618816] blk_mq_flush_plug_list+0x137/0x300 >[1294453.618821] blk_add_rq_to_plug+0xa4/0x150 >[1294453.618824] blk_mq_submit_bio+0x370/0x5e0 >[1294453.618829] __submit_bio+0xf5/0x180 >[1294453.618832] submit_bio_noacct_nocheck+0x332/0x370 >[1294453.618836] __btrfs_submit_bio+0x89/0x140 >[1294453.618840] btrfs_submit_chunk+0x150/0x4c0 >[1294453.618845] btrfs_submit_bio+0x1a/0x30 >[1294453.618848] submit_one_bio+0x61/0x1b0 >[1294453.618851] btree_write_cache_pages+0x85e/0x8d0 >[1294453.618856] ? __pfx_end_bio_extent_buffer_writepage+0x10/0x10 >[1294453.618861] do_writepages+0xd2/0x1e0 >[1294453.618865] ? merge_state.part.0+0x46/0x100 >[1294453.618869] filemap_fdatawrite_wbc+0x63/0x90 >[1294453.618872] __filemap_fdatawrite_range+0x5c/0x80 >[1294453.618876] btrfs_write_marked_extents+0x72/0x150 >[1294453.618879] btrfs_write_and_wait_transaction+0x70/0xf0 >[1294453.618882] btrfs_commit_transaction+0x8c4/0xf00 >[1294453.618886] ? start_transaction+0xc5/0x5c0 >[1294453.618890] transaction_kthread+0x141/0x1b0 >[1294453.618893] ? __pfx_transaction_kthread+0x10/0x10 >[1294453.618896] kthread+0xde/0x110 >[1294453.618899] ? __pfx_kthread+0x10/0x10 >[1294453.618903] ret_from_fork+0x2c/0x50 >[1294453.618908] </TASK> >[1294563.626426] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [systemd:1] >[1294563.626440] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1294563.626520] CPU: 0 PID: 1 Comm: systemd Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294563.626524] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294563.626527] RIP: 0010:avtab_search_node+0xbc/0x130 >[1294563.626537] Code: 31 c8 69 c0 6b ca eb 85 41 89 c1 41 c1 e9 0d 44 31 c8 69 c0 35 ae b2 c2 41 89 c1 41 c1 e9 10 44 31 c8 23 42 10 48 8b 12 48 98 <48> 8b 04 c2 48 85 c0 74 35 41 0f b7 50 06 66 81 e2 ff 7f 41 89 d0 >[1294563.626541] RSP: 0018:ffffb5d800013a00 EFLAGS: 00010202 >[1294563.626544] RAX: 0000000000005ea2 RBX: ffff99a1c2b6a8c8 RCX: 000000000000014d >[1294563.626547] RDX: ffff99a0e2540000 RSI: 000000000000013f RDI: 0000000000000007 >[1294563.626549] RBP: ffffb5d800013a98 R08: ffffb5d800013a98 R09: 0000000000002bb5 >[1294563.626552] R10: ffff99a212510000 R11: 0000000000000002 R12: ffffb5d800013b80 >[1294563.626554] R13: ffffb5d800013c04 R14: 000000000000013e R15: 000000000000014d >[1294563.626556] FS: 00007f54db786440(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294563.626580] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294563.626583] CR2: 00005586b5bd78c0 CR3: 000000010715e000 CR4: 00000000000106f0 >[1294563.626587] Call Trace: >[1294563.626591] <IRQ> >[1294563.626598] ? watchdog_timer_fn+0x1a8/0x210 >[1294563.626604] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1294563.626608] ? __hrtimer_run_queues+0x112/0x2b0 >[1294563.626614] ? hrtimer_interrupt+0xf8/0x230 >[1294563.626618] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294563.626623] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294563.626629] </IRQ> >[1294563.626631] <TASK> >[1294563.626632] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294563.626640] ? avtab_search_node+0xbc/0x130 >[1294563.626644] cond_compute_av+0x3a/0xd0 >[1294563.626649] context_struct_compute_av+0x27a/0x4d0 >[1294563.626654] security_compute_av+0x11a/0x2c0 >[1294563.626658] avc_compute_av.isra.0+0x58/0x200 >[1294563.626664] avc_has_perm_noaudit+0xe6/0x120 >[1294563.626669] selinux_inode_permission+0x136/0x1b0 >[1294563.626674] security_inode_permission+0x3e/0x60 >[1294563.626679] link_path_walk.part.0.constprop.0+0x29c/0x380 >[1294563.626686] ? path_init+0x287/0x3c0 >[1294563.626689] path_openat+0xae/0x1110 >[1294563.626693] ? do_filp_open+0xb3/0x160 >[1294563.626696] ? xa_load+0x8c/0xe0 >[1294563.626701] do_filp_open+0xb3/0x160 >[1294563.626708] do_sys_openat2+0xaf/0x170 >[1294563.626713] __x64_sys_openat+0x6e/0xa0 >[1294563.626717] do_syscall_64+0x5f/0x90 >[1294563.626722] ? syscall_exit_to_user_mode+0x1b/0x40 >[1294563.626725] ? do_syscall_64+0x6b/0x90 >[1294563.626729] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1294563.626733] RIP: 0033:0x7f54db31dfb0 >[1294563.713878] Code: 48 89 44 24 20 75 97 44 89 54 24 0c e8 29 c6 f8 ff 44 8b 54 24 0c 89 da 48 89 ee 41 89 c0 bf 9c ff ff ff b8 01 01 00 00 0f 05 <48> 3d 00 f0 ff ff 77 38 44 89 c7 89 44 24 0c e8 7c c6 f8 ff 8b 44 >[1294563.713882] RSP: 002b:00007fff04aaed60 EFLAGS: 00000293 ORIG_RAX: 0000000000000101 >[1294563.713887] RAX: ffffffffffffffda RBX: 0000000000080000 RCX: 00007f54db31dfb0 >[1294563.713890] RDX: 0000000000080000 RSI: 00007f54db6a4b75 RDI: 00000000ffffff9c >[1294563.713892] RBP: 00007f54db6a4b75 R08: 0000000000000000 R09: 0000000000000001 >[1294563.713894] R10: 0000000000000000 R11: 0000000000000293 R12: 00007f54db6a4b75 >[1294563.713896] R13: 00007f54db668ac3 R14: 0000000000000001 R15: 00000000000003a1 >[1294563.713904] </TASK> >[1294633.711126] rcu: INFO: rcu_preempt self-detected stall on CPU >[1294633.711136] rcu: 0-...!: (7396 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277453/113277453 fqs=1 >[1294633.711143] rcu: (t=240114 jiffies g=128827769 q=3967 ncpus=1) >[1294633.711147] rcu: rcu_preempt kthread timer wakeup didn't happen for 156809 jiffies! g128827769 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1294633.711151] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940867 >[1294633.711153] rcu: rcu_preempt kthread starved for 156812 jiffies! g128827769 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1294633.711157] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1294633.711159] rcu: RCU grace-period kthread stack dump: >[1294633.711160] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1294633.711167] Call Trace: >[1294633.711169] <TASK> >[1294633.711176] __schedule+0x449/0x1480 >[1294633.711186] ? lock_timer_base+0x61/0x80 >[1294633.711194] schedule+0x5e/0xd0 >[1294633.711199] schedule_timeout+0x98/0x160 >[1294633.711208] ? __pfx_process_timeout+0x10/0x10 >[1294633.711212] rcu_gp_fqs_loop+0x141/0x520 >[1294633.711217] ? __note_gp_changes+0x153/0x1a0 >[1294633.711221] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1294633.711224] rcu_gp_kthread+0xea/0x1e0 >[1294633.711227] kthread+0xde/0x110 >[1294633.711232] ? __pfx_kthread+0x10/0x10 >[1294633.711236] ret_from_fork+0x2c/0x50 >[1294633.711243] </TASK> >[1294633.711244] rcu: Stack dump where RCU GP kthread last ran: >[1294633.711247] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294633.711251] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294633.711253] RIP: 0010:ip6_finish_output2+0xf2/0x6f0 >[1294633.711259] Code: 3f 04 00 00 41 8b 46 18 48 89 d9 41 8b 7c 24 04 41 8b 74 24 0c 4c 8b 0d e4 d5 41 01 48 c1 e9 20 41 8b 54 24 08 48 31 d9 31 c8 <41> 8b 49 10 41 0f af 41 0c 0f af cf 01 c8 41 8b 49 18 0f af ce 01 >[1294633.711262] RSP: 0018:ffffb5d800083b40 EFLAGS: 00010206 >[1294633.711266] RAX: 000000003d09788b RBX: ffff99a1c8f8e000 RCX: ffff99a1370779a1 >[1294633.711269] RDX: 0000000000000000 RSI: 0000000050010000 RDI: 00000000702a2600 >[1294633.711271] RBP: ffff99a1d1514000 R08: ffffffff86b65e80 R09: ffff99a0df0d5200 >[1294633.711273] R10: ffff99a1c798a000 R11: 0000000000000004 R12: ffff99a1c8111428 >[1294633.711275] R13: ffff99a0cb09d700 R14: ffff99a1c8111410 R15: ffff99a1c0c0dc80 >[1294633.711278] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294633.711280] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294633.711283] CR2: 00005586b5bd78c0 CR3: 000000013b57c000 CR4: 00000000000106f0 >[1294633.711286] Call Trace: >[1294633.711288] <IRQ> >[1294633.711290] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1294633.711295] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1294633.711298] ? sched_slice+0x87/0x140 >[1294633.711303] ? timekeeping_update+0xdd/0x130 >[1294633.711308] ? timekeeping_advance+0x377/0x590 >[1294633.711312] ? update_process_times+0x74/0xb0 >[1294633.711316] ? tick_sched_handle+0x22/0x60 >[1294633.711320] ? tick_sched_timer+0x67/0x80 >[1294633.711323] ? __pfx_tick_sched_timer+0x10/0x10 >[1294633.711327] ? __hrtimer_run_queues+0x112/0x2b0 >[1294633.711331] ? hrtimer_interrupt+0xf8/0x230 >[1294633.711335] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294633.711340] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294633.711345] </IRQ> >[1294633.711346] <TASK> >[1294633.711348] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294633.711353] ? ip6_finish_output2+0xf2/0x6f0 >[1294633.711357] ? nf_hook_slow+0x45/0xc0 >[1294633.711363] ip6_finish_output+0x1c5/0x320 >[1294633.711368] ndisc_send_skb+0x1cd/0x300 >[1294633.711374] ndisc_send_ns+0x70/0xc0 >[1294633.711378] ndisc_solicit+0x14a/0x190 >[1294633.711382] neigh_probe+0x51/0x70 >[1294633.711387] neigh_timer_handler+0x231/0x320 >[1294633.711391] ? __pfx_neigh_timer_handler+0x10/0x10 >[1294633.711394] call_timer_fn+0x27/0x130 >[1294633.711398] ? __pfx_neigh_timer_handler+0x10/0x10 >[1294633.711401] __run_timers+0x222/0x2c0 >[1294633.711405] run_timer_softirq+0x1d/0x40 >[1294633.711408] __do_softirq+0xd4/0x2c8 >[1294633.711413] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1294633.711417] run_ksoftirqd+0x2c/0x40 >[1294633.711422] smpboot_thread_fn+0xdc/0x1d0 >[1294633.711425] kthread+0xde/0x110 >[1294633.711428] ? __pfx_kthread+0x10/0x10 >[1294633.711432] ret_from_fork+0x2c/0x50 >[1294633.711437] </TASK> >[1294633.711447] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294633.711450] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294633.711452] RIP: 0010:ip6_finish_output2+0xf2/0x6f0 >[1294633.711456] Code: 3f 04 00 00 41 8b 46 18 48 89 d9 41 8b 7c 24 04 41 8b 74 24 0c 4c 8b 0d e4 d5 41 01 48 c1 e9 20 41 8b 54 24 08 48 31 d9 31 c8 <41> 8b 49 10 41 0f af 41 0c 0f af cf 01 c8 41 8b 49 18 0f af ce 01 >[1294633.711459] RSP: 0018:ffffb5d800083b40 EFLAGS: 00010206 >[1294633.711461] RAX: 000000003d09788b RBX: ffff99a1c8f8e000 RCX: ffff99a1370779a1 >[1294633.711463] RDX: 0000000000000000 RSI: 0000000050010000 RDI: 00000000702a2600 >[1294633.711466] RBP: ffff99a1d1514000 R08: ffffffff86b65e80 R09: ffff99a0df0d5200 >[1294633.711468] R10: ffff99a1c798a000 R11: 0000000000000004 R12: ffff99a1c8111428 >[1294633.711470] R13: ffff99a0cb09d700 R14: ffff99a1c8111410 R15: ffff99a1c0c0dc80 >[1294633.711472] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294633.711474] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294633.711476] CR2: 00005586b5bd78c0 CR3: 000000013b57c000 CR4: 00000000000106f0 >[1294633.711479] Call Trace: >[1294633.711480] <IRQ> >[1294633.711482] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1294633.711486] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1294633.711489] ? sched_slice+0x87/0x140 >[1294633.711493] ? timekeeping_update+0xdd/0x130 >[1294633.711497] ? timekeeping_advance+0x377/0x590 >[1294633.711502] ? update_process_times+0x74/0xb0 >[1294633.711505] ? tick_sched_handle+0x22/0x60 >[1294633.711509] ? tick_sched_timer+0x67/0x80 >[1294633.711512] ? __pfx_tick_sched_timer+0x10/0x10 >[1294633.711516] ? __hrtimer_run_queues+0x112/0x2b0 >[1294633.711520] ? hrtimer_interrupt+0xf8/0x230 >[1294633.711524] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294633.711527] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294633.711531] </IRQ> >[1294633.711532] <TASK> >[1294633.711534] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294633.711539] ? ip6_finish_output2+0xf2/0x6f0 >[1294633.711543] ? nf_hook_slow+0x45/0xc0 >[1294633.711547] ip6_finish_output+0x1c5/0x320 >[1294633.711551] ndisc_send_skb+0x1cd/0x300 >[1294633.711556] ndisc_send_ns+0x70/0xc0 >[1294633.711560] ndisc_solicit+0x14a/0x190 >[1294633.711565] neigh_probe+0x51/0x70 >[1294633.711568] neigh_timer_handler+0x231/0x320 >[1294633.711571] ? __pfx_neigh_timer_handler+0x10/0x10 >[1294633.711575] call_timer_fn+0x27/0x130 >[1294633.711578] ? __pfx_neigh_timer_handler+0x10/0x10 >[1294633.711581] __run_timers+0x222/0x2c0 >[1294633.711585] run_timer_softirq+0x1d/0x40 >[1294633.711588] __do_softirq+0xd4/0x2c8 >[1294633.711593] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1294633.711596] run_ksoftirqd+0x2c/0x40 >[1294633.711600] smpboot_thread_fn+0xdc/0x1d0 >[1294633.711603] kthread+0xde/0x110 >[1294633.711606] ? __pfx_kthread+0x10/0x10 >[1294633.711609] ret_from_fork+0x2c/0x50 >[1294633.711615] </TASK> >[1294659.587500] watchdog: BUG: soft lockup - CPU#0 stuck for 29s! [ksoftirqd/0:15] >[1294659.587512] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1294659.587588] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294659.587592] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294659.587595] RIP: 0010:vbg_req_perform+0x2c/0x40 [vboxguest] >[1294659.587607] Code: 1f 00 0f 1f 44 00 00 b8 00 00 00 80 48 01 f0 72 21 48 c7 c2 00 00 00 80 48 2b 15 e7 3e 4f c4 48 01 d0 0f b7 57 08 ef 0f ae f0 <8b> 46 0c e9 fc 3f b0 c3 48 8b 15 c5 ca b7 c4 eb e4 0f 1f 00 90 90 >[1294659.587611] RSP: 0018:ffffb5d800083db0 EFLAGS: 00010207 >[1294659.587614] RAX: 0000000001114000 RBX: ffff99a1c3d66298 RCX: 0000000000000000 >[1294659.587617] RDX: 000000000000d040 RSI: ffff99a0c1114000 RDI: ffff99a1c3d66028 >[1294659.587620] RBP: ffff99a1c3d66298 R08: ffff99a1c004f028 R09: ffffffff8505d6e0 >[1294659.587622] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffc04abd60 >[1294659.587624] R13: ffff99a1c3d66298 R14: ffffb5d800083e10 R15: ffff99a21ac21e80 >[1294659.587627] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294659.587629] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294659.587632] CR2: 00005586b5bd78c0 CR3: 000000013b57c000 CR4: 00000000000106f0 >[1294659.587636] Call Trace: >[1294659.587639] <IRQ> >[1294659.587644] ? watchdog_timer_fn+0x1a8/0x210 >[1294659.587651] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1294659.587655] ? __hrtimer_run_queues+0x112/0x2b0 >[1294659.587661] ? hrtimer_interrupt+0xf8/0x230 >[1294659.587665] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294659.587670] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294659.587676] </IRQ> >[1294659.587677] <TASK> >[1294659.587679] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294659.587684] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1294659.587694] ? vbg_req_perform+0x2c/0x40 [vboxguest] >[1294659.587702] vbg_heartbeat_timer+0x1d/0x40 [vboxguest] >[1294659.587709] call_timer_fn+0x27/0x130 >[1294659.587713] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1294659.587720] __run_timers+0x222/0x2c0 >[1294659.587725] run_timer_softirq+0x1d/0x40 >[1294659.587728] __do_softirq+0xd4/0x2c8 >[1294659.587734] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1294659.587738] run_ksoftirqd+0x2c/0x40 >[1294659.587743] smpboot_thread_fn+0xdc/0x1d0 >[1294659.587746] kthread+0xde/0x110 >[1294659.587750] ? __pfx_kthread+0x10/0x10 >[1294659.587754] ret_from_fork+0x2c/0x50 >[1294659.587760] </TASK> >[1294687.631240] watchdog: BUG: soft lockup - CPU#0 stuck for 55s! [ksoftirqd/0:15] >[1294687.631251] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1294687.631327] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294687.631331] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294687.631334] RIP: 0010:ndisc_recv_ns+0x542/0x7b0 >[1294687.631344] Code: c9 41 b8 01 00 00 00 50 85 f6 48 8b 54 24 08 45 0f b6 c9 0f 95 c1 4c 89 fe 41 21 c1 e8 87 f3 ff ff 49 8d 7d 30 b8 ff ff ff ff <3e> 41 0f c1 45 30 83 f8 01 41 58 4c 8b 54 24 08 0f 84 d9 01 00 00 >[1294687.631347] RSP: 0018:ffffb5d8000838b8 EFLAGS: 00010246 >[1294687.631351] RAX: 00000000ffffffff RBX: ffff99a1c7e37890 RCX: 00000000000000d6 >[1294687.631354] RDX: ffff99a1c3d24c40 RSI: 00000000fffffe01 RDI: ffff99a0d2030c30 >[1294687.631356] RBP: ffff99a1c8f8e000 R08: ffff99a1c8f8e000 R09: 00000000dc328000 >[1294687.631358] R10: 0000000000000000 R11: 0000000108111b82 R12: 0000000000000000 >[1294687.631360] R13: ffff99a0d2030c00 R14: ffff99a1c798a000 R15: ffff99a1c7e37856 >[1294687.631363] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294687.631365] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294687.631368] CR2: 00005586b5bd78c0 CR3: 000000013b57c000 CR4: 00000000000106f0 >[1294687.631372] Call Trace: >[1294687.631376] <IRQ> >[1294687.631383] ? watchdog_timer_fn+0x1a8/0x210 >[1294687.631389] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1294687.631394] ? __hrtimer_run_queues+0x112/0x2b0 >[1294687.631399] ? hrtimer_interrupt+0xf8/0x230 >[1294687.631403] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294687.631408] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294687.631413] </IRQ> >[1294687.631414] <TASK> >[1294687.631416] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294687.631424] ? ndisc_recv_ns+0x542/0x7b0 >[1294687.631427] ? ndisc_recv_ns+0x539/0x7b0 >[1294687.631433] icmpv6_rcv+0x425/0x590 >[1294687.631438] ip6_protocol_deliver_rcu+0x3be/0x490 >[1294687.631443] ip6_input_finish+0x43/0x60 >[1294687.631447] ip6_mc_input+0xee/0x2c0 >[1294687.631451] ip6_sublist_rcv_finish+0x85/0x90 >[1294687.631455] ip6_sublist_rcv+0x22f/0x2f0 >[1294687.631479] ? __pfx_ip6_rcv_finish+0x10/0x10 >[1294687.631484] ipv6_list_rcv+0x13f/0x170 >[1294687.631488] __netif_receive_skb_list_core+0x97/0x2c0 >[1294687.631495] netif_receive_skb_list_internal+0x1d1/0x310 >[1294687.631499] napi_gro_receive+0xd0/0x210 >[1294687.631504] e1000_clean_rx_irq+0x1c8/0x500 [e1000] >[1294687.631519] e1000_clean+0x28c/0x990 [e1000] >[1294687.631533] __napi_poll+0x2b/0x1c0 >[1294687.631537] net_rx_action+0x29f/0x350 >[1294687.631541] __do_softirq+0xd4/0x2c8 >[1294687.631546] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1294687.631550] run_ksoftirqd+0x2c/0x40 >[1294687.631555] smpboot_thread_fn+0xdc/0x1d0 >[1294687.631558] kthread+0xde/0x110 >[1294687.631562] ? __pfx_kthread+0x10/0x10 >[1294687.631566] ret_from_fork+0x2c/0x50 >[1294687.631572] </TASK> >[1294752.570113] rcu: INFO: rcu_preempt self-detected stall on CPU >[1294752.570124] rcu: 0-...!: (1644 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277454/113277454 fqs=0 >[1294752.570234] rcu: (t=60045 jiffies g=128827773 q=4059 ncpus=1) >[1294752.570238] rcu: rcu_preempt kthread timer wakeup didn't happen for 60042 jiffies! g128827773 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1294752.570242] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940867 >[1294752.570244] rcu: rcu_preempt kthread starved for 60045 jiffies! g128827773 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1294752.570248] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1294752.570249] rcu: RCU grace-period kthread stack dump: >[1294752.570251] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1294752.570258] Call Trace: >[1294752.570275] <TASK> >[1294752.570283] __schedule+0x449/0x1480 >[1294752.570294] ? lock_timer_base+0x61/0x80 >[1294752.570301] schedule+0x5e/0xd0 >[1294752.570305] schedule_timeout+0x98/0x160 >[1294752.570309] ? __pfx_process_timeout+0x10/0x10 >[1294752.570313] rcu_gp_fqs_loop+0x141/0x520 >[1294752.570318] ? __note_gp_changes+0x153/0x1a0 >[1294752.570321] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1294752.570324] rcu_gp_kthread+0xea/0x1e0 >[1294752.570327] kthread+0xde/0x110 >[1294752.570332] ? __pfx_kthread+0x10/0x10 >[1294752.570336] ret_from_fork+0x2c/0x50 >[1294752.570342] </TASK> >[1294752.570344] rcu: Stack dump where RCU GP kthread last ran: >[1294752.570346] CPU: 0 PID: 1299944 Comm: pool-udisksd Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294752.570351] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294752.570353] RIP: 0010:finish_task_switch.isra.0+0x96/0x2d0 >[1294752.570359] Code: 45 34 00 00 00 00 0f 1f 44 00 00 49 8b 9c 24 20 0a 00 00 48 85 db 0f 85 aa 00 00 00 4c 89 e7 e8 10 f6 ff ff fb 0f 1f 44 00 00 <65> 48 8b 04 25 80 32 03 00 66 90 4d 85 f6 74 21 65 48 8b 04 25 80 >[1294752.570362] RSP: 0018:ffffb5d805d57c68 EFLAGS: 00010282 >[1294752.570365] RAX: ffff99a1c0372740 RBX: 0000000000000000 RCX: 0000000000000002 >[1294752.570367] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff99a21ac33ac0 >[1294752.570370] RBP: ffffb5d805d57c90 R08: 0000000000000000 R09: 0000000000000000 >[1294752.570371] R10: 0000000000000001 R11: 0000000000000110 R12: ffff99a21ac33ac0 >[1294752.570374] R13: ffff99a1c0372740 R14: ffff99a206ccb200 R15: 0000000000000001 >[1294752.570376] FS: 00007fe15e9ff6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294752.570379] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294752.570381] CR2: 00005586b5bd78c0 CR3: 0000000102d66000 CR4: 00000000000106f0 >[1294752.570385] Call Trace: >[1294752.570387] <IRQ> >[1294752.570389] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1294752.570393] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1294752.570396] ? sched_slice+0x87/0x140 >[1294752.570401] ? timekeeping_update+0xdd/0x130 >[1294752.570405] ? timekeeping_advance+0x377/0x590 >[1294752.570409] ? update_process_times+0x74/0xb0 >[1294752.570412] ? tick_sched_handle+0x22/0x60 >[1294752.570417] ? tick_sched_timer+0x67/0x80 >[1294752.570420] ? __pfx_tick_sched_timer+0x10/0x10 >[1294752.570423] ? __hrtimer_run_queues+0x112/0x2b0 >[1294752.570427] ? hrtimer_interrupt+0xf8/0x230 >[1294752.570431] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294752.570435] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294752.570440] </IRQ> >[1294752.570442] <TASK> >[1294752.570443] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294752.570450] ? finish_task_switch.isra.0+0x96/0x2d0 >[1294752.570455] ? finish_task_switch.isra.0+0x90/0x2d0 >[1294752.570459] __schedule+0x451/0x1480 >[1294752.570462] ? reweight_entity+0x14d/0x160 >[1294752.570466] ? check_preempt_wakeup+0x17f/0x2d0 >[1294752.570470] ? timerqueue_add+0x66/0xb0 >[1294752.570474] schedule+0x5e/0xd0 >[1294752.570478] futex_wait_queue+0x64/0x90 >[1294752.570482] futex_wait+0x189/0x270 >[1294752.570485] ? __pfx_hrtimer_wakeup+0x10/0x10 >[1294752.570490] do_futex+0x10a/0x1b0 >[1294752.570493] __x64_sys_futex+0x92/0x1d0 >[1294752.570498] do_syscall_64+0x5f/0x90 >[1294752.570502] ? do_syscall_64+0x6b/0x90 >[1294752.570506] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1294752.570510] RIP: 0033:0x7fe165af992d >[1294752.914524] Code: 5d c3 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d d3 e4 0c 00 f7 d8 64 89 01 48 >[1294752.914593] RSP: 002b:00007fe15e9febf8 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca >[1294752.914599] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe165af992d >[1294752.914602] RDX: 0000000000000016 RSI: 0000000000000080 RDI: 0000563fb43f98c0 >[1294752.914605] RBP: 0000563fb43f98b0 R08: 00000000000000c0 R09: 0000000000000000 >[1294752.914607] R10: 00007fe15e9fec20 R11: 0000000000000246 R12: 0000000000000016 >[1294752.914610] R13: 0000000000000001 R14: 0000563fb43f98b8 R15: 00007fe15e1ff000 >[1294752.914621] </TASK> >[1294752.914638] CPU: 0 PID: 1299944 Comm: pool-udisksd Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294752.914660] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294752.914662] RIP: 0010:finish_task_switch.isra.0+0x96/0x2d0 >[1294752.914672] Code: 45 34 00 00 00 00 0f 1f 44 00 00 49 8b 9c 24 20 0a 00 00 48 85 db 0f 85 aa 00 00 00 4c 89 e7 e8 10 f6 ff ff fb 0f 1f 44 00 00 <65> 48 8b 04 25 80 32 03 00 66 90 4d 85 f6 74 21 65 48 8b 04 25 80 >[1294752.914675] RSP: 0018:ffffb5d805d57c68 EFLAGS: 00010282 >[1294752.914679] RAX: ffff99a1c0372740 RBX: 0000000000000000 RCX: 0000000000000002 >[1294752.914681] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff99a21ac33ac0 >[1294752.914683] RBP: ffffb5d805d57c90 R08: 0000000000000000 R09: 0000000000000000 >[1294752.914685] R10: 0000000000000001 R11: 0000000000000110 R12: ffff99a21ac33ac0 >[1294752.914687] R13: ffff99a1c0372740 R14: ffff99a206ccb200 R15: 0000000000000001 >[1294752.914690] FS: 00007fe15e9ff6c0(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294752.914692] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294752.914695] CR2: 00005586b5bd78c0 CR3: 0000000102d66000 CR4: 00000000000106f0 >[1294752.914699] Call Trace: >[1294752.914702] <IRQ> >[1294752.914720] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1294752.914729] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1294752.914733] ? sched_slice+0x87/0x140 >[1294752.914739] ? timekeeping_update+0xdd/0x130 >[1294752.914743] ? timekeeping_advance+0x377/0x590 >[1294752.914748] ? update_process_times+0x74/0xb0 >[1294752.914751] ? tick_sched_handle+0x22/0x60 >[1294752.914756] ? tick_sched_timer+0x67/0x80 >[1294752.914759] ? __pfx_tick_sched_timer+0x10/0x10 >[1294752.914763] ? __hrtimer_run_queues+0x112/0x2b0 >[1294752.914767] ? hrtimer_interrupt+0xf8/0x230 >[1294752.914771] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294752.914794] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294752.914819] </IRQ> >[1294752.914821] <TASK> >[1294752.914823] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294752.914830] ? finish_task_switch.isra.0+0x96/0x2d0 >[1294752.914834] ? finish_task_switch.isra.0+0x90/0x2d0 >[1294752.914856] __schedule+0x451/0x1480 >[1294752.914862] ? reweight_entity+0x14d/0x160 >[1294752.914866] ? check_preempt_wakeup+0x17f/0x2d0 >[1294752.914869] ? timerqueue_add+0x66/0xb0 >[1294752.914874] schedule+0x5e/0xd0 >[1294752.914877] futex_wait_queue+0x64/0x90 >[1294752.914882] futex_wait+0x189/0x270 >[1294752.914887] ? __pfx_hrtimer_wakeup+0x10/0x10 >[1294752.914892] do_futex+0x10a/0x1b0 >[1294752.914895] __x64_sys_futex+0x92/0x1d0 >[1294752.914899] do_syscall_64+0x5f/0x90 >[1294752.914922] ? do_syscall_64+0x6b/0x90 >[1294752.914927] entry_SYSCALL_64_after_hwframe+0x72/0xdc >[1294752.914930] RIP: 0033:0x7fe165af992d >[1294753.338863] Code: 5d c3 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d d3 e4 0c 00 f7 d8 64 89 01 48 >[1294753.338878] RSP: 002b:00007fe15e9febf8 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca >[1294753.338883] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe165af992d >[1294753.338886] RDX: 0000000000000016 RSI: 0000000000000080 RDI: 0000563fb43f98c0 >[1294753.338889] RBP: 0000563fb43f98b0 R08: 00000000000000c0 R09: 0000000000000000 >[1294753.338891] R10: 00007fe15e9fec20 R11: 0000000000000246 R12: 0000000000000016 >[1294753.338916] R13: 0000000000000001 R14: 0000563fb43f98b8 R15: 00007fe15e1ff000 >[1294753.338928] </TASK> >[1294932.534713] rcu: INFO: rcu_preempt self-detected stall on CPU >[1294932.534725] rcu: 0-...!: (16313 ticks this GP) idle=0f2c/1/0x4000000000000000 softirq=113277454/113277454 fqs=1 >[1294932.534733] rcu: (t=240078 jiffies g=128827773 q=4068 ncpus=1) >[1294932.534737] rcu: rcu_preempt kthread timer wakeup didn't happen for 180030 jiffies! g128827773 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 >[1294932.534741] rcu: Possible timer handling issue on cpu=0 timer-softirq=892940867 >[1294932.534745] rcu: rcu_preempt kthread starved for 180033 jiffies! g128827773 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 >[1294932.534748] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. >[1294932.534750] rcu: RCU grace-period kthread stack dump: >[1294932.534752] task:rcu_preempt state:I stack:0 pid:16 ppid:2 flags:0x00004000 >[1294932.534759] Call Trace: >[1294932.534763] <TASK> >[1294932.534770] __schedule+0x449/0x1480 >[1294932.534782] ? lock_timer_base+0x61/0x80 >[1294932.534791] schedule+0x5e/0xd0 >[1294932.534795] schedule_timeout+0x98/0x160 >[1294932.534801] ? __pfx_process_timeout+0x10/0x10 >[1294932.534805] rcu_gp_fqs_loop+0x141/0x520 >[1294932.534811] ? __note_gp_changes+0x153/0x1a0 >[1294932.534833] ? __pfx_rcu_gp_kthread+0x10/0x10 >[1294932.534839] rcu_gp_kthread+0xea/0x1e0 >[1294932.534844] kthread+0xde/0x110 >[1294932.534850] ? __pfx_kthread+0x10/0x10 >[1294932.534854] ret_from_fork+0x2c/0x50 >[1294932.534861] </TASK> >[1294932.534863] rcu: Stack dump where RCU GP kthread last ran: >[1294932.534866] CPU: 0 PID: 389 Comm: btrfs-transacti Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294932.534871] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294932.534873] RIP: 0010:kmem_cache_alloc+0xfe/0x340 >[1294932.534880] Code: 83 78 10 00 48 8b 38 0f 84 b8 01 00 00 48 85 ff 0f 84 af 01 00 00 8b 45 28 4c 8b 45 00 48 8b 9d b8 00 00 00 48 01 f8 48 89 c1 <48> 33 18 48 0f c9 48 31 cb 41 f6 c0 0f 0f 85 f0 01 00 00 48 8d 8a >[1294932.534883] RSP: 0018:ffffb5d800823ad8 EFLAGS: 00010282 >[1294932.534887] RAX: ffff99a0c52a4ac8 RBX: a8ff4640cdee6673 RCX: ffff99a0c52a4ac8 >[1294932.534890] RDX: 0000000b54dae000 RSI: 0000000000092800 RDI: ffff99a0c52a4a00 >[1294932.534892] RBP: ffff99a1c09f8500 R08: 000000000003cde0 R09: 0000000000000000 >[1294932.534894] R10: 0000000000000001 R11: 0000000000000110 R12: 0000000000000000 >[1294932.534896] R13: 0000000000092800 R14: 00000000000000c8 R15: ffffffff8333dac2 >[1294932.534899] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294932.534902] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294932.534904] CR2: 00007f436bf84000 CR3: 0000000102da4000 CR4: 00000000000106f0 >[1294932.534908] Call Trace: >[1294932.534910] <IRQ> >[1294932.534912] ? rcu_check_gp_kthread_starvation+0x120/0x1a0 >[1294932.534918] ? rcu_sched_clock_irq+0x4ed/0x1150 >[1294932.534922] ? sched_slice+0x87/0x140 >[1294932.534927] ? timekeeping_update+0xdd/0x130 >[1294932.534932] ? timekeeping_advance+0x377/0x590 >[1294932.534937] ? update_process_times+0x74/0xb0 >[1294932.534940] ? tick_sched_handle+0x22/0x60 >[1294932.534945] ? tick_sched_timer+0x67/0x80 >[1294932.534949] ? __pfx_tick_sched_timer+0x10/0x10 >[1294932.534952] ? __hrtimer_run_queues+0x112/0x2b0 >[1294932.534956] ? hrtimer_interrupt+0xf8/0x230 >[1294932.534960] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294932.534965] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294932.534970] </IRQ> >[1294932.534971] <TASK> >[1294932.534973] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294932.534977] ? mempool_alloc+0x92/0x1c0 >[1294932.534986] ? kmem_cache_alloc+0xfe/0x340 >[1294932.534990] ? kmem_cache_alloc+0x59/0x340 >[1294932.534993] mempool_alloc+0x92/0x1c0 >[1294932.535000] bio_alloc_bioset+0x200/0x4f0 >[1294932.535008] write_dev_supers+0x1d1/0x320 >[1294932.535018] write_all_supers+0x1b5/0xdb0 >[1294932.535022] ? btrfs_write_and_wait_transaction+0xad/0xf0 >[1294932.535026] btrfs_commit_transaction+0x8e2/0xf00 >[1294932.535031] ? start_transaction+0xc5/0x5c0 >[1294932.535035] transaction_kthread+0x141/0x1b0 >[1294932.535039] ? __pfx_transaction_kthread+0x10/0x10 >[1294932.535042] kthread+0xde/0x110 >[1294932.535046] ? __pfx_kthread+0x10/0x10 >[1294932.535049] ret_from_fork+0x2c/0x50 >[1294932.535056] </TASK> >[1294932.535069] CPU: 0 PID: 389 Comm: btrfs-transacti Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1294932.535072] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1294932.535074] RIP: 0010:kmem_cache_alloc+0xfe/0x340 >[1294932.535078] Code: 83 78 10 00 48 8b 38 0f 84 b8 01 00 00 48 85 ff 0f 84 af 01 00 00 8b 45 28 4c 8b 45 00 48 8b 9d b8 00 00 00 48 01 f8 48 89 c1 <48> 33 18 48 0f c9 48 31 cb 41 f6 c0 0f 0f 85 f0 01 00 00 48 8d 8a >[1294932.535081] RSP: 0018:ffffb5d800823ad8 EFLAGS: 00010282 >[1294932.535083] RAX: ffff99a0c52a4ac8 RBX: a8ff4640cdee6673 RCX: ffff99a0c52a4ac8 >[1294932.535085] RDX: 0000000b54dae000 RSI: 0000000000092800 RDI: ffff99a0c52a4a00 >[1294932.535087] RBP: ffff99a1c09f8500 R08: 000000000003cde0 R09: 0000000000000000 >[1294932.535089] R10: 0000000000000001 R11: 0000000000000110 R12: 0000000000000000 >[1294932.535091] R13: 0000000000092800 R14: 00000000000000c8 R15: ffffffff8333dac2 >[1294932.535093] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1294932.535096] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1294932.535098] CR2: 00007f436bf84000 CR3: 0000000102da4000 CR4: 00000000000106f0 >[1294932.535100] Call Trace: >[1294932.535102] <IRQ> >[1294932.535103] ? rcu_dump_cpu_stacks+0xc4/0x100 >[1294932.535108] ? rcu_sched_clock_irq+0x4f2/0x1150 >[1294932.535111] ? sched_slice+0x87/0x140 >[1294932.535114] ? timekeeping_update+0xdd/0x130 >[1294932.535118] ? timekeeping_advance+0x377/0x590 >[1294932.535144] ? update_process_times+0x74/0xb0 >[1294932.535173] ? tick_sched_handle+0x22/0x60 >[1294932.535180] ? tick_sched_timer+0x67/0x80 >[1294932.535183] ? __pfx_tick_sched_timer+0x10/0x10 >[1294932.535187] ? __hrtimer_run_queues+0x112/0x2b0 >[1294932.535190] ? hrtimer_interrupt+0xf8/0x230 >[1294932.535194] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1294932.535198] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1294932.535201] </IRQ> >[1294932.535203] <TASK> >[1294932.535204] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1294932.535208] ? mempool_alloc+0x92/0x1c0 >[1294932.535213] ? kmem_cache_alloc+0xfe/0x340 >[1294932.535216] ? kmem_cache_alloc+0x59/0x340 >[1294932.535220] mempool_alloc+0x92/0x1c0 >[1294932.535224] bio_alloc_bioset+0x200/0x4f0 >[1294932.535229] write_dev_supers+0x1d1/0x320 >[1294932.535237] write_all_supers+0x1b5/0xdb0 >[1294932.535240] ? btrfs_write_and_wait_transaction+0xad/0xf0 >[1294932.535244] btrfs_commit_transaction+0x8e2/0xf00 >[1294932.535247] ? start_transaction+0xc5/0x5c0 >[1294932.535251] transaction_kthread+0x141/0x1b0 >[1294932.535254] ? __pfx_transaction_kthread+0x10/0x10 >[1294932.535257] kthread+0xde/0x110 >[1294932.535260] ? __pfx_kthread+0x10/0x10 >[1294932.535263] ret_from_fork+0x2c/0x50 >[1294932.535269] </TASK> >[1295043.569927] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ksoftirqd/0:15] >[1295043.569938] Modules linked in: nf_log_syslog nft_log nf_conntrack_netbios_ns nf_conntrack_broadcast nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 iptable_mangle iptable_raw iptable_security ip_set nf_tables nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables snd_seq_dummy snd_hrtimer tls rfkill qrtr lz4 lz4_compress snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd intel_rapl_msr intel_rapl_common soundcore pcspkr xfs joydev i2c_piix4 vboxguest auth_rpcgss sunrpc loop zram vmwgfx e1000 drm_ttm_helper crc32c_intel sha512_ssse3 serio_raw ttm video wmi ata_generic pata_acpi scsi_dh_rdac scsi_dh_emc scsi_dh_alua fuse dm_multipath >[1295043.570079] CPU: 0 PID: 15 Comm: ksoftirqd/0 Tainted: G D W L 6.3.12-100.fc37.x86_64 #1 >[1295043.570083] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 >[1295043.570086] RIP: 0010:vbg_req_perform+0x2c/0x40 [vboxguest] >[1295043.570098] Code: 1f 00 0f 1f 44 00 00 b8 00 00 00 80 48 01 f0 72 21 48 c7 c2 00 00 00 80 48 2b 15 e7 3e 4f c4 48 01 d0 0f b7 57 08 ef 0f ae f0 <8b> 46 0c e9 fc 3f b0 c3 48 8b 15 c5 ca b7 c4 eb e4 0f 1f 00 90 90 >[1295043.570102] RSP: 0018:ffffb5d800083db0 EFLAGS: 00010207 >[1295043.570105] RAX: 0000000001114000 RBX: ffff99a1c3d66298 RCX: 0000000000000000 >[1295043.570108] RDX: 000000000000d040 RSI: ffff99a0c1114000 RDI: ffff99a1c3d66028 >[1295043.570110] RBP: ffff99a1c3d66298 R08: ffff99a1c0370090 R09: 0000000000000000 >[1295043.570112] R10: 00000000f5257d14 R11: 0000000000000110 R12: ffffffffc04abd60 >[1295043.570114] R13: ffff99a1c3d66298 R14: ffffb5d800083e10 R15: ffff99a21ac21e80 >[1295043.570117] FS: 0000000000000000(0000) GS:ffff99a21ac00000(0000) knlGS:0000000000000000 >[1295043.570119] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >[1295043.570121] CR2: 00007f54db786d68 CR3: 000000010e76c000 CR4: 00000000000106f0 >[1295043.570126] Call Trace: >[1295043.570129] <IRQ> >[1295043.570134] ? watchdog_timer_fn+0x1a8/0x210 >[1295043.570141] ? __pfx_watchdog_timer_fn+0x10/0x10 >[1295043.570145] ? __hrtimer_run_queues+0x112/0x2b0 >[1295043.570150] ? hrtimer_interrupt+0xf8/0x230 >[1295043.570155] ? __sysvec_apic_timer_interrupt+0x61/0x130 >[1295043.570159] ? sysvec_apic_timer_interrupt+0x6d/0x90 >[1295043.570165] </IRQ> >[1295043.570167] <TASK> >[1295043.570168] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 >[1295043.570173] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1295043.570183] ? vbg_req_perform+0x2c/0x40 [vboxguest] >[1295043.570190] vbg_heartbeat_timer+0x1d/0x40 [vboxguest] >[1295043.570197] call_timer_fn+0x27/0x130 >[1295043.570201] ? __pfx_vbg_heartbeat_timer+0x10/0x10 [vboxguest] >[1295043.570208] __run_timers+0x222/0x2c0 >[1295043.570212] run_timer_softirq+0x1d/0x40 >[1295043.570215] __do_softirq+0xd4/0x2c8 >[1295043.570221] ? __pfx_smpboot_thread_fn+0x10/0x10 >[1295043.570225] run_ksoftirqd+0x2c/0x40 >[1295043.570230] smpboot_thread_fn+0xdc/0x1d0 >[1295043.570233] kthread+0xde/0x110 >[1295043.570237] ? __pfx_kthread+0x10/0x10 >[1295043.570240] ret_from_fork+0x2c/0x50 >[1295043.570247] </TASK> >[1295044.489404] 02:24:40.667694 timesync vgsvcTimeSyncWorker: Radical guest time change: 1 913 965 771 000ns (GuestNow=1 690 597 480 667 681 00 >[1295044.893017] systemd-journald[502]: /dev/kmsg buffer overrun, some messages lost.
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 2227438
: 1980616