Bug 2006295 - Workqueue: btrfs-delalloc btrfs_work_helper PC is at mmiocpy LR is at ZSTD_compressStream
Summary: Workqueue: btrfs-delalloc btrfs_work_helper PC is at mmiocpy LR is at ZSTD_co...
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Fedora
Classification: Fedora
Component: kernel
Version: rawhide
Hardware: armhfp
OS: Linux
unspecified
unspecified
Target Milestone: ---
Assignee: fedora-kernel-btrfs
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-09-21 12:46 UTC by Paul Whalen
Modified: 2022-06-08 14:29 UTC (History)
21 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2022-06-08 14:29:46 UTC
Type: Bug
Embargoed:


Attachments (Terms of Use)

Description Paul Whalen 2021-09-21 12:46:32 UTC
1. Please describe the problem:

Kernel oops during armhfp installation when using btrfs

Configuring storage
Creating disklabel on /dev/vda
Creating ext4 on /dev/vda2
Creating btrfs on /dev/vda3
Creating btrfs on /dev/vda3
Creating efi on /dev/vda1
...
Running pre-installation scripts
.
Running pre-installation tasks
....
Installing.
Starting package installation process
[  660.364997] Internal error: Oops: 5 [#1] SMP ARM
[  660.366873] Modules linked in: vfat fat libfc scsi_transport_fc uinput scsi_dh_rdac scsi_dh_emc scsi_dh_alua virtio_balloon drm fu
se zram overlay loop crc32_arm_ce gpio_keys virtio_mmio virtio_blk virtio_net virtio_console net_failover failover rfkill sunrpc lrw 
dm_crypt trusted asn1_encoder tee dm_round_robin dm_multipath linear raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor
 async_tx raid1 raid0 squashfs cramfs be2iscsi bnx2i cnic uio cxgb4i cxgb4 tls cxgb3i cxgb3 mdio libcxgbi libcxgb qla4xxx iscsi_boot_
sysfs iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi
[  660.386214] CPU: 0 PID: 101 Comm: kworker/u2:1 Not tainted 5.15.0-0.rc1.20210917gitbdb575f87217.15.fc36.armv7hl #1
[  660.390180] Hardware name: QEMU KVM Virtual Machine, BIOS 0.0.0 02/06/2015
[  660.392854] Workqueue: btrfs-delalloc btrfs_work_helper
[  660.394972] PC is at mmiocpy+0x48/0x330
[  660.396511] LR is at ZSTD_compressStream+0x184/0x294
[  660.398465] pc : [<c08bd768>]    lr : [<c089c314>]    psr: 20000013
[  660.400885] sp : c3659d14  ip : 00000000  fp : 00000000
[  660.402912] r10: 00000200  r9 : dd247000  r8 : 00000400
[  660.404990] r7 : 00000200  r6 : c4d2b328  r5 : c4d2b334  r4 : df800008
[  660.407533] r3 : 00000200  r2 : 00000180  r1 : 00000000  r0 : df8027c0
[  660.410068] Flags: nzCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment none
[  660.412842] Control: 10c5383d  Table: 4451406a  DAC: 00000051
[  660.415129] Register r0 information: non-slab/vmalloc memory
[  660.417423] Register r1 information: NULL pointer
[  660.419319] Register r2 information: non-paged memory
[  660.421353] Register r3 information: non-paged memory
[  660.423374] Register r4 information: non-slab/vmalloc memory
[  660.425681] Register r5 information: slab kmalloc-64 start c4d2b300 pointer offset 52 size 64
[  660.429093] Register r6 information: slab kmalloc-64 start c4d2b300 pointer offset 40 size 64
[  660.432503] Register r7 information: non-paged memory
[  660.434574] Register r8 information: non-paged memory
[  660.436601] Register r9 information: non-slab/vmalloc memory
[  660.438857] Register r10 information: non-paged memory
[  660.440912] Register r11 information: NULL pointer
[  660.442858] Register r12 information: NULL pointer
[  660.444819] Process kworker/u2:1 (pid: 101, stack limit = 0x74c3639d)
[  660.447370] Stack: (0xc3659d14 to 0xc365a000)
[  660.449148] 9d00:                                              ???????? ???????? ????????
[  660.452389] 9d20: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.455697] 9d40: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.458882] 9d60: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.462028] 9d80: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.465214] 9da0: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.468460] 9dc0: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.471712] 9de0: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.474966] 9e00: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.478214] 9e20: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.481406] 9e40: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.484674] 9e60: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.487922] 9e80: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.491150] 9ea0: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.494441] 9ec0: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.497702] 9ee0: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.500922] 9f00: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.504185] 9f20: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.507455] 9f40: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.510697] 9f60: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.513926] 9f80: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.517174] 9fa0: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.520418] 9fc0: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.523695] 9fe0: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.527003] [<c08bd768>] (mmiocpy) from [<c089c314>] (ZSTD_compressStream+0x184/0x294)
[  660.530199] [<c089c314>] (ZSTD_compressStream) from [<c0737980>] (zstd_compress_pages+0x174/0x390)
[  660.533775] [<c0737980>] (zstd_compress_pages) from [<c0739ba4>] (btrfs_compress_pages+0x104/0x10c)
[  660.537437] [<c0739ba4>] (btrfs_compress_pages) from [<c06f1df8>] (compress_file_range+0x25c/0x5dc)
[  660.541022] [<c06f1df8>] (compress_file_range) from [<c06f2190>] (async_cow_start+0x18/0x30)
[  660.544409] [<c06f2190>] (async_cow_start) from [<c071c704>] (btrfs_work_helper+0x1ac/0x39c)
[  660.547770] [<c071c704>] (btrfs_work_helper) from [<c036d7c4>] (process_one_work+0x2f8/0x4f4)
[  660.551133] [<c036d7c4>] (process_one_work) from [<c036e4f0>] (worker_thread+0x234/0x2f4)
[  660.554413] [<c036e4f0>] (worker_thread) from [<c037508c>] (kthread+0x134/0x140)
[  660.557369] [<c037508c>] (kthread) from [<c0300160>] (ret_from_fork+0x14/0x34)
[  660.560247] Exception stack(0xc3659fb0 to 0xc3659ff8)
[  660.562253] 9fa0:                                     ???????? ???????? ???????? ????????
[  660.565507] 9fc0: ???????? ???????? ???????? ???????? ???????? ???????? ???????? ????????
[  660.568705] 9fe0: ???????? ???????? ???????? ???????? ???????? ????????
[  660.571276] Code: ba000002 f5d1f03c f5d1f05c f5d1f07c (e8b151f8) 
[  660.573959] ---[ end trace 81cba4d66eb19ae1 ]---
[  688.941507] 8<--- cut here ---


2. What is the Version-Release number of the kernel:

5.15 rcX (including 5.15.0-0.rc2.18.fc36.armv7hl)


3. Did it work previously in Fedora? If so, what kernel version did the issue
   *first* appear?  Old kernels are available for download at
   https://koji.fedoraproject.org/koji/packageinfo?packageID=8 :

5.15 rcx


4. Can you reproduce this issue? If so, please provide the steps to reproduce
   the issue below:

Attempt an armhfp installation using btrfs


5. Does this problem occur with the latest Rawhide kernel? To install the
   Rawhide kernel, run ``sudo dnf install fedora-repos-rawhide`` followed by
   ``sudo dnf update --enablerepo=rawhide kernel``:

Yes.

6. Are you running any modules that not shipped with directly Fedora's kernel?:

No.


7. Please attach the kernel logs. You can get the complete kernel log
   for a boot with ``journalctl --no-hostname -k > dmesg.txt``. If the
   issue occurred on a previous boot, use the journalctl ``-b`` flag.

This is happening during disk image creation in koji:

https://koji.fedoraproject.org/koji/taskinfo?taskID=76049201

Comment 2 Paul Whalen 2021-09-28 18:10:46 UTC
From the upstream mailing list:

From: David Sterba @ 2021-09-21 19:56 UTC
The last function to fail is inside ZSTD implementation in kernel.
If btrfs passes wrong data to zstd we'd see that also on non-arm builds,
so guessing by mmiocpy as a copy-something function it could be some
sort of alignment problem that works on x86_64 but throws an exception
on arm as it's stricter about alignment.

Comment 3 Paul Whalen 2021-11-03 19:03:11 UTC
Armhfp images with btrfs are working again with the update to 5.15.0-60.fc36.armv7hl (Fedora-Rawhide-20211102.n.1)


Note You need to log in before you can comment on or make changes to this bug.