Bug 2332064

Summary: ipu6 camera driver freezes Fedora with kernel 6.11.11-300 during boot
Product: [Fedora] Fedora Reporter: fattony4
Component: libcameraAssignee: Javier Martinez Canillas <fmartine>
Status: CLOSED DUPLICATE QA Contact:
Severity: medium Docs Contact:
Priority: unspecified    
Version: 41CC: atiqcx, ecurtin, fmartine, hdegoede, mzamazal, terjeros, wtaymans
Target Milestone: ---   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2024-12-12 13:55:21 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description fattony4 2024-12-12 13:10:18 UTC
After upgrading to kernel 6.11.11-300.fc41.x86_64, I get a freeze during boot caused by the ipu6 stack.

Reasoning:
- using an older kernel works
- after removing the ipu6 stack, it boots with the newer kernel. I removed these packages to get it to run again:
    akmod-intel-ipu6, gstreamer1-plugins-icamerasrc, intel-vsc-firmware, ipu6-camera-bins, ipu6-camera-hal, ivsc-firmware, kmod-intel-ipu6-6.11.10-300.fc41.x86_64, kmod-intel-ipu6-6.11.11-300.fc41.x86_64, kmod-intel-ipu6-6.11.8-300.fc41.x86_64, v4l2-relayd


These are the ipu6-related boot logs:

$ journalctl -k -b -1 | grep ipu6
Dez 12 11:51:58 spectre kernel: intel-ipu6 0000:00:05.0: enabling device (0000 -> 0002)
Dez 12 11:51:58 spectre kernel: intel-ipu6 0000:00:05.0: IPU6 in secure mode touch 0x80000000 mask 0x0
Dez 12 11:51:58 spectre kernel: intel-ipu6 0000:00:05.0: FW version: 20230925
Dez 12 11:51:58 spectre kernel: intel-ipu6 0000:00:05.0: Found supported sensor INT3537:00
Dez 12 11:51:58 spectre kernel: intel-ipu6 0000:00:05.0: Connected 1 cameras
Dez 12 11:51:58 spectre kernel: intel-ipu6 0000:00:05.0: Sending BOOT_LOAD to CSE
Dez 12 11:51:58 spectre kernel: intel-ipu6 0000:00:05.0: Sending AUTHENTICATE_RUN to CSE
Dez 12 11:51:58 spectre kernel: intel-ipu6 0000:00:05.0: CSE authenticate_run done
Dez 12 11:51:58 spectre kernel: intel-ipu6 0000:00:05.0: IPU6-v3[a75d] hardware version 5
Dez 12 11:51:58 spectre kernel: Modules linked in: snd_soc_core(+) intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling(-) x86_pkg_temp_thermal intel_ipu6_isys(+) intel_powerclamp videobuf2_dma_contig snd_compress coretemp ac97_bus spi_nor videobuf2_memops snd_pcm_dmaengine videobuf2_v4l2 iTCO_wdt kvm_intel snd_hda_intel intel_pmc_bxt snd_intel_dspcfg videobuf2_common mtd iTCO_vendor_support libarc4 mei_pxp mei_hdcp intel_rapl_msr kvm snd_intel_sdw_acpi btusb snd_hda_codec btrtl rapl snd_hda_core btintel snd_hwdep btbcm intel_cstate processor_thermal_device_pci snd_seq btmtk processor_thermal_device iwlwifi snd_seq_device hp_wmi(+) intel_uncore processor_thermal_wt_hint bluetooth platform_profile wmi_bmof hid_sensor_accel_3d hid_sensor_incl_3d hid_sensor_gyro_3d hid_sensor_rotation hid_sensor_als processor_thermal_rfim i2c_i801 spi_intel_pci hid_sensor_trigger processor_thermal_rapl pcspkr snd_pcm spi_intel i2c_smbus cfg80211 hid_sensor_iio_common intel_rapl_common industrialio_triggered_buffer snd_timer mei_me
Dez 12 11:51:58 spectre kernel:  processor_thermal_wt_req kfifo_buf snd intel_ipu6 processor_thermal_power_floor industrialio soundcore mei rfkill idma64 thunderbolt(+) processor_thermal_mbox ipu_bridge igen6_edac intel_skl_int3472_tps68470 tps68470_regulator int3403_thermal int340x_thermal_zone clk_tps68470 intel_pmc_core hi556 v4l2_fwnode intel_vsec v4l2_async intel_skl_int3472_discrete pmt_telemetry int3400_thermal acpi_pad intel_hid acpi_tad pmt_class soc_button_array acpi_thermal_rel sparse_keymap joydev v4l2loopback(OE) videodev mc loop nfnetlink zram xe drm_ttm_helper gpu_sched drm_suballoc_helper drm_gpuvm drm_exec hid_sensor_hub intel_ishtp_hid i915 crct10dif_pclmul crc32_pclmul i2c_algo_bit crc32c_intel polyval_clmulni drm_buddy polyval_generic nvme ttm rtsx_pci_sdmmc ghash_clmulni_intel drm_display_helper nvme_core mmc_core sha512_ssse3 video ucsi_acpi intel_ish_ipc sha256_ssse3 hid_multitouch rtsx_pci sha1_ssse3 typec_ucsi intel_ishtp nvme_auth typec cec i2c_hid_acpi i2c_hid wmi pinctrl_tigerlake serio_raw fuse
Dez 12 11:51:58 spectre kernel:  alloc_fw_msg_bufs+0x67/0x1f0 [intel_ipu6_isys]
Dez 12 11:51:58 spectre kernel:  isys_probe+0x3a2/0xb60 [intel_ipu6_isys]
Dez 12 11:51:58 spectre kernel:  ? __pfx_isys_probe+0x10/0x10 [intel_ipu6_isys]
Dez 12 11:51:58 spectre kernel:  ? __pfx_isys_driver_init+0x10/0x10 [intel_ipu6_isys]
Dez 12 11:51:58 spectre kernel: intel_ipu6_isys.isys intel_ipu6.isys.40: probe with driver intel_ipu6_isys.isys failed with error -12


Reproducible: Always

Steps to Reproduce:
1. Install ipu6 stack
2. Boot kernel 6.11.11-300.fc41.x86_64
3. Boot freezes -> use older kernel or uninstall ipu6
Actual Results:  
Boot freezes

Expected Results:  
Normal boot, ipu6 camera working

Comment 1 Hans de Goede 2024-12-12 13:55:21 UTC
Unfortunately an incomplete backport of IPU6 DMA handling changes has landed in kernel 6.11.11.

This not only causes IPU6 cameras to not work, this causes the kernel to (often?) crash on boot on systems where the IPU6 is in use and thus enabled by the BIOS.

Kernels 6.12.2 - 6.12.4 are also affected by this. A fix for this is pending for the upcoming 6.12.5 release.

6.11.11 is the last stable release in the 6.11.y series, so there will be no new stable 6.11.y release with a fix.

As a workaround users affected by this can stay with 6.11.10 or 6.12.1 until 6.12.5 is available in your distributions updates(-testing) repository.

*** This bug has been marked as a duplicate of bug 2332063 ***

Comment 2 Atiq 2024-12-13 00:18:31 UTC
Having same problem with kernel boot on Dell Precision 5690

ref, Screenshot of the boot where it gets stuck is here:
  https://imgur.com/gallery/kernel-6-11-11-300-fc41-x86-64-has-bugs-Qp9e6Nq

**Hardware**  
*Dell Precision 5690*  
CPU: Intel(R) Core(TM) Ultra 9 185H  
GPU: NVIDIA AD107GLM - RTX 1000 Ada Generation

Comment 3 Atiq 2024-12-21 05:49:07 UTC
> Having same problem with kernel boot on Dell Precision 5690

Seems that is fixed on kernel-6.12.5-200

However, camera app seems to be not working yet. Here's screenshot.
  https://imgur.com/a/tLF4o5R

Need help where (probably some gnome app project) to report it?

Comment 4 Hans de Goede 2024-12-21 10:38:07 UTC
(In reply to Atiq from comment #3)
> > Having same problem with kernel boot on Dell Precision 5690
> 
> Seems that is fixed on kernel-6.12.5-200
> 
> However, camera app seems to be not working yet. Here's screenshot.
>   https://imgur.com/a/tLF4o5R
> 
> Need help where (probably some gnome app project) to report it?

First of all please make sure you have installed all recent updates
by running: "sudo dnf update".

Then check if your camera works at all when directly
using libcamera by using qcam, see:

https://fedoraproject.org/wiki/Changes/IPU6_Camera_support#How_To_Test

For the permission error in your screen shot, please see:
https://jgrulich.cz/2024/12/13/when-your-webcam-doesnt-work-solving-firefox-and-pipewire-issues/

If the camera does not work in qcam please file a new bug to track this against
component kernel, first please enable some extra debugging by running:

sudo grubby --update-kernel=ALL --args="intel_skl_int3472_discrete.dyndbg"

Reboot and read and follow:
https://fedoraproject.org/wiki/Changes/IPU6_Camera_support#How_To_Test
to test the cameras.

If things still do not work, please run the following commands to
collect logs after testing the cameras:

`journalctl -b 0 -k > kernel.txt`
`lsusb > lsusb.txt`
`ls -l /sys/bus/i2c/devices/ > i2c-devices.txt`
`ls -l /sys/bus/spi/devices/ > spi-devices.txt`

And then please file a bug here:

https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&component=kernel

using "IPU6 camera on $vendor $model laptop does not work" as summary
and attach the generated "*.txt" files to the bug.

p.s. I'm taking an end of year break till January 6th, so my next reply will be in January.