[BUG] ipc tx error on suspend/resume (error loading HDA0.OUT)

[specious]

Sound is not restored on suspend/resume with the recent 5.16-rc7 kernel.

This is the kernel log on wake:

[54581.864703] Restarting tasks ... 
[54581.865400] sof-audio-pci-intel-cnl 0000:00:1f.3: ipc tx error for 0x80010000 (msg/reply size: 216/12): -19
[54581.865416] sof-audio-pci-intel-cnl 0000:00:1f.3: error: failed resetting DAI config for HDA0.OUT
[54581.867204] done.
[54581.871672] mei_hdcp 0000:00:16.0-b638ab7e-94e2-4ea2-a552-d1c54b627f04: bound 0000:00:02.0 (ops 0xffffffff822ad480)
[54581.872203] sof-audio-pci-intel-cnl 0000:00:1f.3: ipc tx error for 0x30010000 (msg/reply size: 96/20): -22
[54581.872213] sof-audio-pci-intel-cnl 0000:00:1f.3: error: failed to load widget HDA0.OUT
[54581.873490] sof-audio-pci-intel-cnl 0000:00:1f.3: error: failed widget list set up for pcm 0 dir 0
[54581.873499] sof-audio-pci-intel-cnl 0000:00:1f.3: ASoC: error at snd_soc_pcm_component_hw_params on 0000:00:1f.3: -22
[54581.873505]  HDA Analog: ASoC: soc_pcm_hw_params() failed (-22)
[54581.873537]  HDA Analog: ASoC: dpcm_fe_dai_hw_params failed (-22)
[54581.873831] sof-audio-pci-intel-cnl 0000:00:1f.3: ipc tx error for 0x30010000 (msg/reply size: 96/20): -22
[54581.873839] sof-audio-pci-intel-cnl 0000:00:1f.3: error: failed to load widget HDA0.OUT
[54581.873843] sof-audio-pci-intel-cnl 0000:00:1f.3: error: failed setting up DAI widget HDA0.OUT
[54581.873847] sof-audio-pci-intel-cnl 0000:00:1f.3: ASoC: error at snd_soc_dai_hw_params on Analog CPU DAI: -22
[54581.873864]  Analog Playback and Capture: ASoC: soc_pcm_hw_params() failed (-22)
[54581.873868]  HDA Analog: ASoC: dpcm_fe_dai_hw_params failed (-22)
[54581.874014] sof-audio-pci-intel-cnl 0000:00:1f.3: ipc tx error for 0x30010000 (msg/reply size: 96/20): -22
[54581.874023] sof-audio-pci-intel-cnl 0000:00:1f.3: error: failed to load widget HDA0.OUT
[54581.874025] sof-audio-pci-intel-cnl 0000:00:1f.3: error: failed setting up DAI widget HDA0.OUT
[54581.874028] sof-audio-pci-intel-cnl 0000:00:1f.3: ASoC: error at snd_soc_dai_hw_params on Analog CPU DAI: -22
[54581.874038]  Analog Playback and Capture: ASoC: soc_pcm_hw_params() failed (-22)
[54581.874041]  HDA Analog: ASoC: dpcm_fe_dai_hw_params failed (-22)
[54581.874278] sof-audio-pci-intel-cnl 0000:00:1f.3: ipc tx error for 0x30010000 (msg/reply size: 96/20): -22
[54581.874294] sof-audio-pci-intel-cnl 0000:00:1f.3: error: failed to load widget HDA0.OUT
[54581.874297] sof-audio-pci-intel-cnl 0000:00:1f.3: error: failed setting up DAI widget HDA0.OUT
[54581.874299] sof-audio-pci-intel-cnl 0000:00:1f.3: ASoC: error at snd_soc_dai_hw_params on Analog CPU DAI: -22
[54581.874309]  Analog Playback and Capture: ASoC: soc_pcm_hw_params() failed (-22)
[54581.874316]  HDA Analog: ASoC: dpcm_fe_dai_hw_params failed (-22)
[54581.874606] sof-audio-pci-intel-cnl 0000:00:1f.3: ipc tx error for 0x30010000 (msg/reply size: 96/20): -22
[54581.874614] sof-audio-pci-intel-cnl 0000:00:1f.3: error: failed to load widget HDA0.OUT
[54581.874618] sof-audio-pci-intel-cnl 0000:00:1f.3: error: failed setting up DAI widget HDA0.OUT
[54581.874621] sof-audio-pci-intel-cnl 0000:00:1f.3: ASoC: error at snd_soc_dai_hw_params on Analog CPU DAI: -22
[54581.874633]  Analog Playback and Capture: ASoC: soc_pcm_hw_params() failed (-22)
[54581.874636]  HDA Analog: ASoC: dpcm_fe_dai_hw_params failed (-22)

It works perfectly with the 5.15.13 kernel.

Perhaps it has something to do with the recent changes.

Impact

Annoyance (need to reboot to restore sound)

Environment

This is on a Thinkpad X1 Carbon gen 8 with Intel Comet Lake PCH-LP cAVS audio.

• Kernel: 5.16-rc7 mainline
• SOF: (with kernel)
• Platform: Arch x86_64 with custom built kernel

Log output

dmesg.txt

[lgirdwood]

@specious how often does this happen ? Fwiw, the changes https://lore.kernel.org/alsa-devel/20211125101520.291581-4-kai.vehmanen@linux.intel.com/T/ were a fix for a similar issue on CML hardware so it may be something is still not right (and this fix was stress tested on a lot of HW).
Btw, are you able to run sof-logger next time this happens and attache the FW log. See https://thesofproject.github.io/latest/developer_guides/debugability/logger/index.html

[lgirdwood]

@kv2019i fyi.

[specious]

It happens consistently on wake. I can boot and have audio, but after the first suspend/resume, it will require a reboot to get it back.

I'd love to help diagnose what is occurring. I can boot into the 5.16-rc7 kernel and test it out. I just installed the sof-tools package and it's got the logger and two other utilities.

How exactly do I run the logger? I'm not sure what the ldc file is and where it comes from. It also looks like I need to boot with snd_sof.sof_debug=1 (I have it compiled into the kernel).

[plbossart]

@specious here are some ideas to help find the root cause

a) downgrade to SOF version 1.9.3 . I see that you are using 2:0:0-b678a so we need to rule out a firmware issue in the last release

b) prevent dynamic pipelines for HDaudio. this can be done with the quirk

options snd_sof sof_debug=0xF

/* Flag definitions used in sof_core_debug (sof_debug module parameter) */
#define SOF_DBG_ENABLE_TRACE	BIT(0)
#define SOF_DBG_RETAIN_CTX	BIT(1)	/* prevent DSP D3 on FW exception */
#define SOF_DBG_VERIFY_TPLG	BIT(2) /* verify topology during load */
#define SOF_DBG_DYNAMIC_PIPELINES_OVERRIDE	BIT(3) /* 0: use topology token
							* 1: override topology
							*/
#define SOF_DBG_DYNAMIC_PIPELINES_ENABLE	BIT(4) /* 0: use static pipelines
							* 1: use dynamic pipelines
							*/
#define SOF_DBG_DISABLE_MULTICORE		BIT(5) /* schedule all pipelines/widgets
							* on primary core
							*/
#define SOF_DBG_PRINT_ALL_DUMPS		BIT(6) /* Print all ipc and dsp dumps */

[specious]

I installed sof-firmware 1.9.3 from the package archive, but dmesg is still reporting:

sof-audio-pci-intel-cnl 0000:00:1f.3: Firmware info: version 2:0:0-b678a

In /lib/firmware/intel I have:

lrwxrwxrwx 1 root root      10 Dec 13 16:17 sof -> sof-v1.9.3
lrwxrwxrwx 1 root root      15 Dec 13 16:17 sof-tplg -> sof-tplg-v1.9.3
drwxr-xr-x 2 root root   20480 Jan 13 15:55 sof-tplg-v1.9.3
drwxr-xr-x 4 root root    3488 Jan 13 15:55 sof-v1.9.3

What could I be doing wrong?

And to be clear, audio works perfectly with the 5.15.13 kernel (same configuration), no matter how many times I suspend/resume (either by closing the lid or sudo rtcwake -m mem -s 1.

Arch official kernel is now at 5.16.arch1-1, and I confirmed that audio breaks on suspend/resume, and it also worked with the previous official kernel.

[lgirdwood]

@specious /lib/firmware/intel/sof and /lib/firmware/intel/sof-tplg are directories e.g. on my PC

drwxr-xr-x 6 root root    4096 Dec 21 09:11 sof
drwxr-xr-x 4 root root   32768 Dec 21 09:11 sof-tplg

These are then populated with the binaries and links.

[xxxbxxx]

got the same issue!

workaround to avoid reboot:

sudo rmmod snd_sof_pci_intel_cnl
sudo modprobe snd_sof_pci_intel_cnl

[specious]

If the module is built into the kernel, is there also a way to reinitialize it?

[plbossart]

If the module is built into the kernel, is there also a way to reinitialize it?

we don't support this case due to dependencies with the firmware loading from the filesystem. The SOF driver has to be module-based. Can you share your kernel config please?

[specious]

My kernel configuration: config-linux-5.16-20220118.txt

Although all drivers are built in, everything works perfectly with the 5.15.13 kernel, and until a sleep/wake also on 5.16.0.

I was simply wondering if there's any way to get the driver to reinitialize without doing an rmmod.

[dumprop]

I have same problem on opensuse - https://bugzilla.suse.com/show_bug.cgi?id=1195027
alsa-info.sh with broken audio https://alsa-project.org/db/?f=9aa7cd2010b1474ccc835b55d807077bc69018d6

[carmilso]

Hi! I have exactly the same issue but with snd_sof_pci_intel_tgl. Thanks for the rmmod workaround, I'll keep subscribed to the issue