On Tue, Jul 22, 2025 at 11:06:21PM +0100, Cameron Williams wrote: > On Tue, Jul 22, 2025 at 05:52:28PM +0200, Johannes Berg wrote: > > Hi, > > So it's been a while ... is this still happening? > I checked a few versions ago, I can't remember which one off the top > of my head, but yeah this seems to still be an issue. This is still happening as of 6.16.0. > > > I have kernel dumps, vmcore dumps, whatever you may need, > > > any help is appreciated! > > > > If it still happens, I guess it might help to put some noinline > > annotations on some of the functions involved to get a better handle on > > what exactly is being passed. And run it in a VM ;-) > > I have noinlined some functions (fq_flow_dequeue, fq_flow_reset, fq_tin_reset, and ieee80211_txq_purge) and enabled CONFIG_MAC80211_NOINLINE to get a bit more output, but nothing is making this any clearer :(. The call trace now finishes on fq_tin_reset but thats about it, I still can't where the bad code is getting passed :(. Here is the crash log with those inlines, config and debug on. I am not sure if those systemd messages are relevant or not: [ 60.485914] [ T65] usb 1-2: new high-speed USB device number 3 using xhci_hcd [ 60.490047] [ T224] systemd-journald[224]: sd-device: Failed to chase symlinks in "/sys/bus/usb/devices/1-2". [ 60.490538] [ T224] systemd-journald[224]: sd-device: Failed to chase symlinks in "/sys/class/usb/1-2". [ 60.490912] [ T224] systemd-journald[224]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/1-2". [ 60.828405] [ T65] usb 1-2: New USB device found, idVendor=1618, idProduct=9113, bcdDevice= 0.02 [ 60.828746] [ T65] usb 1-2: New USB device strings: Mfr=1, Product=2, SerialNumber=6 [ 60.829067] [ T65] usb 1-2: Product: Wireless USB Network Module [ 60.829347] [ T65] usb 1-2: Manufacturer: Redpine Signals, Inc. [ 60.829639] [ T65] usb 1-2: SerialNumber: 000000000001 [ 61.051519] [ T569] cfg80211: Loading compiled-in X.509 certificates for regulatory database [ 61.060694] [ T569] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' [ 61.065710] [ T569] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' [ 61.134422] [ T64] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2 [ 61.135140] [ T64] cfg80211: failed to load regulatory.db [ 61.135950] [ T224] systemd-journald[224]: sd-device: Failed to chase symlinks in "/sys/class/platform/regulatory.0". [ 61.136358] [ T224] systemd-journald[224]: sd-device: Failed to chase symlinks in "/sys/firmware/platform/regulatory.0". [ 61.508902] [ T569] rsi_91x: rsi_probe: Initialized os intf ops [ 61.550349] [ T569] rsi_91x: ================================================ [ 61.550711] [ T569] rsi_91x: ================ RSI Version Info ============== [ 61.551045] [ T569] rsi_91x: ================================================ [ 61.551403] [ T569] rsi_91x: FW Version : 1.6.2 [ 61.551695] [ T569] rsi_91x: Operating mode : 1 [Wi-Fi alone] [ 61.551696] [ T569] rsi_91x: Firmware file : rsi/rs9113_wlan_qspi.rps [ 61.551994] [ T569] rsi_91x: ================================================ [ 61.649118] [ T569] rsi_91x: ***** Firmware Loading successful ***** [ 61.653390] [ T569] usbcore: registered new interface driver RSI-USB WLAN [ 61.674664] [ T578] rsi_91x: Max Stations Allowed = 32 [ 61.681325] [ T569] RSI-USB WLAN 1-2:1.0 wlp0s12u2: renamed from wlan0 [ 61.686396] [ T224] systemd-journald[224]: sd-device: Failed to chase symlinks in "/sys/class/usb/1-2:1.0". [ 61.686924] [ T224] systemd-journald[224]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/1-2:1.0". [ 61.715786] [ T224] systemd-journald[224]: Successfully sent stream file descriptor to service manager. [ 79.598357] [ T594] rsi_91x: ===> Interface UP <=== [ 79.602483] [ T594] rsi_91x: rsi_disable_ps: Cannot accept disable PS in PS_NONE state [ 82.100497] [ T64] usb 1-2: USB disconnect, device number 3 [ 82.128685] [ T64] BUG: unable to handle page fault for address: 00000000c12f6080 [ 82.129133] [ T64] #PF: supervisor read access in kernel mode [ 82.129536] [ T64] #PF: error_code(0x0000) - not-present page [ 82.129891] [ T64] PGD 0 P4D 0 [ 82.130226] [ T64] Oops: Oops: 0000 [#1] SMP NOPTI [ 82.130569] [ T64] CPU: 0 UID: 0 PID: 64 Comm: kworker/0:2 Kdump: loaded Not tainted 6.16.0-dirty #1 PREEMPT(voluntary) 01ad4c2bf7751774a8dac4ffc0ff3686a61b6778 [ 82.130923] [ T64] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 [ 82.131284] [ T64] Workqueue: usb_hub_wq hub_event [ 82.131662] [ T64] RIP: 0010:fq_flow_reset.constprop.0+0x18/0xe0 [mac80211] [ 82.132097] [ T64] Code: 1f 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1f 44 00 00 41 55 41 54 4c 8d a7 40 ff ff ff 55 48 89 fd 53 48 89 f3 <4c> 8b 2e eb 0b 48 89 c6 4c 89 e7 e8 a8 57 fc ff 48 89 de 48 89 ef [ 82.132513] [ T64] RSP: 0018:ffffcdc8002f7928 EFLAGS: 00010202 [ 82.132878] [ T64] RAX: ffff8a97c12f6088 RBX: 00000000c12f6080 RCX: ffff8a97c12ed210 [ 82.133239] [ T64] RDX: 00000000c12f6088 RSI: 00000000c12f6080 RDI: ffff8a97c12ec9c0 [ 82.133617] [ T64] RBP: ffff8a97c12ec9c0 R08: 0000000000000000 R09: 0000000000000000 [ 82.133974] [ T64] R10: ffff8a97c12ed210 R11: 0000000000000246 R12: ffff8a97c12ec900 [ 82.134333] [ T64] R13: 0000000000000000 R14: ffffcdc8002f7ad8 R15: ffffcdc8002f79c0 [ 82.134818] [ T64] FS: 0000000000000000(0000) GS:ffff8a994c085000(0000) knlGS:0000000000000000 [ 82.135216] [ T64] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 82.135738] [ T64] CR2: 00000000c12f6080 CR3: 0000000102af4004 CR4: 00000000000726f0 [ 82.136286] [ T64] Call Trace: [ 82.136730] [ T64] <TASK> [ 82.137105] [ T64] fq_tin_reset.constprop.0+0x24/0x80 [mac80211 929346fed04d387366a55c8dfe4baff0095fbbe6] [ 82.137586] [ T64] ieee80211_txq_purge+0x35/0xc0 [mac80211 929346fed04d387366a55c8dfe4baff0095fbbe6] [ 82.138058] [ T64] ieee80211_do_stop+0x47d/0x980 [mac80211 929346fed04d387366a55c8dfe4baff0095fbbe6] [ 82.138493] [ T64] ? synchronize_rcu_expedited+0x1df/0x220 [ 82.138892] [ T64] ieee80211_stop+0x62/0xe0 [mac80211 929346fed04d387366a55c8dfe4baff0095fbbe6] [ 82.139340] [ T64] __dev_close_many+0xd5/0x1c0 [ 82.139721] [ T64] dev_close_many+0xbc/0x1a0 [ 82.140092] [ T64] netif_close+0x68/0xa0 [ 82.140481] [ T64] dev_close+0x34/0x60 [ 82.140853] [ T64] cfg80211_shutdown_all_interfaces+0x46/0xf0 [cfg80211 dd16b5aa15c7e1bea6a27abe1c3536b4e8d54dde] [ 82.141360] [ T64] ieee80211_remove_interfaces+0x4c/0x220 [mac80211 929346fed04d387366a55c8dfe4baff0095fbbe6] [ 82.141843] [ T64] ieee80211_unregister_hw+0x4a/0x130 [mac80211 929346fed04d387366a55c8dfe4baff0095fbbe6] [ 82.142291] [ T64] rsi_mac80211_detach+0x29/0x80 [rsi_91x a6efdcfea87ad896e34b827cf5122ed0585a3c7c] [ 82.142691] [ T64] rsi_disconnect+0x22/0x220 [rsi_usb e6893aa53c0a54e986015b3fc93cd4ca1a5408f9] [ 82.143331] [ T64] usb_unbind_interface+0x90/0x280 [ 82.144726] [ T64] device_release_driver_internal+0x19e/0x200 [ 82.145300] [ T64] bus_remove_device+0xc2/0x130 [ 82.145674] [ T64] device_del+0x160/0x3d0 [ 82.146040] [ T64] ? kobject_put+0xa2/0x200 [ 82.146425] [ T64] usb_disable_device+0xf4/0x220 [ 82.146798] [ T64] usb_disconnect+0xdf/0x2d0 [ 82.147195] [ T64] hub_event+0xe4e/0x1900 [ 82.147573] [ T64] ? insn_init+0x1/0x70 [ 82.147928] [ T64] process_one_work+0x190/0x350 [ 82.148304] [ T64] worker_thread+0x2d7/0x410 [ 82.148656] [ T64] ? __pfx_worker_thread+0x10/0x10 [ 82.148998] [ T64] kthread+0xf9/0x240 [ 82.149347] [ T64] ? __pfx_kthread+0x10/0x10 [ 82.149687] [ T64] ? __pfx_kthread+0x10/0x10 [ 82.150024] [ T64] ret_from_fork+0x197/0x1c0 [ 82.150392] [ T64] ? __pfx_kthread+0x10/0x10 [ 82.150770] [ T64] ret_from_fork_asm+0x1a/0x30 [ 82.151120] [ T64] </TASK> [ 82.151560] [ T64] Modules linked in: rsi_usb rsi_91x mac80211 libarc4 cfg80211 rfkill vboxsf intel_rapl_msr intel_rapl_common intel_uncore_frequency_common intel_pmc_core pmt_telemetry pmt_class intel_pmc_ssram_telemetry intel_vsec kvm_intel kvm snd_intel8x0 snd_ac97_codec ac97_bus irqbypass snd_pcm vfat fat polyval_clmulni snd_timer ghash_clmulni_intel psmouse snd sha512_ssse3 video sha1_ssse3 joydev e1000 mousedev aesni_intel soundcore vboxguest i2c_piix4 wmi pcspkr rapl i2c_smbus mac_hid dm_mod loop nfnetlink vsock_loopback vmw_vsock_virtio_transport_common vmw_vsock_vmci_transport vmw_vmci vsock bpf_preload ip_tables x_tables ext4 crc16 mbcache jbd2 vmwgfx serio_raw sr_mod atkbd libps2 cdrom vivaldi_fmap ata_generic drm_ttm_helper i8042 intel_agp pata_acpi ttm serio intel_gtt hid_generic ata_piix usbhid [ 82.153690] [ T64] CR2: 00000000c12f6080 Thanks again for the help. Cameron.
