Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wifi: Firmware crashing regularly on RPi 0W2 #1768

Open
porst17 opened this issue Jan 1, 2023 · 87 comments
Open

Wifi: Firmware crashing regularly on RPi 0W2 #1768

porst17 opened this issue Jan 1, 2023 · 87 comments

Comments

@porst17
Copy link

porst17 commented Jan 1, 2023

Describe the bug
The firmware of the onboard WiFi on my RPi 0W2 crashes almost every day:

[78167.189463] ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed
[78167.237807] brcmfmac: CONSOLE:
[78167.237835] brcmfmac: CONSOLE: FWID 01-3b307371
[78167.237846] brcmfmac: CONSOLE: flags 1
[78167.237856] brcmfmac: CONSOLE:
[78167.237868] brcmfmac: CONSOLE: TRAP c(6ff7c): pc 837364, lr 8372bb, sp 3f828, cpsr 4000000c, spsr 41000000
[78167.237881] brcmfmac: CONSOLE:   r0 0, r1 4, r2 0, r3 0, r4 0, r5 0, r6 60cbc
[78167.237893] brcmfmac: CONSOLE:   r7 4f390, r8 61190, r9 0, r10 168, r11 0, r12 7c
[78167.237904] brcmfmac: CONSOLE:
[78167.237916] brcmfmac: CONSOLE:    sp+0 00000000 00802fa9 00060de8 00061218
[78167.237928] brcmfmac: CONSOLE:   sp+10 00065e00 00061190 00065e00 00060cbc
[78167.237939] brcmfmac: CONSOLE:
[78167.237949] brcmfmac: CONSOLE: sp+4 00802fa9
[78167.237959] brcmfmac: CONSOLE: sp+34 00019ab5
[78167.237970] brcmfmac: CONSOLE: sp+5c 00844f3f
[78167.237980] brcmfmac: CONSOLE: sp+7c 008472b5
[78167.237991] brcmfmac: CONSOLE: sp+94 0085e3f5
[78167.238001] brcmfmac: CONSOLE: sp+fc 0081e9e9
[78167.238012] brcmfmac: CONSOLE: sp+130 00844c95
[78167.238023] brcmfmac: CONSOLE: sp+134 00844fe9
[78167.238033] brcmfmac: CONSOLE: sp+164 0002f6df
[78167.238044] brcmfmac: CONSOLE: sp+1bc 00807f53
[78167.238055] brcmfmac: CONSOLE: sp+1f4 00875b39
[78167.238065] brcmfmac: CONSOLE: sp+234 0001b6b1
[78167.238076] brcmfmac: CONSOLE: sp+274 0001e085
[78167.238087] brcmfmac: CONSOLE: sp+29c 0082eed3
[78167.238097] brcmfmac: CONSOLE: sp+2c4 0082f215
[78167.238108] brcmfmac: CONSOLE: sp+2d4 0081f351
[78167.285400] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
[78167.285433] ieee80211 phy0: brcmf_cfg80211_get_tx_power: error (-5)
[78167.937870] brcmfmac: brcmf_sdiod_probe: Failed to set F1 blocksize
[78167.937934] brcmfmac: brcmf_sdio_bus_reset: Failed to probe after sdio device reset: ret -123

It seems I can only get it back online by restarting the RPi. I am tracking this issue for the past months and already tried running with over_voltage=2 as suggested elsewhere, but no luck.

Expected behaviour
WiFi firmware does not crash.

Actual behaviour
WiFi firmware crashes.

System & Logs
See the attached raspinfo.txt.

Additional context
I can't confirm it 100% yet, but the crash seems to happen whenever the connection is handed over from my WiFi router to my WiFi repeater or vice versa.

@pelwell
Copy link
Contributor

pelwell commented Jan 4, 2023

There's a ticket open with Synaptics for this issue. I'll report back with any questions or findings.

@Smyl3
Copy link

Smyl3 commented Jan 6, 2023

I had the same issue with a Raspberry Zero 2 W and Dietpi OS. With like every day unrecoverable brcmf_fw_crash.
It seems its related to overlapping wifi networks.
We used 2 routers here with the same SSID.
I changed one of them SSID to something else, and since then I didnt see wifi issue. I installed a bash script to check my router ip access every 5 min and restart kernel module if needed but it wasnt.
What is weird I didnt upgrade the Raspberry packages (Dietpi OS) and we used this router setup long time ago, so I dont know the reason why it started facing the issue some weeks ago.

Example for the crash:
Dec 29 19:00:10 zero2 kernel: [122694.272662] brcmfmac: brcmf_cfg80211_set_power_mgmt: power save disabled
Dec 29 19:00:11 zero2 kernel: [122695.912670] ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed
Dec 29 19:00:12 zero2 kernel: [122695.985029] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Dec 29 19:00:12 zero2 kernel: [122695.985074] ieee80211 phy0: brcmf_cfg80211_get_tx_power: error (-5)
Dec 29 19:00:12 zero2 kernel: [122696.617005] brcmfmac: brcmf_sdiod_probe: Failed to set F1 blocksize
Dec 29 19:00:12 zero2 kernel: [122696.617137] brcmfmac: brcmf_sdio_bus_reset: Failed to probe after sdio device reset: r
et -123
Dec 29 19:00:12 zero2 kernel: [122696.618115] mmc1: card 0001 removed
Dec 29 19:00:12 zero2 kernel: [122696.660762] mmc1: queuing unknown CIS tuple 0xc0 [dd 38 c1 95 4f f1 8a 61 89 b7 68 bf
e2 45 00] (15 bytes)
Dec 29 19:00:12 zero2 kernel: [122696.751641] mmc1: queuing unknown CIS tuple 0x2a [80 ff e6 ec 00 00 01 0a 1e 2c 00 f9
92 b6 b4 0c ff 01 13 48 ff 00 e4 41 48 09 38 6b 4c 1f ff 00 58 0a 12 83 7c 7f f4 00 ff ad ff ec 22 08 c6 59 df 10 f8 33
da 1f 48 ff a5 e2 28 2f b4 ff f0 20] (253 bytes)
Dec 29 19:00:12 zero2 kernel: [122696.753777] mmc1: queuing unknown CIS tuple 0xf1 [03 35] (2 bytes)
Dec 29 19:00:12 zero2 kernel: [122696.805589] mmc1: queuing unknown CIS tuple 0x2e [e2 12 22 c1 04 72 76 ff 8d ff fe a4
49 44 00 00 4b 16 86 12 c3 3d 75 07 93 00 01 b1 62 ed 2e 49 16 ff 27 13 6a 0b 02 30 06 b0 c2 02 16 7f 00 41 7a 48 6d 02
24 61 00 20 00 00 9f 42 99 06 c1 04] (144 bytes)
Dec 29 19:00:57 zero2 kernel: [122740.941905] mmc1: error -22 whilst initialising SDIO card
Dec 29 19:00:57 zero2 kernel: [122740.997200] mmc1: queuing unknown CIS tuple 0xc0 [dd 38 c1 95 4f f1 8a 61 89 b7 68 bf
e2 45 00] (15 bytes)
Dec 29 19:00:57 zero2 kernel: [122741.110450] mmc1: queuing unknown CIS tuple 0x2a [80 ff e6 ec 00 00 01 0a 1e 2c 00 f9
92 b6 b4 0c ff 01 13 48 ff 00 e4 41 48 09 38 6b 4c 1f ff 00 58 0a 12 83 7c 7f f4 00 ff ad ff ec 22 08 c6 59 df 10 f8 33
da 1f 48 ff a5 e2 28 2f b4 ff f0 20] (253 bytes)
Dec 29 19:00:57 zero2 kernel: [122741.112705] mmc1: queuing unknown CIS tuple 0xf1 [03 35] (2 bytes)
Dec 29 19:00:57 zero2 kernel: [122741.177792] mmc1: queuing unknown CIS tuple 0x2e [e2 12 22 c1 04 72 76 ff 8d ff fe a4
49 44 00 00 4b 16 86 12 c3 3d 75 07 93 00 01 b1 62 ed 2e 49 16 ff 27 13 6a 0b 02 30 06 b0 c2 02 16 7f 00 41 7a 48 6d 02
24 61 00 20 00 00 9f 42 99 06 c1 04] (144 bytes)
Dec 29 19:01:52 zero2 kernel: [122796.785417] mmc1: error -22 whilst initialising SDIO card
Dec 29 19:01:52 zero2 kernel: [122796.850698] mmc1: queuing unknown CIS tuple 0xc0 [dd 38 c1 95 4f f1 8a 61 89 b7 68 bf
e2 45 00] (15 bytes)

@pelwell
Copy link
Contributor

pelwell commented Jan 6, 2023

Can you do what @porst17 did and add brcmfmac.debug=0x100000 to /boot/cmdline.txt (keeping it all in one line) and reboot? Any firmware crash should then generate a log like the one in the first post:

[78167.189463] ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed
[78167.237807] brcmfmac: CONSOLE:
[78167.237835] brcmfmac: CONSOLE: FWID 01-3b307371
[78167.237846] brcmfmac: CONSOLE: flags 1
[78167.237856] brcmfmac: CONSOLE:
[78167.237868] brcmfmac: CONSOLE: TRAP c(6ff7c): pc 837364, lr 8372bb, sp 3f828, cpsr 4000000c, spsr 41000000
[78167.237881] brcmfmac: CONSOLE:   r0 0, r1 4, r2 0, r3 0, r4 0, r5 0, r6 60cbc
[78167.237893] brcmfmac: CONSOLE:   r7 4f390, r8 61190, r9 0, r10 168, r11 0, r12 7c
...

@porst17
Copy link
Author

porst17 commented Jan 8, 2023

I also want to add that my setup uses the same SSID for the main router and the repeater. This is the default setup of the wifi mesh system (AVM Fritz!Box) I have been using for years without problems on the many WiFi devices I own. It's just the RPi 0W2 that doesn't seem to like it. 🤷‍♂️

@WLBQE
Copy link

WLBQE commented Jan 9, 2023

I have also been experiencing this on my 0W2 for two weeks, ever since I moved the pi from a wall socket to a power strip, so it might have something to do with voltage. I use the "official" adapter.
Until a couple of days ago I handled it by plugging the pi out and then back in. The firmware could hold up for at least a day before crashing again. Then I switched to a cron script that reboots whenever the firmware crashes, and in the past 24 hours it has crashed 3 times.
One thing I notice is that the crash always happens after attempting to renew the DHCP lease. Meanwhile, as other folks, I'm also on a mesh Wi-Fi network (Deco).
I'll set the firmware to debug mode and post logs here the next time it crashes.

@WLBQE
Copy link

WLBQE commented Jan 19, 2023

Logs from a recent crash:

Jan 18 17:50:25 homebridge kernel: [87244.740253] ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed
Jan 18 17:50:25 homebridge kernel: [87244.798582] brcmfmac: CONSOLE: 
Jan 18 17:50:25 homebridge kernel: [87244.798611] brcmfmac: CONSOLE: FWID 01-3b307371
Jan 18 17:50:25 homebridge kernel: [87244.798624] brcmfmac: CONSOLE: flags 1
Jan 18 17:50:25 homebridge kernel: [87244.798636] brcmfmac: CONSOLE: 
Jan 18 17:50:25 homebridge kernel: [87244.798648] brcmfmac: CONSOLE: TRAP 3(6ff7c): pc 87b7c6, lr 867231, sp 3f71c, cpsr 20000003, spsr 21000000
Jan 18 17:50:25 homebridge kernel: [87244.798661] brcmfmac: CONSOLE:   r0 f7d19ee4, r1 61190, r2 3f808, r3 0, r4 3f784, r5 1002, r6 3f780
Jan 18 17:50:25 homebridge kernel: [87244.798675] brcmfmac: CONSOLE:   r7 0, r8 3f808, r9 0, r10 61190, r11 6058c, r12 3f7d4
Jan 18 17:50:25 homebridge kernel: [87244.798687] brcmfmac: CONSOLE: 
Jan 18 17:50:25 homebridge kernel: [87244.798699] brcmfmac: CONSOLE:    sp+0 0003f784 00001002 00867231 00000001
Jan 18 17:50:25 homebridge kernel: [87244.798711] brcmfmac: CONSOLE:   sp+10 0085ec05 ffffffff 0005a080 00000000
Jan 18 17:50:25 homebridge kernel: [87244.798723] brcmfmac: CONSOLE: 
Jan 18 17:50:25 homebridge kernel: [87244.798734] brcmfmac: CONSOLE: sp+8 00867231
Jan 18 17:50:25 homebridge kernel: [87244.798746] brcmfmac: CONSOLE: sp+10 0085ec05
Jan 18 17:50:25 homebridge kernel: [87244.798758] brcmfmac: CONSOLE: sp+48 00867607
Jan 18 17:50:25 homebridge kernel: [87244.798769] brcmfmac: CONSOLE: sp+88 008364af
Jan 18 17:50:25 homebridge kernel: [87244.798780] brcmfmac: CONSOLE: sp+a0 00839441
Jan 18 17:50:25 homebridge kernel: [87244.798792] brcmfmac: CONSOLE: sp+b8 008566f3
Jan 18 17:50:25 homebridge kernel: [87244.798803] brcmfmac: CONSOLE: sp+d8 0084807f
Jan 18 17:50:25 homebridge kernel: [87244.798815] brcmfmac: CONSOLE: sp+110 00830fc9
Jan 18 17:50:25 homebridge kernel: [87244.798826] brcmfmac: CONSOLE: sp+15c 00001531
Jan 18 17:50:25 homebridge kernel: [87244.798838] brcmfmac: CONSOLE: sp+164 00011531
Jan 18 17:50:25 homebridge kernel: [87244.798850] brcmfmac: CONSOLE: sp+1c4 0087702d
Jan 18 17:50:25 homebridge kernel: [87244.798861] brcmfmac: CONSOLE: sp+1c8 0087710d
Jan 18 17:50:25 homebridge kernel: [87244.798872] brcmfmac: CONSOLE: sp+1d0 00807b3f
Jan 18 17:50:25 homebridge kernel: [87244.798884] brcmfmac: CONSOLE: sp+230 0000586f
Jan 18 17:50:25 homebridge kernel: [87244.798895] brcmfmac: CONSOLE: sp+28c 008302d5
Jan 18 17:50:25 homebridge kernel: [87244.798907] brcmfmac: CONSOLE: sp+2a0 00833417
Jan 18 17:50:25 homebridge kernel: [87245.147269] ieee80211 phy0: brcmf_netdev_start_xmit: xmit rejected state=0
Jan 18 17:50:27 homebridge kernel: [87247.291281] brcmfmac: brcmf_sdio_bus_rxctl: resumed on timeout
Jan 18 17:50:27 homebridge kernel: [87247.292223] brcmfmac: brcmf_sdio_checkdied: firmware trap in dongle
Jan 18 17:50:27 homebridge kernel: [87247.292588] brcmfmac: dongle trap info: type 0x3 @ epc 0x0087b7c6
Jan 18 17:50:27 homebridge kernel: [87247.292588]   cpsr 0x20000003 spsr 0x21000000 sp 0x0003f71c
Jan 18 17:50:27 homebridge kernel: [87247.292588]   lr   0x00867231 pc   0x0087b7c6 offset 0x6ff7c
Jan 18 17:50:27 homebridge kernel: [87247.292588]   r0   0xf7d19ee4 r1   0x00061190 r2 0x0003f808 r3 0x00000000
Jan 18 17:50:27 homebridge kernel: [87247.292588]   r4   0x0003f784 r5   0x00001002 r6 0x0003f780 r7 0x00000000
Jan 18 17:50:27 homebridge kernel: [87247.292660] ieee80211 phy0: brcmf_cfg80211_disconnect: error (-110)
Jan 18 17:50:27 homebridge kernel: [87247.292753] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Jan 18 17:50:27 homebridge kernel: [87247.292777] ieee80211 phy0: _brcmf_set_multicast_list: Setting BRCMF_C_SET_PROMISC failed, err=-5
Jan 18 17:50:27 homebridge kernel: [87247.292805] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Jan 18 17:50:27 homebridge kernel: [87247.292827] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Jan 18 17:50:28 homebridge kernel: [87247.807106] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Jan 18 17:50:28 homebridge kernel: [87247.807172] ieee80211 phy0: brcmf_cfg80211_get_tx_power: error (-5)
Jan 18 17:50:28 homebridge kernel: [87247.807612] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Jan 18 17:50:28 homebridge kernel: [87247.807643] ieee80211 phy0: brcmf_cfg80211_reg_notifier: Country code iovar returned err = -5
Jan 18 17:50:28 homebridge kernel: [87247.886394] brcmfmac: brcmf_sdiod_probe: Failed to set F1 blocksize
Jan 18 17:50:28 homebridge kernel: [87247.886499] brcmfmac: brcmf_sdio_bus_reset: Failed to probe after sdio device reset: ret -123
Jan 18 17:50:28 homebridge kernel: [87247.887801] mmc1: card 0001 removed
Jan 18 17:50:28 homebridge kernel: [87248.012263] mmc1: queuing unknown CIS tuple 0x02 [0b 9f 10 37 b5 cb 93 26 ff 98 4a e6 44 80 00 d6 03 c9 ff 76 4d 53 ff bd 60 c7 42 ca 03 e3 50 3f 0c cf 69 d6 5f ff 12 c8 44 cd 48 cc c0 ca b3 39 00 51 4d ff 41 8c d1 a8 c8 ff 84 ff c1 cc 52 9a] (196 bytes)
Jan 18 17:50:28 homebridge kernel: [87248.014664] mmc1: queuing unknown CIS tuple 0x6e [12 81 29 22 77] (5 bytes)
Jan 18 17:50:28 homebridge kernel: [87248.075837] mmc1: queuing unknown CIS tuple 0x0c [b9 ff f5 42 31 4b 51 1a 95 69 ff 03 eb 44 7f c0 e3 24 fc 4a 30 ab 4c 71 77 40 ff 28 b3 c2 fd c0 6e 81 73 12 ff d6 29 8e 39 2a be 86 49 02 04 03 7b 22 30 13 7e 3f e9 13 e0 59 e4 42 e4 fa a4 84] (178 bytes)
Jan 18 17:50:28 homebridge kernel: [87248.096219] mmc1: queuing unknown CIS tuple 0xf0 [51 ff 32 c8 45 04 cf 43 56 47 59 a8 52 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00] (58 bytes)

@pelwell
Copy link
Contributor

pelwell commented Jan 19, 2023

Thanks for that, @WLBQE. I've passed it on.

@mati75
Copy link

mati75 commented Jan 29, 2023

I have the same issue with firmware from next branch.

@pelwell
Copy link
Contributor

pelwell commented Jan 30, 2023

I've received two test firmwares from Synaptics, numbered 1 and 2. There was no accompanying information, so I don't know if they might be a fixes or whether they are just to gather more information.

Firmware 1: https://drive.google.com/file/d/1UghnB9zZ7ydpVlYaTbp8F1M0rqEX_DZK/view?usp=share_link
Firmware 2: https://drive.google.com/file/d/1P3QZDMFPR3I5wPGYWNu2SCEJli9oTCC6/view?usp=share_link

To back up the original firmware:

$ sudo cp /lib/firmware/brcm/brcmfmac43436-sdio.bin{,.orig} 

To install (change test1 to test2 for the second test firmware):

$ sudo cp fw_bcmdhd_test1.bin /lib/firmware/brcm/brcmfmac43436-sdio.bin

To revert to the original firmware:

$ sudo cp /lib/firmware/brcm/brcmfmac43436-sdio.bin{.orig,} 

@Smyl3
Copy link

Smyl3 commented Jan 30, 2023

Unfortunately it would be pointless to test those test firmwares for me I think, because I still couldnt reproduce the issuse for some reason.

@porst17
Copy link
Author

porst17 commented Jan 31, 2023

I am running the test2 firmware since yesterday and so far there haven't been any firmware crashes. I'll report back in a couple of days.

@pelwell
Copy link
Contributor

pelwell commented Jan 31, 2023

@Smyl3 I understand - enjoy the lack of crashes.

@porst17 Thank you - that's sounding promising.

@porst17
Copy link
Author

porst17 commented Feb 3, 2023

Unfortunately, the Wifi firmware (test2) crashed again two times over the past couple of days:

Feb  1 22:14:41 openhab kernel: [212302.000222] ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed
Feb  1 22:14:41 openhab kernel: [212302.046161] brcmfmac: CONSOLE:
Feb  1 22:14:41 openhab kernel: [212302.046190] brcmfmac: CONSOLE: FWID 01-c43ac73d
Feb  1 22:14:41 openhab kernel: [212302.046201] brcmfmac: CONSOLE: flags 1
Feb  1 22:14:41 openhab kernel: [212302.046211] brcmfmac: CONSOLE:
Feb  1 22:14:41 openhab kernel: [212302.046224] brcmfmac: CONSOLE: TRAP c(6ff7c): pc 83cf64, lr 83cf5d, sp 40ff0, cpsr 2000000c, spsr 21000000
Feb  1 22:14:41 openhab kernel: [212302.046237] brcmfmac: CONSOLE:   r0 1, r1 41138, r2 2151, r3 137, r4 41138, r5 0, r6 67940
Feb  1 22:14:41 openhab kernel: [212302.046250] brcmfmac: CONSOLE:   r7 5057c, r8 30, r9 1, r10 85e671, r11 41170, r12 4
Feb  1 22:14:41 openhab kernel: [212302.046261] brcmfmac: CONSOLE:
Feb  1 22:14:41 openhab kernel: [212302.046272] brcmfmac: CONSOLE:    sp+0 0005d1e0 00041138 00000000 0083cef5
Feb  1 22:14:41 openhab kernel: [212302.046284] brcmfmac: CONSOLE:   sp+10 00041138 0005b810 00000016 0085e6c5
Feb  1 22:14:41 openhab kernel: [212302.046295] brcmfmac: CONSOLE:
Feb  1 22:14:41 openhab kernel: [212302.046305] brcmfmac: CONSOLE: sp+c 0083cef5
Feb  1 22:14:41 openhab kernel: [212302.046316] brcmfmac: CONSOLE: sp+1c 0085e6c5
Feb  1 22:14:41 openhab kernel: [212302.046328] brcmfmac: CONSOLE: sp+4c 0085e7c9
Feb  1 22:14:41 openhab kernel: [212302.046211] brcmfmac: CONSOLE:
Feb  1 22:14:41 openhab kernel: [212302.046224] brcmfmac: CONSOLE: TRAP c(6ff7c): pc 83cf64, lr 83cf5d, sp 40ff0, cpsr 2000000c, spsr 21000000
Feb  1 22:14:41 openhab kernel: [212302.046237] brcmfmac: CONSOLE:   r0 1, r1 41138, r2 2151, r3 137, r4 41138, r5 0, r6 67940
Feb  1 22:14:41 openhab kernel: [212302.046250] brcmfmac: CONSOLE:   r7 5057c, r8 30, r9 1, r10 85e671, r11 41170, r12 4
Feb  1 22:14:41 openhab kernel: [212302.046261] brcmfmac: CONSOLE:
Feb  1 22:14:41 openhab kernel: [212302.046272] brcmfmac: CONSOLE:    sp+0 0005d1e0 00041138 00000000 0083cef5
Feb  1 22:14:41 openhab kernel: [212302.046284] brcmfmac: CONSOLE:   sp+10 00041138 0005b810 00000016 0085e6c5
Feb  1 22:14:41 openhab kernel: [212302.046295] brcmfmac: CONSOLE:
Feb  1 22:14:41 openhab kernel: [212302.046305] brcmfmac: CONSOLE: sp+c 0083cef5
Feb  1 22:14:41 openhab kernel: [212302.046316] brcmfmac: CONSOLE: sp+1c 0085e6c5
Feb  1 22:14:41 openhab kernel: [212302.046328] brcmfmac: CONSOLE: sp+4c 0085e7c9
Feb  1 22:14:41 openhab kernel: [212302.046338] brcmfmac: CONSOLE: sp+8c 0085e929
Feb  1 22:14:41 openhab kernel: [212302.046349] brcmfmac: CONSOLE: sp+98 0085e671
Feb  1 22:14:41 openhab kernel: [212302.046359] brcmfmac: CONSOLE: sp+11c 0085e515
Feb  1 22:14:41 openhab kernel: [212302.046370] brcmfmac: CONSOLE: sp+130 0085e635
Feb  1 22:14:41 openhab kernel: [212302.046380] brcmfmac: CONSOLE: sp+134 0085e671
Feb  1 22:14:41 openhab kernel: [212302.046391] brcmfmac: CONSOLE: sp+18c 0000013b
Feb  1 22:14:41 openhab kernel: [212302.046401] brcmfmac: CONSOLE: sp+1b4 0085ea59
Feb  1 22:14:41 openhab kernel: [212302.046412] brcmfmac: CONSOLE: sp+1d4 00836547
Feb  1 22:14:41 openhab kernel: [212302.046422] brcmfmac: CONSOLE: sp+22c 0085e2af
Feb  1 22:14:41 openhab kernel: [212302.046433] brcmfmac: CONSOLE: sp+25c 008390b3
Feb  1 22:14:41 openhab kernel: [212302.046443] brcmfmac: CONSOLE: sp+300 00832175
Feb  1 22:14:41 openhab kernel: [212302.046454] brcmfmac: CONSOLE: sp+304 00832165
Feb  1 22:14:41 openhab kernel: [212302.046464] brcmfmac: CONSOLE: sp+308 00832191
Feb 02 04:15:08 openhab kernel: ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE:
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: FWID 01-c43ac73d
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: flags 1
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE:
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: TRAP c(6ff7c): pc 83cf64, lr 83cf5d, sp 40ff0, cpsr 2000000c, spsr 21000000
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE:   r0 1, r1 41138, r2 2151, r3 137, r4 41138, r5 0, r6 67940
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE:   r7 50d60, r8 30, r9 1, r10 85e671, r11 41170, r12 4
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE:
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE:    sp+0 0005d1e0 00041138 00000000 0083cef5
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE:   sp+10 00041138 0005b810 00000016 0085e6c5
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE:
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE:
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: TRAP c(6ff7c): pc 83cf64, lr 83cf5d, sp 40ff0, cpsr 2000000c, spsr 21000000
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE:   r0 1, r1 41138, r2 2151, r3 137, r4 41138, r5 0, r6 67940
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE:   r7 50d60, r8 30, r9 1, r10 85e671, r11 41170, r12 4
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE:
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE:    sp+0 0005d1e0 00041138 00000000 0083cef5
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE:   sp+10 00041138 0005b810 00000016 0085e6c5
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE:
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: sp+c 0083cef5
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: sp+1c 0085e6c5
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: sp+4c 0085e7c9
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: sp+8c 0085e929
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: sp+98 0085e671
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: sp+11c 0085e515
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: sp+130 0085e635
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: sp+134 0085e671
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: sp+18c 0000013b
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: sp+1b4 0085ea59
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: sp+1d4 00836547
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: sp+22c 0085e2af
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: sp+25c 008390b3
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: sp+300 00832175
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: sp+304 00832165
Feb 02 04:15:08 openhab kernel: brcmfmac: CONSOLE: sp+308 00832191

@pelwell
Copy link
Contributor

pelwell commented Feb 3, 2023

Thanks - I'll feed back your findings. Did you try test1?

Did anybody else try the new firmwares?

@porst17
Copy link
Author

porst17 commented Feb 3, 2023

I was running test2 so far and switched over to the test1 firmware just now. I'll keep you updated.

@pelwell
Copy link
Contributor

pelwell commented Feb 3, 2023

Thanks again. Until we are able to reproduce the issue we are relying on people like you.

@mati75
Copy link

mati75 commented Feb 4, 2023

In my case test1 crashes just as often, additionally bluetooth loses connections. test2 works fine so far.

@pelwell
Copy link
Contributor

pelwell commented Feb 4, 2023

Interesting. Do you have an example log from a test1 crash?

@porst17
Copy link
Author

porst17 commented Feb 10, 2023

In my case test1 crashes just as often, additionally bluetooth loses connections. test2 works fine so far.

I've been running test1 now for about a week without a single crash. 🤞
Strange that others seem to observe the opposite behavior.

@pelwell
Copy link
Contributor

pelwell commented Feb 10, 2023

Indeed - it is strange.

@mati75 It would be helpful if you could find the time to capture and post a crash log from the test1 firmware.

@Smyl3
Copy link

Smyl3 commented Feb 10, 2023

Maybe there are more different issues in the firmware that needs different solutions.

@mati75
Copy link

mati75 commented Feb 10, 2023

@pelwell I will try catch crash at the weekend. I only caught that the crash occurs when dhcpv6 loses connection, but I wasn't able to save dmesg.

@mati75
Copy link

mati75 commented Feb 10, 2023

[Fri Feb 10 18:56:22 2023] brcmfmac: CONSOLE: wlc_join_adopt_bss, 5751
[Fri Feb 10 18:56:22 2023] brcmfmac: CONSOLE: wlc_link, 36727
[Fri Feb 10 18:56:22 2023] brcmfmac: CONSOLE: wlc_link, 36849
[Fri Feb 10 18:56:22 2023] brcmfmac: CONSOLE: wl0: link up (wl0)
[Fri Feb 10 18:56:22 2023] brcmfmac: CONSOLE: wl0.0: wlc_send_bar: seq 0x1 tid 0
[Fri Feb 10 18:56:22 2023] brcmfmac: CONSOLE: wl0: wlc_iovar_op: BCME -23 :ndoe
[Fri Feb 10 18:56:22 2023] brcmfmac: CONSOLE: wl0: wlc_iovar_op: BCME -23 :ndoe
[Fri Feb 10 18:56:22 2023] brcmfmac: CONSOLE: wl0: wlc_iovar_op: BCME -23 :ndoe
[Fri Feb 10 18:56:22 2023] brcmfmac: CONSOLE: wl0: wlc_iovar_op: BCME -23 :ndoe
[Fri Feb 10 18:56:22 2023] brcmfmac: CONSOLE: wl0: wlc_iovar_op: BCME -23 :ndoe
[Fri Feb 10 18:56:22 2023] brcmfmac: CONSOLE: wl0: wlc_iovar_op: BCME -23 :ndoe
[Fri Feb 10 18:56:22 2023] brcmfmac: CONSOLE: wl0: wlc_iovar_op: BCME -23 :ndoe
[Fri Feb 10 18:56:28 2023] brcmfmac: CONSOLE: wl0: wlc_iovar_op: BCME -23 :ndoe
[Fri Feb 10 18:56:33 2023] brcmfmac: CONSOLE: wl0.0: wlc_send_bar: seq 0x1 tid 4
[Fri Feb 10 18:56:34 2023] brcmfmac: CONSOLE: wl0: wlc_iovar_op: BCME -23 :ndoe
[Fri Feb 10 18:56:34 2023] brcmfmac: CONSOLE: wl0: wlc_iovar_op: BCME -23 :ndoe
[Fri Feb 10 18:56:35 2023] brcmfmac: CONSOLE: wl0: wlc_iovar_op: BCME -23 :ndoe
ping6 google.com -c 3
PING google.com(bud02s23-in-x0e.1e100.net (2a00:1450:400d:802::200e)) 56 data bytes

--- google.com ping statistics ---
3 packets transmitted, 0 received, 100% packet loss, time 2108ms

connections down, in the same network pi0w, rpi4 working fine

@aa777888-2
Copy link

aa777888-2 commented Feb 15, 2023

All: I'm also seeing this problem, I think. My Pi Z2W is living in a Ubiquiti wireless environment. Four UAP-AC-LR access points, all advertising three different SSIDs, on SSID reserved for IoT devices and not broadcasting it's ID. The Z2W is on the IoT WiFi SSID. It can really only see two of the access points. I used Unifi controller to lock the Z2W to a single AP. This reduced spontaneous reboots from a couple of times a day to about once or twice a week, but still has not fixed the problem. Running box stock Raspian 64 bit.

Here is a syslog snippet from the latest reboot. You can see the usual FIPS logging nonsense, some trouble with the WiFi connection, then BOOM!

Feb 15 09:34:23 genmon rngd[397]: stats: bits received from HRNG source: 6200064
Feb 15 09:34:23 genmon rngd[397]: stats: bits sent to kernel pool: 6146144
Feb 15 09:34:23 genmon rngd[397]: stats: entropy added to kernel pool: 6146144
Feb 15 09:34:23 genmon rngd[397]: stats: FIPS 140-2 successes: 310
Feb 15 09:34:23 genmon rngd[397]: stats: FIPS 140-2 failures: 0
Feb 15 09:34:23 genmon rngd[397]: stats: FIPS 140-2(2001-10-10) Monobit: 0
Feb 15 09:34:23 genmon rngd[397]: stats: FIPS 140-2(2001-10-10) Poker: 0
Feb 15 09:34:23 genmon rngd[397]: stats: FIPS 140-2(2001-10-10) Runs: 0
Feb 15 09:34:23 genmon rngd[397]: stats: FIPS 140-2(2001-10-10) Long run: 0
Feb 15 09:34:23 genmon rngd[397]: stats: FIPS 140-2(2001-10-10) Continuous run: 0
Feb 15 09:34:23 genmon rngd[397]: stats: HRNG source speed: (min=906.070; avg=1070.052; max=1088.698)Kibits/s
Feb 15 09:34:23 genmon rngd[397]: stats: FIPS tests speed: (min=23.176; avg=36.915; max=43.747)Mibits/s
Feb 15 09:34:23 genmon rngd[397]: stats: Lowest ready-buffers level: 2
Feb 15 09:34:23 genmon rngd[397]: stats: Entropy starvations: 0
Feb 15 09:34:23 genmon rngd[397]: stats: Time spent starving for entropy: (min=0; avg=0.000; max=0)us
Feb 15 09:57:29 genmon dhcpcd[491]: wlan0: carrier lost
Feb 15 09:57:29 genmon dhcpcd[491]: wlan0: deleting route to 192.168.1.0/24
Feb 15 09:57:29 genmon dhcpcd[491]: wlan0: deleting default route via 192.168.1.1
Feb 15 09:57:36 genmon dhcpcd[491]: wlan0: carrier acquired
Feb 15 09:57:36 genmon dhcpcd[491]: wlan0: IAID 01:44:3d:a1
Feb 15 09:57:36 genmon dhcpcd[491]: wlan0: probing address 192.168.1.62/24
Feb 15 09:57:37 genmon dhcpcd[491]: wlan0: soliciting an IPv6 router
Feb 15 09:57:41 genmon dhcpcd[491]: wlan0: using static address 192.168.1.62/24
Feb 15 09:57:41 genmon dhcpcd[491]: wlan0: adding route to 192.168.1.0/24
Feb 15 09:57:41 genmon dhcpcd[491]: wlan0: adding default route via 192.168.1.1
Feb 15 09:57:49 genmon dhcpcd[491]: wlan0: carrier lost
Feb 15 09:57:49 genmon dhcpcd[491]: wlan0: deleting route to 192.168.1.0/24
Feb 15 09:57:49 genmon dhcpcd[491]: wlan0: deleting default route via 192.168.1.1
Feb 15 09:57:51 genmon dhcpcd[491]: wlan0: carrier acquired
Feb 15 09:57:51 genmon dhcpcd[491]: wlan0: IAID 01:44:3d:a1
Feb 15 09:57:51 genmon dhcpcd[491]: wlan0: probing address 192.168.1.62/24
Feb 15 09:57:51 genmon dhcpcd[491]: wlan0: soliciting an IPv6 router
Feb 15 09:57:56 genmon dhcpcd[491]: wlan0: using static address 192.168.1.62/24
Feb 15 09:57:56 genmon dhcpcd[491]: wlan0: adding route to 192.168.1.0/24
Feb 15 09:57:56 genmon dhcpcd[491]: wlan0: adding default route via 192.168.1.1
Feb 15 10:02:44 genmon dhcpcd[491]: wlan0: carrier lost
Feb 15 10:02:44 genmon dhcpcd[491]: wlan0: deleting route to 192.168.1.0/24
Feb 15 10:02:44 genmon dhcpcd[491]: wlan0: deleting default route via 192.168.1.1
Feb 15 10:02:46 genmon dhcpcd[491]: wlan0: carrier acquired
Feb 15 10:02:46 genmon dhcpcd[491]: wlan0: IAID 01:44:3d:a1
Feb 15 10:02:46 genmon dhcpcd[491]: wlan0: probing address 192.168.1.62/24
Feb 15 10:02:47 genmon dhcpcd[491]: wlan0: soliciting an IPv6 router
Feb 15 10:02:51 genmon dhcpcd[491]: wlan0: using static address 192.168.1.62/24
Feb 15 10:02:51 genmon dhcpcd[491]: wlan0: adding route to 192.168.1.0/24
Feb 15 10:02:51 genmon dhcpcd[491]: wlan0: adding default route via 192.168.1.1
Feb 15 10:17:01 genmon CRON[182485]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Feb 15 10:34:23 genmon rngd[397]: stats: bits received from HRNG source: 6220064
Feb 15 10:34:23 genmon rngd[397]: stats: bits sent to kernel pool: 6176384
Feb 15 10:34:23 genmon rngd[397]: stats: entropy added to kernel pool: 6176384
Feb 15 10:34:23 genmon rngd[397]: stats: FIPS 140-2 successes: 311
Feb 15 10:34:23 genmon rngd[397]: stats: FIPS 140-2 failures: 0
Feb 15 10:34:23 genmon rngd[397]: stats: FIPS 140-2(2001-10-10) Monobit: 0
Feb 15 10:34:23 genmon rngd[397]: stats: FIPS 140-2(2001-10-10) Poker: 0
Feb 15 10:34:23 genmon rngd[397]: stats: FIPS 140-2(2001-10-10) Runs: 0
Feb 15 10:34:23 genmon rngd[397]: stats: FIPS 140-2(2001-10-10) Long run: 0
Feb 15 10:34:23 genmon rngd[397]: stats: FIPS 140-2(2001-10-10) Continuous run: 0
Feb 15 10:34:23 genmon rngd[397]: stats: HRNG source speed: (min=906.070; avg=1070.062; max=1088.698)Kibits/s
Feb 15 10:34:23 genmon rngd[397]: stats: FIPS tests speed: (min=23.176; avg=36.866; max=43.747)Mibits/s
Feb 15 10:34:23 genmon rngd[397]: stats: Lowest ready-buffers level: 2
Feb 15 10:34:23 genmon rngd[397]: stats: Entropy starvations: 0
Feb 15 10:34:23 genmon rngd[397]: stats: Time spent starving for entropy: (min=0; avg=0.000; max=0)us
Feb 15 10:17:07 genmon fake-hwclock[132]: Wed 15 Feb 15:17:01 UTC 2023
Feb 15 10:17:07 genmon systemd-fsck[146]: e2fsck 1.46.2 (28-Feb-2021)
Feb 15 10:17:07 genmon systemd-fsck[146]: rootfs: clean, 56189/473280 files, 668565/1873920 blocks
Feb 15 10:17:07 genmon systemd[1]: Finished Remount Root and Kernel File Systems.
Feb 15 10:17:07 genmon systemd[1]: Condition check resulted in Rebuild Hardware Database being skipped.
Feb 15 10:17:07 genmon systemd[1]: Starting Flush Journal to Persistent Storage...
Feb 15 10:17:07 genmon systemd[1]: Condition check resulted in Platform Persistent Storage Archival being skipped.
Feb 15 10:17:07 genmon kernel: [    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034]

@pelwell
Copy link
Contributor

pelwell commented Feb 15, 2023

[ Stop editing the log - I've fixed it up once already ]

@aa777888-2
Copy link

Sorry, Phil, but I had no way of knowing you and I were editing in parallel. Your last edit truncated the log. It appears fine now. I could not get it to show properly in code tags for some reason.

@pelwell
Copy link
Contributor

pelwell commented Feb 15, 2023

The WiFi firmware crashing (if that's what's happening to you - you don't appear to have added brcmfmac.debug=0x100000 to /boot/cmdline.txt as requested above) shouldn't cause your Pi to reboot.

How are you powering the Pi and its peripherals?

@aa777888-2
Copy link

I made the change and rebooted as requested. Now we need to wait for a spontaneous reboot. Where should I look for the relevant log entries?

The Z2W is powered by a large, commercial, 5VDC power supply that can provide 5A. The only peripheral the Z2W is powering is a single RS232-TTL level translator IC on the 3.3VDC bus which consumes well under 10ma. The Z2W never reports undervoltage or throttling. The SD card has been replaced once as a possible source of the problem.

@pelwell
Copy link
Contributor

pelwell commented Feb 15, 2023

The additional log entries will go into the kernel log, which should appear in the main system log as above.

@pelwell
Copy link
Contributor

pelwell commented Apr 19, 2023

I imagine that dmesg | grep Firmware: will show a date from this week. Yes - Apr 19 2023.

@phylax2020
Copy link

I also have had stable conditions with the firmware test3 for more than 10 days. However, I have to admit that I replaced the SD card with a new one before using the test3 firmware. I also removed my PowerBoost 1000C UPS uninterruptible power supply module, which provides a maximum current of 1A at 5.1V for the RPi 0W2.
As you can see in one of my earlier posts, the firmware crash happened at the same time as mmc1 problems (mmc1: card 0001 removed). Since I don't believe in coincidences, there should be a connection between the firmware crash and the SD card problem. It could probably be a problem with a voltage sag in the power supply.
I will first work with the firmware test3 for a while and do experiments with the PowerBoost 1000C module to rule out power supply problems.

@Krautmaster
Copy link

Krautmaster commented Apr 21, 2023

I imagine that dmesg | grep Firmware: will show a date from this week. Yes - Apr 19 2023.

still crashing for me and the Pi stays offline until hard reboot. Will switch back to the working FW

root@raspberrypi:/home/pi# vcgencmd read_ring_osc
read_ring_osc(2)=3.692MHz (@1.3563V) (47.2'C)

https://pastebin.com/YN7YsqJR

@pelwell
Copy link
Contributor

pelwell commented Apr 21, 2023

@Krautmaster Where is the firmware crash in that log? You will see "brcmf_fw_crashed: Firmware has halted or crashed".

@Krautmaster
Copy link

Krautmaster commented Apr 21, 2023

tell me the commands in detail and ill check. Normally that system is online 24/7 and as you can see from the log the Wifi broke down anywhere around April 19th 10pm
Apr 19 22:04:01 raspberrypi kernel: [31970.230540] mmc1: card 0001 removed

Can i grab any logs to find more about the card to be removed any how?

@pelwell
Copy link
Contributor

pelwell commented Apr 21, 2023

tell me the commands in detail and ill check.

#1768 (comment)

Apr 19 22:04:01 raspberrypi kernel: [31970.230540] mmc1: card 0001 removed

That's not a firmware crash - that looks more like a hardware issue. What happens once it gets into that state?

@Krautmaster
Copy link

Krautmaster commented Apr 21, 2023

maybe that helps https://pastebin.com/S7JB4UiS

Apr 19 22:03:39 raspberrypi ntpd[15895]: bind(24) AF_INET6 fe80::3190:3a59:64ce:3b1c%2#123 flags 0x11 failed: Cannot assign requested address
Apr 19 22:03:39 raspberrypi ntpd[15895]: unable to create socket on wlan0 (6) for fe80::3190:3a59:64ce:3b1c%2#123
Apr 19 22:03:39 raspberrypi ntpd[15895]: failed to init interface for address fe80::3190:3a59:64ce:3b1c%2
Apr 19 22:03:39 raspberrypi ntpd[15895]: new interface(s) found: waking up resolver
Apr 19 22:03:44 raspberrypi ntpd[15895]: Listen normally on 7 wlan0 [fe80::3190:3a59:64ce:3b1c%2]:123
Apr 19 22:03:44 raspberrypi ntpd[15895]: new interface(s) found: waking up resolver
Apr 19 22:03:55 raspberrypi dhcpcd[407]: wlan0: no IPv6 Routers available
Apr 19 22:04:00 raspberrypi kernel: [31969.465539] ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed
Apr 19 22:04:00 raspberrypi kernel: [31969.496086] brcmfmac: CONSOLE:
Apr 19 22:04:00 raspberrypi kernel: [31969.496108] brcmfmac: CONSOLE: FWID 01-35723e3d
Apr 19 22:04:00 raspberrypi kernel: [31969.496113] brcmfmac: CONSOLE: flags 1
Apr 19 22:04:00 raspberrypi kernel: [31969.496118] brcmfmac: CONSOLE:
Apr 19 22:04:00 raspberrypi kernel: [31969.496125] brcmfmac: CONSOLE: TRAP c(6ff7c): pc 83d228, lr 83d223, sp 40fe8, cpsr 2000000c, spsr 21000000
Apr 19 22:04:00 raspberrypi kernel: [31969.496132] brcmfmac: CONSOLE: r0 1, r1 4e864, r2 2, r3 5100, r4 679fc, r5 1d, r6 0
Apr 19 22:04:00 raspberrypi kernel: [31969.496139] brcmfmac: CONSOLE: r7 1, r8 41024, r9 60d40, r10 4e850, r11 41248, r12 d
Apr 19 22:04:00 raspberrypi kernel: [31969.496144] brcmfmac: CONSOLE:
Apr 19 22:04:00 raspberrypi kernel: [31969.496150] brcmfmac: CONSOLE: sp+0 000679fc 00061214 00061214 00041024
Apr 19 22:04:00 raspberrypi kernel: [31969.496156] brcmfmac: CONSOLE: sp+10 000679fc 000413a8 00000016 00000001
Apr 19 22:04:00 raspberrypi kernel: [31969.496162] brcmfmac: CONSOLE:
Apr 19 22:04:00 raspberrypi kernel: [31969.496167] brcmfmac: CONSOLE: sp+20 0085e701
Apr 19 22:04:00 raspberrypi kernel: [31969.496172] brcmfmac: CONSOLE: sp+24 0001295d
Apr 19 22:04:00 raspberrypi kernel: [31969.496177] brcmfmac: CONSOLE: sp+30 00000101
Apr 19 22:04:00 raspberrypi kernel: [31969.496182] brcmfmac: CONSOLE: sp+a8 0088e253
Apr 19 22:04:00 raspberrypi kernel: [31969.496187] brcmfmac: CONSOLE: sp+ac 0085ee25
Apr 19 22:04:00 raspberrypi kernel: [31969.496193] brcmfmac: CONSOLE: sp+bc 0085ed67

@pelwell
Copy link
Contributor

pelwell commented Apr 21, 2023

That's better. Is that with the test4 firmware? The log isn't long enough to include the Firmware: message.

@Krautmaster
Copy link

yeah, should be. Full Log: https://cloud.krautmaster.de/index.php/s/Qi2J8BiYoFB8bGd

@pelwell
Copy link
Contributor

pelwell commented Apr 21, 2023

That's great - I'll pass on the crash report.

@pelwell
Copy link
Contributor

pelwell commented Apr 21, 2023

And here's test5: https://drive.google.com/file/d/1knjlChyFy-KDsl6L4_QPUEYgCqDkFGRy/view?usp=share_link

@Krautmaster
Copy link

testing now on, thx!

@Krautmaster
Copy link

Krautmaster commented Apr 22, 2023

sadly still the same issue. It occurs any how on reconnect or shifting within the mesh, while some shifts are successfull. Occured
https://cloud.krautmaster.de/index.php/s/kKZwJrspCePQ9qB

Anywhere around Apr 22 11:51:14 raspberrypi the device got inaccessible
I also wann state that hopping within the mesh takes ages to reconnect, at least its like 20s and not like 2s which id expect.

This time (22th april) i cant find a fw crash. But the device was not reconnecting after signal loss and that works fine with the other fw.

Edit: Gone now the second time within 60 min after reboot. Is there any further debugging possible which is persistent after boot as i have to hard reboot the device each time it goes off

@pelwell
Copy link
Contributor

pelwell commented Apr 24, 2023

That appears to be very different behaviour - there is no firmware crash, as you say, but something is sending avahi daemon a SIGHUP, perhaps in response to the "carrier lost" events.

I'll report the change in behaviour.

@Krautmaster
Copy link

OKI let me know if I can help

@phylax2020
Copy link

phylax2020 commented Jul 23, 2023

test5 firmware was running many weeks with changing from normal client mode to AP mode and back without firmware crash untill now. Power supply is strong enough, Raspi power supply voltage measured at Raspi board is 5.1V. Pi-OS is bullseye.

Jul 23 18:18:11 pi-ager kernel: [73427.260637] brcmfmac: CONSOLE: wl0: wlc_txc_scb_init: failed to allocate cubby space for txheader cache
Jul 23 18:18:11 pi-ager kernel: [73427.260644] brcmfmac: CONSOLE: wl0: wlc_scbinit: Cubby failed
Jul 23 18:18:11 pi-ager kernel: [73427.260651] brcmfmac: CONSOLE: wl0: wlc_userscb_alloc failed with err -27
Jul 23 18:18:11 pi-ager kernel: [73427.260657] brcmfmac: CONSOLE: wl0: wlc_join_BSS_select: out of scbs
Jul 23 18:18:11 pi-ager kernel: [73427.557468] brcmfmac: CONSOLE: wl0: wlc_txc_scb_init: failed to allocate cubby space for txheader cache
Jul 23 18:18:11 pi-ager kernel: [73427.557484] brcmfmac: CONSOLE: wl0: wlc_scbinit: Cubby failed
Jul 23 18:18:11 pi-ager kernel: [73427.557491] brcmfmac: CONSOLE: wl0: wlc_userscb_alloc failed with err -27
Jul 23 18:18:11 pi-ager kernel: [73427.557497] brcmfmac: CONSOLE: wl0: wlc_join_BSS_select: out of scbs
**Jul 23 18:18:11 pi-ager kernel: [73428.101951] ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed**
Jul** 23 18:18:11 pi-ager kernel: [73428.134966] brcmfmac: CONSOLE: wl0.0: wlc_keymgmt_set_bss_tx_key_id:key id 00, key index 65535 is out of range.
Jul 23 18:18:11 pi-ager kernel: [73428.134996] brcmfmac: CONSOLE: 
Jul 23 18:18:11 pi-ager kernel: [73428.135003] brcmfmac: CONSOLE: FWID 01-139d9a8f
Jul 23 18:18:11 pi-ager kernel: [73428.135009] brcmfmac: CONSOLE: flags 1
Jul 23 18:18:11 pi-ager kernel: [73428.135013] brcmfmac: CONSOLE: 
Jul 23 18:18:11 pi-ager kernel: [73428.135021] brcmfmac: CONSOLE: TRAP c(6ff7c): pc 80cdd0, lr 7337, sp 41628, cpsr 2000000c, spsr 21000000
Jul 23 18:18:11 pi-ager kernel: [73428.135028] brcmfmac: CONSOLE:   r0 0, r1 2, r2 2, r3 2101, r4 61214, r5 6163c, r6 62fe8
Jul 23 18:18:11 pi-ager kernel: [73428.135036] brcmfmac: CONSOLE:   r7 1, r8 0, r9 0, r10 6261c, r11 6261c, r12 0
Jul 23 18:18:11 pi-ager kernel: [73428.135042] brcmfmac: CONSOLE: 
Jul 23 18:18:11 pi-ager kernel: [73428.135047] brcmfmac: CONSOLE:    sp+0 00000000 00000002 00000001 00007337
Jul 23 18:18:11 pi-ager kernel: [73428.135054] brcmfmac: CONSOLE:   sp+10 0000ffff 00000000 00000000 0006163e
Jul 23 18:18:11 pi-ager kernel: [73428.135060] brcmfmac: CONSOLE: 
Jul 23 18:18:11 pi-ager kernel: [73428.135065] brcmfmac: CONSOLE: sp+c 00007337
Jul 23 18:18:11 pi-ager kernel: [73428.135070] brcmfmac: CONSOLE: sp+10 0000ffff
Jul 23 18:18:11 pi-ager kernel: [73428.135076] brcmfmac: CONSOLE: sp+24 0000ffff
Jul 23 18:18:11 pi-ager kernel: [73428.135081] brcmfmac: CONSOLE: sp+5c 0080a22d
Jul 23 18:18:11 pi-ager kernel: [73428.135087] brcmfmac: CONSOLE: sp+64 00005201
Jul 23 18:18:11 pi-ager kernel: [73428.135093] brcmfmac: CONSOLE: sp+8c 00835fa5
Jul 23 18:18:11 pi-ager kernel: [73428.135098] brcmfmac: CONSOLE: sp+ac 0000b347
Jul 23 18:18:11 pi-ager kernel: [73428.135103] brcmfmac: CONSOLE: sp+b4 0083803f
Jul 23 18:18:11 pi-ager kernel: [73428.135109] brcmfmac: CONSOLE: sp+c4 00838173
Jul 23 18:18:11 pi-ager kernel: [73428.135115] brcmfmac: CONSOLE: sp+dc 00011b3b
Jul 23 18:18:11 pi-ager kernel: [73428.135120] brcmfmac: CONSOLE: sp+ec 0081e9e9
Jul 23 18:18:11 pi-ager kernel: [73428.135125] brcmfmac: CONSOLE: sp+fc 00005201
Jul 23 18:18:11 pi-ager kernel: [73428.135131] brcmfmac: CONSOLE: sp+114 008341e5
Jul 23 18:18:11 pi-ager kernel: [73428.135136] brcmfmac: CONSOLE: sp+118 008341dd
Jul 23 18:18:11 pi-ager kernel: [73428.135141] brcmfmac: CONSOLE: sp+11c 0082f4e3
Jul 23 18:18:11 pi-ager kernel: [73428.135147] brcmfmac: CONSOLE: sp+120 0082f4d1
Jul 23 18:18:11 pi-ager kernel: [73428.187355] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Jul 23 18:18:11 pi-ager kernel: [73428.187378] ieee80211 phy0: brcmf_cfg80211_get_tx_power: error (-5)
Jul 23 18:18:12 pi-ager kernel: [73428.840977] mmc1: card 0001 removed
Jul 23 18:18:12 pi-ager kernel: [73428.901336] mmc1: queuing unknown CIS tuple 0x95 [78 41 0f 0a aa 7b e0 cc ff 28 e5 c5 e0 05 00 8a 5e 81 ff f6 6f a8 ff 10 94 4d 46 59 12 49 1a 1b ae ff 51 37 90 ff 51 53 ac 05 22 cb 0c b3 00 ff 54 26 85 ff 0d e3 3b d0 de ff 4a ff ee 6d b9 9e] (77 bytes)
Jul 23 18:18:12 pi-ager kernel: [73428.902837] mmc1: new high speed SDIO card at address 0001
Jul 23 18:20:37 pi-ager kernel: [    0.000000] Booting Linux on physical CPU 0x0
Jul 23 18:20:37 pi-ager kernel: [    0.000000] Linux version 6.1.21-v7+ (dom@buildbot) (arm-linux-gnueabihf-gcc-8 (Ubuntu/Linaro 8.4.0-3ubuntu1) 8.4.0, GNU ld (GNU Binutils for Ubuntu) 2.34) #1642 SMP Mon Apr  3 17:20:52 BST 2023
Jul 23 18:20:37 pi-ager kernel: [    0.000000] CPU: ARMv7 Processor [410fd034] revision 4 (ARMv7), cr=10c5383d
Jul 23 18:20:37 pi-ager kernel: [    0.000000] CPU: div instructions available: patching division code
Jul 23 18:20:37 pi-ager kernel: [    0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing instruction cache
Jul 23 18:20:37 pi-ager kernel: [    0.000000] OF: fdt: Machine model: Raspberry Pi Zero 2 W Rev 1.0
Jul 23 18:20:37 pi-ager kernel: [    0.000000] random: crng init done
Jul 23 18:20:37 pi-ager kernel: [    0.000000] Memory policy: Data cache writealloc
Jul 23 18:20:37 pi-ager kernel: [    0.000000] Reserved memory: created CMA memory pool at 0x0bc00000, size 256 MiB
Jul 23 18:20:37 pi-ager kernel: [    0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
Jul 23 18:20:37 pi-ager kernel: [    0.000000] Zone ranges:
Jul 23 18:20:37 pi-ager kernel: [    0.000000]   DMA      [mem 0x0000000000000000-0x000000001bffffff]
Jul 23 18:20:37 pi-ager kernel: [    0.000000]   Normal   empty
Jul 23 18:20:37 pi-ager kernel: [    0.000000] Movable zone start for each node
Jul 23 18:20:37 pi-ager kernel: [    0.000000] Early memory node ranges
Jul 23 18:20:37 pi-ager kernel: [    0.000000]   node   0: [mem 0x0000000000000000-0x000000001bffffff]
Jul 23 18:20:37 pi-ager kernel: [    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x000000001bffffff]
Jul 23 18:20:37 pi-ager kernel: [    0.000000] percpu: Embedded 17 pages/cpu s36884 r8192 d24556 u69632
Jul 23 18:20:37 pi-ager kernel: [    0.000000] pcpu-alloc: s36884 r8192 d24556 u69632 alloc=17*4096
Jul 23 18:20:37 pi-ager kernel: [    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3

@porst17
Copy link
Author

porst17 commented Jul 23, 2023

BTW: I am running @Krautmaster 's workaround since April 19 without a single crash. I am hesitating to switch to any of the test firmwares again (didn't try test4 or test5) ...

@phylax2020
Copy link

Thanks for the hint. The Firmware from Krautmaster's workaround crashed when I turned off WLAN on my router. So the best choice for me at the moment is the firmware test5, as long as there is no better solution.

Jul 25 09:24:04 pi-ager kernel: [45887.142121] brcmfmac: CONSOLE: wl0: link up (wl0)
Jul 25 09:24:04 pi-ager kernel: [45887.142127] brcmfmac: CONSOLE: wl0: wlc_iovar_op: BCME -23 :ndoe
Jul 25 09:24:19 pi-ager kernel: [45902.222053] brcmfmac: CONSOLE: E/GTK: wlc_bcol_process_gtk_rekey: 4 handshake frame, skip
Jul 25 09:24:19 pi-ager kernel: [45902.222077] brcmfmac: CONSOLE: E/GTK: wlc_bcol_process_gtk_rekey: 4 handshake frame, skip
Jul 25 09:24:19 pi-ager kernel: [45902.412066] ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed
Jul 25 09:24:19 pi-ager kernel: [45902.443369] brcmfmac: CONSOLE:
Jul 25 09:24:19 pi-ager kernel: [45902.443387] brcmfmac: CONSOLE: FWID 01-f40f3270
Jul 25 09:24:19 pi-ager kernel: [45902.443393] brcmfmac: CONSOLE: flags 1
Jul 25 09:24:19 pi-ager kernel: [45902.443398] brcmfmac: CONSOLE:
Jul 25 09:24:19 pi-ager kernel: [45902.443404] brcmfmac: CONSOLE: TRAP 3(6ff7c): pc 5b830, lr 243d, sp 3f128, cpsr 40000003, spsr 40000000
Jul 25 09:24:19 pi-ager kernel: [45902.443412] brcmfmac: CONSOLE: r0 6e, r1 77192, r2 0, r3 5b830, r4 5b7f4, r5 77192, r6 c84
Jul 25 09:24:19 pi-ager kernel: [45902.443419] brcmfmac: CONSOLE: r7 1320, r8 6d864, r9 77192, r10 60600, r11 3f1c8, r12 8
Jul 25 09:24:19 pi-ager kernel: [45902.443425] brcmfmac: CONSOLE:
Jul 25 09:24:19 pi-ager kernel: [45902.443431] brcmfmac: CONSOLE: sp+0 0006d858 0006d864 000611e8 00807b27
Jul 25 09:24:19 pi-ager kernel: [45902.443437] brcmfmac: CONSOLE: sp+10 00065574 0002d40d 00000001 00000007
Jul 25 09:24:19 pi-ager kernel: [45902.443443] brcmfmac: CONSOLE:
Jul 25 09:24:19 pi-ager kernel: [45902.443449] brcmfmac: CONSOLE: sp+c 00807b27
Jul 25 09:24:19 pi-ager kernel: [45902.443454] brcmfmac: CONSOLE: sp+14 0002d40d
Jul 25 09:24:19 pi-ager kernel: [45902.443460] brcmfmac: CONSOLE: sp+28 000086dd
Jul 25 09:24:19 pi-ager kernel: [45902.443465] brcmfmac: CONSOLE: sp+44 00810da3
Jul 25 09:24:19 pi-ager kernel: [45902.443470] brcmfmac: CONSOLE: sp+6c 0002dcf5
Jul 25 09:24:19 pi-ager kernel: [45902.443476] brcmfmac: CONSOLE: sp+84 0002d0b7
Jul 25 09:24:19 pi-ager kernel: [45902.443482] brcmfmac: CONSOLE: sp+9c 00005961
Jul 25 09:24:19 pi-ager kernel: [45902.443487] brcmfmac: CONSOLE: sp+a0 00003333
Jul 25 09:24:19 pi-ager kernel: [45902.443493] brcmfmac: CONSOLE: sp+d4 0002e577
Jul 25 09:24:19 pi-ager kernel: [45902.443498] brcmfmac: CONSOLE: sp+140 0001080f
Jul 25 09:24:19 pi-ager kernel: [45902.443504] brcmfmac: CONSOLE: sp+15c 00807f53
Jul 25 09:24:19 pi-ager kernel: [45902.443509] brcmfmac: CONSOLE: sp+194 00875b25
Jul 25 09:24:19 pi-ager kernel: [45902.443514] brcmfmac: CONSOLE: sp+1d4 0001b3a1
Jul 25 09:24:19 pi-ager kernel: [45902.443519] brcmfmac: CONSOLE: sp+214 0001dd6d
Jul 25 09:24:19 pi-ager kernel: [45902.443525] brcmfmac: CONSOLE: sp+23c 0082eed3
Jul 25 09:24:19 pi-ager kernel: [45902.443530] brcmfmac: CONSOLE: sp+264 0082f215
Jul 25 09:24:20 pi-ager kernel: [45903.431879] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Jul 25 09:24:20 pi-ager kernel: [45903.431904] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Jul 25 09:24:20 pi-ager kernel: [45903.431913] ieee80211 phy0: brcmf_cfg80211_stop_ap: SET SSID error (-5)
Jul 25 09:24:20 pi-ager kernel: [45903.431924] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Jul 25 09:24:20 pi-ager kernel: [45903.431932] ieee80211 phy0: brcmf_cfg80211_stop_ap: BRCMF_C_DOWN error -5
Jul 25 09:24:20 pi-ager kernel: [45903.431941] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Jul 25 09:24:20 pi-ager kernel: [45903.431949] ieee80211 phy0: brcmf_cfg80211_stop_ap: setting AP mode failed -5
Jul 25 09:24:20 pi-ager kernel: [45903.431958] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Jul 25 09:24:20 pi-ager kernel: [45903.431966] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Jul 25 09:24:20 pi-ager kernel: [45903.431974] ieee80211 phy0: brcmf_cfg80211_stop_ap: BRCMF_C_UP error -5
Jul 25 09:24:20 pi-ager kernel: [45903.431993] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Jul 25 09:24:20 pi-ager kernel: [45903.432002] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Jul 25 09:24:21 pi-ager kernel: [45903.613446] mmc1: card 0001 removed
Jul 25 09:24:21 pi-ager kernel: [45903.673418] mmc1: queuing unknown CIS tuple 0xb5 [78 01 cf 02 aa 5b 40 cc ff 2a 65 85 e0 0d 00 8a 5e 81 ff f6 6f a8 ff 14 00 49 67 59 12 49 58 11 ae ff 51 37 90 ff 49 53 ae 05 72 cd 1d b3 00 ff 54 22 a5 ff 0d e3 3b d0 de ff 1e ff ee fd b9 06] (77 bytes)
Jul 25 09:24:21 pi-ager kernel: [45903.719800] mmc1: queuing unknown CIS tuple 0x67 [86 4d 92 d3 c2 b8 12 6d 10 9e 0d a0 85 92 48 0c 10 04 c0 c1 7c bd fa 47 c2 c5 91 d7 9d b8 93 00 c0 64 c8 d3 b8 2a 31 10 95 7a bb bc a4 11 3a 9a 37 3d b5 e3 15 e6 40 f0 e8 7f 70 f6 04 00 00 84] (149 bytes)
Jul 25 09:24:21 pi-ager kernel: [45903.721306] mmc1: new high speed SDIO card at address 0001

@knoellp
Copy link

knoellp commented Aug 4, 2023

After crashing every night, I now installed firmware test5 on my RPi 0W2 (with piSCSI-Board) and no crashes since then (for two days).
I think, the problems startet with a new firmware on my FritzBox Router. I think, it has something to do with the fast handover of clients in the mesh.
There are related issues raspberrypi/linux#1342 and raspberrypi/linux#3849, where they report the same crashes on RPi 4 and 3.

@phylax2020
Copy link

Can anyone provide information on the following problem:

My RPi 0W2 is equipped with the Broadcom chip BCM43430/2 with the signature 0x1542a9a6. As described in my earlier postings, there are occasional crahes with the original firmware of the Pi OS Bullseye for this chip.
That's why I've been using the test5 firmware for quite some time, which works with sufficient stability as long as I have a stable connection to my router.

Now I have seen in the syslog of a user that another Broadcom chip BCM43430/1 with the signature 0x1541a9a6 is installed in his RPi 0W2. The system loads a different firmware brcmfmac43436s-sdio accordingly.

I would be interested in the following:
Does the combination of chip BCM43430/1 and firmware brcmfmac43436s-sdio work without firmware crashes ?
If I order an RPi 0W2 today, which configuration of the Broadcom chip will I get? BCM43430/1 or BCM43430/2 ?
Can I find out from the outside by marking on the chips which chip version was installed ?

Information on this topic is very welcome.

@AxeR21
Copy link

AxeR21 commented Oct 18, 2023

Hi everyone, sorry for jumping on this stale thread but I've just started having some issues with my RPi 0W2.

Just a brief history of what happened before having any issue.
I have the RPi set up as Pi-hole with static IP and everything worked fine until a couple of days ago when I started having connection dropouts. The RPi is also my main DHCP and DNS server and I would have to unplug it since I can't SSH into it when this happens and plug it back in to bring the Internet connection back up.

I recently changed the ISP and with that, the modem, and everything worked fine for the first week, but I was having signal issues around my house so they installed a mesh repeater to strengthen the signal and all the problems started. Since then I've started losing connection every 24h-ish.

Stock firmware is: Firmware: BCM43430/2 wl0: Mar 31 2022 17:24:51 version 9.88.4.77 (g58bc5cc) FWID 01-3b307371 and I'm not experiencing any crash.

Firmware details iw phy
Wiphy phy0
        wiphy index: 0
        max # scan SSIDs: 10
        max scan IEs length: 2048 bytes
        max # sched scan SSIDs: 16
        max # match sets: 16
        Retry short limit: 7
        Retry long limit: 4
        Coverage class: 0 (up to 0m)
        Device supports roaming.
        Supported Ciphers:
                * WEP40 (00-0f-ac:1)
                * WEP104 (00-0f-ac:5)
                * TKIP (00-0f-ac:2)
                * CCMP-128 (00-0f-ac:4)
                * CMAC (00-0f-ac:6)
        Available Antennas: TX 0 RX 0
        Supported interface modes:
                 * IBSS
                 * managed
                 * AP
                 * P2P-client
                 * P2P-GO
                 * P2P-device
        Band 1:
                Capabilities: 0x1020
                        HT20
                        Static SM Power Save
                        RX HT20 SGI
                        No RX STBC
                        Max AMSDU length: 3839 bytes
                        DSSS/CCK HT40
                Maximum RX AMPDU length 65535 bytes (exponent: 0x003)
                Minimum RX AMPDU time spacing: 16 usec (0x07)
                HT TX/RX MCS rate indexes supported: 0-7
                Bitrates (non-HT):
                        * 1.0 Mbps
                        * 2.0 Mbps (short preamble supported)
                        * 5.5 Mbps (short preamble supported)
                        * 11.0 Mbps (short preamble supported)
                        * 6.0 Mbps
                        * 9.0 Mbps
                        * 12.0 Mbps
                        * 18.0 Mbps
                        * 24.0 Mbps
                        * 36.0 Mbps
                        * 48.0 Mbps
                        * 54.0 Mbps
                Frequencies:
                        * 2412 MHz [1] (20.0 dBm)
                        * 2417 MHz [2] (20.0 dBm)
                        * 2422 MHz [3] (20.0 dBm)
                        * 2427 MHz [4] (20.0 dBm)
                        * 2432 MHz [5] (20.0 dBm)
                        * 2437 MHz [6] (20.0 dBm)
                        * 2442 MHz [7] (20.0 dBm)
                        * 2447 MHz [8] (20.0 dBm)
                        * 2452 MHz [9] (20.0 dBm)
                        * 2457 MHz [10] (20.0 dBm)
                        * 2462 MHz [11] (20.0 dBm)
                        * 2467 MHz [12] (20.0 dBm)
                        * 2472 MHz [13] (20.0 dBm)
                        * 2484 MHz [14] (disabled)
        Supported commands:
                 * new_interface
                 * set_interface
                 * new_key
                 * start_ap
                 * join_ibss
                 * set_pmksa
                 * del_pmksa
                 * flush_pmksa
                 * remain_on_channel
                 * frame
                 * set_wiphy_netns
                 * set_channel
                 * start_sched_scan
                 * start_p2p_device
                 * connect
                 * disconnect
                 * crit_protocol_start
                 * crit_protocol_stop
                 * update_connect_params
        software interface modes (can always be added):
        valid interface combinations:
                 * #{ managed } <= 1, #{ P2P-device } <= 1, #{ P2P-client, P2P-GO } <= 1,
                   total <= 3, #channels <= 2
                 * #{ managed } <= 1, #{ AP } <= 1, #{ P2P-client } <= 1, #{ P2P-device } <= 1,
                   total <= 4, #channels <= 1
        Device supports scan flush.
        Device supports randomizing MAC-addr in sched scans.
        max # scan plans: 1
        max scan plan interval: 508
        max scan plan iterations: 0
        Supported TX frame types:
                 * managed: 0x00 0x10 0x20 0x30 0x40 0x50 0x60 0x70 0x80 0x90 0xa0 0xb0 0xc0 0xd0 0xe0 0xf0
                 * AP: 0x00 0x10 0x20 0x30 0x40 0x50 0x60 0x70 0x80 0x90 0xa0 0xb0 0xc0 0xd0 0xe0 0xf0
                 * P2P-client: 0x00 0x10 0x20 0x30 0x40 0x50 0x60 0x70 0x80 0x90 0xa0 0xb0 0xc0 0xd0 0xe0 0xf0
                 * P2P-GO: 0x00 0x10 0x20 0x30 0x40 0x50 0x60 0x70 0x80 0x90 0xa0 0xb0 0xc0 0xd0 0xe0 0xf0
                 * P2P-device: 0x00 0x10 0x20 0x30 0x40 0x50 0x60 0x70 0x80 0x90 0xa0 0xb0 0xc0 0xd0 0xe0 0xf0
        Supported RX frame types:
                 * managed: 0x40 0xd0
                 * AP: 0x00 0x20 0x40 0xa0 0xb0 0xc0 0xd0
                 * P2P-client: 0x40 0xd0
                 * P2P-GO: 0x00 0x20 0x40 0xa0 0xb0 0xc0 0xd0
                 * P2P-device: 0x40 0xd0
        Supported extended features:
                * [ CQM_RSSI_LIST ]: multiple CQM_RSSI_THOLD records
                * [ 4WAY_HANDSHAKE_STA_PSK ]: 4-way handshake with PSK in station mode
                * [ 4WAY_HANDSHAKE_STA_1X ]: 4-way handshake with 802.1X in station mode
                * [ SAE_OFFLOAD ]: SAE offload support

Below you can notice this odd pattern:

# Oct 12 technician installed new repeater
Oct 13 14:02:03 pihole dhcpcd[526]: wlan0: carrier lost
Oct 13 19:17:06 pihole kernel: [    0.000000] Booting Linux on physical CPU 0x0
Oct 14 17:01:07 pihole dhcpcd[575]: wlan0: carrier lost
Oct 14 20:17:07 pihole kernel: [    0.000000] Booting Linux on physical CPU 0x0
Oct 15 20:56:47 pihole dhcpcd[577]: wlan0: carrier lost
Oct 15 23:17:07 pihole kernel: [    0.000000] Booting Linux on physical CPU 0x0
# changed repeater operation mode from EasyMesh to AP and interface "froze"
Oct 16 10:41:50 pihole dhcpcd[542]: wlan0: carrier lost
Oct 16 10:43:09 pihole kernel: [    0.000000] Booting Linux on physical CPU 0x0
Oct 17 10:42:31 pihole dhcpcd[529]: wlan0: carrier lost
Oct 17 17:17:09 pihole kernel: [    0.000000] Booting Linux on physical CPU 0x0
# installed `fw_bcmdhd_test5.bin`and rebooted
Oct 17 23:13:13 pihole kernel: [    0.000000] Booting Linux on physical CPU 0x0
Oct 18 10:42:33 pihole dhcpcd[543]: wlan0: carrier lost
Oct 18 10:36:18 pihole kernel: [    0.000000] Booting Linux on physical CPU 0x0

The time in lines saying Booting Linux on physical CPU 0x0 is off by roughly -10min

My problem is the exact one described in this comment with or without test firmware installed.

That appears to be very different behaviour - there is no firmware crash, as you say, but something is sending avahi daemon a SIGHUP, perhaps in response to the "carrier lost" events.

I'll report the change in behaviour.

Here's a section of the syslog where the issue is visible.

Oct 17 10:42:31 pihole dhcpcd[529]: wlan0: carrier lost
Oct 17 10:42:32 pihole avahi-daemon[298]: Withdrawing address record for 192.168.1.120 on wlan0.
Oct 17 10:42:32 pihole avahi-daemon[298]: Leaving mDNS multicast group on interface wlan0.IPv4 with address 192.168.1.120.
Oct 17 10:42:32 pihole avahi-daemon[298]: Interface wlan0.IPv4 no longer relevant for mDNS.
Oct 17 10:42:32 pihole dhcpcd[529]: wlan0: deleting route to 192.168.1.0/24
Oct 17 10:42:32 pihole dhcpcd[529]: wlan0: deleting default route via 192.168.1.101
Oct 17 10:42:32 pihole avahi-daemon[298]: Got SIGHUP, reloading.
Oct 17 10:42:32 pihole avahi-daemon[298]: No service file found in /etc/avahi/services.
Oct 17 10:42:33 pihole dhcpcd[529]: wlan0: carrier acquired
Oct 17 10:42:33 pihole dhcpcd[529]: wlan0: IAID 01:5b:1e:9c
Oct 17 10:42:33 pihole dhcpcd[529]: wlan0: probing address 192.168.1.120/24
Oct 17 10:42:33 pihole dhcpcd[529]: wlan0: soliciting an IPv6 router
Oct 17 10:42:38 pihole dhcpcd[529]: wlan0: using static address 192.168.1.120/24
Oct 17 10:42:38 pihole avahi-daemon[298]: Joining mDNS multicast group on interface wlan0.IPv4 with address 192.168.1.120.
Oct 17 10:42:38 pihole avahi-daemon[298]: New relevant interface wlan0.IPv4 for mDNS.
Oct 17 10:42:38 pihole avahi-daemon[298]: Registering new address record for 192.168.1.120 on wlan0.IPv4.
Oct 17 10:42:38 pihole dhcpcd[529]: wlan0: adding route to 192.168.1.0/24
Oct 17 10:42:38 pihole dhcpcd[529]: wlan0: adding default route via 192.168.1.101
Oct 17 10:42:38 pihole avahi-daemon[298]: Got SIGHUP, reloading.
Oct 17 10:42:38 pihole avahi-daemon[298]: No service file found in /etc/avahi/services.
Oct 17 10:43:52 pihole dhcpcd[529]: wlan0: carrier lost
Oct 17 10:43:52 pihole avahi-daemon[298]: Withdrawing address record for 192.168.1.120 on wlan0.
Oct 17 10:43:52 pihole avahi-daemon[298]: Leaving mDNS multicast group on interface wlan0.IPv4 with address 192.168.1.120.
Oct 17 10:43:52 pihole avahi-daemon[298]: Interface wlan0.IPv4 no longer relevant for mDNS.
Oct 17 10:43:52 pihole dhcpcd[529]: wlan0: deleting route to 192.168.1.0/24
Oct 17 10:43:52 pihole dhcpcd[529]: wlan0: deleting default route via 192.168.1.101
Oct 17 10:43:52 pihole avahi-daemon[298]: Got SIGHUP, reloading.
Oct 17 10:43:52 pihole avahi-daemon[298]: No service file found in /etc/avahi/services.
Oct 17 10:43:52 pihole dhcpcd[529]: wlan0: carrier acquired
Oct 17 10:43:52 pihole dhcpcd[529]: wlan0: IAID 01:5b:1e:9c
Oct 17 10:43:52 pihole dhcpcd[529]: wlan0: probing address 192.168.1.120/24
Oct 17 10:43:53 pihole dhcpcd[529]: wlan0: soliciting an IPv6 router
Oct 17 10:43:57 pihole dhcpcd[529]: wlan0: using static address 192.168.1.120/24
Oct 17 10:43:57 pihole avahi-daemon[298]: Joining mDNS multicast group on interface wlan0.IPv4 with address 192.168.1.120.
Oct 17 10:43:57 pihole avahi-daemon[298]: New relevant interface wlan0.IPv4 for mDNS.
Oct 17 10:43:57 pihole avahi-daemon[298]: Registering new address record for 192.168.1.120 on wlan0.IPv4.
Oct 17 10:43:57 pihole dhcpcd[529]: wlan0: adding route to 192.168.1.0/24
Oct 17 10:43:57 pihole dhcpcd[529]: wlan0: adding default route via 192.168.1.101
Oct 17 10:43:57 pihole avahi-daemon[298]: Got SIGHUP, reloading.
Oct 17 10:43:57 pihole avahi-daemon[298]: No service file found in /etc/avahi/services.

Further details

  • brcmf_cfg80211_set_power_mgmt: power save enabled;
  • never set over_voltage=2 (since it does not seem to produce any effect);
  • official power brick;
  • now (Oct 18) trying @Krautmaster workaround to see if there's any behavior change.

I'm down for any debugging or additional info that could help diagnose or narrow down what could cause this issue.

Thanks in advance to anyone who will reply to my post and @pelwell for the constant follow-ups and test firmware.

EDIT Oct 19
As wrote yesterday I've tried @Krautmaster workaround and, fingers crossed, it seems to work, except there's still something strange with avahi-daemon that still receives a SIGHUP.

I've compared the two logs and they're almost identical, except for the obvious part that could change like time and PID.

image

I don't know if it's related to this issue or not but the firmware BCM43430/2 wl0: Oct 9 2020 14:44:32 version 9.88.4.65 (test) (f149b32@shgit) (r679549) FWID 01-f40f3270 (that's the one suggested by @Krautmaster) does not support 4-way handshake offloading that is present in the stock version.

Firmware details iw phy
Wiphy phy0
        wiphy index: 0
        max # scan SSIDs: 10
        max scan IEs length: 2048 bytes
        max # sched scan SSIDs: 16
        max # match sets: 16
        Retry short limit: 7
        Retry long limit: 4
        Coverage class: 0 (up to 0m)
        Device supports roaming.
        Supported Ciphers:
                * WEP40 (00-0f-ac:1)
                * WEP104 (00-0f-ac:5)
                * TKIP (00-0f-ac:2)
                * CCMP-128 (00-0f-ac:4)
                * CMAC (00-0f-ac:6)
        Available Antennas: TX 0 RX 0
        Supported interface modes:
                 * IBSS
                 * managed
                 * AP
                 * P2P-client
                 * P2P-GO
                 * P2P-device
        Band 1:
                Capabilities: 0x1020
                        HT20
                        Static SM Power Save
                        RX HT20 SGI
                        No RX STBC
                        Max AMSDU length: 3839 bytes
                        DSSS/CCK HT40
                Maximum RX AMPDU length 65535 bytes (exponent: 0x003)
                Minimum RX AMPDU time spacing: 16 usec (0x07)
                HT TX/RX MCS rate indexes supported: 0-7
                Bitrates (non-HT):
                        * 1.0 Mbps
                        * 2.0 Mbps (short preamble supported)
                        * 5.5 Mbps (short preamble supported)
                        * 11.0 Mbps (short preamble supported)
                        * 6.0 Mbps
                        * 9.0 Mbps
                        * 12.0 Mbps
                        * 18.0 Mbps
                        * 24.0 Mbps
                        * 36.0 Mbps
                        * 48.0 Mbps
                        * 54.0 Mbps
                Frequencies:
                        * 2412 MHz [1] (20.0 dBm)
                        * 2417 MHz [2] (20.0 dBm)
                        * 2422 MHz [3] (20.0 dBm)
                        * 2427 MHz [4] (20.0 dBm)
                        * 2432 MHz [5] (20.0 dBm)
                        * 2437 MHz [6] (20.0 dBm)
                        * 2442 MHz [7] (20.0 dBm)
                        * 2447 MHz [8] (20.0 dBm)
                        * 2452 MHz [9] (20.0 dBm)
                        * 2457 MHz [10] (20.0 dBm)
                        * 2462 MHz [11] (20.0 dBm)
                        * 2467 MHz [12] (20.0 dBm)
                        * 2472 MHz [13] (20.0 dBm)
                        * 2484 MHz [14] (disabled)
        Supported commands:
                 * new_interface
                 * set_interface
                 * new_key
                 * start_ap
                 * join_ibss
                 * set_pmksa
                 * del_pmksa
                 * flush_pmksa
                 * remain_on_channel
                 * frame
                 * set_wiphy_netns
                 * set_channel
                 * start_sched_scan
                 * start_p2p_device
                 * connect
                 * disconnect
                 * crit_protocol_start
                 * crit_protocol_stop
                 * update_connect_params
        software interface modes (can always be added):
        valid interface combinations:
                 * #{ managed } <= 1, #{ P2P-device } <= 1, #{ P2P-client, P2P-GO } <= 1,
                   total <= 3, #channels <= 2
                 * #{ managed } <= 1, #{ AP } <= 1, #{ P2P-client } <= 1, #{ P2P-device } <= 1,
                   total <= 4, #channels <= 1
        Device supports scan flush.
        Device supports randomizing MAC-addr in sched scans.
        max # scan plans: 1
        max scan plan interval: 508
        max scan plan iterations: 0
        Supported TX frame types:
                 * managed: 0x00 0x10 0x20 0x30 0x40 0x50 0x60 0x70 0x80 0x90 0xa0 0xb0 0xc0 0xd0 0xe0 0xf0
                 * AP: 0x00 0x10 0x20 0x30 0x40 0x50 0x60 0x70 0x80 0x90 0xa0 0xb0 0xc0 0xd0 0xe0 0xf0
                 * P2P-client: 0x00 0x10 0x20 0x30 0x40 0x50 0x60 0x70 0x80 0x90 0xa0 0xb0 0xc0 0xd0 0xe0 0xf0
                 * P2P-GO: 0x00 0x10 0x20 0x30 0x40 0x50 0x60 0x70 0x80 0x90 0xa0 0xb0 0xc0 0xd0 0xe0 0xf0
                 * P2P-device: 0x00 0x10 0x20 0x30 0x40 0x50 0x60 0x70 0x80 0x90 0xa0 0xb0 0xc0 0xd0 0xe0 0xf0
        Supported RX frame types:
                 * managed: 0x40 0xd0
                 * AP: 0x00 0x20 0x40 0xa0 0xb0 0xc0 0xd0
                 * P2P-client: 0x40 0xd0
                 * P2P-GO: 0x00 0x20 0x40 0xa0 0xb0 0xc0 0xd0
                 * P2P-device: 0x40 0xd0
        Supported extended features:
                * [ CQM_RSSI_LIST ]: multiple CQM_RSSI_THOLD records
Oct 19 10:42:34 pihole dhcpcd[541]: wlan0: carrier lost
Oct 19 10:42:34 pihole avahi-daemon[291]: Withdrawing address record for 192.168.1.120 on wlan0.
Oct 19 10:42:34 pihole avahi-daemon[291]: Leaving mDNS multicast group on interface wlan0.IPv4 with address 192.168.1.120.
Oct 19 10:42:34 pihole avahi-daemon[291]: Interface wlan0.IPv4 no longer relevant for mDNS.
Oct 19 10:42:34 pihole dhcpcd[541]: wlan0: deleting route to 192.168.1.0/24
Oct 19 10:42:34 pihole dhcpcd[541]: wlan0: deleting default route via 192.168.1.101
Oct 19 10:42:34 pihole avahi-daemon[291]: Got SIGHUP, reloading.
Oct 19 10:42:34 pihole avahi-daemon[291]: No service file found in /etc/avahi/services.
Oct 19 10:42:35 pihole dhcpcd[541]: wlan0: carrier acquired
Oct 19 10:42:35 pihole dhcpcd[541]: wlan0: IAID 01:5b:1e:9c
Oct 19 10:42:35 pihole dhcpcd[541]: wlan0: probing address 192.168.1.120/24
Oct 19 10:42:36 pihole dhcpcd[541]: wlan0: soliciting an IPv6 router
Oct 19 10:42:40 pihole dhcpcd[541]: wlan0: using static address 192.168.1.120/24
Oct 19 10:42:40 pihole avahi-daemon[291]: Joining mDNS multicast group on interface wlan0.IPv4 with address 192.168.1.120.
Oct 19 10:42:40 pihole avahi-daemon[291]: New relevant interface wlan0.IPv4 for mDNS.
Oct 19 10:42:40 pihole avahi-daemon[291]: Registering new address record for 192.168.1.120 on wlan0.IPv4.
Oct 19 10:42:40 pihole dhcpcd[541]: wlan0: adding route to 192.168.1.0/24
Oct 19 10:42:40 pihole dhcpcd[541]: wlan0: adding default route via 192.168.1.101
Oct 19 10:42:40 pihole avahi-daemon[291]: Got SIGHUP, reloading.
Oct 19 10:42:40 pihole avahi-daemon[291]: No service file found in /etc/avahi/services.
Oct 19 10:43:04 pihole dhcpcd[541]: wlan0: carrier lost
Oct 19 10:43:04 pihole avahi-daemon[291]: Withdrawing address record for 192.168.1.120 on wlan0.
Oct 19 10:43:04 pihole avahi-daemon[291]: Leaving mDNS multicast group on interface wlan0.IPv4 with address 192.168.1.120.
Oct 19 10:43:04 pihole avahi-daemon[291]: Interface wlan0.IPv4 no longer relevant for mDNS.
Oct 19 10:43:04 pihole dhcpcd[541]: wlan0: deleting route to 192.168.1.0/24
Oct 19 10:43:04 pihole dhcpcd[541]: wlan0: deleting default route via 192.168.1.101
Oct 19 10:43:05 pihole avahi-daemon[291]: Got SIGHUP, reloading.
Oct 19 10:43:05 pihole avahi-daemon[291]: No service file found in /etc/avahi/services.
Oct 19 10:43:05 pihole dhcpcd[541]: wlan0: carrier acquired
Oct 19 10:43:05 pihole dhcpcd[541]: wlan0: IAID 01:5b:1e:9c
Oct 19 10:43:05 pihole dhcpcd[541]: wlan0: probing address 192.168.1.120/24
Oct 19 10:43:05 pihole dhcpcd[541]: wlan0: soliciting an IPv6 router
Oct 19 10:43:09 pihole dhcpcd[541]: wlan0: using static address 192.168.1.120/24
Oct 19 10:43:09 pihole avahi-daemon[291]: Joining mDNS multicast group on interface wlan0.IPv4 with address 192.168.1.120.
Oct 19 10:43:09 pihole avahi-daemon[291]: New relevant interface wlan0.IPv4 for mDNS.
Oct 19 10:43:09 pihole avahi-daemon[291]: Registering new address record for 192.168.1.120 on wlan0.IPv4.
Oct 19 10:43:09 pihole dhcpcd[541]: wlan0: adding route to 192.168.1.0/24
Oct 19 10:43:09 pihole dhcpcd[541]: wlan0: adding default route via 192.168.1.101
Oct 19 10:43:10 pihole avahi-daemon[291]: Got SIGHUP, reloading.
Oct 19 10:43:10 pihole avahi-daemon[291]: No service file found in /etc/avahi/services.

@ORippler
Copy link

ORippler commented Nov 1, 2023

I am also suffering from the firmware crashes (though without the reboot). However, one peculiarity from my side is that I don't run a WiFi Mesh. Some informations:

  • Firmware: BCM43430/2 wl0: Mar 31 2022 17:24:51 version 9.88.4.77 (g58bc5cc) FWID 01-3b307371
  • Offiical power supply (no undervoltage warnings appear in the logs)
  • Never set over_voltage=2
  • brcmf_cfg80211_set_power_mgmt: power save enabled (disabling it didn't resolve the issue)
  • I am sometimes observing poor network speeds, even though signal strength should be strong enough (4 meters of air between the access point and the 02w)

I'll try running test5 version of the firmware first, and afterwards the workaround suggested here. Let me know if there is anything I can do to help in further debugging the root-cause.

Logs of a crash (I had a cron checking and restarting the wifi interface running as a first attempt before I identified this issue here):

Oct 30 10:00:01 raspizero2w CRON[47146]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Oct 30 10:00:01 raspizero2w CRON[47148]: (root) CMD (   /usr/local/bin/wifi_rebooter.sh)
Oct 30 10:00:02 raspizero2w CRON[47146]: pam_unix(cron:session): session closed for user root
Oct 30 10:02:42 raspizero2w dhcpcd[620]: wlan0: carrier lost
Oct 30 10:02:42 raspizero2w dhcpcd[620]: wlan0: deleting address 2003:fd:bf00:cd00:72d7:9d3c:2482:2439/64
Oct 30 10:02:42 raspizero2w avahi-daemon[334]: Withdrawing address record for 2003:fd:bf00:cd00:72d7:9d3c:2482:2439 on wlan0.
Oct 30 10:02:42 raspizero2w avahi-daemon[334]: Leaving mDNS multicast group on interface wlan0.IPv6 with address 2003:fd:bf00:cd00:72d7:9d3c:2482:2439.
Oct 30 10:02:42 raspizero2w avahi-daemon[334]: Joining mDNS multicast group on interface wlan0.IPv6 with address fe80::57ba:eb33:62e1:b754.
Oct 30 10:02:42 raspizero2w avahi-daemon[334]: Registering new address record for fe80::57ba:eb33:62e1:b754 on wlan0.*.
Oct 30 10:02:42 raspizero2w dhcpcd[620]: wlan0: deleting route to 2003:fd:bf00:cd00::/64
Oct 30 10:02:42 raspizero2w dhcpcd[620]: wlan0: deleting default route via fe80::1eed:6fff:fe84:34ee
Oct 30 10:02:42 raspizero2w avahi-daemon[334]: Got SIGHUP, reloading.
Oct 30 10:02:42 raspizero2w avahi-daemon[334]: No service file found in /etc/avahi/services.
Oct 30 10:02:42 raspizero2w dhcpcd[620]: wlan0: deleting address fe80::57ba:eb33:62e1:b754
Oct 30 10:02:42 raspizero2w avahi-daemon[334]: Withdrawing address record for fe80::57ba:eb33:62e1:b754 on wlan0.
Oct 30 10:02:42 raspizero2w avahi-daemon[334]: Leaving mDNS multicast group on interface wlan0.IPv6 with address fe80::57ba:eb33:62e1:b754.
Oct 30 10:02:42 raspizero2w avahi-daemon[334]: Interface wlan0.IPv6 no longer relevant for mDNS.
Oct 30 10:02:42 raspizero2w avahi-daemon[334]: Withdrawing address record for 192.168.178.30 on wlan0.
Oct 30 10:02:42 raspizero2w avahi-daemon[334]: Leaving mDNS multicast group on interface wlan0.IPv4 with address 192.168.178.30.
Oct 30 10:02:42 raspizero2w avahi-daemon[334]: Interface wlan0.IPv4 no longer relevant for mDNS.
Oct 30 10:02:42 raspizero2w dhcpcd[620]: vethab94e98: adding default route
Oct 30 10:02:42 raspizero2w dhcpcd[620]: wlan0: deleting route to 192.168.178.0/24
Oct 30 10:02:42 raspizero2w dhcpcd[620]: wlan0: deleting default route via 192.168.178.1
Oct 30 10:02:43 raspizero2w avahi-daemon[334]: Got SIGHUP, reloading.
Oct 30 10:02:43 raspizero2w avahi-daemon[334]: No service file found in /etc/avahi/services.
Oct 30 10:02:43 raspizero2w dhcpcd[620]: wlan0: carrier acquired
Oct 30 10:02:43 raspizero2w dhcpcd[620]: wlan0: IAID 01:59:45:40
Oct 30 10:02:43 raspizero2w dhcpcd[620]: wlan0: adding address fe80::57ba:eb33:62e1:b754
Oct 30 10:02:43 raspizero2w avahi-daemon[334]: Joining mDNS multicast group on interface wlan0.IPv6 with address fe80::57ba:eb33:62e1:b754.
Oct 30 10:02:43 raspizero2w avahi-daemon[334]: New relevant interface wlan0.IPv6 for mDNS.
Oct 30 10:02:43 raspizero2w avahi-daemon[334]: Registering new address record for fe80::57ba:eb33:62e1:b754 on wlan0.*.
Oct 30 10:02:43 raspizero2w dhcpcd[620]: wlan0: rebinding lease of 192.168.178.30
Oct 30 10:02:43 raspizero2w dhcpcd[620]: wlan0: soliciting an IPv6 router
Oct 30 10:02:48 raspizero2w dhcpcd[620]: wlan0: probing for an IPv4LL address
Oct 30 10:02:48 raspizero2w dhcpcd[620]: wlan0: DHCP lease expired
Oct 30 10:02:48 raspizero2w dhcpcd[620]: wlan0: soliciting a DHCP lease
Oct 30 10:02:53 raspizero2w dhcpcd[620]: wlan0: using IPv4LL address 169.254.177.144
Oct 30 10:02:53 raspizero2w avahi-daemon[334]: Joining mDNS multicast group on interface wlan0.IPv4 with address 169.254.177.144.
Oct 30 10:02:53 raspizero2w avahi-daemon[334]: New relevant interface wlan0.IPv4 for mDNS.
Oct 30 10:02:53 raspizero2w avahi-daemon[334]: Registering new address record for 169.254.177.144 on wlan0.IPv4.
Oct 30 10:02:53 raspizero2w dhcpcd[620]: wlan0: adding route to 169.254.0.0/16
Oct 30 10:02:53 raspizero2w dhcpcd[620]: wlan0: adding default route
Oct 30 10:02:53 raspizero2w dhcpcd[620]: vethab94e98: deleting default route
Oct 30 10:02:59 raspizero2w dhcpcd[620]: wlan0: no IPv6 Routers available
Oct 30 10:05:01 raspizero2w CRON[47330]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Oct 30 10:05:01 raspizero2w CRON[47332]: (root) CMD (   /usr/local/bin/wifi_rebooter.sh)
Oct 30 10:05:05 raspizero2w avahi-daemon[334]: Interface wlan0.IPv6 no longer relevant for mDNS.
Oct 30 10:05:05 raspizero2w avahi-daemon[334]: Leaving mDNS multicast group on interface wlan0.IPv6 with address fe80::57ba:eb33:62e1:b754.
Oct 30 10:05:05 raspizero2w dhcpcd[620]: wlan0: carrier lost
Oct 30 10:05:05 raspizero2w avahi-daemon[334]: Interface wlan0.IPv4 no longer relevant for mDNS.
Oct 30 10:05:05 raspizero2w avahi-daemon[334]: Leaving mDNS multicast group on interface wlan0.IPv4 with address 169.254.177.144.
Oct 30 10:05:05 raspizero2w avahi-daemon[334]: Withdrawing address record for fe80::57ba:eb33:62e1:b754 on wlan0.
Oct 30 10:05:05 raspizero2w avahi-daemon[334]: Withdrawing address record for 169.254.177.144 on wlan0.
Oct 30 10:05:05 raspizero2w dhcpcd[620]: wlan0: deleting address fe80::57ba:eb33:62e1:b754
Oct 30 10:05:05 raspizero2w dhcpcd[620]: vethab94e98: adding default route
Oct 30 10:05:05 raspizero2w dhcpcd[620]: wlan0: deleting route to 169.254.0.0/16
Oct 30 10:05:05 raspizero2w dhcpcd[620]: wlan0: deleting default route
Oct 30 10:05:06 raspizero2w kernel: brcmfmac: brcmf_cfg80211_set_power_mgmt: power save enabled
Oct 30 10:05:06 raspizero2w CRON[47330]: pam_unix(cron:session): session closed for user root
Oct 30 10:05:07 raspizero2w kernel: ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed
Oct 30 10:05:07 raspizero2w kernel: ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Oct 30 10:05:07 raspizero2w kernel: ieee80211 phy0: brcmf_cfg80211_get_tx_power: error (-5)
Oct 30 10:05:08 raspizero2w kernel: mmc1: card 0001 removed
Oct 30 10:05:08 raspizero2w systemd[1]: Starting Load/Save RF Kill Switch Status...
Oct 30 10:05:08 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0x44 [38 e8 8e a3 54 ca 2e 06 ff 6c 16 b6 60 70 00 af 58 c2 13 f5 4a 1c ff a1] (24 bytes)
Oct 30 10:05:08 raspizero2w dhcpcd[620]: wlan0: removing interface
Oct 30 10:05:08 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0x1b [c2 b0 34 96 88 95 d3 3c 2a 82 66 f2 d2 17 23 a9 22 73 01 db 8b 4b 41 6f 68 67 fb 8f 00 9d 04 ae 58 37 3a 98 60 ff 01 78 c6 f5 30 f1 00 05 c4 03 0d ab bd ff 50 07 99 ff e8 ff 0c 30 ff 01 ff 22] (81 bytes)
Oct 30 10:05:08 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0xa8 [1c 0d 63 d2 03 1c c6 20 8b 27 10 24 2e 88 a8 08 a8 81 ff 28 84 df dc 16 5a 62 2a 28 19 2a 12 dc 5a 48 ff 25 13 23 ab 80 30 d8 bd 00 ff 64 64 b7 0e 91 28 20 89 03 68 8a f0 23 f2 22 02 ff ce c2] (128 bytes)
Oct 30 10:05:08 raspizero2w systemd[1]: Started Load/Save RF Kill Switch Status.
Oct 30 10:05:08 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0x5c [13 50 f2 66 2c 47 a3 c1 08 94 2c 14 29 3c b0 c4 46 80 0c 4a 19 ff e0 c2 a5 43 5b 52 08 d7 9b c1 dc 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00] (232 bytes)
Oct 30 10:05:08 raspizero2w dhcpcd-run-hooks[47374]: wlan0: stopping wpa_supplicant
Oct 30 10:05:13 raspizero2w systemd[1]: systemd-rfkill.service: Succeeded.
Oct 30 10:05:50 raspizero2w kernel: mmc1: error -22 whilst initialising SDIO card
Oct 30 10:05:50 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0x44 [38 e8 8e a3 54 ca 2e 06 ff 6c 16 b6 60 70 00 af 58 c2 13 f5 4a 1c ff a1] (24 bytes)
Oct 30 10:05:50 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0x1b [c2 b0 34 96 88 95 d3 3c 2a 82 66 f2 d2 17 23 a9 22 73 01 db 8b 4b 41 6f 68 67 fb 8f 00 9d 04 ae 58 37 3a 98 60 ff 01 78 c6 f5 30 f1 00 05 c4 03 0d ab bd ff 50 07 99 ff e8 ff 0c 30 ff 01 ff 22] (81 bytes)
Oct 30 10:05:50 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0xa8 [1c 0d 63 d2 03 1c c6 20 8b 27 10 24 2e 88 a8 08 a8 81 ff 28 84 df dc 16 5a 62 2a 28 19 2a 12 dc 5a 48 ff 25 13 23 ab 80 30 d8 bd 00 ff 64 64 b7 0e 91 28 20 89 03 68 8a f0 23 f2 22 02 ff ce c2] (128 bytes)
Oct 30 10:05:50 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0x5c [13 50 f2 66 2c 47 a3 c1 08 94 2c 14 29 3c b0 c4 46 80 0c 4a 19 ff e0 c2 a5 43 5b 52 08 d7 9b c1 dc 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00] (232 bytes)
Oct 30 10:06:44 raspizero2w kernel: mmc1: error -22 whilst initialising SDIO card
Oct 30 10:06:44 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0x44 [38 e8 8e a3 54 ca 2e 06 ff 6c 16 b6 60 70 00 af 58 c2 13 f5 4a 1c ff a1] (24 bytes)
Oct 30 10:06:44 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0x1b [c2 b0 34 96 88 95 d3 3c 2a 82 66 f2 d2 17 23 a9 22 73 01 db 8b 4b 41 6f 68 67 fb 8f 00 9d 04 ae 58 37 3a 98 60 ff 01 78 c6 f5 30 f1 00 05 c4 03 0d ab bd ff 50 07 99 ff e8 ff 0c 30 ff 01 ff 22] (81 bytes)
Oct 30 10:06:44 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0xa8 [1c 0d 63 d2 03 1c c6 20 8b 27 10 24 2e 88 a8 08 a8 81 ff 28 84 df dc 16 5a 62 2a 28 19 2a 12 dc 5a 48 ff 25 13 23 ab 80 30 d8 bd 00 ff 64 64 b7 0e 91 28 20 89 03 68 8a f0 23 f2 22 02 ff ce c2] (128 bytes)
Oct 30 10:06:44 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0x5c [13 50 f2 66 2c 47 a3 c1 08 94 2c 14 29 3c b0 c4 46 80 0c 4a 19 ff e0 c2 a5 43 5b 52 08 d7 9b c1 dc 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00] (232 bytes)
Oct 30 10:08:01 raspizero2w kernel: mmc1: error -22 whilst initialising SDIO card
Oct 30 10:08:02 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0x44 [38 e8 8e a3 54 ca 2e 06 ff 6c 16 b6 60 70 00 af 58 c2 13 f5 4a 1c ff a1] (24 bytes)
Oct 30 10:08:02 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0x1b [c2 b0 34 96 88 95 d3 3c 2a 82 66 f2 d2 17 23 a9 22 73 01 db 8b 4b 41 6f 68 67 fb 8f 00 9d 04 ae 58 37 3a 98 60 ff 01 78 c6 f5 30 f1 00 05 c4 03 0d ab bd ff 50 07 99 ff e8 ff 0c 30 ff 01 ff 22] (81 bytes)
Oct 30 10:08:02 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0xa8 [1c 0d 63 d2 03 1c c6 20 8b 27 10 24 2e 88 a8 08 a8 81 ff 28 84 df dc 16 5a 62 2a 28 19 2a 12 dc 5a 48 ff 25 13 23 ab 80 30 d8 bd 00 ff 64 64 b7 0e 91 28 20 89 03 68 8a f0 23 f2 22 02 ff ce c2] (128 bytes)
Oct 30 10:08:02 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0x5c [13 50 f2 66 2c 47 a3 c1 08 94 2c 14 29 3c b0 c4 46 80 0c 4a 19 ff e0 c2 a5 43 5b 52 08 d7 9b c1 dc 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00] (232 bytes)
Oct 30 10:09:15 raspizero2w systemd-timesyncd[265]: Timed out waiting for reply from 90.187.112.137:123 (2.debian.pool.ntp.org).
Oct 30 10:09:25 raspizero2w systemd-timesyncd[265]: Timed out waiting for reply from 194.163.182.21:123 (2.debian.pool.ntp.org).
Oct 30 10:09:36 raspizero2w systemd-timesyncd[265]: Timed out waiting for reply from 144.76.59.106:123 (2.debian.pool.ntp.org).
Oct 30 10:09:46 raspizero2w systemd-timesyncd[265]: Timed out waiting for reply from 131.188.3.220:123 (2.debian.pool.ntp.org).
iw phy
  wiphy index: 0
  max # scan SSIDs: 10
  max scan IEs length: 2048 bytes
  max # sched scan SSIDs: 16
  max # match sets: 16
  Retry short limit: 7
  Retry long limit: 4
  Coverage class: 0 (up to 0m)
  Device supports roaming.
  Supported Ciphers:
  	* WEP40 (00-0f-ac:1)
  	* WEP104 (00-0f-ac:5)
  	* TKIP (00-0f-ac:2)
  	* CCMP-128 (00-0f-ac:4)
  	* CMAC (00-0f-ac:6)
  Available Antennas: TX 0 RX 0
  Supported interface modes:
  	 * IBSS
  	 * managed
  	 * AP
  	 * P2P-client
  	 * P2P-GO
  	 * P2P-device
  Band 1:
  	Capabilities: 0x1020
  		HT20
  		Static SM Power Save
  		RX HT20 SGI
  		No RX STBC
  		Max AMSDU length: 3839 bytes
  		DSSS/CCK HT40
  	Maximum RX AMPDU length 65535 bytes (exponent: 0x003)
  	Minimum RX AMPDU time spacing: 16 usec (0x07)
  	HT TX/RX MCS rate indexes supported: 0-7
  	Bitrates (non-HT):
  		* 1.0 Mbps
  		* 2.0 Mbps (short preamble supported)
  		* 5.5 Mbps (short preamble supported)
  		* 11.0 Mbps (short preamble supported)
  		* 6.0 Mbps
  		* 9.0 Mbps
  		* 12.0 Mbps
  		* 18.0 Mbps
  		* 24.0 Mbps
  		* 36.0 Mbps
  		* 48.0 Mbps
  		* 54.0 Mbps
  	Frequencies:
  		* 2412 MHz [1] (20.0 dBm)
  		* 2417 MHz [2] (20.0 dBm)
  		* 2422 MHz [3] (20.0 dBm)
  		* 2427 MHz [4] (20.0 dBm)
  		* 2432 MHz [5] (20.0 dBm)
  		* 2437 MHz [6] (20.0 dBm)
  		* 2442 MHz [7] (20.0 dBm)
  		* 2447 MHz [8] (20.0 dBm)
  		* 2452 MHz [9] (20.0 dBm)
  		* 2457 MHz [10] (20.0 dBm)
  		* 2462 MHz [11] (20.0 dBm)
  		* 2467 MHz [12] (20.0 dBm)
  		* 2472 MHz [13] (20.0 dBm)
  		* 2484 MHz [14] (disabled)
  Supported commands:
  	 * new_interface
  	 * set_interface
  	 * new_key
  	 * start_ap
  	 * join_ibss
  	 * set_pmksa
  	 * del_pmksa
  	 * flush_pmksa
  	 * remain_on_channel
  	 * frame
  	 * set_wiphy_netns
  	 * set_channel
  	 * start_sched_scan
  	 * start_p2p_device
  	 * connect
  	 * disconnect
  	 * crit_protocol_start
  	 * crit_protocol_stop
  	 * update_connect_params
  software interface modes (can always be added):
  valid interface combinations:
  	 * #{ managed } <= 1, #{ P2P-device } <= 1, #{ P2P-client, P2P-GO } <= 1,
  	   total <= 3, #channels <= 2
  	 * #{ managed } <= 1, #{ AP } <= 1, #{ P2P-client } <= 1, #{ P2P-device } <= 1,
  	   total <= 4, #channels <= 1
  Device supports scan flush.
  Device supports randomizing MAC-addr in sched scans.
  max # scan plans: 1
  max scan plan interval: 508
  max scan plan iterations: 0
  Supported TX frame types:
  	 * managed: 0x00 0x10 0x20 0x30 0x40 0x50 0x60 0x70 0x80 0x90 0xa0 0xb0 0xc0 0xd0 0xe0 0xf0
  	 * AP: 0x00 0x10 0x20 0x30 0x40 0x50 0x60 0x70 0x80 0x90 0xa0 0xb0 0xc0 0xd0 0xe0 0xf0
  	 * P2P-client: 0x00 0x10 0x20 0x30 0x40 0x50 0x60 0x70 0x80 0x90 0xa0 0xb0 0xc0 0xd0 0xe0 0xf0
  	 * P2P-GO: 0x00 0x10 0x20 0x30 0x40 0x50 0x60 0x70 0x80 0x90 0xa0 0xb0 0xc0 0xd0 0xe0 0xf0
  	 * P2P-device: 0x00 0x10 0x20 0x30 0x40 0x50 0x60 0x70 0x80 0x90 0xa0 0xb0 0xc0 0xd0 0xe0 0xf0
  Supported RX frame types:
  	 * managed: 0x40 0xd0
  	 * AP: 0x00 0x20 0x40 0xa0 0xb0 0xc0 0xd0
  	 * P2P-client: 0x40 0xd0
  	 * P2P-GO: 0x00 0x20 0x40 0xa0 0xb0 0xc0 0xd0
  	 * P2P-device: 0x40 0xd0
  Supported extended features:
  	* [ CQM_RSSI_LIST ]: multiple CQM_RSSI_THOLD records
  	* [ 4WAY_HANDSHAKE_STA_PSK ]: 4-way handshake with PSK in station mode
  	* [ 4WAY_HANDSHAKE_STA_1X ]: 4-way handshake with 802.1X in station mode
  	* [ SAE_OFFLOAD ]: SAE offload support

@pelwell
Copy link
Contributor

pelwell commented Nov 1, 2023

Oct 30 10:05:07 raspizero2w kernel: ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed
Oct 30 10:05:07 raspizero2w kernel: ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Oct 30 10:05:07 raspizero2w kernel: ieee80211 phy0: brcmf_cfg80211_get_tx_power: error (-5)

Please also add brcmfmac.debug=0x100000 to cmdline.txt.

@ORippler
Copy link

ORippler commented Nov 7, 2023

@pelwell here a log of a crash with debug information for the version test5

-- Journal begins at Wed 2023-05-03 05:11:24 CEST, ends at Tue 2023-11-07 08:05:59 CET. --
Nov 06 07:43:40 raspizero2w kernel: brcmfmac: CONSOLE: wl0: wlc_enable_probe_req: state down, deferring setting of host flags
Nov 06 07:43:40 raspizero2w kernel: brcmfmac: CONSOLE: wl0: wlc_bss_mac_rxframe_event MALLOC failed
Nov 06 07:43:41 raspizero2w kernel: brcmfmac: CONSOLE: wl0: wlc_bss_mac_rxframe_event MALLOC failed
Nov 06 07:43:41 raspizero2w kernel: brcmfmac: CONSOLE: wl0: wlc_bss_mac_rxframe_event MALLOC failed
Nov 06 07:43:41 raspizero2w kernel: brcmfmac: CONSOLE: wl0: wlc_bss_mac_rxframe_event MALLOC failed
Nov 06 07:43:41 raspizero2w kernel: brcmfmac: CONSOLE: wl0: wlc_bss_mac_rxframe_event MALLOC failed
Nov 06 07:43:41 raspizero2w kernel: brcmfmac: CONSOLE: wl0: wlc_bss_mac_rxframe_event MALLOC failed
Nov 06 07:43:41 raspizero2w kernel: brcmfmac: CONSOLE: wl0: wlc_bss_mac_rxframe_event MALLOC failed
Nov 06 07:43:41 raspizero2w kernel: brcmfmac: CONSOLE: wl0: wlc_bss_mac_rxframe_event MALLOC failed
Nov 06 07:43:41 raspizero2w kernel: brcmfmac: CONSOLE: wl0: wlc_bss_mac_rxframe_event MALLOC failed
Nov 06 07:43:41 raspizero2w kernel: brcmfmac: CONSOLE: wl0: wlc_enable_probe_req: state down, deferring setting of host flags
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: wl0: wlc_txc_scb_init: failed to allocate cubby space for txheader cache
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: wl0: wlc_scbinit: Cubby failed
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: wl0: wlc_userscb_alloc failed with err -27
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: wl0: wlc_join_BSS_select: out of scbs
Nov 06 07:43:42 raspizero2w kernel: ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: brcmf_sdio_hostmail: unexpected NAKHANDLED!
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: wl0.0: wlc_keymgmt_set_bss_tx_key_id:key id 00, key index 65535 is out of range.
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: 
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: FWID 01-139d9a8f
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: flags 1
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: 
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: TRAP c(6ff7c): pc 80cdd0, lr 7337, sp 41628, cpsr 2000000c, spsr 21000000
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE:   r0 0, r1 2, r2 2, r3 2101, r4 61214, r5 6163c, r6 62fe8
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE:   r7 1, r8 0, r9 0, r10 6261c, r11 6261c, r12 0
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: 
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE:    sp+0 00000000 00000002 00000001 00007337
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE:   sp+10 0000ffff 00000000 00000000 0006163e
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: 
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: sp+c 00007337
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: sp+10 0000ffff
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: sp+24 0000ffff
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: sp+5c 0080a22d
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: sp+64 00005201
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: sp+8c 00835fa5
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: sp+ac 0000b347
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: sp+b4 0083803f
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: sp+c4 00838173
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: sp+dc 00011b3b
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: sp+ec 0081e9e9
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: sp+fc 00005201
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: sp+114 008341e5
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: sp+118 008341dd
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: sp+11c 0082f4e3
Nov 06 07:43:42 raspizero2w kernel: brcmfmac: CONSOLE: sp+120 0082f4d1
Nov 06 07:43:42 raspizero2w kernel: ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
Nov 06 07:43:42 raspizero2w kernel: ieee80211 phy0: brcmf_cfg80211_get_tx_power: error (-5)
Nov 06 07:43:43 raspizero2w kernel: mmc1: card 0001 removed
Nov 06 07:43:43 raspizero2w systemd[1]: Starting Load/Save RF Kill Switch Status...
Nov 06 07:43:43 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0x04 [38 f8 8e a3 06 fa 2e 06 ff 6c 04 b6 a7 00 00 af 00 c2 ff f5 48 1c ff a1] (24 bytes)
Nov 06 07:43:43 raspizero2w kernel: mmc1: queuing unknown CIS tuple 0x56 [29 0e e5 63 9a 49 ff 01 b5 0f ff 0a 46 44 fd 05 95 40 da d7] (20 bytes)
Nov 06 07:43:43 raspizero2w kernel: mmc1: new high speed SDIO card at address 0001
Nov 06 07:43:43 raspizero2w dhcpcd[622]: wlan0: removing interface
Nov 06 07:43:43 raspizero2w systemd[1]: Started Load/Save RF Kill Switch Status.
Nov 06 07:43:43 raspizero2w dhcpcd-run-hooks[55969]: wlan0: stopping wpa_supplicant
Nov 06 07:43:48 raspizero2w systemd[1]: systemd-rfkill.service: Succeeded.
Nov 06 08:17:01 raspizero2w CRON[56006]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Nov 06 08:17:01 raspizero2w CRON[56007]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Nov 06 08:17:01 raspizero2w CRON[56006]: pam_unix(cron:session): session closed for user root
Nov 06 08:34:57 raspizero2w rngd[433]: stats: bits received from HRNG source: 3560064
Nov 06 08:34:57 raspizero2w rngd[433]: stats: bits sent to kernel pool: 3508192
Nov 06 08:34:57 raspizero2w rngd[433]: stats: entropy added to kernel pool: 3508192
Nov 06 08:34:57 raspizero2w rngd[433]: stats: FIPS 140-2 successes: 178
Nov 06 08:34:57 raspizero2w rngd[433]: stats: FIPS 140-2 failures: 0
Nov 06 08:34:57 raspizero2w rngd[433]: stats: FIPS 140-2(2001-10-10) Monobit: 0
Nov 06 08:34:57 raspizero2w rngd[433]: stats: FIPS 140-2(2001-10-10) Poker: 0
Nov 06 08:34:57 raspizero2w rngd[433]: stats: FIPS 140-2(2001-10-10) Runs: 0
Nov 06 08:34:57 raspizero2w rngd[433]: stats: FIPS 140-2(2001-10-10) Long run: 0
Nov 06 08:34:57 raspizero2w rngd[433]: stats: FIPS 140-2(2001-10-10) Continuous run: 0
Nov 06 08:34:57 raspizero2w rngd[433]: stats: HRNG source speed: (min=513.642; avg=896.844; max=983.496)Kibits/s
Nov 06 08:34:57 raspizero2w rngd[433]: stats: FIPS tests speed: (min=21.949; avg=26.516; max=43.646)Mibits/s
Nov 06 08:34:57 raspizero2w rngd[433]: stats: Lowest ready-buffers level: 2
Nov 06 08:34:57 raspizero2w rngd[433]: stats: Entropy starvations: 0
Nov 06 08:34:57 raspizero2w rngd[433]: stats: Time spent starving for entropy: (min=0; avg=0.000; max=0)us

Should it help: My Access Point is a FritzBox 6490 running FritzOS 7.57 (it sits behind a FritzBox 5530, but I don't run a mesh and the 5530 has wifi disabled alltogether).

I'll now try with the firmware posted by Krautmaster suggested here


Edit: As of 2024-01-14, I have not observed any more crashes with the firmware posted/suggested by Krautmaster

@TalalMash
Copy link

TalalMash commented Nov 12, 2023

Report: test5 firmware fixed the crash when restarting the nearest Wi-Fi Router/AP while a poor signal AP with the same SSID is accessible. (repeater, probably similar to the mesh reports)

Edit: Also works when changing parameters on the same SSID on the AP such as switching to WPA3 and enabling MFP then switching back to WPA2 w/o MFP and the Pi reconnects without crashing.

@phillipse01
Copy link

phillipse01 commented Jan 10, 2024

Having the same issues with octopi when viewing pi cams - I am adding:

  • brcmfmac.debug=0x100000
  • ipv6.disable=1

to cmdline.txt and I am trying the work-around:

for me this was a working workaround if someone wants to test and report:

please try wget https://github.com/RPi-Distro/firmware-nonfree/raw/d95f6614b19cb2d3ead4f2e2ea4ba0a7397ac5c0/debian/config/brcm80211/brcm/brcmfmac43436f-sdio.bin cp brcmfmac43436f-sdio.bin /lib/firmware/brcm/brcmfmac43436-sdio.bin reboot

@phillipse01
Copy link

phillipse01 commented Jan 10, 2024

Had a failure :( Here is the logs:

Jan 11 02:39:03 octopi kernel: [  188.187629] brcmfmac: brcmf_sdio_rxfail: abort command, terminate frame, send NAK
Jan 11 02:39:03 octopi kernel: [  188.189353] ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed
Jan 11 02:39:03 octopi kernel: [  188.191852] 8<--- cut here ---
Jan 11 02:39:03 octopi kernel: [  188.191913] Unable to handle kernel NULL pointer dereference at virtual address 00000030
Jan 11 02:39:03 octopi kernel: [  188.191940] [00000030] *pgd=00000000
Jan 11 02:39:03 octopi kernel: [  188.191970] Internal error: Oops: 17 [#1] SMP ARM
Jan 11 02:39:03 octopi kernel: [  188.191991] Modules linked in: xt_DSCP xt_tcpudp nft_compat nf_tables nfnetlink tcp_diag inet_diag cmac algif_hash aes_arm_bs crypto_simd cryptd algif_skcipher af_alg bnep lz4 lz4_compress 8021q garp stp llc zram zsmalloc dw9807_vcm imx708 vc4 s
nd_soc_hdmi_codec drm_display_helper cec drm_dma_helper drm_kms_helper brcmfmac snd_soc_core brcmutil snd_compress snd_pcm_dmaengine fb_sys_fops syscopyarea sha256_generic sysfillrect cfg80211 sysimgblt hci_uart btbcm i2c_mux_pinctrl raspberrypi_hwmon bcm2835_unicam i2c_mux blue
tooth bcm2835_isp(C) v4l2_dv_timings v4l2_fwnode v4l2_async bcm2835_codec(C) bcm2835_v4l2(C) v4l2_mem2mem snd_bcm2835(C) bcm2835_mmal_vchiq(C) videobuf2_dma_contig videobuf2_vmalloc videobuf2_memops snd_pcm ecdh_generic videobuf2_v4l2 ecc videobuf2_common videodev rfkill snd_tim
er i2c_bcm2835 snd mc vc_sm_cma(C) raspberrypi_gpiomem fixed uio_pdrv_genirq uio drm fuse drm_panel_orientation_quirks backlight ip_tables x_tables ipv6
Jan 11 02:39:03 octopi kernel: [  188.192540] CPU: 0 PID: 288 Comm: kworker/u9:3 Tainted: G         C         6.1.70-v7+ #1714
Jan 11 02:39:03 octopi kernel: [  188.192572] Hardware name: BCM2835
Jan 11 02:39:03 octopi kernel: [  188.192592] Workqueue: brcmf_wq/mmc1:0001:1 brcmf_sdio_dataworker [brcmfmac]
Jan 11 02:39:03 octopi kernel: [  188.192949] PC is at bcm2835_mmc_transfer_dma+0xb0/0x234
Jan 11 02:39:03 octopi kernel: [  188.192982] LR is at dma_direct_map_sg+0x214/0x324
Jan 11 02:39:03 octopi kernel: [  188.193009] pc : [<80825d08>]    lr : [<801a0850>]    psr: a0000113
Jan 11 02:39:03 octopi kernel: [  188.193029] sp : 98c11be0  ip : 38e38e39  fp : 1dc00020
Jan 11 02:39:03 octopi kernel: [  188.193046] r10: 00000000  r9 : 00000020  r8 : 00000001
Jan 11 02:39:03 octopi kernel: [  188.193063] r7 : 00000000  r6 : 00000002  r5 : 8179d640  r4 : 81f90380
Jan 11 02:39:03 octopi kernel: [  188.193082] r3 : 8179d440  r2 : 00000000  r1 : 8587abc0  r0 : 00000001
Jan 11 02:39:03 octopi kernel: [  188.193102] Flags: NzCv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment user
Jan 11 02:39:03 octopi kernel: [  188.193125] Control: 10c5383d  Table: 040c806a  DAC: 00000055
Jan 11 02:39:03 octopi kernel: [  188.193142] Register r0 information: non-paged memory
Jan 11 02:39:03 octopi kernel: [  188.193165] Register r1 information: non-slab/vmalloc memory
Jan 11 02:39:03 octopi kernel: [  188.193188] Register r2 information: NULL pointer
Jan 11 02:39:03 octopi kernel: [  188.193207] Register r3 information: slab kmalloc-512 start 8179d400 pointer offset 64 size 512
Jan 11 02:39:03 octopi kernel: [  188.193253] Register r4 information: slab kmalloc-2k start 81f90000 pointer offset 896 size 2048
Jan 11 02:39:03 octopi kernel: [  188.193296] Register r5 information: slab kmalloc-512 start 8179d600 pointer offset 64 size 512
Jan 11 02:39:03 octopi kernel: [  188.193337] Register r6 information: non-paged memory
Jan 11 02:39:03 octopi kernel: [  188.193356] Register r7 information: NULL pointer
Jan 11 02:39:03 octopi kernel: [  188.193375] Register r8 information: non-paged memory
Jan 11 02:39:03 octopi kernel: [  188.193395] Register r9 information: non-paged memory
Jan 11 02:39:03 octopi kernel: [  188.193414] Register r10 information: NULL pointer
Jan 11 02:39:03 octopi kernel: [  188.193433] Register r11 information: non-paged memory
Jan 11 02:39:03 octopi kernel: [  188.193452] Register r12 information: non-paged memory
Jan 11 02:39:03 octopi kernel: [  188.193471] Process kworker/u9:3 (pid: 288, stack limit = 0x23eb8ea0)
Jan 11 02:39:03 octopi kernel: [  188.193495] Stack: (0x98c11be0 to 0x98c12000)
Jan 11 02:39:03 octopi kernel: [  188.193519] 1be0: 00000000 00000020 00000000 81f90000 98c11c88 00000000 8587a3c0 81f91000
Jan 11 02:39:03 octopi kernel: [  188.193547] 1c00: 00000020 808096a4 98c11c88 00000001 81f90000 808097d0 00000800 00000001
Jan 11 02:39:03 octopi kernel: [  188.193575] 1c20: 00080000 80815d50 81204950 81004fc8 811de47c 98c11ca8 98c11c54 81004fc8
Jan 11 02:39:03 octopi kernel: [  188.193603] 1c40: 97cd712a 000003c0 00000800 c587a3c0 3b9aca00 00000000 00000040 00000020
Jan 11 02:39:03 octopi kernel: [  188.193630] 1c60: 00000000 00000000 00000200 00000000 00000000 98c11c88 00000001 00000000
Jan 11 02:39:03 octopi kernel: [  188.193658] 1c80: 98c11c40 00000000 00000000 98c11ccc 98c11c50 00000000 00000001 00010001
Jan 11 02:39:03 octopi kernel: [  188.193686] 1ca0: 98c11ca0 98c11ca0 00000000 00000000 98c11cb0 98c11cb0 808087c8 00000000
Jan 11 02:39:03 octopi kernel: [  188.193713] 1cc0: 00000000 00000000 00000000 00000035 1dc00020 00000000 00000000 00000000
Jan 11 02:39:03 octopi kernel: [  188.193740] 1ce0: 00000000 000001b5 00000000 ffffff92 00000000 98c11c50 98c11c88 09289f12
Jan 11 02:39:03 octopi kernel: [  188.193768] 1d00: 92001800 00000800 00000800 81f78c00 8587a3c0 00000001 0000e000 00000000
Jan 11 02:39:03 octopi kernel: [  188.193796] 1d20: 000001ff 80817684 00000001 8587a3c0 00000020 00000040 81f9026c 82c4c000
Jan 11 02:39:03 octopi kernel: [  188.193824] 1d40: 00000800 00006000 843c20c0 82c4c000 00006000 0000e000 98fc1000 80817798
Jan 11 02:39:03 octopi kernel: [  188.193851] 1d60: 8587a3c0 00000800 98c11d60 7f497510 00000800 00000800 00000800 7f4984dc
Jan 11 02:39:03 octopi kernel: [  188.193879] 1d80: 00000800 00006000 00000000 0006e800 7f4a8d3c ffff8000 00000000 7f4a8c2c
Jan 11 02:39:03 octopi kernel: [  188.193907] 1da0: 00000000 00006800 0006a000 98fc1000 00006000 00070000 82c4c000 00000000
Jan 11 02:39:03 octopi kernel: [  188.193935] 1dc0: 0006a000 7f490f44 00000800 ffffffff 7f49aebc 00000000 8383b940 00000000
Jan 11 02:39:03 octopi kernel: [  188.193962] 1de0: 00070000 98fbb000 00070000 83fb6605 8376d668 7f49aef0 83d10580 81f78c08
Jan 11 02:39:03 octopi kernel: [  188.193990] 1e00: 8383bb40 83fb6600 00000000 00000040 83fb6605 7f4881d0 83d10580 7f49b49c
Jan 11 02:39:03 octopi kernel: [  188.194018] 1e20: 82c4c000 ffffffff 8383bb40 7f493d9c 00000000 81004fc8 00000001 cfe7f6d4
Jan 11 02:39:03 octopi kernel: [  188.194045] 1e40: 0000002b 801584ac 83f62600 8376d400 87bae440 83f62600 00000000 00000001
Jan 11 02:39:03 octopi kernel: [  188.194073] 1e60: 83f62380 7f4a73bc 8376d410 7f4a858c 00000014 09289f12 7f4a85c4 8155db40
Jan 11 02:39:03 octopi kernel: [  188.194101] 1e80: 7f4ac208 87bae440 87bae400 87bae440 81004fc8 80da8b98 98c11f4c 00000000
Jan 11 02:39:03 octopi kernel: [  188.194129] 1ea0: 00000000 80a3e148 83f62600 83f62600 8155db40 ffffff92 83f62380 8153ea80
Jan 11 02:39:03 octopi kernel: [  188.194156] 1ec0: 00000000 87bae400 83f62380 8155d8c0 81004fc8 00000000 0000002b 83f62380
Jan 11 02:39:03 octopi kernel: [  188.194184] 1ee0: 98c11f4c 80a3e148 81f3a61c 0000bd20 8376d668 83fcdc80 00000000 00000000
Jan 11 02:39:03 octopi kernel: [  188.194211] 1f00: 00000000 09289f12 00000000 8376d668 83fcdc80 81f3a600 83fb6600 00000000
Jan 11 02:39:03 octopi kernel: [  188.194239] 1f20: 00000120 83fb6605 81f3a600 80139eac 81f3a600 81f3a600 81f3a61c 83fcdc80
Jan 11 02:39:03 octopi kernel: [  188.194267] 1f40: 81f3a600 83fcdc98 81f3a61c 81003d40 00000088 81153749 81f3a600 8013a1b8
Jan 11 02:39:03 octopi kernel: [  188.194295] 1f60: 80d134e8 83f62380 83fe55c0 83fe5100 00000000 8013a170 83fcdc80 83f62380
Jan 11 02:39:03 octopi kernel: [  188.194322] 1f80: 83fe55c0 98ae1eb4 00000000 80141810 83fe5100 8014172c 00000000 00000000
Jan 11 02:39:03 octopi kernel: [  188.194349] 1fa0: 00000000 00000000 00000000 8010011c 00000000 00000000 00000000 00000000
Jan 11 02:39:03 octopi kernel: [  188.194376] 1fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Jan 11 02:39:03 octopi kernel: [  188.194403] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000 00000000 00000000
Jan 11 02:39:03 octopi kernel: [  188.194492]  mmc_start_request from mmc_wait_for_req+0x6c/0xd8
Jan 11 02:39:03 octopi kernel: [  188.194523]  mmc_wait_for_req from mmc_io_rw_extended+0x228/0x33c
Jan 11 02:39:03 octopi kernel: [  188.194557]  mmc_io_rw_extended from sdio_io_rw_ext_helper+0xc8/0x1b8
Jan 11 02:39:03 octopi kernel: [  188.194591]  sdio_io_rw_ext_helper from sdio_memcpy_fromio+0x24/0x2c
Jan 11 02:39:03 octopi kernel: [  188.194626]  sdio_memcpy_fromio from brcmf_sdiod_skbuff_read+0x80/0xa0 [brcmfmac]
Jan 11 02:39:03 octopi kernel: [  188.194941]  brcmf_sdiod_skbuff_read [brcmfmac] from brcmf_sdiod_ramrw+0x190/0x210 [brcmfmac]
Jan 11 02:39:03 octopi kernel: [  188.195428]  brcmf_sdiod_ramrw [brcmfmac] from brcmf_sdio_bus_get_memdump+0xd8/0x118 [brcmfmac]
Jan 11 02:39:03 octopi kernel: [  188.195912]  brcmf_sdio_bus_get_memdump [brcmfmac] from brcmf_debug_create_memdump+0x78/0xdc [brcmfmac]
Jan 11 02:39:03 octopi kernel: [  188.196398]  brcmf_debug_create_memdump [brcmfmac] from brcmf_dev_coredump+0x1c/0x40 [brcmfmac]
Jan 11 02:39:03 octopi kernel: [  188.196886]  brcmf_dev_coredump [brcmfmac] from brcmf_fw_crashed+0x38/0xb9c [brcmfmac]
Jan 11 02:39:03 octopi kernel: [  188.197389]  brcmf_fw_crashed [brcmfmac] from brcmf_sdio_dataworker+0x66c/0x2478 [brcmfmac]
Jan 11 02:39:03 octopi kernel: [  188.197875]  brcmf_sdio_dataworker [brcmfmac] from process_one_work+0x240/0x504
Jan 11 02:39:03 octopi kernel: [  188.198144]  process_one_work from worker_thread+0x48/0x54c
Jan 11 02:39:03 octopi kernel: [  188.198179]  worker_thread from kthread+0xe4/0x100
Jan 11 02:39:03 octopi kernel: [  188.198212]  kthread from ret_from_fork+0x14/0x38
Jan 11 02:39:03 octopi kernel: [  188.198240] Exception stack(0x98c11fb0 to 0x98c11ff8)
Jan 11 02:39:03 octopi kernel: [  188.198261] 1fa0:                                     00000000 00000000 00000000 00000000
Jan 11 02:39:03 octopi kernel: [  188.198288] 1fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Jan 11 02:39:03 octopi kernel: [  188.198314] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000
Jan 11 02:39:03 octopi kernel: [  188.198340] Code: 0a000046 e5942094 e1550007 e5953000 (e5921030)
Jan 11 02:39:03 octopi kernel: [  188.198472] ---[ end trace 0000000000000000 ]---
Jan 11 02:39:09 octopi sh[620]: device/links.c: STREAM:capture:mplane:buf0: Capture image is outdated. Skipped. Now: 194490968, vs 188575850.
Jan 11 02:39:12 octopi sh[620]: util/http/http.c: HTTP8080/7: Client disconnected 127.0.0.1.
Jan 11 02:39:12 octopi sh[620]: util/http/http.c: HTTP8080/6: Client disconnected 127.0.0.1.
Jan 11 02:39:12 octopi sh[620]: util/http/http.c: HTTP8080/3: Client disconnected 127.0.0.1.
Jan 11 02:40:00 octopi systemd[1]: Started Network Monitor.
Jan 11 02:40:00 octopi networkcheck[1180]: Network monitoring not enabled.
Jan 11 02:40:00 octopi systemd[1]: networkcheck.service: Succeeded.
Jan 11 02:40:02 octopi CRON[1182]: (root) CMD (/home/pi/check_wifi.sh >> $HOME/check_wifi_cron.log 2>&1)

@JsBergbau
Copy link

JsBergbau commented Feb 9, 2024

Problem is still existing.
Occured when I've resetted Wifi APs, so it was roaming to another AP.
Maybe this helps: Before there was a problem in ARP resolution and OpenWRT openwrt/openwrt#9555 so I did a wifi and after that there was in the log

2024-02-09T15:55:10.360700+01:00 THE_SYSTEM kernel: [85972.934899] ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed
2024-02-09T15:55:10.391054+01:00 THE_SYSTEM kernel: [85972.972656] brcmfmac: brcmf_sdio_hostmail: unexpected NAKHANDLED!
2024-02-09T15:55:10.410282+01:00 THE_SYSTEM kernel: [85972.991638] ieee80211 phy0: brcmf_fil_cmd_data: bus is down. we have nothing to do.
2024-02-09T15:55:10.410331+01:00 THE_SYSTEM kernel: [85972.991662] ieee80211 phy0: brcmf_cfg80211_get_tx_power: error (-5)
2024-02-09T15:55:11.026168+01:00 THE_SYSTEM kernel: [85973.609466] mmc1: card 0001 removed
2024-02-09T15:55:11.070124+01:00 THE_SYSTEM kernel: [85973.653950] mmc1: queuing unknown CIS tuple 0xa0 [c0 ff 22 00 81 c0 50 7b ff ac 63 63 30 68 00 82 e5 00 5c f1 81 00 c4 78] (24 bytes)
2024-02-09T15:55:11.138126+01:00 THE_SYSTEM kernel: [85973.720720] mmc1: queuing unknown CIS tuple 0x4b [89 ff 8c 4f f1 e1 0c ff 41 0c 19 ff 01 ad 05 92 fc 5b 01 6b 40 ca 44 10 fd ff ff 19 0 27 ff 30 e3 49 0f a4 b0 32 99 84 b4 28 60 ff 7b 92 c6 29 f8 ff 88 7a d2 3c 43 01 96 91 00 37 c3] (213 bytes)
2024-02-09T15:55:11.170210+01:00 THE_SYSTEM kernel: [85973.751985] mmc1: queuing unknown CIS tuple 0xf1 [ff b5 e4 41 aa 10 b9 28 e4 a6 44 25 36 e9 86 30 e2 ff cc 21 6f 3b b0 06 ee 4d 59 86 e 18 89 88 ed 29 04 6a 35 93 88 ed ff 79 ff ff 25 b3 10 55 30 09 a0 3e 18 91 39 12 d3 34 00 01 11] (100 bytes)
2024-02-09T15:55:11.218096+01:00 THE_SYSTEM kernel: [85973.800140] mmc1: queuing unknown CIS tuple 0xe2 [1e 06 57 87 12 ff 56 9c 6d f9 cf 80 26 2c ee e2 37 13 9b 02 28 21 11 98 0b 7f 94 f5 8 29 30 04 58 4b 38 67 00 21 5a 96 ff 50 0a 33 02 f6 4f ab 4c 3f 24 a0 00 00 00 00 00 00 00 00 00] (156 bytes)
2024-02-09T15:55:16.106968+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490500.1482] device (wlan0): supplicant interface state: disconnected -> associating
2024-02-09T15:55:16.108917+01:00 THE_SYSTEM wpa_supplicant[466]: wlan0: CTRL-EVENT-REGDOM-CHANGE init=USER type=COUNTRY alpha2=DE
2024-02-09T15:55:16.110465+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490500.1483] device (p2p-dev-wlan0): supplicant management interface state: disconnected -> associating
2024-02-09T15:55:16.111172+01:00 THE_SYSTEM wpa_supplicant[466]: wlan0: CTRL-EVENT-ASSOC-REJECT bssid=1e:3b:f3:xx:xx:xx status_code=16
2024-02-09T15:55:16.112062+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490503.2623] device (wlan0): supplicant interface state: associating -> disconnected
2024-02-09T15:55:16.112582+01:00 THE_SYSTEM wpa_supplicant[466]: BSSID 1e:3b:f3:xx:xx:xx ignore list count incremented to 2, ignoring for 10 seconds
2024-02-09T15:55:16.113094+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490503.2625] device (p2p-dev-wlan0): supplicant management interface state: associating -> disconnected
2024-02-09T15:55:16.113583+01:00 THE_SYSTEM wpa_supplicant[466]: wlan0: Trying to associate with SSID 'THE_SSID'
2024-02-09T15:55:16.114215+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490503.7607] device (wlan0): supplicant interface state: disconnected -> scanning
2024-02-09T15:55:16.114736+01:00 THE_SYSTEM wpa_supplicant[466]: wlan0: CTRL-EVENT-ASSOC-REJECT bssid=1e:3b:f3:xx:xx:xx status_code=16
2024-02-09T15:55:16.115293+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490503.7609] device (p2p-dev-wlan0): supplicant management interface state: disconnected -> scanning
2024-02-09T15:55:16.115834+01:00 THE_SYSTEM wpa_supplicant[466]: wlan0: Trying to associate with SSID 'THE_SSID'
2024-02-09T15:55:16.116363+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490505.3162] device (wlan0): supplicant interface state: scanning -> associating
2024-02-09T15:55:16.116909+01:00 THE_SYSTEM wpa_supplicant[466]: wlan0: CTRL-EVENT-ASSOC-REJECT bssid=1e:3b:f3:xx:xx:xx status_code=16
2024-02-09T15:55:16.117411+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490505.3164] device (p2p-dev-wlan0): supplicant management interface state: scanning -> associating
2024-02-09T15:55:16.117814+01:00 THE_SYSTEM wpa_supplicant[466]: wlan0: CTRL-EVENT-SSID-TEMP-DISABLED id=0 ssid="THE_SSID" auth_failures=1 duration=10 reason=CONN_FAILED
2024-02-09T15:55:16.118240+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490506.8877] device (wlan0): supplicant interface state: associating -> disconnected
2024-02-09T15:55:16.119463+01:00 THE_SYSTEM avahi-daemon[404]: Interface wlan0.IPv6 no longer relevant for mDNS.
2024-02-09T15:55:16.120259+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490506.8879] device (p2p-dev-wlan0): supplicant management interface state: associating -> disconnected
2024-02-09T15:55:16.120734+01:00 THE_SYSTEM avahi-daemon[404]: Leaving mDNS multicast group on interface wlan0.IPv6 with address <IPv6-Address>.
2024-02-09T15:55:16.121267+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490506.9243] device (wlan0): supplicant interface state: disconnected -> scanning
2024-02-09T15:55:16.121701+01:00 THE_SYSTEM avahi-daemon[404]: Interface wlan0.IPv4 no longer relevant for mDNS.
2024-02-09T15:55:16.122233+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490506.9244] device (p2p-dev-wlan0): supplicant management interface state: disconnected -> scanning
2024-02-09T15:55:16.122761+01:00 THE_SYSTEM avahi-daemon[404]: Leaving mDNS multicast group on interface wlan0.IPv4 with address 192.168.178.50.
2024-02-09T15:55:16.123194+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490507.8761] device (wlan0): supplicant interface state: scanning -> associating
2024-02-09T15:55:16.123548+01:00 THE_SYSTEM avahi-daemon[404]: Withdrawing address record for <IPv6-Address> on wlan0.
2024-02-09T15:55:16.123880+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490507.8762] device (p2p-dev-wlan0): supplicant management interface state: scanning -> associating
2024-02-09T15:55:16.124347+01:00 THE_SYSTEM avahi-daemon[404]: Withdrawing address record for 192.168.178.50 on wlan0.
2024-02-09T15:55:16.124820+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490508.9158] device (wlan0): supplicant interface state: associating -> disconnected
2024-02-09T15:55:16.125417+01:00 THE_SYSTEM wpa_supplicant[466]: p2p-dev-wlan0: CTRL-EVENT-DSCP-POLICY clear_all
2024-02-09T15:55:16.125779+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490508.9160] device (p2p-dev-wlan0): supplicant management interface state: associating -> disconnected
2024-02-09T15:55:16.127030+01:00 THE_SYSTEM dbus-daemon[408]: [system] Activating via systemd: service name='org.freedesktop.nm_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service' by ':1.7' (uid=0 pid=464 comm="/usr/sbin/NetworkManager --no-daemon")
2024-02-09T15:55:16.131955+01:00 THE_SYSTEM systemd[1]: Starting systemd-rfkill.service - Load/Save RF Kill Switch Status...
2024-02-09T15:55:16.132823+01:00 THE_SYSTEM wpa_supplicant[466]: p2p-dev-wlan0: CTRL-EVENT-DSCP-POLICY clear_all
2024-02-09T15:55:16.133394+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490511.4073] device (wlan0): state change: activated -> unmanaged (reason 'removed', sys-iface-state: 'removed')
2024-02-09T15:55:16.134006+01:00 THE_SYSTEM wpa_supplicant[466]: nl80211: deinit ifname=p2p-dev-wlan0 disabled_11b_rates=0
2024-02-09T15:55:16.134607+01:00 THE_SYSTEM systemd[1]: Started systemd-rfkill.service - Load/Save RF Kill Switch Status.
2024-02-09T15:55:16.135081+01:00 THE_SYSTEM wpa_supplicant[466]: Could not read interface p2p-dev-wlan0 flags: No such device
2024-02-09T15:55:16.135460+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490511.5661] dhcp4 (wlan0): canceled DHCP transaction
2024-02-09T15:55:16.135846+01:00 THE_SYSTEM wpa_supplicant[466]: wlan0: CTRL-EVENT-DSCP-POLICY clear_all
2024-02-09T15:55:16.136213+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490511.5662] dhcp4 (wlan0): activation: beginning transaction (timeout in 45 seconds)
2024-02-09T15:55:16.136627+01:00 THE_SYSTEM wpa_supplicant[466]: wlan0: CTRL-EVENT-DSCP-POLICY clear_all
2024-02-09T15:55:16.137041+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490511.5663] dhcp4 (wlan0): state changed no lease
2024-02-09T15:55:16.137420+01:00 THE_SYSTEM wpa_supplicant[466]: nl80211: deinit ifname=wlan0 disabled_11b_rates=0
2024-02-09T15:55:16.137816+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490512.1816] manager: NetworkManager state is now DISCONNECTED
2024-02-09T15:55:16.138267+01:00 THE_SYSTEM dbus-daemon[408]: [system] Successfully activated service 'org.freedesktop.nm_dispatcher'
2024-02-09T15:55:16.138653+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490512.5473] device (p2p-dev-wlan0): state change: disconnected -> unmanaged (reason 'removed', sys-iface-state:)
2024-02-09T15:55:16.139021+01:00 THE_SYSTEM systemd[1]: Starting NetworkManager-dispatcher.service - Network Manager Script Dispatcher Service...
2024-02-09T15:55:16.139361+01:00 THE_SYSTEM NetworkManager[464]: <info>  [1707490513.1219] radio killswitch /sys/devices/platform/soc/3f300000.mmcnr/mmc_host/mmc1/mmc1:0001/mmc1:0001:1/ieee8rfkill1 disappeared
2024-02-09T15:55:16.139691+01:00 THE_SYSTEM systemd[1]: Started NetworkManager-dispatcher.service - Network Manager Script Dispatcher Service.
2024-02-09T15:55:16.486698+01:00 THE_SYSTEM systemd[1]: systemd-rfkill.service: Deactivated successfully.
2024-02-09T15:55:26.279786+01:00 THE_SYSTEM systemd[1]: NetworkManager-dispatcher.service: Deactivated successfully.
2024-02-09T15:55:50.410130+01:00 THE_SYSTEM kernel: [86012.993684] mmc1: error -22 whilst initialising SDIO card
2024-02-09T15:55:50.470093+01:00 THE_SYSTEM kernel: [86013.053335] mmc1: queuing unknown CIS tuple 0xa0 [c0 ff 22 00 81 c0 50 7b ff ac 63 63 30 68 00 82 e5 00 5c f1 81 00 c4 78] (24 bytes)
2024-02-09T15:55:50.562114+01:00 THE_SYSTEM kernel: [86013.144921] mmc1: queuing unknown CIS tuple 0x4b [89 ff 8c 4f f1 e1 0c ff 41 0c 19 ff 01 ad 05 92 fc 5b 01 6b 40 ca 44 10 fd ff ff 19 0 27 ff 30 e3 49 0f a4 b0 32 99 84 b4 28 60 ff 7b 92 c6 29 f8 ff 88 7a d2 3c 43 01 96 91 00 37 c3] (213 bytes)
2024-02-09T15:55:50.606112+01:00 THE_SYSTEM kernel: [86013.188448] mmc1: queuing unknown CIS tuple 0xf1 [ff b5 e4 41 aa 10 b9 28 e4 a6 44 25 36 e9 86 30 e2 ff cc 21 6f 3b b0 06 ee 4d 59 86 e 18 89 88 ed 29 04 6a 35 93 88 ed ff 79 ff ff 25 b3 10 55 30 09 a0 3e 18 91 39 12 d3 34 00 01 11] (100 bytes)
2024-02-09T15:55:50.666104+01:00 THE_SYSTEM kernel: [86013.251523] mmc1: queuing unknown CIS tuple 0xe2 [1e 06 57 87 12 ff 56 9c 6d f9 cf 80 26 2c ee e2 37 13 9b 02 28 21 11 98 0b 7f 94 f5 8 29 30 04 58 4b 38 67 00 21 5a 96 ff 50 0a 33 02 f6 4f ab 4c 3f 24 a0 00 00 00 00 00 00 00 00 00] (156 bytes)
2024-02-09T15:56:41.470106+01:00 THE_SYSTEM kernel: [86064.053602] mmc1: error -22 whilst initialising SDIO card
2024-02-09T15:56:41.538097+01:00 THE_SYSTEM kernel: [86064.122288] mmc1: queuing unknown CIS tuple 0xa0 [c0 ff 22 00 81 c0 50 7b ff ac 63 63 30 68 00 82 e5 00 5c f1 81 00 c4 78] (24 bytes)
2024-02-09T15:56:41.674124+01:00 THE_SYSTEM kernel: [86064.258093] mmc1: queuing unknown CIS tuple 0x4b [89 ff 8c 4f f1 e1 0c ff 41 0c 19 ff 01 ad 05 92 fc 5b 01 6b 40 ca 44 10 fd ff ff 19 0 27 ff 30 e3 49 0f a4 b0 32 99 84 b4 28 60 ff 7b 92 c6 29 f8 ff 88 7a d2 3c 43 01 96 91 00 37 c3] (213 bytes)
2024-02-09T15:56:41.734140+01:00 THE_SYSTEM kernel: [86064.318206] mmc1: queuing unknown CIS tuple 0xf1 [ff b5 e4 41 aa 10 b9 28 e4 a6 44 25 36 e9 86 30 e2 ff cc 21 6f 3b b0 06 ee 4d 59 86 e 18 89 88 ed 29 04 6a 35 93 88 ed ff 79 ff ff 25 b3 10 55 30 09 a0 3e 18 91 39 12 d3 34 00 01 11] (100 bytes)
2024-02-09T15:56:41.826133+01:00 THE_SYSTEM kernel: [86064.410295] mmc1: queuing unknown CIS tuple 0xe2 [1e 06 57 87 12 ff 56 9c 6d f9 cf 80 26 2c ee e2 37 13 9b 02 28 21 11 98 0b 7f 94 f5 8 29 30 04 58 4b 38 67 00 21 5a 96 ff 50 0a 33 02 f6 4f ab 4c 3f 24 a0 00 00 00 00 00 00 00 00 00] (156 bytes)
2024-02-09T15:57:05.182116+01:00 THE_SYSTEM kernel: [86087.764894] Bluetooth: hci1: Opcode 0x2042 failed: -32
2024-02-09T15:57:05.182174+01:00 THE_SYSTEM kernel: [86087.764933] Bluetooth: hci1: Unable to disable scanning: -32
2024-02-09T15:57:55.818158+01:00 THE_SYSTEM kernel: [86138.403063] mmc1: error -22 whilst initialising SDIO card
2024-02-09T15:57:55.910097+01:00 THE_SYSTEM kernel: [86138.493660] mmc1: queuing unknown CIS tuple 0xa0 [c0 ff 22 00 81 c0 50 7b ff ac 63 63 30 68 00 82 e5 00 5c f1 81 00 c4 78] (24 bytes)
2024-02-09T15:57:56.154108+01:00 THE_SYSTEM kernel: [86138.739530] mmc1: queuing unknown CIS tuple 0x4b [89 ff 8c 4f f1 e1 0c ff 41 0c 19 ff 01 ad 05 92 fc 5b 01 6b 40 ca 44 10 fd ff ff 19 0 27 ff 30 e3 49 0f a4 b0 32 99 84 b4 28 60 ff 7b 92 c6 29 f8 ff 88 7a d2 3c 43 01 96 91 00 37 c3] (213 bytes)
2024-02-09T15:57:56.270106+01:00 THE_SYSTEM kernel: [86138.856355] mmc1: queuing unknown CIS tuple 0xf1 [ff b5 e4 41 aa 10 b9 28 e4 a6 44 25 36 e9 86 30 e2 ff cc 21 6f 3b b0 06 ee 4d 59 86 e 18 89 88 ed 29 04 6a 35 93 88 ed ff 79 ff ff 25 b3 10 55 30 09 a0 3e 18 91 39 12 d3 34 00 01 11] (100 bytes)
2024-02-09T15:57:56.450112+01:00 THE_SYSTEM kernel: [86139.035599] mmc1: queuing unknown CIS tuple 0xe2 [1e 06 57 87 12 ff 56 9c 6d f9 cf 80 26 2c ee e2 37 13 9b 02 28 21 11 98 0b 7f 94 f5 8 29 30 04 58 4b 38 67 00 21 5a 96 ff 50 0a 33 02 f6 4f ab 4c 3f 24 a0 00 00 00 00 00 00 00 00 00] (156 bytes)

Trying now the solution from Krautmaster #1768 (comment)

 dmesg | grep Firmware:
[   10.818513] brcmfmac: brcmf_c_preinit_dcmds: Firmware: BCM43430/2 wl0: Oct  9 2020 14:44:32 version 9.88.4.65 (test) (f149b32@shgit)  (r679549) FWID 01-f40f3270

Current orignal firmware is from
dmesg | grep Firmware:
[ 10.975778] brcmfmac: brcmf_c_preinit_dcmds: Firmware: BCM43430/2 wl0: Mar 31 2022 17:24:51 version 9.88.4.77 (g58bc5cc) FWID 01-3b307371

So the firmware that seems to work is ~1 year before official release of RPI 2 W...

@OlSteph
Copy link

OlSteph commented Jun 23, 2024

Hello,
i too reverted the firmware 45 days ago and the Pi is up and running, never runs so long without cold restart.
Trying now the solution from Krautmaster #1768 (comment)
-> This is what i did too.

Edit: Uptime now 81 Days
Edit2: Uptime now 187 Days

@tarikgraba
Copy link

Same issue here:

  • version 9.88.4.77 -> WPA2 Enterprise authentication fails
  • version 9.88.4.65 -> seems ok

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests