Add Wi-Fi firmware partition support for Pico 2 W #1969

will-v-pi · 2024-10-03T13:45:49Z

This adds the ability to store and load the Wi-Fi firmware for Pico 2 W in a partition. It can be enabled by adding pico_use_partition_firmware(<exe_name>) to your CMakeLists.txt, which will embed a compatible partition table in the binary, and output lots of firmware UF2s to use (all called <exe_name>_firmware_..._.uf2, eg ..._firmware_w for Wi-Fi only, ..._firmware_wb for Wi-Fi and Bluetooth, ..._firmware_w_tbyb for TBYB). You can also create your own partition table and use that.

A Wi-Fi firmware partition is detected as having the ID 0x123456789abcdef0, and the UF2 family_is for Wi-Fi firmware blobs is 0x12345678 - these should probably both be changed to something else before merging? The default firmware partition starts at 3500K into the flash - should this be changed to depend on PICO_FLASH_SIZE_BYTES? The default firmware partition is also duplicated with A/B partitions in the same location in flash - this is required to ensure a signature check is performed before loading the Wi-Fi firmware, as there's no way to call the bootrom to check the signature of a single partition (unless chaining into it), you can only call pick_ab_partition.

The Wi-Fi firmware blob is marked in it's image_def as an RP2350 Risc-V executable, and the partition is marked as ignored_during_riscv_boot - this ensures that it can work with TBYB (as TBYB only works for executable image_defs), and that signature checks are performed before loading the firmware when Secure Boot is enabled (because signature checks are performed for all executable image_defs in a partition that is not marked ignored_during_arm_boot). This is slightly clunky, but seems to work robustly.

Supercedes #1850, as it now includes that function in this PR, and shows a use for it.

lurch · 2024-10-03T14:53:10Z

pinging @peterharperuk as he did a lot of the Wifi-related stuff for Pico 1.

src/rp2_common/pico_cyw43_driver/CMakeLists.txt

src/rp2_common/pico_cyw43_driver/cyw43_driver.c

peterharperuk · 2024-11-19T15:02:37Z

Works nicely. I think we need to fix the Pico W (rp2040) build errors in src/rp2_common/pico_cyw43_driver/cyw43_driver.c
It would be nice if it gave an error if you're a numpty like me and put pico_use_partition_firmware after pico_add_extra_outputs, but that could be improved later?

will-v-pi · 2024-11-19T15:13:40Z

It would be nice if it gave an error if you're a numpty like me and put pico_use_partition_firmware after pico_add_extra_outputs, but that could be improved later?

Have added in separate PR #2054

will-v-pi · 2024-11-19T15:28:41Z

I think we need to fix the Pico W (rp2040) build errors in src/rp2_common/pico_cyw43_driver/cyw43_driver.c

I've added a check that it's not RP2040 in the CMake function, so it'll throw a fatal error at that point if you try to build a binary with pico_use_partition_firmware for RP2040

armandomontanez · 2024-11-19T16:46:37Z

If the Bazel checks are getting in your way, you can add the two new files to a filegroup (which will silence the error) and file an issue+leave a TODO to support this in Bazel and assign it to me.

peterharperuk

Tested this and it seems good.

src/rp2_common/pico_bootrom/include/pico/bootrom.h

will-v-pi · 2024-11-19T17:10:45Z

If the Bazel checks are getting in your way, you can add the two new files to a filegroup (which will silence the error) and file an issue+leave a TODO to support this in Bazel and assign it to me.

Thanks, have done - I couldn't actually assign the issue to you, but have tagged you in it

src/rp2_common/pico_bootrom/include/pico/bootrom.h

lurch · 2024-11-19T23:01:56Z

A Wi-Fi firmware partition is detected as having the ID 0x123456789abcdef0, and the UF2 family_is for Wi-Fi firmware blobs is 0x12345678 - these should probably both be changed to something else before merging?

Is that still going to be happening? I guess choosing randomly-generated IDs is much less likely to produce an accidental collision than a "nice" ID like 0x123456789abcdef0 ? And should those IDs be added to a header-file, to allow other UF2s to make use of this Wi-Fi firmware partition?

will-v-pi · 2024-11-20T10:57:11Z

A Wi-Fi firmware partition is detected as having the ID 0x123456789abcdef0, and the UF2 family_is for Wi-Fi firmware blobs is 0x12345678 - these should probably both be changed to something else before merging?

Is that still going to be happening? I guess choosing randomly-generated IDs is much less likely to produce an accidental collision than a "nice" ID like 0x123456789abcdef0 ? And should those IDs be added to a header-file, to allow other UF2s to make use of this Wi-Fi firmware partition?

Yes - I was looking for ideas. We could go with 0x776966696669726d (hex for wififirm) for the partition ID, and just use the data family_id we already have?

lurch · 2024-11-20T12:45:17Z

src/rp2_common/pico_bootrom/include/pico/bootrom.h

+ * It requires the same minimum workarea size as `rom_pick_ab_partition`.
 * 
- * Also checks that the chosen partition contained a valid image
+ * For example, if an `explicit_buy` is pending then calling `pick_ab_partition` would normally clear the saved `flash_erase_addr` so the required erase would not


This doxygen mentions both rom_pick_ab_partition and pick_ab_partition - are they referring to the same function or are they different?

rom_… is the SDK function wrapper for the pick_ab_partition function - so I was using that to refer to it in the SDK (ie the function this calls internally, and where more docs are), but using pick_ab_partition to refer to the behaviour of the underlying bootrom function

src/rp2_common/pico_bootrom/include/pico/bootrom.h

lurch · 2024-11-20T13:06:44Z

Yes - I was looking for ideas. We could go with 0x776966696669726d (hex for wififirm) for the partition ID, and just use the data family_id we already have?

I've got no opinions on this so it's probably something that you and @peterharperuk ought to decide. Would MicroPython be able to use the same Wifi firmware partition as C-SDK code? (or is that another one of my stupidly naive questions? 😆 )

kilograham · 2024-11-21T17:47:26Z

src/rp2_common/pico_bootrom/bootrom.c

+// printf("IMAGE_DEF_TBYB_FLAGGED %08x\n", (uint32_t)&(scan_workarea->parsed_block_loops[0].image_def.core.tbyb_flagged) - (uint32_t)scan_workarea);
+// printf("IMAGE_DEF_BASE %08x\n", (uint32_t)&(scan_workarea->parsed_block_loops[0].image_def.core.enclosing_window.base) - (uint32_t)scan_workarea);
+// printf("IMAGE_DEF_REL_BLOCK_OFFSET %08x\n", (uint32_t)&(scan_workarea->parsed_block_loops[0].image_def.core.window_rel_block_offset) - (uint32_t)scan_workarea);
+#define VERSION_DOWNGRADE_ERASE_ADDR *(uint32_t*)0x400e0338


arguably these are not addresses. i would leave the leading * off and use in code references

Technically they are addresses, eg the version downgrade erase address (ie the address in flash to erase) is stored at 0x400e0338

Page 31 of the RP2350 datasheet says BOOTRAM_BASE 0x400e0000

yeah, more of a stylistic thing I guess; it's weird to see a CONSTANT as a lhs

kilograham · 2024-11-21T23:12:05Z

src/rp2_common/pico_bootrom/include/pico/bootrom.h

@@ -1071,6 +1071,29 @@ static inline int rom_get_last_boot_type(void) {
 */
 int rom_add_flash_runtime_partition(uint32_t start_offset, uint32_t size, uint32_t permissions);

+/*! \brief  Pick A/B partition with TBYB guards


I still find the function description a bit confusing:

maybe something along the lines of "Pick A/B partition for an arbitrary pair of partitions without disturbing any in process update A/B or TBYB boot" (needs improvement still)...

not sure people know what a flash_erase_addr is maybe describe it in words (e.g. the erase of xxx because yyy"

I'd say "using the flash_update_boot_window_base from the current boot"

I think "Pick A/B partition without disturbing any in progress update or TBYB boot" works for the description - pick_ab_partition is always for an arbitrary pair of partitions, so that probably doesn't need including in the description?

Ah, I was (wrongly) thinking this new API existed because pick_ab_partition was for the regular boot partitions, rather than because that API is somewhat broken. Perhaps just add a warning to the other API referencing this one

src/rp2_common/pico_cyw43_driver/cyw43_driver.c

src/rp2_common/pico_cyw43_driver/CMakeLists.txt

src/rp2_common/pico_cyw43_driver/cyw43_driver.c

Enabled using the pico_use_partition_firmware(exe_name) cmake function

…ifi only firmware variants

…bootrom_headers

RP2040 does not support partitions, so throw fatal_error at the CMake stage

… family Adds CYW43_WIFI_FW_PARTITION_ID define to override the partition ID

Add copyright headers Put ptinfo buffer on the stack, and break when partition is found Improve function description

RCP mask constants still need to be accessed from Risc-V

will-v-pi · 2024-11-22T12:06:19Z

I've noticed an issue with the Risc-V build of the firmware UF2 - for some reason the compilation is putting a programme header in the ELF with offset of 0x0000 in the file loading to 0x1ffff000, when the Arm compiler correctly puts this at offset 0x1000 in the file loading to 0x20000000. @Wren6991 or @kilograham any ideas why the Arm and Risc-V compilers might be compiling the wifi_firmware.S file differently?

… CYW43_WIFI_FW_PARTITION_ID->CYW43_FIRMWARE_PARTITION_ID

The Risc-V compiler doesn't link the firmware blobs as expected, so use Arm ELFs instead

will-v-pi · 2024-11-22T17:39:25Z

I've now got it working for Risc-V by storing copies of the firmware ELFs in the SDK, and then copying those into the build when necessary. It also needs increased bootrom stack size. This is tested and working fine.

However, I'm not sure if this is actually a solution that we want to put in the 2.1.0 SDK release, so it might be best if we don't merge this for 2.1.0 and I can investigate further to fix the Risc-V firmware build?

… when in a flash update boot

will-v-pi requested a review from kilograham October 3, 2024 13:45

This was referenced Oct 3, 2024

Add TBYB safe rom_pick_ab_partition function #1850

Closed

Pico 2 W OTA Update Example raspberrypi/pico-examples#559

Draft

peterharperuk reviewed Oct 8, 2024

View reviewed changes

src/rp2_common/pico_cyw43_driver/CMakeLists.txt Outdated Show resolved Hide resolved

peterharperuk reviewed Oct 8, 2024

View reviewed changes

src/rp2_common/pico_cyw43_driver/CMakeLists.txt Outdated Show resolved Hide resolved

peterharperuk reviewed Oct 8, 2024

View reviewed changes

src/rp2_common/pico_cyw43_driver/cyw43_driver.c Outdated Show resolved Hide resolved

peterharperuk reviewed Oct 8, 2024

View reviewed changes

src/rp2_common/pico_cyw43_driver/cyw43_driver.c Show resolved Hide resolved

peterharperuk reviewed Oct 8, 2024

View reviewed changes

src/rp2_common/pico_cyw43_driver/cyw43_driver.c Outdated Show resolved Hide resolved

will-v-pi force-pushed the pico2-w-pts branch from d6121e9 to 508071f Compare October 15, 2024 16:36

will-v-pi marked this pull request as ready for review October 17, 2024 09:01

will-v-pi added this to the 2.0.1 milestone Oct 30, 2024

peterharperuk reviewed Nov 19, 2024

View reviewed changes

peterharperuk previously approved these changes Nov 19, 2024

View reviewed changes

will-v-pi dismissed peterharperuk’s stale review via 7cfcf04 November 19, 2024 16:58

will-v-pi mentioned this pull request Nov 19, 2024

[Bazel] Support storing Wi-Fi firmware in partitions #2055

Open

lurch reviewed Nov 19, 2024

View reviewed changes

src/rp2_common/pico_bootrom/include/pico/bootrom.h Show resolved Hide resolved

lurch reviewed Nov 19, 2024

View reviewed changes

src/rp2_common/pico_bootrom/include/pico/bootrom.h Outdated Show resolved Hide resolved

lurch reviewed Nov 20, 2024

View reviewed changes

src/rp2_common/pico_bootrom/include/pico/bootrom.h Outdated Show resolved Hide resolved

lurch reviewed Nov 20, 2024

View reviewed changes

src/rp2_common/pico_bootrom/include/pico/bootrom.h Outdated Show resolved Hide resolved

lurch reviewed Nov 20, 2024

View reviewed changes

src/rp2_common/pico_bootrom/include/pico/bootrom.h Outdated Show resolved Hide resolved

kilograham reviewed Nov 21, 2024

View reviewed changes

src/rp2_common/pico_cyw43_driver/cyw43_driver.c Outdated Show resolved Hide resolved

kilograham reviewed Nov 21, 2024

View reviewed changes

src/rp2_common/pico_cyw43_driver/CMakeLists.txt Outdated Show resolved Hide resolved

kilograham reviewed Nov 21, 2024

View reviewed changes

src/rp2_common/pico_cyw43_driver/cyw43_driver.c Outdated Show resolved Hide resolved

will-v-pi added 14 commits November 22, 2024 10:31

Add rom_pick_ab_update_partition function

a4d28d2

Fix TBYB flag - it's bool, not uint32_t

f35fdb9

Add partitions for Wi-Fi firmware

8d258a8

Enabled using the pico_use_partition_firmware(exe_name) cmake function

Use common scope var for PICO_CYW43_DRIVER_CURRENT_PATH, and remove w…

8e570b9

…ifi only firmware variants

Use FLASH_SECTOR_SIZE instead of 4096

0e26b2b

Attempt to fix bazel build in same way as pico_flash works with pico_…

b3f0071

…bootrom_headers

Throw FATAL_ERROR when using RP2040

cf61a17

RP2040 does not support partitions, so throw fatal_error at the CMake stage

Add new sources to bazel filegroup

9d9e1f9

Add Bazel todo referencing raspberrypi#2055

7ba5fa9

Improve rom_pick_ab_update_partition description

639e0c4

Fix docs typos, add \see, and rename brief

80fc3ce

Change partition ID to 0x776966696669726d (wififirm) and use data UF2…

85f1105

… family Adds CYW43_WIFI_FW_PARTITION_ID define to override the partition ID

Review feedback

cea9802

Add copyright headers Put ptinfo buffer on the stack, and break when partition is found Improve function description

Fix Risc-V build

1e7e0c7

RCP mask constants still need to be accessed from Risc-V

will-v-pi force-pushed the pico2-w-pts branch from f7952f2 to 1e7e0c7 Compare November 22, 2024 11:00

Rename CYW43_USE_PARTITION_FIRMWARE->CYW43_USE_FIRMWARE_PARTITION and…

f2511a9

… CYW43_WIFI_FW_PARTITION_ID->CYW43_FIRMWARE_PARTITION_ID

will-v-pi force-pushed the pico2-w-pts branch from 1792796 to f2511a9 Compare November 22, 2024 12:09

will-v-pi added 2 commits November 22, 2024 17:24

Use hard copies of the firmware for Risc-V builds

1e8324a

The Risc-V compiler doesn't link the firmware blobs as expected, so use Arm ELFs instead

Requires increased bootrom stack size on Risc-V

9730601

will-v-pi modified the milestones: 2.1.0, 2.2.0 Nov 22, 2024

will-v-pi added 2 commits November 22, 2024 17:46

pico_use_partition_firmware -> pico_use_wifi_firmware_partition

cfd0c34

Add note to rom_pick_ab_partition to see rom_pick_ab_update_partition…

def9608

… when in a flash update boot

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add Wi-Fi firmware partition support for Pico 2 W #1969

Add Wi-Fi firmware partition support for Pico 2 W #1969

will-v-pi commented Oct 3, 2024

lurch commented Oct 3, 2024

peterharperuk commented Nov 19, 2024

will-v-pi commented Nov 19, 2024

will-v-pi commented Nov 19, 2024

armandomontanez commented Nov 19, 2024 •

edited

Loading

peterharperuk left a comment

will-v-pi commented Nov 19, 2024

lurch commented Nov 19, 2024

will-v-pi commented Nov 20, 2024

lurch Nov 20, 2024

will-v-pi Nov 20, 2024

lurch commented Nov 20, 2024

kilograham Nov 21, 2024

will-v-pi Nov 21, 2024

lurch Nov 21, 2024

kilograham Nov 21, 2024

kilograham Nov 21, 2024

kilograham Nov 21, 2024

will-v-pi Nov 22, 2024

kilograham Nov 22, 2024

will-v-pi commented Nov 22, 2024

will-v-pi commented Nov 22, 2024

Add Wi-Fi firmware partition support for Pico 2 W #1969

Are you sure you want to change the base?

Add Wi-Fi firmware partition support for Pico 2 W #1969

Conversation

will-v-pi commented Oct 3, 2024

lurch commented Oct 3, 2024

peterharperuk commented Nov 19, 2024

will-v-pi commented Nov 19, 2024

will-v-pi commented Nov 19, 2024

armandomontanez commented Nov 19, 2024 • edited Loading

peterharperuk left a comment

Choose a reason for hiding this comment

will-v-pi commented Nov 19, 2024

lurch commented Nov 19, 2024

will-v-pi commented Nov 20, 2024

Choose a reason for hiding this comment

Choose a reason for hiding this comment

lurch commented Nov 20, 2024

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

will-v-pi commented Nov 22, 2024

will-v-pi commented Nov 22, 2024

armandomontanez commented Nov 19, 2024 •

edited

Loading