-
Notifications
You must be signed in to change notification settings - Fork 52
Pre Release Checklist
Chris L edited this page Dec 3, 2023
·
48 revisions
Things to test before publishing a new release. Those are mainly things that are hard/impossible to catch via automated testing because they actually need the real hardware to run on.
- Check that a hint about supported browsers is shown in Firefox
- Check that a hint about supported browsers is shown in Brave
- Check that Browser information is shown in the logs
- Clear application cache in browser
- Check that language is automatically detected
- Make sure cookie banner is displayed
- Make sure language selection is saved between reloads
- Make sure cookie banner is not displayed after accepting
- Flash latest version of BLHeli_S (as a Baseline for testing)
- Flash Bluejay via Dropdown (latest stable version)
- Change settings - write, read, disconnect, read again
- Flash different version of Bluejay, make sure settings are migrated
- Flash a single ESC > 1. Make sure information is updated accordingly
- Make sure melody editor is playing melodies and highlighting notes properly
- Change melody to a long melody, disconnect
- Make sure reading fails with a proper error message while melody is playing
- Make sure reading settings works after melody finishes playing
- Enable pre-releases in settings, make sure that pre-releases are shown (if applicable)
- Flash pre-release (if applicable)
- Check that blacklisted versions are not available for flashing (<=0.8)
- Flash a local version of Bluejay
- Make sure that it is not possible to flash a wrong layout
- Make sure no settings are migrated from Bluejay
- Disable common settings
- Change common settings
- Enable common settings and make sure common settings are shown out of sync
- Restore default settings
- Flash mistagged BlHeli_S firmware and make sure that it is recognized as such
- Check mistagged error message when selecting image to flash
- Check that battery voltage is shown
- Spin up all motors
- Spin up a single motor
- Verify that motors stop spinning when disconnecting via button
- Check that sliders are working
- Enable advanced settings
- Verify that dumping firmware is possible (resulting in a hex file)
- Change settings / flash different Bluejay version
- Flash back the previously dumped hex file
- Verify that an ESC with the "FLASH*FAILED" status is still shown in the listing and can be recovered
- Verify that L Type MCUs are not detected as mistagged with BLHeli_S flashed
- Verify that JESC is properly detected and an unsupported message is shown
- Verify that settings can be read
- Check that blacklisted versions are not available for flashing
- Flash oldest available firmware
- Check that settings can be changed and saved
- Check that restoring the default settings works
- Flash latest bootloader updater
- Make sure hint is shown to flash the firmware (TODO)
- Enable pre-releases
- Flash latest firmware
- Check that melody editor is enabled
- Check that melody is playing
- Check that a different melody can be written
- Check that settings can be changed and saved
- Verify that dumping firmware is possible
- Check that battery voltage is shown
- Spin up all motors
- Spin up a single motor
- Check that sliders are working
- Read with latest offline tool
- Check that the settings match what was set with esc-configurator
- Write settings with offline tool
- Check that settings match with what was written with the offline tool
- Create new release branch
- Check that changelog contains all major changes
- Bump all version numbers
- Run test suit for a last time
- Publish release
- Check on prod