Release 0.9.8
Release Note π
This release is a step towards stability of the tests. We keep climbing the mountain. Whereas it's still uncertain why some of the tests are failing on runners (locally they do pass). Some bullet points on release
- Removing workflow dependency on Smoke test suite. With reusable workflows this does not work properly in the EVE repository. The other test suites are triggered regardless of the outcome of Smoke tests. The only effect this dependency has, is that other workflows are delayed from starting until Smoke tests finish, increasing the total execution time of all tests.
- Moving tests that depend on virtualization (apps must be deployed inside VMs) to a separate test suite. The primary reason is that the HW-assisted nested virtualization is performing poorly on the buildjet runners and we are getting many failures (not related to EVE code). For every other test it is therefore better to run EVE with acceleration disabled. A secondary reason is that most of these tests are from the networking test suite, which is already quite long and takes well over an hour to execute. It therefore makes sense to move some tests to a different test suite. Please note that when the Virtualization test suite is run locally, all tests are passing. However, on buildjet runners they are expected to fail until we resolve the issue with the nested virtualization.
- Fixes in timeouts and app states in various tests
- Test publish_location is now skipped and likely will be removed. This is because after the recent changes in the EVE/wwan microservice, injecting a fake GPS location data is no longer possible.
- Modified EVE-upgrade tests to use newer base EVE version (> 12.0). This is because the policy_version of fscrypt was bumped from 1 to 2 and this change is not backward compatible. Meaning we cannot downgrade from 12.X to 11.Y or older.
- Introducing telemetry action in Eden test suit to get better inside on how tests are consuming runners' resources
Stay tuned to find out what was the real problem with virtualisation tests suite!
Improvements π
- GitHub Actions: Integrate telemetry action by @uncleDecart in #984
- Update go-containerregistry dependency by @giggsoff in #982
Dependabot bumps:
Bug fixes π
- Increase memory available for EVE-OS in EdenGCP tests by @giggsoff in #983
- Fix failing eden tests by @milan-zededa in #986
Technical details π§βπ»:
- EVE version: 12.4.0
Full Changelog: 0.9.7...0.9.8