Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automated release verification #60

Open
vreynolds opened this issue Oct 5, 2021 · 0 comments
Open

Automated release verification #60

vreynolds opened this issue Oct 5, 2021 · 0 comments
Labels
type: maintenance The necessary chores to keep the dust off.

Comments

@vreynolds
Copy link
Contributor

Release 10.0.0 had some issues

As a future-proofing measure to catch broken layer versions before customers, add a verification step after the aws publish-layer-version step (layer versions are relatively cheap, so not worth it to set up a pre-release infrastructure at this point).

Non-directive ideas:

  • we can have a test lambda function in our telemetry-sandbox account, configured to export telemetry (consider adding the function source and deploy code to a repo, so it's easy to re-create if necessary)
  • as a follow-up to the publish-aws job, we add a job that updates the layer on the test function to the new version
  • we invoke the test function a few times
  • we verify that honeycomb received data within some timeout window but curling the query data API
@vreynolds vreynolds added the type: maintenance The necessary chores to keep the dust off. label Oct 5, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: maintenance The necessary chores to keep the dust off.
Projects
None yet
Development

No branches or pull requests

1 participant