Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run nightly tests to have a chance detecting flakiness #37

Closed
invidian opened this issue Jan 15, 2021 · 2 comments
Closed

Run nightly tests to have a chance detecting flakiness #37

invidian opened this issue Jan 15, 2021 · 2 comments
Labels
kind/feature Categorizes issue or PR as related to a new feature. priority/backlog Higher priority than priority/awaiting-more-evidence.

Comments

@invidian
Copy link

Expected Behaviour

Every day e2e tests runs to ensure everything is functioning as expected.

Current Behaviour

Currently, some users may hit things like tinkerbell/osie#183, which does not happen all the time.

Possible Solution

Configure GitHub Action to run every night, so build fails are reported via email.

@tstromberg tstromberg added kind/feature Categorizes issue or PR as related to a new feature. priority/backlog Higher priority than priority/awaiting-more-evidence. labels Aug 27, 2021
@tstromberg
Copy link
Contributor

Seems reasonable. My concern here is that folks will just ignore the flake e-mails. The next extension from here is automatic issue opening.

@jacobweinstock
Copy link
Member

Unfortunately at the moment manual testing is all that @chrisdoherty4 and I are able to provide. A roadmap item has been opened for discussion and community help. tinkerbell/roadmap#32

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/feature Categorizes issue or PR as related to a new feature. priority/backlog Higher priority than priority/awaiting-more-evidence.
Projects
None yet
Development

No branches or pull requests

3 participants