Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable trigger of cos_integration in PR #345

Merged
merged 1 commit into from
Nov 18, 2024

Conversation

rgildein
Copy link
Contributor

The cos_integration workflow should be triggered only by dispatch or, when the workflow was changed and not for all PR.

fixes: #344

The cos_integration workflow should be triggered only by dispatch or,
when the workflow was changed and not for all PR.

fixes: canonical#344

Signed-off-by: Robert Gildein <[email protected]>
@rgildein rgildein self-assigned this Nov 15, 2024
@rgildein rgildein marked this pull request as ready for review November 15, 2024 12:55
@rgildein rgildein requested a review from a team as a code owner November 15, 2024 12:55
Copy link
Contributor

@Deezzir Deezzir left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@samuelallan72 samuelallan72 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

From #344 :

The cos_integration.yaml is triggered during PR, however the integration test are not building charm locally.

Why not build the charm locally then so we can run the cos_integration tests on PRs? I don't understand the rationale for dropping the tests - it's important to run all CI tests on PRs to catch issues before they are merged.

Also, why does this not work currently when run on PRs, but does work on manual dispatch or weekly tests?

@rgildein
Copy link
Contributor Author

Why not build the charm locally then so we can run the cos_integration tests on PRs? I don't understand the rationale for dropping the tests - it's important to run all CI tests on PRs to catch issues before they are merged.

I think that this tests was designed to run only weekly, @jneo8 ? I'm ok to use builded charm for testing this with latest/stable channel. However, running it with latest/edge in PR is not good aproach, since it can easialy failed and halt the PR, so that's why I think tunning on latest/edge should by only done by weekly test.

Also, why does this not work currently when run on PRs, but does work on manual dispatch or weekly tests?

I think that there is some issue with new release of cos in latested/edge, which is blocking my other PR.

@aieri
Copy link
Contributor

aieri commented Nov 18, 2024

This integration test isn't testing the code in a pending PR, so it doesn't add value as a gate to merging. @rgildein is creating a separate issue to track adapting the test code to make it more appropriate for testing PRs

@aieri aieri dismissed samuelallan72’s stale review November 18, 2024 17:21

overriding to land this PR and unblock others - we can rediscuss this change internally though!

@rgildein rgildein merged commit 773876d into canonical:main Nov 18, 2024
9 of 10 checks passed
@rgildein rgildein deleted the chore/SOLENG-867/fix-ci branch November 18, 2024 17:31
@samuelallan72
Copy link
Contributor

This integration test isn't testing the code in a pending PR, so it doesn't add value as a gate to merging

Ah right, so it's only testing hardware-observer-operator from the charm store? That makes more sense for why it's a weekly test then.

@jneo8
Copy link
Contributor

jneo8 commented Nov 19, 2024

Note: The purpose of this test is to make sure the newest cos integration can work with hardware observer. Weekly is fine but the purpose is to remind someone to check with cos team to make sure we are on the path.

@rgildein
Copy link
Contributor Author

rgildein commented Nov 19, 2024

Note: The purpose of this test is to make sure the newest cos integration can work with hardware observer. Weekly is fine but the purpose is to remind someone to check with cos team to make sure we are on the path.

Yes, that purpose makes sense to me. What do you say about running it with PR and latest/stable and on weekly test we run it with latest/edge? Check this #349 issue.

BTW, Test are failing for almost a week, we need to investigate why.

@samuelallan72
Copy link
Contributor

samuelallan72 commented Nov 20, 2024

Note: The purpose of this test is to make sure the newest cos integration can work with hardware observer. Weekly is fine but the purpose is to remind someone to check with cos team to make sure we are on the path.

Could we add this purpose, and the fact that it tests hardware observer from the charm store (not from the repo), as a comment at least in the cos_integration.yaml file please? Otherwise we're bound to have this misunderstanding again.

@rgildein
Copy link
Contributor Author

There is an issue #349 for running these test in every PR, so for now comment is not needed. But I agree that's confusing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Cos integration tests are triggered in PR
5 participants