-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update CI workflows for E2E tests #13722
Closed
lukaszcl
wants to merge
129
commits into
develop
from
TT-1297-Create-nightly-pipeline-for-all-e2e-tests-in-core
Closed
Update CI workflows for E2E tests #13722
lukaszcl
wants to merge
129
commits into
develop
from
TT-1297-Create-nightly-pipeline-for-all-e2e-tests-in-core
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
add nightly pipeline add check tool that will be executed in PRs if a test from integration-tests is added or modified. It will report a comment or block pipeline requiring test to be added to the nightly workflow
lukaszcl
force-pushed
the
TT-1297-Create-nightly-pipeline-for-all-e2e-tests-in-core
branch
from
July 1, 2024 11:12
602d740
to
0fbedb7
Compare
lukaszcl
force-pushed
the
TT-1297-Create-nightly-pipeline-for-all-e2e-tests-in-core
branch
from
July 1, 2024 11:16
0fbedb7
to
fe07752
Compare
lukaszcl
force-pushed
the
TT-1297-Create-nightly-pipeline-for-all-e2e-tests-in-core
branch
from
July 1, 2024 11:18
fe07752
to
d6fe746
Compare
lukaszcl
force-pushed
the
TT-1297-Create-nightly-pipeline-for-all-e2e-tests-in-core
branch
from
July 1, 2024 11:22
d6fe746
to
6fbd4f5
Compare
lukaszcl
force-pushed
the
TT-1297-Create-nightly-pipeline-for-all-e2e-tests-in-core
branch
from
July 1, 2024 11:25
6fbd4f5
to
3550114
Compare
lukaszcl
force-pushed
the
TT-1297-Create-nightly-pipeline-for-all-e2e-tests-in-core
branch
from
July 1, 2024 11:41
3550114
to
afad909
Compare
lukaszcl
force-pushed
the
TT-1297-Create-nightly-pipeline-for-all-e2e-tests-in-core
branch
from
July 1, 2024 11:55
afad909
to
66531cd
Compare
lukaszcl
force-pushed
the
TT-1297-Create-nightly-pipeline-for-all-e2e-tests-in-core
branch
from
July 1, 2024 11:56
66531cd
to
8108ec6
Compare
lukaszcl
force-pushed
the
TT-1297-Create-nightly-pipeline-for-all-e2e-tests-in-core
branch
from
July 1, 2024 12:00
8108ec6
to
3dd4e8b
Compare
lukaszcl
force-pushed
the
TT-1297-Create-nightly-pipeline-for-all-e2e-tests-in-core
branch
from
July 1, 2024 12:01
3dd4e8b
to
2d0ae2b
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR introduces a Reusable GitHub Workflow for E2E tests, centralizing all the necessary logic to run various types of tests—such as Docker and K8s remote runner—within a single workflow. This approach allows other E2E test workflows to utilize this central workflow at different stages of the software development process, whether it's for every commit, within the merge queue, nightly, or on-demand.
The workflow sources the tests to run from the .github/e2e-tests.yml file, where each test or group of tests is defined with specific parameters:
test-cmd
to dictate how to execute the test,runs-on
to specify the required GitHub runner, and aworkflows
parameter that outlines when each test should be executed (e.g., on every pull request or nightly).The run-e2e-tests-reusable-workflow.yml workflow can be utilized in various ways:
test_ids
input to run specific tests. For example, see the run-selected-e2e-tests.yml workflow.test_workflow
input to run all tests associated with a particular workflow. For example, see the run-nightly-e2e-tests.yml workflow.test_list
input. For example, see the run-automation-ondemand-e2e-tests.yml workflow.To learn more about new CI Workflows for E2E Tests, please visit https://smartcontract-it.atlassian.net/wiki/spaces/TT/pages/815497220/CI+Workflows+for+E2E+Tests
Note: This update does not affect existing workflows for now. Changes to integrate existing workflows with this new setup will be addressed in separate PRs. More details are provided below.
Full scope of this PR:
workflows
field in .github/e2e-tests.yml file. Example build.require_chainlink_image_versions_in_qa_ecr
andrequire_chainlink_plugin_versions_in_qa_ecr
workflow inputsNot in the scope:
test_config_base64_override
as workflow input. This will be enabled onceTestConfig
does not have any secrets. Related ticket https://smartcontract-it.atlassian.net/browse/TT-1283