Add moonwall integration tests #1194

Chralt98 · 2023-11-29T12:38:38Z

What does it do?

It adds integration tests for our parachain setup and current live chains (main-net and battery-station) and uses those in our CI.

What important points should reviewers know?

This PR depends on #1192

Is there something left for follow-up PRs?

What alternative implementations were considered?

Are there relevant PRs or issues?

References

Chralt98 · 2023-12-11T15:47:39Z

Don't forget to add your tests to the CI.

codecov-commenter · 2023-12-14T12:26:18Z

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (b6922bd) 93.25% compared to head (5bd843a) 93.25%.
Report is 3 commits behind head on chralt98-add-integration-tests.

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@                       Coverage Diff                       @@
##           chralt98-add-integration-tests    #1194   +/-   ##
===============================================================
  Coverage                           93.25%   93.25%           
===============================================================
  Files                                 121      121           
  Lines                               34162    34162           
===============================================================
  Hits                                31858    31858           
  Misses                               2304     2304

Flag	Coverage Δ
tests	`93.25% <ø> (ø)`

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

integration-tests/README.md

maltekliemann · 2024-01-21T18:33:13Z

integration-tests/README.md

+
+Useful for integration testing:
+
+- `./integration-tests/scripts/deploy-zombienet.sh` - Deploy a local relay-parachain network for zombienet.


Getting this on Ubuntu VM. I did call cargo build ...

What did you get?

Ooops, screenshot didn't load

You have the same error like previously. It's because you are missing the polkadot binary.

Can you try running the following first?

cd integration-tests ./scripts/download-polkadot.sh

Will add this to the documentation properly, if everything works fine on your side.

Ends on this. That's what it's supposed to look like?

Exactly what you can see there. It starts the network by spawning a zeitgeist node (alice) and two polkadot validators. You can do whatever you want on polkadot js now.

maltekliemann · 2024-01-21T18:39:54Z

integration-tests/README.md

+- `./integration-tests/scripts/deploy-zombienet.sh` - Deploy a local relay-parachain network for zombienet.
+- `pnpm chopsticks xcm -r polkadot -p ./configs/hydradx.yml -p ./configs/zeitgeist.yml` - Deploy a local relay-parachain fork network via chopsticks to test XCM.
+- `./integration-tests/scripts/deploy-zombienet.sh --test` - Run ZNDSL zombienet tests on a local relay-parachain network.
+- `pnpm exec moonwall test zombienet_zeitgeist_upgrade` - Test Zeitgeist runtime upgrade on zombienet for the local network.


Getting this on Ubuntu VM

This often takes a little bit longer. It's often on my machine too: fetching metrics...

So the fact that it says "Error" shouldn't concern me?

I can't do anything about it. It is just stated, because the nodes are not ready to fetch the metrics yet. It's because the nodes are still in the process of starting the metric endpoint.

Okay, we should add this to the README

maltekliemann · 2024-01-21T18:43:05Z

integration-tests/README.md

+- `./integration-tests/scripts/deploy_zombienet.sh --test` - Run ZNDSL zombienet tests on a local relay-parachain network.
+- `pnpm exec moonwall test chopsticks_zeitgeist_hydra_xcm_tests` - XCM Tests from Zeitgeist to HydraDX.
+- `pnpm exec moonwall test zombienet_zeitgeist_upgrade` - Test Zeitgeist runtime upgrade on zombienet for the local network.
+- `pnpm exec moonwall test chopsticks_zeitgeist_upgrade` - Test Zeitgeist runtime upgrade on chopsticks for the live network.


This one passes on the Linux VM.

add runtime upgrade integration tests

5ce5bd1

Chralt98 added the s:in-progress The pull requests is currently being worked on label Nov 29, 2023

Chralt98 self-assigned this Nov 29, 2023

Chralt98 added 6 commits December 6, 2023 12:28

update readme

56e4a8c

wip chopticks runtime upgrade test

e870647

prepare chopsticks battery station upgrade test

ca30c01

add chopsticks and sqlite3

9f941b1

chopsticks runs locally after python installation

bdc5143

battery station rt-upgrade works, but not main-net

8923038

Chralt98 added 12 commits December 12, 2023 14:31

fix zeitgeist chopsticks upgrade test

cd52bc2

add zndsl test to workflow

cc965e7

update integration test workflow

a365585

wip

e2b4b1b

update download polkadot

a69b61a

wip

d015679

wip

bf2e843

wip

0634057

wip

3b4ba2d

wip

793036a

wip

af2120b

use artifact storage in github actions

5846b71

Chralt98 added s:review-needed The pull request requires reviews s:in-progress The pull requests is currently being worked on and removed s:in-progress The pull requests is currently being worked on s:review-needed The pull request requires reviews labels Dec 14, 2023

use release instead of debug

4e38cd4

Chralt98 commented Dec 14, 2023

View reviewed changes

integration-tests/README.md Outdated Show resolved Hide resolved

update ci

6b4d57d

Chralt98 added s:review-needed The pull request requires reviews and removed s:in-progress The pull requests is currently being worked on labels Jan 8, 2024

Chralt98 requested a review from maltekliemann January 8, 2024 09:39

Chralt98 added 2 commits January 8, 2024 12:56

add copyrights

027b87d

mkdir integration-tests/tmp

5bd843a

Chralt98 added s:review-needed The pull request requires reviews and removed s:review-needed The pull request requires reviews labels Jan 8, 2024

sea212 added this to the v0.5.1 milestone Jan 10, 2024

maltekliemann reviewed Jan 21, 2024

View reviewed changes

maltekliemann approved these changes Feb 6, 2024

View reviewed changes

update integration test readme

6e574ff

mergify bot added s:in-progress The pull requests is currently being worked on and removed s:review-needed The pull request requires reviews labels Feb 7, 2024

Chralt98 added s:review-needed The pull request requires reviews and removed s:in-progress The pull requests is currently being worked on labels Feb 7, 2024

update gitignore

ecb38d1

mergify bot added s:in-progress The pull requests is currently being worked on and removed s:review-needed The pull request requires reviews labels Feb 9, 2024

Chralt98 mentioned this pull request Feb 9, 2024

Integrate Moonwall #1192

Merged

update download polkadot comment

4e41a90

Chralt98 added s:review-needed The pull request requires reviews s:in-progress The pull requests is currently being worked on and removed s:in-progress The pull requests is currently being worked on s:review-needed The pull request requires reviews labels Feb 9, 2024

Chralt98 merged commit 6240fe3 into chralt98-add-integration-tests Feb 9, 2024
15 of 22 checks passed

Chralt98 deleted the chralt98-add-it-tests branch February 9, 2024 12:17

sea212 added s:accepted This pull request is ready for merge and removed s:in-progress The pull requests is currently being worked on labels Feb 9, 2024

This was referenced Feb 22, 2024

Test runtime upgrades with Chopstick #915

Closed

Add workflow which verifies that the node is producing blocks #708

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add moonwall integration tests #1194

Add moonwall integration tests #1194

Chralt98 commented Nov 29, 2023 •

edited

Loading

Chralt98 commented Dec 11, 2023

codecov-commenter commented Dec 14, 2023 •

edited

Loading

maltekliemann Jan 21, 2024

Chralt98 Jan 22, 2024

maltekliemann Jan 22, 2024

Chralt98 Jan 22, 2024 •

edited

Loading

maltekliemann Jan 23, 2024

Chralt98 Jan 23, 2024

Chralt98 Feb 7, 2024

maltekliemann Jan 21, 2024

Chralt98 Jan 22, 2024

maltekliemann Jan 22, 2024

Chralt98 Jan 22, 2024

maltekliemann Jan 23, 2024

Chralt98 Feb 7, 2024

maltekliemann Jan 21, 2024


		Useful for integration testing:

		- `./integration-tests/scripts/deploy-zombienet.sh` - Deploy a local relay-parachain network for zombienet.

Add moonwall integration tests #1194

Add moonwall integration tests #1194

Conversation

Chralt98 commented Nov 29, 2023 • edited Loading

What does it do?

What important points should reviewers know?

Is there something left for follow-up PRs?

What alternative implementations were considered?

Are there relevant PRs or issues?

References

Chralt98 commented Dec 11, 2023

codecov-commenter commented Dec 14, 2023 • edited Loading

Codecov Report

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Chralt98 Jan 22, 2024 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Chralt98 commented Nov 29, 2023 •

edited

Loading

codecov-commenter commented Dec 14, 2023 •

edited

Loading

Chralt98 Jan 22, 2024 •

edited

Loading