feat(fw): Implement execute command to run tests in live networks

[marioevz]

Requires

#822, #823, #824, #825, #826, #827

Will stay in draft until these requirements are merged.

🗒️ Description

Introduces the new command execute that allows to run tests in live networks when provided with enough funds to send test transactions.

execute Command

It includes two modes of executing tests.

Hive Local Network Mode

Run the tests in a local network instantiated using hive. The execute command drives the network by use of the Engine API and does not require a consensus client.

Remote RPC Network Mode

Run the tests on a live network by sending the transactions using the JSON RPC endpoint of an execution client connected to the network.

The command requires a private key with funds to be specified by using a parameter (--rpc-seed-key).

For more information see the included doc page: https://github.com/ethereum/execution-spec-tests/pull/686/files#diff-39b858dd04aa8508cf00fe9dafe46936865a8a3cded669a628c8ee1556b6cee1

New Test Markers

Included in this PR there are two new markers which can aid to mark tests with specific behavior on execute and fill modes.

pytest.mark.fill, pytest.mark.execute

These marks accept any number of markers as arguments which will be applied to the tests in the respective mode.

For example:

@pytest.mark.execute(pytest.mark.skip(reason="excessive amount of balance required"))

for tests that cannot be executed on a live network due to balance requirements.

🔗 Related Issues

None.

✅ Checklist

• All: Set appropriate labels for the changes.
• All: Considered squashing commits to improve commit history.
• All: Added an entry to CHANGELOG.md.
• All: Considered updating the online docs in the ./docs/ directory.
• Tests: All converted JSON/YML tests from ethereum/tests have been added to converted-ethereum-tests.txt.
• Tests: A PR with removal of converted JSON/YML tests from ethereum/tests have been opened.
• Tests: Included the type and version of evm t8n tool used to locally execute test cases: e.g., ref with commit hash or geth 1.13.1-stable-3f40e65.
• Tests: Ran mkdocs serve locally and verified the auto-generated docs for new tests in the Test Case Reference are correctly formatted.

[marioevz]

Hi @danceratopz @spencer-tb this has been rebased on top of main and I think is ready for review.

One thing that could be missing is the changes to existing tests to add markers or make the tests more execute-friendly, but that would add many files to this PR (I have a commit on other branch). Should that be on a different PR for easier review?

[danceratopz]

One thing that could be missing is the changes to existing tests to add markers or make the tests more execute-friendly, but that would add many files to this PR (I have a commit on other branch). Should that be on a different PR for easier review?

@marioevz Let's get this merged without getting hung up on running with existing tests and handle that in a subsequent PR 🚀

[spencer-tb]

LGTM!

[danceratopz]

Let's get this merged!