Test Automation for All available solutions on the new dashboard

[ramezsaeed]

Add automated tests for all solutions in dashboard.

• Tests must include ssh to the created solution.
• successful login if the solution has UI interface

[khaledyoussef24]

Wip

• added a new solutions page to the selenium
• Added a separate page for solutions (full vm and micro vm)
• On going automated test for deploying still working on verifying the deployment and asserting then will go to deleting.

[xmonader]

it should be scripted first (and added to integration tests)

[khaledyoussef24]

WIP
started in two automated tests but stuck in making them passing
(peertube , funk whale)

[khaledyoussef24]

work done:

• added scripts to all of the 12 soltuions
• domain generating still needs some fixing (tested on public ips)
• finished 5 solutions but could not test them freely due to lack of public ips and the planetary ip current issue and development to use mycellium.
• deployments are made without planetary ip #2107

WIP:
finishing the rest of the tests.
adding to ping the solutions through ip with time out to assert that the websites made.
tests left to be done

• owncloud
• presearch
• subsquid
• casperlabs
• node pilot
• umbrel
• wordpress

[khaledyoussef24]

work done : finished test and testing them to see if it works properly

[khaledyoussef24]

the new branch is ready for review
solved all the conflicts

[khaledyoussef24]

work done :

• added a http request to the test to check if the gateway deployed right.
• added mycelium flag to the tests and scripts.
• the pr is ready for review.

[khaledyoussef24]

tried scripts and working fine.
tests don't work with consistency, but still work.
PR is ready for review.

[khaledyoussef24]

some changes are made so scripts needs to be updated.
comments are resolved but still searching why scripts are not working.

[khaledyoussef24]

Work done
scripts for solutions are added.
the vms are working fine with flists waiting to be tested with public ips then will move the pr from drafts.
(created a new branch because the old branch had so many conflicts.)
will continue the tests after the pr gets merged.

[khaledyoussef24]

estimated time for the tests 3 days after the test run of testnet andthe script branch gets merged.

[A-Harby]

#2743

[A-Harby]

#2743

This PR got accepted and merged, and I created another PR with remaining solutions scripts here #2766.
And now pending reviews.

[A-Harby]

I created the a third PR for the automated tests for the casperlabs and waiting for the reviews. #2784

[A-Harby]

The 2 PRs for the grid client scripts, #2743 and #2766, got approved and merged.

waiting for CasperLabs automated tests PR to get approved to create other PRs with the rest of the solutions tests.

[A-Harby]

Updated PR with Peertube, Funkwhale, and CasperLabs, and still waiting for review.

And got blocked on threefoldtech/tf-images#250 and #2833.

[A-Harby]

As 3 automated tests scripts are megered #2784, I created another PR with the remaining 8 applications #2890

[A-Harby]

Created a separate PR for Algorand and presearch: #3030.

[A-Harby]

By having last PR merged this issue should be done.

All of the 13 scripts for the applications are created in example folder, And their tests are created with Jest on tests folder.