Home

TestEAS

A Test Execution and Analysis System in Python.

Usage

To run:

# Using the Makefile:
make run args="<arguments>"
# Or directly with
python src <arguments>

To print help for instance:

make run args="-h"
# or
python src -h

TestEAS reads tests contexts as generated by [the testgen branch of Kind 2](Kind 2 tg branch). The complete description of the input format [is available here](xml description). Kind 2 generates incomplete test contexts in that they do not specify any binaries. TestEAS can add binaries using

make run args="--add_bin <name> <cmd> <path_to_context>"

which adds a binary named <name>, ran with command <cmd> to the context corresponding to xml file <path_to_context>.

The typical workflow is thus to have Kind 2 generate a test context, add binaries using TestEAS, and run the test cases. For instance

> ls
PilotFlying-synchronous.lus
# Generate test cases.
> kind2-tg --testgen true --testgen_len 15 PilotFlying-synchronous.lus
(...)
# Add binaries.
> testEAS\
  --add_bin pfs_impl_1 ./path/pfs_impl_1 PFS/tests.xml\
  --add_bin pfs_impl_2 ./path/pfs_impl_2 PFS/tests.xml

Adding binary ("pfs_impl_1", "./path/pfs_impl_1") to test context "PFS/tests.xml".
Done.

Adding binary ("pfs_impl_2", "./path/pfs_impl_2") to test context "PFS/tests.xml".
Done.

[warning] No file to run on, done.

# Run TestEAS.
> testEAS PFS/tests.xml
(...)

Alternatively, adding the binary and running at the same time:

> testEAS\
  --add_bin pfs_impl_1 ./path/pfs_impl_1 PFS/tests.xml\
  --add_bin pfs_impl_2 ./path/pfs_impl_2 PFS/tests.xml\
  PFS/tests.xml

License

TestEAS is released under the [Apache 2.0 license](apache license).