Skip to content

Latest commit

 

History

History
 
 

run_tests

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
dockerize
dockerize
 
 
performance
performance
 
 
sanity
sanity
 
 
stress_test
stress_test
 
 
README.md
README.md
 
 
antagonist.py
antagonist.py
 
 
artifact_targets.py
artifact_targets.py
 
 
build_artifact_csharp.bat
build_artifact_csharp.bat
 
 
build_artifact_csharp.sh
build_artifact_csharp.sh
 
 
build_artifact_node.bat
build_artifact_node.bat
 
 
build_artifact_node.sh
build_artifact_node.sh
 
 
build_artifact_php.sh
build_artifact_php.sh
 
 
build_artifact_protoc.bat
build_artifact_protoc.bat
 
 
build_artifact_protoc.sh
build_artifact_protoc.sh
 
 
build_artifact_python.bat
build_artifact_python.bat
 
 
build_artifact_python.sh
build_artifact_python.sh
 
 
build_artifact_ruby.sh
build_artifact_ruby.sh
 
 
build_csharp.sh
build_csharp.sh
 
 
build_csharp_coreclr.bat
build_csharp_coreclr.bat
 
 
build_csharp_coreclr.sh
build_csharp_coreclr.sh
 
 
build_node.bat
build_node.bat
 
 
build_node.sh
build_node.sh
 
 
build_package_node.sh
build_package_node.sh
 
 
build_package_php.sh
build_package_php.sh
 
 
build_package_python.sh
build_package_python.sh
 
 
build_package_ruby.sh
build_package_ruby.sh
 
 
build_php.sh
build_php.sh
 
 
build_python.sh
build_python.sh
 
 
build_python_msys2.sh
build_python_msys2.sh
 
 
build_ruby.sh
build_ruby.sh
 
 
build_stats_schema.json
build_stats_schema.json
 
 
build_stats_schema_no_matrix.json
build_stats_schema_no_matrix.json
 
 
configs.json
configs.json
 
 
distribtest_targets.py
distribtest_targets.py
 
 
dockerjob.py
dockerjob.py
 
 
filter_pull_request_tests.py
filter_pull_request_tests.py
 
 
interop_html_report.template
interop_html_report.template
 
 
jobset.py
jobset.py
 
 
package_targets.py
package_targets.py
 
 
port_server.py
port_server.py
 
 
post_tests_c.sh
post_tests_c.sh
 
 
post_tests_csharp.bat
post_tests_csharp.bat
 
 
post_tests_csharp.sh
post_tests_csharp.sh
 
 
post_tests_php.sh
post_tests_php.sh
 
 
post_tests_ruby.sh
post_tests_ruby.sh
 
 
pre_build_c.bat
pre_build_c.bat
 
 
pre_build_csharp.bat
pre_build_csharp.bat
 
 
pre_build_csharp.sh
pre_build_csharp.sh
 
 
pre_build_node.bat
pre_build_node.bat
 
 
pre_build_node.sh
pre_build_node.sh
 
 
pre_build_ruby.sh
pre_build_ruby.sh
 
 
prepare_travis.sh
prepare_travis.sh
 
 
report_utils.py
report_utils.py
 
 
run_build_statistics.py
run_build_statistics.py
 
 
run_interop_tests.py
run_interop_tests.py
 
 
run_lcov.sh
run_lcov.sh
 
 
run_node.bat
run_node.bat
 
 
run_node.sh
run_node.sh
 
 
run_performance_tests.py
run_performance_tests.py
 
 
run_python.sh
run_python.sh
 
 
run_ruby.sh
run_ruby.sh
 
 
run_stress_tests.py
run_stress_tests.py
 
 
run_tests.py
run_tests.py
 
 
run_tests_in_workspace.sh
run_tests_in_workspace.sh
 
 
run_tests_matrix.py
run_tests_matrix.py
 
 
sources_and_headers.json
sources_and_headers.json
 
 
task_runner.py
task_runner.py
 
 
tests.json
tests.json
 
 
watch_dirs.py
watch_dirs.py
 
 

README.md

#Overview

This directory contains scripts that facilitate building and running tests. We are using python scripts as entrypoint for our tests because that gives us the opportunity to run tests using the same commandline regardless of the platform you are using.

#Unit tests (run_tests.py)

Builds gRPC in given language and runs unit tests. Use tools/run_tests/run_tests.py --help for more help.

######Example tools/run_tests/run_tests.py -l csharp -c dbg

######Useful options (among many others)

  • --use_docker Builds a docker container containing all the prerequisites for given language and runs the tests under that container.
  • --build_only Only build, do not run the tests.

#Interop tests (run_interop_tests.py)

Runs tests for cross-platform/cross-language interoperability. For more details, see Interop tests descriptions The script is also capable of running interop tests for grpc-java and grpc-go, using sources checked out alongside the ones of the grpc repository.

######Example tools/run_tests/run_interop_tests.py -l csharp -s c++ --use_docker (run interop tests with C# client and C++ server)

#Performance benchmarks (run_performance_tests.py)

Runs predefined benchmark scenarios for given languages. Besides the simple configuration of running all the scenarios locally, the script also supports orchestrating test runs with client and server running on different machines and uploading the results to BigQuery.

######Example tools/run_tests/run_peformance_tests.py -l c++ node

######Useful options

  • --regex use regex to select particular scenarios to run.

#Stress tests (run_stress_tests.py)

Runs modified interop tests clients and servers under heavy load for an extended period of time to discover potential stability issues. The tests are internally using Kubernetes to run the client and server on GKE and upload statistics to BigQuery.

tools/run_tests/stress_test/run_on_gke.py --gcp_project_id=<google-cloud-platform-project-id> --config_file=<path-to-config-file>

The directory tools/run_tests/stress_test/configs/ contains the config files for several scenarios

#Artifacts & Packages (task_runner.py)

A generalized framework for running predefined tasks based on their labels. We use this to building binary artifacts & distrib packages and testing them)

######Example tools/run_tests/task_runner.py -f python artifact linux x64 (build tasks with labels python, artifact, linux, and x64)