Intel Extension for Transformers use Github Action (GHA) for CI test, if you are new to GHA, please refer to GHA
Generally We use Azure Cloud to deploy CI on Es-v5, Bas-v2.
| Test Name | Test Scope | Test Pass Criteria |
|---|---|---|
| Format Scan | Pylint/Cpplint/bandit/cloc/clangformat Pass | PASS |
| Spell Check | Spelling Check | PASS |
| Copyright Check | Copyright Check | PASS |
| DCO | Use git commit -s to sign off | PASS |
| Unit Test | pytest + coverage + gtest | PASS(No failure, No core dump, No segmentation fault, No coverage drop) |
| Kernel Benchmark | Benchmark Details | PASS(No performance regression) |
| Model Test | Pytorch + Tensorflow + Neural Engine + IPEX + CPP Graph | PASS(FP32/INT8 No performance regression) |
-
How to add examples
(1) Still need to pass detected CI tests
(2) Use Extension Test to cover new examples. If you do not have permission for extension test, please contact Maintainers
-
How to test specific component version
(1) Use Extension Test to specify the version. If you do not have permission for extension test, please contact Maintainers
-
How to run tests locally
Please refer to test scripts and usage README