[ORT Training] Some important updates of ONNX Runtime training APIs

[JingyaHuang]

What does this PR do?

• Update ORTTrainer to be compatible with transformers 40ea9ab2a1ad99f12e71c3a26215ad33df082ef9.
• /Deprecation/ Deprecate the evaluation and prediction using ONNX runtime
• Refactoring of examples, tests and enable again the CI -> Run with tiny functional models

[Deprecation notes]

The Optimum team decided to deprecate the evaluation and prediction using ONNX Runtime for the reasons below:

• After the deprecation, evaluation and prediction for the trained model are always possible within PyTorch through ORTTrainer. If you want to do inference with ORT, either the evaluation or the prediction can be done through ORTModels in the library.
• Reduce the workload of maintaining ORT inference, which could be broken easily with the evolution of ORT inference APIs. And the feature has no clear usage to encourage us to continue maintaining it.
• Ease the maintenance of ORTTrainer and training examples

[Other subjects to discuss]

• Automate the update and tests of ORT training examples

[fxmarty]

#1327 should already be fixed

[JingyaHuang]

yeah @fxmarty I forgot to update the description, thanks a lot for the fix.

[fxmarty]

LGTM, hopefully adding position_ids inputs did not break ORTTrainer?

[regisss]

LGTM!

[JingyaHuang]

All tests passed:

====================================================== test session starts =======================================================
platform linux -- Python 3.10.0, pytest-7.4.2, pluggy-1.0.0 -- /home/onnxruntimedev/miniconda3/bin/python
cachedir: .pytest_cache
rootdir: /workspace
configfile: pyproject.toml
collected 13 items                                                                                                               

onnxruntime/nightly_test_trainer.py::ORTTrainerIntegrationTest::test_trainer_fp16_0_distilbert_text_classification PASSED  [  7%]
onnxruntime/nightly_test_trainer.py::ORTTrainerIntegrationTest::test_trainer_fp16_1_gpt2_text_generation PASSED            [ 15%]
onnxruntime/nightly_test_trainer.py::ORTTrainerIntegrationTest::test_trainer_fp16_2_t5_text2text_generation PASSED         [ 23%]
onnxruntime/nightly_test_trainer.py::ORTTrainerIntegrationTest::test_trainer_fp32_0_distilbert_text_classification PASSED  [ 30%]
onnxruntime/nightly_test_trainer.py::ORTTrainerIntegrationTest::test_trainer_fp32_1_gpt2_text_generation PASSED            [ 38%]
onnxruntime/nightly_test_trainer.py::ORTTrainerIntegrationTest::test_trainer_fp32_2_t5_text2text_generation PASSED         [ 46%]
onnxruntime/nightly_test_trainer.py::ORTTrainerIntegrationTest::test_trainer_fp32_with_label_smoothing_0_distilbert_text_classification PASSED [ 53%]
onnxruntime/nightly_test_trainer.py::ORTTrainerIntegrationTest::test_trainer_fp32_with_label_smoothing_1_gpt2_text_generation PASSED [ 61%]
onnxruntime/nightly_test_trainer.py::ORTTrainerIntegrationTest::test_trainer_fp32_with_label_smoothing_2_t5_text2text_generation PASSED [ 69%]
onnxruntime/nightly_test_trainer.py::ORTTrainerIntegrationDeepSpeedTest::test_trainer_fp16_ds_stage1_0_distilbert_text_classification PASSED [ 76%]
onnxruntime/nightly_test_trainer.py::ORTTrainerIntegrationDeepSpeedTest::test_trainer_fp16_ds_stage2_0_distilbert_text_classification PASSED [ 84%]
onnxruntime/nightly_test_trainer.py::ORTTrainerOptimizerChoiceTest::test_ort_fused_adam PASSED                             [ 92%]
onnxruntime/nightly_test_trainer.py::ORTTrainerExampleTest::test_trainer_glue SKIPPED (skip for now, server socket error)  [100%]

Left an example test skipped, need to add similar tests for other tasks.