-
Notifications
You must be signed in to change notification settings - Fork 1.5k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add distributed TCN (v2) notebook (#2516)
* distributed tcn notebook * Added cluster name to notebooks_config.ini. Increased experiment timeout to 1 hour * modified readme.py to add mlflow to requirements without explicitly calling import mlflow * re-ran readmy.py to reflect changes in the workflwo file * removed best run line from artifacts download * added logging of the best child run ID to file an ICM for the service team. * changed to public client registry * print format * add tracking URI for mlflow * replaced mlflowclient due to deprecation * added disclaimer and increase experiment limit to 60 min * added sleep import
- Loading branch information
Showing
14 changed files
with
1,531 additions
and
1 deletion.
There are no files selected for viewing
80 changes: 80 additions & 0 deletions
80
...standalone-jobs-automl-forecasting-distributed-tcn-automl-forecasting-distributed-tcn.yml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,80 @@ | ||
| # This code is autogenerated. | ||
| # Code is generated by running custom script: python3 readme.py | ||
| # Any manual changes to this file may cause incorrect behavior. | ||
| # Any manual changes will be overwritten if the code is regenerated. | ||
|
|
||
| name: sdk-jobs-automl-standalone-jobs-automl-forecasting-distributed-tcn-automl-forecasting-distributed-tcn | ||
| # This file is created by sdk/python/readme.py. | ||
| # Please do not edit directly. | ||
| on: | ||
| workflow_dispatch: | ||
| schedule: | ||
| - cron: "8 2/12 * * *" | ||
| pull_request: | ||
| branches: | ||
| - main | ||
| paths: | ||
| - sdk/python/jobs/automl-standalone-jobs/automl-forecasting-distributed-tcn/** | ||
| - .github/workflows/sdk-jobs-automl-standalone-jobs-automl-forecasting-distributed-tcn-automl-forecasting-distributed-tcn.yml | ||
| - sdk/python/dev-requirements.txt | ||
| - infra/bootstrapping/** | ||
| - sdk/python/setup.sh | ||
| concurrency: | ||
| group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }} | ||
| cancel-in-progress: true | ||
| jobs: | ||
| build: | ||
| runs-on: ubuntu-latest | ||
| steps: | ||
| - name: check out repo | ||
| uses: actions/checkout@v2 | ||
| - name: setup python | ||
| uses: actions/setup-python@v2 | ||
| with: | ||
| python-version: "3.8" | ||
| - name: pip install notebook reqs | ||
| run: pip install -r sdk/python/dev-requirements.txt | ||
| - name: pip install mlflow reqs | ||
| run: pip install -r sdk/python/mlflow-requirements.txt | ||
| - name: azure login | ||
| uses: azure/login@v1 | ||
| with: | ||
| creds: ${{secrets.AZUREML_CREDENTIALS}} | ||
| - name: bootstrap resources | ||
| run: | | ||
| echo '${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}'; | ||
| bash bootstrap.sh | ||
| working-directory: infra/bootstrapping | ||
| continue-on-error: false | ||
| - name: setup SDK | ||
| run: | | ||
| source "${{ github.workspace }}/infra/bootstrapping/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/bootstrapping/init_environment.sh"; | ||
| bash setup.sh | ||
| working-directory: sdk/python | ||
| continue-on-error: true | ||
| - name: setup-cli | ||
| run: | | ||
| source "${{ github.workspace }}/infra/bootstrapping/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/bootstrapping/init_environment.sh"; | ||
| bash setup.sh | ||
| working-directory: cli | ||
| continue-on-error: true | ||
| - name: run jobs/automl-standalone-jobs/automl-forecasting-distributed-tcn/automl-forecasting-distributed-tcn.ipynb | ||
| run: | | ||
| source "${{ github.workspace }}/infra/bootstrapping/sdk_helpers.sh"; | ||
| source "${{ github.workspace }}/infra/bootstrapping/init_environment.sh"; | ||
| bash "${{ github.workspace }}/infra/bootstrapping/sdk_helpers.sh" generate_workspace_config "../../.azureml/config.json"; | ||
| bash "${{ github.workspace }}/infra/bootstrapping/sdk_helpers.sh" replace_template_values "automl-forecasting-distributed-tcn.ipynb"; | ||
| [ -f "../../.azureml/config" ] && cat "../../.azureml/config"; | ||
| papermill -k python -p compute_name automl-cpu-cluster automl-forecasting-distributed-tcn.ipynb automl-forecasting-distributed-tcn.output.ipynb | ||
| working-directory: sdk/python/jobs/automl-standalone-jobs/automl-forecasting-distributed-tcn | ||
| - name: upload notebook's working folder as an artifact | ||
| if: ${{ always() }} | ||
| uses: actions/upload-artifact@v2 | ||
| with: | ||
| name: automl-forecasting-distributed-tcn | ||
| path: sdk/python/jobs/automl-standalone-jobs/automl-forecasting-distributed-tcn | ||
|
|
||
| - name: Remove the compute if notebook did not done it properly. | ||
| run: bash "${{ github.workspace }}/infra/bootstrapping/remove_computes.sh" "distributed-tcn-cluster" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.