Skip to content

Commit

Permalink
add validation tags to image notebooks (#2708)
Browse files Browse the repository at this point in the history
* image notebooks - add validation tags

* rename files with long names

* renaming workflow

* remove coco stuff for validation

* add validation tag for limit settings in od

* add validation-trials tag

* revert rename forecasting files

* add batch scoring tags
  • Loading branch information
sharma-riti authored Oct 10, 2023
1 parent a93774b commit efece5a
Show file tree
Hide file tree
Showing 5 changed files with 530 additions and 117 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,10 @@
"transient": {
"deleting": false
}
}
},
"tags": [
"validation-workspace"
]
},
"outputs": [],
"source": [
Expand Down Expand Up @@ -440,7 +443,11 @@
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"metadata": {
"tags": [
"validation-compute"
]
},
"outputs": [],
"source": [
"from azure.ai.ml.entities import AmlCompute\n",
Expand Down Expand Up @@ -475,7 +482,11 @@
},
{
"cell_type": "markdown",
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"source": [
"## 4.1. Automatic hyperparameter sweeping for your models (AutoMode)\n",
"\n",
Expand Down Expand Up @@ -518,7 +529,11 @@
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"outputs": [],
"source": [
"# Create the AutoML job with the related factory-function.\n",
Expand All @@ -542,7 +557,11 @@
},
{
"cell_type": "markdown",
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"source": [
"### Submitting an AutoML job for Computer Vision tasks\n",
"Once you've configured your job, you can submit it as a job in the workspace in order to train a vision model using your training dataset."
Expand All @@ -551,7 +570,11 @@
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"outputs": [],
"source": [
"# Submit the AutoML job\n",
Expand All @@ -565,15 +588,23 @@
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"outputs": [],
"source": [
"ml_client.jobs.stream(returned_job.name)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"source": [
"## 4.2. Individual runs\n",
"\n",
Expand All @@ -596,7 +627,11 @@
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"outputs": [],
"source": [
"# Create the AutoML job with the related factory-function.\n",
Expand All @@ -618,7 +653,11 @@
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"outputs": [],
"source": [
"# Submit the AutoML job\n",
Expand All @@ -630,15 +669,23 @@
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"outputs": [],
"source": [
"ml_client.jobs.stream(returned_job.name)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"source": [
"### 4.2.1 Individual runs with models from Hugging Face (Preview)\n",
"\n",
Expand All @@ -650,7 +697,11 @@
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"outputs": [],
"source": [
"registry_ml_client = MLClient(credential, registry_name=\"azureml\")\n",
Expand All @@ -670,15 +721,23 @@
},
{
"cell_type": "markdown",
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"source": [
"If you wish to try a model (say `microsoft/beit-base-patch16-224-pt22k-ft22k`), you can specify the job for your AutoML Image runs as follows:"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"outputs": [],
"source": [
"# Create the AutoML job with the related factory-function.\n",
Expand All @@ -701,7 +760,11 @@
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"outputs": [],
"source": [
"# Submit the AutoML job\n",
Expand All @@ -713,7 +776,11 @@
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"outputs": [],
"source": [
"ml_client.jobs.stream(returned_job.name)"
Expand Down Expand Up @@ -755,7 +822,11 @@
"transient": {
"deleting": false
}
}
},
"tags": [
"validation-scenario",
"validation-trials"
]
},
"outputs": [],
"source": [
Expand Down Expand Up @@ -857,7 +928,11 @@
},
{
"cell_type": "markdown",
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"source": [
"### 4.3.1 Manual hyperparameter sweeping for models from Hugging Face (Preview)\n",
"\n",
Expand All @@ -869,7 +944,11 @@
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"outputs": [],
"source": [
"# Create the AutoML job with the related factory-function.\n",
Expand Down Expand Up @@ -920,7 +999,11 @@
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"outputs": [],
"source": [
"# Submit the AutoML job\n",
Expand All @@ -934,7 +1017,11 @@
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"metadata": {
"tags": [
"validation-remove"
]
},
"outputs": [],
"source": [
"ml_client.jobs.stream(returned_job_hf.name)"
Expand Down Expand Up @@ -1266,7 +1353,11 @@
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"metadata": {
"tags": [
"validation-deployment"
]
},
"outputs": [],
"source": [
"deployment = ManagedOnlineDeployment(\n",
Expand Down
Loading

0 comments on commit efece5a

Please sign in to comment.