v0.13.0

New features

• Support on-demand instance backup when spot instances are not available #745 #629 (vishalbollu)
• Remove kind: deployment from API configuration #759 (deliahu, vishalbollu)
• Add cortex refresh <api_name> command #759 #758 (deliahu)
• Update cortex delete <api_name> command #759 (deliahu)
• Add configuration for rolling update strategy (max_surge and max_unavailable) #763 (deliahu)
• Support programatic CLI configuration via command line flags #764 #729 (deliahu)
• Support small instance types #720 (deliahu)
• Add env flag to cluster up and cluster update commands #731 (deliahu)

Bug fixes

• Limit cluster growth rate to avoid Kubernetes API server crashes #769 (vishalbollu)
• Use configured max price for filtering spot instance distribution #746 #719 (vishalbollu)
• Disallow nano and mirco instances 84f0937 #755 (deliahu)
• Fix pod status calculation to classify successfully recovered replicas as ready c5d97eb #738 (deliahu)

New Examples

• Object detection in images with R-CNN #754 (ArkinDharawat)
• Fastai #725 (caleb-kaiser)

Misc

• Add total cluster price to installation confirmation message #714 #775 #713 (deliahu, vishalbollu)
• Prompt before attempting to zip large files, many files, or large total folder size #752 #767 #721 #722 (vishalbollu, deliahu)
• Reduce cortex operator kubernetes API calls #759 #672 (deliahu)
• Reduce fluentd kubernetes API calls #759 #672 (vishalbollu)
• Add EKS control plane logging #753 #717 (vishalbollu)
• Enforce that bucket and cluster regions match #777 (deliahu)
• Update ONNX runtime to 1.1.0 1e74ab7 64f95b7 #571 (deliahu)
• Direct users to check auto scaling group activity history if cluster up fails #757 #740 (vishalbollu)
• Pre-install opencv system packages #772 (vishalbollu)
• Improve config validations #751 c0a89a2 #732 #742 (deliahu, vishalbollu)
• Increase metrics server memory request/limit 60f00b0#diff-d62cba9784a96fc0a7471ca4d8b38e96 #748 (deliahu)
• Disable operator autoscaling #743 (vishalbollu)
• Add kubectl top to cortex cluster info --debug output #756 #716 (vishalbollu)

v0.12.0

New features

• Support new instance types (e.g. g3 and g4 instances) #655 (deliahu)
• Support batched TensorFlow and ONNX predictions #666 #562 (vishalbollu)
• Allow users to configure availability zones #681 #677 (vishalbollu)
• Support multiple cortex clusters in the same region #661 #664 #660 (deliahu)
• Add AWS resource pricing to cortex cluster up confirmation message #647 #690 #641 (deliahu)
• Autofill instance distribution based on spot price #670 #603 (vishalbollu)
• Add support for passing environment variables through to containers #694 #688 (vishalbollu)

Bug fixes

• Surface operator connection error messages in CLI #659 #658 (deliahu)
• Fix occasional logs stream errors #689 (vishalbollu)
• Install pip packages with --no-cache-dir #623 (vishalbollu)

Misc

• Convert predictor APIs into Python classes #636 #666 #589 (vishalbollu)
• Rename sample to payload in Python APIs #626 (vishalbollu)
• Confirm before deleting a deployment #692 #674 (vishalbollu)
• Check for unsupported instance types 952a1f7 (deliahu)
• Check user EC2 limits before spinning up instances #638 #653 #584 (vishalbollu, deliahu)
• Add cortex cluster info --debug command #691 #657 (deliahu)
• Remove upper limit on CPU target utilization #635 (deliahu)
• Improve cortex deploy response message #650 #642 (deliahu)
• Improve API status output #656 #652 (deliahu)
• Improve spot config documentation #670 #627 (vishalbollu)
• Pre-download Docker images on cluster installation #662 #569 (deliahu)
• Remove cortex support command #683 #668 (vishalbollu)
• Stream logs from all pods to CloudWatch #671 #586 (vishalbollu)
• Support running cortex deploy from subdirectories #675 #673 (deliahu)
• Set log group and bucket name defaults to cluster name #693 #680 (vishalbollu)

v0.11.1

Bug fixes

• Update healthcheck to use exec instead of using http healthz #648 (vishalbollu)

Misc

• Allow configuring waitress parameters via API metadata 5529873 a354308 (deliahu)

v0.11.0

New features

• Support spot instances #585 #597 #469 (vishalbollu)

Examples

• Add MLflow example #566 #553 (ospillinger)
• Add language identification example (fastText) 0173bc4 (ospillinger)
• Add answer generation example #580 (ospillinger)
• Add reading comprehension example #581 (ospillinger)
• Add text summarization example be42b7c (ospillinger)

Misc

• Create separate nodegroup for Cortex operator containers #577 #500 (vishalbollu)
• Improve API logging #596 #587 (deliahu)
• Improve CLI output #570 #567 #568 #574 (deliahu)
• Update API info endpoint route and response #594 #593 (deliahu)
• Add quickstart / tutorial #595 (ospillinger)
• Create CONTRIBUTING.md #555 #310 (ospillinger)

v0.10.3

Misc:

• Make instance volume size configurable f0adbb0 (deliahu)

v0.10.2

Bug fixes:

• Query node group min and max size from AWS AutoScalingGroup API #576 #575 (deliahu)
• Route API requests on exact URL matches, not prefix matches bb22971 (deliahu)

v0.10.1

Bug fixes:

• Refresh logger after loading user modules #563 (vishalbollu)
• Remove extra parameters that may be sent JSON tricks encoder initialization #565 (vishalbollu)
• Set all TensorFlow version directory names to "1" #560 #354 (deliahu)
• Convert TensorFlow model prefix to a directory 10b62b4 (deliahu)

Misc

• Show CLI version regardless of cluster status 0e218ab (deliahu)
• Check EKS status before spinning up cluster #561 (deliahu)
• Add git to API images #559 (vishalbollu)

v0.10.0

New features

• Add Predictor model format to support deploying generic Python models #535 #549 #506 (vishalbollu)
• Ship with popular Python packages out of the box #550 (vishalbollu)
• Add metadata field to API configuration #535 #544 #522 (vishalbollu)
• Support custom API endpoints #534 #531 #223 (deliahu)
• Move cluster installation and management commands to the CLI #527 #501 #499 #515 #518 #526 (deliahu)

Examples

• Add an example with Hugging Face's DistilGPT2 text generation model (PyTorch) #535 #507 (vishalbollu)
• Add an example for predicting miles per gallon to demonstrate regression (scikit-learn) #535 #497 (vishalbollu)

v0.9.2

Bug fixes

• Fix bug in multi-input ONNX models a6bdb5f (vishalbollu)
• Don't update API metrics on non-POST requests f1bc223 (deliahu)

Misc

• Add CORS headers #540 (deliahu)

v0.9.1

Bug fixes:

• Downgrade AWS CNI from v1.5.4 to v1.5.3 dba3ef7 (deliahu)