Notable Changes
- 💪 Multi-platform images with ARM64 support! All pre-made models include both AMD64 and ARM64 platform support.
- 📦 Support for models from OCI Artifacts. For example, use models from ollama by simply running:
docker buildx build -t my-model --load \
--build-arg="model=oci://registry.ollama.ai/library/llama3:8b" \
"https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"
docker run -d --rm -p 8080:8080 my-model
curl http://localhost:8080/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "llama3",
"messages": [
{
"role": "user",
"content": "Hello!"
}
]
}'
- ⎈ Helm chart security hardening with
restricted pod security admission
Chores
Commits
