Skip to content

v0.15.0
Compare
Choose a tag to compare
@github-actions github-actions released this 27 Nov 07:39
· 19 commits to main since this release
v0.15.0
9bd67fa
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Notable Changes

  • 🍎 Apple Silicon GPU acceleration through Podman Desktop for macOS!

     podman run -d --rm --device /dev/dri -p 8080:8080 ghcr.io/sozercan/applesilicon/llama3.1:8b

    then visit http://localhost:8080/chat or use:

     curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
     "model": "llama-3.1-8b-instruct",
     "messages": [{"role": "user", "content": "tell me about quantum mechanics"}]
   }'
     docker buildx build -t registry/repo/image:tag --push \
     --build-arg="model=huggingface://MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF/Llama-3.2-1B-Instruct.Q4_K_M.gguf" \
     --build-arg="runtime=applesilicon" \
     "https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"

  • 🍏 Pre-made models for Llama 3.2 and 3.1, Phi 3.5, and Gemma 2 with Apple Silicon support

  • ✨ Update to LocalAI v2.23.0

  • 🦥 Update Unsloth to Sept 2024 release

Features

Bug Fixes

Documentation

Continuous Integration

Chores

Assets 2
Loading