Skip to content

Releases: sozercan/aikit

v0.16.0

10 Dec 07:09
@github-actions github-actions
v0.16.0
b2833a2
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.16.0 Latest
Latest

Notable Changes

  • ✨ Update to LocalAI v2.24.1.
  • 🖖 Apple Silicon containers uses llama.cpp kompute backend instead of vulkan.
  • 🦙 Added Llama 3.3 70B and QwQ 32B to pre-made models.

Features

Continuous Integration

Chores

Assets 2
Loading

v0.15.0

27 Nov 07:39
@github-actions github-actions
v0.15.0
9bd67fa
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.15.0

Notable Changes

  • 🍎 Apple Silicon GPU acceleration through Podman Desktop for macOS!

     podman run -d --rm --device /dev/dri -p 8080:8080 ghcr.io/sozercan/applesilicon/llama3.1:8b

    then visit http://localhost:8080/chat or use:

     curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
     "model": "llama-3.1-8b-instruct",
     "messages": [{"role": "user", "content": "tell me about quantum mechanics"}]
   }'
     docker buildx build -t registry/repo/image:tag --push \
     --build-arg="model=huggingface://MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF/Llama-3.2-1B-Instruct.Q4_K_M.gguf" \
     --build-arg="runtime=applesilicon" \
     "https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"

  • 🍏 Pre-made models for Llama 3.2 and 3.1, Phi 3.5, and Gemma 2 with Apple Silicon support

  • ✨ Update to LocalAI v2.23.0

  • 🦥 Update Unsloth to Sept 2024 release

Features

Bug Fixes

Documentation

Continuous Integration

Chores

Assets 2
Loading

v0.14.0

27 Sep 03:50
@github-actions github-actions
v0.14.0
9fa9ac1
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.14.0

Notable Changes

Features

Documentation

Continuous Integration

Chores

Assets 2
Loading

v0.13.0

07 Sep 20:35
@github-actions github-actions
v0.13.0
97c114e
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.13.0

Notable Changes

Features

Documentation

Continuous Integration

Chores

Assets 2
Loading

v0.12.2

03 Aug 23:18
@github-actions github-actions
v0.12.2
43058b2
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.12.2

Notable Changes

Chores

Assets 2
Loading

v0.12.1

03 Aug 20:26
@github-actions github-actions
v0.12.1
69284c6
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.12.1

Notable Changes

Chores

Assets 2
Loading

v0.12.0

28 Jul 05:56
@github-actions github-actions
v0.12.0
767888a
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.12.0

Notable Changes

Deprecation

Features

Bug Fixes

Documentation

Tests

Continuous Integration

Chores

Assets 2
Loading

v0.11.1

13 Jun 05:44
@github-actions github-actions
v0.11.1
abf1ef4
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.11.1

Notable Changes

  • 💪 Multi-platform images with ARM64 support! All pre-made models include both AMD64 and ARM64 platform support.
  • 📦 Support for models from OCI Artifacts. For example, use models from ollama by simply running:
docker buildx build -t my-model --load \
    --build-arg="model=oci://registry.ollama.ai/library/llama3:8b" \
    "https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"

docker run -d --rm -p 8080:8080 my-model

curl http://localhost:8080/v1/chat/completions \
    -H "Content-Type: application/json" \
    -d '{
        "model": "llama3",
        "messages": [
            {
                "role": "user",
                "content": "Hello!"
            }
        ]
    }'
  • ⎈ Helm chart security hardening with restricted pod security admission

Chores

Commits

Assets 2
Loading

v0.11.0

13 Jun 03:49
@github-actions github-actions
v0.11.0
8f80515
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.11.0

Notable Changes

  • 💪 Multi-platform images with ARM64 support! All pre-made models include both AMD64 and ARM64 platform support.
  • 📦 Support for models from OCI Artifacts. For example, use models from ollama by simply running:
docker buildx build -t my-model --load \
    --build-arg="model=oci://registry.ollama.ai/library/llama3:8b" \
    "https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"

docker run -d --rm -p 8080:8080 my-model

curl http://localhost:8080/v1/chat/completions \
    -H "Content-Type: application/json" \
    -d '{
        "model": "llama3",
        "messages": [
            {
                "role": "user",
                "content": "Hello!"
            }
        ]
    }'
  • ⎈ Helm chart security hardening with restricted pod security admission

Features

Documentation

Continuous Integration

Chores

Assets 2
Loading

v0.10.0

06 Jun 11:11
@github-actions github-actions
v0.10.0
0eb9597
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.10.0

Notable changes

⚡️ Quick start to create custom images using models from Hugging Face 🤗 without creating an aikitfile

Example:

docker buildx build -t my-model --load \
    --build-arg="model=huggingface://TheBloke/Llama-2-7B-Chat-GGUF/llama-2-7b-chat.Q4_K_M.gguf" \
    "https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"

Features

Bug Fixes

Documentation

Tests

Continuous Integration

Chores

Assets 2
Loading