v0.18.2

Announcement

🎉 First release from https://github.com/kaito-project (CNCF sandbox) organization!

• New website URL: https://kaito-project.github.io/aikit

• New charts URL: https://kaito-project.github.io/aikit/charts
  helm repo add aikit https://kaito-project.github.io/aikit/charts --force-update to migrate existing Helm repo

• AIKit BuildKit frontend image is moved to ghcr.io/kaito-project/aikit/aikit:latest

• New pre-made image registries are moved under ghcr.io/kaito-project/aikit/ : https://kaito-project.github.io/aikit/docs/premade-models

Chores

• Prepare v0.18.2 release (#574) #574 (github-actions[bot])
• cherry pick kaito org migration (#575) #575 (Sertaç Özercan)

v0.18.1

Breaking Changes

⚠️ This will be the last release before AIKit moves to https://github.com/kaito-project (CNCF sandbox project) organization.

• Existing pre-made images will continue to work, but no new images will be published under ghcr.io/sozercan.
• New images will be published under ghcr.io/kaito-project/aikit/
• Documentation website will be https://kaito-project.github.io/aikit/
• Helm repo will need to be updated to https://kaito-project.github.io/aikit/charts

Chores

• cherry pick chores into release 0.18 (#564) #564 (Sertaç Özercan)
• Prepare v0.18.1 release (#565) #565 (github-actions[bot])
• Prepare v0.18.0 release (#495) (#567) #567 (Sertaç Özercan)

v0.18.0

Continuous Integration

• bump golang 1.24 (#489) #489 (Sertaç Özercan)

Chores

• Prepare v0.17.0 release (#490) #490 (github-actions[bot])
• deps: Bump the actions-all group with 6 updates #493 (dependabot[bot])
• deps: Bump the actions-all group with 6 updates (#493) #493 (github-actions[bot])
• deps: Bump github.com/moby/buildkit from 0.19.0 to 0.20.0 #494 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.19.0 to 0.20.0 (#494) #494 (github-actions[bot])
• bump localai v2.26.0 (#487) #487 (Sertaç Özercan)
• Prepare v0.18.0 release (#495) #495 (github-actions[bot])

v0.17.0

Continuous Integration

• auto merge dependabot prs (#477) #477 (Sertaç Özercan)

Chores

• Prepare v0.16.0 release (#456) #456 (github-actions[bot])
• deps: Bump golang.org/x/crypto from 0.27.0 to 0.31.0 in the go_modules group (#457) #457 (dependabot[bot])
• deps: Bump nanoid from 3.3.7 to 3.3.8 in /website in the npm_and_yarn group across 1 directory (#458) #458 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.18.1 to 0.18.2 (#463) #463 (dependabot[bot])
• deps: Bump golang from ef30001 to 2e83858 (#465) #465 (dependabot[bot])
• deps: Bump kubectl from v1.31.3 to v1.32.1 in /charts/aikit (#469) #469 (dependabot[bot])
• deps: Bump the actions-all group across 1 directory with 10 updates (#470) #470 (dependabot[bot])
• deps: Bump golang.org/x/net from 0.29.0 to 0.33.0 in the go_modules group (#471) #471 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.68.1 to 1.70.0 (#472) #472 (dependabot[bot])
• deps: Bump golang from 2e83858 to 3149bc5 (#476) #476 (dependabot[bot])
• deps: Bump the actions-all group with 3 updates (#475) #475 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.18.2 to 0.19.0 (#474) #474 (dependabot[bot])
• update localai to v2.25.0 (#473) #473 (Sertaç Özercan)
• deps: Bump the actions-all group across 1 directory with 6 updates #480 (dependabot[bot])
• deps: Bump golang from 3149bc5 to 441f59f #481 (dependabot[bot])
• deps: Bump golang.org/x/sync from 0.10.0 to 0.11.0 #482 (dependabot[bot])
• deps: Bump golang.org/x/sync from 0.10.0 to 0.11.0 (#482) #482 (github-actions[bot])
• deps: Bump golang from 3149bc5 to 441f59f (#481) #481 (github-actions[bot])
• deps: Bump the actions-all group across 1 directory with 6 updates (#480) #480 (github-actions[bot])
• deps: Bump kubectl from v1.32.1 to v1.32.2 in /charts/aikit #484 (dependabot[bot])
• deps: Bump kubectl from v1.32.1 to v1.32.2 in /charts/aikit (#484) #484 (github-actions[bot])
• deps: Bump golang from 1.23-bookworm to 1.24-bookworm #485 (dependabot[bot])
• deps: Bump golang from 1.23-bookworm to 1.24-bookworm (#485) #485 (github-actions[bot])
• deps: Bump the actions-all group with 2 updates #486 (dependabot[bot])
• deps: Bump the actions-all group with 2 updates (#486) #486 (github-actions[bot])
• Prepare v0.17.0 release (#488) #488 (github-actions[bot])

v0.16.0

Notable Changes

• ✨ Update to LocalAI v2.24.1.
• 🖖 Apple Silicon containers uses llama.cpp kompute backend instead of vulkan.
• 🦙 Added Llama 3.3 70B and QwQ 32B to pre-made models.

Features

• add qwq 32b preview (#443) #443 (Sertaç Özercan)
• llama 3.3 70b (#448) #448 (Sertaç Özercan)
• use kompute backend for apple silicon (#444) #444 (Sertaç Özercan)

Continuous Integration

• allow storage endpoint (#440) #440 (Sertaç Özercan)
• fix name parsing (#449) #449 (Sertaç Özercan)

Chores

• Prepare v0.15.0 release (#439) #439 (github-actions[bot])
• deps: Bump github.com/moby/buildkit from 0.17.2 to 0.18.0 (#441) #441 (dependabot[bot])
• deps: Bump the actions-all group with 2 updates (#442) #442 (dependabot[bot])
• deps: Bump golang from 3f3b9da to 1479eb3 (#445) #445 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.18.0 to 0.18.1 (#446) #446 (dependabot[bot])
• deps: Bump github/codeql-action from 3.27.5 to 3.27.6 in the actions-all group (#447) #447 (dependabot[bot])
• deps: Bump golang.org/x/sync from 0.9.0 to 0.10.0 (#452) #452 (dependabot[bot])
• deps: Bump golang from 1479eb3 to ef30001 (#454) #454 (dependabot[bot])
• deps: Bump the actions-all group with 2 updates (#453) #453 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.68.0 to 1.68.1 (#451) #451 (dependabot[bot])
• bump localai v2.24.1 (#450) #450 (Sertaç Özercan)
• Prepare v0.16.0 release (#455) #455 (github-actions[bot])

v0.15.0

Notable Changes

• 🍎 Apple Silicon GPU acceleration through Podman Desktop for macOS!

  • Get started quickly after setting up Podman Desktop with GPUs (macOS) with pre-made models as easy as

   podman run -d --rm --device /dev/dri -p 8080:8080 ghcr.io/sozercan/applesilicon/llama3.1:8b

  then visit http://localhost:8080/chat or use:

   curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
       "model": "llama-3.1-8b-instruct",
       "messages": [{"role": "user", "content": "tell me about quantum mechanics"}]
     }'

  • Get started creating your own images as easy as

   docker buildx build -t registry/repo/image:tag --push \
       --build-arg="model=huggingface://MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF/Llama-3.2-1B-Instruct.Q4_K_M.gguf" \
       --build-arg="runtime=applesilicon" \
       "https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"

• 🍏 Pre-made models for Llama 3.2 and 3.1, Phi 3.5, and Gemma 2 with Apple Silicon support

• ✨ Update to LocalAI v2.23.0

• 🦥 Update Unsloth to Sept 2024 release

Features

• apple silicon support (#433) #433 (Sertaç Özercan)

Bug Fixes

• set config file env (#401) #401 (Sertaç Özercan)
• fix llama 3.1 70b (#402) #402 (Sertaç Özercan)
• bump grpcio to 1.68.0 (#437) #437 (Sertaç Özercan)

Documentation

• update apple silicon docs (#436) #436 (Sertaç Özercan)

Continuous Integration

• allow hf.co in update models (#400) #400 (Sertaç Özercan)
• bump precommit (#421) #421 (Sertaç Özercan)
• fix podman test (#435) #435 (Sertaç Özercan)

Chores

• Prepare v0.14.0 release (#399) #399 (github-actions[bot])
• deps: Bump golang from 1a5326b to dba79eb (#404) #404 (dependabot[bot])
• deps: Bump the actions-all group with 3 updates (#405) #405 (dependabot[bot])
• bump unsloth to sept-2024 (#403) #403 (Sertaç Özercan)
• deps: Bump google.golang.org/grpc from 1.67.0 to 1.67.1 (#406) #406 (dependabot[bot])
• deps: Bump the actions-all group with 6 updates (#407) #407 (dependabot[bot])
• deps: Bump golang from dba79eb to 18d2f94 (#408) #408 (dependabot[bot])
• deps: Bump golang from 18d2f94 to 2341ddf (#410) #410 (dependabot[bot])
• deps: Bump the actions-all group across 1 directory with 4 updates (#411) #411 (dependabot[bot])
• bump localai v2.22.1 (#412) #412 (Sertaç Özercan)
• deps: Bump kubectl from v1.31.1 to v1.31.2 in /charts/aikit (#415) #415 (dependabot[bot])
• deps: Bump the actions-all group with 6 updates (#414) #414 (dependabot[bot])
• deps: Bump http-proxy-middleware from 2.0.6 to 2.0.7 in /website in the npm_and_yarn group across 1 directory (#413) #413 (dependabot[bot])
• update base image chisel to 1.0.0 and use the new manifest (#417) #417 (Sertaç Özercan)
• deps: Bump the actions-all group with 2 updates (#420) #420 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.16.0 to 0.17.0 (#419) #419 (dependabot[bot])
• deps: Bump golang from 2341ddf to 0e3377d (#422) #422 (dependabot[bot])
• deps: Bump golang.org/x/sync from 0.8.0 to 0.9.0 (#424) #424 (dependabot[bot])
• deps: Bump github/codeql-action from 3.27.0 to 3.27.4 in the actions-all group across 1 directory (#427) #427 (dependabot[bot])
• deps: Bump cross-spawn from 7.0.3 to 7.0.6 in /website in the npm_and_yarn group across 1 directory (#428) #428 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.17.0 to 0.17.1 (#425) #425 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.67.1 to 1.68.0 (#423) #423 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.17.1 to 0.17.2 (#430) #430 (dependabot[bot])
• deps: Bump golang from 0e3377d to 3f3b9da (#431) #431 (dependabot[bot])
• deps: Bump kubectl from v1.31.2 to v1.31.3 in /charts/aikit (#429) #429 (dependabot[bot])
• deps: Bump the actions-all group with 4 updates (#432) #432 (dependabot[bot])
• Prepare v0.15.0 release (#438) #438 (github-actions[bot])

v0.14.0

Notable Changes

• 🦙 Llama 3.2 1B and 3B are available in pre-made images!

Features

• add llama 3.2 (#395) #395 (Sertaç Özercan)

Documentation

• update flux emoji (#377) #377 (Sertaç Özercan)
• add search (#386) #386 (Sertaç Özercan)

Continuous Integration

• fix flux release (#378) #378 (Sertaç Özercan)
• fix flux release (#379) #379 (Sertaç Özercan)
• update allowlist (#380) #380 (Sertaç Özercan)
• update allowlist (#381) #381 (Sertaç Özercan)

Chores

• Prepare v0.13.0 release (#376) #376 (github-actions[bot])
• deps: Bump golang from 31dc846 to 1a5326b (#384) #384 (dependabot[bot])
• deps: Bump peter-evans/create-pull-request from 6.1.0 to 7.0.1 in the actions-all group (#383) #383 (dependabot[bot])
• deps: Bump the npm_and_yarn group across 1 directory with 4 updates (#385) #385 (dependabot[bot])
• deps: Bump kubectl from v1.31.0 to v1.31.1 in /charts/aikit (#388) #388 (dependabot[bot])
• deps: Bump the actions-all group with 3 updates (#391) #391 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.66.0 to 1.67.0 (#393) #393 (dependabot[bot])
• deps: Bump the actions-all group with 3 updates (#392) #392 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.15.2 to 0.16.0 (#389) #389 (dependabot[bot])
• remove deprecated exllama (#396) #396 (Sertaç Özercan)
• update update-models script (#397) #397 (Sertaç Özercan)
• Prepare v0.14.0 release (#398) #398 (github-actions[bot])

v0.13.0

Notable Changes

• 🤗 Added huggingface diffusers backend
• 📸 Flux-1 Dev is available in pre-made images!
• 🅿️ Phi 3.5 Mini Instruct is available in pre-made images!

Features

• add gemma2 2b (#355) #355 (Sertaç Özercan)
• diffusers backend (#373) #373 (Sertaç Özercan)
• add phi3.5 model (#374) #374 (Sertaç Özercan)

Documentation

• update for llama3.1 (#349) #349 (Sertaç Özercan)

Continuous Integration

• add ubuntu to allow list (#348) #348 (Sertaç Özercan)
• fix patch models (#358) #358 (Sertaç Özercan)

Chores

• Prepare v0.12.0 release (#347) #347 (github-actions[bot])
• deps: Bump github.com/moby/buildkit from 0.15.0 to 0.15.1 (#351) #351 (dependabot[bot])
• deps: Bump golang from 6c27802 to af9b40f (#352) #352 (dependabot[bot])
• deps: Bump the actions-all group with 6 updates (#350) #350 (dependabot[bot])
• bump localai v2.19.4 (#343) #343 (Sertaç Özercan)
• deps: Bump the actions-all group with 3 updates (#360) #360 (dependabot[bot])
• deps: Bump golang.org/x/sync from 0.7.0 to 0.8.0 (#359) #359 (dependabot[bot])
• deps: Bump the actions-all group with 5 updates (#361) #361 (dependabot[bot])
• deps: Bump golang from af9b40f to 39b7e6e (#362) #362 (dependabot[bot])
• deps: Bump golang from 1.22-bookworm to 1.23-bookworm (#364) #364 (dependabot[bot])
• deps: Bump the actions-all group with 2 updates (#366) #366 (dependabot[bot])
• deps: Bump github.com/moby/buildkit from 0.15.1 to 0.15.2 (#367) #367 (dependabot[bot])
• deps: Bump kubectl from v1.30.3 to v1.31.0 in /charts/aikit (#365) #365 (dependabot[bot])
• deps: Bump github/codeql-action from 3.26.2 to 3.26.5 in the actions-all group (#368) #368 (dependabot[bot])
• deps: Bump the npm_and_yarn group across 1 directory with 2 updates (#370) #370 (dependabot[bot])
• update localai to v2.20.1 (#369) #369 (Sertaç Özercan)
• deps: Bump the actions-all group with 2 updates (#372) #372 (dependabot[bot])
• deps: Bump google.golang.org/grpc from 1.65.0 to 1.66.0 (#371) #371 (dependabot[bot])
• Prepare v0.13.0 release (#375) #375 (github-actions[bot])

v0.12.2

Notable Changes

• 🔠 Gemma 2 2B is available in pre-made images!

Chores

• cherry-pick #355 (#356) #356 (Sertaç Özercan)
• Prepare v0.12.2 release (#357) #357 (github-actions[bot])

v0.12.1

Notable Changes

• 🆕 Update to LocalAI v2.19.4.

Chores

• cherry pick #343 (#353) #353 (Sertaç Özercan)
• Prepare v0.12.1 release (#354) #354 (github-actions[bot])