Code

[pull] master from ggerganov:master#143

Code

Closed

pull[bot] wants to merge 35 commits intoteleprint-me:masterteleprint-me/llama.cpp:masterfrom ggerganov:masterggerganov/llama.cpp:masterCopy head branch name to clipboard

+3,725-2,434

Commits

Commits on Oct 2, 2024

• ggml-backend : add device and backend reg interfaces (#9707)

  Show description for c83ad6d
  

  slaren

  and

  JohannesGaessler

  authored
  c83ad6d

Commits on Oct 3, 2024

• Fixed dequant precision issues in Q4_1 and Q5_1 (#9711)

  OuadiElfarouki

  authored
  5639971

• rpc : enable vulkan (#9714)

  Show description for 841713e
  rgerganov

  authored
  841713e

• convert : handle tokenizer merges format from transformers 4.45 (#9696)

  compilade

  authored
  e3c355b

• ggml: unify backend logging mechanism (#9709)

  Show description for d6fe7ab
  bandoti

  authored
  d6fe7ab

• ggml-backend : add device description to CPU backend (#9720)

  slaren

  authored
  a7ad553

• metal : fix compute pass descriptor autorelease crash (#9718)

  jmousseau

  authored
  5d5ab1e

• ggml: refactor cross entropy loss CPU impl. (ggml/976)

  

  JohannesGaessler

  authored and

  ggerganov

  committed
  eee39bd

• ggml/ex: calculate accuracy in graph, adapt MNIST (ggml/980)

  

  JohannesGaessler

  authored and

  ggerganov

  committed
  fabdc3b

• sync : ggml

  ggerganov

  committed
  1bb8a64

• metal : remove abort (skip) (ggml/0)

  ggerganov

  committed
  d5ed2b9

Commits on Oct 4, 2024

• Fixed RNG seed docs (#9723)

  Show description for 133c7b4
  d-kleine

  authored
  133c7b4

• ci : fine-grant permission (#9710)

  ngxson

  authored
  f3fdcfa

• ggml : fixes after sync (ggml/983)

  Show description for ff56576
  

  slaren

  authored and

  ggerganov

  committed
  ff56576

• ggml : fix typo in example usage ggml_gallocr_new (ggml/984)

  

  danbev

  authored and

  ggerganov

  committed
  55951c0

• sync : ggml

  ggerganov

  committed
  1788077

• Add Llama Assistant (#9744)

  vietanhdev

  authored
  71967c2

Commits on Oct 5, 2024

• metal : zero-init buffer contexts (whisper/0)

  ggerganov

  committed
  905f548

• sync : ggml

  ggerganov

  committed
  58b1669

• rerank : use [SEP] token instead of [BOS] (#9737)

  Show description for 8c475b9
  ggerganov

  authored
  8c475b9

Commits on Oct 6, 2024

• vulkan : retry allocation with fallback flags (whisper/2451)

  Show description for b0915d5
  

  2 peopleauthored and

  ggerganov

  committed
  b0915d5

• sync : llama.cpp

  ggerganov

  committed
  b6d6c52

• readme : fix typo [no ci]

  ggerganov

  authored
  f4b2dcd

• contrib : simplify + minor edits [no ci]

  ggerganov

  authored
  d5cb868

Commits on Oct 7, 2024

• metal : single allocation of encode_async block (#9747)

  Show description for 96b6912
  

  ptsochantaris

  and

  ggerganov

  authored
  96b6912

• ggml : add metal backend registry / device (#9713)

  Show description for d5ac8cf
  

  ggerganov

  and

  slaren

  authored
  d5ac8cf

• flake.lock: Update (#9753)

  Show description for 6279dac
  

  ggerganov

  and

  github-actions[bot]

  authored
  6279dac

• Update building for Android (#9672)

  Show description for f1af42f
  amqdn

  authored
  f1af42f

• ggml : add backend registry / device interfaces to BLAS backend (#9752)

  Show description for 6374743
  slaren

  authored
  6374743

Commits on Oct 8, 2024

• scripts : fix spelling typo in messages and comments (#9782)

  Show description for fa42aa6
  standby24x7

  authored
  fa42aa6

• server : better security control for public deployments (#9776)

  Show description for 458367a
  ngxson

  authored
  458367a

• ggml : fix BLAS with unsupported types (#9775)

  Show description for dca1d4b
  slaren

  authored
  dca1d4b

Commits on Oct 9, 2024

• examples : remove llama.vim

  Show description for 3dc48fe
  ggerganov

  committed
  3dc48fe

• perplexity : fix integer overflow (#9783)

  Show description for e702206
  ggerganov

  authored
  e702206

• cmake : do not build common library by default when standalone (#9804)

  slaren

  authored
  c81f3bb