Code

merged upstream#5

Code

Merged

l3utterfly merged 16 commits intolayla-buildl3utterfly/llama.cpp:layla-buildfrom masterl3utterfly/llama.cpp:masterCopy head branch name to clipboardMar 14, 2024

+3,900-2,801

Commits

Commits on Mar 11, 2024

• Update server docker image URLs (ggerganov#5997)

  GetTuh

  authored
  828defe

  Copy full SHA for 828defe

• llama : refactor unicode stuff (ggerganov#5992)

  Show description for 83796e6
  ggerganov

  authored
  83796e6

  Copy full SHA for 83796e6

• llama : more consistent names of count variables (ggerganov#5994)

  Show description for 05b0621
  ggerganov

  authored
  05b0621

  Copy full SHA for 05b0621

• 1.5 bit: we can do even better (ggerganov#5999)

  Show description for 44ca159
  

  ikawrakow

  and

  Kawrakow

  authored
  44ca159

  Copy full SHA for 44ca159

• grammar : fix unnecessarily retained pointer to rules (ggerganov#6003)

  gliptic

  authored
  5cdb371

  Copy full SHA for 5cdb371

Commits on Mar 12, 2024

• sycl : update IQ1_S kernels (WIP - not working!) (ggerganov#5995)

  Show description for 48358b2
  ggerganov

  authored
  48358b2

  Copy full SHA for 48358b2

• ggml : fix UB in IQ2_S and IQ3_S (ggerganov#6012)

  ggerganov

  authored
  184215e

  Copy full SHA for 184215e

• ggml : reuse quantum structs across backends (ggerganov#5943)

  Show description for 8030da7
  ggerganov

  authored
  8030da7

  Copy full SHA for 8030da7

• ci : remove tidy-review (ggerganov#6021)

  slaren

  authored
  306d34b

  Copy full SHA for 306d34b

Commits on Mar 13, 2024

• Server: Use multi-task for embeddings endpoint (ggerganov#6001)

  Show description for 99b71c0
  ngxson

  authored
  99b71c0

  Copy full SHA for 99b71c0

• Update get version (ggerganov#6025)

  AidanBeltonS

  authored
  b3d9786

  Copy full SHA for b3d9786

• test-backend-ops : skip CPU backend by default (ggerganov#6028)

  slaren

  authored
  d8fd0cc

  Copy full SHA for d8fd0cc

• llama : add pipeline parallelism support (ggerganov#6017)

  Show description for f30ea47
  

  3 peopleauthored
  f30ea47

  Copy full SHA for f30ea47

• grammar : handle missing "root" node (ggerganov#6004)

  HanClinto

  authored
  4636283

  Copy full SHA for 4636283

• readme : update API changes and hot topics

  ggerganov

  authored
  76a936c

  Copy full SHA for 76a936c

• readme : update details about running llama in Termux on Android (ggerganov#6039)

  wanix1988

  authored
  19885d2

  Copy full SHA for 19885d2