Code

[pull] master from ggerganov:master#15

Code

Closed

pull[bot] wants to merge 8 commits intoteleprint-me:masterteleprint-me/llama.cpp:masterfrom ggerganov:masterggerganov/llama.cpp:masterCopy head branch name to clipboard

+407-56

Commits

Commits on Jan 8, 2024

• readme : add link to SOTA models

  ggerganov

  authored
  a9a8c5d

• common : fix the short form of --grp-attn-w, not -gat (#4825)

  Show description for 1fc2f26
  howlger

  authored
  1fc2f26

Commits on Jan 9, 2024

• CUDA: faster softmax via shared memory + fp16 math (#4742)

  JohannesGaessler

  authored
  8f900ab

• ggml : fix vld1q_s8_x4 32-bit compat (#4828)

  Show description for 18c2e17
  ggerganov

  authored
  18c2e17

• server : add api-key flag to documentation (#4832)

  Show description for 8c58330
  Zsapi

  authored
  8c58330

• server : update readme about token probs (#4777)

  Show description for 128de35
  

  ibehnam

  and

  ggerganov

  authored
  128de35

• scripts : script to get Paul Graham essays in txt format (#4838)

  ggerganov

  authored
  d965389

• readme : add 3rd party collama reference to UI list (#4840)

  Show description for 18adb4e
  iohub

  authored
  18adb4e