Code

SnapKV_Cache support added#34710

Code

Open

shirinyamani wants to merge 5 commits intohuggingface:mainhuggingface/transformers:mainfrom shirinyamani:mainshirinyamani/transformers:mainCopy head branch name to clipboard

+291

Commits

Commits on Nov 12, 2024

• snapkv cache implementation added to cache

  shirinyamani

  committed
  6fe4d87

  Copy full SHA for 6fe4d87

• flash attention2 for snapkv cache added

  shirinyamani

  committed
  80d3362

  Copy full SHA for 80d3362

• cache_utils updated accofing to ruff

  shirinyamani

  committed
  f4e0f15

  Copy full SHA for f4e0f15

Commits on Nov 13, 2024

• ruff errors solved

  shirinyamani

  committed
  debb5ad

  Copy full SHA for debb5ad

Commits on Nov 25, 2024

• Merge branch 'main' into main

  shirinyamani

  authored
  e5525eb

  Copy full SHA for e5525eb