Skip to content

v1.2.0
Compare
Choose a tag to compare
@yejunjin yejunjin released this 24 Jun 05:32
· 20 commits to main since this release
v1.2.0
3a0417b
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

expand context length to 32K & support flash attention on intel-avx512 platform

  • remove currently unsupported cache mode
  • examples: update qwen prompt template, add print func to examples
  • support glm-4-9b-chat by
  • change to size_t to avoid overflow when seq is long
  • update README since we support 32k context length
  • Add flash attention on intel-avx512 platform
Assets 13
Loading