Skip to content

Koboldcpp 1.54 + Dynamic Temp (UI Build)
Compare
Choose a tag to compare
@kalomaze kalomaze released this 05 Jan 03:58
· 2 commits to dynatemp-pr-upstream since this release
dynatemp-ui
79aeadf
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
image

I have decided to submit a PR for Dynamic Temp to be added to the mainline koboldcpp rather than as a janky side build.

Once this is merged, it will have some notable changes:

  • No more manual override settings or .txt files; it's a properly integrated sampler within kobold itself (thanks for the help @AAbushady!)
  • UI is included in kobold lite to control it like how you would any other sampler, will look into SillyTavern integration too
  • The older methods (Greedy Dynamic Temp & HHI Dynamic Temp) have been removed

I am considering keeping the exponent value as a configurable setting as well if that is in demand.

The source code of this release is correct this time for the dynatemp-ui changes (the dynatemp-pr-upstream branch is also identical as of writing).

Do keep in mind this release will not support Dynamic Temp directly in SillyTavern until ST's UI is updated to expect it.

Contributors

AAbushady
Assets 3
Loading