v0.8.3-beta3

v0.8.3-beta3

This update introduces the new experimental API Manager and API Configuration templates! This should allow you to add APIs missing from ChatterUI to a degree. This is mostly useful for APIs which are almost compliant with the OpenAI spec but may have extra or reduced sampler options. These configurations are sharable jsons which you can share to add new API compatibility to ChatterUI!

Features:

• Added a new API Manager!
  • This API manager functions similar to the recently added Model manager.
  • If you prefer the old API Manager, simply go to Settings > Use Legacy API
  • You can now have multiple connection presets to the same API type
  • You can now create your own API Configuration Templates! Refer to this discussion to give feedback and suggestions.
• Updated llama.cpp: This brings in a new feature which requantizes Q4_0 models into Q4_0_X_X for optimized arm kernels upon loading the model, removing the need for special quantizations.

Changes:

• Added a new dropdown bottom sheet. This will replace a few old dropdown menus in future.
• Characters and Chats will no longer have last_modified update when accessed, only when edited or chatted.
• Checkbox styles have been updated!

Fixes:

• Fixed chat displaying upside-down.
• Fixed header buttons not working on Samsung and Pixel devices.
• Fixed Markdown formatter not applying properly in specific cases.
• Fixed a crash on startup due to importing an unsupported model.

Known Issues:

• Popups in screen headers may be incorrectly placed.
• Multiline TextInput fields will not resize to full height on a blank newline.
• During generations, if AnimatedEllipsis is visible, it will break Modals such as Alerts and TextBoxModals until the generation ends.