Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SimpleChat v3.1: Boolean chat request options in Settings UI, cache_prompt #7950

Merged
merged 8 commits into from
Jun 25, 2024

Conversation

hanishkvc
Copy link
Contributor

@hanishkvc hanishkvc commented Jun 15, 2024

Allow user to control any boolean options in the request json sent to server, from the settings ui.

Using same allow cache_prompt to be enabled, if the user so wants.

  • Self Reported Review Complexity:
    • Review Complexity : Low
    • Review Complexity : Medium
    • Review Complexity : High
  • I have read the contributing guidelines

@mofosyne mofosyne added the Review Complexity : Low Trivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fix label Jun 16, 2024
@hanishkvc
Copy link
Contributor Author

Hi @mofosyne

I will push few more commits in an hours time, to clean up the settings entries to match a logical flow, rather than the current sequence which came about, more based on when things were added into it.

Also rename chatRequestOptions to apiRequestOptions, to indicate that it is used for both chat/completions and completions api end points.

@hanishkvc
Copy link
Contributor Author

hanishkvc commented Jun 16, 2024

Hi @mofosyne this PR is done, you can merge this.

Copy link
Contributor

@akx akx left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think it's necessarily a great idea to add a 140 KB, 1200 × 720 screenshot...

@hanishkvc
Copy link
Contributor Author

@ggerganov @mofosyne @akx

have changed to webp image format and also resized to 800x480, so now it occupies only 20K. Added the image to give a rough idea of how it will be, if one wants to use it.

@hanishkvc hanishkvc force-pushed the hkvc_webfrontend_simplechat_v3.1 branch from 6c0d43c to ed762f8 Compare June 25, 2024 01:00
@hanishkvc
Copy link
Contributor Author

Hi @mofosyne

The failing check was not related to simplechat nor this pr. Eitherway I have force rebased to the latest upstream.

@mofosyne
Copy link
Collaborator

@ggerganov seems like multiple PRs are constantly getting out-of-date with the base branch even if all the checks has passed. Rebasing and waiting for the checks doesn't seem to clear it in time as another PR would have been merged and then the cycle needs to start again.

@mofosyne mofosyne added the merge ready indicates that this may be ready to merge soon and is just holding out in case of objections label Jun 25, 2024
@ggerganov
Copy link
Owner

I had accidentally enabled the following setting:

image

Disabled now and should be good

@mofosyne mofosyne merged commit 3791ad2 into ggerganov:master Jun 25, 2024
21 checks passed
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Jun 30, 2024
…rompt (ggerganov#7950)

* SimpleChat: Allow for chat req bool options to be user controlled

* SimpleChat: Allow user to control cache_prompt flag in request

* SimpleChat: Add sample GUI images to readme file

Show the chat screen and the settings screen

* SimpleChat:Readme: Add quickstart block, title to image, cleanup

* SimpleChat: RePosition contents of the Info and Settings UI

Make it more logically structured and flow through.

* SimpleChat: Rename to apiRequestOptions from chatRequestOptions

So that it is not wrongly assumed that these request options are
used only for chat/completions endpoint. Rather these are used
for both the end points, so rename to match semantic better.

* SimpleChat: Update image included with readme wrt settings ui

* SimpleChat:ReadMe: Switch to webp screen image to reduce size
MagnusS0 pushed a commit to MagnusS0/llama.cpp-normistral-tokenizer that referenced this pull request Jul 1, 2024
…rompt (ggerganov#7950)

* SimpleChat: Allow for chat req bool options to be user controlled

* SimpleChat: Allow user to control cache_prompt flag in request

* SimpleChat: Add sample GUI images to readme file

Show the chat screen and the settings screen

* SimpleChat:Readme: Add quickstart block, title to image, cleanup

* SimpleChat: RePosition contents of the Info and Settings UI

Make it more logically structured and flow through.

* SimpleChat: Rename to apiRequestOptions from chatRequestOptions

So that it is not wrongly assumed that these request options are
used only for chat/completions endpoint. Rather these are used
for both the end points, so rename to match semantic better.

* SimpleChat: Update image included with readme wrt settings ui

* SimpleChat:ReadMe: Switch to webp screen image to reduce size
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
examples merge ready indicates that this may be ready to merge soon and is just holding out in case of objections Review Complexity : Low Trivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fix server
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants