Issues using the API - response using api differs vastly from response in web interface #3631
Unanswered
BigKid1973
asked this question in
Q&A
Replies: 2 comments
-
Same shit lil bro |
Beta Was this translation helpful? Give feedback.
0 replies
-
I see the same thing when I use the API vs the webui. I'm not sure what was causing it. I thought I had all the settings identical. Mine was adding things at the end. Like asking 3 times if I wanted more information and stuff like that. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
After a long period of try and error I finally got the api to respond to my c# client.
However the answer is very different from the answer I get using the web-interface.
I use "instruct" mode in web interface and api.
In the webinterface in the setting for chat-instruct I modified Context = "" and Command for chat-instruct mode = "<|prompt|>".
The answers I get using the API remind me of the answers I got before that.Like the LLM is reflecting ABOUT my request instead of fullfilling it.
When trying very often I sometimes get an answer alike what I want and usually get on the webinterface but again with some kind of introductory sentence like the AI is reflecting ABOUT my request first instead of fullfilling it.
Any help highly appreciated. I'm just looking for a way to get the same response I would get when typing it into theh web interface using the same settings I made there (or just use those settings). Probably I'm using the wrong api, or I use it wrong but all I found are the examples here.
This is the json I send to http://127.0.0.1:5001/v1/generate_text
Beta Was this translation helpful? Give feedback.
All reactions