You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
i am trying to understand this endpoint. Questions:
what are slots? i thought slots would map to users. each user would be assigned a slot and to get a chat completion the request has to go to appropriate slot but the /POST endpoint does not take slot as parameter.
id_slot: Assign the completion task to an specific slot. If is -1 the task will be assigned to a Idle slot. Default: -1
if same /POST endpoint is serving multiple users then their history and conversation is getting mixed up which can't be right.
is the /POST endpoint stateless meaning it does not remember the chat history?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
i am trying to understand this endpoint. Questions:
/POST
endpoint does not take slot as parameter.id_slot: Assign the completion task to an specific slot. If is -1 the task will be assigned to a Idle slot. Default: -1
/POST
endpoint is serving multiple users then their history and conversation is getting mixed up which can't be right./POST
endpoint stateless meaning it does not remember the chat history?Beta Was this translation helpful? Give feedback.
All reactions