Skip to content

Commit

Permalink
Revert max_new_tokens to 1024 (opea-project#479)
Browse files Browse the repository at this point in the history
Signed-off-by: lvliang-intel <[email protected]>
Signed-off-by: siddhivelankar23 <[email protected]>
  • Loading branch information
lvliang-intel authored and siddhivelankar23 committed Aug 22, 2024
1 parent b9dd8ad commit 386cc7e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion comps/cores/proto/api_protocol.py
Original file line number Diff line number Diff line change
Expand Up @@ -160,7 +160,7 @@ class ChatCompletionRequest(BaseModel):
logit_bias: Optional[Dict[str, float]] = None
logprobs: Optional[bool] = False
top_logprobs: Optional[int] = 0
max_tokens: Optional[int] = 16 # use https://platform.openai.com/docs/api-reference/completions/create
max_tokens: Optional[int] = 1024 # use https://platform.openai.com/docs/api-reference/completions/create
n: Optional[int] = 1
presence_penalty: Optional[float] = 0.0
response_format: Optional[ResponseFormat] = None
Expand Down

0 comments on commit 386cc7e

Please sign in to comment.