Skip to content

Commit

Permalink
Merge remote-tracking branch 'upstream/main' into agent
Browse files Browse the repository at this point in the history
  • Loading branch information
cike8899 committed Oct 8, 2024
2 parents bbca9d8 + b3b5468 commit ade4a6c
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions api/db/services/dialog_service.py
Original file line number Diff line number Diff line change
Expand Up @@ -189,6 +189,7 @@ def chat(dialog, messages, stream=True, **kwargs):
used_token_count, msg = message_fit_in(msg, int(max_tokens * 0.97))
assert len(msg) >= 2, f"message_fit_in has bug: {msg}"
prompt = msg[0]["content"]
prompt += "\n\n### Query:\n%s" % " ".join(questions)

if "max_tokens" in gen_conf:
gen_conf["max_tokens"] = min(
Expand Down

0 comments on commit ade4a6c

Please sign in to comment.