Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ChatQnA Benchmark] Fixed the output token in chatqnafixed.py #193

Merged
merged 2 commits into from
Nov 8, 2024
Merged

[ChatQnA Benchmark] Fixed the output token in chatqnafixed.py #193

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
d2d56e8
Fixed the output token in chatqnafixed.py
Zhenzhong1 Nov 7, 2024
f988a83
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Nov 7, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 2 additions & 6 deletions evals/benchmark/stresscli/locust/chatqnafixed.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,12 +17,8 @@ def getReqData():
global opea_eval_prompts
global max_new_tokens
if opea_eval_prompts == "none":
opea_eval_prompts = "In a world where technology has advanced beyond our wildest dreams, humanity stands on the brink of a new era. The year is 2050, and artificial intelligence has become an integral part of everyday life. Autonomous vehicles zip through the streets, drones deliver packages with pinpoint accuracy, and smart homes anticipate every need of their inhabitants. But with these advancements come new challenges and ethical dilemmas. As society grapples with the implications of AI, questions about privacy, security, and the nature of consciousness itself come to the forefront. Please answer me the question what is artificial intelligence."
return {
"messages": opea_eval_prompts,
"max_tokens": max_new_tokens,
"top_k": 1,
}
opea_eval_prompts = "In a world where technology has advanced beyond our wildest dreams, humanity stands on the brink of a new era. The year is 2050, and artificial intelligence has become an integral part of everyday life. Autonomous vehicles zip through streets, drones deliver packages with pinpoint accuracy, and smart homes anticipate every need of their inhabitants. But with these advancements come new challenges and ethical dilemmas. As society grapples with implications of AI, questions about privacy, security, and the nature of consciousness itself come to the forefront. Please answer me the question what is artificial intelligence in detail."
return {"messages": opea_eval_prompts, "max_tokens": max_new_tokens, "top_k": 1, "temperature": 0}


def respStatics(environment, reqData, respData):
Expand Down