We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
如题报错,用local qwen14b-chat评测math数据集,所有prompt完成后,出现以下log
cumulative_logprob=-19.35974837415906, logprobs=None, finish_reason=stop)], finished=True, metrics=RequestMetrics(arrival_time=4056577.262733273, last_token_time=4056577.262733273, first_scheduled_time=1710923909.215728, first_token_time=1710923909.2368155, time_in_queue=1706867331.9529948, finished_time=1710923915.924205), lora_request=None)]WARNING: Error in configuration: macro '\frac' failed its substitution! 运行代码如下: CUDA_VISIBLE_DEVICES=5 python -m ochat.evaluation.run_eval --condition "GPT4 Correct" --model /model/qwen-14b-chat --model-type qwen-14b-chat --eval_sets zs/math
cumulative_logprob=-19.35974837415906, logprobs=None, finish_reason=stop)], finished=True, metrics=RequestMetrics(arrival_time=4056577.262733273, last_token_time=4056577.262733273, first_scheduled_time=1710923909.215728, first_token_time=1710923909.2368155, time_in_queue=1706867331.9529948, finished_time=1710923915.924205), lora_request=None)]WARNING: Error in configuration: macro '\frac' failed its substitution!
没有出现 eval_results 文件夹
请问如何这是怎么回事啊?
The text was updated successfully, but these errors were encountered:
No branches or pull requests
如题报错,用local qwen14b-chat评测math数据集,所有prompt完成后,出现以下log
cumulative_logprob=-19.35974837415906, logprobs=None, finish_reason=stop)], finished=True, metrics=RequestMetrics(arrival_time=4056577.262733273, last_token_time=4056577.262733273, first_scheduled_time=1710923909.215728, first_token_time=1710923909.2368155, time_in_queue=1706867331.9529948, finished_time=1710923915.924205), lora_request=None)]WARNING: Error in configuration: macro '\frac' failed its substitution!
运行代码如下:
CUDA_VISIBLE_DEVICES=5 python -m ochat.evaluation.run_eval --condition "GPT4 Correct" --model /model/qwen-14b-chat --model-type qwen-14b-chat --eval_sets zs/math
没有出现 eval_results 文件夹
请问如何这是怎么回事啊?
The text was updated successfully, but these errors were encountered: