Skip to content

Commit

Permalink
update eval
Browse files Browse the repository at this point in the history
  • Loading branch information
kl2806 committed Jan 8, 2025
1 parent ab0d724 commit 9d2f392
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion evaluate_gsm8k.py
Original file line number Diff line number Diff line change
Expand Up @@ -99,7 +99,7 @@ def evaluate(input_file: str):
example_num_rethinks.append(num_rethinks)

print("Accuracy (any correct): ", any_correct_count / total)
print("Accuracy (final): ", correct / total)
print("Accuracy (majority vote): ", correct / total)
with jsonlines.open(input_file) as reader:
lines = list(reader)
print("avg. num rethinks: ", statistics.mean(example_num_rethinks))
Expand Down

0 comments on commit 9d2f392

Please sign in to comment.