Skip to content

Commit

Permalink
error line fix
Browse files Browse the repository at this point in the history
  • Loading branch information
nmowmita committed Feb 16, 2024
1 parent ab95f5c commit 3051566
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion lm_eval/tasks/crowspairsde.py
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@
with nine types of bias, like race, religion, and age. In CrowS-Pairs a model is presented with two sentences: one
that is more stereotyping and another that is less stereotyping. The data focuses on stereotypes about historically
disadvantaged groups and contrasts them with advantaged groups. We find that all three of the widely-used MLMs we
evaluate substantially favor sentences that express stereotypes in every category in CrowS-Pairs. As work on building
evaluate substantially favor sentences that express stereotypes in every category in CrowS-Pairs. As work on building
less biased models advances, this dataset can be used as a benchmark to evaluate progress.", } """


Expand Down

0 comments on commit 3051566

Please sign in to comment.