forked from EleutherAI/lm-evaluation-harness
-
Notifications
You must be signed in to change notification settings - Fork 8
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
7447360
commit 485acdd
Showing
47 changed files
with
279 additions
and
1 deletion.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-bul_Cyrl-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-bul_Cyrl-lvs_Latn" | ||
| "dataset_name": "bul_Cyrl-lvs_Latn" | ||
| "doc_to_text": "Bulgarian phrase: {{sentence_bul_Cyrl}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_bul_Cyrl}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-ces_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-ces_Latn-lvs_Latn" | ||
| "dataset_name": "ces_Latn-lvs_Latn" | ||
| "doc_to_text": "Czech phrase: {{sentence_ces_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_ces_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-dan_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-dan_Latn-lvs_Latn" | ||
| "dataset_name": "dan_Latn-lvs_Latn" | ||
| "doc_to_text": "Danish phrase: {{sentence_dan_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_dan_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-deu_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-deu_Latn-lvs_Latn" | ||
| "dataset_name": "deu_Latn-lvs_Latn" | ||
| "doc_to_text": "German phrase: {{sentence_deu_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_deu_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
7 changes: 7 additions & 0 deletions
7
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-ell_Grek-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-ell_Grek-lvs_Latn" | ||
| "dataset_name": "ell_Grek-lvs_Latn" | ||
| "doc_to_text": "Modern Greek (1453-) phrase: {{sentence_ell_Grek}}\nStandard Latvian\ | ||
| \ phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_ell_Grek}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-eng_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-eng_Latn-lvs_Latn" | ||
| "dataset_name": "eng_Latn-lvs_Latn" | ||
| "doc_to_text": "English phrase: {{sentence_eng_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_eng_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-est_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-est_Latn-lvs_Latn" | ||
| "dataset_name": "est_Latn-lvs_Latn" | ||
| "doc_to_text": "Estonian phrase: {{sentence_est_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_est_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-fin_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-fin_Latn-lvs_Latn" | ||
| "dataset_name": "fin_Latn-lvs_Latn" | ||
| "doc_to_text": "Finnish phrase: {{sentence_fin_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_fin_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-fra_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-fra_Latn-lvs_Latn" | ||
| "dataset_name": "fra_Latn-lvs_Latn" | ||
| "doc_to_text": "French phrase: {{sentence_fra_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_fra_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-gle_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-gle_Latn-lvs_Latn" | ||
| "dataset_name": "gle_Latn-lvs_Latn" | ||
| "doc_to_text": "Irish phrase: {{sentence_gle_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_gle_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-hrv_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-hrv_Latn-lvs_Latn" | ||
| "dataset_name": "hrv_Latn-lvs_Latn" | ||
| "doc_to_text": "Croatian phrase: {{sentence_hrv_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_hrv_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-hun_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-hun_Latn-lvs_Latn" | ||
| "dataset_name": "hun_Latn-lvs_Latn" | ||
| "doc_to_text": "Hungarian phrase: {{sentence_hun_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_hun_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-ita_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-ita_Latn-lvs_Latn" | ||
| "dataset_name": "ita_Latn-lvs_Latn" | ||
| "doc_to_text": "Italian phrase: {{sentence_ita_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_ita_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lit_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lit_Latn-lvs_Latn" | ||
| "dataset_name": "lit_Latn-lvs_Latn" | ||
| "doc_to_text": "Lithuanian phrase: {{sentence_lit_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lit_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-bul_Cyrl.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-bul_Cyrl" | ||
| "dataset_name": "lvs_Latn-bul_Cyrl" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nBulgarian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_bul_Cyrl}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-ces_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-ces_Latn" | ||
| "dataset_name": "lvs_Latn-ces_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nCzech phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_ces_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-dan_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-dan_Latn" | ||
| "dataset_name": "lvs_Latn-dan_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nDanish phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_dan_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-deu_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-deu_Latn" | ||
| "dataset_name": "lvs_Latn-deu_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nGerman phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_deu_Latn}}" |
7 changes: 7 additions & 0 deletions
7
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-ell_Grek.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-ell_Grek" | ||
| "dataset_name": "lvs_Latn-ell_Grek" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nModern Greek (1453-)\ | ||
| \ phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_ell_Grek}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-eng_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-eng_Latn" | ||
| "dataset_name": "lvs_Latn-eng_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nEnglish phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_eng_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-est_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-est_Latn" | ||
| "dataset_name": "lvs_Latn-est_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nEstonian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_est_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-fin_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-fin_Latn" | ||
| "dataset_name": "lvs_Latn-fin_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nFinnish phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_fin_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-fra_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-fra_Latn" | ||
| "dataset_name": "lvs_Latn-fra_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nFrench phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_fra_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-gle_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-gle_Latn" | ||
| "dataset_name": "lvs_Latn-gle_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nIrish phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_gle_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-hrv_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-hrv_Latn" | ||
| "dataset_name": "lvs_Latn-hrv_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nCroatian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_hrv_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-hun_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-hun_Latn" | ||
| "dataset_name": "lvs_Latn-hun_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nHungarian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_hun_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-ita_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-ita_Latn" | ||
| "dataset_name": "lvs_Latn-ita_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nItalian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_ita_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-lit_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-lit_Latn" | ||
| "dataset_name": "lvs_Latn-lit_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nLithuanian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_lit_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-mlt_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-mlt_Latn" | ||
| "dataset_name": "lvs_Latn-mlt_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nMaltese phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_mlt_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-nld_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-nld_Latn" | ||
| "dataset_name": "lvs_Latn-nld_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nDutch phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_nld_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-pol_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-pol_Latn" | ||
| "dataset_name": "lvs_Latn-pol_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nPolish phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_pol_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-por_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-por_Latn" | ||
| "dataset_name": "lvs_Latn-por_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nPortuguese phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_por_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-ron_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-ron_Latn" | ||
| "dataset_name": "lvs_Latn-ron_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nRomanian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_ron_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-slk_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-slk_Latn" | ||
| "dataset_name": "lvs_Latn-slk_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nSlovak phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_slk_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-slv_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-slv_Latn" | ||
| "dataset_name": "lvs_Latn-slv_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nSlovenian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_slv_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-spa_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-spa_Latn" | ||
| "dataset_name": "lvs_Latn-spa_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nSpanish phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_spa_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-lvs_Latn-swe_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-lvs_Latn-swe_Latn" | ||
| "dataset_name": "lvs_Latn-swe_Latn" | ||
| "doc_to_text": "Standard Latvian phrase: {{sentence_lvs_Latn}}\nSwedish phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_lvs_Latn}}" | ||
| "doc_to_target": "{{sentence_swe_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-mlt_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-mlt_Latn-lvs_Latn" | ||
| "dataset_name": "mlt_Latn-lvs_Latn" | ||
| "doc_to_text": "Maltese phrase: {{sentence_mlt_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_mlt_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-nld_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-nld_Latn-lvs_Latn" | ||
| "dataset_name": "nld_Latn-lvs_Latn" | ||
| "doc_to_text": "Dutch phrase: {{sentence_nld_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_nld_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-pol_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-pol_Latn-lvs_Latn" | ||
| "dataset_name": "pol_Latn-lvs_Latn" | ||
| "doc_to_text": "Polish phrase: {{sentence_pol_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_pol_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-por_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-por_Latn-lvs_Latn" | ||
| "dataset_name": "por_Latn-lvs_Latn" | ||
| "doc_to_text": "Portuguese phrase: {{sentence_por_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_por_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-ron_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-ron_Latn-lvs_Latn" | ||
| "dataset_name": "ron_Latn-lvs_Latn" | ||
| "doc_to_text": "Romanian phrase: {{sentence_ron_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_ron_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-slk_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-slk_Latn-lvs_Latn" | ||
| "dataset_name": "slk_Latn-lvs_Latn" | ||
| "doc_to_text": "Slovak phrase: {{sentence_slk_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_slk_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-slv_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-slv_Latn-lvs_Latn" | ||
| "dataset_name": "slv_Latn-lvs_Latn" | ||
| "doc_to_text": "Slovenian phrase: {{sentence_slv_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_slv_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-spa_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-spa_Latn-lvs_Latn" | ||
| "dataset_name": "spa_Latn-lvs_Latn" | ||
| "doc_to_text": "Spanish phrase: {{sentence_spa_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_spa_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |
6 changes: 6 additions & 0 deletions
6
lm_eval/tasks/opengptx/ogx_flores200-trans/ogx_flores200-trans-swe_Latn-lvs_Latn.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| "include": "_default_template_yaml" | ||
| "task": "ogx_flores200-trans-swe_Latn-lvs_Latn" | ||
| "dataset_name": "swe_Latn-lvs_Latn" | ||
| "doc_to_text": "Swedish phrase: {{sentence_swe_Latn}}\nStandard Latvian phrase:" | ||
| "doc_to_decontamination_query": "{{sentence_swe_Latn}}" | ||
| "doc_to_target": "{{sentence_lvs_Latn}}" |