Closes #225 | Add Dataloader ALICE-THI

[akhdanfadh]

Closes #225

I implemented one config per language/subset. Thus, configs will look like this: alice_thi_THI-C68_source, alice_thi_THI-D10_seacrowd_imtext, etc. When testing, pass alice_thi_<subset> to the --subset_id parameter.

Checkbox

• Confirm that this PR is linked to the dataset issue.
• Create the dataloader script seacrowd/sea_datasets/my_dataset/my_dataset.py (please use only lowercase and underscore for dataset naming).
• Provide values for the _CITATION, _DATASETNAME, _DESCRIPTION, _HOMEPAGE, _LICENSE, _URLs, _SUPPORTED_TASKS, _SOURCE_VERSION, and _SEACROWD_VERSION variables.
• Implement _info(), _split_generators() and _generate_examples() in dataloader script.
• Make sure that the BUILDER_CONFIGS class attribute is a list with at least one SEACrowdConfig for the source schema and one for a seacrowd schema.
• Confirm dataloader script works with datasets.load_dataset function.
• Confirm that your dataloader script passes the test suite run with python -m tests.test_seacrowd seacrowd/sea_datasets/<my_dataset>/<my_dataset>.py.
• If my dataset is local, I have provided an output of the unit-tests in the PR (please copy paste). This is OPTIONAL for public datasets, as we can test these without access to the data files.

[yongzx]

I ran into this issue when I run python -m tests.test_seacrowd seacrowd/sea_datasets/alice_thi/alice_thi.py --subset alice_thi_THI-D10. also the same when I ran with --schema IMTEXT

Traceback (most recent call last):
  File "/Users/yong/Dev/env_seacrowd/lib/python3.8/site-packages/datasets/builder.py", line 1687, in _prepare_split_single
    example = self.info.features.encode_example(record) if self.info.features is not None else record
  File "/Users/yong/Dev/env_seacrowd/lib/python3.8/site-packages/datasets/features/features.py", line 1866, in encode_example
    return encode_nested_example(self, example)
  File "/Users/yong/Dev/env_seacrowd/lib/python3.8/site-packages/datasets/features/features.py", line 1243, in encode_nested_example
    {
  File "/Users/yong/Dev/env_seacrowd/lib/python3.8/site-packages/datasets/features/features.py", line 1244, in <dictcomp>
    k: encode_nested_example(sub_schema, sub_obj, level=level + 1)
  File "/Users/yong/Dev/env_seacrowd/lib/python3.8/site-packages/datasets/features/features.py", line 1243, in encode_nested_example
    {
  File "/Users/yong/Dev/env_seacrowd/lib/python3.8/site-packages/datasets/features/features.py", line 1243, in <dictcomp>
    {
  File "/Users/yong/Dev/env_seacrowd/lib/python3.8/site-packages/datasets/utils/py_utils.py", line 323, in zip_dict
    yield key, tuple(d[key] for d in dicts)
  File "/Users/yong/Dev/env_seacrowd/lib/python3.8/site-packages/datasets/utils/py_utils.py", line 323, in <genexpr>
    yield key, tuple(d[key] for d in dicts)
KeyError: 'context'

[ljvmiranda921]

Will review this after you address @yongzx 's comments! Got a bit busy this week 😅

[akhdanfadh]

I don't know why the comment resulted in an error on your end, but not on mine. I've uncommented the line there. Also, ran the makefile.

@yongzx @ljvmiranda921

[ljvmiranda921]

Ran the source subset_ids and it passed! lgtm

[yongzx]

It runs for me now! LGTM