Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create dataset loader for Parallel Corpus Dataset of Indonesian and Bengkulu Malay Language #711

Open
SamuelCahyawijaya opened this issue Jul 30, 2024 · 0 comments

Comments

@SamuelCahyawijaya
Copy link
Collaborator

Dataloader name: ind_bengkulu_mt/ind_bengkulu_mt.py
DataCatalogue: http://seacrowd.github.io/seacrowd-catalogue/card.html?ind_bengkulu_mt

Dataset ind_bengkulu_mt
Description This is a parallel corpus dataset in which each sentence has a corresponding pair. This dataset is specifically created to facilitate the use of machine learning in the field of translation. The dataset is meticulously compiled to encompass various contexts and topics, enabling users to expand their understanding of the use of everyday language, language variations, as well as expressions and typical idioms from both languages. This dataset is independently compiled, with a total of 5261 sentences formed through the collection of online sources for the Indonesian language. Additionally, it utilizes the Malay language dictionary from the Bengkulu library, located in the city of Bengkulu, Bengkulu Province, Indonesia.
Subsets -
Languages ind, zlm
Tasks Machine Translation
License Creative Commons Attribution 4.0 (cc-by-4.0)
Homepage https://data.mendeley.com/datasets/tnk42hhjjk/1
HF URL -
Paper URL https://www.ijcaonline.org/archives/volume184/number49/soyusiawaty-2023-ijca-922603.pdf
@SamuelCahyawijaya SamuelCahyawijaya converted this from a draft issue Jul 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: No status
Development

No branches or pull requests

1 participant