New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhance DataCollatorForLanguageModeling with Configurable Token Replacement Probabilities #35251

Open

mahdibaghbanzadeh wants to merge 7 commits into huggingface:main from mahdibaghbanzadeh:data_collator_mlm

+139 −20

Open

Enhance DataCollatorForLanguageModeling with Configurable Token Replacement Probabilities #35251

Merge branch 'main' into data_collator_mlm

CircleCI Checks / run_tests succeeded Dec 17, 2024 in 8m 27s

Workflow: run_tests

View CircleCI workflow

tests_tokenization - Success
tests_onnx - Success
tests_generate - Success
tests_exotic_models - Success
examples_tensorflow - Success
tests_non_model - Success
tests_torch_and_flax - Success
tests_torch_and_tf - Success
collection_job - Success
tests_hub - Success
pipelines_torch - Success
tests_processors - Success
pipelines_tf - Success
tests_torch - Success
tests_custom_tokenizers - Success
examples_torch - Success
tests_tf - Success

View more details on CircleCI Checks