Skip to content

Actions: huggingface/tokenizers

Build documentation

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
115 workflow runs
115 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Updating error messages. (#1599)
Build documentation #184: Commit 7a30bca pushed by Narsil
August 6, 2024 14:42 1m 54s main
August 6, 2024 14:42 1m 54s
Add test normalizers (#1600)
Build documentation #183: Commit 8f2cc90 pushed by Narsil
August 6, 2024 14:08 1m 44s main
August 6, 2024 14:08 1m 44s
Better serialization error (#1595)
Build documentation #182: Commit fe41687 pushed by Narsil
August 6, 2024 11:39 1m 43s main
August 6, 2024 11:39 1m 43s
Adding a few tests for decoder deserialization.
Build documentation #181: Commit 2d27761 pushed by Narsil
August 6, 2024 11:36 1m 50s main
August 6, 2024 11:36 1m 50s
Add-legacy-tests (#1597)
Build documentation #180: Commit adc82cb pushed by ArthurZucker
August 6, 2024 11:08 1m 43s main
August 6, 2024 11:08 1m 43s
Clippy.
Build documentation #179: Commit 99a48dc pushed by Narsil
August 6, 2024 08:48 1m 48s main
August 6, 2024 08:48 1m 48s
Fixing release CI strict (taken from safetensors).
Build documentation #178: Commit 7b80359 pushed by Narsil
August 6, 2024 07:11 2m 11s main
August 6, 2024 07:11 2m 11s
Revert "Using serde (serde_pyo3) to get __str__ and __repr__ easily."
Build documentation #177: Commit a010f6b pushed by Narsil
August 2, 2024 16:43 1m 57s main
August 2, 2024 16:43 1m 57s
Using serde (serde_pyo3) to get __str__ and __repr__ easily.
Build documentation #176: Commit 8613833 pushed by Narsil
August 2, 2024 16:42 2m 3s main
August 2, 2024 16:42 2m 3s
Enabling the option to use fancy_regex instead of onig.
Build documentation #175: Commit 7415e28 pushed by Narsil
August 1, 2024 13:53 1m 55s main
August 1, 2024 13:53 1m 55s
Small performance fixup (negligible but obviously better).
Build documentation #174: Commit 9e0c791 pushed by Narsil
August 1, 2024 13:52 1m 59s main
August 1, 2024 13:52 1m 59s
Fixing the benchmark. (#1583)
Build documentation #173: Commit c6f2c0b pushed by Narsil
August 1, 2024 08:36 1m 59s main
August 1, 2024 08:36 1m 59s
Add benchmark vs tiktoken (#1582)
Build documentation #172: Commit 35f338a pushed by Narsil
July 31, 2024 15:09 1m 58s main
July 31, 2024 15:09 1m 58s
dump spm_precompiled to 0.1.3 (#1571)
Build documentation #171: Commit aface7a pushed by Narsil
July 31, 2024 13:38 2m 11s main
July 31, 2024 13:38 2m 11s
Fix clippy + feature test management. (#1580)
Build documentation #170: Commit a3ad85b pushed by Narsil
July 26, 2024 10:16 1m 49s main
July 26, 2024 10:16 1m 49s
Add bytelevel normalizer to fix decode when adding tokens to BPE (#1555)
Build documentation #169: Commit 4ea2f23 pushed by ArthurZucker
July 15, 2024 10:12 1m 59s main
July 15, 2024 10:12 1m 59s
Revert "[BREAKING CHANGE] Ignore added_tokens (both special and not) …
Build documentation #168: Commit f2a44dc pushed by ArthurZucker
July 12, 2024 05:29 1m 41s main
July 12, 2024 05:29 1m 41s
Enable dropout = 0.0 as an equivalent to none in BPE (#1550)
Build documentation #167: Commit fdd26ba pushed by ArthurZucker
June 24, 2024 10:36 1m 56s main
June 24, 2024 10:36 1m 56s
make sure we don't warn on empty tokens (#1554)
Build documentation #166: Commit 9441f7e pushed by ArthurZucker
June 20, 2024 12:33 2m 2s main
June 20, 2024 12:33 2m 2s
Fix clippy
Build documentation #165: Commit 3e736bb pushed by ArthurZucker
June 20, 2024 07:39 2m 30s main
June 20, 2024 07:39 2m 30s
Fix 'dictionnary' typo (#1511)
Build documentation #164: Commit 1ff56c0 pushed by ArthurZucker
June 11, 2024 13:43 1m 52s main
June 11, 2024 13:43 1m 52s
Switch from cached_download to hf_hub_download in tests (#1547)
Build documentation #163: Commit 88f51fe pushed by Wauplin
June 11, 2024 13:27 1m 43s main
June 11, 2024 13:27 1m 43s
feat(ci): add trufflehog secrets detection (#1551)
Build documentation #162: Commit 418c35c pushed by McPatate
June 10, 2024 14:10 2m 44s main
June 10, 2024 14:10 2m 44s
Fixing for clippy 1.78 (#1548)
Build documentation #161: Commit 8d28dbe pushed by Narsil
June 6, 2024 11:19 1m 59s main
June 6, 2024 11:19 1m 59s
Make USED_PARALLELISM atomic (#1532)
Build documentation #160: Commit bfefcf6 pushed by Narsil
June 6, 2024 11:02 1m 44s main
June 6, 2024 11:02 1m 44s