Code

Add safety comments#1651

Code

Merged

ArthurZucker merged 6 commits intohuggingface:mainhuggingface/tokenizers:mainfrom Manishearth:safetyManishearth/tokenizers:safetyCopy head branch name to clipboardOct 29, 2024

+32-6

Commits

Commits on Oct 11, 2024

• Unsafe comment for from_u32_unchecked

  Manishearth

  committed
  4fa84fa

• Add safety comments and type assertion for HashSet parallel iteration

  Manishearth

  committed
  37dd9c2

• Add safety comment for String splice

  Manishearth

  committed
  4715a27

Commits on Oct 23, 2024

• fixes

  Manishearth

  committed
  c67f5ae

Commits on Oct 24, 2024

• fmt

  Manishearth

  committed
  d8e1a00

Commits on Oct 25, 2024

• pos

  Manishearth

  committed
  973d0bc