Skip to content
Python

add option to skip special tokens #2118

Sign in to view logs

add option to skip special tokens

add option to skip special tokens #2118

Triggered via pull request December 18, 2023 15:02
@ArthurZuckerArthurZucker
synchronize #1419
encode-special-tokens
Status Success
Total duration 8m 26s
Artifacts –

python.yml

on: pull_request
Matrix: Check everything builds & tests
Matrix: Check it builds for Windows 32-bit
Fit to window
Zoom out
Zoom in

Annotations

46 warnings
Check it builds for Windows 32-bit (3.9)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1, actions/setup-python@v2, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Check it builds for Windows 32-bit (3.9)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check it builds for Windows 32-bit (3.9)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check it builds for Windows 32-bit (3.9)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check it builds for Windows 32-bit (3.9)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check it builds for Windows 32-bit (3.9): tokenizers/src/tokenizer/mod.rs#L295
field `encode_special_tokens` is never read
Check it builds for Windows 32-bit (3.9)
`tokenizers` (lib) generated 1 warning
Check it builds for Windows 32-bit (3.7)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1, actions/setup-python@v2, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Check it builds for Windows 32-bit (3.7): tokenizers/src/tokenizer/mod.rs#L295
field `encode_special_tokens` is never read
Check it builds for Windows 32-bit (3.7)
`tokenizers` (lib) generated 1 warning
Check it builds for Windows 32-bit (3.7)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check it builds for Windows 32-bit (3.7)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check it builds for Windows 32-bit (3.7)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check it builds for Windows 32-bit (3.7)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check it builds for Windows 32-bit (3.10)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1, actions/setup-python@v2, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Check it builds for Windows 32-bit (3.10): tokenizers/src/tokenizer/mod.rs#L295
field `encode_special_tokens` is never read
Check it builds for Windows 32-bit (3.10)
`tokenizers` (lib) generated 1 warning
Check it builds for Windows 32-bit (3.10)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check it builds for Windows 32-bit (3.10)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check it builds for Windows 32-bit (3.10)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check it builds for Windows 32-bit (3.10)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check it builds for Windows 32-bit (3.8)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions-rs/toolchain@v1, actions/setup-python@v2, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Check it builds for Windows 32-bit (3.8)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check it builds for Windows 32-bit (3.8)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check it builds for Windows 32-bit (3.8)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check it builds for Windows 32-bit (3.8)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check it builds for Windows 32-bit (3.8): tokenizers/src/tokenizer/mod.rs#L295
field `encode_special_tokens` is never read
Check it builds for Windows 32-bit (3.8)
`tokenizers` (lib) generated 1 warning
Check everything builds & tests (ubuntu-latest)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions-rs/toolchain@v1, actions/cache@v1, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Check everything builds & tests (ubuntu-latest): tokenizers/src/tokenizer/mod.rs#L295
field `encode_special_tokens` is never read
Check everything builds & tests (ubuntu-latest)
`tokenizers` (lib) generated 1 warning
Check everything builds & tests (ubuntu-latest): tokenizers/src/tokenizer/mod.rs#L295
field `encode_special_tokens` is never read
Check everything builds & tests (ubuntu-latest)
`tokenizers` (lib) generated 1 warning
Check everything builds & tests (ubuntu-latest)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check everything builds & tests (ubuntu-latest)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check everything builds & tests (ubuntu-latest)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check everything builds & tests (ubuntu-latest)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check everything builds & tests (macos-latest)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions-rs/toolchain@v1, actions/cache@v1, actions-rs/cargo@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Check everything builds & tests (macos-latest)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check everything builds & tests (macos-latest)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check everything builds & tests (macos-latest)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check everything builds & tests (macos-latest)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Check everything builds & tests (macos-latest): tokenizers/src/tokenizer/mod.rs#L295
field `encode_special_tokens` is never read
Check everything builds & tests (macos-latest)
`tokenizers` (lib) generated 1 warning
Check everything builds & tests (macos-latest): tokenizers/src/tokenizer/mod.rs#L295
field `encode_special_tokens` is never read
Check everything builds & tests (macos-latest)
`tokenizers` (lib) generated 1 warning