Skip to content

Commit

Permalink
nit
Browse files Browse the repository at this point in the history
  • Loading branch information
ArthurZucker committed Jun 10, 2024
1 parent 5b20fa7 commit 15f877e
Show file tree
Hide file tree
Showing 2 changed files with 0 additions and 2 deletions.
1 change: 0 additions & 1 deletion bindings/python/src/pre_tokenizers.rs
Original file line number Diff line number Diff line change
Expand Up @@ -641,7 +641,6 @@ impl<'de> Deserialize<'de> for CustomPreTokenizer {
}

#[derive(Clone, Deserialize, Display)]
#[display(fmt = "{}")]
#[serde(untagged)]
pub(crate) enum PyPreTokenizerWrapper {
Custom(CustomPreTokenizer),
Expand Down
1 change: 0 additions & 1 deletion tokenizers/src/pre_tokenizers/mod.rs
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,6 @@ use crate::{PreTokenizedString, PreTokenizer};
use derive_more::Display;

#[derive(Deserialize, Serialize, Clone, Debug, PartialEq, Display)]
#[display(fmt = "{}")]
#[serde(untagged)]
pub enum PreTokenizerWrapper {
BertPreTokenizer(BertPreTokenizer),
Expand Down

0 comments on commit 15f877e

Please sign in to comment.