Derive Clone
on Tokenizer
, add Encoding.into_tokens()
method
#657
Job | Run time |
---|---|
4m 11s | |
4m 11s |
Clone
on Tokenizer
, add Encoding.into_tokens()
method
#657
Job | Run time |
---|---|
4m 11s | |
4m 11s |