Skip to content

Commit

Permalink
Merge pull request #1007 from xu-song/patch-1
Browse files Browse the repository at this point in the history
Fix typo
  • Loading branch information
taku910 authored May 10, 2024
2 parents 238fd2c + 1b7d45c commit 5253649
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion doc/experiments.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@

* Segmentation algorithms:
* **SentencePiece**: SentencePiece with a language-model based segmentation. (`--model_type=unigram`)
* **SentencePeice(BPE)**: SentencePiece with Byte Pair Encoding. [[Sennrich et al.](http://www.aclweb.org/anthology/P16-1162)]] (`--model_type=bpe`)
* **SentencePiece(BPE)**: SentencePiece with Byte Pair Encoding. [[Sennrich et al.](http://www.aclweb.org/anthology/P16-1162)]] (`--model_type=bpe`)
* **Moses**: [Moses tokenizer](https://github.com/moses-smt/mosesdecoder/blob/master/scripts/tokenizer/tokenizer.perl) for English.
* **KyTea**: [KyTea](http://www.phontron.com/kytea/) for Japanese.
* **MeCab**: [MeCab](http://taku910.github.io/mecab/) for Japanese.
Expand Down

0 comments on commit 5253649

Please sign in to comment.