diff options
| author | Taku Kudo <taku910@users.noreply.github.com> | 2018-05-01 15:55:08 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2018-05-01 15:55:08 +0300 |
| commit | 8183193de86fdfa4b335acd089480dce0210fce3 (patch) | |
| tree | cb62b87cffd36af810997f6eceae9f293ba8c046 /README.md | |
| parent | 694896108c299d982e8ecdbc24855ce3817a645f (diff) | |
Update README.md
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 2 |
1 files changed, 1 insertions, 1 deletions
@@ -48,7 +48,7 @@ vocabulary. Unlike most unsupervised word segmentation algorithms, which assume an infinite vocabulary, SentencePiece trains the segmentation model such that the final vocabulary size is fixed, e.g., 8k, 16k, or 32k. -Note that SentencePices specifies the final vocabulary size for training, which is different from the +Note that SentencePices specifies the final vocabulary size for training, which is different from [subword-nmt](https://github.com/rsennrich/subword-nmt) that uses the number of merge operations. The number of merge operations is a BPE-specific parameter and not applicable to other segmentation algorithms, including unigram, word and character. |