Welcome to mirror list, hosted at ThFree Co, Russian Federation.

github.com/marian-nmt/sentencepiece.git - Unnamed repository; edit this file 'description' to name the repository.
summaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authorTaku Kudo <taku@google.com>2018-06-08 12:44:58 +0300
committerTaku Kudo <taku@google.com>2018-06-08 16:10:13 +0300
commitdb1eeac98580e3aa5a9e523ece5cdc1dc839b333 (patch)
tree9b4261d1cadf7a6764d983b83db6ca82a8d323d3 /src/unigram_model_trainer_test.cc
parent54ccef78b800625a58cbdbac1245d77c9b744e84 (diff)
Allows to define duplicated user defined symbols
Diffstat (limited to 'src/unigram_model_trainer_test.cc')
-rw-r--r--src/unigram_model_trainer_test.cc2
1 files changed, 1 insertions, 1 deletions
diff --git a/src/unigram_model_trainer_test.cc b/src/unigram_model_trainer_test.cc
index 6845da1..aa60427 100644
--- a/src/unigram_model_trainer_test.cc
+++ b/src/unigram_model_trainer_test.cc
@@ -42,7 +42,7 @@ TEST(UnigramTrainerTest, EndToEndTest) {
" --vocab_size=8000"
" --normalization_rule_name=identity"
" --model_type=unigram"
- " --user_defined_symbols=<user>"
+ " --user_defined_symbols=<user>" // Allows duplicated symbol
" --control_symbols=<ctrl>"));
SentencePieceProcessor sp;