Welcome to mirror list, hosted at ThFree Co, Russian Federation.

github.com/marian-nmt/sentencepiece.git - Unnamed repository; edit this file 'description' to name the repository.
summaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authorTaku Kudo <taku@google.com>2018-06-09 19:15:34 +0300
committerTaku Kudo <taku@google.com>2018-06-09 19:15:34 +0300
commita65ca0d829f925406ae5c25f5be0de6a94af8e00 (patch)
tree6061d7819a3d83a20ccaaae0262ad70c22a67f74 /src/spm_train_main.cc
parenta574ce183c05c99a4919df50d0926c947a0dfa12 (diff)
Uses NMT_NFKC rule by default.
Diffstat (limited to 'src/spm_train_main.cc')
-rw-r--r--src/spm_train_main.cc2
1 files changed, 1 insertions, 1 deletions
diff --git a/src/spm_train_main.cc b/src/spm_train_main.cc
index 92cc6a1..a9890a1 100644
--- a/src/spm_train_main.cc
+++ b/src/spm_train_main.cc
@@ -64,7 +64,7 @@ DEFINE_bool(split_by_whitespace, kDefaultTrainerSpec.split_by_whitespace(),
DEFINE_string(control_symbols, "", "comma separated list of control symbols");
DEFINE_string(user_defined_symbols, "",
"comma separated list of user defined symbols");
-DEFINE_string(normalization_rule_name, "nfkc",
+DEFINE_string(normalization_rule_name, "nmt_nfkc",
"Normalization rule name. "
"Choose from nfkc or identity");
DEFINE_string(normalization_rule_tsv, "", "Normalization rule TSV file. ");