diff options
| author | Taku Kudo <taku@google.com> | 2018-06-09 19:15:34 +0300 |
|---|---|---|
| committer | Taku Kudo <taku@google.com> | 2018-06-09 19:15:34 +0300 |
| commit | a65ca0d829f925406ae5c25f5be0de6a94af8e00 (patch) | |
| tree | 6061d7819a3d83a20ccaaae0262ad70c22a67f74 /src/sentencepiece_processor_test.cc | |
| parent | a574ce183c05c99a4919df50d0926c947a0dfa12 (diff) | |
Uses NMT_NFKC rule by default.
Diffstat (limited to 'src/sentencepiece_processor_test.cc')
| -rw-r--r-- | src/sentencepiece_processor_test.cc | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/src/sentencepiece_processor_test.cc b/src/sentencepiece_processor_test.cc index 3a6f689..ae65069 100644 --- a/src/sentencepiece_processor_test.cc +++ b/src/sentencepiece_processor_test.cc @@ -104,7 +104,7 @@ std::vector<std::string> GetSpVec(const SentencePieceText &spt) { } NormalizerSpec MakeDefaultNormalizerSpec() { - return SentencePieceTrainer::GetNormalizerSpec("nfkc"); + return SentencePieceTrainer::GetNormalizerSpec("nmt_nfkc"); } TEST(SentencepieceProcessorTest, StatusTest) { |