Welcome to mirror list, hosted at ThFree Co, Russian Federation.

github.com/marian-nmt/sentencepiece.git - Unnamed repository; edit this file 'description' to name the repository.
summaryrefslogtreecommitdiff
path: root/src/sentencepiece_processor_test.cc
AgeCommit message (Collapse)Author
2018-09-01Introduced new Filesystem API.Taku Kudo
2018-08-05Enable unittest on WindowsTaku Kudo
2018-08-03Added JoinPath and StrCatTaku Kudo
2018-08-01Added u8 literal to UTF8 string.Taku Kudo
2018-07-26Added --unk_surface option to allow user to change unknown surface string.Taku Kudo
2018-07-12Added new API to get bos/eos/unk/pad idsTaku Kudo
2018-06-22Add LoadFromSerialiedProtoTaku Kudo
2018-06-18Uses abs::string_view instead of StringPieceTaku Kudo
2018-06-17Minor fixesTaku Kudo
2018-06-16Minor fixes.Taku Kudo
2018-06-09Uses NMT_NFKC rule by default.Taku Kudo
2018-06-06Support vocab restriction featureTaku Kudo
2018-06-04Minor style fixesTaku Kudo
2018-06-04Updated normalizerTaku Kudo
2018-05-11s/PopulateNormalizationSpec/PopulateNormalizerSpec/Taku Kudo
2018-05-10CHECK to util::Status migration for BuilderTaku Kudo
2018-04-28Uses util::Status to propagate error messagesTaku Kudo
2018-02-28Add Sample/NBestEncodeTaku Kudo
2017-07-23use pointer instead of not-const referenceresec
2017-07-20remove useless includeresec
removed: #include <sstream>;
2017-07-20Add test case for loading model from std::istreamresec
EXPECT_DEATH(sp.LoadOrDie(std::istringstream ss(std::string("__UNKNOWN_STREAM__")));
2017-03-07Initialize repositoryTaku Kudo
    generated by cgit v1.2.3 (git 2.25.1) at 2024-07-21 19:58:32 +0300