Welcome to mirror list, hosted at ThFree Co, Russian Federation.

github.com/marian-nmt/sentencepiece.git - Unnamed repository; edit this file 'description' to name the repository.
summaryrefslogtreecommitdiff
path: root/src
AgeCommit message (Expand)Author
2018-08-03Added JoinPath and StrCatTaku Kudo
2018-08-01Added u8 literal to UTF8 string.Taku Kudo
2018-08-01Minor fixes for windowsTaku Kudo
2018-08-01Support to load big blob data for Windows.Taku Kudo
2018-08-01Updated version numberTaku Kudo
2018-07-31Prepare windows buildTaku Kudo
2018-07-31Remove setjmp/longjmpTaku Kudo
2018-07-27invalid test causing all pieces to be identified as non valid because on firs...Jean A. Senellart
2018-07-26Added --unk_surface option to allow user to change unknown surface string.Taku Kudo
2018-07-25Add messages to tcmallocTaku Kudo
2018-07-24Switched to cmakeTaku Kudo
2018-07-12Added new API to get bos/eos/unk/pad idsTaku Kudo
2018-06-29Changed the hard-limit of --mining_sentence_sizeTaku Kudo
2018-06-29Added normalization with Unicode case foldingTaku Kudo
2018-06-22Add LoadFromSerialiedProtoTaku Kudo
2018-06-20Fixes the usage of strerror_rTaku Kudo
2018-06-19Avoids copy in Python2 Unicode mode.Taku Kudo
2018-06-19Update sentencepiece_processor.hTaku Kudo
2018-06-18Fixed build error on clang.Taku Kudo
2018-06-18Introduced minimum string_wrapper to remove extra string copyTaku Kudo
2018-06-18remove src/stringpiece.hTaku Kudo
2018-06-18Uses abs::string_view instead of StringPieceTaku Kudo
2018-06-17Minor fixesTaku Kudo
2018-06-16Support snake case in Python moduleTaku Kudo
2018-06-16Minor fixes.Taku Kudo
2018-06-11Minor style fixes.Taku Kudo
2018-06-11Support an empty normalziation and other minor fixesTaku Kudo
2018-06-11added missing includeTaku Kudo
2018-06-09Uses NMT_NFKC rule by default.Taku Kudo
2018-06-08Allows to define duplicated user defined symbolsTaku Kudo
2018-06-07Support user defined symbols in Char/BPETaku Kudo
2018-06-06Added --generate_vocabulary option to spm_encodeTaku Kudo
2018-06-06Support vocab restriction feature in BPE model.Taku Kudo
2018-06-06Support vocab restriction featureTaku Kudo
2018-06-04Minor style fixesTaku Kudo
2018-06-04Updated normalizerTaku Kudo
2018-05-13Made DecodeUTF8 more strict.Taku Kudo
2018-05-11s/PopulateNormalizationSpec/PopulateNormalizerSpec/Taku Kudo
2018-05-11Fixed build errorsTaku Kudo
2018-05-10CHECK to util::Status migration for BuilderTaku Kudo
2018-05-06CHECK to Status migration for Trainer.Taku Kudo
2018-05-05Changed the Makefile rule for protobufTaku Kudo
2018-05-03Update sentencepiece_processor.hTaku Kudo
2018-05-01Set normalization_rule in once placeTaku Kudo
2018-04-30Reimplement Trainer with Proto reflectionTaku Kudo
2018-04-28Uses util::Status to propagate error messagesTaku Kudo
2018-04-18Fix typoGraham Neubig
2018-04-17Moved the spec verifier and increases the sentencepiece_length paramTaku Kudo
2018-04-16Add --hard_vocab_limit flag.Taku Kudo
2018-04-09Merge pull request #53 from google/srTaku Kudo
generated by cgit v1.2.3 (git 2.25.1) at 2024-07-16 08:48:15 +0300