Welcome to mirror list, hosted at ThFree Co, Russian Federation.

github.com/marian-nmt/sentencepiece.git - Unnamed repository; edit this file 'description' to name the repository.
summaryrefslogtreecommitdiff
path: root/src
AgeCommit message (Expand)Author
2022-02-21add one header file to installationMarcin Junczys-Dowmunt
2021-08-31Fix Surface String to Token Mappings for Case Encoding (#12)Rohit Jain
2021-08-27Disable denormalizer flags (#13)Rohit Jain
2021-07-16Enable toggling Case Encoding flag from C++ Train API (#11)Rohit Jain
2021-06-16Enables --encode_unicode_case option for case-aware sentence piece (#10)Marcin Junczys-Dowmunt
2020-10-24add SetRandomGeneratorSeedTaku Kudo
2020-10-23fixed build break.Taku Kudo
2020-10-23validate the range of piece in Python moduleTaku Kudo
2020-10-21fixed typo.Taku Kudo
2020-10-21move sentencepiece python moduel to sub directory.Taku Kudo
2020-10-17Fix FTBFS on armel, mips, powerpc, m68k and sh4Kentaro Hayashi
2020-10-13changed macro big endianTaku Kudo
2020-10-13changed macro big endianTaku Kudo
2020-10-13changed macro big endianTaku Kudo
2020-10-13changed macro big endianTaku Kudo
2020-10-13support big-endian architectureTaku Kudo
2020-10-13support big-endian architectureTaku Kudo
2020-10-13merges internal changes to githubTaku Kudo
2020-10-03Fix type of generate_vocabulary optionGuillaume Klein
2020-09-04clear description for alpha of BPE-dropoutzengl
2020-08-27fix typoYohei Tamura
2020-06-26Added split_digits to SentencePieceTrainermingruimingrui
2020-06-16rollback proto versionTaku Kudo
2020-06-08upgrade protobufTaku Kudo
2020-06-08Fixed compile error on Solaris.Taku Kudo
2020-06-02Fix build break.Taku Kudo
2020-06-01Port absl::flat_hash_mapTaku Kudo
2020-05-31Use absl::flagsTaku Kudo
2020-05-23Surpress build warning, reproduced minloglevelTaku Kudo
2020-05-200.1.91 pre-releaseTaku Kudo
2020-05-17added interface to read from iterator/write to io bufferTaku Kudo
2020-05-12Fixed test failure error.Taku Kudo
2020-05-12Added new Pythonic interface.Taku Kudo
2020-05-10Added spec_parser test cases.Taku Kudo
2020-05-09Revert the default size of piece length.Taku Kudo
2020-05-09Fixed windows build failureTaku Kudo
2020-05-09Fixed windows build failureTaku Kudo
2020-05-08Fixed TF build error.Taku Kudo
2020-05-07Fixed test error.Taku Kudo
2020-05-07Initial release of 0.19. Merged internal sentencepiece.Taku Kudo
2020-04-24Prefer longest user_defined_symbol if ambigousTaku Kudo
2019-10-30Fix a typoKentaro Hayashi
2019-01-29Update trainer_interface.ccTaku Kudo
2019-01-18Update trainer_interface.ccTaku Kudo
2019-01-10remove control characters in the default nmt_* normalizersTaku Kudo
2019-01-10updated the documentTaku Kudo
2019-01-09added --treat_whitespace_as_suffix option to make _ be a suffix of word.Taku Kudo
2019-01-08emit relative path of file in LOG(INFO)Taku Kudo
2019-01-08Do not parse deprecated proto filedsTaku Kudo
2019-01-08added (Encode|Decode)AsSerializedProto interface so Python module can get ful...Taku Kudo
generated by cgit v1.2.3 (git 2.25.1) at 2024-05-23 16:13:59 +0300