Age | Commit message (Expand) | Author |
---|---|---|
2021-06-16 | Enables --encode_unicode_case option for case-aware sentence piece (#10) | Marcin Junczys-Dowmunt |
2020-10-13 | changed macro big endian | Taku Kudo |
2020-10-13 | support big-endian architecture | Taku Kudo |
2020-10-13 | support big-endian architecture | Taku Kudo |
2020-05-07 | Initial release of 0.19. Merged internal sentencepiece. | Taku Kudo |
2019-01-09 | added --treat_whitespace_as_suffix option to make _ be a suffix of word. | Taku Kudo |
2018-11-08 | stop normalization for user_defined_symbols | Taku Kudo |
2018-06-18 | Uses abs::string_view instead of StringPiece | Taku Kudo |
2018-06-04 | Minor style fixes | Taku Kudo |
2018-06-04 | Updated normalizer | Taku Kudo |
2018-05-13 | Made DecodeUTF8 more strict. | Taku Kudo |
2018-05-11 | Fixed build errors | Taku Kudo |
2018-04-28 | Uses util::Status to propagate error messages | Taku Kudo |
2017-03-07 | Initialize repository | Taku Kudo |