Welcome to
mirror list
, hosted at
ThFree Co
, Russian Federation.
github.com/marian-nmt/sentencepiece.git - Unnamed repository; edit this file 'description' to name the repository.
index
:
github.com/marian-nmt/sentencepiece.git
anthonyaue/document_minexport_build
anthonyaue/remove_cr
anthonyaue/test_change
casing
gmaster
master
mjd/base64
mjd/casing
mjd/casing2
mjd/casing3
mjd/oldmaster
mjd/oldmaster2
noproto
rename-version
rjai/casing
rjai/fix_case_encoding_arg
sr
zhaogao/modify_batch_file
Unnamed repository; edit this file 'description' to name the repository.
www-data
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
src
Age
Commit message (
Expand
)
Author
2020-06-01
Port absl::flat_hash_map
Taku Kudo
2020-05-31
Use absl::flags
Taku Kudo
2020-05-23
Surpress build warning, reproduced minloglevel
Taku Kudo
2020-05-20
0.1.91 pre-release
Taku Kudo
2020-05-17
added interface to read from iterator/write to io buffer
Taku Kudo
2020-05-12
Fixed test failure error.
Taku Kudo
2020-05-12
Added new Pythonic interface.
Taku Kudo
2020-05-10
Added spec_parser test cases.
Taku Kudo
2020-05-09
Revert the default size of piece length.
Taku Kudo
2020-05-09
Fixed windows build failure
Taku Kudo
2020-05-09
Fixed windows build failure
Taku Kudo
2020-05-08
Fixed TF build error.
Taku Kudo
2020-05-07
Fixed test error.
Taku Kudo
2020-05-07
Initial release of 0.19. Merged internal sentencepiece.
Taku Kudo
2020-04-24
Prefer longest user_defined_symbol if ambigous
Taku Kudo
2019-10-30
Fix a typo
Kentaro Hayashi
2019-01-29
Update trainer_interface.cc
Taku Kudo
2019-01-18
Update trainer_interface.cc
Taku Kudo
2019-01-10
remove control characters in the default nmt_* normalizers
Taku Kudo
2019-01-10
updated the document
Taku Kudo
2019-01-09
added --treat_whitespace_as_suffix option to make _ be a suffix of word.
Taku Kudo
2019-01-08
emit relative path of file in LOG(INFO)
Taku Kudo
2019-01-08
Do not parse deprecated proto fileds
Taku Kudo
2019-01-08
added (Encode|Decode)AsSerializedProto interface so Python module can get ful...
Taku Kudo
2019-01-08
emits too-long-sentence error only once
Taku Kudo
2019-01-08
use builtin protobuf-lite package in third_party
Taku Kudo
2018-12-10
added third_party as a subdir of cmake
Taku Kudo
2018-12-09
Fixed build break.
Taku Kudo
2018-12-09
deperecated mining_sentence_size and training_sentence_size. Load all sentenc...
Taku Kudo
2018-12-08
support to change the piece of unk/bos/eos/pad
Taku Kudo
2018-11-18
remvoe the max size constraint for input sentence size etc.
Taku Kudo
2018-11-13
Fixed minor bugs
Taku Kudo
2018-11-13
Do not set UNUSED type to UNK/CONTROL/USER_DEFINED tokens
Taku Kudo
2018-11-13
Fixed build error on Ubutu trusty
Taku Kudo
2018-11-11
added --max_sentence_length flag
Taku Kudo
2018-11-10
added --split_by_number flag
Taku Kudo
2018-11-09
bug fix around user-defined-symbols
Taku Kudo
2018-11-08
stop normalization for user_defined_symbols
Taku Kudo
2018-11-06
added --minloglevel flag
Taku Kudo
2018-10-28
pushed new nfkc_cf.tsv
Taku Kudo
2018-09-16
performance tuning
sr
Taku Kudo
2018-09-07
Added --use_all_vocab=true flag for WORD/CHAR model
Taku Kudo
2018-09-02
Added self testing feature.
Taku Kudo
2018-09-01
Update sentencepiece_processor_test.cc
Taku Kudo
2018-09-01
Added is_binary flag to filesystem API.
Taku Kudo
2018-09-01
Introduced new Filesystem API phase 2.
Taku Kudo
2018-09-01
Introduced new Filesystem API.
Taku Kudo
2018-08-14
Fixed build break.
Taku Kudo
2018-08-14
Do not allow the token to include NULL character.
Taku Kudo
2018-08-14
Added make_py_wheel_mac.py
Taku Kudo
[next]