Welcome to
mirror list
, hosted at
ThFree Co
, Russian Federation.
github.com/marian-nmt/sentencepiece.git - Unnamed repository; edit this file 'description' to name the repository.
index
:
github.com/marian-nmt/sentencepiece.git
anthonyaue/document_minexport_build
anthonyaue/remove_cr
anthonyaue/test_change
casing
gmaster
master
mjd/base64
mjd/casing
mjd/casing2
mjd/casing3
mjd/oldmaster
mjd/oldmaster2
noproto
rename-version
rjai/casing
rjai/fix_case_encoding_arg
sr
zhaogao/modify_batch_file
Unnamed repository; edit this file 'description' to name the repository.
www-data
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
src
/
trainer_interface_test.cc
Age
Commit message (
Expand
)
Author
2020-06-01
Port absl::flat_hash_map
Taku Kudo
2020-05-31
Use absl::flags
Taku Kudo
2020-05-07
Initial release of 0.19. Merged internal sentencepiece.
Taku Kudo
2019-01-09
added --treat_whitespace_as_suffix option to make _ be a suffix of word.
Taku Kudo
2018-12-08
support to change the piece of unk/bos/eos/pad
Taku Kudo
2018-11-10
added --split_by_number flag
Taku Kudo
2018-08-14
Fixed build break.
Taku Kudo
2018-08-14
Do not allow the token to include NULL character.
Taku Kudo
2018-08-05
Enable unittest on Windows
Taku Kudo
2018-08-01
Added u8 literal to UTF8 string.
Taku Kudo
2018-06-04
Minor style fixes
Taku Kudo
2018-06-04
Updated normalizer
Taku Kudo
2018-05-06
CHECK to Status migration for Trainer.
Taku Kudo
2018-04-28
Uses util::Status to propagate error messages
Taku Kudo
2018-04-17
Moved the spec verifier and increases the sentencepiece_length param
Taku Kudo
2018-04-16
Add --hard_vocab_limit flag.
Taku Kudo
2018-04-09
Support to change ids of <unk>, <s>, </s>
Taku Kudo
2017-03-07
Initialize repository
Taku Kudo