tokenizer « scripts - github.com/moses-smt/mosesdecoder.git - Unnamed repository; edit this file 'description' to name the repository.

Welcome to mirror list, hosted at ThFree Co, Russian Federation.

tokenizer « scripts - github.com/moses-smt/mosesdecoder.git - Unnamed repository; edit this file 'description' to name the repository.

index : github.com/moses-smt/mosesdecoder.git

Unnamed repository; edit this file 'description' to name the repository.

www-data

summary refs log tree commit diff

path: root/scripts/tokenizer

Mode	Name	Size
-rwxr-xr-x	detokenizer.perl	8025	log plain
-rwxr-xr-x	lowercase.perl	120	log plain
d---------	nonbreaking_prefixes	784	log plain
-rwxr-xr-x	tokenizer.perl	4461	log plain