Age | Commit message (Collapse) | Author | |
---|---|---|---|
2020-08-03 | Allow Arabic letters to begin a fa sentence | Kenneth Heafield | |
2020-06-30 | escape ampersands | Barry Haddow | |
2020-03-19 | sentence splitter -k option to keep line boundaries | Kenneth Heafield | |
2020-03-19 | Add Pashto ؟ as a sentence splitting character | Kenneth Heafield | |
2020-02-26 | flag to turn off sentence splitter from emitting <P> | William Waites | |
2020-01-06 | Proper spacingalvations-patch-2 | alvations | |
2019-12-16 | attempt to handle Korean better; only consider horizontal space in final split | Barry Haddow | |
2019-12-09 | split word on any type of space | Barry Haddow | |
2019-11-08 | 2 letter codes | Barry Haddow | |
2019-11-08 | support for several Indic languages | Barry Haddow | |
2019-11-05 | list items | Barry Haddow | |
2019-11-05 | fix abbrev rule | Barry Haddow | |
2019-11-01 | devanagari fix | Barry Haddow | |
2019-10-31 | reorganise indic support | Barry Haddow | |
2019-10-31 | use block notation for indic scripts | Barry Haddow | |
2019-10-31 | fix nbp | Barry Haddow | |
2019-10-28 | full cjk test | Barry Haddow | |
2019-09-30 | debug | Barry Haddow | |
2019-09-30 | revert 05788925 | Barry Haddow | |
2019-09-30 | enable custom non breaking prefixes | Barry Haddow | |
2019-09-30 | Merge branch 'master' of github.com:moses-smt/mosesdecoder | Barry Haddow | |
2019-09-30 | do not add spaces in cjk | Barry Haddow | |
2019-09-04 | The dot before an acronym should be optional.alvations-patch-regexes | alvations | |
2019-07-10 | Support for Urdu in sentence splitter | Achim Ruopp | |
2019-04-26 | escape angle brackets | Matt Post | |
The script doesn't escape angle brackets which can result in bad SGML / XML output. This fixes that, although ideally, this should be implemented with a proper parser and dumper. | |||
2018-12-30 | consistent output | Hieu Hoang | |
2018-12-04 | sacre bleu | Hieu Hoang | |
2018-10-30 | basic support for Gujarati and Hindi, backported from one of the many upstreams | Barry Haddow | |
2018-05-04 | Merge pull request #196 from astronautguo/master | Hieu Hoang | |
fix bug when copying to cache | |||
2018-05-03 | Don't drop last character if file does not end with newline | Kenneth Heafield | |
2018-04-28 | fix bug when copying to cache | astro | |
2017-03-07 | reference-from-sgm.perl: fix Perl error | Phil Williams | |
2017-01-11 | Update to applly CJK processing conditionally. | Linas Vepstas | |
2017-01-08 | Handle punctuation+CJK combinations. | Linas Vepstas | |
2017-01-06 | Bug-fix: regular Western sentence enders not recognized. | Linas Vepstas | |
2017-01-05 | Whoops, revert cut-n-paste damage in previous commit. | Linas Vepstas | |
2017-01-05 | Preliminary support for Chinese. | Linas Vepstas | |
Also, cleanup some of the comments. | |||
2017-01-05 | oops. | Linas Vepstas | |
2017-01-05 | Purely cosmetic cleanup. | Linas Vepstas | |
Use same indentation style throughout; wrap long lines; capitalize sentences; add punctuation; remove trailing whitespace. | |||
2016-08-11 | make probing pt work with ems | Hieu Hoang | |
2016-06-04 | barebone support for quality estimation in experiment.perl | Philipp Koehn | |
2016-02-05 | fix search graph parsing for CYK+ | shuoyangd | |
2015-09-24 | option to cat model files | Hieu Hoang | |
2015-07-29 | script to copy model files to local disk before running the decoder - useful ↵ | Philipp Koehn | |
for grid | |||
2015-07-14 | allow saving of model from fast-align (for incremental use) | Philipp Koehn | |
2015-06-02 | Lint-fixing binge. | Jeroen Vermeulen | |
2015-05-29 | Add license notices to scripts. | Jeroen Vermeulen | |
This is not pleasant to read (and much, much less pleasant to write!) but sort of necessary in an open project. Right now it's quite hard to figure out what is licensed how, which doesn't matter much to most people but can suddenly become very important when people want to know what they're being allowed to do. I kept the notices as short as I could. As far as I could see, everything without a clear license notice is LGPL v2.1 or later. | |||
2015-05-17 | Fix a lot of lint, mostly trailing whitespace. | Jeroen Vermeulen | |
This is lint reported by the new lint-checking functionality in beautify.py. (We can change to a different lint checker if we have a better one, but it would probably still flag these same problems.) Lint checking can help a lot, but only if we get the lint under control. | |||
2015-05-16 | Fix more Python lint. | Jeroen Vermeulen | |
Most of the complaints fixed here were from Pocketlint, but many were also from Syntastic the vim plugin. | |||
2015-05-05 | output bleu for multi-bleu hack | Hieu Hoang | |