diff options
| author | Hieu Hoang <hieuhoang@gmail.com> | 2015-04-19 10:21:07 +0300 |
|---|---|---|
| committer | Hieu Hoang <hieuhoang@gmail.com> | 2015-04-19 10:21:07 +0300 |
| commit | 637e8a17e8ce008dc63cfc262dcc128a32703e0f (patch) | |
| tree | 6c9f86f53caa2883332dbb96a15c032fc211ff91 /scripts/ems/support/submit-grid.perl | |
| parent | f98de4dc83be2057174b24e6a222c19fb30551a8 (diff) | |
add pre tokenization cleaning script. In case training has bad, overlying long lines which blows up some taggers/segmenters, eg. mada
Diffstat (limited to 'scripts/ems/support/submit-grid.perl')
0 files changed, 0 insertions, 0 deletions