Welcome to mirror list, hosted at ThFree Co, Russian Federation.

github.com/moses-smt/mosesdecoder.git - Unnamed repository; edit this file 'description' to name the repository.
summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2015-04-22Support tokenize(const std::string &) as well.Jeroen Vermeulen
Convenience wrapper: the actual function takes a const char[], but many of the call sites want to pass a string and have to call its c_str() first.
2015-04-22Unify tokenize() into util, and unit-test it.Jeroen Vermeulen
The duplicate definition works fine in environments where the inline definition becomes a weak symbol in the object file, but if it gets generated as a regular definition, the duplicate definition causes link problems. In most call sites the return value could easily be made const, which gives both the reader and the compiler a bit more certainty about the code's intentions. In theory this may help performance, but it's mainly for clarity. The comments are based on reverse-engineering, and the unit tests are based on the comments. It's possible that some of what's in there is not essential, in which case, don't feel bad about changing it! I left a third identical definition in place, though I updated it with my changes to avoid creeping divergence, and noted the duplication in a comment. It would be nice to get rid of this definition as well, but it'd introduce headers from the main Moses tree into biconcor, which may be against policy.
2015-02-04more efficient default recaser trainingPhilipp Koehn
2015-01-14beautifyHieu Hoang
2014-06-08use standard c++ getline instead of old Moses SAFE_GETLINEHieu Hoang
2013-05-29beautifyHieu Hoang
2012-11-12Refactor phrase-extract/JamfileKenneth Heafield