diff options
| author | Rico Sennrich <rico.sennrich@gmx.ch> | 2014-03-21 14:53:15 +0400 |
|---|---|---|
| committer | Rico Sennrich <rico.sennrich@gmx.ch> | 2014-03-21 15:12:24 +0400 |
| commit | 45630a5851fad3bdd6953e88727e4b7c8d0c4c18 (patch) | |
| tree | cd95a3175eb7fc4bb1027cf92d2fa880112b3fee /OnDiskPt | |
| parent | 1c6061e78174d09ea4a7a8125ee0df7f41d88ae5 (diff) | |
various optimizations to make CYK+ parser several times faster and eat less memory.
speed-up of decoding depends on how much time is spent in parser:
10-50% speed-up for string-to-tree systems observed (more on long sentences and with high max-chart-span).
if you only use hiero or string-to-tree models (but none with source syntax), use compile-option --unlabelled-source for (small) efficiency gains.
Diffstat (limited to 'OnDiskPt')
| -rw-r--r-- | OnDiskPt/Word.cpp | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/OnDiskPt/Word.cpp b/OnDiskPt/Word.cpp index 9704be83e..23d29cc7a 100644 --- a/OnDiskPt/Word.cpp +++ b/OnDiskPt/Word.cpp @@ -109,7 +109,7 @@ void Word::ConvertToMoses( for (std::vector<Moses::FactorType>::const_iterator t = outputFactorsVec.begin(); t != outputFactorsVec.end(); ++t, ++tok) { UTIL_THROW_IF2(!tok, "Too few factors in \"" << vocab.GetString(m_vocabId) << "\"; was expecting " << outputFactorsVec.size()); - overwrite.SetFactor(*t, factorColl.AddFactor(*tok)); + overwrite.SetFactor(*t, factorColl.AddFactor(*tok, m_isNonTerminal)); } UTIL_THROW_IF2(tok, "Too many factors in \"" << vocab.GetString(m_vocabId) << "\"; was expecting " << outputFactorsVec.size()); } |