Welcome to mirror list, hosted at ThFree Co, Russian Federation.

github.com/moses-smt/mosesdecoder.git - Unnamed repository; edit this file 'description' to name the repository.
summaryrefslogtreecommitdiff
path: root/mert/BleuScorer.h
AgeCommit message (Collapse)Author
2015-05-01sentence-bleu less greedy regarding memoryMatthias Huck
Don't load all references, read them line by line. Corpora with millions of sentences can now be evaluated without consuming gigabytes of RAM.
2015-04-30sentence-bleu-nbestMatthias Huck
2014-09-22basic support for more metrics with kbmiraRico Sennrich
metrics need getReferenceLength (for background smoothing) to work with kbmira
2014-09-22calculateScore with float (for smoothing support)Rico Sennrich
2014-07-21Merge 08811deb17337356cd8dae9c59c0160590679a35 from joshuaBarry Haddow
2013-07-04beautifyHieu Hoang
2013-07-03added document level Bleu scoring to mertSara Stymne
2013-05-29beautifyHieu Hoang
2013-02-18Implement brevity penalty smoothing for PROBarry Haddow
As in Nakov et al (Coling 2012)
2012-12-07Use boost::unordered_map instead of std::map.Tetsuo Kiso
For storing the word vocabulary used in computation of BLEU scores. This change will reduce the running time of extractor about 2-3 seconds (9% reduction).
2012-11-04Using namespace std in a header file pollutes the global namespace.Tetsuo Kiso
Using directives should be put into the implementation files.
2012-07-17Merge branch 'trunk' into miramergeBarry Haddow
Compiles, not tested. Conflicts: Jamroot OnDiskPt/PhraseNode.h OnDiskPt/TargetPhrase.cpp OnDiskPt/TargetPhrase.h OnDiskPt/TargetPhraseCollection.cpp mert/BleuScorer.cpp mert/Data.cpp mert/FeatureData.cpp moses-chart-cmd/src/Main.cpp moses/src/AlignmentInfo.h moses/src/ChartManager.cpp moses/src/LM/Ken.cpp moses/src/LM/Ken.h moses/src/LMList.h moses/src/LexicalReordering.h moses/src/PhraseDictionaryTree.h moses/src/ScoreIndexManager.h moses/src/StaticData.h moses/src/TargetPhrase.h moses/src/Word.cpp scripts/ems/experiment.meta scripts/ems/experiment.perl scripts/training/train-model.perl
2012-06-30namespace all classes in mert directoryHieu Hoang
2012-06-24merge Lexi Birch's LRScore from mert_mtm5 branch. Compiles and run. Hack, ↵Hieu Hoang
must double check with barry or lexi
2012-06-07mergeEva Hasler
2012-06-01fix start weights in experiment.perl, add hypothesis queue for picking hope ↵Eva Hasler
and fear translations, add variations to 1slack formulation
2012-05-29Batch k-best MIRA is written and integrated into mert-moses.plColin Cherry
Regression tests all check out, and kbmira seems to work fine on a Hansard French->English task. HypPackEnumerator class may be of interest to pro.cpp and future optimizers, as it abstracts a lot of the boilerplate involved in enumerating multiple k-best lists. MiraWeightVector is not really mira-specific - just a weight vector that enables efficient averaging. Could be useful to a perceptron as well. Same goes for MiraFeatureVector. Interaction with sparse features is written, but untested.
2012-05-10changed permission, everything changed..Eva Hasler
2012-05-10Avoid "using namespace std" in headers.Tetsuo Kiso
2012-04-29testEva
2012-04-06Add test cases for BLEU and sentence-level BLEU+1.Tetsuo Kiso
- Move a definition of sentenceLevelBleuPlusOne() from pro.cpp to BleuScorer.cpp. - Add check for the length of an input vector.
2012-04-04Add a test case for BLEU's clipped counts.Tetsuo Kiso
- Make BleuScorer::setReferenceFiles() more testable by adding OpenReference() and OpenReferenceStream().
2012-03-19Add some functions to BleuScorer for unit testing.Tetsuo Kiso
This commit also includes - Fix typo. - Fix indentations. - Add 'const' to Scorer::applyFactors().
2012-03-18Create Reference class to clean up BleuScorer.Tetsuo Kiso
- Add an unit test for Reference. - Move functions to calculate the reference length from BleuScorer to Reference.
2012-03-14Create a header file for NgramCounts class.Tetsuo Kiso
The reason is that we want to add the unit test.
2012-03-09Minor change for calculating BLEU.Tetsuo Kiso
To avoid defining the similar variables twice to calculate document-wise BLEU and sentence-wise BLEU scores.
2012-02-25Minor change the logging utility for n-gram counts.Tetsuo Kiso
Use std::ostream instead of directly using std::cerr.
2012-02-25Clean up calculation effective reference length.Tetsuo Kiso
2012-02-25Hide the implementation details of Ngram counts from the header.Tetsuo Kiso
2012-02-25Clean up commented out code snippets for debugging purposes.Tetsuo Kiso
2012-02-20Change the naming conventions for the guard macros; Rename TER directory.Tetsuo Kiso
This change might be useful to avoid duplicating the names. The reason is that although MERT programs are standalone applications, some header files such as data.h and point.h have common guard macro names like "DATA_H" and "POINT_H", and this is not good naming conventions when you want to include external headers. Some files actually include headers in Moses and KenLM's util.
2012-02-01Add prefix 'm_' to private and protected members in Scorer classes.Tetsuo Kiso
2012-02-01Move reference length type into a private member of BleuScorer.Tetsuo Kiso
The reason is that the type is used as internal purpose.
2011-11-29Fix a typedef for comparing N-grams.Tetsuo Kiso
Declared const_iterator was not *const* actually.
2011-11-29Fix a typedef for comparing N-grams.Tetsuo Kiso
Declared const_iterator was not *const* actually.
2011-11-14Minimize using #include headers in headers.Tetsuo Kiso
Should use it in .cpp files.
2011-11-12Add const member functions in Scorer classes.Tetsuo Kiso
2011-11-12Use const Scorer::calculateScore().Tetsuo Kiso
2011-11-12Simple refactoring of BLEU scorer.Tetsuo Kiso
2011-11-12Fix constructors of scorer classes and optimizer classes.Tetsuo Kiso
Using public const members is not good idea. It should be initialized in private by constructors.
2011-11-12Add 'explicit' for constructors with one argument.Tetsuo Kiso
2011-11-12Remove unnecessary semicolons used in end of member functions.Tetsuo Kiso
2011-11-12Fix class, function, and implementation comments format.Tetsuo Kiso
Functions comments should be placed in their declarations.
2011-11-12Add comments to mark the end of #define guards.Tetsuo Kiso
2011-11-11Fix memory leaks in extractor.Tetsuo Kiso
2011-10-05M mert/TerScorer.cppservan
M mert/BleuScorer.h M mert/ScorerFactory.h M mert/Scorer.h M mert/PerScorer.h M mert/TerScorer.h M mert/Makefile.am AM scripts/training/mert-moses-multi.pl git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4299 1f5c12ca-751b-0410-a591-d2e778427230
2011-08-20Added evaluator to MERT directory. This tool computes a metric score for ↵machacekmatous
given candidate and reference files: evaluator --sctype PER --reference ref.file --candidate cand.file usage: evaluator [options] --reference ref1[,ref2[,ref3...]] --candidate cand1[,cand2[,cand3...]] [--sctype|-s] the scorer type (default BLEU) [--scconfig|-c] configuration string passed to scorer This is of the form NAME1:VAL1,NAME2:VAL2 etc [--reference|-R] comma separated list of reference files [--candidate|-C] comma separated list of candidate files [--bootstrap|-b] number of booststraped samples (default 0 - no bootstraping) [--rseed|-r] the random seed for bootstraping (defaults to system clock) [--help|-h] print this message and exit git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4153 1f5c12ca-751b-0410-a591-d2e778427230
2011-02-24run beautify.perl. Consistent formatting for .h & .cpp fileshieuhoang1972
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3899 1f5c12ca-751b-0410-a591-d2e778427230
2009-08-05mert software now works with different reference length policies: shortest, ↵nicolabertoldi
average, closest (default) and with case information (default is preserving case). Pay attention that both defaults are different from the previous version (which were shortest reflen and case-insensitive). git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@2459 1f5c12ca-751b-0410-a591-d2e778427230
2008-10-17added headers for standard compliance (gcc 4.3 on 64 bit linux)phkoehn
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1905 1f5c12ca-751b-0410-a591-d2e778427230
generated by cgit v1.2.3 (git 2.25.1) at 2024-09-01 18:28:03 +0300