diff options
| author | TharinduDR <rhtdranasinghe@gmail.com> | 2020-10-13 17:49:51 +0300 |
|---|---|---|
| committer | TharinduDR <rhtdranasinghe@gmail.com> | 2020-10-13 17:49:51 +0300 |
| commit | f33a00e12b1e0ccb2262dba6f77e4636baded41b (patch) | |
| tree | f83a86c982f306f66fae8f4cf2bbe89dec44a5e9 /docs | |
| parent | f47d36e7f735d13161fca98c24df741af20dcead (diff) | |
033: Adding documentation
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/pretrained.md | 46 |
1 files changed, 45 insertions, 1 deletions
diff --git a/docs/pretrained.md b/docs/pretrained.md index 00fd964..a5b45df 100644 --- a/docs/pretrained.md +++ b/docs/pretrained.md @@ -2,9 +2,53 @@ We have released several pre-trained TransQuest models on two aspects in sentence-level quality estimation. We will be keep releasing new models. So please keep in touch. ## Predicting HTER +The performance of QE systems has typically been assessed using the semiautomatic HTER (Human-mediated Translation Edit Rate). HTER is an edit-distance-based measure which captures the distance between the automatic translation and a reference translation in terms of the number of modifications required to transform one into another. In light of this, a QE system should be able to predict the percentage of edits required in the translation. + +We have released several quality estimation models for this aspect. We have also released a couple of multi-language pair models that would work on any language pair in any domain. ### Available Models +| Language Pair | NMT/SMT | Domain | Algorithm | Model Link | +|:---------------:|:--------------:|:------------:|:-------------------:|:------------------------------------:| +| English-German | NMT | Wikipedia | MonoTransQuest | [model.zip](https://bit.ly/37tkTvZ) | +| | | | SiameseTransQuest | [model.zip](https://bit.ly/3icI5Dw) | +| | SMT | IT | MonoTransQuest | [model.zip](https://bit.ly/3dNafBx) | +| | | | SiameseTransQuest | | +| English-Latvian | SMT | Life Sciences| MonoTransQuest | [model.zip](https://bit.ly/3gkY7JX) | +| | | | SiameseTransQuest | | +| English-Latvian | NMT | Life Sciences| MonoTransQuest | [model.zip](https://bit.ly/3eLb1jU) | +| | | | SiameseTransQuest | | +| English-Czech | SMT | IT | MonoTransQuest | [model.zip](https://bit.ly/2VyBOZ2) | +| | | | SiameseTransQuest | | +| German-English | SMT | Life Sciences| MonoTransQuest | [model.zip](https://bit.ly/3dRlqJu) | +| | | | SiameseTransQuest | | +| English-Chinese | NMT | Wikipedia | MonoTransQuest | [model.zip](https://bit.ly/2YLIvJw) | +| | | | SiameseTransQuest | | + + + ## Predicting Direct Assessment +The current practice in MT evaluation is the so-called Direct Assessment (DA) of MT quality, where raters evaluate the machine translation on a continuous 1-100 scale. This method has been shown to improve the reproducibility of manual evaluation and to provide a more reliable gold standard for automatic evaluation metrics + +We have released several quality estimation models for this aspect. We have also released a couple of multi-language pair models that would work on any language pair in any domain. + +### Available Models + +| Language Pair | NMT/SMT | Domain | Algorithm | Model Link | +|:---------------:|:--------------:|:------------:|:-------------------:|:------------------------------------:| +| Romanian-English| NMT | Wikipedia | MonoTransQuest | [model.zip](https://bit.ly/37tkTvZ) | +| | | | SiameseTransQuest | [model.zip](https://bit.ly/3icI5Dw) | +| Estonian-English| NMT | Wikipedia | MonoTransQuest | [model.zip](https://bit.ly/3gkY7JX) | +| | | | SiameseTransQuest | | +| Nepalese-English| NMT | Wikipedia | MonoTransQuest | [model.zip](https://bit.ly/3eLb1jU) | +| | | | SiameseTransQuest | | +| Sinhala-English | NMT | Wikipedia | MonoTransQuest | [model.zip](https://bit.ly/2VyBOZ2) | +| | | | SiameseTransQuest | | +| Russian-English | NMT | Wikipedia | MonoTransQuest | [model.zip](https://bit.ly/3dRlqJu) | +| | | | SiameseTransQuest | | +| English-German | NMT | Wikipedia | MonoTransQuest | [model.zip](https://bit.ly/2YLIvJw) | +| | | | SiameseTransQuest | | +| English-Chinese | NMT | Wikipedia | MonoTransQuest | [model.zip](https://bit.ly/2YLIvJw) | +| | | | SiameseTransQuest | | + -### Available Models
\ No newline at end of file |