Welcome to mirror list, hosted at ThFree Co, Russian Federation.

github.com/TharinduDR/TransQuest.git - Unnamed repository; edit this file 'description' to name the repository.
summaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authorTharinduDR <rhtdranasinghe@gmail.com>2021-06-03 20:18:22 +0300
committerTharinduDR <rhtdranasinghe@gmail.com>2021-06-03 20:18:22 +0300
commitaf45e485ead27001fa05e7c7312e350412955b9e (patch)
tree0edda0b0f4b514bdd73093827ce04fdeefc2982a
parent66ae8f324989e2e910f7e7ddb953b819cbdea0a3 (diff)
057: Code Refactoring - Siamese Architectures
-rw-r--r--docs/models/sentence_level_pretrained.md52
-rw-r--r--docs/models/word_level_pretrained.md5
2 files changed, 30 insertions, 27 deletions
diff --git a/docs/models/sentence_level_pretrained.md b/docs/models/sentence_level_pretrained.md
index f79c681..ba57f92 100644
--- a/docs/models/sentence_level_pretrained.md
+++ b/docs/models/sentence_level_pretrained.md
@@ -10,25 +10,25 @@ We have released several quality estimation models for this aspect. We have also
| Language Pair | NMT/SMT | Domain | Algorithm | Model Link |
|:---------------:|:--------------:|:------------:|:-------------------:|:------------------------------------:|
-| Romanian-English| NMT | Wikipedia | MonoTransQuest | [model.zip](http://bit.ly/3s7WOnS) |
-| | | | SiameseTransQuest | [model.zip](https://bit.ly/37vT4mt) |
-| Estonian-English| NMT | Wikipedia | MonoTransQuest | [model.zip](http://bit.ly/3tD5Jhm) |
-| | | | SiameseTransQuest | [model.zip](https://bit.ly/30mO5mW) |
-| Nepalese-English| NMT | Wikipedia | MonoTransQuest | [model.zip](http://bit.ly/3lwvsVT) |
-| | | | SiameseTransQuest | [model.zip](https://bit.ly/3h674bc) |
-| Sinhala-English | NMT | Wikipedia | MonoTransQuest | [model.zip](http://bit.ly/3cMXdpf) |
-| | | | SiameseTransQuest | [model.zip](https://bit.ly/3foBSlP) |
-| Russian-English | NMT | Wikipedia | MonoTransQuest | [model.zip](http://bit.ly/3lx5L7H) |
-| | | | SiameseTransQuest | [model.zip](https://bit.ly/2B3UM2D) |
-| English-German | NMT | Wikipedia | MonoTransQuest | [model.zip](http://bit.ly/3bZmr4y) |
-| | | | SiameseTransQuest | [model.zip](https://bit.ly/3d8gT5n) |
-| English-Chinese | NMT | Wikipedia | MonoTransQuest | [model.zip](http://bit.ly/3vGrApX) |
-| | | | SiameseTransQuest | [model.zip](https://bit.ly/3h4WSQ8) |
-| English-\* | Any | Any | MonoTransQuest | [model.zip](http://bit.ly/38Vp6KG) |
+| Romanian-English| NMT | Wikipedia | MonoTransQuest | [TransQuest/monotransquest-da-ro_en-wiki](https://huggingface.co/TransQuest/monotransquest-da-ro_en-wiki) |
+| | | | SiameseTransQuest | [TransQuest/siamesetransquest-da-ro_en-wiki](https://huggingface.co/TransQuest/siamesetransquest-da-ro_en-wiki) |
+| Estonian-English| NMT | Wikipedia | MonoTransQuest | [TransQuest/monotransquest-da-et_en-wiki](https://huggingface.co/TransQuest/monotransquest-da-et_en-wiki) |
+| | | | SiameseTransQuest | [TransQuest/siamesetransquest-da-et_en-wiki](https://huggingface.co/TransQuest/siamesetransquest-da-et_en-wiki) |
+| Nepalese-English| NMT | Wikipedia | MonoTransQuest | [TransQuest/monotransquest-da-ne_en-wiki](https://huggingface.co/TransQuest/monotransquest-da-ne_en-wiki) |
+| | | | SiameseTransQuest | [TransQuest/siamesetransquest-da-ne_en-wiki](https://huggingface.co/TransQuest/siamesetransquest-da-ne_en-wiki) |
+| Sinhala-English | NMT | Wikipedia | MonoTransQuest | [TransQuest/monotransquest-da-ne_en-wiki](https://huggingface.co/TransQuest/monotransquest-da-ne_en-wiki) |
+| | | | SiameseTransQuest | [TransQuest/siamesetransquest-da-si_en-wiki](https://huggingface.co/TransQuest/siamesetransquest-da-si_en-wiki) |
+| Russian-English | NMT | Wikipedia | MonoTransQuest | [TransQuest/monotransquest-da-ru_en-reddit_wikiquotes](https://huggingface.co/TransQuest/monotransquest-da-ru_en-reddit_wikiquotes) |
+| | | | SiameseTransQuest | [TransQuest/siamesetransquest-da-ru_en-reddit_wikiquotes](https://huggingface.co/TransQuest/siamesetransquest-da-ru_en-reddit_wikiquotes) |
+| English-German | NMT | Wikipedia | MonoTransQuest | [TransQuest/monotransquest-da-en_de-wiki](https://huggingface.co/TransQuest/monotransquest-da-en_de-wiki) |
+| | | | SiameseTransQuest | [TransQuest/siamesetransquest-da-en_de-wiki](https://huggingface.co/TransQuest/siamesetransquest-da-en_de-wiki) |
+| English-Chinese | NMT | Wikipedia | MonoTransQuest | [TransQuest/monotransquest-da-en_zh-wiki](https://huggingface.co/TransQuest/monotransquest-da-en_zh-wiki) |
+| | | | SiameseTransQuest | [TransQuest/siamesetransquest-da-en_zh-wiki](https://huggingface.co/TransQuest/siamesetransquest-da-en_zh-wiki) |
+| English-\* | Any | Any | MonoTransQuest | [TransQuest/monotransquest-da-en_any](https://huggingface.co/TransQuest/monotransquest-da-en_any) |
| | | | SiameseTransQuest | |
-| \*-English | Any | Any | MonoTransQuest | [model.zip](http://bit.ly/3vKgX5u) |
+| \*-English | Any | Any | MonoTransQuest | [TransQuest/monotransquest-da-any_en](https://huggingface.co/TransQuest/monotransquest-da-any_en) |
| | | | SiameseTransQuest | |
-| \*-\* | Any | Any | MonoTransQuest | [model.zip](http://bit.ly/3eVOS5n) |
+| \*-\* | Any | Any | MonoTransQuest | [TransQuest/monotransquest-da-multilingual](https://huggingface.co/TransQuest/monotransquest-da-multilingual) |
| | | | SiameseTransQuest | |
!!! note
@@ -43,19 +43,21 @@ We have released several quality estimation models for this aspect. We have also
| Language Pair | NMT/SMT | Domain | Algorithm | Model Link |
|:---------------:|:--------------:|:------------:|:-------------------:|:------------------------------------:|
-| English-German | NMT | Wikipedia | MonoTransQuest | [model.zip](https://bit.ly/37tkTvZ) |
-| | | | SiameseTransQuest | [model.zip](https://bit.ly/3icI5Dw) |
-| | SMT | IT | MonoTransQuest | [model.zip](https://bit.ly/3dNafBx) |
+| English-German | NMT | Wikipedia | MonoTransQuest | [TransQuest/monotransquest-hter-en_de-wiki](https://huggingface.co/TransQuest/monotransquest-hter-en_de-wiki) |
+| | | | SiameseTransQuest | |
+| | NMT | IT | MonoTransQuest | [TransQuest/monotransquest-hter-en_de-it-nmt](https://huggingface.co/TransQuest/monotransquest-hter-en_de-it-nmt) |
| | | | SiameseTransQuest | |
-| English-Latvian | SMT | Life Sciences| MonoTransQuest | [model.zip](https://bit.ly/3gkY7JX) |
+| | SMT | IT | MonoTransQuest | [TransQuest/monotransquest-hter-en_de-it-smt](https://huggingface.co/TransQuest/monotransquest-hter-en_de-it-smt) |
+| | | | SiameseTransQuest | |
+| English-Latvian | SMT | Life Sciences| MonoTransQuest | [TransQuest/monotransquest-hter-en_lv-it-nmt](https://huggingface.co/TransQuest/monotransquest-hter-en_lv-it-nmt) |
| | | | SiameseTransQuest | |
-| English-Latvian | NMT | Life Sciences| MonoTransQuest | [model.zip](https://bit.ly/3eLb1jU) |
+| | NMT | Life Sciences| MonoTransQuest | [TransQuest/monotransquest-hter-en_lv-it-smt](https://huggingface.co/TransQuest/monotransquest-hter-en_lv-it-smt) |
| | | | SiameseTransQuest | |
-| English-Czech | SMT | IT | MonoTransQuest | [model.zip](https://bit.ly/2VyBOZ2) |
+| English-Czech | SMT | IT | MonoTransQuest | [TransQuest/monotransquest-hter-en_cs-pharmaceutical](https://huggingface.co/TransQuest/monotransquest-hter-en_cs-pharmaceutical) |
| | | | SiameseTransQuest | |
-| German-English | SMT | Life Sciences| MonoTransQuest | [model.zip](https://bit.ly/3dRlqJu) |
+| German-English | SMT | Life Sciences| MonoTransQuest | [TransQuest/monotransquest-hter-de_en-pharmaceutical](https://huggingface.co/TransQuest/monotransquest-hter-de_en-pharmaceutical) |
| | | | SiameseTransQuest | |
-| English-Chinese | NMT | Wikipedia | MonoTransQuest | [model.zip](https://bit.ly/2YLIvJw) |
+| English-Chinese | NMT | Wikipedia | MonoTransQuest | [TransQuest/monotransquest-hter-en_zh-wiki](https://huggingface.co/TransQuest/monotransquest-hter-en_zh-wiki) |
| | | | SiameseTransQuest | |
| English-* | Any | Any | MonoTransQuest | |
| | | | SiameseTransQuest | |
diff --git a/docs/models/word_level_pretrained.md b/docs/models/word_level_pretrained.md
index b173c6c..5c7e016 100644
--- a/docs/models/word_level_pretrained.md
+++ b/docs/models/word_level_pretrained.md
@@ -18,15 +18,16 @@ We have released several pre-trained TransQuest models on word-level quality est
| \*-\* | Any | Any | MicroTransQuest | |
You can load any of the above models with the below code. The full notebook is available [here.](https://colab.research.google.com/drive/1fslfFoQnspdv2Do5hfwwkbEwow-CDIxD?usp=sharing)
+Let's consider loading microtransquest-en_lv-pharmaceutical-nmt model.
```python
from transquest.algo.word_level.microtransquest.run_model import MicroTransQuestModel
import torch
model = MicroTransQuestModel("xlmroberta", "TransQuest/microtransquest-en_lv-pharmaceutical-nmt", labels=["OK", "BAD"], use_cuda=torch.cuda.is_available())
-```
-
+source_tags, target_tags = model.predict([["if not , you may not be protected against the diseases . ", "ja tā nav , Jūs varat nepasargāt no slimībām . "]])
+```
!!! note