blob: e5438b566e9269e5e8b5904e173026a3c62d76f5 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
|
Marian regression tests
=======================
**Marian** is a C++ GPU-specific parallel automatic differentiation library
with operator overloading. It is the training framework used in the Marian
toolkit.
This repository contains the regression test framework for the repo of
`https://github.com/marian-nmt/marian-dev`.
## Structure
Directories:
* `tests` - regression tests
* `tools` - scripts and repositories
* `models` - models used in regression tests
* `data` - data used for training or translating
Each test consists of:
* `test_*.sh` files
* `setup.sh` (optional)
* `teardown.sh` (optional)
## Usage
Download data and compile tools:
```
make install
```
Run regression tests:
```
./run_mrt.sh
```
or a specific group of tests, e.g.:
```
./run_mrt tests/translation
```
To specify which GPU device should be used to run tests, set the
`CUDA_VISIBLE_DEVICES` variable, e.g.:
```
CUDA_VISIBLE_DEVICES=2 && ./run_mrt.sh
```
## TODO:
* add a test for marian-server
* add a test for restarting training
* add descriptions of tests
* add logging tests
## Acknowledgements
The development of Marian received funding from the European Union's
_Horizon 2020 Research and Innovation Programme_ under grant agreements
688139 ([SUMMA](http://www.summa-project.eu); 2016-2019),
645487 ([Modern MT](http://www.modernmt.eu); 2015-2017) and
644333 ([TraMOOC](http://tramooc.eu/); 2015-2017),
the Amazon Academic Research Awards program, and
the World Intellectual Property Organization.
|