Welcome to mirror list, hosted at ThFree Co, Russian Federation.

README.md - github.com/marian-nmt/marian-regression-tests.git - Unnamed repository; edit this file 'description' to name the repository.
summaryrefslogtreecommitdiff
blob: e5438b566e9269e5e8b5904e173026a3c62d76f5 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
Marian regression tests
=======================

**Marian** is a C++ GPU-specific parallel automatic differentiation library
with operator overloading. It is the training framework used in the Marian
toolkit.

This repository contains the regression test framework for the repo of
`https://github.com/marian-nmt/marian-dev`.


## Structure

Directories:

* `tests` - regression tests
* `tools` - scripts and repositories
* `models` - models used in regression tests
* `data` - data used for training or translating

Each test consists of:

* `test_*.sh` files
* `setup.sh` (optional)
* `teardown.sh` (optional)

## Usage

Download data and compile tools:

```
make install
```

Run regression tests:

```
./run_mrt.sh
```

or a specific group of tests, e.g.:

```
./run_mrt tests/translation
```

To specify which GPU device should be used to run tests, set the
`CUDA_VISIBLE_DEVICES` variable, e.g.:

```
CUDA_VISIBLE_DEVICES=2 && ./run_mrt.sh
```

## TODO:

* add a test for marian-server
* add a test for restarting training
* add descriptions of tests
* add logging tests

## Acknowledgements

The development of Marian received funding from the European Union's
_Horizon 2020 Research and Innovation Programme_ under grant agreements
688139 ([SUMMA](http://www.summa-project.eu); 2016-2019),
645487 ([Modern MT](http://www.modernmt.eu); 2015-2017) and
644333 ([TraMOOC](http://tramooc.eu/); 2015-2017),
the Amazon Academic Research Awards program, and
the World Intellectual Property Organization.