diff options
| author | bgottesman <bgottesman@1f5c12ca-751b-0410-a591-d2e778427230> | 2011-08-08 19:30:54 +0400 |
|---|---|---|
| committer | bgottesman <bgottesman@1f5c12ca-751b-0410-a591-d2e778427230> | 2011-08-08 19:30:54 +0400 |
| commit | 24f5bf6723460d838e2ef03158d0ff6ce700ddbf (patch) | |
| tree | 5373beced8b88140adec152286a23621139aa8f9 /regression-testing | |
| parent | 14587cdafc42cdbff9221c07b5545551ecec475b (diff) | |
when detokenizing, remove whitespace between a pair of CJK (Chinese/Japanese/Korean) words
This gets the Chinese and Japanese tests working, so remove the failure expectation.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4134 1f5c12ca-751b-0410-a591-d2e778427230
Diffstat (limited to 'regression-testing')
| -rw-r--r-- | regression-testing/run-test-detokenizer.t | 14 |
1 files changed, 2 insertions, 12 deletions
diff --git a/regression-testing/run-test-detokenizer.t b/regression-testing/run-test-detokenizer.t index 9d677b43e..da6585cc8 100644 --- a/regression-testing/run-test-detokenizer.t +++ b/regression-testing/run-test-detokenizer.t @@ -107,9 +107,7 @@ Frau Präsidentin! Frau Díez González und ich hatten einige Anfragen EXP ); -# A (failing) simple Chinese test -{ -my $testCase = +# A simple Chinese test &addDetokenizerTest("TEST_CHINESE_EASY", undef, <<'TOK' 这 是 一个 简单 的的 汉语 句子 。 @@ -120,12 +118,7 @@ TOK EXP ); -$testCase->setExpectedToFail("Chinese detokenization is not implemented yet."); -} - -# A (failing) simple Japanese test -{ -my $testCase = +# A simple Japanese test &addDetokenizerTest("TEST_JAPANESE_EASY", undef, <<'TOK' どう しょ う か な 。 @@ -138,9 +131,6 @@ TOK EXP ); -$testCase->setExpectedToFail("Japanese detokenization is not implemented yet."); -} - ###################################### # Now run those babies ... |