Skip to content
This repository was archived by the owner on Jul 7, 2023. It is now read-only.

Commit 5418429

Browse files
committed
utils: input sentence is no longer shown in decoded file (correct bleu calculation script for en-de)
1 parent 422aac7 commit 5418429

File tree

1 file changed

+1
-3
lines changed

1 file changed

+1
-3
lines changed

tensor2tensor/utils/get_ende_bleu.sh

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -5,10 +5,8 @@ tok_gold_targets=newstest2013.tok.de
55

66
decodes_file=$1
77

8-
cut -d' ' -f1 $decodes_file > $decodes_file.target
9-
108
# Tokenize.
11-
perl $mosesdecoder/scripts/tokenizer/tokenizer.perl -l de < $decodes_file.target > $decodes_file.tok
9+
perl $mosesdecoder/scripts/tokenizer/tokenizer.perl -l de < $decodes_file > $decodes_file.tok
1210

1311
# Put compounds in ATAT format (comparable to papers like GNMT, ConvS2S).
1412
# See https://nlp.stanford.edu/projects/nmt/ :

0 commit comments

Comments
 (0)