Double data?

[duyvuleo]

Hi Marcin,

May I need you to clarify something?

'''
if [ ! -e "data/all.bpe.en" ]
then
cat data/corpus.bpe.en data/corpus.bpe.en data/news.2016.bpe.en > data/all.bpe.en
cat data/corpus.bpe.de data/corpus.bpe.de data/news.2016.bpe.de > data/all.bpe.de
fi
'''

Why do you need to double the parallel data (corpus.bpe.{en,de})?

Thanks!

[duyvuleo]

I understood this. It is to fit with sample size of synthetic data.