You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I got the weird problem. Before it happened, I ran the command /.run-me.sh with -w 1024 (by default: -w 3000. Of course, it would take very long time to finish translation between English-Romanian with marian-examples.
I decided to stop running, added --max-length 30, and ran the command again.
The error is:
#!/bin/bash -v
MARIAN=../../build
# if we are in WSL, we need to add '.exe' to the tool names
if [ -e "/bin/wslpath" ]
then
EXT=.exe
fi
MARIAN_TRAIN=$MARIAN/marian$EXT
MARIAN_DECODER=$MARIAN/marian-decoder$EXT
MARIAN_VOCAB=$MARIAN/marian-vocab$EXT
MARIAN_SCORER=$MARIAN/marian-scorer$EXT
# set chosen gpus
GPUS=0
if [ $# -ne 0 ]
then
GPUS=$@
fi
echo Using GPUs: $GPUS
Using GPUs: 0
if [ ! -e $MARIAN_TRAIN ]
then
echo "marian is not installed in $MARIAN, you need to compile the toolkit first"
exit 1
fi
if [ ! -e ../tools/moses-scripts ] || [ ! -e ../tools/subword-nmt ]
then
echo "missing tools in ../tools, you need to download them first"
exit 1
fi
if [ ! -e "data/corpus.en" ]
then
./scripts/download-files.sh
fi
mkdir -p model
# preprocess data
if [ ! -e "data/corpus.bpe.en" ]
then
./scripts/preprocess-data.sh
fi
# train model
if [ ! -e "model/model.npz.best-translation.npz" ]
then
$MARIAN_TRAIN \
--devices $GPUS \
--type amun \
--model model/model.npz \
--train-sets data/corpus.bpe.ro data/corpus.bpe.en \
--vocabs model/vocab.ro.yml model/vocab.en.yml \
--dim-vocabs 66000 50000 \
--mini-batch-fit -w 1024 \
--max-length 50
--layer-normalization --dropout-rnn 0.2 --dropout-src 0.1 --dropout-trg 0.1 \
--early-stopping 5 \
--valid-freq 10000 --save-freq 10000 --disp-freq 1000 \
--valid-metrics cross-entropy translation \
--valid-sets data/newsdev2016.bpe.ro data/newsdev2016.bpe.en \
--valid-script-path "bash ./scripts/validate.sh" \
--log model/train.log --valid-log model/valid.log \
--overwrite --keep-best \
--seed 1111 --exponential-smoothing \
--normalize=1 --beam-size=12 --quiet-translation
fi
[2019-05-17 09:17:00] Error: There are option(s) in a config file that are not expected
[2019-05-17 09:17:00] Error: Aborted from void marian::ConfigParser::parseOptions(int, char**, bool) in /tmp/marian/src/common/config_parser.cpp:707
[CALL STACK]
[0x6d134e] marian::ConfigParser:: parseOptions (int, char**, bool) + 0x5ae
[0x6aa64f] marian::Config:: initialize (int, char**, marian::cli::mode, bool) + 0x7f
[0x6acd5d] marian::Config:: Config (int, char**, marian::cli::mode, bool) + 0x2d
[0x6acdcd] marian:: parseOptions (int, char**, marian::cli::mode, bool) + 0x3d
[0x59c722] mainTrainer (int, char**) + 0x42
[0x57afba] main + 0x8a
[0x7f7ec316d830] __libc_start_main + 0xf0
[0x59a219] _start + 0x29
How can I fix it? Please let me know.
Thanks in advance.
Supachan
The text was updated successfully, but these errors were encountered:
I got the weird problem. Before it happened, I ran the command
/.run-me.sh
with-w 1024
(by default:-w 3000
. Of course, it would take very long time to finish translation between English-Romanian with marian-examples.I decided to stop running, added
--max-length 30
, and ran the command again.The error is:
How can I fix it? Please let me know.
Thanks in advance.
Supachan
The text was updated successfully, but these errors were encountered: