length(results_phe_filename) not equal to 1

[richelbilderbeek]

All the other runs worked, except this one:

Parameters: /proj/sens2021565/nobackup/nsphs_ml_qt_results/data_issue_42_M1_p1_100/experiment_params.csv
Number of parameters: 1
Correct number of arguments: 1
gcae_experiment_params_filename: /proj/sens2021565/nobackup/nsphs_ml_qt_results/data_issue_42_M1_p1_100/experiment_params.csv
singularity_filename: nsphs_ml_qt/nsphs_ml_qt.sif
Starting time: 2022-06-17T16:21:46+0200
Running on computer with HOSTNAME: sens2021565-b10
Running at location /home/richel
'nsphs_ml_qt.sif' running with arguments 'Rscript nsphs_ml_qt/scripts_rackham/25_run.R /proj/sens2021565/nobackup/nsphs_ml_qt_results/data_issue_42_M1_p1_100/experiment_params.csv'
gcae_experiment_params_filename: /proj/sens2021565/nobackup/nsphs_ml_qt_results/data_issue_42_M1_p1_100/experiment_params.csv
Running the GCAE experiment
Error: length(results_phe_filename) not equal to 1.
1/1 mismatches
[1] 0 - 1 == -1
In addition: Warning message:
In system2(command = run_args[1], args = run_args[-1], stdout = TRUE,  :
  running command ''python3' /opt/gcae_richel/run_gcae.py train --datadir /proj/sens2021565/nobackup/nsphs_ml_qt_results/data_issue_42_M1_p1_100/ --data data_issue_42_M1_p1_100 --model_id M1 --resume_from 40 --epochs 10 --save_interval 10 --train_opts_id ex3 --data_opts_id b_0_4 --trainedmodeldir /proj/sens2021565/nobackup/nsphs_ml_qt_results/data_issue_42_M1_p1_100_ae/ --pheno_model_id p1 2>&1' had status 1
Execution halted
End time: 2022-06-17T16:41:14+0200
Duration: 1168 seconds

25_run_issue_42_M1_p1_100.log

[richelbilderbeek]

I would think this has to do with concurrency:

The z...... filenames (6 in total) hint of that. They are binary, so no idea what they are.