Skip to content

Latest commit

 

History

History
90 lines (77 loc) · 4.47 KB

result-stat.md

File metadata and controls

90 lines (77 loc) · 4.47 KB

Regression

  • MOSI
Model Has0_acc_2 Has0_F1_score Non0_acc_2 Non0_F1_score Mult_acc_5 Mult_acc_7 MAE Corr Data Setting
ef_lstm 77.38 77.35 78.48 78.51 40.15 35.39 94.88 66.9 Aligned
lf_dnn 77.52 77.46 78.63 78.63 38.05 34.52 95.48 65.84 Unaligned
tfn 77.99 77.95 79.08 79.11 39.39 34.46 94.73 67.33 Unaligned
lmf 77.9 77.8 79.18 79.15 38.13 33.82 95.04 65.1 Unaligned
mfn 77.67 77.63 78.87 78.90 40.47 35.83 92.68 67.02 Aligned
graph_mfn 77.14 77.08 78.35 78.35 38.63 34.64 95.57 64.86 Aligned
mult 79.71 79.63 80.98 80.95 42.68 36.91 87.99 70.22 Unaligned
misa 81.84 81.82 83.54 83.58 47.08 41.37 77.65 77.81 Unaligned
self_mm 83.44 83.36 85.46 85.43 53.47 46.67 70.80 79.63 Unaligned
  • MOSEI
Model Has0_acc_2 Has0_F1_score Non0_acc_2 Non0_F1_score Mult_acc_5 Mult_acc_7 MAE Corr Data Setting
ef_lstm 77.84 78.34 80.79 80.67 51.16 50.01 60.05 68.25 Aligned
lf_dnn 80.6 80.85 82.74 82.52 51.97 50.83 58.02 70.87 Unaligned
tfn 78.50 78.96 81.89 81.74 53.1 51.6 57.26 71.41 Unaligned
lmf 80.54 80.94 83.48 83.36 52.99 51.59 57.57 71.69 Unaligned
mfn 78.94 79.55 82.86 82.85 52.76 51.34 57.33 71.82 Aligned
graph_mfn 81.28 81.48 83.48 83.23 52.69 51.37 57.45 71.33 Aligned
mult 81.15 81.56 84.63 84.52 54.18 52.84 55.93 73.31 Unaligned
misa 80.67 81.12 84.67 84.66 53.63 52.05 55.75 75.15 Unaligned
self_mm 83.76 83.82 85.15 84.90 55.53 53.87 53.09 76.49 Unaligned
  • SIMS
Model Mult_acc_2 Mult_acc_3 Mult_acc_5 F1_score MAE Corr Data Setting
ef_lstm 69.37 54.27 21.23 56.82 59.07 5.45 Unaligned
lf_dnn 77.02 64.33 39.74 77.27 44.63 55.51 Unaligned
tfn 78.38 65.12 39.3 78.62 43.22 59.1 Unaligned
lmf 77.77 64.68 40.53 77.88 44.12 57.59 Unaligned
mfn 77.9 65.73 39.47 77.88 43.49 58.24 Unaligned
graph_mfn 78.77 65.65 39.82 78.21 44.5 57.84 Unaligned
mult 78.56 64.77 37.94 79.66 45.32 56.41 Unaligned
mlf_dnn 80.44 69.37 40.22 80.28 39.58 66.52 Unaligned
mtfn 81.09 68.80 40.31 81.01 39.54 66.58 Unaligned
mlmf 79.34 68.36 41.05 79.07 40.91 63.90 Unaligned
self_mm 80.04 65.47 41.53 80.44 42.50 59.52 Unaligned

Classification

Data setting is the same as Regression

  • MOSI
Model Has0_acc_2 Has0_F1_score Non0_acc_2 Non0_F1_score Acc_3 F1_score_3
ef_lstm 76.65 76.69 46.40 46.55 74.43 72.74
lf_dnn 76.73 76.82 46.13 46.62 74.64 72.99
tfn 75.33 75.24 43.78 45.55 73.44 71.86
lmf 76.01 76.11 45.76 46.34 74.11 72.50
mfn 77.23 77.17 46.68 46.78 74.99 73.22
graph_mfn 77.38 77.50 46.13 46.96 75.34 73.71
mult 77.41 77.20 48.93 47.29 74.99 73.06
misa 78.34 78.32 44.15 46.75 76.30 74.57
  • MOSEI
Model Has0_acc_2 Has0_F1_score Non0_acc_2 Non0_F1_score Acc_3 F1_score_3
ef_lstm 70.36 69.27 26.73 28.12 66.09 63.68
lf_dnn 71.18 70.14 27.19 28.67 67.35 64.65
tfn 71.54 70.91 28.66 28.75 66.63 63.93
lmf 71.90 71.26 28.86 28.92 66.59 64.86
mfn 71.49 70.80 28.61 28.70 66.59 64.31
graph_mfn 71.25 70.51 28.47 28.77 66.39 64.00
mult 71.23 70.23 27.38 28.67 67.04 65.01
misa 71.44 70.56 28.40 29.03 67.63 65.39
  • SIMS
Model Has0_acc_2 Has0_F1_score Non0_acc_2 Non0_F1_score Acc_3 F1_score_3
ef_lstm 69.37 56.82 63.92 49.85 54.27 38.18
lf_dnn 79.87 79.97 56.70 55.27 70.20 65.29
tfn 75.32 75.66 53.56 52.79 65.95 62.04
lmf 77.99 77.59 57.06 53.83 66.87 62.46
mfn 78.25 78.08 56.96 54.14 67.57
graph_mfn 79.21 78.92 57.99 54.66 68.44 63.44
mult 78.07 78.07 56.34 54.26 68.27 64.23
misa 78.07 77.70 57.27 53.99 67.05 60.98
mlf_dnn 80.79 80.59 58.19 55.55 70.37 65.94
mtfn 81.23 81.24 56.91 55.29 70.28 66.44
mlmf 81.45 81.62 56.60 55.66 71.60 70.45