- MOSI
Model | Has0_acc_2 | Has0_F1_score | Non0_acc_2 | Non0_F1_score | Mult_acc_5 | Mult_acc_7 | MAE | Corr | Data Setting |
---|---|---|---|---|---|---|---|---|---|
ef_lstm | 77.38 | 77.35 | 78.48 | 78.51 | 40.15 | 35.39 | 94.88 | 66.9 | Aligned |
lf_dnn | 77.52 | 77.46 | 78.63 | 78.63 | 38.05 | 34.52 | 95.48 | 65.84 | Unaligned |
tfn | 77.99 | 77.95 | 79.08 | 79.11 | 39.39 | 34.46 | 94.73 | 67.33 | Unaligned |
lmf | 77.9 | 77.8 | 79.18 | 79.15 | 38.13 | 33.82 | 95.04 | 65.1 | Unaligned |
mfn | 77.67 | 77.63 | 78.87 | 78.90 | 40.47 | 35.83 | 92.68 | 67.02 | Aligned |
graph_mfn | 77.14 | 77.08 | 78.35 | 78.35 | 38.63 | 34.64 | 95.57 | 64.86 | Aligned |
mult | 79.71 | 79.63 | 80.98 | 80.95 | 42.68 | 36.91 | 87.99 | 70.22 | Unaligned |
misa | 81.84 | 81.82 | 83.54 | 83.58 | 47.08 | 41.37 | 77.65 | 77.81 | Unaligned |
self_mm | 83.44 | 83.36 | 85.46 | 85.43 | 53.47 | 46.67 | 70.80 | 79.63 | Unaligned |
- MOSEI
Model | Has0_acc_2 | Has0_F1_score | Non0_acc_2 | Non0_F1_score | Mult_acc_5 | Mult_acc_7 | MAE | Corr | Data Setting |
---|---|---|---|---|---|---|---|---|---|
ef_lstm | 77.84 | 78.34 | 80.79 | 80.67 | 51.16 | 50.01 | 60.05 | 68.25 | Aligned |
lf_dnn | 80.6 | 80.85 | 82.74 | 82.52 | 51.97 | 50.83 | 58.02 | 70.87 | Unaligned |
tfn | 78.50 | 78.96 | 81.89 | 81.74 | 53.1 | 51.6 | 57.26 | 71.41 | Unaligned |
lmf | 80.54 | 80.94 | 83.48 | 83.36 | 52.99 | 51.59 | 57.57 | 71.69 | Unaligned |
mfn | 78.94 | 79.55 | 82.86 | 82.85 | 52.76 | 51.34 | 57.33 | 71.82 | Aligned |
graph_mfn | 81.28 | 81.48 | 83.48 | 83.23 | 52.69 | 51.37 | 57.45 | 71.33 | Aligned |
mult | 81.15 | 81.56 | 84.63 | 84.52 | 54.18 | 52.84 | 55.93 | 73.31 | Unaligned |
misa | 80.67 | 81.12 | 84.67 | 84.66 | 53.63 | 52.05 | 55.75 | 75.15 | Unaligned |
self_mm | 83.76 | 83.82 | 85.15 | 84.90 | 55.53 | 53.87 | 53.09 | 76.49 | Unaligned |
- SIMS
Model | Mult_acc_2 | Mult_acc_3 | Mult_acc_5 | F1_score | MAE | Corr | Data Setting |
---|---|---|---|---|---|---|---|
ef_lstm | 69.37 | 54.27 | 21.23 | 56.82 | 59.07 | 5.45 | Unaligned |
lf_dnn | 77.02 | 64.33 | 39.74 | 77.27 | 44.63 | 55.51 | Unaligned |
tfn | 78.38 | 65.12 | 39.3 | 78.62 | 43.22 | 59.1 | Unaligned |
lmf | 77.77 | 64.68 | 40.53 | 77.88 | 44.12 | 57.59 | Unaligned |
mfn | 77.9 | 65.73 | 39.47 | 77.88 | 43.49 | 58.24 | Unaligned |
graph_mfn | 78.77 | 65.65 | 39.82 | 78.21 | 44.5 | 57.84 | Unaligned |
mult | 78.56 | 64.77 | 37.94 | 79.66 | 45.32 | 56.41 | Unaligned |
mlf_dnn | 80.44 | 69.37 | 40.22 | 80.28 | 39.58 | 66.52 | Unaligned |
mtfn | 81.09 | 68.80 | 40.31 | 81.01 | 39.54 | 66.58 | Unaligned |
mlmf | 79.34 | 68.36 | 41.05 | 79.07 | 40.91 | 63.90 | Unaligned |
self_mm | 80.04 | 65.47 | 41.53 | 80.44 | 42.50 | 59.52 | Unaligned |
Data setting is the same as
Regression
- MOSI
Model | Has0_acc_2 | Has0_F1_score | Non0_acc_2 | Non0_F1_score | Acc_3 | F1_score_3 |
---|---|---|---|---|---|---|
ef_lstm | 76.65 | 76.69 | 46.40 | 46.55 | 74.43 | 72.74 |
lf_dnn | 76.73 | 76.82 | 46.13 | 46.62 | 74.64 | 72.99 |
tfn | 75.33 | 75.24 | 43.78 | 45.55 | 73.44 | 71.86 |
lmf | 76.01 | 76.11 | 45.76 | 46.34 | 74.11 | 72.50 |
mfn | 77.23 | 77.17 | 46.68 | 46.78 | 74.99 | 73.22 |
graph_mfn | 77.38 | 77.50 | 46.13 | 46.96 | 75.34 | 73.71 |
mult | 77.41 | 77.20 | 48.93 | 47.29 | 74.99 | 73.06 |
misa | 78.34 | 78.32 | 44.15 | 46.75 | 76.30 | 74.57 |
- MOSEI
Model | Has0_acc_2 | Has0_F1_score | Non0_acc_2 | Non0_F1_score | Acc_3 | F1_score_3 |
---|---|---|---|---|---|---|
ef_lstm | 70.36 | 69.27 | 26.73 | 28.12 | 66.09 | 63.68 |
lf_dnn | 71.18 | 70.14 | 27.19 | 28.67 | 67.35 | 64.65 |
tfn | 71.54 | 70.91 | 28.66 | 28.75 | 66.63 | 63.93 |
lmf | 71.90 | 71.26 | 28.86 | 28.92 | 66.59 | 64.86 |
mfn | 71.49 | 70.80 | 28.61 | 28.70 | 66.59 | 64.31 |
graph_mfn | 71.25 | 70.51 | 28.47 | 28.77 | 66.39 | 64.00 |
mult | 71.23 | 70.23 | 27.38 | 28.67 | 67.04 | 65.01 |
misa | 71.44 | 70.56 | 28.40 | 29.03 | 67.63 | 65.39 |
- SIMS
Model | Has0_acc_2 | Has0_F1_score | Non0_acc_2 | Non0_F1_score | Acc_3 | F1_score_3 |
---|---|---|---|---|---|---|
ef_lstm | 69.37 | 56.82 | 63.92 | 49.85 | 54.27 | 38.18 |
lf_dnn | 79.87 | 79.97 | 56.70 | 55.27 | 70.20 | 65.29 |
tfn | 75.32 | 75.66 | 53.56 | 52.79 | 65.95 | 62.04 |
lmf | 77.99 | 77.59 | 57.06 | 53.83 | 66.87 | 62.46 |
mfn | 78.25 | 78.08 | 56.96 | 54.14 | 67.57 | |
graph_mfn | 79.21 | 78.92 | 57.99 | 54.66 | 68.44 | 63.44 |
mult | 78.07 | 78.07 | 56.34 | 54.26 | 68.27 | 64.23 |
misa | 78.07 | 77.70 | 57.27 | 53.99 | 67.05 | 60.98 |
mlf_dnn | 80.79 | 80.59 | 58.19 | 55.55 | 70.37 | 65.94 |
mtfn | 81.23 | 81.24 | 56.91 | 55.29 | 70.28 | 66.44 |
mlmf | 81.45 | 81.62 | 56.60 | 55.66 | 71.60 | 70.45 |