AR ranking
Generated on 2015-11-18 15:08:02
| baseline | region_noise | Overall |
---|
Accuracy | Robustness | Accuracy | Robustness | Accuracy | Robustness |
---|
ABS | 20.67 | 18.64 | 15.34 | 15.34 | 18.01 | 16.99 |
---|
ACAT | 13.80 | 15.08 | 17.77 | 14.91 | 15.78 | 14.99 |
---|
ACT | 20.76 | 16.60 | 22.18 | 15.20 | 21.47 | 15.90 |
---|
BDF | 23.24 | 17.83 | 21.73 | 18.08 | 22.49 | 17.95 |
---|
CMT | 20.10 | 25.48 | 22.61 | 25.09 | 21.36 | 25.29 |
---|
CT | 32.46 | 28.71 | 30.82 | 27.93 | 31.64 | 28.32 |
---|
DGT | 11.72 | 9.55 | 9.32 | 10.44 | 10.52 | 10.00 |
---|
DSST | 5.98 | 12.41 | 5.86 | 12.93 | 5.92 | 12.67 |
---|
DynMS | 22.82 | 19.47 | 21.51 | 19.45 | 22.16 | 19.46 |
---|
EDFT | 20.34 | 24.69 | 22.14 | 24.21 | 21.24 | 24.45 |
---|
FRT | 24.30 | 31.30 | 27.20 | 31.91 | 25.75 | 31.60 |
---|
FSDT | 24.38 | 32.17 | 24.32 | 29.29 | 24.35 | 30.73 |
---|
FoT | 19.39 | 26.62 | 21.62 | 27.13 | 20.51 | 26.87 |
---|
HMMTxD | 10.07 | 20.73 | 9.73 | 19.60 | 9.90 | 20.16 |
---|
IIVTv2 | 25.65 | 25.69 | 25.40 | 23.82 | 25.53 | 24.75 |
---|
IMPNCC | 26.57 | 28.56 | 29.35 | 29.24 | 27.96 | 28.90 |
---|
IPRT | 27.56 | 22.46 | 26.64 | 23.52 | 27.10 | 22.99 |
---|
IVT | 27.95 | 29.83 | 27.43 | 28.21 | 27.69 | 29.02 |
---|
KCF | 5.53 | 15.20 | 5.58 | 13.10 | 5.56 | 14.15 |
---|
LGTv1 | 29.23 | 11.78 | 26.53 | 9.85 | 27.88 | 10.81 |
---|
LT_FLO | 17.08 | 30.84 | 20.84 | 31.20 | 18.96 | 31.02 |
---|
MCT | 16.81 | 13.95 | 17.58 | 13.05 | 17.19 | 13.50 |
---|
MIL | 34.93 | 25.08 | 35.53 | 25.75 | 35.23 | 25.42 |
---|
MatFlow | 22.00 | 8.79 | 19.14 | 14.68 | 20.57 | 11.74 |
---|
Matrioska | 22.12 | 20.63 | 21.95 | 24.29 | 22.03 | 22.46 |
---|
NCC | 18.50 | 35.17 | 23.44 | 37.17 | 20.97 | 36.17 |
---|
OGT | 14.81 | 30.12 | 16.89 | 30.16 | 15.85 | 30.14 |
---|
PLT_13 | 18.34 | 3.75 | 17.30 | 4.83 | 17.82 | 4.29 |
---|
PLT_14 | 14.72 | 6.33 | 13.73 | 5.10 | 14.22 | 5.72 |
---|
PTp | 33.05 | 21.53 | 30.27 | 20.15 | 31.66 | 20.84 |
---|
SAMF | 5.87 | 14.07 | 5.69 | 12.91 | 5.78 | 13.49 |
---|
SIR_PF | 24.54 | 20.87 | 22.33 | 22.50 | 23.43 | 21.68 |
---|
Struck | 20.87 | 21.21 | 21.42 | 18.83 | 21.15 | 20.02 |
---|
ThunderStruck | 22.61 | 20.17 | 21.99 | 18.68 | 22.30 | 19.42 |
---|
VTDMG | 21.48 | 18.50 | 20.65 | 17.02 | 21.06 | 17.76 |
---|
aStruck | 22.41 | 19.15 | 20.88 | 22.05 | 21.64 | 20.60 |
---|
alov441 | 5.54 | 10.87 | 7.23 | 9.95 | 6.39 | 10.41 |
---|
eASMS | 14.22 | 14.31 | 11.33 | 14.35 | 12.77 | 14.33 |
---|
qwsEDFT | 17.50 | 19.24 | 18.55 | 21.01 | 18.02 | 20.12 |
---|
Experiment baseline
Ranking plot for experiment baseline
AR plot for experiment baseline
Accuracy
| camera_motion | illum_change | occlusion | size_change | motion_change | empty | Overall |
---|
A-Rank | Overlap | A-Rank | Overlap | A-Rank | Overlap | A-Rank | Overlap | A-Rank | Overlap | A-Rank | Overlap | A-Rank | Overlap |
---|
ABS | 19.22 | 0.51 | 28.45 | 0.45 | 25.12 | 0.46 | 12.50 | 0.49 | 14.70 | 0.53 | 24.00 | 0.49 | 20.67 | 0.50 |
---|
ACAT | 19.37 | 0.56 | 8.00 | 0.62 | 20.70 | 0.49 | 15.05 | 0.50 | 14.65 | 0.57 | 5.00 | 0.62 | 13.80 | 0.56 |
---|
ACT | 20.54 | 0.55 | 18.00 | 0.55 | 17.04 | 0.54 | 22.58 | 0.47 | 19.88 | 0.55 | 26.50 | 0.47 | 20.76 | 0.54 |
---|
BDF | 28.25 | 0.50 | 21.00 | 0.54 | 23.71 | 0.51 | 27.86 | 0.44 | 26.14 | 0.52 | 12.50 | 0.56 | 23.24 | 0.50 |
---|
CMT | 21.92 | 0.50 | 22.27 | 0.49 | 25.52 | 0.51 | 22.38 | 0.45 | 24.00 | 0.49 | 4.50 | 0.64 | 20.10 | 0.50 |
---|
CT | 34.62 | 0.43 | 35.71 | 0.38 | 30.33 | 0.43 | 36.60 | 0.36 | 34.50 | 0.42 | 23.00 | 0.49 | 32.46 | 0.42 |
---|
DGT | 10.94 | 0.56 | 24.29 | 0.47 | 21.92 | 0.48 | 3.00 | 0.58 | 7.67 | 0.58 | 2.50 | 0.68 | 11.72 | 0.57 |
---|
DSST | 3.67 | 0.67 | 1.50 | 0.75 | 5.44 | 0.64 | 9.27 | 0.53 | 3.50 | 0.65 | 12.50 | 0.56 | 5.98 | 0.65 |
---|
DynMS | 17.20 | 0.54 | 22.92 | 0.50 | 26.50 | 0.48 | 17.14 | 0.47 | 16.63 | 0.54 | 36.50 | 0.34 | 22.82 | 0.51 |
---|
EDFT | 22.46 | 0.52 | 17.50 | 0.56 | 22.65 | 0.52 | 21.00 | 0.47 | 20.92 | 0.53 | 17.50 | 0.52 | 20.34 | 0.52 |
---|
FRT | 20.81 | 0.50 | 24.29 | 0.48 | 21.00 | 0.52 | 27.71 | 0.42 | 23.48 | 0.48 | 28.50 | 0.45 | 24.30 | 0.48 |
---|
FSDT | 20.26 | 0.53 | 19.16 | 0.53 | 18.07 | 0.53 | 26.35 | 0.44 | 23.43 | 0.51 | 39.00 | 0.13 | 24.38 | 0.49 |
---|
FoT | 24.19 | 0.50 | 18.54 | 0.56 | 23.31 | 0.50 | 15.00 | 0.51 | 19.29 | 0.55 | 16.00 | 0.54 | 19.39 | 0.52 |
---|
HMMTxD | 7.82 | 0.60 | 13.16 | 0.58 | 12.00 | 0.59 | 6.00 | 0.55 | 8.44 | 0.61 | 13.00 | 0.56 | 10.07 | 0.59 |
---|
IIVTv2 | 21.92 | 0.50 | 27.55 | 0.44 | 18.00 | 0.53 | 22.59 | 0.45 | 26.85 | 0.49 | 37.00 | 0.29 | 25.65 | 0.47 |
---|
IMPNCC | 23.68 | 0.49 | 21.00 | 0.52 | 31.00 | 0.41 | 23.04 | 0.45 | 24.20 | 0.50 | 36.50 | 0.33 | 26.57 | 0.48 |
---|
IPRT | 25.12 | 0.47 | 33.00 | 0.40 | 27.00 | 0.46 | 24.04 | 0.43 | 28.22 | 0.46 | 28.00 | 0.45 | 27.56 | 0.46 |
---|
IVT | 34.00 | 0.47 | 19.12 | 0.57 | 32.55 | 0.40 | 33.42 | 0.41 | 31.13 | 0.49 | 17.50 | 0.53 | 27.95 | 0.48 |
---|
KCF | 2.50 | 0.67 | 2.00 | 0.75 | 6.92 | 0.65 | 4.29 | 0.58 | 2.50 | 0.68 | 15.00 | 0.55 | 5.53 | 0.66 |
---|
LGTv1 | 34.11 | 0.44 | 27.65 | 0.45 | 36.60 | 0.33 | 28.05 | 0.43 | 31.44 | 0.46 | 17.50 | 0.52 | 29.23 | 0.45 |
---|
LT_FLO | 20.26 | 0.54 | 7.22 | 0.61 | 28.11 | 0.42 | 19.42 | 0.47 | 20.44 | 0.54 | 7.00 | 0.60 | 17.08 | 0.54 |
---|
MCT | 18.26 | 0.55 | 14.55 | 0.57 | 18.50 | 0.50 | 16.10 | 0.48 | 19.44 | 0.54 | 14.00 | 0.55 | 16.81 | 0.54 |
---|
MIL | 36.80 | 0.41 | 34.78 | 0.38 | 38.50 | 0.28 | 33.73 | 0.37 | 35.80 | 0.41 | 30.00 | 0.42 | 34.93 | 0.40 |
---|
MatFlow | 21.38 | 0.52 | 22.68 | 0.52 | 16.26 | 0.55 | 22.38 | 0.45 | 21.78 | 0.53 | 27.50 | 0.46 | 22.00 | 0.51 |
---|
Matrioska | 19.85 | 0.54 | 21.76 | 0.51 | 15.44 | 0.57 | 26.76 | 0.42 | 22.04 | 0.51 | 26.85 | 0.46 | 22.12 | 0.51 |
---|
NCC | 14.84 | 0.59 | 14.11 | 0.56 | 11.29 | 0.60 | 20.96 | 0.48 | 19.29 | 0.55 | 30.50 | 0.43 | 18.50 | 0.55 |
---|
OGT | 16.96 | 0.56 | 14.29 | 0.56 | 19.18 | 0.51 | 12.00 | 0.51 | 13.94 | 0.56 | 12.50 | 0.56 | 14.81 | 0.55 |
---|
PLT_13 | 19.37 | 0.55 | 21.00 | 0.52 | 11.29 | 0.58 | 16.10 | 0.48 | 19.29 | 0.55 | 23.00 | 0.49 | 18.34 | 0.54 |
---|
PLT_14 | 15.77 | 0.56 | 21.00 | 0.51 | 10.75 | 0.59 | 12.24 | 0.51 | 12.56 | 0.57 | 16.00 | 0.53 | 14.72 | 0.55 |
---|
PTp | 34.00 | 0.45 | 34.78 | 0.37 | 32.00 | 0.41 | 32.85 | 0.40 | 32.15 | 0.45 | 32.50 | 0.40 | 33.05 | 0.43 |
---|
SAMF | 3.00 | 0.66 | 4.50 | 0.67 | 8.50 | 0.61 | 5.00 | 0.57 | 3.20 | 0.67 | 11.00 | 0.57 | 5.87 | 0.65 |
---|
SIR_PF | 19.85 | 0.53 | 24.78 | 0.46 | 15.44 | 0.55 | 26.96 | 0.42 | 24.20 | 0.49 | 36.00 | 0.35 | 24.54 | 0.49 |
---|
Struck | 20.26 | 0.53 | 21.00 | 0.51 | 12.39 | 0.58 | 27.71 | 0.41 | 22.85 | 0.51 | 21.00 | 0.50 | 20.87 | 0.51 |
---|
ThunderStruck | 21.38 | 0.51 | 24.29 | 0.46 | 13.52 | 0.57 | 27.71 | 0.41 | 24.20 | 0.49 | 24.56 | 0.48 | 22.61 | 0.49 |
---|
VTDMG | 19.37 | 0.55 | 31.25 | 0.43 | 15.44 | 0.57 | 21.88 | 0.47 | 19.88 | 0.54 | 21.07 | 0.50 | 21.48 | 0.52 |
---|
aStruck | 29.88 | 0.51 | 9.08 | 0.62 | 28.50 | 0.44 | 32.50 | 0.41 | 29.50 | 0.50 | 5.00 | 0.63 | 22.41 | 0.51 |
---|
alov441 | 3.67 | 0.62 | 10.07 | 0.61 | 10.75 | 0.57 | 4.29 | 0.57 | 3.50 | 0.61 | 1.00 | 0.72 | 5.54 | 0.61 |
---|
eASMS | 14.16 | 0.55 | 28.00 | 0.47 | 14.17 | 0.56 | 8.50 | 0.51 | 13.00 | 0.55 | 7.50 | 0.59 | 14.22 | 0.54 |
---|
qwsEDFT | 19.37 | 0.55 | 15.00 | 0.57 | 14.65 | 0.58 | 16.10 | 0.48 | 19.29 | 0.56 | 20.56 | 0.50 | 17.50 | 0.54 |
---|
Robustness
| camera_motion | illum_change | occlusion | size_change | motion_change | empty | Overall |
---|
R-Rank | Failures | R-Rank | Failures | R-Rank | Failures | R-Rank | Failures | R-Rank | Failures | R-Rank | Failures | R-Rank | Failures |
---|
ABS | 16.33 | 22.00 | 21.58 | 3.00 | 22.75 | 5.00 | 18.56 | 16.00 | 15.60 | 24.00 | 17.00 | 0.00 | 18.64 | 18.11 |
---|
ACAT | 18.87 | 28.00 | 6.50 | 1.00 | 15.35 | 4.00 | 18.56 | 16.00 | 14.21 | 29.00 | 17.00 | 0.00 | 15.08 | 21.74 |
---|
ACT | 14.42 | 23.00 | 7.50 | 2.00 | 23.38 | 6.00 | 21.68 | 19.00 | 15.60 | 29.00 | 17.00 | 0.00 | 16.60 | 20.20 |
---|
BDF | 19.38 | 27.00 | 7.50 | 2.00 | 26.65 | 5.00 | 22.35 | 14.00 | 14.08 | 18.00 | 17.00 | 0.00 | 17.83 | 18.19 |
---|
CMT | 30.57 | 54.00 | 21.71 | 7.00 | 30.40 | 9.00 | 21.68 | 19.00 | 31.50 | 46.00 | 17.00 | 0.00 | 25.48 | 38.26 |
---|
CT | 33.38 | 55.00 | 30.57 | 11.00 | 26.14 | 8.00 | 32.89 | 33.00 | 32.29 | 58.00 | 17.00 | 0.00 | 28.71 | 44.03 |
---|
DGT | 7.00 | 19.00 | 24.29 | 14.00 | 1.50 | 1.00 | 3.00 | 6.00 | 4.50 | 14.00 | 17.00 | 0.00 | 9.55 | 13.78 |
---|
DSST | 9.78 | 20.00 | 6.50 | 1.00 | 11.75 | 3.00 | 16.67 | 15.00 | 12.75 | 24.00 | 17.00 | 0.00 | 12.41 | 16.90 |
---|
DynMS | 18.87 | 36.00 | 29.80 | 15.00 | 22.75 | 5.00 | 14.17 | 14.00 | 14.21 | 23.00 | 17.00 | 0.00 | 19.47 | 24.50 |
---|
EDFT | 28.83 | 36.00 | 24.58 | 5.00 | 27.35 | 6.00 | 25.12 | 19.00 | 25.27 | 35.00 | 17.00 | 0.00 | 24.69 | 27.51 |
---|
FRT | 36.00 | 65.00 | 38.00 | 18.00 | 26.14 | 10.00 | 33.17 | 27.00 | 37.50 | 63.00 | 17.00 | 0.00 | 31.30 | 49.52 |
---|
FSDT | 33.83 | 55.00 | 30.90 | 14.00 | 25.87 | 6.00 | 31.83 | 31.00 | 33.60 | 55.00 | 37.00 | 1.00 | 32.17 | 43.23 |
---|
FoT | 30.88 | 47.00 | 21.58 | 3.00 | 30.40 | 8.00 | 33.10 | 23.00 | 26.75 | 41.00 | 17.00 | 0.00 | 26.62 | 34.08 |
---|
HMMTxD | 20.25 | 32.00 | 22.94 | 10.00 | 32.00 | 7.00 | 19.42 | 18.00 | 12.75 | 20.00 | 17.00 | 0.00 | 20.73 | 22.12 |
---|
IIVTv2 | 30.89 | 59.67 | 31.00 | 13.87 | 20.38 | 4.47 | 26.50 | 29.60 | 28.36 | 52.73 | 17.00 | 0.00 | 25.69 | 44.25 |
---|
IMPNCC | 34.60 | 72.00 | 31.09 | 11.00 | 25.87 | 6.00 | 25.32 | 29.00 | 37.50 | 64.00 | 17.00 | 0.00 | 28.56 | 52.15 |
---|
IPRT | 20.54 | 37.40 | 30.67 | 11.13 | 7.70 | 3.07 | 17.77 | 18.13 | 21.62 | 32.67 | 36.50 | 0.80 | 22.46 | 27.86 |
---|
IVT | 34.00 | 52.00 | 31.00 | 11.00 | 30.40 | 9.00 | 33.00 | 28.00 | 33.60 | 53.00 | 17.00 | 0.00 | 29.83 | 40.83 |
---|
KCF | 13.50 | 24.00 | 6.50 | 1.00 | 17.11 | 5.00 | 22.89 | 20.00 | 14.21 | 26.00 | 17.00 | 0.00 | 15.20 | 19.79 |
---|
LGTv1 | 9.78 | 15.20 | 7.50 | 1.47 | 20.42 | 3.93 | 11.50 | 7.40 | 4.50 | 10.47 | 17.00 | 0.00 | 11.78 | 10.34 |
---|
LT_FLO | 32.00 | 47.80 | 21.38 | 4.67 | 30.06 | 9.07 | 33.10 | 28.13 | 31.50 | 45.53 | 37.00 | 0.80 | 30.84 | 36.53 |
---|
MCT | 9.57 | 15.47 | 6.50 | 1.20 | 7.50 | 2.27 | 14.17 | 12.40 | 12.44 | 20.07 | 33.50 | 0.27 | 13.95 | 13.64 |
---|
MIL | 30.57 | 41.87 | 31.67 | 13.53 | 22.75 | 5.00 | 19.60 | 19.40 | 28.90 | 40.13 | 17.00 | 0.00 | 25.08 | 32.15 |
---|
MatFlow | 5.00 | 17.00 | 6.50 | 1.00 | 8.75 | 3.00 | 11.00 | 9.00 | 4.50 | 11.00 | 17.00 | 0.00 | 8.79 | 11.36 |
---|
Matrioska | 13.79 | 35.00 | 21.38 | 8.00 | 9.62 | 4.00 | 22.74 | 27.00 | 19.24 | 45.00 | 37.00 | 1.00 | 20.63 | 31.09 |
---|
NCC | 39.00 | 162.00 | 38.00 | 39.00 | 39.00 | 29.00 | 39.00 | 60.00 | 39.00 | 111.00 | 17.00 | 0.00 | 35.17 | 109.50 |
---|
OGT | 32.60 | 71.07 | 27.46 | 10.87 | 34.33 | 10.53 | 23.63 | 24.27 | 25.67 | 41.47 | 37.00 | 1.00 | 30.12 | 45.21 |
---|
PLT_13 | 1.00 | 2.00 | 1.00 | 0.00 | 1.50 | 1.00 | 1.00 | 2.00 | 1.00 | 2.00 | 17.00 | 0.00 | 3.75 | 1.66 |
---|
PLT_14 | 2.00 | 4.00 | 6.50 | 1.00 | 7.50 | 2.00 | 3.00 | 4.00 | 2.00 | 4.00 | 17.00 | 0.00 | 6.33 | 3.41 |
---|
PTp | 19.50 | 30.00 | 30.36 | 8.00 | 26.14 | 7.00 | 12.00 | 13.00 | 24.18 | 33.00 | 17.00 | 0.00 | 21.53 | 24.05 |
---|
SAMF | 9.70 | 24.00 | 6.50 | 1.00 | 15.35 | 4.00 | 22.89 | 18.00 | 13.00 | 25.00 | 17.00 | 0.00 | 14.07 | 19.23 |
---|
SIR_PF | 18.38 | 34.80 | 31.67 | 19.47 | 9.62 | 2.60 | 22.35 | 16.40 | 25.73 | 37.27 | 17.50 | 0.07 | 20.87 | 28.55 |
---|
Struck | 20.25 | 36.67 | 21.58 | 3.67 | 11.75 | 3.20 | 30.50 | 27.07 | 25.67 | 41.67 | 17.50 | 0.07 | 21.21 | 30.39 |
---|
ThunderStruck | 20.25 | 35.80 | 21.38 | 4.33 | 10.20 | 3.67 | 26.50 | 25.87 | 25.67 | 42.20 | 17.00 | 0.00 | 20.17 | 30.10 |
---|
VTDMG | 19.38 | 30.00 | 21.38 | 7.00 | 26.65 | 5.00 | 11.00 | 12.00 | 15.60 | 23.00 | 17.00 | 0.00 | 18.50 | 21.02 |
---|
aStruck | 18.06 | 44.00 | 21.71 | 6.00 | 22.75 | 5.00 | 13.46 | 21.00 | 21.93 | 38.00 | 17.00 | 0.00 | 19.15 | 31.95 |
---|
alov441 | 7.67 | 17.00 | 11.00 | 2.00 | 7.50 | 2.00 | 7.83 | 16.00 | 14.21 | 32.00 | 17.00 | 0.00 | 10.87 | 18.03 |
---|
eASMS | 11.60 | 25.00 | 23.79 | 14.00 | 22.75 | 5.00 | 6.25 | 6.00 | 4.50 | 10.00 | 17.00 | 0.00 | 14.31 | 15.31 |
---|
qwsEDFT | 20.25 | 30.00 | 11.00 | 2.00 | 27.35 | 6.00 | 22.35 | 15.00 | 17.46 | 26.00 | 17.00 | 0.00 | 19.24 | 21.78 |
---|
Detailed plots
Ranking plot for label camera_motion in experiment baseline
AR plot for label camera_motion in experiment baseline
Ranking plot for label illum_change in experiment baseline
AR plot for label illum_change in experiment baseline
Ranking plot for label occlusion in experiment baseline
AR plot for label occlusion in experiment baseline
Ranking plot for label size_change in experiment baseline
AR plot for label size_change in experiment baseline
Ranking plot for label motion_change in experiment baseline
AR plot for label motion_change in experiment baseline
Ranking plot for label empty in experiment baseline
AR plot for label empty in experiment baseline
Experiment region_noise
Ranking plot for experiment region_noise
AR plot for experiment region_noise
Accuracy
| camera_motion | illum_change | occlusion | size_change | motion_change | empty | Overall |
---|
A-Rank | Overlap | A-Rank | Overlap | A-Rank | Overlap | A-Rank | Overlap | A-Rank | Overlap | A-Rank | Overlap | A-Rank | Overlap |
---|
ABS | 16.12 | 0.50 | 24.52 | 0.45 | 20.00 | 0.46 | 8.93 | 0.47 | 10.50 | 0.52 | 12.00 | 0.52 | 15.34 | 0.50 |
---|
ACAT | 21.54 | 0.52 | 9.38 | 0.59 | 23.12 | 0.43 | 24.00 | 0.43 | 19.58 | 0.52 | 9.00 | 0.56 | 17.77 | 0.51 |
---|
ACT | 23.00 | 0.51 | 19.00 | 0.52 | 17.53 | 0.51 | 25.50 | 0.42 | 22.07 | 0.51 | 26.00 | 0.44 | 22.18 | 0.49 |
---|
BDF | 25.96 | 0.46 | 21.47 | 0.50 | 21.50 | 0.46 | 25.50 | 0.41 | 22.46 | 0.49 | 13.50 | 0.52 | 21.73 | 0.47 |
---|
CMT | 25.96 | 0.44 | 24.11 | 0.46 | 22.00 | 0.46 | 25.50 | 0.39 | 29.11 | 0.42 | 9.00 | 0.56 | 22.61 | 0.44 |
---|
CT | 31.23 | 0.42 | 34.00 | 0.37 | 27.00 | 0.43 | 36.17 | 0.35 | 34.10 | 0.41 | 22.44 | 0.47 | 30.82 | 0.41 |
---|
DGT | 7.91 | 0.55 | 22.43 | 0.44 | 15.57 | 0.51 | 3.00 | 0.56 | 5.00 | 0.56 | 2.00 | 0.68 | 9.32 | 0.55 |
---|
DSST | 6.33 | 0.61 | 2.00 | 0.70 | 4.00 | 0.60 | 7.50 | 0.51 | 5.80 | 0.60 | 9.50 | 0.55 | 5.86 | 0.60 |
---|
DynMS | 17.08 | 0.52 | 23.32 | 0.45 | 20.00 | 0.49 | 17.05 | 0.45 | 14.61 | 0.51 | 37.00 | 0.34 | 21.51 | 0.49 |
---|
EDFT | 23.00 | 0.49 | 19.00 | 0.53 | 20.97 | 0.47 | 24.00 | 0.42 | 21.38 | 0.50 | 24.50 | 0.46 | 22.14 | 0.48 |
---|
FRT | 23.50 | 0.46 | 28.71 | 0.41 | 25.17 | 0.44 | 28.41 | 0.38 | 27.41 | 0.43 | 30.00 | 0.41 | 27.20 | 0.43 |
---|
FSDT | 21.54 | 0.48 | 20.00 | 0.50 | 20.00 | 0.48 | 24.96 | 0.40 | 25.42 | 0.46 | 34.00 | 0.40 | 24.32 | 0.46 |
---|
FoT | 28.47 | 0.46 | 19.47 | 0.54 | 20.00 | 0.48 | 24.96 | 0.43 | 24.84 | 0.49 | 12.00 | 0.52 | 21.62 | 0.48 |
---|
HMMTxD | 8.31 | 0.57 | 13.05 | 0.55 | 9.12 | 0.57 | 5.50 | 0.51 | 6.83 | 0.58 | 15.56 | 0.50 | 9.73 | 0.56 |
---|
IIVTv2 | 22.50 | 0.47 | 24.52 | 0.43 | 18.47 | 0.49 | 24.00 | 0.40 | 25.42 | 0.45 | 37.50 | 0.33 | 25.40 | 0.44 |
---|
IMPNCC | 28.47 | 0.44 | 22.00 | 0.47 | 28.50 | 0.40 | 27.83 | 0.38 | 30.80 | 0.42 | 38.50 | 0.29 | 29.35 | 0.42 |
---|
IPRT | 25.32 | 0.46 | 33.45 | 0.38 | 25.17 | 0.44 | 24.00 | 0.42 | 25.92 | 0.45 | 26.00 | 0.44 | 26.64 | 0.44 |
---|
IVT | 31.00 | 0.44 | 18.50 | 0.54 | 33.88 | 0.35 | 28.41 | 0.39 | 31.31 | 0.44 | 21.50 | 0.48 | 27.43 | 0.45 |
---|
KCF | 4.00 | 0.61 | 2.00 | 0.70 | 8.50 | 0.57 | 5.50 | 0.52 | 3.50 | 0.62 | 10.00 | 0.55 | 5.58 | 0.60 |
---|
LGTv1 | 31.00 | 0.43 | 27.29 | 0.43 | 37.50 | 0.32 | 24.50 | 0.43 | 27.41 | 0.46 | 11.50 | 0.53 | 26.53 | 0.44 |
---|
LT_FLO | 21.54 | 0.51 | 8.00 | 0.59 | 27.95 | 0.40 | 22.00 | 0.44 | 20.58 | 0.51 | 25.00 | 0.46 | 20.84 | 0.50 |
---|
MCT | 19.69 | 0.52 | 15.71 | 0.53 | 16.17 | 0.51 | 21.00 | 0.45 | 21.38 | 0.50 | 11.50 | 0.53 | 17.58 | 0.51 |
---|
MIL | 39.00 | 0.34 | 36.50 | 0.34 | 38.50 | 0.27 | 36.17 | 0.33 | 37.00 | 0.35 | 26.00 | 0.44 | 35.53 | 0.35 |
---|
MatFlow | 19.69 | 0.50 | 20.50 | 0.50 | 20.00 | 0.49 | 20.58 | 0.43 | 19.58 | 0.51 | 14.50 | 0.51 | 19.14 | 0.49 |
---|
Matrioska | 19.69 | 0.51 | 20.50 | 0.50 | 19.53 | 0.50 | 24.50 | 0.40 | 22.46 | 0.48 | 25.00 | 0.46 | 21.95 | 0.48 |
---|
NCC | 17.54 | 0.52 | 17.20 | 0.52 | 20.59 | 0.47 | 25.50 | 0.40 | 24.84 | 0.47 | 35.00 | 0.37 | 23.44 | 0.48 |
---|
OGT | 17.54 | 0.52 | 17.07 | 0.53 | 19.00 | 0.50 | 10.13 | 0.48 | 14.61 | 0.53 | 23.00 | 0.47 | 16.89 | 0.52 |
---|
PLT_13 | 18.67 | 0.52 | 20.50 | 0.50 | 13.58 | 0.54 | 15.50 | 0.46 | 16.55 | 0.52 | 19.00 | 0.49 | 17.30 | 0.51 |
---|
PLT_14 | 15.50 | 0.54 | 21.00 | 0.49 | 13.16 | 0.56 | 10.13 | 0.48 | 12.07 | 0.54 | 10.50 | 0.54 | 13.73 | 0.53 |
---|
PTp | 28.47 | 0.45 | 30.50 | 0.39 | 32.91 | 0.37 | 27.83 | 0.39 | 27.90 | 0.45 | 34.00 | 0.39 | 30.27 | 0.43 |
---|
SAMF | 4.00 | 0.61 | 3.00 | 0.64 | 7.62 | 0.59 | 5.50 | 0.52 | 4.00 | 0.61 | 10.00 | 0.54 | 5.69 | 0.60 |
---|
SIR_PF | 17.08 | 0.52 | 22.81 | 0.45 | 16.17 | 0.52 | 24.00 | 0.42 | 21.92 | 0.49 | 32.00 | 0.40 | 22.33 | 0.48 |
---|
Struck | 21.54 | 0.50 | 20.00 | 0.50 | 16.17 | 0.53 | 25.50 | 0.40 | 24.84 | 0.48 | 20.50 | 0.49 | 21.42 | 0.48 |
---|
ThunderStruck | 21.54 | 0.50 | 21.47 | 0.48 | 15.57 | 0.53 | 25.50 | 0.40 | 25.42 | 0.48 | 22.44 | 0.47 | 21.99 | 0.48 |
---|
VTDMG | 19.69 | 0.52 | 22.00 | 0.48 | 17.53 | 0.52 | 20.58 | 0.44 | 19.08 | 0.51 | 25.00 | 0.46 | 20.65 | 0.50 |
---|
aStruck | 23.59 | 0.48 | 15.00 | 0.54 | 22.21 | 0.43 | 25.50 | 0.41 | 25.92 | 0.47 | 13.05 | 0.52 | 20.88 | 0.47 |
---|
alov441 | 4.00 | 0.59 | 14.00 | 0.56 | 14.62 | 0.51 | 4.75 | 0.53 | 5.00 | 0.58 | 1.00 | 0.73 | 7.23 | 0.58 |
---|
eASMS | 10.53 | 0.54 | 25.12 | 0.45 | 12.67 | 0.54 | 6.00 | 0.50 | 8.15 | 0.54 | 5.50 | 0.59 | 11.33 | 0.53 |
---|
qwsEDFT | 19.69 | 0.52 | 18.10 | 0.54 | 17.53 | 0.52 | 16.44 | 0.45 | 14.00 | 0.52 | 25.50 | 0.45 | 18.55 | 0.51 |
---|
Robustness
| camera_motion | illum_change | occlusion | size_change | motion_change | empty | Overall |
---|
R-Rank | Failures | R-Rank | Failures | R-Rank | Failures | R-Rank | Failures | R-Rank | Failures | R-Rank | Failures | R-Rank | Failures |
---|
ABS | 10.40 | 20.93 | 13.50 | 2.40 | 17.96 | 4.20 | 17.65 | 17.00 | 13.00 | 24.80 | 19.50 | 0.20 | 15.34 | 17.94 |
---|
ACAT | 14.85 | 29.40 | 7.09 | 1.33 | 16.72 | 5.33 | 18.46 | 18.47 | 13.33 | 30.20 | 19.00 | 0.07 | 14.91 | 23.03 |
---|
ACT | 12.25 | 29.00 | 7.09 | 1.67 | 17.96 | 4.73 | 19.78 | 23.13 | 16.62 | 36.13 | 17.50 | 0.00 | 15.20 | 25.07 |
---|
BDF | 19.69 | 31.00 | 9.80 | 2.13 | 28.76 | 5.47 | 17.65 | 14.33 | 13.57 | 21.00 | 19.00 | 0.07 | 18.08 | 20.74 |
---|
CMT | 27.82 | 52.40 | 21.69 | 5.07 | 29.44 | 7.53 | 22.61 | 23.13 | 29.50 | 46.07 | 19.50 | 0.13 | 25.09 | 37.90 |
---|
CT | 33.14 | 62.87 | 30.46 | 13.47 | 22.57 | 7.73 | 30.92 | 35.13 | 31.50 | 54.93 | 19.00 | 0.07 | 27.93 | 46.93 |
---|
DGT | 6.00 | 23.80 | 24.16 | 14.73 | 4.25 | 1.80 | 6.75 | 8.60 | 4.00 | 16.20 | 17.50 | 0.00 | 10.44 | 16.79 |
---|
DSST | 8.89 | 22.27 | 5.00 | 0.80 | 16.72 | 3.93 | 17.65 | 17.93 | 11.83 | 26.67 | 17.50 | 0.00 | 12.93 | 18.94 |
---|
DynMS | 21.92 | 38.80 | 30.83 | 16.07 | 16.00 | 3.80 | 17.65 | 16.80 | 12.79 | 26.20 | 17.50 | 0.00 | 19.45 | 26.94 |
---|
EDFT | 28.36 | 40.07 | 24.67 | 6.27 | 29.73 | 7.40 | 20.41 | 18.93 | 22.60 | 34.07 | 19.50 | 0.20 | 24.21 | 29.10 |
---|
FRT | 37.00 | 69.00 | 38.00 | 20.00 | 26.62 | 10.27 | 34.33 | 32.33 | 38.00 | 64.67 | 17.50 | 0.00 | 31.91 | 52.49 |
---|
FSDT | 29.54 | 46.27 | 28.50 | 9.87 | 23.62 | 6.40 | 32.10 | 30.80 | 32.00 | 53.40 | 30.00 | 0.33 | 29.29 | 38.74 |
---|
FoT | 32.25 | 56.00 | 17.70 | 3.67 | 29.73 | 9.80 | 34.14 | 30.07 | 31.44 | 46.87 | 17.50 | 0.00 | 27.13 | 40.41 |
---|
HMMTxD | 19.69 | 32.93 | 24.67 | 8.80 | 28.76 | 5.87 | 15.13 | 14.33 | 11.83 | 21.27 | 17.50 | 0.00 | 19.60 | 22.25 |
---|
IIVTv2 | 27.86 | 59.73 | 31.64 | 16.80 | 17.96 | 5.40 | 18.88 | 27.47 | 27.08 | 48.93 | 19.50 | 0.13 | 23.82 | 43.28 |
---|
IMPNCC | 32.25 | 68.27 | 28.50 | 14.93 | 26.62 | 6.40 | 33.89 | 33.53 | 34.67 | 61.73 | 19.50 | 0.20 | 29.24 | 50.94 |
---|
IPRT | 24.46 | 40.67 | 30.90 | 11.00 | 15.52 | 4.60 | 16.90 | 20.07 | 20.83 | 34.53 | 32.50 | 0.47 | 23.52 | 29.98 |
---|
IVT | 32.44 | 52.67 | 28.50 | 9.60 | 25.38 | 8.53 | 32.10 | 28.67 | 33.33 | 53.87 | 17.50 | 0.00 | 28.21 | 41.28 |
---|
KCF | 10.64 | 26.20 | 5.00 | 1.07 | 12.47 | 3.33 | 19.78 | 21.80 | 13.20 | 29.47 | 17.50 | 0.00 | 13.10 | 21.82 |
---|
LGTv1 | 6.86 | 15.00 | 6.00 | 1.33 | 17.96 | 3.87 | 6.75 | 7.47 | 4.00 | 11.00 | 17.50 | 0.00 | 9.85 | 10.40 |
---|
LT_FLO | 31.50 | 49.93 | 21.58 | 4.53 | 31.91 | 9.13 | 33.75 | 30.60 | 31.44 | 48.27 | 37.00 | 0.67 | 31.20 | 38.44 |
---|
MCT | 8.12 | 19.33 | 9.80 | 1.80 | 14.25 | 3.67 | 14.27 | 15.47 | 12.36 | 23.20 | 19.50 | 0.13 | 13.05 | 16.57 |
---|
MIL | 31.45 | 49.13 | 29.36 | 11.40 | 24.08 | 5.53 | 22.61 | 23.73 | 29.50 | 45.87 | 17.50 | 0.00 | 25.75 | 37.09 |
---|
MatFlow | 13.29 | 29.20 | 11.40 | 2.67 | 16.72 | 4.13 | 16.47 | 14.07 | 12.69 | 21.67 | 17.50 | 0.00 | 14.68 | 20.15 |
---|
Matrioska | 24.46 | 47.93 | 26.07 | 8.67 | 19.67 | 5.67 | 27.05 | 34.20 | 29.50 | 58.67 | 19.00 | 0.07 | 24.29 | 41.14 |
---|
NCC | 39.00 | 149.40 | 37.00 | 33.13 | 39.00 | 27.73 | 39.00 | 52.80 | 39.00 | 101.93 | 30.00 | 0.33 | 37.17 | 100.34 |
---|
OGT | 31.45 | 69.73 | 24.94 | 11.80 | 36.00 | 9.87 | 28.41 | 26.33 | 30.18 | 46.27 | 30.00 | 0.33 | 30.16 | 46.25 |
---|
PLT_13 | 1.50 | 6.27 | 5.00 | 1.00 | 2.00 | 1.27 | 1.50 | 4.33 | 1.50 | 7.40 | 17.50 | 0.00 | 4.83 | 5.29 |
---|
PLT_14 | 1.50 | 4.53 | 7.09 | 1.27 | 1.50 | 0.93 | 1.50 | 3.80 | 1.50 | 5.87 | 17.50 | 0.00 | 5.10 | 4.10 |
---|
PTp | 17.54 | 28.47 | 28.50 | 9.07 | 20.36 | 4.60 | 17.65 | 15.87 | 17.33 | 29.93 | 19.50 | 0.27 | 20.15 | 22.96 |
---|
SAMF | 8.33 | 23.07 | 6.00 | 1.07 | 14.90 | 3.80 | 18.88 | 21.13 | 11.83 | 28.87 | 17.50 | 0.00 | 12.91 | 20.29 |
---|
SIR_PF | 23.08 | 40.60 | 34.86 | 21.87 | 13.00 | 3.07 | 19.36 | 16.60 | 25.18 | 35.60 | 19.50 | 0.20 | 22.50 | 30.77 |
---|
Struck | 19.29 | 36.33 | 17.70 | 3.40 | 13.26 | 3.33 | 20.54 | 25.07 | 24.71 | 43.73 | 17.50 | 0.00 | 18.83 | 30.55 |
---|
ThunderStruck | 18.17 | 32.80 | 20.85 | 3.93 | 11.78 | 3.33 | 21.17 | 22.27 | 22.60 | 39.87 | 17.50 | 0.00 | 18.68 | 27.73 |
---|
VTDMG | 14.25 | 26.47 | 27.40 | 7.80 | 14.25 | 3.33 | 16.90 | 16.47 | 11.83 | 22.47 | 17.50 | 0.00 | 17.02 | 19.99 |
---|
aStruck | 23.07 | 49.13 | 21.71 | 4.87 | 24.38 | 5.93 | 19.29 | 25.07 | 26.36 | 44.67 | 17.50 | 0.00 | 22.05 | 36.33 |
---|
alov441 | 5.33 | 16.73 | 3.83 | 0.53 | 13.00 | 3.33 | 8.25 | 16.93 | 11.78 | 30.47 | 17.50 | 0.00 | 9.95 | 17.52 |
---|
eASMS | 9.73 | 27.00 | 25.29 | 13.73 | 24.08 | 4.80 | 4.00 | 6.93 | 4.00 | 11.87 | 19.00 | 0.07 | 14.35 | 16.73 |
---|
qwsEDFT | 26.20 | 37.47 | 15.00 | 4.47 | 29.44 | 7.53 | 17.65 | 16.27 | 18.25 | 29.47 | 19.50 | 0.20 | 21.01 | 26.27 |
---|
Detailed plots
Ranking plot for label camera_motion in experiment region_noise
AR plot for label camera_motion in experiment region_noise
Ranking plot for label illum_change in experiment region_noise
AR plot for label illum_change in experiment region_noise
Ranking plot for label occlusion in experiment region_noise
AR plot for label occlusion in experiment region_noise
Ranking plot for label size_change in experiment region_noise
AR plot for label size_change in experiment region_noise
Ranking plot for label motion_change in experiment region_noise
AR plot for label motion_change in experiment region_noise
Ranking plot for label empty in experiment region_noise
AR plot for label empty in experiment region_noise