AR ranking

Generated on 2015-11-18 15:08:02

 baselineregion_noiseOverall
AccuracyRobustnessAccuracyRobustnessAccuracyRobustness
ABS20.6718.6415.3415.3418.0116.99
ACAT13.8015.0817.7714.9115.7814.99
ACT20.7616.6022.1815.2021.4715.90
BDF23.2417.8321.7318.0822.4917.95
CMT20.1025.4822.6125.0921.3625.29
CT32.4628.7130.8227.9331.6428.32
DGT11.729.559.3210.4410.5210.00
DSST5.9812.415.8612.935.9212.67
DynMS22.8219.4721.5119.4522.1619.46
EDFT20.3424.6922.1424.2121.2424.45
FRT24.3031.3027.2031.9125.7531.60
FSDT24.3832.1724.3229.2924.3530.73
FoT19.3926.6221.6227.1320.5126.87
HMMTxD10.0720.739.7319.609.9020.16
IIVTv225.6525.6925.4023.8225.5324.75
IMPNCC26.5728.5629.3529.2427.9628.90
IPRT27.5622.4626.6423.5227.1022.99
IVT27.9529.8327.4328.2127.6929.02
KCF5.5315.205.5813.105.5614.15
LGTv129.2311.7826.539.8527.8810.81
LT_FLO17.0830.8420.8431.2018.9631.02
MCT16.8113.9517.5813.0517.1913.50
MIL34.9325.0835.5325.7535.2325.42
MatFlow22.008.7919.1414.6820.5711.74
Matrioska22.1220.6321.9524.2922.0322.46
NCC18.5035.1723.4437.1720.9736.17
OGT14.8130.1216.8930.1615.8530.14
PLT_1318.343.7517.304.8317.824.29
PLT_1414.726.3313.735.1014.225.72
PTp33.0521.5330.2720.1531.6620.84
SAMF5.8714.075.6912.915.7813.49
SIR_PF24.5420.8722.3322.5023.4321.68
Struck20.8721.2121.4218.8321.1520.02
ThunderStruck22.6120.1721.9918.6822.3019.42
VTDMG21.4818.5020.6517.0221.0617.76
aStruck22.4119.1520.8822.0521.6420.60
alov4415.5410.877.239.956.3910.41
eASMS14.2214.3111.3314.3512.7714.33
qwsEDFT17.5019.2418.5521.0118.0220.12

Experiment baseline

Ranking plot for experiment baselineRanking plot for experiment baseline
AR plot for experiment baselineAR plot for experiment baseline
Accuracy
 camera_motionillum_changeocclusionsize_changemotion_changeemptyOverall
A-RankOverlapA-RankOverlapA-RankOverlapA-RankOverlapA-RankOverlapA-RankOverlapA-RankOverlap
ABS19.220.5128.450.4525.120.4612.500.4914.700.5324.000.4920.670.50
ACAT19.370.568.000.6220.700.4915.050.5014.650.575.000.6213.800.56
ACT20.540.5518.000.5517.040.5422.580.4719.880.5526.500.4720.760.54
BDF28.250.5021.000.5423.710.5127.860.4426.140.5212.500.5623.240.50
CMT21.920.5022.270.4925.520.5122.380.4524.000.494.500.6420.100.50
CT34.620.4335.710.3830.330.4336.600.3634.500.4223.000.4932.460.42
DGT10.940.5624.290.4721.920.483.000.587.670.582.500.6811.720.57
DSST3.670.671.500.755.440.649.270.533.500.6512.500.565.980.65
DynMS17.200.5422.920.5026.500.4817.140.4716.630.5436.500.3422.820.51
EDFT22.460.5217.500.5622.650.5221.000.4720.920.5317.500.5220.340.52
FRT20.810.5024.290.4821.000.5227.710.4223.480.4828.500.4524.300.48
FSDT20.260.5319.160.5318.070.5326.350.4423.430.5139.000.1324.380.49
FoT24.190.5018.540.5623.310.5015.000.5119.290.5516.000.5419.390.52
HMMTxD7.820.6013.160.5812.000.596.000.558.440.6113.000.5610.070.59
IIVTv221.920.5027.550.4418.000.5322.590.4526.850.4937.000.2925.650.47
IMPNCC23.680.4921.000.5231.000.4123.040.4524.200.5036.500.3326.570.48
IPRT25.120.4733.000.4027.000.4624.040.4328.220.4628.000.4527.560.46
IVT34.000.4719.120.5732.550.4033.420.4131.130.4917.500.5327.950.48
KCF2.500.672.000.756.920.654.290.582.500.6815.000.555.530.66
LGTv134.110.4427.650.4536.600.3328.050.4331.440.4617.500.5229.230.45
LT_FLO20.260.547.220.6128.110.4219.420.4720.440.547.000.6017.080.54
MCT18.260.5514.550.5718.500.5016.100.4819.440.5414.000.5516.810.54
MIL36.800.4134.780.3838.500.2833.730.3735.800.4130.000.4234.930.40
MatFlow21.380.5222.680.5216.260.5522.380.4521.780.5327.500.4622.000.51
Matrioska19.850.5421.760.5115.440.5726.760.4222.040.5126.850.4622.120.51
NCC14.840.5914.110.5611.290.6020.960.4819.290.5530.500.4318.500.55
OGT16.960.5614.290.5619.180.5112.000.5113.940.5612.500.5614.810.55
PLT_1319.370.5521.000.5211.290.5816.100.4819.290.5523.000.4918.340.54
PLT_1415.770.5621.000.5110.750.5912.240.5112.560.5716.000.5314.720.55
PTp34.000.4534.780.3732.000.4132.850.4032.150.4532.500.4033.050.43
SAMF3.000.664.500.678.500.615.000.573.200.6711.000.575.870.65
SIR_PF19.850.5324.780.4615.440.5526.960.4224.200.4936.000.3524.540.49
Struck20.260.5321.000.5112.390.5827.710.4122.850.5121.000.5020.870.51
ThunderStruck21.380.5124.290.4613.520.5727.710.4124.200.4924.560.4822.610.49
VTDMG19.370.5531.250.4315.440.5721.880.4719.880.5421.070.5021.480.52
aStruck29.880.519.080.6228.500.4432.500.4129.500.505.000.6322.410.51
alov4413.670.6210.070.6110.750.574.290.573.500.611.000.725.540.61
eASMS14.160.5528.000.4714.170.568.500.5113.000.557.500.5914.220.54
qwsEDFT19.370.5515.000.5714.650.5816.100.4819.290.5620.560.5017.500.54
Robustness
 camera_motionillum_changeocclusionsize_changemotion_changeemptyOverall
R-RankFailuresR-RankFailuresR-RankFailuresR-RankFailuresR-RankFailuresR-RankFailuresR-RankFailures
ABS16.3322.0021.583.0022.755.0018.5616.0015.6024.0017.000.0018.6418.11
ACAT18.8728.006.501.0015.354.0018.5616.0014.2129.0017.000.0015.0821.74
ACT14.4223.007.502.0023.386.0021.6819.0015.6029.0017.000.0016.6020.20
BDF19.3827.007.502.0026.655.0022.3514.0014.0818.0017.000.0017.8318.19
CMT30.5754.0021.717.0030.409.0021.6819.0031.5046.0017.000.0025.4838.26
CT33.3855.0030.5711.0026.148.0032.8933.0032.2958.0017.000.0028.7144.03
DGT7.0019.0024.2914.001.501.003.006.004.5014.0017.000.009.5513.78
DSST9.7820.006.501.0011.753.0016.6715.0012.7524.0017.000.0012.4116.90
DynMS18.8736.0029.8015.0022.755.0014.1714.0014.2123.0017.000.0019.4724.50
EDFT28.8336.0024.585.0027.356.0025.1219.0025.2735.0017.000.0024.6927.51
FRT36.0065.0038.0018.0026.1410.0033.1727.0037.5063.0017.000.0031.3049.52
FSDT33.8355.0030.9014.0025.876.0031.8331.0033.6055.0037.001.0032.1743.23
FoT30.8847.0021.583.0030.408.0033.1023.0026.7541.0017.000.0026.6234.08
HMMTxD20.2532.0022.9410.0032.007.0019.4218.0012.7520.0017.000.0020.7322.12
IIVTv230.8959.6731.0013.8720.384.4726.5029.6028.3652.7317.000.0025.6944.25
IMPNCC34.6072.0031.0911.0025.876.0025.3229.0037.5064.0017.000.0028.5652.15
IPRT20.5437.4030.6711.137.703.0717.7718.1321.6232.6736.500.8022.4627.86
IVT34.0052.0031.0011.0030.409.0033.0028.0033.6053.0017.000.0029.8340.83
KCF13.5024.006.501.0017.115.0022.8920.0014.2126.0017.000.0015.2019.79
LGTv19.7815.207.501.4720.423.9311.507.404.5010.4717.000.0011.7810.34
LT_FLO32.0047.8021.384.6730.069.0733.1028.1331.5045.5337.000.8030.8436.53
MCT9.5715.476.501.207.502.2714.1712.4012.4420.0733.500.2713.9513.64
MIL30.5741.8731.6713.5322.755.0019.6019.4028.9040.1317.000.0025.0832.15
MatFlow5.0017.006.501.008.753.0011.009.004.5011.0017.000.008.7911.36
Matrioska13.7935.0021.388.009.624.0022.7427.0019.2445.0037.001.0020.6331.09
NCC39.00162.0038.0039.0039.0029.0039.0060.0039.00111.0017.000.0035.17109.50
OGT32.6071.0727.4610.8734.3310.5323.6324.2725.6741.4737.001.0030.1245.21
PLT_131.002.001.000.001.501.001.002.001.002.0017.000.003.751.66
PLT_142.004.006.501.007.502.003.004.002.004.0017.000.006.333.41
PTp19.5030.0030.368.0026.147.0012.0013.0024.1833.0017.000.0021.5324.05
SAMF9.7024.006.501.0015.354.0022.8918.0013.0025.0017.000.0014.0719.23
SIR_PF18.3834.8031.6719.479.622.6022.3516.4025.7337.2717.500.0720.8728.55
Struck20.2536.6721.583.6711.753.2030.5027.0725.6741.6717.500.0721.2130.39
ThunderStruck20.2535.8021.384.3310.203.6726.5025.8725.6742.2017.000.0020.1730.10
VTDMG19.3830.0021.387.0026.655.0011.0012.0015.6023.0017.000.0018.5021.02
aStruck18.0644.0021.716.0022.755.0013.4621.0021.9338.0017.000.0019.1531.95
alov4417.6717.0011.002.007.502.007.8316.0014.2132.0017.000.0010.8718.03
eASMS11.6025.0023.7914.0022.755.006.256.004.5010.0017.000.0014.3115.31
qwsEDFT20.2530.0011.002.0027.356.0022.3515.0017.4626.0017.000.0019.2421.78

Detailed plots

Ranking plot for label camera_motion in experiment baselineRanking plot for label camera_motion in experiment baseline
AR plot for label camera_motion in experiment baselineAR plot for label camera_motion in experiment baseline
Ranking plot for label illum_change in experiment baselineRanking plot for label illum_change in experiment baseline
AR plot for label illum_change in experiment baselineAR plot for label illum_change in experiment baseline
Ranking plot for label occlusion in experiment baselineRanking plot for label occlusion in experiment baseline
AR plot for label occlusion in experiment baselineAR plot for label occlusion in experiment baseline
Ranking plot for label size_change in experiment baselineRanking plot for label size_change in experiment baseline
AR plot for label size_change in experiment baselineAR plot for label size_change in experiment baseline
Ranking plot for label motion_change in experiment baselineRanking plot for label motion_change in experiment baseline
AR plot for label motion_change in experiment baselineAR plot for label motion_change in experiment baseline
Ranking plot for label empty in experiment baselineRanking plot for label empty in experiment baseline
AR plot for label empty in experiment baselineAR plot for label empty in experiment baseline

Experiment region_noise

Ranking plot for experiment region_noiseRanking plot for experiment region_noise
AR plot for experiment region_noiseAR plot for experiment region_noise
Accuracy
 camera_motionillum_changeocclusionsize_changemotion_changeemptyOverall
A-RankOverlapA-RankOverlapA-RankOverlapA-RankOverlapA-RankOverlapA-RankOverlapA-RankOverlap
ABS16.120.5024.520.4520.000.468.930.4710.500.5212.000.5215.340.50
ACAT21.540.529.380.5923.120.4324.000.4319.580.529.000.5617.770.51
ACT23.000.5119.000.5217.530.5125.500.4222.070.5126.000.4422.180.49
BDF25.960.4621.470.5021.500.4625.500.4122.460.4913.500.5221.730.47
CMT25.960.4424.110.4622.000.4625.500.3929.110.429.000.5622.610.44
CT31.230.4234.000.3727.000.4336.170.3534.100.4122.440.4730.820.41
DGT7.910.5522.430.4415.570.513.000.565.000.562.000.689.320.55
DSST6.330.612.000.704.000.607.500.515.800.609.500.555.860.60
DynMS17.080.5223.320.4520.000.4917.050.4514.610.5137.000.3421.510.49
EDFT23.000.4919.000.5320.970.4724.000.4221.380.5024.500.4622.140.48
FRT23.500.4628.710.4125.170.4428.410.3827.410.4330.000.4127.200.43
FSDT21.540.4820.000.5020.000.4824.960.4025.420.4634.000.4024.320.46
FoT28.470.4619.470.5420.000.4824.960.4324.840.4912.000.5221.620.48
HMMTxD8.310.5713.050.559.120.575.500.516.830.5815.560.509.730.56
IIVTv222.500.4724.520.4318.470.4924.000.4025.420.4537.500.3325.400.44
IMPNCC28.470.4422.000.4728.500.4027.830.3830.800.4238.500.2929.350.42
IPRT25.320.4633.450.3825.170.4424.000.4225.920.4526.000.4426.640.44
IVT31.000.4418.500.5433.880.3528.410.3931.310.4421.500.4827.430.45
KCF4.000.612.000.708.500.575.500.523.500.6210.000.555.580.60
LGTv131.000.4327.290.4337.500.3224.500.4327.410.4611.500.5326.530.44
LT_FLO21.540.518.000.5927.950.4022.000.4420.580.5125.000.4620.840.50
MCT19.690.5215.710.5316.170.5121.000.4521.380.5011.500.5317.580.51
MIL39.000.3436.500.3438.500.2736.170.3337.000.3526.000.4435.530.35
MatFlow19.690.5020.500.5020.000.4920.580.4319.580.5114.500.5119.140.49
Matrioska19.690.5120.500.5019.530.5024.500.4022.460.4825.000.4621.950.48
NCC17.540.5217.200.5220.590.4725.500.4024.840.4735.000.3723.440.48
OGT17.540.5217.070.5319.000.5010.130.4814.610.5323.000.4716.890.52
PLT_1318.670.5220.500.5013.580.5415.500.4616.550.5219.000.4917.300.51
PLT_1415.500.5421.000.4913.160.5610.130.4812.070.5410.500.5413.730.53
PTp28.470.4530.500.3932.910.3727.830.3927.900.4534.000.3930.270.43
SAMF4.000.613.000.647.620.595.500.524.000.6110.000.545.690.60
SIR_PF17.080.5222.810.4516.170.5224.000.4221.920.4932.000.4022.330.48
Struck21.540.5020.000.5016.170.5325.500.4024.840.4820.500.4921.420.48
ThunderStruck21.540.5021.470.4815.570.5325.500.4025.420.4822.440.4721.990.48
VTDMG19.690.5222.000.4817.530.5220.580.4419.080.5125.000.4620.650.50
aStruck23.590.4815.000.5422.210.4325.500.4125.920.4713.050.5220.880.47
alov4414.000.5914.000.5614.620.514.750.535.000.581.000.737.230.58
eASMS10.530.5425.120.4512.670.546.000.508.150.545.500.5911.330.53
qwsEDFT19.690.5218.100.5417.530.5216.440.4514.000.5225.500.4518.550.51
Robustness
 camera_motionillum_changeocclusionsize_changemotion_changeemptyOverall
R-RankFailuresR-RankFailuresR-RankFailuresR-RankFailuresR-RankFailuresR-RankFailuresR-RankFailures
ABS10.4020.9313.502.4017.964.2017.6517.0013.0024.8019.500.2015.3417.94
ACAT14.8529.407.091.3316.725.3318.4618.4713.3330.2019.000.0714.9123.03
ACT12.2529.007.091.6717.964.7319.7823.1316.6236.1317.500.0015.2025.07
BDF19.6931.009.802.1328.765.4717.6514.3313.5721.0019.000.0718.0820.74
CMT27.8252.4021.695.0729.447.5322.6123.1329.5046.0719.500.1325.0937.90
CT33.1462.8730.4613.4722.577.7330.9235.1331.5054.9319.000.0727.9346.93
DGT6.0023.8024.1614.734.251.806.758.604.0016.2017.500.0010.4416.79
DSST8.8922.275.000.8016.723.9317.6517.9311.8326.6717.500.0012.9318.94
DynMS21.9238.8030.8316.0716.003.8017.6516.8012.7926.2017.500.0019.4526.94
EDFT28.3640.0724.676.2729.737.4020.4118.9322.6034.0719.500.2024.2129.10
FRT37.0069.0038.0020.0026.6210.2734.3332.3338.0064.6717.500.0031.9152.49
FSDT29.5446.2728.509.8723.626.4032.1030.8032.0053.4030.000.3329.2938.74
FoT32.2556.0017.703.6729.739.8034.1430.0731.4446.8717.500.0027.1340.41
HMMTxD19.6932.9324.678.8028.765.8715.1314.3311.8321.2717.500.0019.6022.25
IIVTv227.8659.7331.6416.8017.965.4018.8827.4727.0848.9319.500.1323.8243.28
IMPNCC32.2568.2728.5014.9326.626.4033.8933.5334.6761.7319.500.2029.2450.94
IPRT24.4640.6730.9011.0015.524.6016.9020.0720.8334.5332.500.4723.5229.98
IVT32.4452.6728.509.6025.388.5332.1028.6733.3353.8717.500.0028.2141.28
KCF10.6426.205.001.0712.473.3319.7821.8013.2029.4717.500.0013.1021.82
LGTv16.8615.006.001.3317.963.876.757.474.0011.0017.500.009.8510.40
LT_FLO31.5049.9321.584.5331.919.1333.7530.6031.4448.2737.000.6731.2038.44
MCT8.1219.339.801.8014.253.6714.2715.4712.3623.2019.500.1313.0516.57
MIL31.4549.1329.3611.4024.085.5322.6123.7329.5045.8717.500.0025.7537.09
MatFlow13.2929.2011.402.6716.724.1316.4714.0712.6921.6717.500.0014.6820.15
Matrioska24.4647.9326.078.6719.675.6727.0534.2029.5058.6719.000.0724.2941.14
NCC39.00149.4037.0033.1339.0027.7339.0052.8039.00101.9330.000.3337.17100.34
OGT31.4569.7324.9411.8036.009.8728.4126.3330.1846.2730.000.3330.1646.25
PLT_131.506.275.001.002.001.271.504.331.507.4017.500.004.835.29
PLT_141.504.537.091.271.500.931.503.801.505.8717.500.005.104.10
PTp17.5428.4728.509.0720.364.6017.6515.8717.3329.9319.500.2720.1522.96
SAMF8.3323.076.001.0714.903.8018.8821.1311.8328.8717.500.0012.9120.29
SIR_PF23.0840.6034.8621.8713.003.0719.3616.6025.1835.6019.500.2022.5030.77
Struck19.2936.3317.703.4013.263.3320.5425.0724.7143.7317.500.0018.8330.55
ThunderStruck18.1732.8020.853.9311.783.3321.1722.2722.6039.8717.500.0018.6827.73
VTDMG14.2526.4727.407.8014.253.3316.9016.4711.8322.4717.500.0017.0219.99
aStruck23.0749.1321.714.8724.385.9319.2925.0726.3644.6717.500.0022.0536.33
alov4415.3316.733.830.5313.003.338.2516.9311.7830.4717.500.009.9517.52
eASMS9.7327.0025.2913.7324.084.804.006.934.0011.8719.000.0714.3516.73
qwsEDFT26.2037.4715.004.4729.447.5317.6516.2718.2529.4719.500.2021.0126.27

Detailed plots

Ranking plot for label camera_motion in experiment region_noiseRanking plot for label camera_motion in experiment region_noise
AR plot for label camera_motion in experiment region_noiseAR plot for label camera_motion in experiment region_noise
Ranking plot for label illum_change in experiment region_noiseRanking plot for label illum_change in experiment region_noise
AR plot for label illum_change in experiment region_noiseAR plot for label illum_change in experiment region_noise
Ranking plot for label occlusion in experiment region_noiseRanking plot for label occlusion in experiment region_noise
AR plot for label occlusion in experiment region_noiseAR plot for label occlusion in experiment region_noise
Ranking plot for label size_change in experiment region_noiseRanking plot for label size_change in experiment region_noise
AR plot for label size_change in experiment region_noiseAR plot for label size_change in experiment region_noise
Ranking plot for label motion_change in experiment region_noiseRanking plot for label motion_change in experiment region_noise
AR plot for label motion_change in experiment region_noiseAR plot for label motion_change in experiment region_noise
Ranking plot for label empty in experiment region_noiseRanking plot for label empty in experiment region_noise
AR plot for label empty in experiment region_noiseAR plot for label empty in experiment region_noise