Information
Contact Name: Wei Liu
Email: weiliu@ecjtu.edu.cn
Organization: East China Jiaotong University
Method's Name: DECM-BS
Reference: Anonymous
Project Website:
Evaluation Metrics

Precision of each category :

$$ Pre_i = \frac{TP_i}{TP_i + FP_i}$$


Articulated Truck Bicycle Bus Car Motorcycle Non-motorized Vehicle Pedestrian Pickup Truck Single Unit Truck Work Van Background
0.9115 0.8269 0.9811 0.9830 0.9550 0.7538 0.9718 0.9445 0.8328 0.9679 0.9929

Recall of each category:

$$ Rec_i = \frac{TP_i}{TP_i + FN_i}$$


Articulated Truck Bicycle Bus Car Motorcycle Non-motorized Vehicle Pedestrian Pickup Truck Single Unit Truck Work Van Background
0.9312 0.9037 0.9663 0.9889 0.9010 0.5594 0.9022 0.9402 0.7898 0.8468 0.9984

Accuracy: 0.9776

$$ Acc = \frac{TP}{Number of Testing Images}$$


Mean Recall: 0.8844

$$ {mRec} = {\rm mean}({Rec_i})$$


Mean Precision: 0.9201

$$ {mPre} = {\rm mean}({Pre_i})$$


Cohen Kappa Score: 0.9651

Confusion Matrix (%):

Predicted
Articulated Truck Bicycle Bus Car Motorcycle Non-motorized Vehicle Pedestrian Pickup Truck Single Unit Truck Work Van Background
True Articulated Truck 93.12 0.00 0.12 0.19 0.00 0.85 0.00 0.15 4.56 0.04 0.97
Bicycle 0.00 90.37 0.53 0.53 0.70 0.00 3.68 0.00 0.00 0.00 4.20
Bus 0.31 0.12 96.63 1.05 0.00 0.12 0.04 0.19 0.04 0.19 1.32
Car 0.01 0.00 0.03 98.89 0.00 0.00 0.00 0.91 0.00 0.06 0.09
Motorcycle 0.00 4.24 0.00 3.43 90.10 0.81 0.20 0.20 0.00 0.20 0.81
Non-motorized Vehicle 10.50 0.46 0.91 9.13 1.60 55.94 0.23 1.37 9.13 0.23 10.50
Pedestrian 0.06 4.98 0.00 0.38 0.51 0.06 90.22 0.00 0.00 0.00 3.77
Pickup Truck 0.04 0.02 0.01 5.58 0.00 0.06 0.03 94.02 0.15 0.03 0.06
Single Unit Truck 11.48 0.08 0.16 1.56 0.08 1.33 0.08 4.22 78.98 0.86 1.17
Work Van 0.45 0.00 0.58 10.65 0.00 0.58 0.00 1.57 0.87 84.68 0.62
Background 0.02 0.00 0.00 0.07 0.00 0.02 0.03 0.00 0.01 0.01 99.84