Information
Contact Name: Carl Lemaire
Email: carl.lemaire@usherbrooke.ca
Organization: Université de Sherbrooke
Method's Name: AlexNet
Reference: A Krizhevsky, I. Sutskever, G. Hinton. ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of NIPS 2012, p.1097-1105.
Project Website:
Evaluation Metrics

Precision of each category :

$$ Pre_i = \frac{TP_i}{TP_i + FP_i}$$


Articulated Truck Bicycle Bus Car Motorcycle Non-motorized Vehicle Pedestrian Pickup Truck Single Unit Truck Work Van Background
0.7164 0.8246 0.7361 0.9378 0.7013 0.0000 0.7355 0.6216 0.6576 0.7035 0.9733

Recall of each category:

$$ Rec_i = \frac{TP_i}{TP_i + FN_i}$$


Articulated Truck Bicycle Bus Car Motorcycle Non-motorized Vehicle Pedestrian Pickup Truck Single Unit Truck Work Van Background
0.6220 0.3047 0.8596 0.9058 0.2182 0.0000 0.7604 0.8430 0.2445 0.4203 0.9847

Accuracy: 0.8917

$$ Acc = \frac{TP}{Number of Testing Images}$$


Mean Recall: 0.5603

$$ {mRec} = {\rm mean}({Rec_i})$$


Mean Precision: 0.6916

$$ {mPre} = {\rm mean}({Pre_i})$$


Cohen Kappa Score: 0.8325

Confusion Matrix (%):

Predicted
Articulated Truck Bicycle Bus Car Motorcycle Non-motorized Vehicle Pedestrian Pickup Truck Single Unit Truck Work Van Background
True Articulated Truck 62.20 0.00 7.23 8.27 0.00 0.00 0.27 11.60 3.36 1.16 5.91
Bicycle 1.40 30.47 0.35 14.89 7.88 0.00 35.03 5.08 0.00 0.00 4.90
Bus 2.02 0.00 85.96 5.54 0.00 0.00 0.12 1.78 0.16 2.29 2.13
Car 0.10 0.00 0.28 90.58 0.00 0.00 0.08 8.02 0.00 0.27 0.67
Motorcycle 1.41 6.26 0.00 25.25 21.82 0.00 24.44 19.60 0.00 0.00 1.21
Non-motorized Vehicle 24.43 0.00 17.58 18.95 0.00 0.00 1.14 11.87 6.62 7.76 11.64
Pedestrian 0.13 0.38 0.00 7.60 0.06 0.00 76.04 0.64 0.00 0.00 15.14
Pickup Truck 0.25 0.00 0.34 14.25 0.00 0.00 0.06 84.30 0.08 0.45 0.28
Single Unit Truck 24.45 0.00 8.20 10.63 0.00 0.00 0.31 22.42 24.45 5.47 4.06
Work Van 1.16 0.00 6.28 30.22 0.00 0.00 0.12 18.00 1.16 42.03 1.03
Background 0.07 0.00 0.11 1.15 0.00 0.00 0.07 0.12 0.01 0.01 98.47