TABLE III: Performance evaluation in the (CoRL2017) Carla benchmark for Town02. The table shows average km driven
between infractions per class (MP, IL, and RL are evaluated in
Dosovitskiy et. al (2017)).
The total number of km might differ. The best performing models are shown in Bold.
|
New Town |
New Town & New Weather |
| Infraction Type |
MP |
IL |
RL |
TGDG |
TEDE |
TEDG |
TGDE |
MP |
IL |
RL |
TGDG |
TEDE |
TEDG |
TGDE |
| Opposite lane ↑ |
0.45 |
1.12 |
0.23 |
2.14 |
0.18 |
0.24 |
4.10 |
0.40 |
0.78 |
0.21 |
2.13 |
0.18 |
0.25 |
2.93 |
| Sidewalk ↑ |
0.46 |
0.76 |
0.43 |
0.40 |
10.24 |
9.80 |
0.11 |
0.43 |
0.81 |
0.48 |
0.39 |
6.64 |
9.80 |
0.10 |
| Collision-static ↑ |
0.44 |
0.40 |
0.23 |
2.52 |
2.16 |
2.18 |
0.55 |
0.45 |
0.28 |
0.25 |
3.55 |
1.53 |
3.27 |
0.79 |
| Collision-vehicle ↑ |
0.51 |
0.59 |
0.41 |
0.34 |
0.22 |
0.27 |
0.38 |
0.47 |
0.44 |
0.37 |
0.33 |
0.26 |
0.24 |
0.34 |
| Collision-pedestrian ↑ |
1.40 |
1.88 |
2.55 |
1.40 |
1.20 |
1.35 |
0.53 |
1.46 |
1.41 |
2.99 |
1.39 |
0.69 |
1.13 |
1.31 |