Multi-Modal Fusion Transformer
for End-to-End Autonomous Driving
CVPR 2021
for End-to-End Autonomous Driving
-
Max Planck Institute for Intelligent Systems -
University of Tübingen
How should representations from complementary sensors be integrated for autonomous driving? Geometry-based sensor fusion has shown great promise for perception tasks such as object detection and motion forecasting. However, for the actual driving task, the global context of the 3D scene is key, e.g. a change in traffic light state can affect the behavior of a vehicle geometrically distant from that traffic light. Geometry alone may therefo