🌱Aadam's Garden


Search IconIcon to open search

2022 BEVFusion - A Simple and Robust LiDAR-Camera Fusion Framework

Last updated Dec 17, 2022

# BEVFusion: A Simple and Robust LiDAR-Camera Fusion Framework


  • CiteKey:: liangBEVFusionSimpleRobust2022
  • Type:: preprint
  • Author:: Tingting Liang Hongwei Xie Kaicheng Yu Zhongyu Xia Zhiwei Lin Yongtao Wang Tao Tang Bing Wang Zhi Tang
  • Editor::
  • Publisher:: arXiv
  • Series::
  • Series Number::
  • Journal::
  • Volume::
  • Issue::
  • Pages::
  • Year:: 2022
  • DOI:: 10.48550/arXiv.2205.13790
  • ISSN::
  • ISBN::
  • Format:: PDF


Fusing the camera and LiDAR information has become a de-facto standard for 3D object detection tasks. Current methods rely on point clouds from the LiDAR sensor as queries to leverage the feature from the image space. However, people discovered that this underlying assumption makes the current fusion framework infeasible to produce any prediction when there is a LiDAR malfunction, regardless of minor or major. This fundamentally limits the deployment capability to realistic autonomous driving scenarios. In contrast, we propose a surprisingly simple yet novel fusion framework, dubbed BEVFusion, whose camera stream does not depend on the input of LiDAR data, thus addressing the downside of previous methods. We empirically show that our framework surpasses the state-of-the-art methods under the normal training settings. Under the robustness training settings that simulate various LiDAR malfunctions, our framework significantly surpasses the state-of-the-art methods by 15.7% to 28.9% mAP. To the best of our knowledge, we are the first to handle realistic LiDAR malfunction and can be deployed to realistic scenarios without any post-processing procedure. The code is available at https://github.com/ADLab-AutoDrive/BEVFusion.

Files and Links

Tags and Collections

  • Keywords:: Computer Science - Computer Vision and Pattern Recognition, ⭐⭐⭐
  • Collections:: CCAM

# Zotero Notes

Comment: Accepted at NeurIPS 2022

# Annotations

# Imported: 2022-12-17 4:06 pm

NY9FLSNZ.png Page 2

W7NQ3NPK.png Page 4

RLV96TJX.png Page 5

E75Y55GY.png Page 7

U8P6CBAF.png Page 7

# Notes