paper-with-me

홈 › Papers

FlatFusion: Delving into Details of Sparse Transformer-based Camera-LiDAR Fusion for Autonomous Driving

2024-08-13 · Yutao Zhu, Xiaosong Jia, Xinyu Yang, Junchi Yan

The integration of data from diverse sensor modalities (e.g., camera and LiDAR) constitutes a prevalent methodology within the ambit of autonomous driving scenarios. Recent advancements in efficient point cloud transformers have underscored the efficacy of integrating information in sparse formats. When it comes to fusion, since image patches are dense in pixel space with ambiguous depth, it necessitates additional design considerations for effective fusion. In this paper, we conduct a comprehensive exploration of design choices for Transformer-based sparse cameraLiDAR fusion. This investigation encompasses strategies for image-to-3D and LiDAR-to-2D mapping, attention neighbor grouping, single modal tokenizer, and micro-structure of Transformer. By amalgamating the most effective principles uncovered through our investigation, we introduce FlatFusion, a carefully designed framework for sparse camera-LiDAR fusion. Notably, FlatFusion significantly outperforms state-of-the-art sparse Transformer-based methods, including UniTR, CMT, and SparseFusion, achieving 73.7 NDS on the nuScenes validation set with 10.1 FPS with PyTorch.

📄 PDF Abstract BibTeX arXiv:2408.06832

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingImage to 3D

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Multi-Head Attention 설명 없음
Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Harnessing Joint Rain-/Detail-aware Representations to Eliminate Intricate Rains

2024-04-18 · Wu Ran, Peirong Ma, Zhiquan He, Hao Ren 외

Recent advances in image deraining have focused on training powerful models on mixed multiple datasets comprising diverse rain types and backgrounds. However, this approach tends to overlook the inherent differences amon…

Contrastive LearningRain Removal

Delving into Macro Placement with Reinforcement Learning

2021-09-06 · Zixuan Jiang, Ebrahim Songhori, Shen Wang, Anna Goldie 외

In physical design, human designers typically place macros via trial and error, which is a Markov decision process. Reinforcement learning (RL) methods have demonstrated superhuman performance on the macro placement. In …

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Axiom Pinpointing

2020-03-18 · Rafael Peñaloza

Axiom pinpointing refers to the task of finding the specific axioms in an ontology which are responsible for a consequence to follow. This task has been studied, under different names, in many research areas, leading to …

End-to-End Vectorized HD-map Construction with Piecewise Bezier Curve

2023-06-16 · CVPR 2023 1 · Limeng Qiao, Wenjie Ding, Xi Qiu, Chi Zhang

Vectorized high-definition map (HD-map) construction, which focuses on the perception of centimeter-level environmental information, has attracted significant research interest in the autonomous driving community. Most e…

3D geometryAutonomous Driving

Delving into Differentially Private Transformer

2024-05-28 · Youlong Ding, Xueyang Wu, Yining Meng, Yonggang Luo 외

Deep learning with differential privacy (DP) has garnered significant attention over the past years, leading to the development of numerous methods aimed at enhancing model accuracy and training efficiency. This paper de…