paper-with-me

Papers

PatchMixer: Rethinking network design to boost generalization for 3D point cloud understanding

2023-07-28 · Davide Boscaini, Fabio Poiesi

The recent trend in deep learning methods for 3D point cloud understanding is to propose increasingly sophisticated architectures either to better capture 3D geometries or by introducing possibly undesired inductive biases. Moreover, prior works introducing novel architectures compared their performance on the same domain, devoting less attention to their generalization to other domains. We argue that the ability of a model to transfer the learnt knowledge to different domains is an important feature that should be evaluated to exhaustively assess the quality of a deep network architecture. In this work we propose PatchMixer, a simple yet effective architecture that extends the ideas behind the recent MLP-Mixer paper to 3D point clouds. The novelties of our approach are the processing of local patches instead of the whole shape to promote robustness to partial point clouds, and the aggregation of patch-wise features using an MLP as a simpler alternative to the graph convolutions or the attention mechanisms that are used in prior works. We evaluated our method on the shape classification and part segmentation tasks, achieving superior generalization performance compared to a selection of the most relevant deep architectures.

📄 PDF Abstract BibTeX arXiv:2307.15692

Code (1)

davideboscaini/patchmixer 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Average Pooling 설명 없음
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Residual Connection 설명 없음
MLP-Mixer 설명 없음

Similar Papers 제목 키워드 기반

PatchMixer: A Patch-Mixing Architecture for Long-Term Time Series Forecasting

2023-10-01 · Zeying Gong, Yujin Tang, Junwei Liang

Although the Transformer has been the dominant architecture for time series forecasting tasks in recent years, a fundamental challenge remains: the permutation-invariant self-attention mechanism within Transformers leads…

Time SeriesTime Series Forecasting

Lossless Compression and Generalization in Overparameterized Models: The Case of Boosting

2021-03-04 · ICLR Workshop Neural_Compression 2021 5 · Nikolaos Nikolaou

Successful learning algorithms like DNNs, kernel methods or ensemble learning methods, have been known to produce models that exhibit good generalization despite being drawn from overparameterized model families. Th…

Ensemble Learning

PillarNeXt: Rethinking Network Designs for 3D Object Detection in LiDAR Point Clouds

2023-05-08 · CVPR 2023 1 · Jinyu Li, Chenxu Luo, Xiaodong Yang

In order to deal with the sparse and unstructured raw point clouds, LiDAR based 3D object detection research mostly focuses on designing dedicated local point aggregators for fine-grained geometrical modeling. In this pa…

2D Object Detection3D Object DetectionObjectobject-detection+1

Rethinking Domain Adaptation and Generalization in the Era of CLIP

2024-07-21 · Ruoyu Feng, Tao Yu, Xin Jin, Xiaoyuan Yu 외

In recent studies on domain adaptation, significant emphasis has been placed on the advancement of learning shared knowledge from a source domain to a target domain. Recently, the large vision-language pre-trained model,…

Domain AdaptationZero-Shot Learning

MVBoost: Boost 3D Reconstruction with Multi-View Refinement

2024-11-26 · CVPR 2025 1 · Xiangyu Liu, Xiaomei Zhang, Zhiyuan Ma, Xiangyu Zhu 외

Recent advancements in 3D object reconstruction have been remarkable, yet most current 3D models rely heavily on existing 3D datasets. The scarcity of diverse 3D datasets results in limited generalization capabilities of…

3D Object Reconstruction3D ReconstructionObject Reconstruction