paper-with-me

Papers

Möbius Transform for Mitigating Perspective Distortions in Representation Learning

2024-03-07 · Prakash Chandra Chhipa, Meenakshi Subhash Chippa, Kanjar De, Rajkumar Saini, Marcus Liwicki, Mubarak Shah

Perspective distortion (PD) causes unprecedented changes in shape, size, orientation, angles, and other spatial relationships of visual concepts in images. Precisely estimating camera intrinsic and extrinsic parameters is a challenging task that prevents synthesizing perspective distortion. Non-availability of dedicated training data poses a critical barrier to developing robust computer vision methods. Additionally, distortion correction methods make other computer vision tasks a multi-step approach and lack performance. In this work, we propose mitigating perspective distortion (MPD) by employing a fine-grained parameter control on a specific family of M\"obius transform to model real-world distortion without estimating camera intrinsic and extrinsic parameters and without the need for actual distorted data. Also, we present a dedicated perspectively distorted benchmark dataset, ImageNet-PD, to benchmark the robustness of deep learning models against this new dataset. The proposed method outperforms existing benchmarks, ImageNet-E and ImageNet-X. Additionally, it significantly improves performance on ImageNet-PD while consistently performing on standard data distribution. Notably, our method shows improved performance on three PD-affected real-world applications crowd counting, fisheye image recognition, and person re-identification and one PD-affected challenging CV task: object detection. The source code, dataset, and models are available on the project webpage at https://prakashchhipa.github.io/projects/mpd.

📄 PDF Abstract BibTeX arXiv:2405.02296

Code (0)

등록된 구현이 없습니다.

Tasks

Crowd Countingdistortion correctionobject-detectionObject DetectionPerson Re-IdentificationRepresentation Learning

Similar Papers 제목 키워드 기반

LCM: Log Conformal Maps for Robust Representation Learning to Mitigate Perspective Distortion

2024-09-20 · Meenakshi Subhash Chippa, Prakash Chandra Chhipa, Kanjar De, Marcus Liwicki 외

Perspective distortion (PD) leads to substantial alterations in the shape, size, orientation, angles, and spatial relationships of visual elements in images. Accurately determining camera intrinsic and extrinsic paramete…

distortion correctionPerson Re-IdentificationRepresentation Learning

PanDA: Towards Panoramic Depth Anything with Unlabeled Panoramas and Mobius Spatial Augmentation

2025-01-01 · CVPR 2025 1 · Zidong Cao, Jinjing Zhu, Weiming Zhang, Hao Ai 외

Recently, Depth Anything Models (DAMs) - a type of depth foundation models - have demonstrated impressive zero-shot capabilities across diverse perspective images. Despite its success, it remains an open question reg…

Depth Estimation

Any360D: Towards 360 Depth Anything with Unlabeled 360 Data and Möbius Spatial Augmentation

2024-06-19 · Zidong Cao, Jinjing Zhu, Weiming Zhang, Lin Wang

Recently, Depth Anything Model (DAM) - a type of depth foundation model - reveals impressive zero-shot capacity for diverse perspective images. Despite its success, it remains an open question regarding DAM's performance…

Differential and integral invariants under Mobius transformation

2018-08-30 · He Zhang, Hanlin Mo, You Hao, Qi Li 외

One of the most challenging problems in the domain of 2-D image or 3-D shape is to handle the non-rigid deformation. From the perspective of transformation groups, the conformal transformation is a key part of the diffeo…

Learning to Understand: Identifying Interactions via the Möbius Transform

2024-02-04 · Justin S. Kang, Yigit E. Erginbas, Landon Butler, Ramtin Pedarsani 외

One of the key challenges in machine learning is to find interpretable representations of learned functions. The M\"obius transform is essential for this purpose, as its coefficients correspond to unique importance score…

Learning Theory