MC-MLP:Multiple Coordinate Frames in all-MLP Architecture for Vision
In deep learning, Multi-Layer Perceptrons (MLPs) have once again garnered attention from researchers. This paper introduces MC-MLP, a general MLP-like backbone for computer vision that is composed of a series of fully-connected (FC) layers. In MC-MLP, we propose that the same semantic information has varying levels of difficulty in learning, depending on the coordinate frame of features. To address this, we perform an orthogonal transform on the feature information, equivalent to changing the coordinate frame of features. Through this design, MC-MLP is equipped with multi-coordinate frame receptive fields and the ability to learn information across different coordinate frames. Experiments demonstrate that MC-MLP outperforms most MLPs in image classification tasks, achieving better performance at the same parameter level. The code will be available at: https://github.com/ZZM11/MC-MLP.
Code (1)
Tasks
Allimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
Learning Cross-Video Neural Representations for High-Quality Frame Interpolation
This paper considers the problem of temporal video interpolation, where the goal is to synthesize a new video frame given its two neighbors. We propose Cross-Video Neural Representation (CURE) as the first video interpol…
Video Frame InterpolationVocal Bursts Intensity PredictionFlowing ConvNets for Human Pose Estimation in Videos
The objective of this work is human pose estimation in videos, where multiple frames are available. We investigate a ConvNet architecture that is able to benefit from temporal context by combining information across the …
Optical Flow EstimationPose EstimationFull-Frame Scene Coordinate Regression for Image-Based Localization
Image-based localization, or camera relocalization, is a fundamental problem in computer vision and robotics, and it refers to estimating camera pose from an image. Recent state-of-the-art approaches use learning based m…
Camera RelocalizationData AugmentationDecoderImage-Based Localization+1Temporally Robust Global Motion Compensation by Keypoint-based Congealing
Global motion compensation (GMC) removes the impact of camera motion and creates a video in which the background appears static over the progression of time. Various vision problems, such as human activity recognition, b…
Activity RecognitionHuman Activity RecognitionMotion CompensationMotion Estimation+2World-consistent Video Diffusion with Explicit 3D Modeling
Recent advancements in diffusion models have set new benchmarks in image and video generation, enabling realistic visual synthesis across single- and multi-frame contexts. However, these models still struggle with effici…
3D GenerationImage GenerationImage to 3DVideo Generation