paper-with-me

Papers

HyperTASR: Hypernetwork-Driven Task-Aware Scene Representations for Robust Manipulation

2025-08-26 · Li Sun, Jiefeng Wu, Feng Chen, Ruizhe Liu, Yanchao Yang arxiv

Effective policy learning for robotic manipulation requires scene representations that selectively capture task-relevant environmental features. Current approaches typically employ task-agnostic representation extraction, failing to emulate the dynamic perceptual adaptation observed in human cognition. We present HyperTASR, a hypernetwork-driven framework that modulates scene representations based on both task objectives and the execution phase. Our architecture dynamically generates representation transformation parameters conditioned on task specifications and progression state, enabling representations to evolve contextually throughout task execution. This approach maintains architectural compatibility with existing policy learning frameworks while fundamentally reconfiguring how visual features are processed. Unlike methods that simply concatenate or fuse task embeddings with task-agnostic representations, HyperTASR establishes computational separation between task-contextual and state-dependent processing paths, enhancing learning efficiency and representational quality. Comprehensive evaluations in both simulation and real-world environments demonstrate substantial performance improvements across different representation paradigms. Through ablation studies and attention visualization, we confirm that our approach selectively prioritizes task-relevant scene information, closely mirroring human adaptive perception during manipulation tasks. The project website is at https://lisunphil.github.io/HyperTASR_projectpage/.

📄 PDF Abstract BibTeX arXiv:2508.18802

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

CVAE-H: Conditionalizing Variational Autoencoders via Hypernetworks and Trajectory Forecasting for Autonomous Driving

2022-01-24 · Geunseob Oh, Huei Peng

The task of predicting stochastic behaviors of road agents in diverse environments is a challenging problem for autonomous driving. To best understand scene contexts and produce diverse possible future states of the road…

Autonomous DrivingPredictionTrajectory Forecasting

SpecAware: A Spectral-Content Aware Foundation Model for Unifying Multi-Sensor Learning in Hyperspectral Remote Sensing Mapping

2025-10-31 · Renjie Ji, Xue Wang, Chao Niu, Wen Zhang 외 arxiv

Hyperspectral imaging (HSI) is a critical technique for fine-grained land-use and land-cover (LULC) mapping. However, the inherent heterogeneity of HSI data, particularly the variation in spectral channels across sensors…

Transfer Learning

HyP-NeRF: Learning Improved NeRF Priors using a HyperNetwork

2023-06-09 · NeurIPS 2023 11 · Bipasha Sen, Gaurav Singh, Aditya Agarwal, Rohith Agaram 외

Neural Radiance Fields (NeRF) have become an increasingly popular representation to capture high-quality appearance and shape of scenes and objects. However, learning generalizable NeRF priors over categories of scenes o…

NeRFRetrieval

FedHypeVAE: Federated Learning with Hypernetwork Generated Conditional VAEs for Differentially Private Embedding Sharing

2026-01-02 · Sunny Gupta, Amit Sethi arxiv

Federated data sharing promises utility without centralizing raw data, yet existing embedding-level generators struggle under non-IID client heterogeneity and provide limited formal protection against gradient leakage. W…

Federated Learning

HyperPose: Camera Pose Localization using Attention Hypernetworks

2023-03-05 · Ron Ferens, Yosi Keller

In this study, we propose the use of attention hypernetworks in camera pose localization. The dynamic nature of natural scenes, including changes in environment, perspective, and lighting, creates an inherent domain gap …

regression