paper-with-me

홈 › Papers

iQRL -- Implicitly Quantized Representations for Sample-efficient Reinforcement Learning

2024-06-04 · Aidan Scannell, Kalle Kujanpää, Yi Zhao, Mohammadreza Nakhaei, Arno Solin, Joni Pajarinen

Learning representations for reinforcement learning (RL) has shown much promise for continuous control. We propose an efficient representation learning method using only a self-supervised latent-state consistency loss. Our approach employs an encoder and a dynamics model to map observations to latent states and predict future latent states, respectively. We achieve high performance and prevent representation collapse by quantizing the latent representation such that the rank of the representation is empirically preserved. Our method, named iQRL: implicitly Quantized Reinforcement Learning, is straightforward, compatible with any model-free RL algorithm, and demonstrates excellent performance by outperforming other recently proposed representation learning methods in continuous control benchmarks from DeepMind Control Suite.

📄 PDF Abstract BibTeX arXiv:2406.02696

Code (0)

등록된 구현이 없습니다.

Tasks

continuous-controlContinuous Controlreinforcement-learningReinforcement LearningReinforcement Learning (RL)Representation Learning

Similar Papers 제목 키워드 기반

Goal Reaching with Eikonal-Constrained Hierarchical Quasimetric Reinforcement Learning

2025-12-12 · Vittorio Giammarino, Ahmed H. Qureshi arxiv

Goal-Conditioned Reinforcement Learning (GCRL) mitigates the difficulty of reward design by framing tasks as goal reaching rather than maximizing hand-crafted reward signals. In this setting, the optimal goal-conditioned…

Reinforcement Learning

AffectEcho: Speaker Independent and Language-Agnostic Emotion and Affect Transfer for Speech Synthesis

2023-08-16 · Hrishikesh Viswanath, Aneesh Bhattacharya, Pascal Jutras-Dubé, Prerit Gupta 외

Affect is an emotional characteristic encompassing valence, arousal, and intensity, and is a crucial attribute for enabling authentic conversations. While existing text-to-speech (TTS) and speech-to-speech systems rely o…

AttributeSpeech Synthesistext-to-speechText to Speech

Learning Finite State Representations of Recurrent Policy Networks

2018-11-29 · ICLR 2019 5 · Anurag Koul, Sam Greydanus, Alan Fern

Recurrent neural networks (RNNs) are an effective representation of control policies for a wide range of reinforcement and imitation learning problems. RNN policies, however, are particularly difficult to explain, unders…

Atari GamesImitation Learning

A Unified Framework for Quantized and Continuous Strong Lottery Tickets

2026-07-04 · Aakash Kumar, Emanuele Natale arxiv

The Strong Lottery Ticket Hypothesis (SLTH) asserts that sufficiently overparameterized, randomly initialized neural networks contain sparse subnetworks that, even without any training, can match the performance of a sma…

Implicit Quantile Networks for Distributional Reinforcement Learning

2018-06-14 · ICML 2018 7 · Will Dabney, Georg Ostrovski, David Silver, Rémi Munos

In this work, we build on recent advances in distributional reinforcement learning to give a generally applicable, flexible, and state-of-the-art distributional variant of DQN. We achieve this by using quantile regressio…

Atari GamesDistributional Reinforcement Learningquantile regressionregression+3