paper-with-me

홈 › Papers

Explorative Imitation Learning: A Path Signature Approach for Continuous Environments

2024-07-05 · Nathan Gavenski, Juarez Monteiro, Felipe Meneguzzi, Michael Luck, Odinaldo Rodrigues

Some imitation learning methods combine behavioural cloning with self-supervision to infer actions from state pairs. However, most rely on a large number of expert trajectories to increase generalisation and human intervention to capture key aspects of the problem, such as domain constraints. In this paper, we propose Continuous Imitation Learning from Observation (CILO), a new method augmenting imitation learning with two important features: (i) exploration, allowing for more diverse state transitions, requiring less expert trajectories and resulting in fewer training iterations; and (ii) path signatures, allowing for automatic encoding of constraints, through the creation of non-parametric representations of agents and expert trajectories. We compared CILO with a baseline and two leading imitation learning methods in five environments. It had the best overall performance of all methods in all environments, outperforming the expert in two of them.

📄 PDF Abstract BibTeX arXiv:2407.04856

Code (2)

NathanGavenski/CILO 공식 구현 pytorch
nathangavenski/il-datasets pytorch

Tasks

Behavioural cloningImitation Learning

Methods 이 논문이 사용한 방법론

CILO 설명 없음

Similar Papers 제목 키워드 기반

From Jumps to Signatures: a Generative Method for Temporal Point Processes

2026-07-07 · Niels Cariou-Kotlarek, Vasileios Lampos arxiv

Rough path signatures are a universal feature map for continuous paths and, via the expected signature, characterise path distributions. These guarantees do not directly extend to cadlag paths of Temporal Point Processes…

Point Processes

Universal approximation with signatures of non-geometric rough paths

2026-02-05 · Mihriban Ceylan, Anna P. Kwossek, David J. Prömel arxiv

We establish a universal approximation theorem for signatures of rough paths that are not necessarily weakly geometric. By extending the path with time and its rough path bracket terms, we prove that linear functionals o…

Expected Signature Kernels for Lévy Rough Paths

2025-09-09 · Peter K. Friz, Paul P. Hager arxiv

The expected signature kernel arises in statistical learning tasks as a similarity measure of probability measures on path space. Computing this kernel for known classes of stochastic processes is an important problem th…

Derivatives pricing using signature payoffs

2018-09-25

We introduce signature payoffs, a family of path-dependent derivatives that are given in terms of the signature of the price path of the underlying asset. We show that these derivatives are dense in the space of continuo…

Path Imputation Strategies for Signature Models of Irregular Time Series

2020-05-25 · Michael Moor, Max Horn, Christian Bock, Karsten Borgwardt 외

The signature transform is a 'universal nonlinearity' on the space of continuous vector-valued paths, and has received attention for use in machine learning on time series. However, real-world temporal data is typically …

ImputationIrregular Time SeriesTime SeriesTime Series Analysis