paper-with-me

Papers

Modulated Neural ODEs

2023-02-26 · NeurIPS 2023 11 · Ilze Amanda Auzina, Çağatay Yıldız, Sara Magliacane, Matthias Bethge, Efstratios Gavves

Neural ordinary differential equations (NODEs) have been proven useful for learning non-linear dynamics of arbitrary trajectories. However, current NODE methods capture variations across trajectories only via the initial state value or by auto-regressive encoder updates. In this work, we introduce Modulated Neural ODEs (MoNODEs), a novel framework that sets apart dynamics states from underlying static factors of variation and improves the existing NODE methods. In particular, we introduce $\textit{time-invariant modulator variables}$ that are learned from the data. We incorporate our proposed framework into four existing NODE variants. We test MoNODE on oscillating systems, videos and human walking trajectories, where each trajectory has trajectory-specific modulation. Our framework consistently improves the existing model ability to generalize to new dynamic parameterizations and to perform far-horizon forecasting. In addition, we verify that the proposed modulator variables are informative of the true unknown factors of variation as measured by $R^2$ scores.

📄 PDF Abstract BibTeX arXiv:2302.13262

Code (1)

ilzeamandaa/monode 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

NODE Neural Oblivious Decision Ensembles (NODE) is a tabular data architecture that consists of differentiable oblivious decision trees (ODT) that are trained end-to-end by…

Similar Papers 제목 키워드 기반

Towards auditory attention decoding with noise-tagging: A pilot study

2024-03-22 · H. A. Scheppink, S. Ahmadi, P. Desain, M. Tangermann 외

Auditory attention decoding (AAD) aims to extract from brain activity the attended speaker amidst candidate speakers, offering promising applications for neuro-steered hearing devices and brain-computer interfacing. This…

Decoder

Making the unmodulated pyramid wavefront sensor smart II. First on-sky demonstration of extreme adaptive optics with deep learning

2025-03-20 · R. Landman, S. Y. Haffert, J. D. Long, J. R. Males 외

Pyramid wavefront sensors (PWFSs) are the preferred choice for current and future extreme adaptive optics (XAO) systems. Almost all instruments use the PWFS in its modulated form to mitigate its limited linearity range. …

Does the Cross-Talk Between Nonlinear Modes Limit the Performance of NFDM Systems?

2017-12-30

We show a non-negligible cross-talk between nonlinear modes in Nonlinear Frequency-Division Multiplexed system when data is modulated over the nonlinear Fourier spectrum, both the continuous spectrum and the discrete spe…

Modulated Graph Convolutional Network for 3D Human Pose Estimation

2021-01-01 · ICCV 2021 10 · Zhiming Zou, Wei Tang

The graph convolutional network (GCN) has recently achieved promising performance of 3D human pose estimation (HPE) by modeling the relationship among body parts. However, most prior GCN approaches suffer from two ma…

3D Human Pose EstimationPose Estimation

RSDet++: Point-based Modulated Loss for More Accurate Rotated Object Detection

2021-09-24 · Wen Qian, Xue Yang, Silong Peng, Junchi Yan 외

We classify the discontinuity of loss in both five-param and eight-param rotated object detection methods as rotation sensitivity error (RSE) which will result in performance degeneration. We introduce a novel modulated …

Objectobject-detectionObject DetectionSensitivity