paper-with-me

Papers

Target-driven Self-Distillation for Partial Observed Trajectories Forecasting

2025-01-28 · Pengfei Zhu, Peng Shu, Mengshi Qi, Liang Liu, Huadong Ma

Accurate prediction of future trajectories of traffic agents is essential for ensuring safe autonomous driving. However, partially observed trajectories can significantly degrade the performance of even state-of-the-art models. Previous approaches often rely on knowledge distillation to transfer features from fully observed trajectories to partially observed ones. This involves firstly training a fully observed model and then using a distillation process to create the final model. While effective, they require multi-stage training, making the training process very expensive. Moreover, knowledge distillation can lead to a performance degradation of the model. In this paper, we introduce a Target-driven Self-Distillation method (TSD) for motion forecasting. Our method leverages predicted accurate targets to guide the model in making predictions under partial observation conditions. By employing self-distillation, the model learns from the feature distributions of both fully observed and partially observed trajectories during a single end-to-end training process. This enhances the model's ability to predict motion accurately in both fully observed and partially observed scenarios. We evaluate our method on multiple datasets and state-of-the-art motion forecasting models. Extensive experimental results demonstrate that our approach achieves significant performance improvements in both settings. To facilitate further research, we will release our code and model checkpoints.

📄 PDF Abstract BibTeX arXiv:2501.16767

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingKnowledge DistillationMotion Forecasting

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Even your Teacher Needs Guidance: Ground-Truth Targets Dampen Regularization Imposed by Self-Distillation

2021-02-25 · NeurIPS 2021 12 · Kenneth Borup, Lars N. Andersen

Knowledge distillation is classically a procedure where a neural network is trained on the output of another network along with the original targets in order to transfer knowledge between the architectures. The special c…

Knowledge DistillationSelf-Knowledge Distillation

Rethinking Reward Supervision: Rubric-Conditioned Self-Distillation

2026-06-17 · Siyi Gu, Jialin Chen, Sophia Zhou, Arman Cohan 외 arxiv

Post-training of reasoning language models is commonly driven by supervised distillation and reinforcement learning with verifiable rewards. Distillation often relies on chain-of-thought annotations that are expensive to…

Reinforcement Learning

Spotlighting Partially Visible Cinematic Language for Video-to-Audio Generation via Self-distillation

2025-07-03 · Feizhen Huang, Yu Wu, Yutian Lin, Bo Du arxiv

Video-to-Audio (V2A) Generation achieves significant progress and plays a crucial role in film and video post-production. However, current methods overlook the cinematic language, a critical component of artistic express…

Audio Generation

Self-Distillation Amplifies Regularization in Hilbert Space

2020-02-13 · NeurIPS 2020 12 · Hossein Mobahi, Mehrdad Farajtabar, Peter L. Bartlett

Knowledge distillation introduced in the deep learning context is a method to transfer knowledge from one architecture to another. In particular, when the architectures are identical, this is called self-distillation. Th…

Knowledge DistillationL2 Regularization

Targeted matrix completion

2017-04-30 · Natali Ruchansky, Mark Crovella, Evimaria Terzi

Matrix completion is a problem that arises in many data-analysis settings where the input consists of a partially-observed matrix (e.g., recommender systems, traffic matrix analysis etc.). Classical approaches to matrix …

Matrix CompletionRecommendation Systems