paper-with-me

Papers

Controlling Steering with Energy-Based Models

2023-01-28 · Mykyta Baliesnyi, Ardi Tampuu, Tambet Matiisen

So-called implicit behavioral cloning with energy-based models has shown promising results in robotic manipulation tasks. We tested if the method's advantages carry on to controlling the steering of a real self-driving car with an end-to-end driving model. We performed an extensive comparison of the implicit behavioral cloning approach with explicit baseline approaches, all sharing the same neural network backbone architecture. Baseline explicit models were trained with regression (MAE) loss, classification loss (softmax and cross-entropy on a discretization), or as mixture density networks (MDN). While models using the energy-based formulation performed comparably to baseline approaches in terms of safety driver interventions, they had a higher whiteness measure, indicating higher jerk. To alleviate this, we show two methods that can be used to improve the smoothness of steering. We confirmed that energy-based models handle multimodalities slightly better than simple regression, but this did not translate to significantly better driving ability. We argue that the steering-only road-following task has too few multimodalities to benefit from energy-based models. This shows that applying implicit behavioral cloning to real-world tasks can be challenging, and further investigation is needed to bring out the theoretical advantages of energy-based models.

📄 PDF Abstract BibTeX arXiv:2301.12264

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Similar Papers 제목 키워드 기반

Modular Energy Steering for Safe Text-to-Image Generation with Foundation Models

2026-04-02 · Yaoteng Tan, Zikui Cai, M. Salman Asif arxiv

Controlling the behavior of text-to-image generative models is critical for safe and practical deployment. Existing safety approaches typically rely on model fine-tuning or curated datasets, which can degrade generation …

Text-to-Image Generation

Beyond Multiple Choice: Evaluating Steering Vectors for Adaptive Free-Form Summarization

2025-05-30 · Joschka Braun, Carsten Eickhoff, Seyed Ali Bahrainian

Steering vectors are a lightweight method for controlling text properties by adding a learned bias to language model activations at inference time. So far, steering vectors have predominantly been evaluated in multiple-c…

FormLanguage ModelingLanguage ModellingMultiple-choice

UniSteer: Text-Guided Flow Matching in Activation Space for Versatile LLM Steering

2026-05-28 · Yingdong Shi, Ruiming Zhang, Changming Li, Zhiyu Yang 외 arxiv

Activation-based control steers large language models (LLMs) by intervening on their internal representations during inference, and has emerged as an effective paradigm for controlling behaviors such as persona and style…

Instruction Following

Controlling Steering Angle for Cooperative Self-driving Vehicles utilizing CNN and LSTM-based Deep Networks

2019-04-08 · Rodolfo Valiente, Mahdi Zaman, Sedat Ozer, Yaser P. Fallah

A fundamental challenge in autonomous vehicles is adjusting the steering angle at different road conditions. Recent state-of-the-art solutions addressing this challenge include deep learning techniques as they provide en…

Autonomous Vehicles

HyperSteer: Activation Steering at Scale with Hypernetworks

2025-06-03 · Jiuding Sun, Sidharth Baskaran, Zhengxuan Wu, Michael Sklar 외

Steering language models (LMs) by modifying internal activations is a popular approach for controlling text generation. Unsupervised dictionary learning methods, e.g., sparse autoencoders, can be scaled to produce many s…

Dictionary LearningText Generation