paper-with-me

홈 › Papers

LORD: Large Models based Opposite Reward Design for Autonomous Driving

2024-03-27 · Xin Ye, Feng Tao, Abhirup Mallik, Burhaneddin Yaman, Liu Ren

Reinforcement learning (RL) based autonomous driving has emerged as a promising alternative to data-driven imitation learning approaches. However, crafting effective reward functions for RL poses challenges due to the complexity of defining and quantifying good driving behaviors across diverse scenarios. Recently, large pretrained models have gained significant attention as zero-shot reward models for tasks specified with desired linguistic goals. However, the desired linguistic goals for autonomous driving such as "drive safely" are ambiguous and incomprehensible by pretrained models. On the other hand, undesired linguistic goals like "collision" are more concrete and tractable. In this work, we introduce LORD, a novel large models based opposite reward design through undesired linguistic goals to enable the efficient use of large pretrained models as zero-shot reward models. Through extensive experiments, our proposed framework shows its efficiency in leveraging the power of large pretrained models for achieving safe and enhanced autonomous driving. Moreover, the proposed approach shows improved generalization capabilities as it outperforms counterpart methods across diverse and challenging driving scenarios.

📄 PDF Abstract BibTeX arXiv:2403.18965

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingImitation LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

"Yes, My LoRD." Guiding Language Model Extraction with Locality Reinforced Distillation

2024-09-04 · Zi Liang, Qingqing Ye, Yanyun Wang, Sen Zhang 외

Model extraction attacks (MEAs) on large language models (LLMs) have received increasing attention in recent research. However, existing attack methods typically adapt the extraction strategies originally developed for d…

Language ModelingLanguage ModellingModel extraction

dlordinal: a Python package for deep ordinal classification

2024-07-24 · Francisco Bérchez-Moreno, Víctor M. Vargas, Rafael Ayllón-Gavilán, David Guijo-Rubio 외

dlordinal is a new Python library that unifies many recent deep ordinal classification methodologies available in the literature. Developed using PyTorch as underlying framework, it implements the top performing state-of…

ClassificationOrdinal Classification

Reward-Conditioned Attention: How Reward Design Shapes What Autonomous Driving Agents See

2026-06-23 · Mohamed Benabdelouahad, Ahmed Djalal Hacini, Nadir Farhi, Aissa Boulmerka arxiv

We investigate how reward design shapes the internal attention patterns of reinforcement learning agents trained for autonomous driving. Using three Perceiver-based agents that share identical architectures and training …

Reinforcement LearningAutonomous Driving

SQLord: A Robust Enterprise Text-to-SQL Solution via Reverse Data Generation and Workflow Decomposition

2025-07-14 · Song Cheng, Qiannan Cheng, Linbo Jin, Lei Yi 외 arxiv

Transforming natural language into SQL queries (NL2SQL) is crucial for data-driven business applications. Existing frameworks, trained on open-source datasets, struggle with complex business logic and lack domain-specifi…

LORD: Low Rank Decomposition Of Monolingual Code LLMs For One-Shot Compression

2023-09-25 · Ayush Kaushal, Tejas Vaidhya, Irina Rish

Low Rank Decomposition of matrix - splitting a large matrix into a product of two smaller matrix offers a means for compression that reduces the parameters of a model without sparsification, and hence delivering more spe…

Code GenerationHumanEvalparameter-efficient fine-tuningQuantization