paper-with-me

Papers

Algorithms for learning value-aligned policies considering admissibility relaxation

2024-06-07 · Andrés Holgado-Sánchez, Joaquín Arias, Holger Billhardt, Sascha Ossowski

The emerging field of \emph{value awareness engineering} claims that software agents and systems should be value-aware, i.e. they must make decisions in accordance with human values. In this context, such agents must be capable of explicitly reasoning as to how far different courses of action are aligned with these values. For this purpose, values are often modelled as preferences over states or actions, which are then aggregated to determine the sequences of actions that are maximally aligned with a certain value. Recently, additional value admissibility constraints at this level have been considered as well. However, often relaxed versions of these constraints are needed, and this increases considerably the complexity of computing value-aligned policies. To obtain efficient algorithms that make value-aligned decisions considering admissibility relaxation, we propose the use of learning techniques, in particular, we have used constrained reinforcement learning algorithms. In this paper, we present two algorithms, $\epsilon\text{-}ADQL$ for strategies based on local alignment and its extension $\epsilon\text{-}CADQL$ for a sequence of decisions. We have validated their efficiency in a water distribution problem in a drought scenario.

📄 PDF Abstract BibTeX arXiv:2406.04838

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Admissibility Alignment

2026-01-05 · Chris Duffey arxiv

This paper introduces Admissibility Alignment: a reframing of AI alignment as a property of admissible action and decision selection over distributions of outcomes under uncertainty, evaluated through the behavior of can…

Strong Admissibility, a Tractable Algorithmic Approach (proofs)

2022-04-07 · Martin Caminada, Sri Harikrishnan

Much like admissibility is the key concept underlying preferred semantics, strong admissibility is the key concept underlying grounded semantics, as membership of a strongly admissible set is sufficient to show membershi…

Actor-Critic learning for mean-field control in continuous time

2023-03-13 · Noufel Frikha, Maximilien Germain, Mathieu Laurière, Huyên Pham 외

We study policy gradient for mean-field control in continuous time in a reinforcement learning setting. By considering randomised policies with entropy regularisation, we derive a gradient expectation representation of t…

reinforcement-learningReinforcement Learning (RL)

Meta-Policy Reflexion: Reusable Reflective Memory and Rule Admissibility for Resource-Efficient LLM Agent

2025-09-04 · Chunlong Wu, Ye Luo, Zhibo Qu, Min Wang arxiv

Large language model (LLM) agents achieve impressive single-task performance but commonly exhibit repeated failures, inefficient exploration, and limited cross-task adaptability. Existing reflective strategies (e.g., Ref…

Delta Epsilon Alpha Star: A PAC-Admissible Search Algorithm

2016-08-08 · David Cox

Delta Epsilon Alpha Star is a minimal coverage, real-time robotic search algorithm that yields a moderately aggressive search path with minimal backtracking. Search performance is bounded by a placing a combinatorial bou…