Addressing and Visualizing Misalignments in Human Task-Solving Trajectories

2024-09-21 · Sejin Kim, Hosung Lee, Sundong Kim

Understanding misalignments in human task-solving trajectories is crucial for enhancing AI models trained to closely mimic human reasoning. This study categorizes such misalignments into three types: (1) lack of functions to express intent, (2) inefficient action sequences, and (3) incorrect intentions that cannot solve the task. To address these issues, we first formalize and define these three misalignment types in a unified framework. We then propose a heuristic algorithm to detect misalignments in ARCTraj trajectories and analyze their impact hierarchically and quantitatively. We also present an intention estimation method based on our formalism that infers missing alignment between user actions and intentions. Through trajectory alignment, we experimentally demonstrate that AI models trained on human task-solving trajectories improve performance in mimicking human reasoning. Based on hierarchical analysis and experiments, we highlight the importance of trajectory-intention alignment and demonstrate the effectiveness of intention-aligned training.

📄 PDF Abstract BibTeX arXiv:2409.14191

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Focus 설명 없음

Interpretable and Editable Programmatic Tree Policies for Reinforcement Learning

2024-05-23 · Hector Kohler, Quentin Delfosse, Riad Akrour, Kristian Kersting 외

Deep reinforcement learning agents are prone to goal misalignments. The black-box nature of their policies hinders the detection and correction of such misalignments, and the trust necessary for real-world deployment. So…

Atari Games Deep Reinforcement Learning reinforcement-learning Reinforcement Learning

Learning Correspondence Structures for Person Re-identification

2017-03-20 · Weiyao Lin, Yang shen, Junchi Yan, Mingliang Xu 외

This paper addresses the problem of handling spatial misalignments due to camera-view changes or human-pose variations in person re-identification. We first introduce a boosting-based approach to learn a correspondence s…

Patch Matching Person Re-Identification

Mismatch Quest: Visual and Textual Feedback for Image-Text Misalignment

2023-12-05 · Brian Gordon, Yonatan Bitton, Yonatan Shafir, Roopal Garg 외

While existing image-text alignment models reach high quality binary assessments, they fall short of pinpointing the exact source of misalignment. In this paper, we present a method to provide detailed textual and visual…

Explanation Generation Visual Grounding

Advancing multivariate time series similarity assessment: an integrated computational approach

2024-03-16 · Franck Tonle, Henri Tonnang, Milliam Ndadji, Maurice Tchendji 외

Data mining, particularly the analysis of multivariate time series data, plays a crucial role in extracting insights from complex systems and supporting informed decision-making across diverse domains. However, assessing…

Decision Making Time Series Time Series Alignment Time Series Analysis

Symbal: Detecting Systematic Misalignments in Model-Generated Captions

2026-07-16 · Maya Varma, Jean-Benoit Delbrouck, Sophie Ostmeier, Akshay Chaudhari 외 arxiv

Multimodal large language models (MLLMs) often introduce errors when generating image captions, resulting in misaligned image-text pairs. Our work focuses on a class of captioning errors that we refer to as systematic mi…