paper-with-me

Papers

Situation Graph Prediction: Structured Perspective Inference for User Modeling

2026-02-10 · Jisung Shin, Daniel Platnick, Marjan Alirezaie, Hossein Rahnama arxiv

Perspective-Aware AI requires modeling evolving internal states--goals, emotions, contexts--not merely preferences. Progress is limited by a data bottleneck: digital footprints are privacy-sensitive and perspective states are rarely labeled. We propose Situation Graph Prediction (SGP), a task that frames perspective modeling as an inverse inference problem: reconstructing structured, ontology-aligned representations of perspective from observable multimodal artifacts. To enable grounding without real labels, we use a structure-first synthetic generation strategy that aligns latent labels and observable traces by design. As a pilot, we construct a dataset and run a diagnostic study using retrieval-augmented in-context learning as a proxy for supervision. In our study with GPT-4o, we observe a gap between surface-level extraction and latent perspective inference--indicating latent-state inference is harder than surface extraction under our controlled setting. Results suggest SGP is non-trivial and provide evidence for the structure-first data synthesis strategy.

📄 PDF Abstract BibTeX arXiv:2602.13319

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Policy Message Passing: A New Algorithm for Probabilistic Graph Inference

2019-09-29 · ICLR 2020 1 · Zhiwei Deng, Greg Mori

A general graph-structured neural network architecture operates on graphs through two core components: (1) complex enough message functions; (2) a fixed information aggregation process. In this paper, we present the Poli…

Partial Inference in Structured Prediction

2023-06-06 · Chuyang Ke, Jean Honorio

In this paper, we examine the problem of partial inference in the context of structured prediction. Using a generative model approach, we consider the task of maximizing a score function with unary and pairwise potential…

PredictionStructured Prediction

Learning Situation Hyper-Graphs for Video Question Answering

2023-04-18 · CVPR 2023 1 · Aisha Urooj Khan, Hilde Kuehne, Bo Wu, Kim Chheu 외

Answering questions about complex situations in videos requires not only capturing the presence of actors, objects, and their relations but also the evolution of these relationships over time. A situation hyper-graph is …

DecoderQuestion AnsweringVideo Question AnsweringVisual Question Answering+1

Differentiable Dynamic Programming for Structured Prediction and Attention

2018-02-11 · ICML 2018 7 · Arthur Mensch, Mathieu Blondel

Dynamic programming (DP) solves a variety of structured combinatorial problems by iteratively breaking them down into smaller subproblems. In spite of their versatility, DP algorithms are usually non-differentiable, whic…

Machine TranslationPredictionStructured PredictionTime Series+3

A Learning Error Analysis for Structured Prediction with Approximate Inference

2017-12-01 · NeurIPS 2017 12 · Yuanbin Wu, Man Lan, Shiliang Sun, Qi Zhang 외

In this work, we try to understand the differences between exact and approximate inference algorithms in structured prediction. We compare the estimation and approximation error of both underestimate and overestimate mod…

Dependency ParsingGeneral ClassificationStructured Predictiontext-classification+1