paper-with-me

Papers

When predict can also explain: few-shot prediction to select better neural latents

2024-05-23 · Kabir Dabholkar, Omri Barak

Latent variable models serve as powerful tools to infer underlying dynamics from observed neural activity. However, due to the absence of ground truth data, prediction benchmarks are often employed as proxies. In this study, we reveal the limitations of the widely-used 'co-smoothing' prediction framework and propose an improved few-shot prediction approach that encourages more accurate latent dynamics. Utilizing a student-teacher setup with Hidden Markov Models, we demonstrate that the high co-smoothing model space can encompass models with arbitrary extraneous dynamics within their latent representations. To address this, we introduce a secondary metric -- a few-shot version of co-smoothing. This involves performing regression from the latent variables to held-out channels in the data using fewer trials. Our results indicate that among models with near-optimal co-smoothing, those with extraneous dynamics underperform in the few-shot co-smoothing compared to 'minimal' models devoid of such dynamics. We also provide analytical insights into the origin of this phenomenon. We further validate our findings on real neural data using two state-of-the-art methods: LFADS and STNDT. In the absence of ground truth, we suggest a proxy measure to quantify extraneous dynamics. By cross-decoding the latent variables of all model pairs with high co-smoothing, we identify models with minimal extraneous dynamics. We find a correlation between few-shot co-smoothing performance and this new measure. In summary, we present a novel prediction metric designed to yield latent variables that more accurately reflect the ground truth, offering a significant improvement for latent dynamics inference.

📄 PDF Abstract BibTeX arXiv:2405.14425

Code (0)

등록된 구현이 없습니다.

Tasks

Prediction

Similar Papers 제목 키워드 기반

Can News Predict the Market? Limits of Zero-Shot Financial NLP and the Role of Explainable AI

2026-06-10 · Ali M Karaoglu, Shreyank N Gowda arxiv

Can financial news reliably predict short-term stock movements? Despite advances in large language models, this question remains unresolved. We revisit this problem using a zero-shot natural language processing framework…

Natural Language Inference

Towards Few-shot Self-explaining Graph Neural Networks

2024-08-14 · Jingyu Peng, Qi Liu, Linan Yue, Zaixi Zhang 외

Recent advancements in Graph Neural Networks (GNNs) have spurred an upsurge of research dedicated to enhancing the explainability of GNNs, particularly in critical domains such as medicine. A promising approach is the se…

Large Language Models are Zero-Shot Next Location Predictors

2024-05-31 · Ciro Beneduce, Bruno Lepri, Massimiliano Luca

Predicting the locations an individual will visit in the future is crucial for solving many societal issues like disease diffusion and reduction of pollution. However, next-location predictors require a significant amoun…

Recommendation Systems

Explaining GNN over Evolving Graphs using Information Flow

2021-11-19 · Yazheng Liu, Xi Zhang, Sihong Xie

Graphs are ubiquitous in many applications, such as social networks, knowledge graphs, smart grids, etc.. Graph neural networks (GNN) are the current state-of-the-art for these applications, and yet remain obscure to hum…

Knowledge Graphs

Can Language Models Teach? Teacher Explanations Improve Student Performance via Personalization

2023-09-21 · NeurIPS 2023 11

A hallmark property of explainable AI models is the ability to teach other agents, communicating knowledge of how to perform a task. While Large Language Models (LLMs) perform complex reasoning by generating explanations…