paper-with-me

Papers

Shifting Attention to You: Personalized Brain-Inspired AI Models

2025-02-07 · Stephen Chong Zhao, Yang Hu, Jason Lee, Andrew Bender, Trisha Mazumdar, Mark Wallace, David A. Tovar

The integration of human and artificial intelligence offers a powerful avenue for advancing our understanding of information processing, as each system provides unique computational insights. However, despite the promise of human-AI integration, current AI models are largely trained on massive datasets, optimized for population-level performance, lacking mechanisms to align their computations with individual users' perceptual semantics and neural dynamics. Here we show that integrating human behavioral insights and millisecond scale neural data within a fine tuned CLIP based model not only captures generalized and individualized aspects of perception but also over doubles behavioral performance compared to the unmodified CLIP baseline. By embedding human inductive biases and mirroring dynamic neural processes during training, personalized neural fine tuning improves predictions of human similarity judgments and tracks the temporal evolution of individual neural responses. Our work establishes a novel, interpretable framework for designing adaptive AI systems, with broad implications for neuroscience, personalized medicine, and human-computer interaction.

📄 PDF Abstract BibTeX arXiv:2502.04658

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

CLIP Contrastive Language-Image Pre-training (CLIP), consisting of a simplified version of ConVIRT trained from scratch, is an efficient method of image representation learning…
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

A Preliminary Exploration of the Differences and Conjunction of Traditional PNT and Brain-inspired PNT

2025-10-19 · Xu He, Xiaolin Meng, Wenxuan Yin, Youdong Zhang 외 arxiv

Developing universal Positioning, Navigation, and Timing (PNT) is our enduring goal. Today's complex environments demand PNT that is more resilient, energy-efficient and cognitively capable. This paper asks how we can en…

HVS-Inspired Signal Degradation Network for Just Noticeable Difference Estimation

2022-08-16 · Jian Jin, Yuan Xue, Xingxing Zhang, Lili Meng 외

Significant improvement has been made on just noticeable difference (JND) modelling due to the development of deep neural networks, especially for the recently developed unsupervised-JND generation models. However, they …

Quantum-Brain: Quantum-Inspired Neural Network Approach to Vision-Brain Understanding

2024-11-20 · Hoang-Quan Nguyen, Xuan-Bac Nguyen, Hugh Churchill, Arabinda Kumar Choudhary 외

Vision-brain understanding aims to extract semantic information about brain signals from human perceptions. Existing deep learning methods for vision-brain understanding are usually introduced in a traditional learning p…

Image Reconstruction

A Penny for Your Thoughts: Decoding Speech from Inexpensive Brain Signals

2025-10-28 · Quentin Auster, Kateryna Shapovalenko, Chuang Ma, Demaio Sun arxiv

We explore whether neural networks can decode brain activity into speech by mapping EEG recordings to audio representations. Using EEG data recorded as subjects listened to natural speech, we train a model with a contras…

NeuReg: Domain-invariant 3D Image Registration on Human and Mouse Brains

2024-11-09 · Taha Razzaq, Asim Iqbal

Medical brain imaging relies heavily on image registration to accurately curate structural boundaries of brain features for various healthcare applications. Deep learning models have shown remarkable performance in image…

Image Registration