paper-with-me

Papers

MEG Evidence That Modality-Independent Conceptual Representations Encode Visual but Not Lexical Representations

2023-12-18 · Julien Dirani, Liina Pylkkänen

The semantic knowledge stored in our brains can be accessed from different stimulus modalities. For example, a picture of a cat and the word "cat" both engage similar conceptual representations. While existing research has found evidence for modality-independent representations, their content remains unknown. Modality-independent representations could be abstract, or they might be perceptual or even lexical in nature. We used a novel approach combining word/picture cross-condition decoding with neural network classifiers that learned latent modality-independent representations from MEG data. We then compared these representations to models representing semantic, sensory, and lexical features. Results show that modality-independent representations are not strictly amodal; rather, they also contain visual representations. There was no evidence that lexical properties contributed to the representation of modality-independent concepts. These findings support the notion that perceptual processes play a fundamental role in encoding modality-independent conceptual representations. Conversely, lexical representations did not appear to partake in modality-independent semantic knowledge.

📄 PDF Abstract BibTeX arXiv:2312.10916

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

The Temporal Evolution of Modality-Independent Representations of Conceptual Categories

2022-06-24 · Julien Dirani, Liina Pylkkänen

To what extent does language production activate amodal conceptual representations? In picture naming, we view specific exemplars of concepts and then name them with a category label, like 'dog'. In contrast, in overt re…

Representations in vision and language converge in a shared, multidimensional space of perceived similarities

2025-07-29 · Katerina Marie Simkova, Adrien Doerig, Clayton Hickey, Ian Charest arxiv

Humans can effortlessly describe what they see, yet establishing a shared representational format between vision and language remains a significant challenge. Emerging evidence suggests that human brain representations i…

The Conceptual VAE

2022-03-21 · Razin A. Shaikh, Sara Sabrina Zemljic, Sean Tull, Stephen Clark

In this report we present a new model of concepts, based on the framework of variational autoencoders, which is designed to have attractive properties such as factored conceptual domains, and at the same time be learnabl…

Beyond Independent Frames: Latent Attention Masked Autoencoders for Multi-View Echocardiography

2026-04-16 · Simon Böhi, Irene Cannistraci, Sergio Muñoz Gonzalez, Moritz Vandenhirtz 외 arxiv

Echocardiography is a widely used modality for cardiac assessment due to its non-invasive and cost-effective nature, but the sparse and heterogeneous spatiotemporal views of the heart pose distinct challenges. Existing m…

Evidence-Aware Inferential Text Generation with Vector Quantised Variational AutoEncoder

2020-06-15 · ACL 2020 6 · Daya Guo, Duyu Tang, Nan Duan, Jian Yin 외

Generating inferential texts about an event in different perspectives requires reasoning over different contexts that the event occurs. Existing works usually ignore the context that is not explicitly provided, resulting…

Common Sense ReasoningDecoderText Generation