Lost in Translation: The Algorithmic Gap Between LMs and the Brain
Language Models (LMs) have achieved impressive performance on various linguistic tasks, but their relationship to human language processing in the brain remains unclear. This paper examines the gaps and overlaps between LMs and the brain at different levels of analysis, emphasizing the importance of looking beyond input-output behavior to examine and compare the internal processes of these systems. We discuss how insights from neuroscience, such as sparsity, modularity, internal states, and interactive learning, can inform the development of more biologically plausible language models. Furthermore, we explore the role of scaling laws in bridging the gap between LMs and human cognition, highlighting the need for efficiency constraints analogous to those in biological systems. By developing LMs that more closely mimic brain function, we aim to advance both artificial intelligence and our understanding of human cognition.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
SEED: Towards More Accurate Semantic Evaluation for Visual Brain Decoding
We present SEED (\textbf{Se}mantic \textbf{E}valuation for Visual Brain \textbf{D}ecoding), a novel metric for evaluating the semantic decoding performance of visual brain decoding models. It integrates three complementa…
Brain DecodingSemantic SimilaritySemantic Textual SimilarityLost in Back-Translation: Emotion Preservation in Neural Machine Translation
Machine translation provides powerful methods to convert text between languages, and is therefore a technology enabling a multilingual world. An important part of communication, however, takes place at the non-propositio…
DiversityMachine TranslationRe-RankingStyle Transfer+1Lost in Translation? Exploring the Shift in Grammatical Gender from Latin to Occitan
The diachronic evolution from Latin to the Romance languages involved a restructuring of the grammatical gender system from a tripartite configuration (masculine, feminine, neuter) to a bipartite one (masculine, feminine…
Gender PredictionLost in Translations? Building Sentiment Lexicons using Context Based Machine Translation
BrainFuse: a unified infrastructure integrating realistic biological modeling and core AI methodology
Neuroscience and artificial intelligence represent distinct yet complementary pathways to general intelligence. However, amid the ongoing boom in AI research and applications, the translational synergy between these two …