paper-with-me

홈 › Papers

Have We Reached AGI? Comparing ChatGPT, Claude, and Gemini to Human Literacy and Education Benchmarks

2024-07-11 · Mfon Akpan

Recent advancements in AI, particularly in large language models (LLMs) like ChatGPT, Claude, and Gemini, have prompted questions about their proximity to Artificial General Intelligence (AGI). This study compares LLM performance on educational benchmarks with Americans' average educational attainment and literacy levels, using data from the U.S. Census Bureau and technical reports. Results show that LLMs significantly outperform human benchmarks in tasks such as undergraduate knowledge and advanced reading comprehension, indicating substantial progress toward AGI. However, true AGI requires broader cognitive assessments. The study highlights the implications for AI development, education, and societal impact, emphasizing the need for ongoing research and ethical considerations.

📄 PDF Abstract BibTeX arXiv:2407.09573

Code (0)

등록된 구현이 없습니다.

Tasks

Reading Comprehension

Similar Papers 제목 키워드 기반

Investigating AI Rater Effects of Large Language Models: GPT, Claude, Gemini, and DeepSeek

2025-05-24 · Hong Jiao, Dan Song, Won-Chan Lee

Large language models (LLMs) have been widely explored for automated scoring in low-stakes assessment to facilitate learning and instruction. Empirical evidence related to which LLM produces the most reliable scores and …

Evaluating Large Language Models for Abstract Evaluation Tasks: An Empirical Study

2026-01-09 · Yinuo Liu, Emre Sezgin, Eric A. Youngstrom arxiv

Introduction: Large language models (LLMs) can process requests and generate texts, but their feasibility for assessing complex academic content needs further investigation. To explore LLM's potential in assisting scient…

On Psychology of AI -- Does Primacy Effect Affect ChatGPT and Other LLMs?

2025-04-29 · Mika Hämäläinen

We study the primacy effect in three commercial LLMs: ChatGPT, Gemini and Claude. We do this by repurposing the famous experiment Asch (1946) conducted using human subjects. The experiment is simple, given two candidates…

Can Vision-Language Models See Squares? Text-Recognition Mediates Spatial Reasoning Across Three Model Families

2026-02-17 · Yuval Levental arxiv

We present a simple experiment that exposes a fundamental limitation in vision-language models (VLMs): the inability to accurately localize filled cells in binary grids when those cells lack textual identity. We generate…

Spatial Reasoning

Model Capability Assessment and Safeguards for Biological Weaponization

2026-04-15 · Michael Richter arxiv

AI leaders and safety reports increasingly warn that advances in model reasoning may enable biological misuse, including by low-expertise users, while major labs describe safeguards as expanding but still evolving rather…