Moving Beyond the Turing Test with the Allen AI Science Challenge
Given recent successes in AI (e.g., AlphaGo's victory against Lee Sedol in the game of GO), it's become increasingly important to assess: how close are AI systems to human-level intelligence? This paper describes the Allen AI Science Challenge---an approach towards that goal which led to a unique Kaggle Competition, its results, the lessons learned, and our next steps.
Code (3)
Tasks
Question AnsweringSimilar Papers 제목 키워드 기반
Learning Dynamic Stability Landscapes in Synchronization Networks
The robustness of synchronization is typically characterized by scalar, per-node stability indices whose dependence on topology is studied via network science or graph neural networks (GNNs). We propose a novel upstream …
Computing a human-like reaction time metric from stable recurrent vision models
The meteoric rise in the adoption of deep neural networks as computational models of vision has inspired efforts to "align" these models with humans. One dimension of interest for alignment includes behavioral choices, b…
Decision MakingBeyond networks, towards adaptive systems
Despite their widespread utility across domains, basic network models face fundamental limitations when applied to complex biological systems, particularly in neuroscience. This paper critically examines these limitation…
MMVU: Measuring Expert-Level Multi-Discipline Video Understanding
We introduce MMVU, a comprehensive expert-level, multi-discipline benchmark for evaluating foundation models in video understanding. MMVU includes 3,000 expert-annotated questions spanning 27 subjects across four core di…
Video UnderstandingGeoAI in Social Science
GeoAI, or geospatial artificial intelligence, is an exciting new area that leverages artificial intelligence (AI), geospatial big data, and massive computing power to solve problems with high automation and intelligence.…