Multiple Choice Question Answering (MCQA)
31개 벤치마크 · 논문 65편 · 이 태스크의 논문 보기 →
Benchmarks
MedMCQA
BIG-bench (Hyperbaton)
BIG-bench (Navigate)
BIG-bench (Ruin Names)
MMLU (College Biology)
MMLU (Medical Genetics)
MMLU (Abstract Algebra)
MMLU (Astronomy)
MMLU (College Chemistry)
MMLU (College Physics)
MMLU (Econometrics)
MMLU (Formal Logic)
MMLU (Machine Learning)
IndicGLUE WSTP Pa
MMLU (Anatomy)
MMLU (College Medicine)
FrenchMedMCQA
Most implemented
Llama 2: Open Foundation and Fine-Tuned Chat Models
PaLM: Scaling Language Modeling with Pathways
From Recognition to Cognition: Visual Commonsense Reasoning
QuALITY: Question Answering with Long Input Texts, Yes!
Scaling Language Models: Methods, Analysis & Insights from Training Gopher
Papers
CP-Router: An Uncertainty-Aware Router Between LLM and LRM
Recent advances in Large Reasoning Models (LRMs) have significantly improved long-chain reasoning capabilities over Large Language Models (LLMs). However, LRMs often produce unnecessarily lengthy outputs even for simple …
Conformal PredictionLogical ReasoningMultiple-choiceMultiple Choice Question Answering (MCQA)+1Improving LLM First-Token Predictions in Multiple-Choice Question Answering via Prefilling Attack
Large Language Models (LLMs) are increasingly evaluated on multiple-choice question answering (MCQA) tasks using *first-token probability* (FTP), which selects the answer option whose initial token has the highest likeli…
Multiple-choiceMultiple Choice Question Answering (MCQA)Question AnsweringvalidHealthy LLMs? Benchmarking LLM Knowledge of UK Government Public Health Information
As Large Language Models (LLMs) become widely accessible, a detailed understanding of their knowledge within specific domains becomes necessary for successful real world use. This is particularly critical in public healt…
BenchmarkingFormMultiple-choiceMultiple Choice Question Answering (MCQA)+1Question-Aware Knowledge Graph Prompting for Enhancing Large Language Models
Large Language Models (LLMs) often struggle with tasks requiring external knowledge, such as knowledge-intensive Multiple Choice Question Answering (MCQA). Integrating Knowledge Graphs (KGs) can enhance reasoning; howeve…
Knowledge GraphsMultiple-choiceMultiple Choice Question Answering (MCQA)Question AnsweringCorrectness Coverage Evaluation for Medical Multiple-Choice Question Answering Based on the Enhanced Conformal Prediction Framework
Large language models (LLMs) are increasingly adopted in medical question-answering (QA) scenarios. However, LLMs can generate hallucinations and nonfactual information, undermining their trustworthiness in high-stakes m…
Conformal PredictionMedical Question AnsweringMedQAMMLU+4Med-RLVR: Emerging Medical Reasoning from a 3B base model via reinforcement Learning
Reinforcement learning from verifiable rewards (RLVR) has recently gained attention for its ability to elicit self-evolved reasoning capabilitie from base language models without explicit reasoning supervisions, as demon…
MathMedical Question AnsweringMultiple-choiceMultiple Choice Question Answering (MCQA)+2