paper-with-me

Papers

Brilla AI: AI Contestant for the National Science and Maths Quiz

2024-03-04 · George Boateng, Jonathan Abrefah Mensah, Kevin Takyi Yeboah, William Edor, Andrew Kojo Mensah-Onumah, Naafi Dasana Ibrahim, Nana Sam Yeboah

The African continent lacks enough qualified teachers which hampers the provision of adequate learning support. An AI could potentially augment the efforts of the limited number of teachers, leading to better learning outcomes. Towards that end, this work describes and evaluates the first key output for the NSMQ AI Grand Challenge, which proposes a robust, real-world benchmark for such an AI: "Build an AI to compete live in Ghana's National Science and Maths Quiz (NSMQ) competition and win - performing better than the best contestants in all rounds and stages of the competition". The NSMQ is an annual live science and mathematics competition for senior secondary school students in Ghana in which 3 teams of 2 students compete by answering questions across biology, chemistry, physics, and math in 5 rounds over 5 progressive stages until a winning team is crowned for that year. In this work, we built Brilla AI, an AI contestant that we deployed to unofficially compete remotely and live in the Riddles round of the 2023 NSMQ Grand Finale, the first of its kind in the 30-year history of the competition. Brilla AI is currently available as a web app that livestreams the Riddles round of the contest, and runs 4 machine learning systems: (1) speech to text (2) question extraction (3) question answering and (4) text to speech that work together in real-time to quickly and accurately provide an answer, and then say it with a Ghanaian accent. In its debut, our AI answered one of the 4 riddles ahead of the 3 human contesting teams, unofficially placing second (tied). Improvements and extensions of this AI could potentially be deployed to offer science tutoring to students and eventually enable millions across Africa to have one-on-one learning interactions, democratizing science education.

📄 PDF Abstract BibTeX arXiv:2403.01699

Code (1)

nsmq-ai/nsmqai 공식 구현

Tasks

MathQuestion AnsweringSpeech-to-Texttext-to-speechText to Speech

Similar Papers 제목 키워드 기반

Can an AI Win Ghana's National Science and Maths Quiz? An AI Grand Challenge for Education

2023-01-30 · George Boateng, Victor Kumbol, Elsie Effah Kaufmann

There is a lack of enough qualified teachers across Africa which hampers efforts to provide adequate learning support such as educational question answering (EQA) to students. An AI system that can enable students to ask…

MathPositionQuestion Answering

Leveraging AI to Advance Science and Computing Education across Africa: Challenges, Progress and Opportunities

2024-02-12 · George Boateng

Across the African continent, students grapple with various educational challenges, including limited access to essential resources such as computers, internet connectivity, reliable electricity, and a shortage of qualif…

Towards an AI to Win Ghana's National Science and Maths Quiz

2023-08-08 · George Boateng, Jonathan Abrefah Mensah, Kevin Takyi Yeboah, William Edor 외

Can an AI win Ghana's National Science and Maths Quiz (NSMQ)? That is the question we seek to answer in the NSMQ AI project, an open-source project that is building AI to compete live in the NSMQ and win. The NSMQ is an …

MathQuestion AnsweringSpeech-to-Texttext-to-speech+1

NSMQ Riddles: A Benchmark of Scientific and Mathematical Riddles for Quizzing Large Language Models

2026-05-08 · George Boateng, Naafi Ibrahim, Samuel John, Philemon Badu 외 arxiv

Large Language Models (LLMs) have shown good performance on various science educational benchmarks, demonstrating their potential for use in science and mathematics education. Yet, LLMs tend to be evaluated on science an…

Mathematical Reasoning

The IOL-AI Challenge: An Open Challenge towards Advancing Linguistic Reasoning

2026-08-18 · Eduardo Sánchez, Rita Berrada, Dan-Mircea Mirea, Sara Rajaee 외 arxiv

Reasoning in LLMs is overwhelmingly studied in domains that provide a model with rules: mathematics and code. Linguistic puzzles invert this: the solver must first discover the system before reasoning within it. We prese…