The MacGyver Test - A Framework for Evaluating Machine Resourcefulness and Creative Problem Solving
Current measures of machine intelligence are either difficult to evaluate or lack the ability to test a robot's problem-solving capacity in open worlds. We propose a novel evaluation framework based on the formal notion of MacGyver Test which provides a practical way for assessing the resilience and resourcefulness of artificial agents.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
MacGyver: Are Large Language Models Creative Problem Solvers?
We explore the creative problem-solving capabilities of modern LLMs in a novel constrained setting. To this end, we create MACGYVER, an automatically generated dataset consisting of over 1,600 real-world problems deliber…
Exploiting machine algorithms in vocalic quantification of African English corpora
Towards procedural fidelity in the processing of African English speech corpora, this work demonstrates how the adaptation of machine-assisted segmentation of phonemes and automatic extraction of acoustic values can sign…
SegmentationAnalysing the Resourcefulness of the Paragraph for Precedence Retrieval
Developing methods for extracting relevant legal information to aid legal practitioners is an active research area. In this regard, research efforts are being made by leveraging different kinds of information, such as me…
RetrievalDeep Learning-driven Community Resilience Rating based on Intertwined Socio-Technical Systems Features
Community resilience is a complex and muti-faceted phenomenon that emerges from complex and nonlinear interactions among different socio-technical systems and their resilience properties. However, present studies on comm…
LiSTra, Automatic Speech Translation: English to Lingala case study
In recent years there have been great interests in addressing the low resourcefulness of African languages and provide baseline models for different Natural Language Processing tasks. Several initiatives on the continent…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)automatic-speech-translationDecoder+4