paper-with-me

홈 › Papers

Testing System Intelligence

2023-05-19 · Joseph Sifakis

We discuss the adequacy of tests for intelligent systems and practical problems raised by their implementation. We propose the replacement test as the ability of a system to replace successfully another system performing a task in a given context. We show how it can characterize salient aspects of human intelligence that cannot be taken into account by the Turing test. We argue that building intelligent systems passing the replacement test involves a series of technical problems that are outside the scope of current AI. We present a framework for implementing the proposed test and validating the properties of the intelligent systems. We discuss the inherent limitations of intelligent system validation and advocate new theoretical foundations for extending existing rigorous test methods. We suggest that the replacement test, based on the complementarity of skills between human and machine, can lead to a multitude of intelligence concepts reflecting the ability to combine data-based and symbolic knowledge to varying degrees.

📄 PDF Abstract BibTeX arXiv:2305.11472

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Can ChatGPT advance software testing intelligence? An experience report on metamorphic testing

2023-10-30 · Quang-Hung Luu, Huai Liu, Tsong Yueh Chen

While ChatGPT is a well-known artificial intelligence chatbot being used to answer human's questions, one may want to discover its potential in advancing software testing. We examine the capability of ChatGPT in advancin…

Chatbotsoftware testing

Evolving Testing Scenario Generation Method and Intelligence Evaluation Framework for Automated Vehicles

2023-06-12 · Yining Ma, Wei Jiang, Lingtong Zhang, Junyi Chen 외

Interaction between the background vehicles (BVs) and automated vehicles (AVs) in scenario-based testing plays a critical role in evaluating the intelligence of the AVs. Current testing scenarios typically employ predefi…

Deep Reinforcement Learning

Building and Testing a General Intelligence Embodied in a Humanoid Robot

2023-07-26 · Suzanne Gildert, Geordie Rose

Machines with human-level intelligence should be able to do most economically valuable work. This aligns a major economic incentive with the scientific grand challenge of building a human-like mind. Here we describe our …

Search-Based Fairness Testing: An Overview

2023-11-10 · Hussaini Mamman, Shuib Basri, Abdullateef Oluwaqbemiga Balogun, Abdullahi Abubakar Imam 외

Artificial Intelligence (AI) has demonstrated remarkable capabilities in domains such as recruitment, finance, healthcare, and the judiciary. However, biases in AI systems raise ethical and societal concerns, emphasizing…

Fairness

Three IQs of AI Systems and their Testing Methods

2017-12-14 · Feng Liu, Yong Shi, Ying Liu

The rapid development of artificial intelligence has brought the artificial intelligence threat theory as well as the problem about how to evaluate the intelligence level of intelligent products. Both need to find a quan…