Measuring Data
We identify the task of measuring data to quantitatively characterize the composition of machine learning data and datasets. Similar to an object's height, width, and volume, data measurements quantify different attributes of data along common dimensions that support comparison. Several lines of research have proposed what we refer to as measurements, with differing terminology; we bring some of this work together, particularly in fields of computer vision and language, and build from it to motivate measuring data as a critical component of responsible AI development. Measuring data aids in systematically building and analyzing machine learning (ML) data towards specific goals and gaining better control of what modern ML systems will learn. We conclude with a discussion of the many avenues of future work, the limitations of data measurements, and how to leverage these measurement approaches in research and practice.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Measuring Inconsistency in Argument Graphs
There have been a number of developments in measuring inconsistency in logic-based representations of knowledge. In contrast, the development of inconsistency measures for computational models of argument has been limite…
Abstract ArgumentationMeasuring the Data
Measuring the Data analytically finds the intrinsic manifold in big data. First, Optimal Transport generates the tangent space at each data point from which the intrinsic dimension is revealed. Then, the Koopman Dimensio…
Dimensionality ReductionMetrological support of acoustic measuring installations mid-frequency devices
The article discusses methods for measuring the speed of sound, scattering, attenuation and absorption of sound in liquids, on the basis of which the structural diagrams of modern devices have been developed. In real con…
Discrepancies of measured SAR between traditional and fast measuring systems
Human exposure to mobile devices is traditionally measured by a system in which the human body (or head) is modelled by a phantom and the energy absorbed from the device is estimated based on the electric fields measured…
Not All Proofs Are Equal: Evaluating LLM Proof Quality Beyond Correctness
Large language models (LLMs) have become capable mathematical problem-solvers, often producing correct proofs for challenging problems. However, correctness alone is not sufficient: mathematical proofs should also be cle…
Mathematical Reasoning