Assessing the Frontier: Active Learning, Model Accuracy, and Multi-objective Materials Discovery and Optimization
Discovering novel materials can be greatly accelerated by iterative machine learning-informed proposal of candidates---active learning. However, standard \emph{global-scope error} metrics for model quality are not predictive of discovery performance, and can be misleading. We introduce the notion of \emph{Pareto shell-scope error} to help judge the suitability of a model for proposing material candidates. Further, through synthetic cases and a thermoelectric dataset, we probe the relation between acquisition function fidelity and active learning performance. Results suggest novel diagnostic tools, as well as new insights for acquisition function design.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningBIG-bench Machine LearningDiagnosticSimilar Papers 제목 키워드 기반
How Far Are We from Optimal Reasoning Efficiency?
Large Reasoning Models (LRMs) demonstrate remarkable problem-solving capabilities through extended Chain-of-Thought (CoT) reasoning but often produce excessively verbose and redundant reasoning traces. This inefficiency …
16kBenchmarkingNumerical IntegrationPushing Forward Pareto Frontiers of Proactive Agents with Behavioral Agentic Optimization
Proactive large language model (LLM) agents aim to actively plan, query, and interact over multiple turns, enabling efficient task completion beyond passive instruction following and making them essential for real-world,…
Reinforcement LearningInstruction FollowingSwarm Intelligence for Multiobjective Optimization of Extraction Process
Multi objective (MO) optimization is an emerging field which is increasingly being implemented in many industries globally. In this work, the MO optimization of the extraction process of bioactive compounds from the Gard…
Multiobjective OptimizationContextual Multi-Objective Optimization: Rethinking Objectives in Frontier AI Systems
Frontier AI systems perform best in settings with clear, stable, and verifiable objectives, such as code generation, mathematical reasoning, games, and unit-test-driven tasks. They remain less reliable in open-ended sett…
Mathematical ReasoningCode GenerationExploring the Adversarial Frontier: Quantifying Robustness via Adversarial Hypervolume
The escalating threat of adversarial attacks on deep learning models, particularly in security-critical fields, has underscored the need for robust deep learning systems. Conventional robustness evaluations have relied o…
Adversarial RobustnessBenchmarkingDeep Learning