paper-with-me

Papers

An ELIXIR scoping review on domain-specific evaluation metrics for synthetic data in life sciences

2025-06-17 · Styliani-Christina Fragkouli, Somya Iqbal, Lisa Crossman, Barbara Gravel, Nagat Masued, Mark Onders, Devesh Haseja, Alex Stikkelman, Alfonso Valencia, Tom Lenaerts, Fotis Psomopoulos, Pilib Ó Broin, Núria Queralt-Rosinach, Davide Cirillo

Synthetic data has emerged as a powerful resource in life sciences, offering solutions for data scarcity, privacy protection and accessibility constraints. By creating artificial datasets that mirror the characteristics of real data, allows researchers to develop and validate computational methods in controlled environments. Despite its promise, the adoption of synthetic data in Life Sciences hinges on rigorous evaluation metrics designed to assess their fidelity and reliability. To explore the current landscape of synthetic data evaluation metrics in several Life Sciences domains, the ELIXIR Machine Learning Focus Group performed a systematic review of the scientific literature following the PRISMA guidelines. Six critical domains were examined to identify current practices for assessing synthetic data. Findings reveal that, while generation methods are rapidly evolving, systematic evaluation is often overlooked, limiting researchers ability to compare, validate, and trust synthetic datasets across different domains. This systematic review underscores the urgent need for robust, standardized evaluation approaches that not only bolster confidence in synthetic data but also guide its effective and responsible implementation. By laying the groundwork for establishing domain-specific yet interoperable standards, this scoping review paves the way for future initiatives aimed at enhancing the role of synthetic data in scientific discovery, clinical practice and beyond.

📄 PDF Abstract BibTeX arXiv:2506.14508

Code (0)

등록된 구현이 없습니다.

Tasks

scientific discoverySynthetic Data Evaluation

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

ELIXIR: Efficient and LIghtweight model for eXplaIning Recommendations

2025-08-27 · Ben Kabongo, Vincent Guigue, Pirmin Lemberger arxiv

Collaborative filtering drives many successful recommender systems but struggles with fine-grained user-item interactions and explainability. As users increasingly seek transparent recommendations, generating textual exp…

Collaborative FilteringText Generation

What's meant by explainable model: A Scoping Review

2023-07-18 · Mallika Mainali, Rosina O Weber

We often see the term explainable in the titles of papers that describe applications based on artificial intelligence (AI). However, the literature in explainable artificial intelligence (XAI) indicates that explanations…

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)

Toward a Semi-Automated Scoping Review of Virtual Human Smiles

2022-06-01 · SmiLa (LREC) 2022 6 · Sharon Mozgai, Jade Winn, Cari Kaurloto, Andrew Leeds 외

Smiles are a fundamental facial expression for successful human-agent communication. The growing number of publications in this domain presents an opportunity for future research and design to be informed by a scoping re…

Towards Automated Scoping of AI for Social Good Projects

2025-04-28 · Jacob Emmerson, Rayid Ghani, Zheyuan Ryan Shi

Artificial Intelligence for Social Good (AI4SG) is an emerging effort that aims to address complex societal challenges with the powerful capabilities of AI systems. These challenges range from local issues with transit n…

World Knowledge

A Scoping Review of Large Language Model-Based Pedagogical Agents

2026-04-14 · Shan Li, Juan Zheng arxiv

This scoping review examines the emerging field of Large Language Model (LLM)-based pedagogical agents in educational settings. While traditional pedagogical agents have been extensively studied, the integration of LLMs …

Natural Language Understanding