paper-with-me

Papers

OmniGenBench: A Modular Platform for Reproducible Genomic Foundation Models Benchmarking

2025-05-20 · Heng Yang, Jack Cole, Yuan Li, Renzhi Chen, Geyong Min, Ke Li

The code of nature, embedded in DNA and RNA genomes since the origin of life, holds immense potential to impact both humans and ecosystems through genome modeling. Genomic Foundation Models (GFMs) have emerged as a transformative approach to decoding the genome. As GFMs scale up and reshape the landscape of AI-driven genomics, the field faces an urgent need for rigorous and reproducible evaluation. We present OmniGenBench, a modular benchmarking platform designed to unify the data, model, benchmarking, and interpretability layers across GFMs. OmniGenBench enables standardized, one-command evaluation of any GFM across five benchmark suites, with seamless integration of over 31 open-source models. Through automated pipelines and community-extensible features, the platform addresses critical reproducibility challenges, including data transparency, model interoperability, benchmark fragmentation, and black-box interpretability. OmniGenBench aims to serve as foundational infrastructure for reproducible genomic AI research, accelerating trustworthy discovery and collaborative innovation in the era of genome-scale modeling.

📄 PDF Abstract BibTeX arXiv:2505.14402

Code (3)

cola-laboratory/omnigenbench 공식 구현 pytorch
yangheng95/omnigenbench 공식 구현 pytorch
yangheng95/OmniGenomeBench pytorch

Tasks

Benchmarking

Similar Papers 제목 키워드 기반

OmniGenBench: Automating Large-scale in-silico Benchmarking for Genomic Foundation Models

2024-10-02 · Heng Yang, Jack Cole, Ke Li

The advancements in artificial intelligence in recent years, such as Large Language Models (LLMs), have fueled expectations for breakthroughs in genomic foundation models (GFMs). The code of nature, hidden in diverse gen…

Benchmarking

OmniGenBench: A Benchmark for Omnipotent Multimodal Generation across 50+ Tasks

2025-05-24 · Jiayu Wang, Yang Jiao, Yue Yu, Tianwen Qian 외

Recent breakthroughs in large multimodal models (LMMs), such as the impressive GPT-4o-Native, have demonstrated remarkable proficiency in following general-purpose instructions for image generation. However, current benc…

Image GenerationInstruction Followingmultimodal generation

Introducing M: A Modular, Modifiable Social Robot

2026-03-19 · Victor Nikhil Antony, Zhili Gong, Yoonjae Kim, Chien-Ming Huang arxiv

We present M, an open-source, low-cost social robot platform designed to reduce platform friction that slows social robotics research by making robots easier to reproduce, modify, and deploy in real-world settings. M com…

FinRL-X: An AI-Native Modular Infrastructure for Quantitative Trading

2026-03-22 · Hongyang Yang, Boyu Zhang, Yang She, Xinyu Liao 외 arxiv

We present FinRL-X, a modular and deployment-consistent trading architecture that unifies data processing, strategy construction, backtesting, and broker execution under a weight-centric interface. While existing open-so…

Reinforcement Learning

OpenRC: An Open-Source Robotic Colonoscopy Framework for Multimodal Data Acquisition and Autonomy Research

2026-04-04 · Siddhartha Kapuria, Mohammad Rafiee Javazm, Naruhiko Ikoma, Joga Ivatury 외 arxiv

Colorectal cancer screening critically depends on colonoscopy, yet existing platforms offer limited support for systematically studying the coupled dynamics of operator control, instrument motion, and visual feedback. Th…