paper-with-me

Papers

Geometry Matters: Benchmarking Scientific ML Approaches for Flow Prediction around Complex Geometries

2024-12-31 · Ali Rabeh, Ethan Herron, Aditya Balu, Soumik Sarkar, Chinmay Hegde, Adarsh Krishnamurthy, Baskar Ganapathysubramanian

Rapid and accurate simulations of fluid dynamics around complicated geometric bodies are critical in a variety of engineering and scientific applications, including aerodynamics and biomedical flows. However, while scientific machine learning (SciML) has shown considerable promise, most studies in this field are limited to simple geometries, and complex, real-world scenarios are underexplored. This paper addresses this gap by benchmarking diverse SciML models, including neural operators and vision transformer-based foundation models, for fluid flow prediction over intricate geometries. Using a high-fidelity dataset of steady-state flows across various geometries, we evaluate the impact of geometric representations -- Signed Distance Fields (SDF) and binary masks -- on model accuracy, scalability, and generalization. Central to this effort is the introduction of a novel, unified scoring framework that integrates metrics for global accuracy, boundary layer fidelity, and physical consistency to enable a robust, comparative evaluation of model performance. Our findings demonstrate that newer foundation models significantly outperform neural operators, particularly in data-limited scenarios, and that SDF representations yield superior results with sufficient training data. Despite these promises, all models struggle with out-of-distribution generalization, highlighting a critical challenge for future SciML applications. By advancing both evaluation models and modeling capabilities, our work paves the way for robust and scalable ML solutions for fluid dynamics across complex geometries.

📄 PDF Abstract BibTeX arXiv:2501.01453

Code (0)

등록된 구현이 없습니다.

Tasks

BenchmarkingOut-of-Distribution Generalization

Similar Papers 제목 키워드 기반

Turbulence in Focus: Benchmarking Scaling Behavior of 3D Volumetric Super-Resolution with BLASTNet 2.0 Data

2023-09-23 · NeurIPS 2023 11

Analysis of compressible turbulent flows is essential for applications related to propulsion, energy generation, and the environment. Here, we present BLASTNet 2.0, a 2.2 TB network-of-datasets containing 744 full-domain…

BenchmarkingSuper-Resolution

Benchmarking that Matters: Rethinking Benchmarking for Practical Impact

2025-11-15 · Anna V. Kononova, Niki van Stein, Olaf Mersmann, Thomas Bäck 외 arxiv

Benchmarking has driven scientific progress in Evolutionary Computation, yet current practices fall short of real-world needs. Widely used synthetic suites such as BBOB and CEC isolate algorithmic phenomena but poorly re…

SAIBench: Benchmarking AI for Science

2022-06-11 · Yatao Li, Jianfeng Zhan

Scientific research communities are embracing AI-based solutions to target tractable scientific tasks and improve research workflows. However, the development and evaluation of such solutions are scattered across multipl…

BenchmarkingFriction

Agentic Mixture-of-Workflows for Multi-Modal Chemical Search

2025-02-26 · Tiffany J. Callahan, Nathaniel H. Park, Sara Capponi

The vast and complex materials design space demands innovative strategies to integrate multidisciplinary scientific knowledge and optimize materials discovery. While large language models (LLMs) have demonstrated promisi…

BenchmarkingRetrievalRetrieval-augmented Generation

MLReplicate: Benchmarking Autonomous Research Systems for Machine Learning Reproducibility

2026-05-15 · Sasi Kiran Gaddipati, Diyana Muhammed, Farhana Keya, Gollam Rabby 외 arxiv

Autonomous research systems capable of generating complete scientific manuscripts have advanced rapidly, yet robust and realistic evaluation frameworks have failed to keep pace. To bridge this gap, we introduce MLReplica…