paper-with-me

Papers

RoseNNa: A performant, portable library for neural network inference with application to computational fluid dynamics

2023-07-30 · Ajay Bati, Spencer H. Bryngelson

The rise of neural network-based machine learning ushered in high-level libraries, including TensorFlow and PyTorch, to support their functionality. Computational fluid dynamics (CFD) researchers have benefited from this trend and produced powerful neural networks that promise shorter simulation times. For example, multilayer perceptrons (MLPs) and Long Short Term Memory (LSTM) recurrent-based (RNN) architectures can represent sub-grid physical effects, like turbulence. Implementing neural networks in CFD solvers is challenging because the programming languages used for machine learning and CFD are mostly non-overlapping, We present the roseNNa library, which bridges the gap between neural network inference and CFD. RoseNNa is a non-invasive, lightweight (1000 lines), and performant tool for neural network inference, with focus on the smaller networks used to augment PDE solvers, like those of CFD, which are typically written in C/C++ or Fortran. RoseNNa accomplishes this by automatically converting trained models from typical neural network training packages into a high-performance Fortran library with C and Fortran APIs. This reduces the effort needed to access trained neural networks and maintains performance in the PDE solvers that CFD researchers build and rely upon. Results show that RoseNNa reliably outperforms PyTorch (Python) and libtorch (C++) on MLPs and LSTM RNNs with less than 100 hidden layers and 100 neurons per layer, even after removing the overhead cost of API calls. Speedups range from a factor of about 10 and 2 faster than these established libraries for the smaller and larger ends of the neural network size ranges tested.

📄 PDF Abstract BibTeX arXiv:2307.16322

Code (1)

comp-physics/roseNNa 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Library 설명 없음
Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Focus 설명 없음

Similar Papers 제목 키워드 기반

Llamas on the Web: Memory-Efficient, Performance-Portable, and Multi-Precision LLM Inference with WebGPU

2026-05-20 · Reese Levine, Rithik Sharma, Nikhil Jain, Abhijit Ramesh 외 arxiv

Running language models in the browser presents a unique opportunity to build efficient, private, and portable AI applications, but requires contending with constrained memory availability and heterogeneous hardware targ…

Volkit: A Performance-Portable Computer Vision Library for 3D Volumetric Data

2022-03-19 · Stefan Zellmann, Giovanni Aguirre, Jürgen P. Schulze

We present volkit, an open source library with high performance implementations of image manipulation and computer vision algorithms that focus on 3D volumetric representations. Volkit implements a cross-platform, perfor…

Image Manipulation

MSCCL++: Rethinking GPU Communication Abstractions for Cutting-edge AI Applications

2025-04-11 · Aashaka Shah, Abhinav Jangda, Binyang Li, Caio Rocha 외

Modern cutting-edge AI applications are being developed over fast-evolving, heterogeneous, nascent hardware devices. This requires frequent reworking of the AI software stack to adopt bottom-up changes from new hardware,…

GPU

BayesOpt: A Bayesian Optimization Library for Nonlinear Optimization, Experimental Design and Bandits

2014-05-29 · Ruben Martinez-Cantin

BayesOpt is a library with state-of-the-art Bayesian optimization methods to solve nonlinear optimization, stochastic bandits or sequential experimental design problems. Bayesian optimization is sample efficient by build…

Bayesian OptimizationExperimental DesignHyperparameter Optimization

JAX-Privacy: A library for differentially private machine learning

2026-02-19 · Ryan McKenna, Galen Andrew, Borja Balle, Vadym Doroshenko 외 arxiv

JAX-Privacy is a library designed to simplify the deployment of robust and performant mechanisms for differentially private machine learning. Guided by design principles of usability, flexibility, and efficiency, JAX-Pri…