paper-with-me

Papers

A mechanism-driven reinforcement learning framework for shape optimization of airfoils

2024-03-07 · Jingfeng Wang, Guanghui Hu

In this paper, a novel mechanism-driven reinforcement learning framework is proposed for airfoil shape optimization. To validate the framework, a reward function is designed and analyzed, from which the equivalence between the maximizing the cumulative reward and achieving the optimization objectives is guaranteed theoretically. To establish a quality exploration, and to obtain an accurate reward from the environment, an efficient solver for steady Euler equations is employed in the reinforcement learning method. The solver utilizes the B\'ezier curve to describe the shape of the airfoil, and a Newton-geometric multigrid method for the solution. In particular, a dual-weighted residual-based h-adaptive method is used for efficient calculation of target functional. To effectively streamline the airfoil shape during the deformation process, we introduce the Laplacian smoothing, and propose a B\'ezier fitting strategy, which not only remits mesh tangling but also guarantees a precise manipulation of the geometry. In addition, a neural network architecture is designed based on an attention mechanism to make the learning process more sensitive to the minor change of the airfoil geometry. Numerical experiments demonstrate that our framework can handle the optimization problem with hundreds of design variables. It is worth mentioning that, prior to this work, there are limited works combining such high-fidelity partial differential equatons framework with advanced reinforcement learning algorithms for design problems with such high dimensionality.

📄 PDF Abstract BibTeX arXiv:2403.04329

Code (0)

등록된 구현이 없습니다.

Tasks

Dimensionality Reductionreinforcement-learningReinforcement Learning

Similar Papers 제목 키워드 기반

Deep convolutional neural network for shape optimization using level-set approach

2022-01-17 · Wrik Mallik, Neil Farvolden, Jasmin Jelovica, Rajeev K. Jaiman

This article presents a reduced-order modeling methodology via deep convolutional neural networks (CNNs) for shape optimization applications. The CNN provides a nonlinear mapping between the shapes and their associated a…

Computational Efficiency

Shape-driven Coordinate Ordering for Star Glyph Sets via Reinforcement Learning

2021-03-03 · Ruizhen Hu, Bin Chen, Juzhan Xu, Oliver van Kaick 외

We present a neural optimization model trained with reinforcement learning to solve the coordinate ordering problem for sets of star glyphs. Given a set of star glyphs associated to multiple class labels, we propose to u…

DecoderPerceptual Distancereinforcement-learningReinforcement Learning (RL)

Anchored Policy Optimization: Mitigating Exploration Collapse Via Support-Constrained Rectification

2026-02-05 · Tianyi Wang, Long Li, Hongcan Guo, Yibiao Chen 외 arxiv

Reinforcement Learning with Verifiable Rewards (RLVR) is increasingly viewed as a tree pruning mechanism. However, we identify a systemic pathology termed Recursive Space Contraction (RSC), an irreversible collapse drive…

Reinforcement Learning

Can LLMs Guide Their Own Exploration? Gradient-Guided Reinforcement Learning for LLM Reasoning

2025-12-17 · Zhenwen Liang, Sidi Lu, Wenhao Yu, Kishan Panaganti 외 arxiv

Reinforcement learning has become essential for strengthening the reasoning abilities of large language models, yet current exploration mechanisms remain fundamentally misaligned with how these models actually learn. Ent…

Reinforcement Learning

Waypoint Optimization Using Bayesian Optimization: A Case Study in Airborne Wind Energy Systems

2020-11-17

We present a data-driven optimization framework that aims to address online adaptation of the flight path shape for an airborne wind energy system (AWE) that follows a repetitive path to generate power. Specifically, Bay…

Bayesian Optimization