Speeding up Computational Morphogenesis with Online Neural Synthetic Gradients
A wide range of modern science and engineering applications are formulated as optimization problems with a system of partial differential equations (PDEs) as constraints. These PDE-constrained optimization problems are typically solved in a standard discretize-then-optimize approach. In many industry applications that require high-resolution solutions, the discretized constraints can easily have millions or even billions of variables, making it very slow for the standard iterative optimizer to solve the exact gradients. In this work, we propose a general framework to speed up PDE-constrained optimization using online neural synthetic gradients (ONSG) with a novel two-scale optimization scheme. We successfully apply our ONSG framework to computational morphogenesis, a representative and challenging class of PDE-constrained optimization problems. Extensive experiments have demonstrated that our method can significantly speed up computational morphogenesis (also known as topology optimization), and meanwhile maintain the quality of final solution compared to the standard optimizer. On a large-scale 3D optimal design problem with around 1,400,000 design variables, our method achieves up to 7.5x speedup while producing optimized designs with comparable objectives.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Cell density controls signal propagation waves in a multicellular synthetic gene circuit
During organismal development, biochemical reaction networks sense and respond to mechanical forces to coordinate embryonic patterning with embryo morphogenesis. Factors such as cortical tension, cell density, and matrix…
Mechanics of Morphogenesis in Neural Development: in vivo, in vitro, and in silico
Morphogenesis in the central nervous system has received intensive attention as elucidating fundamental mechanisms of morphogenesis will shed light on the physiology and pathophysiology of the developing central nervous …
AI-driven control of bioelectric signalling for real-time topological reorganization of cells
Understanding and manipulating bioelectric signaling could present a new wave of progress in developmental biology, regenerative medicine, and synthetic biology. Bioelectric signals, defined as voltage gradients across c…
Deep Reinforcement LearningEmbarassingly Simple Dataset Distillation
Dataset distillation extracts a small set of synthetic training samples from a large dataset with the goal of achieving competitive performance on test data when trained on this sample. In this work, we tackle dataset di…
Bilevel OptimizationDataset DistillationDataset Distillation - 1IPCBP(λ): Online Learning via Synthetic Gradients
Training recurrent neural networks typically relies on backpropagation through time (BPTT). BPTT depends on forward and backward passes to be completed, rendering the network locked to these computations before loss grad…
Reinforcement Learning (RL)