paper-with-me

Papers

Fast, Convex and Conditioned Network for Multi-Fidelity Vectors and Stiff Univariate Differential Equations

2025-08-08 · Siddharth Rout arxiv

Accuracy in neural PDE solvers often breaks down not because of limited expressivity, but due to poor optimisation caused by ill-conditioning, especially in multi-fidelity and stiff problems. We study this issue in Physics-Informed Extreme Learning Machines (PIELMs), a convex variant of neural PDE solvers, and show that asymptotic components in governing equations can produce highly ill-conditioned activation matrices, severely limiting convergence. We introduce Shifted Gaussian Encoding, a simple yet effective activation filtering step that increases matrix rank and expressivity while preserving convexity. Our method extends the solvable range of Peclet numbers in steady advection-diffusion equations by over two orders of magnitude, achieves up to six orders lower error on multi-frequency function learning, and fits high-fidelity image vectors more accurately and faster than deep networks with over a million parameters. This work highlights that conditioning, not depth, is often the bottleneck in scientific neural solvers and that simple architectural changes can unlock substantial gains.

📄 PDF Abstract BibTeX arXiv:2508.05921

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

VectorSynth: Fine-Grained Satellite Image Synthesis with Structured Semantics

2025-11-11 · Daniel Cher, Brian Wei, Srikumar Sastry, Nathan Jacobs arxiv

We introduce VectorSynth, a diffusion-based framework for pixel-accurate satellite image synthesis conditioned on polygonal geographic annotations with semantic attributes. Unlike prior text- or layout-conditioned models…

Conditional Image Generation

Robust Gradient Descent via Heavy-Ball Momentum with Predictive Extrapolation

2025-12-10 · Sarwan Ali arxiv

Accelerated gradient methods like Nesterov's Accelerated Gradient (NAG) achieve faster convergence on well-conditioned problems but often diverge on ill-conditioned or non-convex landscapes due to aggressive momentum acc…

High-Fidelity Text-to-Image Generation from Pre-Trained Vision-Language Models via Distribution-Conditioned Diffusion Decoding

2026-03-11 · Ji Woo Hong, Hee Suk Yoon, Gwanhyeong Koo, Eunseop Yoon 외 arxiv

Recent large-scale vision-language models (VLMs) have shown remarkable text-to-image generation capabilities, yet their visual fidelity remains constrained by the discrete image tokenization, which poses a major challeng…

Text-to-Image Generation

Fast Stochastic Algorithms for SVD and PCA: Convergence Properties and Convexity

2015-07-31 · Ohad Shamir

We study the convergence properties of the VR-PCA algorithm introduced by \cite{shamir2015stochastic} for fast computation of leading singular vectors. We prove several new results, including a formal analysis of a block…

Preconditioned subgradient method for composite optimization: overparameterization and fast convergence

2025-09-15 · Mateo Díaz, Liwei Jiang, Abdel Ghani Labassi arxiv

Composite optimization problems involve minimizing the composition of a smooth map with a convex function. Such objectives arise in numerous data science and signal processing applications, including phase retrieval, bli…

Collaborative Filtering