Вход на сайт

Просмотр новости

Найдите то, что Вас интересует

A Natural Primal-Dual Hybrid Gradient Method for Adversarial Neural Network Training on Solving Partial Differential Equation

Дата публикации: 17-08-2026 20:26:00


We propose a scalable preconditioned primal-dual hybrid gradient algorithm for solving partial differential equations (PDEs). We multiply the PDE with a dual test function to obtain an inf-sup problem whose loss functional involves lower-order differential operators. The Primal-Dual Hybrid Gradient (PDHG) algorithm is then leveraged for this saddle point problem. By introducing suitable precondition operators to the proximal steps in the PDHG algorithm, we obtain an alternative natural gradient ascent-descent optimization scheme for updating the neural network parameters. We apply the Krylov subspace method (MINRES) to evaluate the natural gradients efficiently. Such treatment readily handles the inversion of precondition matrices via matrix-vector multiplication. An a posteriori convergence analysis is established for the time-continuous version of the proposed algorithm for general linear PDEs. By incorporating appropriate boundary loss terms, we further obtain a refined a priori convergence result for elliptic equations in divergence form. The algorithm is tested on various types of PDEs with dimensions ranging from $1$ to $50$, including linear and nonlinear elliptic equations, reaction-diffusion equations, and Monge-Ampere equations stemming from the $L^2$ optimal transport problems. We compare the performance of the proposed method with several commonly used deep learning algorithms such as physics-informed neural networks (PINNs), the DeepRitz method and weak adversarial networks (WANs) using either the Adam or the L-BFGS optimizer. The numerical results suggest that the proposed method performs efficiently and robustly and converges more stably with higher accuracy.

Схожие новости

#Наименование новостиТональностьИнформативностьДата публикации
1 STDE++: Polynomial-Time Amortization for Linear Differential Operators 07.1217-08-2026
2 Statistical Learning Theory for Neural Operators 010.2117-08-2026
3 Nonlocal Techniques for the Analysis of Deep ReLU Neural Network Approximations 06.6217-08-2026
4 A Functional-Space Mean-Field Theory of Partially-Trained Three-Layer Neural Networks 010.9717-08-2026
5 High-Dimensional Analysis of Gradient Flow for Extensive-Width Quadratic Neural Networks 08.717-08-2026
6 Flavors of Margin: Implicit Bias of Steepest Descent in Homogeneous Neural Networks 0517-08-2026
7 Statistical guarantees for denoising reflected diffusion models 05.317-08-2026
8 Convergence of Decentralized Stochastic Subgradient-based Methods for Nonsmooth Nonconvex Optimization 08.7817-08-2026
9 A Two-Timescale Primal-Dual Framework for Reinforcement Learning via Online Dual Variable Guidance 013.1217-08-2026
10 Reparameterized Complex-valued Neurons Can Efficiently Learn More than Real-valued Neurons via Gradient Descent 011.8617-08-2026

Классификация: Наука. Схожих патентов: 0. Схожих новостей: 10. Тональность: 0. Информативность: 7.94. Источник: jmlr.org.