paper-with-me

홈 › Papers

Prevention of Overfitting on Mesh-Structured Data Regressions with a Modified Laplace Operator

2025-07-09 · Enda D. V. Bigarella arxiv

This document reports on a method for detecting and preventing overfitting on data regressions, herein applied to mesh-like data structures. The mesh structure allows for the straightforward computation of the Laplace-operator second-order derivatives in a finite-difference fashion for noiseless data. Derivatives of the training data are computed on the original training mesh to serve as a true label of the entropy of the training data. Derivatives of the trained data are computed on a staggered mesh to identify oscillations in the interior of the original training mesh cells. The loss of the Laplace-operator derivatives is used for hyperparameter optimisation, achieving a reduction of unwanted oscillation through the minimisation of the entropy of the trained model. In this setup, testing does not require the splitting of points from the training data, and training is thus directly performed on all available training points. The Laplace operator applied to the trained data on a staggered mesh serves as a surrogate testing metric based on diffusion properties.

📄 PDF Abstract BibTeX arXiv:2507.06631

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Keeping Deep Learning Models in Check: A History-Based Approach to Mitigate Overfitting

2024-01-18 · Hao Li, Gopi Krishnan Rajbahadur, Dayi Lin, Cor-Paul Bezemer 외

In software engineering, deep learning models are increasingly deployed for critical tasks such as bug detection and code review. However, overfitting remains a challenge that affects the quality, reliability, and trustw…

A Distributed Neural Network Architecture for Robust Non-Linear Spatio-Temporal Prediction

2019-12-23 · Matthias Karlbauer, Sebastian Otte, Hendrik P. A. Lensch, Thomas Scholten 외

We introduce a distributed spatio-temporal artificial neural network architecture (DISTANA). It encodes mesh nodes using recurrent, neural prediction kernels (PKs), while neural transition kernels (TKs) transfer informat…

Time SeriesTime Series Analysis

Tessellation GS: Neural Mesh Gaussians for Robust Monocular Reconstruction of Dynamic Objects

2025-12-08 · Shuohan Tao, Boyao Zhou, Hanzhang Tu, Yuwang Wang 외 arxiv

3D Gaussian Splatting (GS) enables highly photorealistic scene reconstruction from posed image sequences but struggles with viewpoint extrapolation due to its anisotropic nature, leading to overfitting and poor generaliz…

A Dissection of Overfitting and Generalization in Continuous Reinforcement Learning

2018-06-20 · Amy Zhang, Nicolas Ballas, Joelle Pineau

The risks and perils of overfitting in machine learning are well known. However most of the treatment of this, including diagnostic tools and remedies, was developed for the supervised learning case. In this work, we aim…

BIG-bench Machine LearningDeep Reinforcement LearningDiagnosticDiversity+3

Dropout as a Structured Shrinkage Prior

2018-10-09 · Eric Nalisnick, José Miguel Hernández-Lobato, Padhraic Smyth

Dropout regularization of deep neural networks has been a mysterious yet effective tool to prevent overfitting. Explanations for its success range from the prevention of "co-adapted" weights to it being a form of cheap B…

Bayesian Inference