paper-with-me

홈 › Papers

Surface Similarity Parameter: A New Machine Learning Loss Metric for Oscillatory Spatio-Temporal Data

2022-04-14 · Mathies Wedler, Merten Stender, Marco Klein, Svenja Ehlers, Norbert Hoffmann

Supervised machine learning approaches require the formulation of a loss functional to be minimized in the training phase. Sequential data are ubiquitous across many fields of research, and are often treated with Euclidean distance-based loss functions that were designed for tabular data. For smooth oscillatory data, those conventional approaches lack the ability to penalize amplitude, frequency and phase prediction errors at the same time, and tend to be biased towards amplitude errors. We introduce the surface similarity parameter (SSP) as a novel loss function that is especially useful for training machine learning models on smooth oscillatory sequences. Our extensive experiments on chaotic spatio-temporal dynamics systems indicate that the SSP is beneficial for shaping gradients, thereby accelerating the training process, reducing the final prediction error, increasing weight initialization robustness, and implementing a stronger regularization effect compared to using classical loss functions. The results indicate the potential of the novel loss metric particularly for highly complex and chaotic data, such as data stemming from the nonlinear two-dimensional Kuramoto-Sivashinsky equation and the linear propagation of dispersive surface gravity waves in fluids.

📄 PDF Abstract BibTeX arXiv:2204.06843

Code (1)

MathiesW/2022-code-surface-similarity-parameter-ml-loss-metric 공식 구현 tf

Tasks

BIG-bench Machine Learning

Methods 이 논문이 사용한 방법론

Gravity Gravity is a kinematic approach to optimization based on gradients.

Similar Papers 제목 키워드 기반

InfoCD: A Contrastive Chamfer Distance Loss for Point Cloud Completion

2023-09-21 · NeurIPS 2023 11

A point cloud is a discrete set of data points sampled from a 3D geometric surface. Chamfer distance (CD) is a popular metric and training loss to measure the distances between point clouds, but also well known to be sen…

Gradient representations in ReLU networks as similarity functions

2021-10-26 · Dániel Rácz, Bálint Daróczy

Feed-forward networks can be interpreted as mappings with linear decision surfaces at the level of the last layer. We investigate how the tangent space of the network can be exploited to refine the decision in case of Re…

Generative Adversarial Networks for geometric surfaces prediction in injection molding

2019-01-29 · Pierre Nagorny, Thomas Lacombe, Hugues Favreliere, Maurice Pillet 외

Geometrical and appearance quality requirements set the limits of the current industrial performance in injection molding. To guarantee the product's quality, it is necessary to adjust the process settings in a closed lo…

S3IM: Stochastic Structural SIMilarity and Its Unreasonable Effectiveness for Neural Fields

2023-08-14 · ICCV 2023 1 · Zeke Xie, Xindi Yang, Yujie Yang, Qi Sun 외

Recently, Neural Radiance Field (NeRF) has shown great success in rendering novel-view images of a given scene by learning an implicit representation with only posed RGB images. NeRF and relevant neural field methods (e.…

NeRFNovel View SynthesisSurface Reconstruction

Rigid Transformations for Stabilized Lower Dimensional Space to Support Subsurface Uncertainty Quantification and Interpretation

2023-08-16 · Ademide O. Mabadeje, Michael J. Pyrcz

Subsurface datasets inherently possess big data characteristics such as vast volume, diverse features, and high sampling speeds, further compounded by the curse of dimensionality from various physical, engineering, and g…

Dimensionality ReductionUncertainty Quantification