paper-with-me

홈 › Papers

Taylor-Sensus Network: Embracing Noise to Enlighten Uncertainty for Scientific Data

2024-09-12 · Guangxuan Song, Dongmei Fu, Zhongwei Qiu, Jintao Meng, Dawei Zhang

Uncertainty estimation is crucial in scientific data for machine learning. Current uncertainty estimation methods mainly focus on the model's inherent uncertainty, while neglecting the explicit modeling of noise in the data. Furthermore, noise estimation methods typically rely on temporal or spatial dependencies, which can pose a significant challenge in structured scientific data where such dependencies among samples are often absent. To address these challenges in scientific research, we propose the Taylor-Sensus Network (TSNet). TSNet innovatively uses a Taylor series expansion to model complex, heteroscedastic noise and proposes a deep Taylor block for aware noise distribution. TSNet includes a noise-aware contrastive learning module and a data density perception module for aleatoric and epistemic uncertainty. Additionally, an uncertainty combination operator is used to integrate these uncertainties, and the network is trained using a novel heteroscedastic mean square error loss. TSNet demonstrates superior performance over mainstream and state-of-the-art methods in experiments, highlighting its potential in scientific research and noise resistance. It will be open-source to facilitate the community of "AI for Science".

📄 PDF Abstract BibTeX arXiv:2409.07942

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningNoise Estimation

Methods 이 논문이 사용한 방법론

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…
Focus 설명 없음
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Embracing Unimodal Aleatoric Uncertainty for Robust Multimodal Fusion

2024-01-01 · CVPR 2024 1 · Zixian Gao, Xun Jiang, Xing Xu, Fumin Shen 외

As a fundamental problem in multimodal learning multimodal fusion aims to compensate for the inherent limitations of a single modality. One challenge of multimodal fusion is that the unimodal data in their unique emb…

Contrastive Learning

VOLTA: The Surprising Ineffectiveness of Auxiliary Losses for Calibrated Deep Learning

2026-04-09 · Rahul D Ray, Utkarsh Srivastava arxiv

Uncertainty quantification (UQ) is essential for deploying deep learning models in safety critical applications, yet no consensus exists on which UQ method performs best across different data modalities and distribution …

How enlightened self-interest guided global vaccine sharing benefits all: a modelling study

2023-10-13 · Zhenyu Han, Qianyue Hao, Qiwei He, Katherine Budeski 외

Background: Despite the consensus that vaccines play an important role in combating the global spread of infectious diseases, vaccine inequity is still rampant with deep-seated mentality of self-priority. This study aims…

All

Enlightenment Period Improving DNN Performance

2025-04-02 · Tiantian Liu, Weishi Xu, Meng Wan, Jue Wang

In the early stage of deep neural network training, the loss decreases rapidly before gradually leveling off. Extensive research has shown that during this stage, the model parameters undergo significant changes and thei…

Data Augmentation

Taylorformer: Probabilistic Modelling for Random Processes including Time Series

2023-05-30 · Omer Nivron, Raghul Parthipan, Damon J. Wischik

We propose the Taylorformer for random processes such as time series. Its two key components are: 1) the LocalTaylor wrapper which adapts Taylor approximations (used in dynamical systems) for use in neural network-based …

Gaussian ProcessesMeta-LearningTime Series