paper-with-me

홈 › Papers

ZENN: A Thermodynamics-Inspired Computational Framework for Heterogeneous Data-Driven Modeling

2025-05-14 · Shun Wang, Shun-Li Shang, Zi-Kui Liu, Wenrui Hao

Traditional entropy-based methods - such as cross-entropy loss in classification problems - have long been essential tools for quantifying uncertainty and disorder in data and developing artificial intelligence algorithms. However, the rapid growth of data across various domains has introduced new challenges, particularly the integration of heterogeneous datasets with intrinsic disparities. In this paper, we extend zentropy theory into the data science domain by introducing intrinsic entropy, enabling more effective learning from heterogeneous data sources. We propose a zentropy-enhanced neural network (ZENN) that simultaneously learns both energy and intrinsic entropy components, capturing the underlying structure of multi-source data. To support this, we redesign the neural network architecture to better reflect the intrinsic properties and variability inherent in diverse datasets. We demonstrate the effectiveness of ZENN on classification tasks and energy landscape reconstructions, showing its superior generalization capabilities and robustness-particularly in predicting high-order derivatives. As a practical application, we employ ZENN to reconstruct the Helmholtz energy landscape of Fe3Pt using data generated from DFT and capture key material behaviors, including negative thermal expansion and the critical point in the temperature-pressure space. Overall, our study introduces a novel approach for data-driven machine learning grounded in zentropy theory, highlighting ZENN as a versatile and robust deep learning framework for scientific problems involving complex, heterogeneous datasets.

📄 PDF Abstract BibTeX arXiv:2505.09851

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A ZeNN architecture to avoid the Gaussian trap

2025-05-26 · Luís Carvalho, João L. Costa, José Mourão, Gonçalo Oliveira

We propose a new simple architecture, Zeta Neural Networks (ZeNNs), in order to overcome several shortcomings of standard multi-layer perceptrons (MLPs). Namely, in the large width limit, MLPs are non-parametric, they do…

Building a database of French frozen adverbial phrases

2012-05-01 · LREC 2012 5 · Aude Grezka, C{\'e}line Poudat

The present paper gives an account of the approach we have led so far to build a database of frozen units. Although it has long been absent from linguistic studies and grammatical tradition, linguistic frozenness is curr…

A Physics-Informed Convolutional Long Short Term Memory Statistical Model for Fluid Thermodynamics Simulations

2025-05-16 · Luca Menicali, Andrew Grace, David H. Richter, Stefano Castruccio

Fluid thermodynamics underpins atmospheric dynamics, climate science, industrial applications, and energy systems. However, direct numerical simulations (DNS) of such systems are computationally prohibitive. To address t…

Conformal Prediction

Thermodynamic-Inspired Explainable GeoAI: Uncovering Regime-Dependent Mechanisms in Heterogeneous Spatial Systems

2026-04-06 · Sooyoung Lim, Zhenlong Li, Zi-Kui Liu arxiv

Modeling spatial heterogeneity and associated critical transitions remains a fundamental challenge in geography and environmental science. While conventional Geographically Weighted Regression (GWR) and deep learning mod…

Combining Thermodynamics-based Model of the Centrifugal Compressors and Active Machine Learning for Enhanced Industrial Design Optimization

2023-09-06 · Shadi Ghiasi, Guido Pazzi, Concettina Del Grosso, Giovanni De Magistris 외

The design process of centrifugal compressors requires applying an optimization process which is computationally expensive due to complex analytical equations underlying the compressor's dynamical equations. Although the…

Active Learning