paper-with-me

Papers

Physical Data Embedding for Memory Efficient AI

2024-07-19 · Callen MacPhee, Yiming Zhou, Bahram Jalali

Deep neural networks (DNNs) have achieved exceptional performance across various fields by learning complex, nonlinear mappings from large-scale datasets. However, they face challenges such as high memory requirements and computational costs with limited interpretability. This paper introduces an approach where master equations of physics are converted into multilayered networks that are trained via backpropagation. The resulting general-purpose model effectively encodes data in the properties of the underlying physical system. In contrast to existing methods wherein a trained neural network is used as a computationally efficient alternative for solving physical equations, our approach directly treats physics equations as trainable models. We demonstrate this physical embedding concept with the Nonlinear Schr\"odinger Equation (NLSE), which acts as trainable architecture for learning complex patterns including nonlinear mappings and memory effects from data. The network embeds data representation in orders of magnitude fewer parameters than conventional neural networks when tested on time series data. Notably, the trained "Nonlinear Schr\"odinger Network" is interpretable, with all parameters having physical meanings. This interpretability offers insight into the underlying dynamics of the system that produced the data. The proposed method of replacing traditional DNN feature learning architectures with physical equations is also extended to the Gross-Pitaevskii Equation, demonstrating the broad applicability of the framework to other master equations of physics. Among our results, an ablation study quantifies the relative importance of physical terms such as dispersion, nonlinearity, and potential energy for classification accuracy. We also outline the limitations of this approach as it relates to generalizability.

📄 PDF Abstract BibTeX arXiv:2407.14504

Code (0)

등록된 구현이 없습니다.

Tasks

Physics-informed machine learningTime SeriesTime Series ClassificationTime Series Forecasting

Similar Papers 제목 키워드 기반

Bandana: Using Non-volatile Memory for Storing Deep Learning Models

2018-11-14 · Assaf Eisenman, Maxim Naumov, Darryl Gardner, Misha Smelyanskiy 외

Typical large-scale recommender systems use deep learning models that are stored on a large amount of DRAM. These models often rely on embeddings, which consume most of the required memory. We present Bandana, a storage …

Deep Learninghypergraph partitioningRecommendation Systems

Learning Plug-and-play Memory for Guiding Video Diffusion Models

2025-11-24 · Selena Song, Ziming Xu, Zijun Zhang, Kun Zhou 외 arxiv

Diffusion Transformer(DiT) based video generation models have recently achieved impressive visual quality and temporal coherence, but they still frequently violate basic physical laws and commonsense dynamics, revealing …

Video Generation

Fine-Grained Embedding Dimension Optimization During Training for Recommender Systems

2024-01-09 · Qinyi Luo, Penghan Wang, Wei zhang, Fan Lai 외

Huge embedding tables in modern deep learning recommender models (DLRM) require prohibitively large memory during training and inference. This paper proposes FIITED, a system to automatically reduce the memory footprint …

Click-Through Rate PredictionRecommendation Systems

Analytic Concept-Centric Memory for Agentic Embodied Manipulation

2026-06-29 · Mingyang Sun, Xiujian Liang, Jiude Wei, Qichen He 외 arxiv

Long-horizon embodied manipulation requires agents to remember persistent objects, track changing scene states, and reuse prior interaction knowledge. However, existing agent memories are often stored as unstructured his…

Skill Generalization

Neural-MMGS: Multi-modal Neural Gaussian Splats for Large-Scale Scene Reconstruction

2025-09-22 · Sitian Shen, Georgi Pramatarov, Yifu Tao, Daniele De Martini arxiv

This paper proposes Neural-MMGS, a novel neural 3DGS framework for multimodal large-scale scene reconstruction that fuses multiple sensing modalities in a per-gaussian compact, learnable embedding. While recent works foc…