A Quantum Field Theory of Representation Learning
Continuous symmetries and their breaking play a prominent role in contemporary physics. Effective low-energy field theories around symmetry breaking states explain diverse phenomena such as superconductivity, magnetism, and the mass of nucleons. We show that such field theories can also be a useful tool in machine learning, in particular for loss functions with continuous symmetries that are spontaneously broken by random initializations. In this paper, we illuminate our earlier published work (Bamler & Mandt, 2018) on this topic more from the perspective of theoretical physics. We show that the analogies between superconductivity and symmetry breaking in temporal representation learning are rather deep, allowing us to formulate a gauge theory of `charged' embedding vectors in time series models. We show that making the loss function gauge invariant speeds up convergence in such models.
Code (0)
등록된 구현이 없습니다.
Tasks
Representation LearningTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
Towards a variational Jordan-Lee-Preskill quantum algorithm
Rapid developments of quantum information technology show promising opportunities for simulating quantum field theory in near-term quantum devices. In this work, we formulate the theory of (time-dependent) variational qu…
Computational EfficiencyQuantum Graph Learning: Frontiers and Outlook
Quantum theory has shown its superiority in enhancing machine learning. However, facilitating quantum theory to enhance graph learning is in its infancy. This survey investigates the current advances in quantum graph lea…
Graph LearningSpecificitySurveyRepresentation Theory for Geometric Quantum Machine Learning
Recent advances in classical machine learning have shown that creating models with inductive biases encoding the symmetries of a problem can greatly improve performance. Importation of these ideas, combined with an exist…
Quantum Machine LearningGrading the Unspoken: Evaluating Tacit Reasoning in Quantum Field Theory and String Theory with LLMs
Large language models have demonstrated impressive performance across many domains of mathematics and physics. One natural question is whether such models can support research in highly abstract theoretical fields such a…
Applications of Machine Learning to Lattice Quantum Field Theory
There is great potential to apply machine learning in the area of numerical lattice quantum field theory, but full exploitation of that potential will require new strategies. In this white paper for the Snowmass communit…
BIG-bench Machine Learning