Quantum Architecture Search via Continual Reinforcement Learning

2021-12-10 · Esther Ye, Samuel Yen-Chi Chen

Quantum computing has promised significant improvement in solving difficult computational tasks over classical computers. Designing quantum circuits for practical use, however, is not a trivial objective and requires expert-level knowledge. To aid this endeavor, this paper proposes a machine learning-based method to construct quantum circuit architectures. Previous works have demonstrated that classical deep reinforcement learning (DRL) algorithms can successfully construct quantum circuit architectures without encoded physics knowledge. However, these DRL-based works are not generalizable to settings with changing device noises, thus requiring considerable amounts of training resources to keep the RL models up-to-date. With this in mind, we incorporated continual learning to enhance the performance of our algorithm. In this paper, we present the Probabilistic Policy Reuse with deep Q-learning (PPR-DQL) framework to tackle this circuit design challenge. By conducting numerical simulations over various noise patterns, we demonstrate that the RL agent with PPR was able to find the quantum gate sequence to generate the two-qubit Bell state faster than the agent that was trained from scratch. The proposed framework is general and can be applied to other quantum gate synthesis or control problems -- including the automatic calibration of quantum devices.

📄 PDF Abstract BibTeX arXiv:2112.05779

Code (0)

등록된 구현이 없습니다.

Tasks

Continual LearningDeep Reinforcement LearningQ-Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

Continual Quantum Architecture Search with Tensor-Train Encoding: Theory and Applications to Signal Processing

2026-01-10 · Jun Qi, Chao-Han Huck Yang, Pin-Yu Chen, Javier Tejedor 외 arxiv

We introduce CL-QAS, a continual quantum architecture search framework that mitigates the challenges of costly amplitude encoding and catastrophic forgetting in variational quantum circuits. The method uses Tensor-Train …

CQural: A Novel CNN based Hybrid Architecture for Quantum Continual Machine Learning

2023-05-16 · Sanyam Jain

Training machine learning models in an incremental fashion is not only important but also an efficient way to achieve artificial general intelligence. The ability that humans possess of continuous or lifelong learning he…

Continual Learning Lifelong learning

Quantum Architecture Search via Deep Reinforcement Learning

2021-04-15 · En-Jui Kuo, Yao-Lung L. Fang, Samuel Yen-Chi Chen

Recent advances in quantum computing have drawn considerable attention to building realistic application for and using quantum computers. However, designing a suitable quantum circuit architecture requires expert knowled…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Evolutionary Quantum Architecture Search for Parametrized Quantum Circuits

2022-08-23 · Li Ding, Lee Spector

Recent advancements in quantum computing have shown promising computational advantages in many problem areas. As one of those areas with increasing attention, hybrid quantum-classical machine learning systems have demons…

Reinforcement Learning (RL)

Differentiable Quantum Architecture Search for Quantum Reinforcement Learning

2023-09-19 · Yize Sun, Yunpu Ma, Volker Tresp

Differentiable quantum architecture search (DQAS) is a gradient-based framework to design quantum circuits automatically in the NISQ era. It was motivated by such as low fidelity of quantum hardware, low flexibility of c…

Q-Learning Quantum Machine Learning reinforcement-learning Reinforcement Learning