CiRL: Open-Source Environments for Reinforcement Learning in Circular Economy and Net Zero

2025-05-24 · Federico Zocco, Andrea Corti, Monica Malvezzi

The demand of finite raw materials will keep increasing as they fuel modern society. Simultaneously, solutions for stopping carbon emissions in the short term are not available, thus making the net zero target extremely challenging to achieve at scale. The circular economy (CE) paradigm is gaining attention as a solution to address climate change and the uncertainties of supplies of critical materials. Hence, in this paper, we introduce CiRL, a deep reinforcement learning (DRL) library of environments focused on the circularity of both solid and fluid materials. The integration of DRL into the design of material circularity is possible thanks to the formalism of thermodynamical material networks, which is underpinned by compartmental dynamical thermodynamics. Along with the focus on circularity, this library has three more features: the new CE-oriented environments are in the state-space form, which is typically used in dynamical systems analysis and control designs; it is based on a state-of-the-art Python library of DRL algorithms, namely, Stable-Baselines3; and it is developed in Google Colaboratory to be accessible to researchers from different disciplines and backgrounds as is often the case for circular economy researchers and engineers. CiRL is publicly available.

📄 PDF Abstract BibTeX arXiv:2505.21536

Code (1)

ciroresearch/cirl 공식 구현

Tasks

Deep Reinforcement Learning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Attention 설명 없음

Library 설명 없음

Focus 설명 없음

elsciRL: Integrating Language Solutions into Reinforcement Learning Problem Settings

2025-07-11 · Philip Osborne, Danilo S. Carvalho, André Freitas arxiv

We present elsciRL, an open-source Python library to facilitate the application of language solutions on reinforcement learning problems. We demonstrate the potential of our software by extending the Language Adapter wit…

Reinforcement Learning

SGN-CIRL: Scene Graph-based Navigation with Curriculum, Imitation, and Reinforcement Learning

2025-06-04 · Nikita Oskolkov, Huzhenyu Zhang, Dmitry Makarov, Dmitry Yudin 외

The 3D scene graph models spatial relationships between objects, enabling the agent to efficiently navigate in a partially observable environment and predict the location of the target object.This paper proposes an origi…

Imitation Learning Navigate reinforcement-learning Reinforcement Learning+1

Cooperative Inverse Reinforcement Learning

2016-06-09 · NeurIPS 2016 12 · Dylan Hadfield-Menell, Anca Dragan, Pieter Abbeel, Stuart Russell

For an autonomous system to be helpful to humans and to pose no unwarranted risks, it needs to align its values with those of the humans in its environment in such a way that its actions contribute to the maximization of…

Active Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Control-Informed Reinforcement Learning for Chemical Processes

2024-08-24 · Maximilian Bloor, Akhil Ahmed, Niki Kotecha, Mehmet Mercangöz 외

This work proposes a control-informed reinforcement learning (CIRL) framework that integrates proportional-integral-derivative (PID) control components into the architecture of deep reinforcement learning (RL) policies. …

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

CIRL: Controllable Imitative Reinforcement Learning for Vision-based Self-driving

2018-07-10 · ECCV 2018 9 · Xiaodan Liang, Tairui Wang, Luona Yang, Eric Xing

Autonomous urban driving navigation with complex multi-agent dynamics is under-explored due to the difficulty of learning an optimal driving policy. The traditional modular pipeline heavily relies on hand-designed rules …

Imitation Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)