paper-with-me

홈 › Papers

To Measure or Not: A Cost-Sensitive, Selective Measuring Environment for Agricultural Management Decisions with Reinforcement Learning

2025-01-22 · Hilmy Baja, Michiel Kallenberg, Ioannis N. Athanasiadis

Farmers rely on in-field observations to make well-informed crop management decisions to maximize profit and minimize adverse environmental impact. However, obtaining real-world crop state measurements is labor-intensive, time-consuming and expensive. In most cases, it is not feasible to gather crop state measurements before every decision moment. Moreover, in previous research pertaining to farm management optimization, these observations are often assumed to be readily available without any cost, which is unrealistic. Hence, enabling optimization without the need to have temporally complete crop state observations is important. An approach to that problem is to include measuring as part of decision making. As a solution, we apply reinforcement learning (RL) to recommend opportune moments to simultaneously measure crop features and apply nitrogen fertilizer. With realistic considerations, we design an RL environment with explicit crop feature measuring costs. While balancing costs, we find that an RL agent, trained with recurrent PPO, discovers adaptive measuring policies that follow critical crop development stages, with results aligned by what domain experts would consider a sensible approach. Our results highlight the importance of measuring when crop feature measurements are not readily available.

📄 PDF Abstract BibTeX arXiv:2501.12823

Code (1)

WUR-AI/CropGym-ToMeasureOrNot 공식 구현

Tasks

ManagementReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음
PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…

Similar Papers 제목 키워드 기반

Dynamic Observation Policies in Observation Cost-Sensitive Reinforcement Learning

2023-07-05 · Colin Bellinger, Mark Crowley, Isaac Tamblyn

Reinforcement learning (RL) has been shown to learn sophisticated control policies for complex tasks including games, robotics, heating and cooling systems and text generation. The action-perception cycle in RL, however,…

OpenAI Gymreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1

The Biosensor based on electrochemical dynamics of fermentation in yeast Saccharomyces Cerevisiae

2022-02-07 · Serge Kernbach, Olga Kernbach, Igor Kuksin, Andreas Kernbach 외

The zymase activity of the yeast Saccharomyces Cerevisiae is sensitive to environmental parameters and is therefore used as a microbiological sensor for water quality assessment, ecotoxicological characterization or envi…

Bounding-Box Inference for Error-Aware Model-Based Reinforcement Learning

2024-06-23 · Erin J. Talvitie, Zilei Shao, Huiying Li, Jinghan Hu 외

In model-based reinforcement learning, simulated experiences from the learned model are often treated as equivalent to experience from the real environment. However, when the model is inaccurate, it can catastrophically …

Model-based Reinforcement Learningreinforcement-learningReinforcement Learning

Robust Active Measuring under Model Uncertainty

2023-12-18 · Merlijn Krale, Thiago D. Simão, Jana Tumova, Nils Jansen

Partial observability and uncertainty are common problems in sequential decision-making that particularly impede the use of formal models such as Markov decision processes (MDPs). However, in practice, agents may be able…

Decision MakingmodelSequential Decision Making

Mining Deep And-Or Object Structures via Cost-Sensitive Question-Answer-Based Active Annotations

2017-08-13 · Quanshi Zhang, Ying Nian Wu, Hao Zhang, Song-Chun Zhu

This paper presents a cost-sensitive active Question-Answering (QA) framework for learning a nine-layer And-Or graph (AOG) from web images. The AOG explicitly represents object categories, poses/viewpoints, parts, and de…

Question Answering