paper-with-me

홈 › Papers

Efficient Calibration of Multi-Agent Simulation Models from Output Series with Bayesian Optimization

2021-12-03 · Yuanlu Bai, Henry Lam, Svitlana Vyetrenko, Tucker Balch

Multi-agent simulation is commonly used across multiple disciplines, specifically in artificial intelligence in recent years, which creates an environment for downstream machine learning or reinforcement learning tasks. In many practical scenarios, however, only the output series that result from the interactions of simulation agents are observable. Therefore, simulators need to be calibrated so that the simulated output series resemble historical -- which amounts to solving a complex simulation optimization problem. In this paper, we propose a simple and efficient framework for calibrating simulator parameters from historical output series observations. First, we consider a novel concept of eligibility set to bypass the potential non-identifiability issue. Second, we generalize the two-sample Kolmogorov-Smirnov (K-S) test with Bonferroni correction to test the similarity between two high-dimensional distributions, which gives a simple yet effective distance metric between the output series sample sets. Third, we suggest using Bayesian optimization (BO) and trust-region BO (TuRBO) to minimize the aforementioned distance metric. Finally, we demonstrate the efficiency of our framework using numerical experiments both on a multi-agent financial market simulator.

📄 PDF Abstract BibTeX arXiv:2112.03874

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian OptimizationTime Series Analysis

Similar Papers 제목 키워드 기반

Alleviating Non-identifiability: a High-fidelity Calibration Objective for Financial Market Simulation with Multivariate Time Series Data

2024-07-23 · ChenKai Wang, Junji Ren, Peng Yang

The non-identifiability issue has been frequently reported in social simulation works, where different parameters of an agent-based simulation model yield indistinguishable simulated time series data under certain discre…

Time Series

Automatic Calibration of Dynamic and Heterogeneous Parameters in Agent-based Model

2019-08-09 · Dongjun Kim, Tae-Sub Yun, Il-Chul Moon

While simulations have been utilized in diverse domains, such as urban growth modeling, market dynamics modeling, etc; some of these applications may require validations based upon some real-world observations modeled in…

Generalized Machine Learning for Fast Calibration of Agent-Based Epidemic Models

2025-09-06 · Sima Najafzadehkhoei, George Vega Yon, Derek S. Meyer, Bernardo Modenesi arxiv

Agent-based models (ABMs) are widely used to study infectious disease dynamics, but their calibration is often computationally intensive, limiting their applicability in time-sensitive public health settings. We propose …

SIM-GAN: Adversarial Calibration of Multi-Agent Market Simulators.

2021-01-01 · Victor Storchan, Svitlana Vyetrenko, Tucker Balch

We look at the problem of how the simulation of a financial market should be configured so that it most accurately emulates the behavior of a real market. In particular, we address agent-based simulations of markets tha…

Automatic Calibration Framework of Agent-Based Models for Dynamic and Heterogeneous Parameters

2022-03-07 · Dongjun Kim, Tae-Sub Yun, Il-Chul Moon, Jang Won Bae

Agent-based models (ABMs) highlight the importance of simulation validation, such as qualitative face validation and quantitative empirical validation. In particular, we focused on quantitative validation by adjusting si…