Document Type
Article
Publication Date
2024
DOI
10.18564/jasss.5258
Publication Title
Journal of Artificial Societies and Social Simulation
Volume
27
Issue
1
Pages
11 (1-32)
Abstract
Validation is the process of determining if a model adequately represents the system under study for the model’s intended purpose. Validation is a critical component in building the credibility of a simulation model with its end-users. Effectively conducting validation can be a daunting task for both novice and experienced simulation developers. Further compounding the difficult task of conducting validation is that there is no universally accepted approach for assessing a simulation. These challenges are particularly relevant to the paradigm of Agent-Based Modeling and Simulation (ABMS) because of the complexity found in these models’ mechanisms and in the real-world situations they attempt to represent. To aid both the novice and expert in conducting a validation process for an agent-based simulation, this article reviews nine methods that are useful for this process, including foundational topics of docking, empirical validation, sampling, and visualization, as well as advanced topics of bootstrapping, causal analysis, inverse generative social science, and role-playing. Each method is reviewed with respect to its benefits and limitations as a validation-supporting method for ABMS. Suggestions that may support a validation plan for an agent-based simulations, are also provided. This article is an introductory guide for understanding and conducting ABMS validation for developers of all experience levels.
Rights
2021 © JASSS. All rights reserved.
Included with the kind written permission of the copyright holder.
ORCID
0000-0002-8012-2272 (Collins), 0000-0002-4830-7488 (Lynch)
Original Publication Citation
Collins, A., Koehler, M., & Lynch, C. (2024). Methods that support the validation of agent-based models: An overview and discussion. Journal of Artificial Societies and Social Simulation, 27(1), 1-32, Article 11. https://doi.org/10.18564/jasss.5258
Repository Citation
Collins, Andrew; Koehler, Matthew; and Lynch, Christopher, "Methods That Support the Validation of Agent-Based Models: An Overview and Discussion" (2024). Engineering Management & Systems Engineering Faculty Publications. 209.
https://digitalcommons.odu.edu/emse_fac_pubs/209