Document Type

Article

Publication Date

2024

DOI

10.18564/jasss.5258

Publication Title

Journal of Artificial Societies and Social Simulation

Volume

27

Issue

1

Pages

11 (1-32)

Abstract

Validation is the process of determining if a model adequately represents the system under study for the model’s intended purpose. Validation is a critical component in building the credibility of a simulation model with its end-users. Effectively conducting validation can be a daunting task for both novice and experienced simulation developers. Further compounding the difficult task of conducting validation is that there is no universally accepted approach for assessing a simulation. These challenges are particularly relevant to the paradigm of Agent-Based Modeling and Simulation (ABMS) because of the complexity found in these models’ mechanisms and in the real-world situations they attempt to represent. To aid both the novice and expert in conducting a validation process for an agent-based simulation, this article reviews nine methods that are useful for this process, including foundational topics of docking, empirical validation, sampling, and visualization, as well as advanced topics of bootstrapping, causal analysis, inverse generative social science, and role-playing. Each method is reviewed with respect to its benefits and limitations as a validation-supporting method for ABMS. Suggestions that may support a validation plan for an agent-based simulations, are also provided. This article is an introductory guide for understanding and conducting ABMS validation for developers of all experience levels.

Rights

2021 © JASSS. All rights reserved.

Included with the kind written permission of the copyright holder.

ORCID

0000-0002-8012-2272 (Collins), 0000-0002-4830-7488 (Lynch)

Original Publication Citation

Collins, A., Koehler, M., & Lynch, C. (2024). Methods that support the validation of agent-based models: An overview and discussion. Journal of Artificial Societies and Social Simulation, 27(1), 1-32, Article 11. https://doi.org/10.18564/jasss.5258

Share

COinS