Wk 07. Verification and Validation of Agent-Based Models

Lecture Date: October 2, 2023 - Monday
Lecturer: Dr. Hamdi Kavak

Agent-based models (ABMs) are used in capturing complex interdependent systems based on the interaction between constituent units. The flexibility of such models come with challenges related to model verification and validation. This lecture discusses methodological approaches to verifying and validating ABMs. In addition to common practices, this lecture will delve into recently developed ABM verification and validation techniques, which will be presented by two lucky students (PP 1 and PP 2).

Slides:

Download PDF

Assigned Reading (choose one for your SWA 3):

• Lamperti, F., Roventini, A., & Sani, A. (2018). Agent-based model calibration using machine learning surrogates. Journal of Economic Dynamics and Control, 90, 366-389.
• Paper Presentation 1 (PP 1): Utomo, D. S., Onggo, B. S. S., Eldridge, S., Daud, A. R., & Tejaningsih, S. (2021). Eliciting agents’ behaviour and model validation using role playing game in agent-based dairy supply chain model. Journal of the Operational Research Society, 1-24.

Recommended Reading:

• Epstein, J. M. (2009). Modelling to contain pandemics. Nature, 460(7256), 687-687.
• Gore, R. J., Lynch, C. J., & Kavak, H. (2017). Applying statistical debugging for enhanced trace validation of agent-based models. Simulation, 93(4), 273-284.
• Grimm, V., Railsback, S. F., Vincenot, C. E., Berger, U., Gallagher, C., DeAngelis, D. L., … & Ayllón, D. (2020). The ODD protocol for describing agent-based and other simulation models: A second update to improve clarity, replication, and structural realism. Journal of Artificial Societies and Social Simulation, 23(2).
• Klügl, F. (2008, March). A validation methodology for agent-based simulations. In Proceedings of the 2008 ACM symposium on Applied computing (pp. 39-43).
• Ligtenberg, A., van Lammeren, R. J., Bregt, A. K., & Beulens, A. J. (2010). Validation of an agent-based model for spatial planning: A role-playing approach. Computers, Environment and Urban Systems, 34(5), 424-434.