Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: a scoping review

Lee, G. Y. and Hickie, I. B. and Occhipinti, J. A. and Song, Y. J. C. and Skinner, A. and Camacho, S. and Lawson, K. and Hilber, A. M. and Freebairn, L.. (2022) Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: a scoping review. PLoS One, 17 (4). e0266125.

[img] PDF - Published Version
Available under License CC BY (Attribution).


Official URL: https://edoc.unibas.ch/90608/

Downloads: Statistics Overview


INTRODUCTION: Systems modelling and simulation can improve understanding of complex systems to support decision making, better managing system challenges. Advances in technology have facilitated accessibility of modelling by diverse stakeholders, allowing them to engage with and contribute to the development of systems models (participatory modelling). However, despite its increasing applications across a range of disciplines, there is a growing need to improve evaluation efforts to effectively report on the quality, importance, and value of participatory modelling. This paper aims to identify and assess evaluation frameworks, criteria, and/or processes, as well as to synthesize the findings into a comprehensive multi-scale framework for participatory modelling programs. MATERIALS AND METHODS: A scoping review approach was utilized, which involved a systematic literature search via Scopus in consultation with experts to identify and appraise records that described an evaluation framework, criteria, and/or process in the context of participatory modelling. This scoping review is registered with the Open Science Framework. RESULTS: The review identified 11 studies, which varied in evaluation purposes, terminologies, levels of examination, and time points. The review of studies highlighted areas of overlap and opportunities for further development, which prompted the development of a comprehensive multi-scale evaluation framework to assess participatory modelling programs across disciplines and systems modelling methods. The framework consists of four categories (Feasibility, Value, Change/Action, Sustainability) with 30 evaluation criteria, broken down across project-, individual-, group- and system-level impacts. DISCUSSION & CONCLUSION: The presented novel framework brings together a significant knowledge base into a flexible, cross-sectoral evaluation effort that considers the whole participatory modelling process. Developed through the rigorous synthesis of multidisciplinary expertise from existing studies, the application of the framework can provide the opportunity to understand practical future implications such as which aspects are particularly important for policy decisions, community learning, and the ongoing improvement of participatory modelling methods.
Faculties and Departments:09 Associated Institutions > Swiss Tropical and Public Health Institute (Swiss TPH)
09 Associated Institutions > Swiss Tropical and Public Health Institute (Swiss TPH) > Department of Swiss Centre for International Health (SCIH) > Systems Performance and Monitoring (Pham-Tan)
UniBasel Contributors:Camacho, Salvador
Item Type:Article, refereed
Article Subtype:Research Article
ISSN:1932-6203 (Electronic)1932-6203 (Linking)
Note:Publication type according to Uni Basel Research Database: Journal article
Related URLs:
Identification Number:
edoc DOI:
Last Modified:27 Dec 2022 11:08
Deposited On:27 Dec 2022 11:08

Repository Staff Only: item control page