Document Type
Article
Publication Date
2024
DOI
10.18564/jasss.5432
Publication Title
Journal of Artificial Societies and Social Simulation
Volume
27
Issue
4
Pages
3
Abstract
We use Monte Carlo techniques to simulate an organized prediction competition between a group of scientific experts acting under the influence of a "self-governing" prediction reward algorithm. Our aim is to illustrate the advantages of a specific type of reward distribution rule that is designed to address some of the limitations of traditional forecast scoring rules. The primary extension of this algorithm as compared with standard forecast scoring is that it incorporates measures of both group consensus and question relevance directly into the reward distribution algorithm. Our model of the prediction competition includes parameters that control both the level of bias from prior beliefs and the influence of the reward incentive. The Monte Carlo simulations demonstrate that, within the simplifying assumptions of the model, experts collectively approach belief in objectively true facts, so long as reward influence is high and the bias stays below a critical threshold. The purpose of this work is to motivate further research into prediction reward algorithms that combine standard forecasting measures with factors like bias and consensus.
Rights
Copyright 2024 © JASSS. All rights reserved.
Included with the kind written permission of the copyright holders and the authors.
Original Publication Citation
Gonzalez-Hernandez, J. O., Marino, J., Rogers, T., & Velasco, B. (2024). Proof of principle for a self-governing prediction and forecasting reward algorithm. Journal of Artificial Societies and Social Simulation, 27(4), 3. https://doi.org/10.18564/jasss.5432
ORCID
0000-0002-0762-0275 (Rogers)
Repository Citation
Gonzalez-Hernandez, Jose Osvaldo; Marino, Jonathan; Rogers, Ted; and Velasco, Brandon, "Proof of Principle for a Self-Governing Prediction and Forecasting Reward Algorithm" (2024). Physics Faculty Publications. 886.
https://digitalcommons.odu.edu/physics_fac_pubs/886
Included in
Other Physics Commons, Quantitative, Qualitative, Comparative, and Historical Methodologies Commons, Science and Technology Policy Commons, Theory and Algorithms Commons