A framework to analyze opinion formation models

Comparing model predictions with real data is crucial to improve and validate a model. For opinion formation models, validation based on real data is uncommon and difficult to obtain, also due to the lack of systematic approaches for a meaningful comparison. We introduce a framework to assess opinion formation models, which can be used to determine the qualitative outcomes that an opinion formation model can produce, and compare model predictions with real data. The proposed approach relies on a histogram-based classification algorithm, and on transition tables. The algorithm classifies an opinion distribution as perfect consensus, consensus, polarization, clustering, or dissensus; these qualitative categories were identified from World Values Survey data. The transition tables capture the qualitative evolution of the opinion distribution between an initial and a final time. We compute the real transition tables based on World Values Survey data from different years, as well as the predicted transition tables produced by the French-DeGroot, Weighted-Median, Bounded Confidence, and Quantum Game models, and we compare them. Our results provide insight into the evolution of real-life opinions and highlight key directions to improve opinion formation models.