What is it about?

Past work has shown that knowing how accurate forecasters have been in the past is a reliable way to predict who is likely to be accurate in the future. The problem is this requires a time lag. Forecasters must first make predictions, and then those predictions must resolve before they can be scored for accuracy. We show it is possible to evaluate forecasters in real-time based on their actual predictions by comparing them to the aggregate Wisdom of the Crowd.

Featured Image

Why is it important?

Finding analysts who can reliably make accurate predictions can help anticipate real worlds problems. However, until now, evaluating those analysts required asking them to make predictions, and then waiting for their predictions to resolve before their skill could be understood. Our method shows this can be done in real-time, without requiring any knowledge of the outcomes about the events they made predictions about.

Read the Original

This page is a summary of: The wisdom of many in few: Finding individuals who are as wise as the crowd., Journal of Experimental Psychology General, March 2023, American Psychological Association (APA), DOI: 10.1037/xge0001340.
You can read the full text:



The following have contributed to this page