Judging Judgment

Bruce Bueno De Mesquita

    Research output: Contribution to journalArticle

    Abstract

    Philip E. Tetlock and I agree that forecasting tools are best evaluated in peer-reviewed settings and in comparison not only to expert judgments, but also to alternative modeling strategies. Applying his suggested standards of assessment, however, certain forecasting models not only outperform expert judgments, but also have gone head-to-head with alternative models and outperformed them. This track record demonstrates the capability to make significant, reliable predictions of difficult, complex events. The record has unfolded, contrary to Tetlock's contention, not only in government and business applications, but also in numerous peer-reviewed publications containing hundreds of real-time forecasts. Moreover, reliable prediction is achieved while avoiding significant false-positive or false-negative rates.

    Original languageEnglish (US)
    Pages (from-to)355-388
    Number of pages34
    JournalCritical Review
    Volume22
    Issue number4
    DOIs
    StatePublished - Dec 2010

    Fingerprint

    expert
    event
    Prediction
    Peers
    time
    Modeling
    Government

    ASJC Scopus subject areas

    • Political Science and International Relations
    • Literature and Literary Theory

    Cite this

    Bueno De Mesquita, B. (2010). Judging Judgment. Critical Review, 22(4), 355-388. https://doi.org/10.1080/08913811.2010.541686

    Judging Judgment. / Bueno De Mesquita, Bruce.

    In: Critical Review, Vol. 22, No. 4, 12.2010, p. 355-388.

    Research output: Contribution to journalArticle

    Bueno De Mesquita, B 2010, 'Judging Judgment', Critical Review, vol. 22, no. 4, pp. 355-388. https://doi.org/10.1080/08913811.2010.541686
    Bueno De Mesquita, Bruce. / Judging Judgment. In: Critical Review. 2010 ; Vol. 22, No. 4. pp. 355-388.
    @article{9bf7cf84a4cd4df89b1055bd6102d18e,
    title = "Judging Judgment",
    abstract = "Philip E. Tetlock and I agree that forecasting tools are best evaluated in peer-reviewed settings and in comparison not only to expert judgments, but also to alternative modeling strategies. Applying his suggested standards of assessment, however, certain forecasting models not only outperform expert judgments, but also have gone head-to-head with alternative models and outperformed them. This track record demonstrates the capability to make significant, reliable predictions of difficult, complex events. The record has unfolded, contrary to Tetlock's contention, not only in government and business applications, but also in numerous peer-reviewed publications containing hundreds of real-time forecasts. Moreover, reliable prediction is achieved while avoiding significant false-positive or false-negative rates.",
    author = "{Bueno De Mesquita}, Bruce",
    year = "2010",
    month = "12",
    doi = "10.1080/08913811.2010.541686",
    language = "English (US)",
    volume = "22",
    pages = "355--388",
    journal = "Critical Review",
    issn = "0891-3811",
    publisher = "Routledge",
    number = "4",

    }

    TY - JOUR

    T1 - Judging Judgment

    AU - Bueno De Mesquita, Bruce

    PY - 2010/12

    Y1 - 2010/12

    N2 - Philip E. Tetlock and I agree that forecasting tools are best evaluated in peer-reviewed settings and in comparison not only to expert judgments, but also to alternative modeling strategies. Applying his suggested standards of assessment, however, certain forecasting models not only outperform expert judgments, but also have gone head-to-head with alternative models and outperformed them. This track record demonstrates the capability to make significant, reliable predictions of difficult, complex events. The record has unfolded, contrary to Tetlock's contention, not only in government and business applications, but also in numerous peer-reviewed publications containing hundreds of real-time forecasts. Moreover, reliable prediction is achieved while avoiding significant false-positive or false-negative rates.

    AB - Philip E. Tetlock and I agree that forecasting tools are best evaluated in peer-reviewed settings and in comparison not only to expert judgments, but also to alternative modeling strategies. Applying his suggested standards of assessment, however, certain forecasting models not only outperform expert judgments, but also have gone head-to-head with alternative models and outperformed them. This track record demonstrates the capability to make significant, reliable predictions of difficult, complex events. The record has unfolded, contrary to Tetlock's contention, not only in government and business applications, but also in numerous peer-reviewed publications containing hundreds of real-time forecasts. Moreover, reliable prediction is achieved while avoiding significant false-positive or false-negative rates.

    UR - http://www.scopus.com/inward/record.url?scp=82455253900&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=82455253900&partnerID=8YFLogxK

    U2 - 10.1080/08913811.2010.541686

    DO - 10.1080/08913811.2010.541686

    M3 - Article

    AN - SCOPUS:82455253900

    VL - 22

    SP - 355

    EP - 388

    JO - Critical Review

    JF - Critical Review

    SN - 0891-3811

    IS - 4

    ER -