Goodness of Fit Metrics in Comparing Models to Data

Christian D. Schunn


Computational and mathematical models, in addition to providing a method for demonstrating qualitative predictions resulting from interacting mechanisms, provide quantitative predictions that can be used to discriminate between alternative models and uncover which aspects of a given theoretical framework require further elaboration. Unfortunately, there are no formal standards for how to evaluate the quantitative goodness-of-fit of models to data, either visually or numerically. As a result, there is considerable variability in methods used, with frequent selection of choices that misinform the reader. While there are some subtle and perhaps controversial issues involved in the evaluation of goodness-of-fit, there are many simple conventions that are quite uncontroversial and should be adopted now. We review various kinds of visual display techniques and numerical measures of goodness-of-fit, setting new standards for the selection and use of such displays and measures.


 

 

 


Last updated: 9/26/05

Return to CDS home page