Significance Tests in Climate Science

A large fraction of papers in the climate literature includes erroneous uses of significance tests. A Bayesian analysis is presented to highlight the meaning of significance tests and why typical misuse occurs. It is concluded that a significance test very rarely provides useful quantitative information. The significance statistic is not a quantitative measure of how confident we can be of the ‘reality’ of a given result.