Better P-Curves: Making p-curve analysis more robust to errors, fraud, and ambitious p-hacking, a reply to Ulrich and Miller (2015)

Uri Simonsohn, Joseph P. Simmons, Leif D. Nelson

Producció científica: Article en revista indexadaArticleAvaluat per experts

186 Cites (Scopus)

Resum

When studies examine true effects, they generate right-skewed p-curves, distributions of statistically significant results ith more low (.01 s) than high (.04 s) p values. What else can cause a right-skewed p-curve? First, we consider the possibility hat researchers report only the smallest significant p value (as conjectured by Ulrich & Miller, 2015), concluding that it is a ery uncommon problem. We then consider more common problems, including (a) p-curvers selecting the wrong p values, (b) fake data, c) honest errors, and (d) ambitiously p-hacked (beyond p = .05) results. We evaluate the impact of these common problems on the alidity of p-curve analysis, and provide practical solutions that substantially increase its robustness.

Idioma originalAnglès
Pàgines (de-a)1146-1152
Nombre de pàgines7
RevistaJournal of Experimental Psychology: General
Volum144
Número6
DOIs
Estat de la publicacióPublicada - 1 de des. 2015
Publicat externament

Fingerprint

Navegar pels temes de recerca de 'Better P-Curves: Making p-curve analysis more robust to errors, fraud, and ambitious p-hacking, a reply to Ulrich and Miller (2015)'. Junts formen un fingerprint únic.

Com citar-ho