We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics: Comment.
- Authors
Kranz, Sebastian; PÜtz, Peter
- Abstract
Brodeur, Cook, and Heyes (2020) study hypothesis tests from economic articles and find evidence for p-hacking and publication bias, in particular for instrumental variable and difference-in-difference studies. When adjusting for rounding errors (introducing a novel method), statistical evidence for p-hacking from randomization tests and caliper tests at the 5 percent significance threshold vanishes for difference-in-differnce studies but remains for instrumental variable studies. Results at the 1 percent and 10 percent significance thresholds remain largely similar. In addition, Brodeur, Cook, and Heyes derive latent distributions of z-statistics absent publication bias using two different approaches. We establish for each approach a result that challenges its applicability. (JEL A14, C12, C52)
- Subjects
PUBLICATION bias; CALIPERS
- Publication
American Economic Review, 2022, Vol 112, Issue 9, p3124
- ISSN
0002-8282
- Publication type
Article
- DOI
10.1257/aer.20210121