We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Statistical Methods for Linguistic Research: Foundational Ideas - Part I.
- Authors
Vasishth, Shravan; Nicenboim, Bruno
- Abstract
We present the fundamental ideas underlying statistical hypothesis testing using the frequentist framework. We start with a simple example that builds up the one-sample t-test from the beginning, explaining important concepts such as the sampling distribution of the sample mean, and the iid assumption. Then, we examine the meaning of the p-value in detail and discuss several important misconceptions about what a p-value does and does not tell us. This leads to a discussion of Type I, II error and power, and Type S and M error. An important conclusion from this discussion is that one should aim to carry out appropriately powered studies. Next, we discuss two common issues that we have encountered in psycholinguistics and linguistics: running experiments until significance is reached and the 'garden-of-forking-paths' problem discussed by Gelman and others. The best way to use frequentist methods is to run appropriately powered studies, check model assumptions, clearly separate exploratory data analysis from planned comparisons decided upon before the study was run, and always attempt to replicate results.
- Subjects
STATISTICAL hypothesis testing; PSYCHOLINGUISTIC ability testing; SYNTAX (Grammar); SEMANTICS; PRAGMATICS
- Publication
Language & Linguistics Compass, 2016, Vol 10, Issue 8, p349
- ISSN
1749-818X
- Publication type
Article
- DOI
10.1111/lnc3.12201