Taryn Tranquil studies the effects of various chants on blood sugar level. Every week she studies 15 controls and 15 people who chant a particular word from the dictionary for 5 minutes. Her study has a false positive rate of α = and, for the size of effect she's looking for, a power of 1 - β = . Only % of words have a genuine effect on blood sugar.
After 1000 weeks, testing a new word each week, her average results will be:
| Retain null | Reject null | |
|---|---|---|
| Null is true | ||
| Null is false |
This means that, out of the statistically significant results she obtains, % are wrong. Of the statistically insignificant results she obtains, % are wrong.