Skip to content
AP Statistics · Inference for Categorical Data: Proportions

type I error

type I error appears in 28 reviewed AP Statistics questions and sits in Inference for Categorical Data: Proportions. Below are worked examples showing exactly how the exam tests it, with the answer marked and every distractor explained.

How type I error is tested

Example 1Easier
In a study examining whether a new fertilizer increases crop yield, the null hypothesis is H0: the new fertilizer has no effect on yield. A Type I error in this context would be:
  1. AUsing too small a sample size to detect a real effect.
  2. BApplying the fertilizer to the wrong type of crop.
  3. CConcluding the fertilizer has no effect when it actually does.
  4. DConcluding the fertilizer increases yield when it actually has no effect.Correct

Why D is right

A Type I error (false positive) is rejecting the null hypothesis when it is actually true. Here, the null hypothesis is that the fertilizer has no effect. A Type I error means concluding that the fertilizer works (rejecting H0) when in reality it has no effect on yield.
Why the other 3 choices miss
A
Using too small a sample size to detect a real effect relates to low statistical power, which increases the probability of a Type II error, not a Type I error.
B
Applying the fertilizer to the wrong crop is an experimental design error, not a Type I error in hypothesis testing.
C
Concluding the fertilizer has no effect when it actually does is a Type II error (false negative) — failing to reject H0 when H0 is false.
Example 2Medium
A significance level of α = 0.05 in hypothesis testing means:
  1. AThe probability the null hypothesis is true is 5%.
  2. BThere is a 5% chance of rejecting a null hypothesis that is true.Correct
  3. COnly 5% of experiments conducted at this level will produce correct results.
  4. DThe study has a 95% probability of detecting a real effect if one exists.

Why B is right

The significance level α is the probability of committing a Type I error — rejecting the null hypothesis when it is actually true. Setting α = 0.05 means the researcher accepts a 5% chance of a false positive (incorrectly concluding there is an effect when there is none).
Why the other 3 choices miss
A
The significance level is not a statement about the probability that H0 is true. That would require prior probabilities and Bayesian reasoning. Alpha is the long-run false positive rate under the frequentist framework.
C
The significance level has nothing to do with the proportion of experiments producing correct results. It specifically controls the false positive rate.
D
The probability of detecting a real effect is statistical power (1 - β), not α. Power depends on α, the effect size, and the sample size, but α alone does not determine power.
Example 3Harder
A researcher conducts 20 separate hypothesis tests at α = 0.05, all testing true null hypotheses (no real effects exist). On average, how many of these tests will produce statistically significant results?
  1. A0
  2. B1Correct
  3. C10
  4. D20

Why B is right

With α = 0.05 and all null hypotheses true, each test has a 5% probability of producing a false positive (Type I error). Over 20 tests, the expected number of false positives = 20 × 0.05 = 1. This illustrates the problem of multiple comparisons: running many tests inflates the overall chance of at least one false positive.
Why the other 3 choices miss
A
With a 5% error rate per test, we expect some false positives. Expecting zero false positives over 20 tests ignores the Type I error rate.
C
10 would correspond to a 50% Type I error rate per test, far above α = 0.05.
D
If all 20 tests produced significant results despite true nulls, that would mean the Type I error rate is 100%, not 5%. This contradicts the definition of α.

Studied alongside

Other concepts from Inference for Categorical Data: Proportions.