Skip to content
AP Statistics · Inference for Categorical Data: Proportions

Common mistakes

Common mistakes appears in 3 reviewed AP Statistics questions and sits in Inference for Categorical Data: Proportions. Below are worked examples showing exactly how the exam tests it, with the answer marked and every distractor explained.

How Common mistakes is tested

Example 1Medium
In a hypothesis test, a researcher obtains a p-value of 0.03. She reports: "There is a 3% chance that the null hypothesis is true." What is wrong with this interpretation?
  1. AThe p-value should be compared to alpha, not interpreted as a probability
  2. BA p-value of 0.03 is not statistically significant
  3. CNothing; this is a correct interpretation of the p-value
  4. DThe p-value is the probability of observing data as extreme as (or more extreme than) the sample data, given that the null hypothesis is true — not the probability that H0 is trueCorrect

Why D is right

The p-value is the probability of obtaining a test statistic as extreme as the observed value, assuming H0 is true. It is NOT the probability that H0 is true. The null hypothesis is either true or false; the p-value quantifies the strength of evidence against H0, not the probability of H0 being true.
Why the other 3 choices miss
A
Incorrect because the p-value is indeed a probability and can be interpreted, but it must be interpreted correctly as described in the correct answer.
B
Incorrect because 0.03 < 0.05, making it statistically significant at the conventional alpha = 0.05 level.
C
Incorrect because this is one of the most common misinterpretations of p-values.

Studied alongside

Other concepts from Inference for Categorical Data: Proportions.