In a hypothesis test, a researcher obtains a p-value of 0.03. She reports: "There is a 3% chance that the null hypothesis is true." What is wrong with this interpretation?
- AThe p-value should be compared to alpha, not interpreted as a probability
- BA p-value of 0.03 is not statistically significant
- CNothing; this is a correct interpretation of the p-value
- DThe p-value is the probability of observing data as extreme as (or more extreme than) the sample data, given that the null hypothesis is true — not the probability that H0 is trueCorrect
Why D is right
The p-value is the probability of obtaining a test statistic as extreme as the observed value, assuming H0 is true. It is NOT the probability that H0 is true. The null hypothesis is either true or false; the p-value quantifies the strength of evidence against H0, not the probability of H0 being true.
Why the other 3 choices miss
- A
- Incorrect because the p-value is indeed a probability and can be interpreted, but it must be interpreted correctly as described in the correct answer.
- B
- Incorrect because 0.03 < 0.05, making it statistically significant at the conventional alpha = 0.05 level.
- C
- Incorrect because this is one of the most common misinterpretations of p-values.