Skip to content
AP Statistics · Exploring One-Variable Data and Collecting Data

Bias

Bias appears in 26 reviewed AP Statistics questions and sits in Exploring One-Variable Data and Collecting Data. Below are worked examples showing exactly how the exam tests it, with the answer marked and every distractor explained.

How Bias is tested

Example 1Easier
A national poll asks: 'Do you support the reckless policy that wastes billions of taxpayer dollars on foreign aid?' This question is an example of:
  1. AUndercoverage, because foreign aid recipients are not included.
  2. BResponse bias due to question wording, because the loaded language ('reckless,' 'wastes') influences respondents toward a particular answer.Correct
  3. CSampling frame bias, because not all voters were included.
  4. DNonresponse bias, because some people may refuse to answer.

Why B is right

Using emotionally charged or leading language like 'reckless' and 'wastes billions' frames the question negatively and pushes respondents to oppose the policy. This is response bias due to question wording (also called leading question bias), which produces results that do not reflect the population's true opinions.
Why the other 3 choices miss
A
Undercoverage is a sampling problem where some groups have no chance of being selected. The issue here is the question's language, not who is sampled.
C
Sampling frame bias occurs when the list used to draw the sample excludes parts of the target population. The question's issue is its wording, not who is on the sampling list.
D
Nonresponse bias occurs when people chosen for the sample don't respond. The question's problem is about those who do respond being influenced by the wording.
Example 2Medium
A researcher studying high school students' social media use defines the target population as 'all high school students in the state.' However, the sampling frame is a list of students enrolled in schools that subscribe to the state education database. What potential problem exists?
  1. AUsing a database list creates voluntary response bias.
  2. BThe sampling frame and the target population are identical, so there is no coverage problem.
  3. CThe sampling frame may omit students at non-subscribing schools, causing undercoverage.Correct
  4. DSystematic sampling cannot be applied to a database list.

Why C is right

The sampling frame (enrolled students in subscribed schools) does not perfectly match the target population (all high school students in the state). Students in non-subscribing schools — potentially private schools, alternative schools, or homeschooled students — are excluded from the sampling frame, creating undercoverage. This can lead to biased results if the excluded group differs from the included group.
Why the other 3 choices miss
A
Voluntary response bias occurs when individuals choose whether to participate. Using a database list for sampling does not create voluntary response bias — individuals don't choose to be on the list.
B
The target population includes all high school students, while the sampling frame includes only those in subscribed schools. These are not identical, and the discrepancy is a real methodological concern.
D
Systematic sampling can absolutely be applied to a database list. The issue here is the incompleteness of the list relative to the target population.
Example 3Medium
A high school has 2,000 students. The student council wants to estimate p, the proportion of all students at the school who support a later start time. Two data collection plans are proposed. Plan I: Select a simple random sample of 150 students from the school roster and ask each selected student the question. Plan II: Post the question on the school website and use the first 400 students who respond. The sample proportion p-hat from each plan will be used to estimate p. Which plan should the council use, and why?
  1. APlan I, because 400 is more than 10% of the 2,000 students, and that makes the p-hat from Plan II a biased estimator of p.
  2. BPlan I, because random selection makes p-hat an unbiased estimator of p; Plan II has less variability but is likely biased by voluntary response.Correct
  3. CNeither plan, because p-hat is an unbiased estimator of p only after the large counts condition is checked.
  4. DPlan II, because with 400 responses p-hat varies less from sample to sample, so it will be closer to p than Plan I.

Why B is right

p-hat is an unbiased estimator of p, meaning the center of its sampling distribution equals p, only when the data come from a random sample. Plan I meets that condition. Plan II is a voluntary response sample: students with strong opinions are more likely to respond, so its p-hat may be systematically too high or too low. Plan II's larger sample does lower the variability of p-hat, but a larger sample does not remove bias, so Plan I gives the better estimator.
Why the other 3 choices miss
A
Misuses the 10% condition. 400/2000 = 20% does break that condition, but the condition only controls whether the formula sqrt(p(1-p)/n) is accurate for the standard deviation. Sampling more than 10% does not make p-hat biased. Plan II's bias comes from voluntary response.
C
Mixes up the conditions: large counts (np >= 10 and n(1-p) >= 10) decides whether the sampling distribution is approximately normal. It has nothing to do with whether p-hat is unbiased, which depends on random sampling.
D
Mixes up variability with bias: a larger sample makes p-hat vary less, but a precise estimate from a biased method still centers on the wrong value, so being less variable does not mean it is closer to p.

Studied alongside

Other concepts from Exploring One-Variable Data and Collecting Data.