Skip to content
AP Psychology · Cognition

Sampling bias

Sampling bias appears in 5 reviewed AP Psychology questions and sits in Cognition. Below are worked examples showing exactly how the exam tests it, with the answer marked and every distractor explained.

Sampling bias occurs when the people in a study do not represent the population the researcher wants to describe. Because the sample differs in a systematic way, the results cannot be generalized to the whole population.

Why it matters

Every research conclusion depends on who was studied, and AP Psychology tests research methods inside every unit, including Cognition. Random sampling is the fix, because it gives every member of the population an equal chance of being chosen.

How the exam tests it

Stems describe a flawed survey, such as one where only 200 of 1,000 adults answer an e-mail about memory lapses. There the keyed answer is the more specific self-selection (volunteer) bias, because the respondents chose themselves. You must name that type and explain why the results cannot be generalized.

Don’t confuse it with

Students confuse it with a confounding variable, but sampling bias is about who is in the study and affects generalization, while a confound is a second variable that differs between groups and affects whether the IV caused the result.

Sampling bias in real questions

Example 1Medium
A researcher studying memory retrieval e-mails a one-time online survey to 1,000 adults asking how often they experience the tip-of-the-tongue phenomenon, in which a known word temporarily cannot be retrieved. Only 200 people complete it, and those who do report far more frequent tip-of-the-tongue lapses than is typical. Which type of bias is MOST illustrated here?
  1. AAttrition bias, because a large share of participants dropped out over the course of a longitudinal memory study
  2. BSocial desirability bias, because respondents wanted to appear to have better memories than they actually do
  3. CObserver bias, because the researcher's expectations about memory lapses influenced which participants chose to respond
  4. DSelf-selection bias, because the people who chose to respond likely differ in how often they have memory lapsesCorrect

Why D is right

This is self-selection (volunteer) bias: when participants decide for themselves whether to take part, those who volunteer can differ systematically from those who do not. People who often have tip-of-the-tongue experiences, a retrieval failure studied in the memory topics of Unit 2 (Cognition), are likely more interested in a survey about them, so the 200 respondents overrepresent frequent sufferers. The results therefore cannot be generalized to the whole population of 1,000 adults, much less to adults in general.
Why the other 3 choices miss
A
Incorrect because attrition bias involves participants dropping out partway through a study that follows them over time; this was a single, one-time survey, and the problem is who chose to respond at all, not who quit later.
B
Incorrect because social desirability bias would push respondents to under-report memory lapses to look capable; here respondents reported unusually many lapses, and the issue is who responded, not how they slanted their answers.
C
Incorrect because observer bias occurs when a researcher's expectations distort how data are recorded or interpreted; the researcher did not choose the respondents, the respondents chose themselves.

Studied alongside

Other concepts from Cognition.