A national poll asks: 'Do you support the reckless policy that wastes billions of taxpayer dollars on foreign aid?' This question is an example of:
- AUndercoverage, because foreign aid recipients are not included.
- BResponse bias due to question wording, because the loaded language ('reckless,' 'wastes') influences respondents toward a particular answer.Correct
- CSampling frame bias, because not all voters were included.
- DNonresponse bias, because some people may refuse to answer.
Why B is right
Using emotionally charged or leading language like 'reckless' and 'wastes billions' frames the question negatively and pushes respondents to oppose the policy. This is response bias due to question wording (also called leading question bias), which produces results that do not reflect the population's true opinions.
Why the other 3 choices miss
- A
- Undercoverage is a sampling problem where some groups have no chance of being selected. The issue here is the question's language, not who is sampled.
- C
- Sampling frame bias occurs when the list used to draw the sample excludes parts of the target population. The question's issue is its wording, not who is on the sampling list.
- D
- Nonresponse bias occurs when people chosen for the sample don't respond. The question's problem is about those who do respond being influenced by the wording.
In a study on the effectiveness of a new ergonomic keyboard in reducing wrist pain, a researcher randomly assigns office workers to use the new keyboard or their standard keyboard for 8 weeks. At the end of the study, workers complete a self-report pain survey. Which aspect of this design could MOST limit the validity of the pain measurements?
- AThe random assignment to keyboard type.
- BDemand characteristics: participants who know they have the 'new' ergonomic keyboard may report less pain because they expect improvement.Correct
- CThe use of self-report rather than physiological pain measurement.
- DThe 8-week study duration.
Why B is right
Demand characteristics occur when participants' knowledge of the study's purpose or their treatment condition influences their responses. Workers who know they have the new 'ergonomic' keyboard may expect it to help and therefore report less pain than they truly experience, inflating the apparent effectiveness of the keyboard. Blinding (not telling workers which keyboard is 'ergonomic') would reduce this bias.
Why the other 3 choices miss
- A
- Random assignment is a strength of the design — it controls for confounding. It does not limit measurement validity.
- C
- While self-report has limitations, demand characteristics are a more specific and direct threat to validity in this context, because participants' expectations about the treatment directly influence their self-reports.
- D
- 8 weeks may or may not be long enough, but duration does not directly introduce measurement bias in the same specific way as demand characteristics.
A company surveys employees to understand job satisfaction. The survey uses a 10-question instrument, and at the end it asks employees to submit their responses in a sealed envelope to be opened by an external analyst. What feature of this design reduces what type of bias?
- AConfidentiality reduces response bias, since employees answer more honestly when they know supervisors cannot identify their individual answers.Correct
- BConfidentiality prevents undercoverage by ensuring every department in the company is included in the sample.
- CConfidentiality reduces voluntary response bias by making participation in the survey mandatory for all employees.
- DConfidentiality eliminates nonresponse bias by encouraging every selected employee to return a completed survey, so no one is left out of the results.
Why A is right
When employees know their responses are confidential (not traceable to them individually), they are more likely to answer honestly about dissatisfaction or criticism of management without fear of retaliation. This reduces social desirability bias — the tendency to give favorable or politically safe answers — which is a type of response bias.
Why the other 3 choices miss
- B
- Incorrect because undercoverage is about missing groups in the sampling frame, not about whether responses are confidential. Confidentiality addresses accuracy of responses, not who is included in the sample.
- C
- Incorrect because confidentiality does not make participation mandatory. Voluntary response bias involves self-selection into an open survey; confidentiality affects answer honesty, not whether participation is voluntary.
- D
- Incorrect because confidentiality may increase response rates but does not eliminate nonresponse bias (some people still won't respond). Nonresponse bias depends on who doesn't respond, and confidentiality doesn't guarantee all non-responders will participate.