A researcher wants to determine if a new app reduces screen time. She allows users to choose whether to download the app (treatment group) or not (control group). After one month, she compares screen time between the two groups. The primary reason this is not a valid experiment is:
- AThe control group should have received a fake app.
- BThe groups were self-selected, not randomly assigned, so pre-existing differences (confounding) prevent causal conclusions.Correct
- CScreen time cannot be measured accurately.
- DThe study is too short at one month.
Why B is right
Without random assignment, this is an observational study, not an experiment. Users who choose to download the app may already be more motivated to reduce screen time. This self-selection creates confounding — the observed reduction in screen time could be due to user motivation, not the app. Random assignment would have controlled for this.
Why the other 3 choices miss
- A
- A fake app (active placebo) would be an improvement, but the most fundamental flaw is the lack of random assignment, which allows self-selection bias and confounding.
- C
- Screen time can be measured accurately using phone usage statistics. Measurement accuracy is not the primary concern described.
- D
- Duration is a study design choice but is not the fundamental flaw here. Even a one-month experiment can produce valid causal evidence if random assignment is used.