Send station · the claim, dispatched
Observer-Expectancy Effect
The observer-expectancy effect occurs when an observer's preconceived expectations unconsciously influence their interactions with subjects or interpretation of data, causing results to align with those expectations.
Supports
The bias files watch for researchers or evaluators who interact differently with subjects based on their expectations as confirmation.
Rosenthal & Jacobson Pygmalion classroom study
First and second graders in the 'bloomer' group showed significantly greater IQ gains than controls
n≈650
Raudenbush meta-analysis of teacher expectancy
Teacher expectancy effects on IQ were d ~ 0
n≈18
Refutes / corrects
Rosenthal & Fode rat experiment
Rats labeled 'bright' averaged 2
d=.70 · n≈12
In the wild
Clever Hans the horse (Pfungst, 1907)
Clever Hans appeared to perform arithmetic by tapping his hoof
1907
Drug-sniffing dog false positives
A University of California
2011
Synchrony-prosociality research bias
A 2023 meta-analysis found that when experiments on interpersonal synchrony and prosociality used non-naive experimente…
2023
Dispatch log · replication contested. The basic experimenter expectancy effect on animal behavior has replicated broadly. Rosenthal & Rubin (1978) estimated d = .70 across 345 studies in eight domains. However, the Pygmalion classroom findings proved difficult to replicate. Raudenbush's 1984 meta-analysis found effects only when expectancies were induced early. Jussim & Harber's 2005 review found effects are typically small (r = 0.1-0.2), may be more likely to dissipate than accumulate, and that teacher expectations predict outcomes more through accuracy than self-fulfilling influence. Thorndike (1968) harshly criticized the original Pygmalion study's methodology.
Pressure diagram · why it sorts this way
Observer-expectancy effects operate through multiple channels: (1) subtle nonverbal and paralinguistic cues (tone, facial expressions, body language) that communicate expectations to subjects; (2) selective attention and interpretation of ambiguous data to confirm expectations; (3) differential treatment (more encouragement, attention, challenging material) toward expected high-performers. In Rosenthal's rat studies, experimenters who expected bright rats handled them more and more gently, mediating the performance difference.
Some researchers argue that teacher expectations primarily reflect accurate assessments of student ability rather than creating self-fulfilling prophecies. Jussim & Harber (2005) found that ~75% of the predictive validity of teacher expectations reflects accuracy, with only ~25% attributable to self-fulfilling prophecy.
Manual override
Use double-blind designs where neither participants nor experimenters know condition assignments. Standardize protocols to minimize subjective interactions. Automate data collection where possible.
Meta-analytic evidence shows that experimenter expectancy effects diminish substantially when experimenters are naive to hypotheses or conditions. The synchrony-prosociality literature found effects were not distinguishable from zero when only naïve experimenters were included.
Adjacent stations
- Pygmalion effectThe Pygmalion effect is a specific instance of observer-expectancy effect in educational settings, where teacher expectations influence student performance.
- Confirmation biasConfirmation bias involves seeking information that confirms existing beliefs; observer-expectancy effect specifically involves expectations influencing the observation process and subject behavior.
- Demand characteristicsDemand characteristics are cues that signal the experimenter's hypothesis to participants; they mediate the observer-expectancy effect by giving participants information about expected behavior.