Research

Would you follow orders from a computer?

Classic obedience studies used a human in charge. I asked whether a computer in charge would get the same compliance.

My role
Author
Status
Master’s thesis, 2019. Preregistered.

Leitao, M. R. (2019). All hail our robot overlords: Obedience to digital authority. Master’s thesis, California State University, Northridge. Preregistered at aspredicted.org #16048.

Main findings

People obeyed a computer about as much as a person

305 adults (217 women, 88 men) took part in a motion-capture task. A human, a standard computer or a sophisticated computer gave the instructions. The key measure was how many actions people completed.

The three groups did not differ reliably (F(2, 302) = 1.31, p = .269). Each group completed about half of the instructions.

p = .269

overall test across three instructors

No reliable difference.

A human instructor drew slightly more compliance, but within chance

Compliance was a little higher for the human than for the computers, at about 16 actions against about 14, read from the thesis figure. The planned tests were not reliable (human against both computers, p = .123).

A more sophisticated computer did not draw more obedience than a basic one (p = .625).

d ≈ .19

human against both computers, derived from t

Small, and not reliable.

Age, gender, income and attitudes toward technology did not change the result

An exploratory model that added age, gender, socioeconomic status and attitudes toward technology showed no reliable effects of those factors.

The evidence

Table 1. Planned comparisons of actions completed

What to look for. No comparison reaches p < .05.

Comparison t (302) p d (derived)
Human against both computers1.549.123.19
Human against basic computer1.093.275.15
Human against sophisticated computer1.585.114.22
Sophisticated against basic computer−0.490.625−.07

t and p are as printed in the thesis. The d values are mine, derived from t with about 101 people per condition.

Size of each difference

What to look for. Every interval crosses zero.

−0.50−0.40−0.30−0.20−0.100.000.100.200.300.400.500.60 Human against both computers Human against basic computer Human against sophisticated computer Sophisticated against basic computer Approximate Cohen’s d

The intervals are approximate, from the standard error equal to the square root of 4 over N plus d squared over 2N.

What this means

A computer got compliance similar to a person. I did not find evidence that people obey a human more than a computer in this task.

Limits. The thesis does not print the group means, so the means I quote are read from its figure and are approximate. A null result with about 100 people per group cannot rule out a small difference.

How this page was made

Test statistics are from the thesis. The effect sizes and intervals are my derivations from those statistics, not values the thesis reports.