Smartphones undermine social connectedness more in men than women
I pooled eight experiments run over several years into one analysis. The question was whether a phone in view changes how connected and how good people feel in the moment, and whether that depends on the situation or the person.
My role
First author
Status
Published, Technology, Mind, and Behavior, 2024
Leitao, M. R., Proulx, J. D. E., & Kushlev, K. (2024). Smartphones undermine social connectedness more in men than women: A mini mega-analysis. Technology, Mind, and Behavior, 5(1), 15–27. doi:10.1037/tmb0000125
Eight experiments put a phone in view during a short social moment. People then rated how connected they felt. Before you read on, guess how much a phone lowered connection for men and for women.
Drag each slider to your guess. The scale is the drop in standard deviations. Zero is no drop.
Filled dots are the values printed in the paper (Cohen’s d). Hollow dots are your guesses. The paper reports no interval for these two values, so none is drawn.
Why pool eight experiments?
The overall drop across everyone was d = −.18, with a phone against without. Slide the number of people to see how sure a study of that size could be.
Interval: d ± 1.96 × √(4/N + d²/2N), assuming two equal groups. This is my derived approximation, not a printed value. The six situations we pooled had between 130 and 408 people each. Use the buttons to jump to them. All eight experiments together had 1,778.
Main findings
A phone nearby made people feel less connected
I pooled eight experiments, 1,778 people in all, that put a phone in view during a short social moment. The moments included a meal, a wait, and a walk to get directions.
People with a phone felt less connected than people without one (b = −.241, d = −.181). The effect is small and it pointed the same way in all six kinds of situation.
d = −.18
effect of a phone on connectedness
With age and gender in the model, 1,694 people.
The drop was about three times larger for men
Men with a phone felt clearly less connected than men without one (d = −.473). Women showed a smaller drop (d = −.152).
Without phones, men and women felt equally connected (d = −.019). The gender gap appeared only when a phone was present. We had not registered a hypothesis about gender, so I treat this as exploratory.
Men Women
Drop in connectedness, d (sign flipped)
0.5
0.2
Effect of a phone on connectedness, by gender.
Mood fell slightly, except when the phone helped find something
Without the getting-directions experiments, a phone went with lower affect valence, meaning more negative feelings (b = −.105, p = .045, d = −.106). The gender difference was not reliable (p = .169).
In the getting-directions experiments, mood did not fall (b = .18, p = .174). The phone helped people find the building and also cost them a chance to talk to someone, and the two effects may have cancelled out.
d = −.11
effect of a phone on affect valence, without getting directions
1,442 people. Close to the p = .05 line.
Plain-language guide to the terms
Mega-analysis
A pooled analysis that uses the raw data from several studies, not each study’s summary result. That lets us test things no single study could, such as differences by gender. We call ours “mini” because the studies came from one lab, not from a systematic literature search.
Paradigm
A type of situation with the same procedure. Eight experiments became six paradigms, because some were replications and one study manipulated a second variable.
Intent to treat
Everyone counts in the condition they were randomly assigned to, even if they did not follow it. This keeps the comparison fair and makes the effects a little smaller.
Affect valence
How good or bad a person feels, from unpleasant to pleasant. Higher is more pleasant.
Standardized score
A score rescaled within each situation so that the average is 0 and one unit is one standard deviation. This puts different scales on the same footing.
Multilevel model
A regression that allows each situation to have its own baseline and its own phone effect, and then averages across them.
Cohen’s d
The size of a difference in standard deviations. Around .2 is small, .5 medium and .8 large by Cohen’s old rule of thumb.
Interaction
One effect depends on another. Here, the phone effect depends on gender.
What I did
Earlier experiments on phones and well-being each studied one situation. They were also usually too small to ask who is affected most. We had run eight experiments in our own lab, four published (n = 809) and four unpublished (n = 969). I combined the raw data from all of them. Including the unpublished studies guards against publication bias, which favors small studies that found large effects.
The theory behind the work is the displacement, interference and complementarity framework from our review paper. It predicts that phones lower well-being when they interrupt pleasant social time, and can help when they give us information we need right now. We registered two predictions. People with a phone would report lower well-being (H1) and lower social connection (H2) than people without one, in every situation except waiting alone, where there was nobody to interrupt.
Table 1. The eight experiments and six situations
What to look for. Five situations compared phone with no phone. The parenting situation compared more phone use with less.
Situation
Experiments
n
What people did
Getting directions
1 and 2
287
College students looked for an unfamiliar campus building with or without a phone.
Parents with children
3 and 4
408
Parents and guardians visiting a science museum (3) or a children’s festival (4) used their phones a lot or limited them.
Meal with strong ties
5
305
Groups of friends and family ate at a local café. Half kept a phone on the table, half put it away.
Meal with weak ties
6
271
Groups of strangers got to know each other over lunch, with phones on the table or put away.
Waiting alone
7
130
People waited 10 minutes in a room alone, with or without a phone.
Waiting together
7 and 8
377
People waited 10 minutes with a stranger, with or without a phone.
Sample sizes count everyone randomly assigned, whether or not the manipulation worked. All experiments except one were preregistered. From the paper’s Table 1.
Measures and design
Social connectedness combined two items on a 7-point scale, adapted from the Social Connectedness Scale: “I feel close to people” minus “I feel distant from people.” The two items correlated between −.41 and −.59 across experiments.
Affect valence was how often people felt good, positive and pleasant minus bad, negative and unpleasant (reliability α = .85 to .90). The parenting experiments used one overall item instead. Both measures were standardized within each situation before pooling.
Design. People were randomly assigned to phone or no phone (50.1% had a phone). Whole tables and groups shared a condition. The purpose of each study was disguised. We counted everyone as assigned, which is the conservative choice. A sensitivity analysis showed the full sample could detect an effect as small as f² = .007 with 95% power.
Analysis plan. We first asked with ordinary regressions whether the effect differed by situation, then pooled the situations that did not differ. Because six situations are few clusters, we avoided a complex model at that step. We then ran multilevel models with people nested in situations, adding phone condition, then gender and age, then their interaction. Our first registration used ordinary regression throughout. We updated it, before looking at the pooled results, to multilevel models and dropped covariates that were not measured in every study (ethnicity was measured in 1,065 people, phone dependence in 713).
Results: social connectedness
Step 1. Does the effect differ by situation?
No. In the first regression no situation changed the phone effect on connectedness, so I pooled all six. The one interaction that stands out is phone by gender.
Table 2. Does the phone effect on connectedness differ by situation? (ordinary regression)
What to look for. Only Condition × Gender is reliable. None of the situation interactions are.
Effect
b
95% CI
t
Intercept
.01
[−.20, .22]
.09
Age
.00
[−.00, .01]
.93
Condition (phone = 1)
−.14
[−.25, −.02]
−2.33*
Gender (man = 1)
.02
[−.12, .16]
.27
Getting directions
.12
[−.03, .28]
1.54
Strong ties meal
−.09
[−.25, .07]
−1.15
Waiting alone
−.06
[−.26, .15]
−.54
Waiting together
−.03
[−.17, .11]
−.40
Parents with children
.04
[−.13, .20]
.44
Condition × Gender
−.32
[−.52, −.11]
−3.03**
Condition × Getting directions
−.20
[−.41, .01]
−1.88
Condition × Strong ties meal
.16
[−.06, .38]
1.45
Condition × Waiting alone
.11
[−.19, .41]
.73
Condition × Waiting together
.11
[−.08, .30]
1.16
Condition × Parents with children
−.17
[−.36, .02]
−1.79
N = 1,694. Deviation coding compares each situation with the others. Meal with weak ties is the reference. * p < .05, ** p < .01. The interval for the gender row is the one consistent with its t value.
What to look for. Every situation interval crosses zero. The gender interval does not.
Step 2. How big is the effect in each situation?
Connectedness, by situation
What to look for. Every dot sits left of zero. Getting directions and parenting show the largest drops. The pooled estimate is the most precise.
Step 3. The multilevel models
Table 3. Multilevel models of connectedness
What to look for. The phone row stays negative as terms are added. The Condition × Gender row is the new finding.
Effect
Model 1
Model 2
Model 3
Intercept
.13** [.06, .20]
.10 [−.05, .25]
.07 [−.09, .22]
Condition (phone = 1)
−.26*** [−.38, −.14]
−.24*** [−.37, −.11]
−.15* [−.29, −.01]
Gender (man = 1)
−.13* [−.24, −.03]
.02 [−.12, .16]
Age
.00 [−.00, .01]
.00 [−.00, .01]
Condition × Gender
−.31** [−.52, −.11]
Residual variance (σ²)
.98
.94
.94
Variance explained, fixed effects (R²)
.02
.02
.02
Variance explained, whole model (R²)
.02
.02
.03
AIC
4967.41
4741.66
4737.18
People in model
1,756
1,694
1,694
Estimates are b with 95% interval. * p < .05, ** p < .01, *** p < .001. Variation between situations was near zero in every model, so each situation’s own baseline barely mattered. From the paper’s Table 3.
People with a phone were less connected than people without one (phone −.13, no phone .13 on the standardized scale; b = −.259, t(1749) = −4.33, p < .001, d = −.207). Adding gender and age barely changed it (b = −.241, d = −.181). Men reported less connection than women overall (b = −.134, p = .010, d = −.126), and age did not matter (p = .368).
Step 4. Men and women, with and without a phone
Model 3 added the interaction (b = −.313, SE = .103, t(1684) = −3.03, p = .003, d = −.148). The simple effects show where it comes from: the phone effect was larger for men (b = −.461, p < .001, d = −.473) than for women (b = −.148, p = .041, d = −.152). Men and women who had no phone did not differ (b = −.018, p = .799, d = −.019).
Average connectedness, by gender and condition
What to look for. Without phones the two groups sit together. With phones, men’s average falls well below women’s. The paper shows the full distributions as rain plots, which need the raw data. Here I show the printed averages with intervals of 1.96 standard errors.
With phone
Without phone
View as a table
Row
With phone
Without phone
Men
−0.33 [−0.47, −0.19]
0.13 [0.01, 0.25]
Women
−0.04 [−0.13, 0.06]
0.11 [0.01, 0.21]
Effect sizes behind it.
Results: affect valence
Step 1. Does the effect differ by situation?
For mood, one situation stood out: getting directions (Condition × Getting directions, b = .251, p = .024, d = .204). Once I removed that situation, no other interaction was reliable. As registered, I analyzed getting directions separately from the other five.
Table 4. Does the phone effect on affect valence differ by situation? (ordinary regression)
What to look for. Only getting directions departs from the others.
Effect
b
95% CI
t
Intercept
−.09
[−.31, .12]
−.85
Age
.01
[−.00, .01]
1.38
Condition (phone = 1)
−.01
[−.13, .11]
−.21
Gender (man = 1)
−.05
[−.20, .09]
−.71
Getting directions
−.10
[−.26, .06]
−1.22
Strong ties meal
.00
[−.17, .16]
−.03
Waiting alone
.07
[−.14, .28]
.65
Waiting together
.09
[−.06, .23]
1.16
Parents with children
−.07
[−.24, .10]
−.81
Condition × Gender
−.20
[−.41, .01]
−1.88
Condition × Getting directions
.25
[.03, .47]
2.27*
Condition × Strong ties meal
−.07
[−.29, .15]
−.61
Condition × Waiting alone
−.10
[−.40, .21]
−.64
Condition × Waiting together
−.09
[−.29, .10]
−.93
Condition × Parents with children
.00
[−.19, .19]
−.02
N = 1,680. Same coding as Table 2. * p < .05. From the paper’s Table 4.
Affect valence, by situation
What to look for. Five dots sit at or left of zero. Getting directions is the one on the right.
Step 2. Models without getting directions
Table 5. Multilevel models of affect valence, without getting directions
What to look for. The phone effect is small and close to the p = .05 line in the first two models.
Effect
Model 1
Model 2
Model 3
Intercept
.06 [−.02, .13]
.06 [−.10, .23]
.04 [−.12, .21]
Condition (phone = 1)
−.11* [−.21, .00]
−.12* [−.22, −.01]
−.07 [−.20, .06]
Gender (man = 1)
−.19** [−.30, −.07]
−.11 [−.27, .05]
Age
.00 [−.00, .01]
.00 [−.00, .01]
Condition × Gender
−.16 [−.39, .07]
Residual variance (σ²)
.99
.99
.99
Variance explained, whole model (R²)
.00
.01
.01
AIC
4098.84
3996.28
3998.86
People in model
1,442
1,400
1,400
* p < .05, ** p < .01. Variation between situations was zero. From the paper’s Table 5.
People with a phone reported more negative affect (b = −.105, t(1436) = −2.009, p = .045, d = −.106). With gender and age in the model it held (b = −.118, p = .027, d = −.119). Men reported more negative affect than women (b = −.185, p = .002, d = −.171). Age did not matter (p = .461). The interaction with gender was not reliable (b = −.159, p = .169, d = −.074).
Step 3. Getting directions on its own
Table 6. Getting directions only (ordinary regression, results printed in the text)
What to look for. The phone does not change mood. Older students reported feeling better.
Effect
Result
Phone, Model 1
b = .18, SE = .119, t(281) = 1.508, p = .133, d = .180
Phone, Model 2
b = .162, SE = .119, t(276) = 1.362, p = .174, d = .163
Gender, Model 2
b = .009, p = .947
Age, Model 2
b = .059, SE = .024, t(276) = 2.423, p = .016, d = .293
Phone × Gender, Model 3
b = −.519, SE = .270, t(275) = −1.921, p = .056, d = −.231
N = 283, 280 and 280 across the three models.
What this means
Phones cost connection even in unpublished studies. Pooling the nonsignificant studies did not erase the effect. It is small (d from −.15 to −.21 in the models), but small effects can add up. A person who is a little less connected at every meal and wait could notice the difference over a day.
The waiting-alone result was not what we predicted. We expected no phone cost when nobody else was there. The effect was not reliably different, and a phone did not make waiting alone feel better either. Our one nonsocial situation cannot settle this.
Mood depends on what the phone is for. Phones lowered affect valence when they competed with people. They did not when the phone served a current goal. The published getting-directions study found two paths that point in opposite directions: finding the building faster felt good, and feeling less connected felt bad. A null main effect is consistent with those two cancelling.
Why men? We did not test the reasons. The paper lists four candidates. Men may use phones more in social settings, though earlier research suggests women use phones more. Men may be more distractible, though earlier research finds no gender gap in attention. Women may follow stricter norms about phones in company. Or women may use phones in more social ways, such as messaging. Each could be tested by measuring how people use their phones during a conversation.
Limits. The samples were mostly college-aged people from British Columbia, and most situations were pleasant social ones. Taking a phone away may add confounds. We analyzed data we had already seen, so our registered plans could have been shaped by that. The gender result was not registered and needs a new, confirmatory test. We kept everyone as randomly assigned, which makes the effect for people who actually followed instructions a little larger than the numbers here.
How this page was made
Every coefficient and test comes from the printed paper. The paper’s data, code and materials are public on OSF, including the supplemental tables and the preregistrations. I have not re-run the models on the raw data.
For the by-situation forest plots, I derived each 95% interval from the group size, with the standard error equal to the square root of 4 over N plus d squared over 2N. The same approach reproduces the paper’s own forest plot. The gender averages carry intervals of 1.96 standard errors from the printed standard errors. The paper’s Table 6 is partly garbled in my copy, so I used the values the text prints. The rain plots in the paper’s Figure 2 need the individual data, so I show the averages instead.