MedicinemedRxiv
Heuristic editor, no API keyVerdict: NotableDigital wellbeing in the social media era: dual pathway analysis of emotional and behavioural distress indicators and public health utility
Social media language and digital lifestyle behaviours are promoted as scalable signals of population mental health, but predictive models are often evaluated in ways that overstate accuracy.
Key numbers
- 95% confidence interval 0.505 to
- 31.7% versus 24.2%
Caveats
- Preprint; not yet peer reviewed.
VerdictWorth a reader's time today.
Abstract
Social media language and digital lifestyle behaviours are promoted as scalable signals of population mental health, but predictive models are often evaluated in ways that overstate accuracy. We analysed 20,000 tweets from 72 users, labelled by whether the account belonged to a user identified as depressed, and two synthetic datasets (100,000 and 30,000 records) linking screen time, sleep and social media use with self-reported stress. Under a conventional tweet-level split, a term-weighted logistic regression appeared accurate (area under the receiver operating characteristic curve 0.835), but when whole users were held out its performance fell to near chance (0.595; 95% confidence interval 0.505 to 0.686), because the model largely recognised users and their topics. Depression-associated tweets were more often negative (31.7% versus 24.2%), yet sentiment alone could not identify unseen users (0.539). The two behavioural datasets gave opposite answers: strong discrimination in one (0.926), driven by short sleep, and chance in the other (0.506), so synthetic results reflect how the data were generated. At a population prevalence of 10%, positive predictive values would be 0.10 to 0.30. Digital distress signals should be validated across individuals, on real linked data and at realistic prevalence before informing public health surveillance or prevention.
The editor's rubric
| Dimension | Level | Weight | What that level means |
|---|---|---|---|
| Leverage | ███░░ 3 | 10% | A method or resource many groups across the field will adopt within a year. |
| Magnitude | ███░░ 3 | 20% | Large gain: roughly 2x, or a clear new state of the art on a hard, unsaturated problem. |
| Evidence | ███░░ 3 | 32% | Solid: multiple benchmarks or cohorts, ablations, fair baselines, released code or data. |
| Novelty | ██░░░ 2 | 8% | A new combination of known ideas. |
| Trajectory | ███░░ 3 | 5% | A clear path to scale. |
| Stakes | ███░░ 3 | 25% | Meaningful benefit to many people within a few years. |
Editor’s rationale
Heuristic triage from title and abstract text only, not a reading of the paper. Cues found: breadth (many tasks); gains (versus baseline); verification (confidence interval, multiple benchmarks, held-out test); scale (scalable); stakes (global scale, prevention or cure).
How the score was computed
- Merit
- 5.8 / 10
- Adjusted merit
- 4.9 / 10
- Attention
- 0%
- Freshness
- 92%
- Citations0 (reference 20, via semantic-scholar, Oct 12, 2026, 06:17 UTC)