Zhou Et Al 2021 Are Online Mental Health Interventions For Youth Effective A Systematic Review
Zhou Et Al 2021 Are Online Mental Health Interventions For Youth Effective A Systematic Review
Zhou Et Al 2021 Are Online Mental Health Interventions For Youth Effective A Systematic Review
Abstract
Objectives: This systematic review aims to examine the effectiveness of online mental health interventions for youth.
Methods: We searched seven electronic databases (PubMed, PsycINFO, Medline, Embase, CINAHL, Web of Science and
SCOPUS) for the past 10 years to identify randomized controlled trials which have evaluated the use of telehealth inter-
ventions for young people with mental health problems. The included studies were assessed for quality and risk of bias.
Results: Forty-five randomized controlled trials (n = 13,291 participants) were eligible for this review. Most studies (35
trials) evaluated the use of web-based self-help platforms to deliver cognitive behavioural therapy (14 trials), mindfulness
(four trials), acceptance commitment therapy (five trials) and positive psychology (two trials). Mobile/computer applica-
tions were used to deliver cognitive behavioural therapy (four trials) and coping strategies training (two trials). Web-based
synchronous chat (one trial) was used to assist communication between counsellors and participants. Three studies used
artificial intelligence-based conversational agents to deliver cognitive behavioural therapy (two trials) and problem-solving-
strategy training (one trial). Eighty-two percent (n = 37) identified the participants as student population (i.e. university
students, high school students). Sixty-four percent (n = 29) of the telehealth interventions were found to be effective
in managing depression, anxiety, stress, insomnia and improving quality of life when compared with control conditions.
Conclusions: Online mental health interventions were found to be effective in managing diverse mental health condi-
tions among youth. Online self-help platforms were the most frequently used modality and artificial intelligence-based
chatbots are merging as potential solutions. Future research is warranted to investigate the solutions to improve the
retention rate and satisfaction of telehealth interventions among this population.
Keywords
Telehealth, telemedicine, adolescent, youth, mental health, effectiveness, systematic review
Date received: 19 July 2021; Date accepted: 1 September 2021
Figure 1. Preferred reporting items for systematic reviews and meta-analysis (PRISMA) flowchart.
assessors from the intervention allocations. Three stress level (n = 14, 40%). Several studies also investigated
studies25,36,37 reported that extra contacts were provided mental health outcomes relating to mental health well-
to intervention groups (e.g. extra email, text messages for being,13,20,25,32,44,45 quality of life,32,36,37,46 life satisfac-
encouraging engagement with the interventions). tion,21,44 psychological distress,16,25,37,45 insomnia47 and
Furthermore, there was insufficient description and analysis sleep quality.43
of lost participants.15,19,21,27,28,30,32,38–42 Five studies did
not perform intent-to-treat analysis.28,33,36,42,43
Modalities of online mental health interventions
Thirty-five studies (78%) used web-based self-help plat-
Efficacy outcomes forms as formats to deliver psychological interventions.
The most frequently assessed mental health outcomes were Six studies used applications (13%), one study (2%) used
depression or depressive symptoms (n = 38; 84%), web-based synchronous chat and three studies (7%) used
anxiety-related symptoms (n = 33; 73%), psychological AI-based conversational agents.
Zhou et al. 641
The efficacy of web-based self-help platforms. Web-based school students. Findings were that the intervention had
self-help platforms were the most frequently used online no impact on anxiety, depressive symptoms or mental
format (n = 35).14,20,25–27,29,30,33,34,36,37,39,40,42–44,46–55 A health wellbeing. One intervention was based on CBT
total of 24 studies were effective in managing and mindfulness,38 the intervention was effective in redu-
mental health issues whilst other 11 were found to be not cing depression, and anxiety but not effective in reducing
effective. psychological stress levels. Farrer et al.37 used a web-based
self-help platform to deliver psychoeducation and train stu-
Cognitive behavioural therapy. Fourteen self-help plat- dents with coping strategies. They found that the interven-
forms were underpinned by cognitive behavioural tion was not effective in reducing anxiety, depression,
therapy.15,16,27,33,35,39,42,48,50,52,53,55–57 Eleven studies psychological distress or improving quality of life.
found that the web-based platforms underpinned by cogni- Gladstone et al.29 delivered a combination of behavioural
tive behavioural therapies were effective in reducing out- activation strategies and interpersonal psychotherapy tech-
comes scores relating to depression,15,27,35,39,48,50,52,55,57 niques via a web-based self-help platform. They found
anxiety,15,33,39,50,55–57 psychological stress level15,39 as the intervention was not effective in reducing anxiety or
compared with the control condition. In contrast, the depressive symptoms. Schleider et al.54 delivered psychoe-
other three studies showed that their interventions were ducation on growth mindsets of personality, self-regulation
not effective in reducing anxiety,16,42 depression16,42,53 and intelligence via a web-based platform. They found that
and psychological stress level.16 the intervention was effective in reducing depressive symp-
Acceptance commitment therapy. Five trials were toms, but not effective in reducing social anxiety symp-
underpinned by acceptance commitment toms. Short et al.47 delivered web-based self-help
therapy.21,25,36,40,51 Three interventions were effective in intervention which combined motivational interviewing
reducing depression,36 psychological stress level,36,51 psy- (MI) and CBT. They found that the intervention was not
chological distress25 and improving quality of life36 and effective in reducing anxiety or insomnia.
mental health wellbeing.25 In contrast, two interventions
did not affect outcomes relating to depressive symp-
toms,40,51 life satisfaction,51 anxiety40 and psychological Efficacy of web-based applications. Six studies13,24,32,45,58,59
stress level.40 used web-based mobile applications as vehicle to deliver
psychological interventions. CBT,32,45,58,59 mindfulness,32
Mindfulness. Four studies14,31,43,46 tested the effective- attention bias modification training,32 coping strategies24,58
ness of web-based programs among young people. One and social learning theory45 were used as psychological
study did not report the efficacy due to the low retention interventions which underpinned these web-based applica-
rate.43 The other three mindfulness web-based interven- tions. Three studies13,58,59 demonstrated the effectiveness
tions14,31,46 showed efficacies in reducing perceived of app-based intervention in improving mental health well-
stress, anxiety, depression14,31,46 and improving quality of being13 and reducing anxiety, depression13,58,59 and per-
life.46 ceived stress.58 The effect sizes ranged from d = 0.30 to d
= 0.76. In contrast, two studies24,32 did not find significant
Positive psychology. Two self-help platforms were differences between intervention groups and control groups
based on positive psychology.30,44 Burckhardt et al.44 in the changes of mental health outcomes at post-
found that the intervention was not effective in managing intervention. Interestingly, O’Dea et al.45 found that the
anxiety, depression, stress, life satisfaction or mental intervention was not effective in reducing depression or
health wellbeing. In contrast, the other intervention30 was anxiety. However, it demonstrated effectiveness in improv-
effective. ing mental health wellbeing. The retention rates ranged
Other stand-alone interventions. Four online platforms from 28% to 92.7%.
were based on present control theory,49 psychodynamic
therapy,41 social cognitive theory26 and religious beliefs
spiritual practices.34 All of these interventions were found Efficacy of web-based synchronous chat between
to be effective in reducing psychological stress level, psychotherapists and participants. Kramer et al.60 tested the
anxiety and depression. effectiveness of web-based synchronous chat between
mental health professionals and participants. The interven-
Combined psychological interventions. Six studies used tion consisted of individual real-time chat sessions with a
web-based self-help interventions combined with several psychotherapist Solution-Focused Brief Therapy (SFBT)
psychological interventions.20,29,37,38,47,54 Calear et al.20 techniques were used by the psychotherapist The result
used a web-based self-help platform to deliver a combin- showed that compared with the waiting list condition, the
ation of psychoeducation, cognitive behavioural therapy intervention group showed significantly greater reductions
(CBT), relaxation skills and physical activity among in symptoms of depression. The retention rate was 51%.
642 Journal of Telemedicine and Telecare 27(10)
Efficacy of AI-based conversational agents (chatbots). Three engagement varied widely for self-help programs. Some
studies19,28,61 tested the effectiveness of AI-based chatbot studies, therefore, sent participants reminders to increase
in reducing anxiety and depression among university stu- the engagement.25,37 This nevertheless may produce mod-
dents. Bird et al.19 used a computerised AI-based chatbot erators and contaminate the intervention.65 Therefore,
(MYLO) to train participants with problem-solving strate- future studies investigating the effect of self-help platforms
gies. They used another mental health chatbot (ELIZA) as should take into account co-design to increase the
a control condition. ELIZA is a text-based chatbot designed engagement.
to encourage users to discuss their problems. They found Our study suggested mixed evidence relating to the
that both intervention and control groups demonstrated sig- effectiveness of web-based applications in managing
nificant reductions in depression and anxiety. However, mental health issues among youth. Previous reviews inves-
MYLO was not found to be more effective than ELIZA. tigating the effectiveness of app-based mental health inter-
Fitzpatrick and Darcy61 and Fulmer et al.28 used chatbots ventions found a similar trend.70 This potentially reflects
(Weobot and Tess) to deliver CBT. Both studies provided the fact that app-based interventions are still in the
control groups with only online mental health-related infor- nascent stages. More rigorous designs of apps for youth
mation. Fitzpatrick et al. found that the intervention was mental health are needed. Unlike the previous study
effective in reducing depressive symptoms but not in redu- which indicate a mean effect size of d = 0.42 for anxiety
cing anxiety. Fulmer et al. found that the chatbot (Tess) was and d = 0.16 for depression for app-based interventions,
effective in reducing depression and anxiety. The retention our study found that the effect sizes of app-based interven-
rate of AI-based chatbot interventions ranged from 83% to tions ranged from d = 0.32 to 0.76 for anxiety and d = 0.30
100%, with one study reporting 83% and two studies to 0.63 for depression. This is likely because included
reporting 100%. studies in our review are all underpinned by standardized
psychotherapy approaches. Our study also found slightly
higher retention rates for mental health applications which
ranged from 58% to 92%. This may be because compared
Discussion to self-help platforms, applications could be accessed via
Telehealth is a clinically effective approach for managing various devices (e.g. tablets, smartphones and laptops),
diverse health conditions62,63 and it is well-accepted and and are therefore easy to use. A review conducted by
widely used in the management of mental health con- Chan and Honey71 suggested that consumers held positive
cerns.64 This systematic review summarised the modalities attitudes toward mental health apps and rated them ‘easy to
and effectiveness of online mental health interventions for use’.
youth in the recent literature. Four modalities were used In line with the previous review,72 our studies only
to manage youth mental health problems: web-based self- found a limited number of synchronous text-based chats,
help platforms, web-based applications, web-based syn- indicating that there is potentially a research gap in investi-
chronous chat and AI-based chatbots. Sixty-four percent gating the efficacy of this modality. The only study in this
(n = 29) of the online interventions were effective in mana- review suggested that web-based synchronous chat was
ging depression, anxiety, psychological stress level, insom- effective in reducing depression as compared with the
nia and psychological distress and improving mental health control condition. As this modality relied largely on the
well-being, life satisfaction, sleep quality, and quality of life characteristics of the psychotherapist, this modality served
among youth. mostly as a communication tool.
Web-based self-help platforms were the most frequent Three trials were identified that investigated the effect-
method used in the reviewed studies (n = 35). In line with iveness of AI-based chatbots. The evidence was mixed
previous studies,65,66 majority of self-help platforms (n = with two studies showing reduced anxiety28 and depres-
25) were effective in managing anxiety, depression and sion28,61 whilst one study did not.19 Abd-Alrazaq et al.73
psychological stress level when compared with the also found conflicting results relating to the effectiveness
control conditions, with those underpinned by cognitive of the chatbots in managing anxiety and depression.
behavioural therapies demonstrating most evidence. These These altogether suggested that confirmatory studies asses-
included self-help platforms comprised of different sing the effectiveness of chatbots are needed. Moreover, the
modules with each module achieving certain aims such as AI-based chatbots had the highest retention rates: 83% (n =
psychoeducation and skills training. Participants could 1) to 100% (n = 2). This finding is in line with previous
access the platform at their convenience. Previous studies studies74 which suggested that chatbots were rated as
have suggested that internet self-help platforms were con- acceptable, satisfying and enjoyable.
venient67 and helpful in reducing stigma.68 It is worth The majority (33/45) of the included studies were of
noting that the retention rate ranged widely from 1% to ‘good’ quality, however, the included studies are heteroge-
100%. This confirmed previous findings relating to online neous. For instance, some studies recruited a universal
self-help platforms,69 which indicated that the uptake and sample whilst some studies recruited a targeted sample
Zhou et al. 643
(i.e. those with elevated symptoms), previous studies sug- Canadian J Psychiatr Revue Canadienne de Psychiatr
gested that mental health interventions which recruited a 2019; 64: 323–328.
targeted sample are likely to produce larger effect sizes.75 8. Wood J, Stathis S, Smith A, et al. E-CYMHS: an expansion of
Furthermore, the use of different control conditions (i.e. a child and youth telepsychiatry model in Queensland.
Australas Psychiatr 2012; 20: 333–337.
active control and passive control) is likely to have an
9. Ryan VN, Stathis S, Smith AC, et al. Telemedicine for rural
impact on the effect.75 Therefore, these factors should be
and remote child and youth mental health services.
considered when interpreting the results of this review. J Telemed Telecare 2005; 11: S76–S78.
10. Hilty DM, Sunderji N, Suo S, et al. Telepsychiatry and other
technologies for integrated care: evidence base, best practice
Conclusion models and competencies. Int Rev Psychiatr 2018; 30: 292–
The findings of this review indicate that online mental 309.
health interventions have the potential as an effective treat- 11. Becker MPE, Christensen BK, Cunningham CE, et al.
Preferences for early intervention mental health services: a
ment for a variety of common youth mental health presen-
discrete-choice conjoint experiment. Psychiatr Serv 2016;
tations. However, a low retention rate (especially among 67: 184–191.
web-based platforms) remains a problem in implementing 12. Cunningham CE, Walker JR, Eastwood JD, et al. Modeling
such interventions, therefore, future studies are warranted mental health information preferences during the early adult
to investigate approaches to engage the youth population. years: a discrete choice conjoint experiment. J Health
Commun 2014; 19: 413–440.
Declaration of conflicting interests 13. Bendtsen M, Mussener U, Linderoth C, et al. A mobile health
intervention for mental health promotion among university
The authors declared no potential conflicts of interest with respect students: randomized controlled trial. JMIR Mhealth
to the research, authorship, and/or publication of this article. Uhealth 2020; 8: e17208.
14. Cavanagh K, Churchard A, O’Hanlon P, et al. A randomised
Funding controlled trial of a brief online mindfulness-based interven-
tion in a non-clinical population: replication and extension.
The authors disclosed receipt of the following financial support for
Mindfulness 2018; 9: 1191–1205.
the research, authorship, and/or publication of this article: This
15. Day V, McGrath PJ and Wojtowicz M. Internet-based guided
work was supported by the Major Projects of the National
self-help for university students with anxiety, depression and
Social Science Foundation (grant no. 20ZDA079).
stress: a randomized controlled clinical trial. Behav Res Ther
2013; 51: 344–351.
ORCID iD 16. Dear BF, Fogliati VJ, Fogliati R, et al. Treating anxiety and
Xiaoyun Zhou https://orcid.org/0000-0002-3903-4166 depression in young adults: a randomised controlled trial
Sisira Edirippulige https://orcid.org/0000-0001-6196-5437 comparing clinician-guided versus self-guided internet-
delivered cognitive behavioural therapy. Aust N Z J
Psychiatry 2018; 52: 668–679.
References 17. Su W, Fang X, Miller JK, et al. Internet-based intervention for
1. The United States. Definition of youth, https://www.un.org/ the treatment of online addiction for college students in China:
esa/socdev/documents/youth/fact-sheets/youth-definition.pdf a pilot study of the healthy online self-helping center.
(2013, accessed 28 September 2021). Cyberpsychol Behav Soc Netw 2011; 14: 497–503.
2. Kessler RC, Amminger GP, Aguilar-Gaxiola S, et al. Age of 18. Das JK, Salam RA, Arshad A, et al. Interventions for adoles-
onset of mental disorders: a review of recent literature. Curr cent substance abuse: an overview of systematic reviews.
Opin Psychiatry 2007; 20: 359. J Adolesc Health 2016; 59: S61–S75.
3. Yatham S, Sivathasan S, Yoon R, et al. Depression, anxiety, 19. Bird T, Mansell W, Wright J, et al. Manage your life online: a
and post-traumatic stress disorder among youth in low and web-based randomized controlled trial evaluating the effect-
middle income countries: a review of prevalence and treat- iveness of a problem-solving intervention in a student
ment interventions. Asian J Psychiatr 2018; 38: 78–91. sample. Behav Cogn Psychother 2018; 46: 570–582.
4. Leathers C, Kroenke K, Flanagan M, et al. Somatic, anxiety, 20. Calear AL, Batterham PJ, Poyser CT, et al. Cluster rando-
and depressive (SAD) symptoms in young adult Latinx immi- mised controlled trial of the e-couch anxiety and worry
grants: prevalence and predictors. J Immigr Minor Health program in schools. J Affect Disord 2016; 196: 210–217.
2021; 23: 956–964. 21. Lappalainen R, Lappalainen P, Puolakanaho A, et al. The
5. Jefferies P and Ungar M. Social anxiety in young people: a youth compass-the effectiveness of an online acceptance
prevalence study in seven countries. PloS One 2020; 15: and commitment therapy program to promote adolescent
e0239133. mental health: a randomized controlled trial. J Contextual
6. Goldstein BI and Levitt AJ. Prevalence and correlates of Behav Sci 2021; 20: 1–12.
bipolar I disorder among adults with primary youth-onset 22. Page MJ, McKenzie JE, Bossuyt PM, et al. Updating guid-
anxiety disorders. J Affect Disord 2007; 103: 187–195. ance for reporting systematic reviews: development of the
7. Jacobs P and Lesage A. The public cost of mental health- and PRISMA 2020 statement. J Clin Epidemiol 2021; 134: 103–
addiction-related services for youth (ages 12–17) in Alberta. 112.
644 Journal of Telemedicine and Telecare 27(10)
23. The Joanna Briggs Institute. The Joanna Briggs Institute crit- of university students: randomised controlled trial of the uni
ical appraisal tools for use in JBI systematic reviews: check- virtual clinic. Internet Interv 2019; 18: 100276.
list for randomized controlled trials 2017, Adelaide: Joanna 38. El Morr C, Ritvo P, Ahmad F, et al. Effectiveness of an
Briggs Institute. Available from: https://jbi.global/sites/default/ 8-week web-based mindfulness virtual community interven-
files/2019-05/JBI_RCTs_Appraisal_tool2017_0.pdf tion for university students on symptoms of stress, anxiety,
24. Kenny R, Fitzgerald A, Segurado R, et al. Is there an app for and depression: randomized controlled trial. JMIR Ment
that? A cluster randomised controlled trial of a mobile app- Health 2020; 7: e18595.
based mental health intervention. Health Informatics J 39. Ip P, Chim D, Chan KL, et al. Effectiveness of a culturally
2020; 26: 1538–1559. attuned internet-based depression prevention program for
25. Levin ME, Krafft J, Hicks ET, et al. A randomized dismant- Chinese adolescents: a randomized controlled trial. Depress
ling trial of the open and engaged components of acceptance Anxiety 2016; 33: 1123–1131.
and commitment therapy in an online intervention for dis- 40. Levin ME, Pistorello J, Seeley JR, et al. Feasibility of a pro-
tressed college students. Behav Res Ther 2020; 126: 103557. totype web-based acceptance and commitment therapy pre-
26. Moeini B, Bashirian S, Soltanian AR, et al. Examining the vention program for college students. J Am Coll Health
effectiveness of a web-based intervention for depressive 2014; 62: 20–30.
symptoms in female adolescents: applying social cognitive 41. Lindqvist K, Mechler J, Carlbring P, et al. Affect-focused psy-
theory. J Res Health Sci 2019; 19: e00454. chodynamic internet-based therapy for adolescent depression:
27. Perry Y, Werner-Seidler A, Calear A, et al. Preventing depres- randomized controlled trial. J Med Internet Res 2020; 22:
sion in final year secondary students: school-based rando- e18047.
mized controlled trial. J Med Internet Res 2017; 19: e369. 42. Melnyk BM, Amaya M, Szalacha LA, et al. Feasibility, accept-
28. Fulmer R, Joerin A, Gentile B, et al. Using psychological arti- ability, and preliminary effects of the COPE online cognitive-
ficial intelligence (Tess) to relieve symptoms of depression behavioral skill-building program on mental health outcomes
and anxiety: randomized controlled trial. JMIR Ment. Health and academic performance in freshmen college students: a ran-
2018; 5: e64. domized controlled pilot study. J Child Adolesce Psychiatr
29. Gladstone T, Buchholz KR, Fitzgibbon M, et al. Randomized Nurs: Official Publication of the Association of Child and
clinical trial of an internet-based adolescent depression pre- Adolesce Psychiat Nurs, Inc 2015; 28: 147–154.
vention intervention in primary care: internalizing symptom 43. Antonson C, Thorsén F, Sundquist J, et al. Upper secondary
outcomes. Int J Environ Res Public Health 2020; 17: 1–17. school students’ compliance with two internet-based self-help
30. Osborn TL, Rodriguez M, Wasil AR, et al. Single-session programmes: a randomised controlled trial. Eur Child Adolesc
digital intervention for adolescent depression, anxiety, and well- Psychiatr 2018; 27: 191–200.
being: outcomes of a randomized controlled trial with Kenyan 44. Burckhardt R, Manicavasagar V, Batterham PJ, et al. A web-
adolescents. J Consult Clin Psychol 2020; 88: 657–668. based adolescent positive psychology program in schools: ran-
31. Ahmad F, El Morr C, Ritvo P, et al. An eight-week, web- domized controlled trial. J Med Internet Res 2015; 17: e4329.
based mindfulness virtual community intervention for stu- 45. O’Dea B, Han J, Batterham PJ, et al. A randomised controlled
dents’ mental health: randomized controlled trial. JMIR trial of a relationship-focussed mobile phone application for
Ment Health 2020; 7: e15520. improving adolescents’ mental health. J Child Psychol
32. Edridge C, Wolpert M, Deighton J, et al. An mHealth inter- Psychiatry 2020; 61: 899–913.
vention (ReZone) to help young people self-manage over- 46. Lahtinen O and Salmivalli C. An effectiveness study of a
whelming feelings: cluster-randomized controlled trial. J digital mindfulness-based program for upper secondary edu-
Med Internet Res 2020; 22: e14223. cation students. Mindfulness (NY) 2020; 11: 2494–2505.
33. McCall HC, Richardson CG, Helgadottir FD, et al. Evaluating a 47. Short NA, Developing SN and Novel Ta. Computerized
web-based social anxiety intervention among university students: insomnia and anxiety intervention to reduce safety aids
randomized controlled trial. J Med Internet Res 2018; 20: e91. among an at-risk student sample: a randomized controlled
34. Rickhi B, Kania-Richmond A, Moritz S, et al. Evaluation of a trial. Behav Ther 2020; 51: 149–161.
spirituality informed e-mental health tool as an intervention 48. Cook L, Mostazir M and Watkins E. Reducing stress and pre-
for major depressive disorder in adolescents and young venting depression (RESPOND): randomized controlled trial
adults – a randomized controlled pilot trial. BMC of web-based rumination-focused cognitive behavioral
Complement Altern Med 2015; 15: 1–14. therapy for high-Ruminating University students. J. Med.
35. Topooco N, Byléhn S, Dahlström Nysäter E, et al. Evaluating Internet Res 2019; 21: e11349.
the efficacy of internet-delivered cognitive behavioral therapy 49. Frazier P, Meredith L, Greer C, et al. Randomized controlled
blended with synchronous chat sessions to treat adolescent trial evaluating the effectiveness of a web-based stress man-
depression: randomized controlled trial. J Med Internet Res agement program among community college students.
2019; 21: e13393. Anxiety Stress Coping 2015; 28: 576–586.
36. Eustis EH, Hayes-Skelton SA, Orsillo SM, et al. Surviving 50. Kählke F, Berger T, Schulz A, et al. Efficacy of an unguided
and thriving during stress: a randomized clinical trial compar- internet-based self-help intervention for social anxiety dis-
ing a brief web-based therapist-assisted acceptance-based order in university students: a randomized controlled trial.
behavioral intervention versus waitlist control for college stu- Int J Methods Psychiatr Res 2019; 28: e1766.
dents. Behav Ther 2018; 49: 889–903. 51. Puolakanaho A, Lappalainen R, Lappalainen P, et al.
37. Farrer LM, Gulliver A, Katruss N, et al. A novel multi- Reducing stress and enhancing academic buoyancy among
component online intervention to improve the mental health adolescents using a brief web-based program based on
Zhou et al. 645
acceptance and commitment therapy: a randomized controlled 64. Gajaria A, Conn DK and Madan R. Telepsychiatry: effective-
trial. J Youth Adolesc 2019; 48: 287–305. ness and feasibility. Smart Homecare Technol Telehealth
52. Ren Z, Li X, Zhao L, et al. Effectiveness and mechanism of 2015; 3: 59–67.
internet-based self-help intervention for depression: the 65. Bennett SD, Cuijpers P, Ebert DD, et al. Practitioner review:
Chinese version of MoodGYM. Acta Psychol Sin 2016. unguided and guided self-help interventions for common
53. Richards D, Timulak L and Hevey D. A comparison of two mental health disorders in children and adolescents: a sys-
online cognitive-behavioural interventions for symptoms of tematic review and meta-analysis. J Child Psychol Psychiatr
depression in a student population: the role of therapist 2019; 60: 828–847.
responsiveness. Couns Psychother Res 2013; 13: 184–193. 66. Lewis C, Pearce J and Bisson JI. Efficacy, cost-effectiveness
54. Schleider JL, Burnette JL, Widman L, et al. Randomized trial and acceptability of self-help interventions for anxiety disor-
of a single-session growth mind-set intervention for rural ado- ders: systematic review. Br J Psychiatr 2012; 200: 15–21.
lescents’ internalizing and externalizing problems. J Clin 67. Musiat P, Goldstone P and Tarrier N. Understanding the
Child Adolesc Psychol 2020; 49: 660–672. acceptability of e-mental health-attitudes and expectations
55. Merry SN, Stasiak K, Shepherd M, et al. The effectiveness of towards computerised self-help treatments for mental health
SPARX, a computerised self-help intervention for adolescents problems. BMC Psychiatry 2014; 14: 1–8.
seeking help for depression: randomised controlled non- 68. Mills H, Mulfinger N, Raeder S, et al. Self-help interventions
inferiority trial. BMJ 2012; 344: e2598. to reduce self-stigma in people with mental health problems: a
56. Stjerneklar S, Hougaard E, McLellan LF, et al. A randomized systematic literature review. Psychiatr Res 2020; 284:
controlled trial examining the efficacy of an internet-based 112702.
cognitive behavioral therapy program for adolescents with 69. Fleming T, Bavin L, Lucassen M, et al. Beyond the trial: sys-
anxiety disorders. PloS One 2019; 14: e0222485. tematic review of real-world uptake and engagement with
57. Wong N, Kady L, Mewton L, et al. Preventing anxiety and digital self-help interventions for depression, low mood, or
depression in adolescents: a randomised controlled trial of anxiety. J Med Internet Res 2018; 20: e9275.
two school based internet-delivered cognitive behavioural 70. Buttazzoni A, Brar K and Minaker L. Smartphone-based
therapy programmes. Internet Interv 2014; 1: 90–94. interventions and internalizing disorders in youth: systematic
58. Harrer M, Adam SH, Fleischmann RJ, et al. Effectiveness of review and meta-analysis. J Med Internet Res 2021; 23:
an internet- and app-based intervention for college students e16490.
with elevated stress: randomized controlled trial. J Med 71. Chan AHY and Honey MLL. User perceptions of mobile
Internet Res 2018; 20: e9293. digital apps for mental health: acceptability and usability–
59. McCloud T, Jones R, Lewis G, et al. Effectiveness of a mobile An integrative review. J Psychiatr Ment Health Nurs 2021:
app intervention for anxiety and depression symptoms in uni- 1–22.
versity students: randomized controlled trial. JMIR Mhealth 72. Varker T, Brand RM, Ward J, et al. Efficacy of synchronous
Uhealth 2020; 8: e15418. telepsychology interventions for people with anxiety, depres-
60. Kramer J, Conijn B, Oijevaar P, et al. Effectiveness of a sion, posttraumatic stress disorder, and adjustment disorder: a
web-based solution-focused brief chat treatment for depressed rapid evidence assessment. Psychol Serv 2019; 16: 621.
adolescents and young adults: randomized controlled trial. 73. Abd-Alrazaq AA, Rababeh A, Alajlani M, et al. Effectiveness
J Med Internet Res 2014; 16: e141. and safety of using chatbots to improve mental health: sys-
61. Fitzpatrick KK and Darcy A. and MJJmh Vierhile. Delivering tematic review and meta-analysis. J Med Internet Res 2020;
cognitive behavior therapy to young adults with symptoms of 22: e16021.
depression and anxiety using a fully automated conversational 74. Vaidyam AN, Wisniewski H, Halamka JD, et al. Chatbots
agent (Woebot): a randomized controlled trial 2017; 4: e19. and conversational agents in mental health: a review of
62. Snoswell CL, Chelberg G, De Guzman KR, et al. The clinical the psychiatric landscape. Can J Psychiatry 2019; 64:
effectiveness of telehealth: a systematic review of 456–464.
meta-analyses from 2010 to 2019. J Telemed Telecare 2021. 75. van Loon AWG, Creemers HE, Beumer WY, et al. Can
63. Snoswell CL, Stringer H, Taylor ML, et al. An overview of the schools reduce adolescent psychological stress? A multilevel
effect of telehealth on mortality: a systematic review of meta-analysis of the effectiveness of school-based interven-
meta-analyses. J Telemed Telecare 2021. 1357633X211023700. tion programs. J Youth Adolesc 2020; 49: 1127–1145.
646 Journal of Telemedicine and Telecare 27(10)
Appendix 1
Ahmad 2020, Design: 4-arm RCT Sample description: Web-based platform: Mindfulness Depression, At 8-week time point, Did not report Post-intervention:
Canada Intervention groups: university students Video-based anxiety, stress compared with the 92%
web-based Condition: modules, symptoms control condition,
interventions universal peer-to-peer there was significant
Control group: WLC Age: M = 24.8 discussion forums, reductions in
Duration: 8 weeks Number:113 brief guided symptoms of
videoconferences depression (p <
0.001), anxiety (p =
0.01) and stress (p <
0.01).
Antonson Design: 3-arm RCT Sample description: Web-based self-help Mindfulness Sleep quality; Did not report the Did not report Post-intervention:
2018, Intervention group 1: upper secondary program: video and perceived effectiveness due to 1%
Sweden internet based school students audio material, stress low compliance
mindfulness Condition: Any device
Intervention group 2: universal Age: 15– No human
internet music 19 interference
therapy intervention Number:283
Control group: WLC
Duration: 8 weeks
Bendtsen Design: 2-arm RCT Sample description: Fully automated mobile Positive psychology Mental health Compared with Wellbeing: IRR = Post-intervention:
2020, Intervention group: university students phone application wellbeing; control group, there 1.052 58%
Sweden mHealth Condition: and daily text anxiety; was significant Depression: IRR =
intervention universal messages depression improvement in 0.878; anxiety: IRR
Control group: TAU Age: Mean = 25 mental health = 0.936
Duration: 10 weeks Number: 654 wellbeing (p = 0.02)
and significant
reduction in anxiety
(p = 0.02) and
depression (p =
0.05)
Bird 2018, UK Design: two-arm RCT Sample description: AI-based computerized Problem-solving skills Depression, Both programs N/A Post-intervention:
Intervention group: university students conversational agent building anxiety, stress (MYLO and ELIZA) 100%
AI-based Condition: were associated with
computerized universal improvements in
Journal of Telemedicine and Telecare 27(10)
(continued)
Table A2. Continued
not in anxiety (p =
0.46)
Farrer 2019, Design: two-arm RCT Sample description: Web-based self-help Psychoeducation, Depression, There was no N/A 72% of participants
Australia Intervention group: university students platform coping strategies anxiety, quality significant difference completed
online intervention Condition: training of life, between post-intervention
(UVC) targeted (those psychological intervention and assessment. 47.5%
Control group: WLC with elevated distress control group in completed
Duration: 6 weeks psychological outcomes relating to 3-month follow-up
distress (K10 > anxiety (p = 0.32), assessment.
15)) depression (p =
Age: M = 22 0.45), psychological
Number:200 distress (p = 0.09) or
quality of life (p =
0.74).
Frazier 2015, Design: two-arm RCT Sample description: Web-based self-help Present control Perceived Compared with Between-group 56.8% of participants
USA Intervention group: university students platform theory stress, stress control condition, effect size range completed
web-based stress Condition: symptoms, intervention group from: d = 0.30 to d post-intervention
management universal depression, achieved significantly = 0.36 at assessment. 52.5%
program (PCI) Age: 18–21 anxiety bigger reductions in post-intervention completed a
Control group: Number: 257 perceived stress (p = but d = 0.12 at 3-week follow-up
stress-information 0.007), DASS stress follow-up. assessment.
only (p = 0.006), anxiety
Duration: two weeks (p = 0.05),
depression (p =
0.02).
Gladstone Design: two-arm RCT Sample description: Web-based self-help Behavioral activation Depression, There were no N/A Did not report
2020, USA Intervention group: adolescents platform strategies training, anxiety significant
web-based self-help Condition: interpersonal differences between
intervention targeted (those psychotherapy groups in change in
(CATCH-IT) with elevated techniques training depressive
Control group: depression) symptoms (p = 0.80)
online health Age: 15.4 or anxiety (p =
education (HE) Number: 369 0.79).
Duration: 14 Improvement in
modules (24 months) depressive
(continued)
Journal of Telemedicine and Telecare 27(10)
Table A2. Continued
symptoms was
statistically
significant (p < 0.05)
for both groups.
Improvement in
anxiety was
significant for
CATCH-IT (p =
0.04) but not HE (p
= 0.07).
Harrer 2018, Design: two-arm RCT Sample description: Internet- and CBT, Perceived Compared to control Stress: d = 0.69; 92.7% of participants
Germany Intervention group: university students app-based program problem-focused stress, group, intervention Anxiety: d = 0.76; completed
internet- and Condition: coping and depression, group achieved a Depression: d = post-intervention
app-based targeted (those emotion-focused state anxiety bigger reduction in 0.63 assessment. 70% of
intervention with elevated coping perceived stress, participants
(CATCH-IT) levels of perceived depression, anxiety. completed
Control group: WLC stress (PSS-4 > = follow-up
Duration: 7 weeks 8)) assessment (3
Age: M = 24 months after
Number: 150 randomization).
Lappalainen Design: three-arm Sample description: Online self-help ACT Depressive The change in the two N/A 96.0% of the
2021, RCT secondary school platform and symptoms; life intervention groups participant finished
Finland Intervention group1: students WhatsApp messages satisfaction was not significantly post-assessment.
online intervention Condition: sent by coaches different compared
with two face-to-face universal with the control
sessions Age:15–16 (M = group in regard to
Intervention group2: 15.27) depressive
online intervention Number: 243 symptoms (p =
with no face-to-face 0.153); life
sessions satisfaction (p =
Control group: no 0.195).
treatment
Duration: 5 weeks
Ip 2016, China Design: two-arm RCT Sample description: Web-based self-help CBT Depression, At post-intervention, Post-intervention: post-intervention:
Intervention group: secondary school program anxiety, stress intervention group Depression: d = 97%
online intervention students achieved statistically −0.28;
Control group: Condition: significant Anxiety: d =
(continued)
653
654
distress, mental
health well-being,
emotional
self-awareness or
coping strategies.
Kramer 2014, Design: two-arm RCT Sample description: Brief web-based Solution-Focused Depression Compared with D = 0.79 Post-intervention:
the Intervention group: young people (12– synchronous chat Brief Therapy control condition, 51%
Netherlands web-based chat 22 years) (PratenOnline/ (SFBT) intervention group
treatment Condition: Talking online) showed significantly
Control group: WLC targeted (those greater
Duration: 4.5 months with depressive improvement at
symptoms) post-intervention.
Age: M = 19.5
Number: 263
Lahtinen, Design: two-arm RCT Sample description: Web-based self-help mindfulness Anxiety, Completing the MBP Anxiety: d = 0.26; Post-intervention:
2020, Intervention group: upper secondary platform depression, resulted in a Depression: d = 70.3%;
Finland digital school students qualify of life small-to-moderate 0.15; At 3-month
mindfulness-based Condition: reduction in anxiety Quality of life: d = follow-up: 53.7%
intervention universal (p < 0.01), a small 0.16
Control group: WLC Age: M = 17 reduction in
Duration: 8 weeks Number: 1349 depression (p <
0.01), and a small
increase in quality of
life (p = 0.05).
Levin 2020, Design: four-arm RCT Sample description: Web-based self-help ACT Psychological All three ACT Psychological Post-intervention:
USA Intervention group: university students program distress, conditions distress: d = 0.71– 89%
online intervention Condition: mental health significantly 0.86 mental health At follow-up:
Control group: WLC targeted (those wellbeing improved over time wellbeing: d = 84.6%
Duration: 12 sessions were relative to the 0.14–0.69
psychologically waitlist condition on
distressed) the primary
Age: M = 22 outcome of mental
Number: 181 health symptoms
(psychological
(continued)
655
656
Percentage of
Sample [sample participants who
description; finished
Study design condition (universal/ Assessed Results (statistical post-intervention/
Author, year, (intervention/control targeted); age; Online intervention Psychological mental health significance compared Effect size of follow-up
country group; duration) number] modalities intervention outcomes with control group) intervention assessment)
anxiety symptoms (p
= 0.004).
Fulmer 2018, Design: three-arm Sample description: AI-based chatbot (Tess) CBT Depression, Compare with control Did not report Post-intervention:
USA RCT university students anxiety group, intervention 100%
Intervention group 1: Condition: group 1
2-week chatbot universal demonstrated a
intervention Age: M = 22.9 significant reduction
Intervention group 2: Number: 75 in depression (p =
4-week chatbot 0.02); both
intervention intervention groups
Control group: 1 and 2
information only demonstrated a
control significant reduction
Duration: 2–4 weeks in anxiety (group 1: p
= 0.045; group 2: p =
0.02).
663
Appendix 3
664
Ahmad et al., Yes Yes Yes No No NA Yes Yes Yes Yes Yes Yes Yes 11
2020
Antonson et al., Yes Yes Yes No No Yes Yes Yes No Yes Yes Yes Yes 10
2018
Bendtsen et al., Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
2020
Bird et al., 2018 Yes Yes Yes No No Yes Yes No Yes Yes Yes Yes Yes 10
Burckhardt Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
et al., 2015
Calear et al., Yes Yes No No No NA Yes Yes Yes Yes Yes Yes Yes 9
2016
Cavanagh et al., Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
2013
Cook et al., Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
2019
Day et al., 2013 Yes Yes No No No NA Yes No Yes Yes Yes Yes Yes 8
Dear et al., 2018 Yes Yes NA No No Yes Yes Yes Yes Yes Yes Yes Yes 10
Edridge et al., Yes Yes Yes No No NA Yes No Yes Yes Yes Yes Yes 8
2020
El Morr et al., Yes Yes Yes No No Yes Yes No Yes Yes Yes Yes Yes 10
2020
Eustis et al., 2018 Yes Yes Yes No No Yes No Yes No Yes Yes Yes Yes 8
Farrer et al., Yes Yes Yes No No Yes No Yes Yes Yes Yes Yes Yes 10
2019
Frazier et al., Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
2015
Gladstone et al., Yes Yes NA No No Yes Yes Yes Yes Yes Yes Yes Yes 10
2020
Journal of Telemedicine and Telecare 27(10)
(continued)
Table A3. Continued
follow-up design
complete and appropriate, and
if not, were any deviations
7. Were differences from the standard
treatment between RCT design
1. Was true 5. Were groups groups in 9. Were 10. Were (individual
randomization 2. Was 3. Were those 6. Were treated terms of participants outcomes randomization,
used for allocation treatment 4. Were delivering outcomes identically their analysed in measured 11. Were 12. Was parallel groups)
assignment of to groups participants treatment assessors other than follow-up the groups to in the same outcomes appropriate accounted for in
participants to treatment similar at blind to blind to blind to the adequately which they way for measured statistical the conduct and
treatment groups the treatment treatment treatment intervention described were treatment in a reliable analysis analysis of the
groups? concealed? baseline? assignment? assignment? assignment? of interest? and analysed? randomized? groups? way? used? trial? Score
Harrer et al., Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
2018
Lappalainen Yes Yes Yes No No NA Yes No Yes Yes Yes Yes Yes 9
et al., 2021
Ip et al., 2016 Yes Yes Yes No No Yes Yes No Yes Yes Yes Yes Yes 10
Kählke et al., Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
2019
Kenny et al., Yes Yes No No No Yes Yes Yes Yes Yes Yes Yes Yes 10
2020
Kramer et al., Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
2014
Lahtinen & Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
Salmivalli,
2020
Levin et al., 2020 Yes Yes No No No Yes No Yes Yes Yes Yes Yes Yes 9
Levin et al., 2014 Yes Yes Yes No No Yes Yes No Yes Yes Yes Yes Yes 10
Lindqvist et al., Yes Yes Yes No No Yes Yes No Yes Yes Yes Yes Yes 10
2020
McCall et al., Yes Yes Yes No No NA Yes Yes No Yes Yes Yes Yes 9
2018
McCloud et al., Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
2020
Melnyk et al., Yes Yes Yes No No Yes Yes No NA Yes Yes Yes Yes 9
2015
Merry et al., Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
2012
Moeini et al., Yes Yes No No No Yes Yes Yes Yes Yes Yes Yes Yes 10
2019
O’Dea et al., Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
2020
(continued)
665
666
Osborn et al., Yes Yes NA No No Yes Yes No Yes Yes Yes Yes Yes 9
2020
Perry et al., 2017 Yes Yes No No No NA Yes No Yes Yes Yes Yes Yes 8
Puolakanaho Yes Yes Yes No No No Yes Yes Yes Yes Yes Yes Yes 10
et al., 2019
Ren et al., 2016 Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
Richards et al., Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
2013
Rickhi et al., Yes Yes Yes No No NA Yes Yes Yes Yes Yes Yes Yes 10
2015
Schleider et al., Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
2019
Short & Yes Yes Yes No No Yes Yes NA Yes Yes Yes Yes Yes 10
Schmidt, 2020
Stjerneklar et al., Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
2019
Topooco et al., Yes Yes Yes No No NA Yes Yes Yes Yes Yes Yes Yes 10
2019
Wong et al., Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 11
2014
Fitzpatrick et al., Yes Yes Yes No No Yes Yes Yes Yes Yes Yes Yes Yes 12
2017
Fulmer et al., Yes Yes NA No No Yes Yes No No Yes Yes Yes Yes 9
2018