Effectiveness and Safety of Asynchronous Telemedicine Consultations in General Practice: A Systematic Review
Effectiveness and Safety of Asynchronous Telemedicine Consultations in General Practice: A Systematic Review
Abstract
Background: There is a focus on increasing asynchronous telemedicine use, which allows medical
data to be transmitted, stored, and interpreted later; however, limited evidence of the quality of care
it allows in general practice hinders its use.
Aim: To investigate uses and effectiveness of asynchronous telemedicine in general practice, according
to the domains of healthcare quality, and describe how the COVID-19 pandemic changed its use.
Design & setting: Systematic review in general practice.
Method: A systematic search was carried out across four databases using terms related to general
practice, asynchronous telemedicine, uses, and effectiveness, and supported by citation searching.
This was followed by screening according to pre- defined criteria, data extraction, and critical
appraisal. Narrative synthesis was then undertaken guided by the six domains of healthcare quality
and exploring differences in use before and following the COVID-19 pandemic.
Results: Searches yielded 6864 reports; 27 reports from 23 studies were included. Asynchronous
*For correspondence: telemedicine is used by a range of staff and patients across many countries. Safety and equity are
[email protected] poorly reported but there were no major safety concerns. Evidence from other domains of healthcare
Twitter: @LeightonCaraH quality show effectiveness in making diagnoses, prescribing medications, replacing other consultations,
providing timely care, and increased convenience for patients. Efficiency is impacted by negative
Twitter: @adriangkedwards
effects on workflow, through poor implementation and patient non- adherence, limiting usability
Twitter: @NJosephWilliams and requiring new administrative approaches from healthcare staff. Asynchronous telemedicine use
increased rapidly from March 2020, following the COVID-19 pandemic outbreak.
Competing interest: The authors
declare that no competing Conclusion: Asynchronous telemedicine provides quality care for patients but is limited by reports
interests exist. of increased workload and inefficient workflow compared with face-to-face consultations. Limits of
evidence include heterogeneity and small- scale studies. Further research into cost- effectiveness,
Received: 08 September 2023
Accepted: 19 September 2023 equity, safety, and sustained implementation will influence future policy and practice.
Published: 07 February 2024
Box 1 Definitions of telemedicine, synchronous telemedicine, asynchronous telemedicine, and general practice
• Telemedicine: 'The use of telecommunication and information technology for the purposes of providing remote health assessments and ther-
apeutic interventions.' NHS England55
• Synchronous telemedicine: 'Real-time, audio-video and telephone communication that connects physicians and patients in different loca-
tions.' American Medical Association6
• Asynchronous telemedicine: Also known as the 'store-and-forward' technique. It allows data, including text and images from online services,
to be transmitted and interpreted later.6
• General practice: General practice is the first point of contact for patients to access healthcare services. It offers a range of services, including
consultations, prescriptions, treatments and management of long-term conditions, referrals to specialists, and health promotion. A wide
range of practitioners work in general practice including doctors (GPs), nurses, and other allied health professionals.56
owing to poor implementation into existing clinical systems. Further research should investigate the
implementation, cost-effectiveness, safety, and equity of asynchronous telemedicine use.
Introduction
Telemedicine, the use of telecommunication for providing remote health assessments and therapeutic
interventions, as defined in Box 1, has been used in health care for several years and there is a
global focus on its development, owing to the rapid increase in use following the COVID-19 pandemic
outbreak.1 During the pandemic, 99% of general practices in the UK adopted remote consultation
platforms, which was a major change in practice and a move towards asynchronous telemedicine,
allowing data to be transmitted, stored, and interpreted later.2 However, it is unclear whether
asynchronous telemedicine allows healthcare professionals to provide quality care for patients
according to the domains of healthcare quality: safety, timeliness, effectiveness, efficiency, equity, and
patient-centredness, as outlined in Figure 1.3
Increased policy directives for telemedicine include the NHS Long Term Plan, aiming for ‘digital
first’ primary care by 2023–2024 through the NHS App.4 The Welsh Government aims for remote
delivery of 35% of initial and 50% of follow-up appointments.5
Asynchronous telemedicine occurs through secure messaging, such as texting and online
platforms, and can involve clinical decision-making aids.6,7 Uses include: evaluating whether patients
need further consultations; and communication between patients and healthcare professionals, or
between multiple healthcare professionals.6 The focus of this review is consultations between patients
and healthcare professionals for medical advice.
Synchronous telemedicine, which includes video and telephone consultations, has been more
widely researched than asynchronous telemedicine.8–10 Existing reviews have focused on areas such
as sharing images for dermatology consultations, and specific types of secure messaging such as
emails.11,12 There is a recent rapid review on the value of asynchronous communication between
patients and physicians in primary care,13 but none focusing specifically on quality of care. A pre-
pandemic review on uses of e-consultations in primary care highlighted that research into effectiveness
and safety of asynchronous telemedicine is needed.14
Asynchronous telemedicine has potential to change service delivery in the UK and internationally
as 90% of NHS consultations occur in general practice,15 there are high levels of public interest in
access to GP appointments,16–18 and practice has changed following COVID-19. Therefore, reviewing
this field is important. Results will be guided by the domains of healthcare quality, a widely accepted
model of healthcare quality,3 which will assist in identifying evidence gaps.
Method
This study occurred between October 2022 and April 2023, and is reported according to the Preferred
Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines.19
Search strategy
Following pilot searching, MEDLINE, CINAHL, Embase, and Scopus were searched. Search themes
included general practice, asynchronous telemedicine, uses, effectiveness, and safety (full details in
Supplementary Figure S1). Further relevant studies were identified from reference lists of included
reports.
Reports published between January 2015 and 31 November 2022 were searched to identify
literature published before and following the COVID-19 pandemic outbreak in March 2020.
Study selection
Eligibility criteria, detailed in Table 1, were developed using Population, Intervention, Comparison,
Outcome (PICO) framework.20
One researcher (CL) screened search results against inclusion criteria and 10% were independently
screened for agreement (AP). One researcher (CL) screened full texts and queries were discussed
within the research team. Search results and inclusion decisions were recorded using EndNote (version
20).21
Population Patients and staff who have used asynchronous Other areas of primary care: dentistry,
telemedicine in a general practice setting, optometry, community nursing, pharmacy.
including all healthcare professionals and other Secondary and tertiary care.
members of staff and consultations relating to
all patient groups, including adults, children,
and carers.
Intervention All methods of asynchronous telemedicine; for Synchronous telemedicine such as video
example, e-consults, secure messaging, text appointments, telephone appointments.
consultations, eVisits, emails. Automated asynchronous telemedicine,
Interactions between patients and healthcare telemonitoring, interactions between two or
professionals seeking medical advice. more healthcare professionals.
Data extraction
CL carried out data extraction. A template was piloted and discussed within the research team. The
final template (Supplementary Figure S2) was based on this review’s objectives and assisted consistent
data extraction across studies, including the design, participant characteristics (staff or patients), type
of asynchronous telemedicine, and comparators. Also retrieved were each study’s objectives, patients
involved, main findings, and whether the results were before or following the COVID-19 pandemic
outbreak.
Critical appraisal
Critical appraisal was at study level with the aid of the Mixed Methods Appraisal Tool (MMAT) for
qualitative, quantitative, and mixed-methods studies.22 The Critical Appraisal Skills Programme (CASP)
checklist was also used for qualitative studies.23 There was no formal risk of bias due to heterogeneity
of included studies.
Data synthesis
A narrative synthesis approach was used.24 Results were grouped and synthesised according to the
study’s objectives and six domains of healthcare quality by one author (CL), and this was discussed
within the research team until agreement was reached.3
No meta-analysis was carried out owing to inclusion of qualitative data.
Results
Search results
Database searching returned 9040 reports. After removing duplicates, 6864 remained; 6777 were
excluded through title and abstract screening, so 87 remained. Eighty- one were retrieved and
assessed for eligibility. Six were inaccessible. Eleven further records were retrieved through citation
searching; four were assessed for inclusion following title and abstract screening, and three of these
were excluded. Twenty-seven reports from 23 primary studies were included.
eConsult, UK26,31–33,40,45 Online questionnaire initiated by patients with responses via email, text,
or synchronous consultations (telephone or face-to-face).
Responses next working day.
Docly, UK42 Online questionnaire with included decision support algorithms and
responses from GPs via secure messaging within the portal.
Digital dialogue with the GP, Norway39 Electronic consultation with GPs through online portal.
Part of a wider online service that also offered non-clinical services to
patients.
Email (n = 2)49,57
Figure 2 summarises screening and Supplementary Table S2 details reasons for exclusion at full
text.
Study characteristics
Studies were from the UK (n = 9), the US (n = 5), Spain (n = 2), Sweden (n = 1), Switzerland (n = 1),
The Netherlands (n = 1), Republic of Ireland (n = 1), Norway (n = 1), Canada (n = 1), and Israel (n = 1).
Designs included the following (some studies used more than one design): interview studies (n =
8); cross-sectional surveys (n = 8); free-text responses (n = 3); cross-sectional data (n = 2); qualitative
data (n = 2); and cohort studies (n = 10).
Three studies compared the COVID-19 pandemic period with the period before the pandemic,25–28
and one addressed only the pandemic period.27
Supplementary Table S1 details study characteristics.
face consultations,31–39 but use was reported across all age groups. Two studies found socioeconomic
factors had no effect on uptake,31–33,40 whereas others reported differences in use between religious
and ethnic groups,25 higher uptake from patients in rural areas,28,41 and higher uptake from patients
with higher education levels.39
Study quality
Studies had appropriate designs to address their aims. However, owing to many being observational,
non-response bias was a limitation. This means their results cannot be assumed to be representative
of study populations, which is important to consider when interpreting the results of this review,
which offers a descriptive overview of existing evidence and suggests where gaps lie. More significant
limitations include omissions in methodology, such as overlooking confounders or reasons for missing
data. Qualitative studies lacked details of data saturation.
Supplementary Table S1 includes study specific comments and Supplementary Table S3 details
critical appraisals.
Timeliness
Most asynchronous platforms were available 24 hours, 7 days a week. Some had expected response
times, ranging from 15 minutes34,35 to 48 hours.43 Two studies found patients completing virtual
consultations reported shorter symptom durations before consultation than those who had face-to-
face consultations.36,37
Effectiveness
Diagnoses and investigations
One study found diagnoses were made based on symptoms following 25% of asynchronous
consultations, compared with 14.2% of face- face consultations.34,35 Face-to-face consultations
to-
resulted in more investigations, but more inappropriate diagnoses.37
36
Prescriptions
One study found 58% of patients received a prescription following asynchronous consultation;44 for
example, antibiotics, birth control, and respiratory medications. Antibiotic prescriptions were in line
with guidelines more often following e-consultations than face-to-face consultations and fewer were
prescribed following e-consultations.34–37
Efficiency
Comparison with other consultation types
E-consultations were considered by GPs in one study as potentially being able to replace 55–88% of
face-to-face consultations.46,47 Timewise, they take between 2.5 and 10 minutes, so are equivalent to
telephone and face-to-face consultations.30,40
One study reported 21% of practices previously used electronic messaging but stopped; it is
unclear why.49
Costs
Costs or savings would be influenced by the efficiency of systems, as this determines whether other
consultation types have been replaced, potentially saving resources for practices and staff. An
economic evaluation of eConsult found no added costs, but they were unable to tell if savings were
made owing to low usage.40 Otherwise, costs were poorly reported.
Equity
Equity is not widely reported. Qualitative evidence suggested asynchronous telemedicine could
improve access to general practice for patients with hearing difficulties, and those who are housebound
or have caring responsibilities.29,48 Concerns included digitally excluded patients and reinforcing
health inequities.31–33,43,48
Patient-centredness
Eight studies reported benefits for patients, including convenience, as asynchronous consultations can
be completed out of hours and at home, saving an average of 1 hour in travel, waiting and consultation
time, and travel costs. Patients reported faster responses and improved quality of treatment.39 One
study reported asynchronous telemedicine promoted patient engagement and empowerment.50
Negative effects included increased responsibility for patients and laborious questionnaires.
in March 2020 to 33.1 per 1000 patients in June 2020 in one healthcare system.28 Despite increased
use, only 32% of practices in The Netherlands intended to continue using e-consultations.27
Average asynchronous telemedicine users during the pandemic were younger, more likely to be
employed. and had fewer chronic diseases than average users before the pandemic,28 and the gap
between numbers of female and male users increased.26
Table 3 provides a synthesis of results and the gaps in the evidence base identified in this review.
Discussion
Summary
Asynchronous telemedicine is used by a range of staff and patients worldwide. It can be effective in
making diagnoses, prescribing medications, and takes equivalent time to face-to-face and telephone
consultations. For patients, it can provide timely access to general practice and save on travel time and
costs. Hindrances to efficiency are reported, such as increased clinical and administrative workload
and barriers to workflow, such as poor usability. Safety and equity are poorly reported, but concerns
include consent, confidentiality, and reinforcing health inequalities. Its use increased rapidly following
the pandemic outbreak in March 2020.
Identify types of asynchronous telemedicine used in • Online platforms are most used. Text • Unclear why implementation differed between
general practice. messages and email also used. practices.
• Implementation differed between • Unclear whether groups of healthcare staff
countries, platforms, and sometimes are more or less likely to use asynchronous
practices or individual clinicians. telemedicine.
• Used by a range of general practice staff. • Reasons for younger people and female
• Use reported across all patient patients using asynchronous telemedicine
demographics. Used more by females more than older people and male patients are
and younger people. needed.
• Unclear whether demographic factors, such as
religion, ethnic group, socioeconomic status,
and geographical location, affects use.
Assess how asynchronous Safety • No differences in numbers of • Not widely reported in included studies.
telemedicine in general patients admitted to hospital or • Studies using clear clinical end-point safety
practice performs on each seeking emergency care according to measures are required.
domain of healthcare consultation type.
quality. • Concerns surrounding consent and
confidentiality.
Timeliness • Many platforms available 24 hours, 7 days • Response times often poorly reported.
a week, with clear response times up to
48 hours.
• Patients reported shorter symptom
duration before asynchronous
consultation.
Effectiveness • More accurate diagnoses made and • Unclear whether clinicians felt patient
fewer investigations. queries were resolved during asynchronous
• Range of prescriptions issued. consultation.
• Antibiotic prescriptions more often in line • Reasons for unresolved queries are unclear.
with guidelines. • Owing to range in reported follow-up rates
• Patients reported resolution of queries (25.8%–66.1%) we cannot know if other
in many cases, but fewer felt able to consultation rates (face-to-face or telephone)
provide all relevant information. are being reduced.
• Many follow-ups were face-to-face or
telephone.
• Many clinicians felt confident dealing
with asynchronous consultations.
Efficiency • Two studies reported asynchronous • Unclear what type of consultations can and
telemedicine could replace more than cannot be carried out asynchronously and
half of face-to-face consultations. reasons for this.
• They take equivalent length of time to • Contradictory reports of increased workflow
face-to-face and telephone consultations. but also time savings for clinical and
• Reports of additional workload for clinical administrative staff.
and administrative staff, but also reports • Unclear why there is a lack of usability and
of time savings. information flow, whether problems with the
• Barriers to improved workflow: poor platform or its implementation.
communication, lack of usability, and • Reasons for patient non-adherence.
information flow. • Further economic evaluation is required.
• Patient non-adherence negatively affects
workflow.
• One economic evaluation reported no
added cost but unable to tell whether
there are savings.
Equity • Qualitative evidence suggests improved • Not widely reported in included studies.
access for some groups. • Further studies are required to identify whether
• Concerns regarding digitally excluded specific groups are excluded and advantaged
patients and reinforcing existing health or disadvantaged by using asynchronous
inequities. telemedicine.
Patient-centredness • Reports of benefits: convenience, savings • Patient involvement in design of platforms to
in travel time and costs, faster treatment. ensure usability clear.
• Increased engagement and
empowerment.
• Reports of questionnaires being
laborious.
Table 3 Continued
Objective Evidence Gaps
Describe how asynchronous telemedicine use has • Huge increase in use of asynchronous • Unclear whether increased use has been
changed since the COVID-19 pandemic outbreak in telemedicine from March 2020. maintained.
March 2020. • Allowed face-to-face consultations to be • Reasons for younger people and female
avoided. patients using asynchronous telemedicine
• Users were younger, employed, with more are needed.
fewer chronic conditions, and more
female patients.
sustainability. This is important in the NHS as UK-based studies reported patient non-adherence to
asynchronous systems.26,30–33,40,43,45
A standardised approach will be influenced by further research into the implementation of
asynchronous telemedicine in general practice. This is of importance as there were reports of practices
stopping using asynchronous telemedicine,27,49 problems with workflow, and increased workload
despite reports suggesting it can replace face-to-face consultations, which could all be influenced by
its implementation. Further, the COVID-19 pandemic offered a unique opportunity for asynchronous
telemedicine to be studied as there was huge widespread implementation, and it is unclear whether
this has been maintained.
Future research should address the safety, economic costs, time savings, and whether specific
groups are advantaged or disadvantaged by using asynchronous telemedicine. This should be through
high quality large-scale studies, such as randomised control trials and observational or cross-sectional
studies, using clear clinical end-point outcomes.
In conclusion, asynchronous telemedicine, such as online platforms, text, and email, is used in
general practice worldwide by many staff and patients. It can provide effective, efficient, and timely
care, and benefits for patients. Increased workload for staff and barriers to efficient workflow are
reported. The COVID-19 pandemic led to rapid increases in asynchronous telemedicine use. Further
evaluation of cost-effectiveness, equity, and safety of asynchronous telemedicine is required, and
studies of its implementation will inform future policy and enable sustainable practice.
Funding
This systematic review was carried out as part of CL's intercalated research project for an under-
graduate BSc in Population Medicine (Cardiff University School of Medicine). The views expressed
in the article submitted are those of the contributing authors and are not the official views of Cardiff
University School of Medicine or Division of Population Medicine.
Ethical approval
This study is a systematic review of the literature so there are no research elements that require
ethical approval.
Provenance
Freely submitted; externally peer reviewed.
Data
The dataset relied on in this article is fully avaliable in the results and supplementary materials.
Acknowledgements
Elizabeth Gillen (Information Specialist, Cardiff University School of Healthcare Sciences) for her
guidance in designing the search strategy for this review.
References
1. Greiwe J. Telemedicine lessons learned during the COVID-19 pandemic. Curr Allergy Asthma Rep 2022; 22(1): 1–5.
DOI: https://doi.org/10.1007/s11882-022-01026-1
2. Hutchings R. The impact of COVID-19 on the use of digital technology in the NHS. London: Nuffield Trust; 2020.
3. Institute of Medicine (US) Committee on Quality of Health Care in America. Crossing the quality chasm: a new
health system for the 21st century. Washington, DC: National Academies Press (US); 2001.
4. NHS England. NHS long term plan 2019. https://www.longtermplan.nhs.uk/ (accessed 14 Nov 2023).
5. Welsh Government. Our programme for transforming and modernising planned care and reducing waiting lists in
Wales. Cardiff: Welsh Government; 2022.
6. American Medical Association. Telehealth resource center: definitions 2021. https://www.ama-assn.org/practice-
management/digital/telehealth-resource-center-definitions (accessed 14 Nov 2023).
7. Elliott T, Yopes MC. Direct-to-consumer telemedicine. J Allergy Clin Immunol Pract 2019; 7(8): S2213-
2198(19)30599-9): 2546–2552: . DOI: https://doi.org/10.1016/j.jaip.2019.06.027
8. Edwards D, Csontos J, Gillen L, et al. A rapid review of the effectiveness of remote consultations versus face-to-
face consultations in secondary care surgical outpatient settings [Preprint]. medRxiv 2022.medRxiv DOI: https://
doi.org/10.1101/2022.09.04.22279537
9. West HJ, Barzi A, Wong D. Telemedicine in cancer care beyond the COVID-19 pandemic: oncology 2.0? Curr Oncol
Rep 2022; 24(12): 1843–1850. DOI: https://doi.org/10.1007/s11912-022-01332-x
10. Farrell A, George N, Amado S, Wozniak J. A systematic review of the literature on telepsychiatry for bipolar
disorder. Brain Behav 2022; 12(10): e2743. DOI: https://doi.org/10.1002/brb3.2743
11. Deshpande A, Khoja S, Lorca J, et al. Asynchronous telehealth: a scoping review of analytic studies. Open Med
2009; 3(2): e69–e91.
12. Goyder C, Atherton H, Car M, et al. Email for clinical communication between healthcare professionals. Cochrane
Database Syst Rev 2015; CD007979. DOI: https://doi.org/10.1002/14651858.CD007979.pub3
13. Fuster-Casanovas A, Vidal-Alaball J. Asynchronous remote communication as a tool for care management in
primary care: a rapid review of the literature. Int J Integr Care 2022; 22(3): 7. DOI: https://doi.org/10.5334/ijic.
6489
14. Mold F, Hendy J, Lai Y-L, de Lusignan S. Electronic consultation in primary care between providers and patients:
systematic review. JMIR Med Inform 2019; 7(4): e13042. DOI: https://doi.org/10.2196/13042
15. Goodwin N, Dixon A, Poole T, Raleigh V. Improving the quality of care in general practice. London: The King’s
Fund; 2011.
16. Oliver D. David Oliver: Facts the Daily Mail omits in its GP bashing. BMJ 2022; 377: 1091. DOI: https://doi.org/10.
1136/bmj.o1091
17. Davis N. Fear of contacting GPs during Covid outbreak “fueling missed diagnoses.” The Guardian. 23 September
2020; https://www.theguardian.com/society/2020/sep/23/fear-of-contacting-gps-during-covid-outbreak-fuelling-
missed-diagnoses (accessed 15 Nov 2023).
18. Rees J. GP appointments: Patients 'compete' when phones open. BBC News. 2021; https://www.bbc.co.uk/news/
uk-wales-58804594 (accessed 15 Nov 2023).
19. PRISMA. Preferred Reporting Items for Systematic Reviews and Meta-Analyses 2020. https://www.prisma-
statement.org/ (accessed 15 Nov 2023).
20. Higgins JPT, Thomas J, Chandler J, et al. Cochrane Handbook for systematic reviews of interventions version 64
2023. www.training.cochrane.org/handbook (accessed 15 Nov 2023).
21. The EndNote Team. Endnote 20. Philedelphia, PA: Clarivate; 2013.
22. Hong QN, Fàbregues S, Bartlett G, et al. Mixed methods appraisal tool (MMAT) version 2018 for information
professionals and researchers. EFI 2018; 34(4): 285–291. DOI: https://doi.org/10.3233/EFI-180221
23. Critical Appraisal Skills Programme. CASP checklists 2022. https://casp-uk.net/casp-tools-checklists/ (accessed 15
Nov 2023).
24. Centre for Reviews and Dissemination (CRD). Systematic reviews: CRD’s guidance for undertaking reviews in health
care 2009. https://www.york.ac.uk/media/crd/Systematic_Reviews.pdf#page=60 (accessed 15 Nov 2023).
25. Miron O, Wolff Sagy Y, Yaron S, et al. Trends in the volume and types of primary care visits during the two years
of the COVID-19 pandemic in Israel. Int J Environ Res Public Health 2022; 19(17): 10601. DOI: https://doi.org/10.
3390/ijerph191710601
26. Jones RB, Tredinnick-Rowe J, Baines R, et al. Use and usability of GP online services: a mixed-methods sequential
study, before and during the COVID-19 pandemic, based on qualitative interviews, analysis of routine eConsult
usage and feedback data, and assessment of GP Websites in Devon and Cornwall, England. BMJ Open 2022;
12(3): e058247. DOI: https://doi.org/10.1136/bmjopen-2021-058247
27. Keuper J, Batenburg R, Verheij R, van Tuyl L. Use of E-health in Dutch general practice during the COVID-19
pandemic. Int J Environ Res Public Health 2021; 18(23): 12479. DOI: https://doi.org/10.3390/ijerph182312479
28. Solans O, Vidal-Alaball J, Roig Cabo P, et al. Characteristics of citizens and their use of teleconsultations in primary
care in the Catalan public health system before and during the COVID-19 pandemic: retrospective descriptive
cross-sectional study. J Med Internet Res 2021; 23(5): e28629. DOI: https://doi.org/10.2196/28629
29. Quinlan D, Dahm M, Lyons A, Collins C. Patient texting in general practice: who, why, why not? A national survey of
text messaging in Irish general practice. Ir Med J 2018; 111(4): 729.
30. Casey M, Shaw S, Swinglehurst D. Experiences with online consultation systems in primary care: case study of one
early adopter site. Br J Gen Pract 2017; 67(664): e736–e743. DOI: https://doi.org/10.3399/bjgp17X693137
31. Banks J, Farr M, Salisbury C, et al. Use of an electronic consultation system in primary care: a qualitative interview
study. Br J Gen Pract 2018; 68(666): e1–e8. DOI: https://doi.org/10.3399/bjgp17X693509
32. Edwards HB, Marques E, Hollingworth W, et al. Use of a primary care online consultation system, by whom, when
and why: evaluation of a pilot observational study in 36 general practices in South West England. BMJ Open 2017;
7(11): e016901. DOI: https://doi.org/10.1136/bmjopen-2017-016901
33. Farr M, Banks J, Edwards HB, et al. Implementing online consultations in primary care: a mixed-method evaluation
extending normalisation process theory through service co-production. BMJ Open 2018; 8(3): e019966. DOI:
https://doi.org/10.1136/bmjopen-2017-019966
34. Entezarjou A, Calling S, Bhattacharyya T, et al. Antibiotic prescription rates after eVisits versus office visits in
primary care: observational study. JMIR Med Inform 2021; 9(3): e25473. DOI: https://doi.org/10.2196/25473
35. Entezarjou A, Sjöbeck M, Midlöv P, et al. Health care utilization following 'digi-physical' assessment compared to
physical assessment for infectious symptoms in primary care. BMC Prim Care 2022; 23: 4. DOI: https://doi.org/10.
1186/s12875-021-01618-2
36. Johnson KL, Dumkow LE, Salvati LA, et al. Comparison of diagnosis and prescribing practices between virtual visits
and office visits for adults diagnosed with uncomplicated urinary tract infections within a primary care network.
Infect Control Hosp Epidemiol 2021; 42(5): 586–591. DOI: https://doi.org/10.1017/ice.2020.1255
37. Johnson KM, Dumkow LE, Burns KW, et al. Comparison of diagnosis and prescribing practices between virtual visits
and office visits for adults diagnosed with sinusitis within a primary care network. Open Forum Infect Dis 2019; 6(9):
ofz393. DOI: https://doi.org/10.1093/ofid/ofz393
38. Stamenova V, Agarwal P, Kelley L, et al. Uptake and patient and provider communication modality preferences of
virtual visits in primary care: a retrospective cohort study in Canada. BMJ Open 2020; 10(7): e037064. DOI: https://
doi.org/10.1136/bmjopen-2020-037064
39. Zanaboni P, Fagerlund AJ. Patients' use and experiences with E-consultation and other digital health services with
their general practitioner in Norway: results from an online survey. BMJ Open 2020; 10(6): e034773. DOI: https://
doi.org/10.1136/bmjopen-2019-034773
40. Cowie J, Calveley E, Bowers G, Bowers J. Evaluation of a digital consultation and self-care advice tool in primary
care: a multi-methods study. Int J Environ Res Public Health 2018; 15(5): 896. DOI: https://doi.org/10.3390/
ijerph15050896
41. Powell KR, Deroche C. Predictors and patterns of portal use in patients with multiple chronic conditions. Chronic
Illn 2020; 16(4): 275–283. DOI: https://doi.org/10.1177/1742395318803663
42. Nijhof D, Ingram A, Ochieng R, et al. Examining GP online consultation in a primary care setting in East Midlands,
UK. BMC Health Serv Res 2021; 21(1): 1030. DOI: https://doi.org/10.1186/s12913-021-07039-2
43. Murphy M, Scott LJ, Salisbury C, et al. Implementation of remote consulting in UK primary care following the
COVID-19 pandemic: a mixed-methods longitudinal study. Br J Gen Pract 2021; 71(704): e166–e177. DOI: https://
doi.org/10.3399/BJGP.2020.0948
44. Penza KS, Murray MA, Pecina JL, et al. Electronic visits for minor acute illnesses: analysis of patient demographics,
prescription rates, and follow-up care within an asynchronous text-based online visit. Telemed J E Health 2018;
24(3): 210–215. DOI: https://doi.org/10.1089/tmj.2017.0091
45. Carter M, Fletcher E, Sansom A, et al. Feasibility, acceptability and effectiveness of an online alternative to face-to-
face consultation in general practice: a mixed-methods study of webGP in six Devon practices. BMJ Open 2018;
8(2): e018688. DOI: https://doi.org/10.1136/bmjopen-2017-018688
46. López Seguí F, Vidal-Alaball J, Sagarra Castro M, et al. General practitioners' perceptions of whether
teleconsultations reduce the number of face-to-face visits in the Catalan public primary care system: retrospective
cross-sectional study. J Med Internet Res 2020; 22(3): e14478. DOI: https://doi.org/10.2196/14478
47. López Seguí F, Walsh S, Solans O, et al. Teleconsultation between patients and health care professionals in the
Catalan primary care service: message annotation analysis in a retrospective cross-sectional study. J Med Internet
Res 2020; 22(9): e19149. DOI: https://doi.org/10.2196/19149
48. Turner A, Morris R, Rakhra D, et al. Unintended consequences of online consultations: a qualitative study in UK
primary care. Br J Gen Pract 2022; 72(715): e128–e137. DOI: https://doi.org/10.3399/BJGP.2021.0426
49. Brant H, Atherton H, Ziebland S, et al. Using alternatives to face-to-face consultations: a survey of prevalence
and attitudes in general practice. Br J Gen Pract 2016; 66(648): e460–e466. DOI: https://doi.org/10.3399/
bjgp16X685597
50. Hoonakker PLT, Carayon P, Cartmill RS. The impact of secure messaging on workflow in primary care: results of a
multiple-case, multiple-method study. Int J Med Inform 2017; 100: S1386-5056(17)30004-7: 63–76: . DOI: https://
doi.org/10.1016/j.ijmedinf.2017.01.004
51. Michaud TL, Zhou J, McCarthy MA, et al. Costs of home-based telemedicine programs: a systematic review. Int J
Technol Assess Health Care 2018; 34(4): 410–418. DOI: https://doi.org/10.1017/S0266462318000454
52. Batsis JA, DiMilia PR, Seo LM, et al. Effectiveness of ambulatory telemedicine care in older adults: a systematic
review. J Am Geriatr Soc 2019; 67(8): 1737–1749. DOI: https://doi.org/10.1111/jgs.15959
53. Mechanic OJ, Persaud Y, Kimball AB. Telehealth systems. Treasure Island, FL: StatPearls Publishing; 2022.
54. Scott Kruse C, Karem P, Shifflett K, et al. Evaluating barriers to adopting telemedicine worldwide: a systematic
review. J Telemed Telecare 2018; 24(1): 4–12. DOI: https://doi.org/10.1177/1357633X16674087
55. NHS England. Telemedicine 2022. https://www.datadictionary.nhs.uk/nhs_business_definitions/telemedicine.
html#:~:text=COMMUNICATION%20CONTACT%20METHOD.-,Telemedicine%20is%20the%20use%20of%
20telecommunication%20and%20information%20technology%20for,mobile%20phones%2C%20computers%
20and%20tablets (accessed 14 Nov 2023).
56. Gregory S. General practice in England: an overview. London: The King’s Fund; 2009.
57. Dash J, Haller DM, Sommer J, Junod Perron N. Use of email, cell phone and text message between patients and
primary-care physicians: cross-sectional study in a French-speaking part of Switzerland. BMC Health Serv Res 2016;
16(1): 549. DOI: https://doi.org/10.1186/s12913-016-1776-9