Skip to main content
Download PDF

Making remote measurement technology work in multiple sclerosis, epilepsy and depression: survey of healthcare professionals

BMC Medical Informatics and Decision Making volume 22, Article number: 125 (2022) Cite this article

Abstract

Background

Epilepsy, multiple sclerosis (MS) and depression are long term, central nervous system disorders which have a significant impact on everyday life. Evaluating symptoms of these conditions is problematic and typically involves repeated visits to a clinic. Remote measurement technology (RMT), consisting of smartphone apps and wearables, may offer a way to improve upon existing methods of managing these conditions. The present study aimed to establish the practical requirements that would enable clinical integration of data from patients’ RMT, according to healthcare professionals.

Methods

This paper reports findings from an online survey of 1006 healthcare professionals currently working in the care of people with epilepsy, MS or depression. The survey included questions on types of data considered useful, how often data should be collected, the value of RMT data, preferred methods of accessing the data, benefits and challenges to RMT implementation, impact of RMT data on clinical practice, and requirement for technical support. The survey was presented on the JISC online surveys platform.

Results

Among this sample of 1006 healthcare professionals, respondents were positive about the benefits of RMT, with 73.2% indicating their service would be likely or highly likely to benefit from the implementation of RMT in patient care plans. The data from patients’ RMT devices should be made available to all nursing and medical team members and could be reviewed between consultations where flagged by the system. However, results suggest it is also likely that RMT data would be reviewed in preparation for and during a consultation with a patient. Time to review information is likely to be one of the greatest barriers to successful implementation of RMT in clinical practice.

Conclusions

While further work would be required to quantify the benefits of RMT in clinical practice, the findings from this survey suggest that a wide array of clinical team members treating epilepsy, MS and depression would find benefit from RMT data in the care of their patients. Findings presented could inform the implementation of RMT and other digital interventions in the clinical management of a range of neurological and mental health conditions.

Peer Review reports

Background

Epilepsy, multiple sclerosis (MS) and depression are long term conditions which have a significant impact on the everyday lives of patients who live with them. Epilepsy is a common neurological condition [1] characterised by repeated seizures which may or may not have a motor component. People with epilepsy are at risk of sudden unexpected death in epilepsy (SUDEP), which has an incidence of 1.16 deaths per thousand people with epilepsy [2]. MS is a neurological condition in which the brain is affected by plaques, which appear in conjunction with ‘attacks’ which cause deterioration in cognitive and physical functioning [3]. MS has a relapsing–remitting form and a progressive form, both of which have a significant impact on the lives of those who live with them. Depression is the most common mental illness [4] and is characterised by periods of low mood, low motivation, anhedonia, excessive/insufficient sleep, poor/excessive appetite, and tiredness [5].

The management of all three of these central nervous system disorders typically involves repeated contact with healthcare professionals (HCPs), in which the patient’s symptoms are evaluated and any treatment they are receiving is reviewed. However, the evaluation of patients’ symptoms is problematic in each of these conditions. In epilepsy, there is poor accuracy of patient-provided seizure records [6], while measures for depression require patients to recall their mental states over long time periods although their recall may be affected by present mental state [7]. In MS, some patients struggle to evidence changes in their condition that they have noticed in the standard tests offered at clinic. Depression is common in MS, though it is frequently undetected [8].

Remote measurement technology (RMT) may offer a way to improve upon existing methods of managing these three conditions. RMT consists of digital technologies (apps and wearables) used to record active (user-inputted) and passive (auto-recorded) data which may provide information about a patient’s condition. Research has begun to explore the potential of RMT in applications to mood monitoring in depression and bipolar disorder [9,10,11], seizure detection in epilepsy [12, 13] and functional assessment of multiple sclerosis via smartphone apps [14].

Over 6 years, the RADAR-CNS (Remote Assessment of Disease and Relapse – Central Nervous System) project seeks to explore the feasibility of the use of RMT in the care of patients with epilepsy, MS or depression. In addition to three, large-scale observational studies using RMT to collect passive and active data from patients with each of the conditions in home (MS, epilepsy, depression) and hospital (epilepsy) settings [15,16,17], the project has involved studies to understand the perspectives of HCPs on ways these technologies could fit into clinical pathways [18, 19]. This paper builds on a prior interview study within the same project where HCP interviewees indicated multiple types of data that could be collected using RMT which would be useful in the management of patients with epilepsy, MS or depression [18]. Findings also showed that RMT data would be useful at specific times, including: initial referral into the care pathway; after any changes in treatment; and prior to routine appointments once the condition was stable. Interviewees considered it important that primary care teams, specialist nurses and all clinical, but not administrative, members of a team, should have access to RMT data from patients, preferably via the electronic patient record. They also indicated that it would be essential for clinicians to have knowledge of the margins of error of any predictions or measures made using RMT data.

Other prior research exploring clinicians’ experiences of RMT has shown that RMT data can enable clinicians to delegate tasks to suitably qualified but more junior staff, reducing their own workload [20, 21]. However, in the specific case of epilepsy, healthcare professionals have suggested that RMT may in fact increase workload and may cause increased patient anxiety [22]. In the area of mental health, clinicians have raised concerns about the reliability and accuracy of sleep and mood tracking apps, although they recognise their potential in facilitating the collection of routine data [23]. Clinicians treating multiple sclerosis have commented on the potential to collect more in-depth data from patients using wearable devices than can be collected in clinic [24]. However, it has been proposed that a number of paradigm shifts will be required for clinicians to integrate remote measurement technology into their work, including the set-up of virtual offices from which clinicians can operate, and a shift toward continuity of data exchange and connection between patients and their clinical team [25]. Despite this need for important changes in the way clinicians work to implement RMT, no research to date has explored at scale the views of healthcare professionals on the practical requirements for, and value of, introducing RMT in central nervous system disorders.

This paper reports the findings of an online survey of healthcare professionals (HCPs) exploring views on the potential application of RMT in clinical pathways for the management of MS, epilepsy and depression in Europe. The aim of the study was to understand the potential value of RMT data in clinical pathways, and the practical requirements for its implementation, including potential barriers to use, from the perspective of healthcare professionals in Europe. Initial findings from the first half of this survey have been published [26], including that use of smartphones for clinical purposes is widespread among clinicians (60%), that the majority of respondents (76%) had experience of treating patients who use RMT, and that data from these devices has an impact on their clinical practice. This paper reports the findings from the second part of the survey, setting out the types of data considered useful in each condition, the potential for benefit, the points at which HCPs can envisage using the data, as well as perceived requirements for training and potential challenges to implementation. These are considered in the context of clinical pathways for the care of epilepsy, MS and depression in Europe.

Methods

Design

Survey methodology was considered appropriate to source data at scale from a range of HCPs working in the care of people with epilepsy, MS or depression. Surveys are useful to allow clinicians to provide their views without spending too long doing so and to allow them to take part at a time of their choosing [27]. The survey was presented on the JISC Online Surveys platform [28]. The survey instrument consisted of 26 questions, including both short, free text response items and closed questions. The full survey is provided in Additional file 1. Ethical approval was granted by the University of Nottingham Research Ethics Committee (ref 277-1802).

Demographic information was collected on age, clinical specialism, job role, clinical setting and country of work. There were seven further sections to the survey, covering: current use of digital services and devices; using digital devices for long term monitoring; the value of RMT; access to and use of data; technical support requirements; and closing remarks, for final additional comments. The selection of questions included in the survey was informed by expert elicitation, in which clinical academic members of the project consortium were invited to suggest areas where gathering the opinions of a large number of HCPs would be useful.

Recruitment was conducted via the East Midlands Clinical Research Network, and by inviting the RADAR-CNS research consortium to pass details of the study on to their clinical colleagues. The Clinical Research Network advertised the study to all healthcare trusts across the United Kingdom. Twenty trusts contacted the research team about the study, and 17 of these advertised the survey to their staff. The survey was also disseminated via official online social media accounts, via the consortium website (www.radar-cns.org) and in project newsletters. The original target set for recruitment was 100 responses, with a minimum of 30 respondents per condition. Within each condition, we sought to recruit 10 medical staff, 10 nursing staff and 10 members of the wider multidisciplinary team. As we expected only to use descriptive statistics to analyse the data, we did not calculate a sample size calculation. The first response was received on the 4th February 2019 and the last was received on the 30th March 2020. Respondents were required to complete the survey in a single sitting. Completion took around 15 min. Inclusion criteria were that the respondent was a healthcare professional and that they currently worked in the care of people with epilepsy, MS or depression.

Analysis

Quantitative data were analysed using frequencies, percentages and chi-squared analyses. Confidence intervals for proportions were calculated at the 95% level. Qualitative results from free text boxes were analysed using content analysis to identify commonalities. The aim of collecting free text qualitative data was to allow respondents to provide additional descriptive detail or context to answers. Microsoft Excel, IBM SPSS 26 and Stata SE 16 were used for analysis and to generate graphs, with confidence intervals calculated in Stata SE 16 and chi square tests computed in IBM SPSS 26.

Results

After removing 3 entries in data cleaning for insincere completion of the questionnaire or improper completion of the consent form, 1006 completed survey responses were analysed, greatly exceeding our target for recruitment. Table 1 presents demographic data from participants who responded to the survey. Job role and country were free text responses which were subsequently categorised. Age and clinical setting were discrete choice items, while specialism was a multi-select item, where respondents selected all that applied (Additional file 1). The majority of responses, 974/1006 (96.8%), were from clinicians working in the United Kingdom (UK). A broad range of ages were represented from age 18 upwards, with the greatest number (293/1006, 29.3%) in the 41–50 category and fewest (52/1006, 5.2%) in the 60+ category. A wide range of specialisms responded to the survey (respondents could select more than one), with greater representation from mental health roles (587/1006, 58.3%). Job roles were similarly diverse, with representation from all major job families. In terms of clinical setting, the least representation was from tertiary specialist care centres (54/1006, 5.4%), while the highest was from staff in mental health trust outpatients in secondary care (254/1006, 25.2%).

Table 1 Demographics of respondents to the survey
Full size table

Presentation of the results

Responses to the first part of the survey, questions 1–10, covered informed consent and respondents’ current use of RMT and apps in clinical practice. These results are presented elsewhere [26]. The remaining data from the main survey (from questions 11–24) are grouped into four general areas, ‘RMT data types of interest’, ‘Accessing RMT data in patient care’, ‘Benefits and challenges to patients using RMT’, and ‘Training required to make use of RMT’. These are each presented below.

RMT data types of interest

Questions 11, 11a and 12 asked respondents to indicate whether they would consider certain types of data to be useful in the management of epilepsy, MS or depression and provided space for free text suggestions. Results from questions 11 and 12 showed that body movements, heart rate, environmental features, sleep quality, mood, concentration, attention and memory were considered useful to monitor across all three conditions. In addition, free text responses to question 11a suggested it could be beneficial to monitor exercise, nutrition (including alcohol consumption), anxiety, social contact and adherence to treatment regimes (including medication).

Some data types were considered helpful only in one or two of the conditions (Fig. 1). Further to the data types deemed useful in all conditions, respondents in epilepsy considered it useful to monitor breathing rate, sweating and skin temperature. In multiple sclerosis specific data types considered useful were breathing rate, voice quality and skin temperature. In depression, clinicians considered it important to measure smartphone usage.

Fig. 1
figure 1

Respondents’ views on the usefulness of different (pre-selected) types of data that could be collected using RMT, across three different central nervous system disorders (Question 11). Percentages plotted here are results of subtracting percentage of ‘no’ responses from percentage of ‘yes’ responses in each data type and each condition. Thus bars above the x axis show items with a greater number of ‘yes’ responses, while bars below the x axis show items with a greater number of ‘no’ responses

Full size image

Question 13 asked respondents to indicate how often it would be useful to collect self-reported mood data from patients. Figure 2 shows how responses to this question varied according to specialism. The majority of responses indicated that daily or weekly mood reports would be most preferable. Among mental health professionals, a greater percentage of respondents indicated that daily mood reports would be useful compared to weekly reports. The same pattern was not observed among neurology specialists.

Fig. 2
figure 2

Frequency of mood reports considered useful (Question 13). Chart shows percentages of each (summarised) specialism selecting each answer

Full size image

Accessing RMT data in patient care

Questions 14, 16, 17 and 18 asked respondents to consider who in their clinical team would access RMT data (Q14), when in a patient’s care the data would be most useful (Qs 16 & 17), and how clinicians would prefer to access the data (Q18). Table 2 shows data from question 14, regarding members of a clinical team who would make use of RMT data. Nurses were considered best placed to benefit from the data, although it was considered by 116/1006 (11.5%) of respondents that all medical staff members would be able to benefit.

Table 2 Responses to question 14, a free text question on clinical team members considered able to benefit from RMT data in their work. Similar responses were grouped, and groups with greater than a threshold of 10 occurrences in the data were included in this table
Full size table

In response to Question 16, the majority of those responding confirmed that there were specific decision points relying on mood-based variables (599/946, 63.3%) and specific decision points relying on relapse/seizure measures (495/857, 57.8%) where remote measurement data would be useful in their clinical practice. Respondents were less confident of the benefits from remote measurement data in informing decision points that were not specific to relapse or that relied on contextual factors.

Results from question 17 showed that a majority of respondents considered it likely or highly likely that they would access RMT data at each of the given times in the question (in preparation for a consultation with a patient (568/978, 58.1%), during a consultation with a patient (602/982, 61.3%), in between consultations if the system were to flag up data/reasons for concern (583/970, 60.1%), and post medical event e.g. seizure and/or relapse (620/949, 65.3%)). The highest proportion of ‘highly likely’ responses was recorded for reviewing data following a medical event such as a seizure (267/949, 28.1%), indicating that this was the occasion when RMT data would be considered most useful. Question 18 asked participants to rank four pre-determined ways of accessing RMT data. The results showed a similar level of preference assigned to all four suggested ways of accessing the data, with mean averages of rankings for all four options falling between 1.9 and 2.5 (1: most preferred to 4: least preferred).

Benefits and challenges to patients using RMT

Question 15 asked respondents to indicate whether they considered the use of RMT in patients’ care plans would benefit their healthcare organisation. On a 5-item response scale from ‘highly likely to benefit’ to ‘highly unlikely to benefit’, 511/994 item respondents (50.8%) indicated their service would be ‘likely to benefit’, with 217/994 (21.6%) considering it ‘highly likely’. A chi squared test showed that there were significant differences between job roles (χ2 = 92.452, p < 0.001). Figure 3 shows a breakdown of these results by job role. GPs and medical students were most likely to indicate they were ‘unsure’ whether use of RMT would benefit their healthcare organisation. GPs were also most likely to indicate it would be ‘highly unlikely’ the organisation would benefit, although this was a small proportion of respondents (n = 6/117, 5%).

Fig. 3
figure 3

Respondent views on whether their healthcare organisation would be likely to benefit from the implementation of remote measurement technologies as part of patients’ care plans (Question 15), separated by job type

Full size image

Question 19 asked respondents to rank different types of information potentially available from RMT in terms of their potential to benefit clinical practice. Analysis of the rankings showed the greatest perceived benefit to derive from ‘Information about mental health/mood measures over a long period of time’, with least benefit perceived in ‘Information about specific physiological measures over a long period of time’ (Fig. 4). Free text responses indicated that RMT would also have the benefit of increasing patients’ engagement in their own care, and thereby improve self-management.

Fig. 4
figure 4

Respondent rankings of how beneficial different types of information from remote measurement technology are likely to be in clinical practice (Question 19), from greatest perceived benefit (1, dark blue) to least (5, orange)

Full size image

Question 20 asked respondents to rank barriers associated with RMT implementation (Fig. 5). Overall, ‘time to review information’ and ‘patient anxiety related to health monitoring and access to data’ were seen as the greatest barriers associated with RMT implementation (Fig. 5). Free text responses supplemented these pre-selected items with other barriers to the implementation of RMT, which included reference to: accessibility of the technology; issues around confidentiality and data protection; patient honesty and reliability to ensure consistent use rather than use only when symptoms were more severe; patients not understanding the technology or being well enough informed to make sense of the data; and, in epilepsy specifically, that some seizure types may be more difficult to detect.

Fig. 5
figure 5

Respondent rankings of barriers related to the implementation of RMT (Question 20). Respondents ranked each from 1 to 5 where 1 indicated most concern and 5 least

Full size image

A generally positive view of the overall potential of RMT was found in responses to question 21. Some concerns were also clear, as 386/972 (39.7%) of item respondents indicated agreement or strong agreement with the statement that ‘you can have too much information about patients’ health state’ (Fig. 6), however this was lower than for other items including ‘if RMT was proven to detect relapse, it has the potential to ‘free up’ resources’ (602/973, 61.9%) and ‘RMTs will help in my management of patients’ (658/976, 67.4%). This indicates that overall, respondents were more positive about the potential of RMT than they were concerned about the volume of data it would generate (Fig. 6).

Fig. 6
figure 6

Respondent opinions of the potential usefulness of patient use of RMT to monitor a condition (Question 21)

Full size image

Training requirements

Questions 22–24 asked respondents to consider the technical support requirements that they and their patients would require to be able to make best use of RMT (Fig. 7). 395 of 979 item respondents (40.3%) indicated that clinicians would require a one-off training session while 360/979 (36.8%) selected that support should be provided on an ad hoc basis. With respect to the type of support that clinicians considered patients would require, the greatest percentage of item respondents (358/981, 36.5%) indicated that patients would require ad hoc support, with 275/981 (28.0%) suggesting optional daily support would be required (Fig. 7). The preferred means of receiving technical support for RMT was by person-to-person support (Fig. 8). This was ranked highest by 638/979 respondents (65.2%).

Fig. 7
figure 7

Amount of technical support considered by healthcare professionals to be necessary for healthcare professionals and their patients for the successful implementation of RMT (Questions 22 and 24)

Full size image
Fig. 8
figure 8

Mode of technical support preferred by respondents (Question 23). Bars represent percentage of item respondents ranking each mode of support as their highest preference

Full size image

Discussion

Principal findings

This sample of survey respondents were positive about the benefits of RMT, with 73.2% (CI 70.4–76.0%) considering that their service would be likely or highly likely to benefit from implementing RMT in patient care plans. This supports prior work in this area, including our own, which has shown that clinicians are in general positively disposed toward remote measurement technology [18, 29]. The results from this survey have added to our previous work [18, 19, 26] by providing an indication of healthcare professionals’ views on how RMT could work in practice, based on a large sample. While the data from patients’ RMT devices could be reviewed between consultations if the system flagged reasons for concern, the results suggest it is also likely that RMT data would be reviewed in preparation for, and during, a consultation with a patient, or for a patient to self-manage their own condition. In relation to data access, healthcare professionals would prefer to access RMT data during consultation via the electronic patient record, indicating a requirement for patients’ data to be centrally held via a secure portal. Respondents indicated that the data collected should be made available to nursing staff and all medical team members . Time to review the information, patient adherence, and potential for increased patient anxiety are the greatest barriers to the successful implementation of RMT.

Analysis of the rankings in question 19 showed the greatest perceived benefit to derive from ‘Information about mental health/mood measures over a long period of time’, with least benefit perceived in ‘Information about physiological measures over a long period of time’, which may be expected given the relatively larger proportion of staff working in mental health care rather than neurology in the res pondent demographics.

Among the conditions covered by the survey (epilepsy, MS and depression), our survey showed sleep measurements, actigraphy (body movements), heart rate, breathing rate and measurements of ambient light and temperature to be considered useful by clinicians treating all three of the conditions. There was more variability between conditions for other measures including GPS data, skin temperature, sweating, smartphone usage and voice quality. The low rating of voice quality in depression was surprising given a growing amount of research interest in this area [30]. It may be that clinicians consider this research to be at a nascent stage or are otherwise unaware of existing tools for its measurement and analysis. For multiple sclerosis, GPS data was not considered to be helpful, perhaps because typical diagnostic indicators of MS progression, including timed walking tests, rely on measurements of gait, where actigraphy is likely to provide a greater level of resolution [31]. Data on smartphone usage was regarded as most useful in depression, which is supported by cross-sectional survey studies reporting correlates between depression symptoms and reported smartphone usage and addiction [32,33,34]. Free text responses supplemented these findings, with data on nutrition highlighted as potentially useful information across all three conditions. These findings could inform feature selection for future predictive models for use in these conditions.

Among the job roles of respondents, it was surprising to find that a large proportion of GP respondents (53/117, 45.3%) were ‘unsure’ that their healthcare organisation would benefit if RMT was used in patient care plans, particularly given that they were more likely than other health care professionals to recognise an impact on their job role from RMT data [26]. This may be because primary care is mostly local and responsive to health events as they happen, in contrast to secondary care where a strategic, longer-term view can be taken. The value of RMT may be greatest where hospital and specialist community teams (secondary and tertiary care) can use RMT as an alternative to hospital admission, specifying the most useful measurements to be taken for a patient, recording baselines, and analysing trends over time. The role of RMT may be more limited in primary care where most care involves the assessment of a patient’s immediate health presentation.

Training has been shown to increase clinicians’ familiarity with, and willingness to use, technologies in their work [35, 36]. The need for training in the use of RMT for both clinicians and patients was recognised by survey respondents. Either a one-off training session or ad hoc support would be preferable above other forms of training for HCPs to make use of RMT data and the preference would be for this to be delivered person-to-person. Authors of prior work suggest that the provision of training seminars and workshops might have a positive influence on attitudes towards healthcare technologies, since these could increase familiarity and experience with some technologies and thereby increase acceptance [37]. The present study adds to these findings by indicating the amount of training support that clinicians consider they would need in relation to RMT (one-off training/ad hoc support) and highlighting their preference for person-to-person support over instruction manuals, online videos and other media-based support.

One of the highest ranked concern s regarding the implementation of RMT in clinical practice in our study was patient adherence to use of the technology. Recent work has highlighted patients’ own concerns with regard to adhering to RMT measurement regimes, for example the bulkiness and visibility of a device meaning it could be stigmatizing [38], and the fact that responding to momentary sampling questionnaires may not fit with their lifestyle or other commitments [39]. In addition, our data show that where patients have access to their data, this may cause them anxiety, indicating a need for careful design of dashboards/apps reporting data back to patients.

Presentation of data to clinicians is similarly important, with time to review data also ranked as an important concern. Our survey explored the times that a clinician would be interested in reviewing the data from patients’ RMT, with a preference shown for accessing the data following a medical event such as a seizure. We cannot tell from these survey data what the desired level of granularity may be in the presentation of such data to the clinician. Actigraphy data is known to be complex to organise in a useful way for clinicians, with clinicians in different clinical disciplines requiring different forms of data presentation and differing levels of detail [40]. A need has been recognised to allow clinicians to focus on subsets of patient-generated data, as well as identify overall trends and present new data alongside contextual data [41]. The responses here may assume that data review requirements for both clinicians and patients will be achieved but RMT systems and corresponding dashboards may need significant development to meet these requirements.

Implications for practice

Findings from this study suggest that health care professionals are likely to be interested in using RMT in the care of patients living with MS, depression or epilepsy, once the safety, usability and cost effectiveness of these technologies have been evaluated. While some barriers to use were recognised as important to respondents in this study, our findings would suggest that clinicians remain positive about the value that RMT can offer. Findings suggest there may be less buy-in from primary care in relation to RMT and use cases for this setting will therefore need to be more clearly established. We additionally highlight clinicians’ preference for in-person training in relation to new technologies, which may be informative for those working in medical education.

In our study, RMT was recognised as a useful tool for helping patients to self-manage their condition, in addition to benefits in clinical patient management and monitoring. Self-management interventions for depression are known to be effective in improving patients’ levels of self-efficacy and in increasing self-management behaviours [42]. However, using RMT for patient self-management is not perceived by clinicians to be a suitable replacement for face-to-face care [18], and prior work has emphasised the need for discussion between patients and clinicians regarding remotely collected data for the effective use of self-management tools [43]. Thus, self-management via RMT may be seen to offer an additional benefit for patients rather than replacing any elements of face-to-face care. The benefits of this additional offer will need to be evaluated for cost effectiveness, incorporating the requirement for ad hoc/optional daily technical support for patients using RMT for self-management, as recognised by survey respondents.

Limitations

Although this survey was completed by over 1,000 healthcare professionals, it is possible there was a sampling bias toward those who have a more positive view of technology, as respondents were self-selecting. In addition, despite attempts to recruit from European countries outside the UK, there was little representation from countries other than the UK among respondents. However, respondents’ demographics showed a large range of job roles and age ranges, indicating a broad sample in these regards. We did not collect data on gender in this survey, although it may have been interesting to explore differences in views on this basis.

While the majority of questions in the survey did not specifically mention the three conditions under consideration, the external validity of the survey may be low with respect to other conditions, as the design was intended to focus only on multiple sclerosis, epilepsy and depression. However, the study results have supported and added to the findings from our prior interviews of healthcare professionals in the same clinical areas. One further limitation is that the survey was conducted prior to the COVID-19 pandemic, which may affect the reliability of the results post-pandemic. In many countries, healthcare professionals may have utilised RMT data more frequently in the absence of usual face to face clinics during lockdown restrictions. Views on the value of RMT and on its potential for implementation may have been modified through this further experience.

Conclusions

The findings from this survey suggest that a wide array of clinical team members treating epilepsy, MS and depression would benefit from RMT data from their patients, although the types of data deemed useful, and the frequency at which these should be collected, vary by condition. The main barriers to overcome prior to implementation are patient adherence, potential for increased patient anxiety and clinical time required to review the information. These findings provide a clear sense of the practical requirements for making use of RMT data in clinical practice from the perspective of healthcare professionals while also highlighting barriers where further development work is required. Further work could include comparison studies to determine the qualities of wearable devices that make them more likely to see continued usage, and explorations of how passive data could be used as a proxy for more attention-demanding active reporting tasks. Good precision in such applications of RMT may offer improved methods for collecting data from patients which is more complete and potentially also more granular. Further work in the form of pilot studies and RCTs (or alternative designs) is also required to evaluate the clinical and cost effectiveness of implementing RMT for the collection of outcome measure data in the three conditions covered here.

Availability of data and materials

The datasets used and/or analysed during the current study are not publicly available due to agreements within the research consortium but are available from the corresponding author on reasonable request and with permission of the RADAR-CNS consortium.

Abbreviations

COVID-19:

Coronavirus Disease 2019

GP:

General Practitioner

HCP:

Healthcare Professional

MS:

Multiple Sclerosis

NHS:

National Health Service

NIHR:

National Institute for Health Research

RADAR-CNS:

Remote Assessment of Disease and Relapse—Central Nervous System

RMT:

Remote Measurement Technology

SUDEP:

Sudden Unexpected Death in Epilepsy

UK:

United Kingdom

References

  1. MacDonald BK, Cockerell OC, Sander JW, Shorvon SD. The incidence and lifetime prevalence of neurological disorders in a prospective community-based study in the UK. Brain. 2000;123(Pt 4):665–76.

    Article  Google Scholar 

  2. Thurman DJ, Hesdorffer DC, French JA. Sudden unexpected death in epilepsy: assessing the public health burden. Epilepsia. 2014;55(10):1479–85.

    Article  Google Scholar 

  3. Dobson R, Giovannoni G. Multiple sclerosis – a review. Euro J Neurol. 2018;26(1):27–40. https://doi.org/10.1111/ene.13819.

    Article  Google Scholar 

  4. Liu Q, He H, Yang J, Feng X, Zhao F, Lyu J. Changes in the global burden of depression from 1990 to 2017: findings from the Global Burden of Disease study. J Psychiatr Res. 2020;126:134–40.

    Article  Google Scholar 

  5. American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-5, 5th edn; 2013.

  6. Elger CE, Hoppe C. Diagnostic challenges in epilepsy: seizure under-reporting and seizure detection. Lancet Neurol. 2018;17(3):279–88. https://doi.org/10.1016/S1474-4422(18)30038-3.

    Article  PubMed  Google Scholar 

  7. Barsky AJ. Forgetting, fabricating, and telescoping: the instability of the medical history. Arch Intern Med. 2002;162(9):981–4.

    Article  Google Scholar 

  8. Marrie RA, Horwitz R, Cutter G, Tyry T, Campagnolo D, Vollmer T. The burden of mental comorbidity in multiple sclerosis: frequent, underdiagnosed, and undertreated. Mult Scler. 2009;15(3):385–92.

    Article  CAS  Google Scholar 

  9. McIntyre RS, Best MW, Bowie CR, Carmona NE, Cha DS, Lee Y, Subramaniapillai M, Mansur RB, Barry H, Baune BT, et al. The THINC-integrated tool (THINC-it) screening assessment for cognitive dysfunction: validation in patients with major depressive disorder. J Clin Psychiatry. 2017;78(7):873–81.

    Article  Google Scholar 

  10. Goodday SM, Atkinson L, Goodwin G, Saunders K, South M, Mackay C, Denis M, Hinds C, Attenburrow MJ, Davies J, et al. The true colours remote symptom monitoring system: a decade of evolution. J Med Internet Res. 2020;22(1): e15188.

    Article  Google Scholar 

  11. Qu C, Sas C, Dauden Roquet C, Doherty G. Functionality of top-rated mobile apps for depression: systematic search and evaluation. JMIR Ment Health. 2020;7(1): e15321.

    Article  Google Scholar 

  12. Munch Nielsen J, Zibrandtsen IC, Masulli P, Lykke Sørensen T, Andersen TS, Wesenberg Kjær T. Towards a wearable multi-modal seizure detection system in epilepsy: a pilot study. Clin Neurophysiol. 2022.

  13. Zanetti R, Aminifar A, Atienza D. Robust epileptic seizure detection on wearable systems with reduced false-alarm rate. In: 2020 42nd annual international conference of the IEEE engineering in medicine & biology society (EMBC): 20–24 July 2020 2020; 2020: 4248–4251.

  14. Stoll S, Litchman T, Wesley S, Litchman C. Multiple Sclerosis Apps: the dawn of a new era: a comprehensive review (P3. 2-021). In: AAN enterprises; 2019.

  15. Stewart CL, Rashid Z, Ranjan Y, Sun S, Dobson RJB, Folarin AA. RADAR-base: major depressive disorder and epilepsy case studies. In: Proceedings of the 2018 ACM international joint conference and 2018 international symposium on pervasive and ubiquitous computing and wearable computers. Association for Computing Machinery, Singapore; 2018. p. 1735–43.

  16. Ranjan Y, Rashid Z, Stewart C, Conde P, Begale M, Verbeeck D, Boettcher S, Dobson R, Folarin A. RADAR-base: open source mobile health platform for collecting, monitoring, and analyzing data using sensors, wearables, and mobile devices. JMIR Mhealth Uhealth. 2019;7(8):e11734.

    Article  Google Scholar 

  17. Matcham F, Barattieri di San Pietro C, Bulgari V, de Girolamo G, Dobson R, Eriksson H, Folarin AA, Haro JM, Kerz M, Lamers F, et al. Remote assessment of disease and relapse in major depressive disorder (RADAR-MDD): a multi-centre prospective cohort study protocol. BMC Psychiatry. 2019;19(1):72.

    Article  CAS  Google Scholar 

  18. Andrews JA, Craven MP, Jamnadas-Khoda J, Lang AR, Morriss R, Hollis C, Consortium R-C. Health care professionals’ views on using remote measurement technology in managing central nervous system disorders: qualitative interview study. J Med Internet Res. 2020;22(7):e17414.

    Article  Google Scholar 

  19. Craven MP, Andrews JA, Lang AR, Simblett SK, Bruce S, Thorpe S, Wykes T, Morriss R, Hollis C. Informing the development of a digital health platform through universal points of care: qualitative survey study. JMIR Form Res. 2020;4(11):e22756.

    Article  Google Scholar 

  20. Terschuren C, Fendrich K, van den Berg N, Hoffman W. Implementing telemonitoring in the daily routine of a GP practice in a rural setting in northern Germany. J Telemed Telecare. 2007;13(4):197–201.

    Article  Google Scholar 

  21. van den Berg N, Fiß T, Meinke C, Heymann R, Scriba S, Hoffmann W. GP-support by means of AGnES-practice assistants and the use of telecare devices in a sparsely populated region in Northern Germany—proof of concept. BMC Fam Pract. 2009;10(1):44.

    Article  Google Scholar 

  22. Bruno E, Simblett S, Lang A, Biondi A, Odoi C, Schulze-Bonhage A, Wykes T, Richardson MP. Wearable technology in epilepsy: the views of patients, caregivers, and healthcare professionals. Epilepsy Behav. 2018;85:141–9.

    Article  Google Scholar 

  23. Wu DTY, Xin C, Bindhu S, Xu C, Sachdeva J, Brown JL, Jung H. Clinician perspectives and design implications in using patient-generated health data to improve mental health practices: mixed methods study. JMIR Form Res. 2020;4(8): e18123.

    Article  Google Scholar 

  24. Brichetto G. We should monitor our patients with wearable technology instead of neurological examination—commentary. Mult Scler. 2020;26(9):1028–30.

    Article  Google Scholar 

  25. Hilty DM, Armstrong CM, Edwards-Stewart A, Gentry MT, Luxton DD, Krupinski EA. Sensor, wearable, and remote patient monitoring competencies for clinical care and training: scoping review. J Technol Behav Sci. 2021;6(2):252–77.

    Article  Google Scholar 

  26. Andrews J, Craven M, Lang A, Guo B, Morris R, Hollis C. RADAR-CNS consortium t: the impact of data from remote measurement technology on the clinical practice of healthcare professionals in depression, epilepsy and multiple sclerosis: survey. BMC Med Inf Decis Mak. 2021;21:587.

    Google Scholar 

  27. Schmidt WC. World-Wide Web survey research: Benefits, potential problems, and solutions. Behav Res Methods Instrum Comput. 1997;29(2):274–9.

    Article  Google Scholar 

  28. JISC. The online survey tool designed for academic research, education and public sector organizations. www.onlinesurveys.ac.uk.

  29. Kuek A, Hakkennes S. Healthcare staff digital literacy levels and their attitudes towards information systems. Health Inform J. 2020;26(1):592–612.

    Article  Google Scholar 

  30. Cummins N, Scherer S, Krajewski J, Schnieder S, Epps J, Quatieri TF. A review of depression and suicide risk assessment using speech analysis. Speech Commun. 2015;71:10–49.

    Article  Google Scholar 

  31. Pau M, Caggiari S, Mura A, Corona F, Leban B, Coghe G, Lorefice L, Marrosu MG, Cocco E. Clinical assessment of gait in individuals with multiple sclerosis using wearable inertial sensors: Comparison with patient-based measure. Multiple Sclerosis Relat Disord. 2016;10:187–91.

    Article  Google Scholar 

  32. Elhai JD, Levine JC, Dvorak RD, Hall BJ. Non-social features of smartphone use are most related to depression, anxiety and problematic smartphone use. Comput Hum Behav. 2017;69:75–82.

    Article  Google Scholar 

  33. Alhassan AA, Alqadhib EM, Taha NW, Alahmari RA, Salam M, Almutairi AF. The relationship between addiction to smartphone usage and depression among adults: a cross sectional study. BMC Psychiatry. 2018;18(1):1–8.

    Article  Google Scholar 

  34. Matar Boumosleh J, Jaalouk D. Depression, anxiety, and smartphone addiction in university students—a cross sectional study. PLoS ONE. 2017;12(8): e0182239.

    Article  Google Scholar 

  35. Perle JG, Langsam LC, Randel A, Lutchman S, Levine AB, Odland AP, Nierenberg B, Marker CD. Attitudes toward psychological telehealth: current and future clinical psychologists’ opinions of internet-based interventions. J Clin Psychol. 2013;69(1):100–13.

    Article  Google Scholar 

  36. Titzler I, Saruhanjan K, Berking M, Riper H, Ebert DD. Barriers and facilitators for the implementation of blended psychotherapy for depression: a qualitative pilot study of therapists’ perspective. Internet Interv. 2018;12:150–64.

    Article  Google Scholar 

  37. Kerst A, Zielasek J, Gaebel W. Smartphone applications for depression: a systematic literature review and a survey of health care professionals’ attitudes towards their use in clinical practice. Eur Arch Psychiatry Clin Neurosci. 2020;270(2):139–52.

    Article  Google Scholar 

  38. Houle J, Gascon-Depatie M, Belanger-Dumontier G, Cardinal C. Depression self-management support: a systematic review. Patient Educ Couns. 2013;91(3):271–9.

    Article  Google Scholar 

  39. Holmes MM, Stanescu S, Bishop FL. The use of measurement systems to support patient self-management of long-term conditions: an overview of opportunities and challenges. Patient Relat Outcome Meas. 2019;10:385–94.

    Article  Google Scholar 

  40. Simblett SK, Bruno E, Siddi S, Matcham F, Giuliano L, Lopez JH, Biondi A, Curtis H, Ferrao J, Polhemus A, et al. Patient perspectives on the acceptability of mHealth technology for remote measurement and management of epilepsy: a qualitative analysis. Epilepsy Behav. 2019;97:123–9.

    Article  Google Scholar 

  41. Simblett S, Matcham F, Siddi S, Bulgari V, Barattieri di San Pietro C, Hortas Lopez J, Ferrao J, Polhemus A, Haro JM, de Girolamo G, et al. Barriers to and facilitators of engagement with mHealth technology for remote measurement and management of depression: qualitative analysis. JMIR Mhealth Uhealth. 2019;7(1):e11325.

    Article  Google Scholar 

  42. Keogh A, Johnston W, Ashton M, Sett N, Mullan R, Donnelly S, Dorn JF, Calvo F, Mac Namee B, Caulfield B. “It’s not as simple as just looking at one chart”: a qualitative study exploring clinician’s opinions on various visualisation strategies to represent longitudinal actigraphy data. Digit Biomark. 2020;4(Suppl 1):87–99.

    Article  Google Scholar 

  43. West P, Kleek MV, Giordano R, Weal MJ, Shadbolt N. Common barriers to the use of patient-generated data across clinical settings. In: Proceedings of the 2018 CHI conference on human factors in computing systems. Montreal QC, Canada: Association for Computing Machinery; 2018: Paper 484.

Download references

Acknowledgements

We would like to acknowledge the support of all members of the RADAR-CNS consortium, who are named on the RADAR-CNS webpage (http://www.radar-cns.org/). The RADAR-CNS project has received funding from the Innovative Medicines Initiative (IMI) 2 Joint Undertaking under grant agreement no 115902 (http://www.imi.europa.eu/). This Joint Undertaking receives support from the European Union’s Horizon 2020 research and innovation program and the European Federation of Pharmaceutical Industries and Associations (EFPIA). This communication reflects the views of the RADAR-CNS consortium, and neither IMI nor the European Union and EFPIA are liable for any use that may be made of the information contained herein. The funding body has not been involved in the design of the study, the collection or analysis of data, or the interpretation of data. This research was supported by the NIHR MindTech MedTech Co-operative, NIHR Nottingham Biomedical Research Centre, and NIHR Applied Research Collaboration East Midlands. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health and Social Care.

Funding

The RADAR-CNS project has received funding from the Innovative Medicines Initiative (IMI) 2 Joint Undertaking under grant agreement no 115902. This Joint Undertaking receives support from the European Union’s Horizon 2020 research and innovation program and the European Federation of Pharmaceutical Industries and Associations (EFPIA). This research was supported by the NIHR MindTech MedTech Co-operative, NIHR Nottingham Biomedical Research Centre, and NIHR Applied Research Collaboration East Midlands. The funding bodies did not take a role in the design of the study or collection, analysis or interpretation of the data or in the writing of the manuscript.

Author information

Authors and Affiliations

  1. NIHR MindTech MedTech Co-operative, Institute of Mental Health, University of Nottingham, Nottingham, UK

    J. A. Andrews, M. P. Craven, R. Morriss & C. Hollis

  2. Mental Health and Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, UK

    J. A. Andrews, R. Morriss & C. Hollis

  3. Human Factors Research Group, Faculty of Engineering, University of Nottingham, Nottingham, UK

    M. P. Craven & A. R. Lang

  4. NIHR Nottingham Biomedical Research Centre, University of Nottingham, Nottingham, UK

    M. P. Craven, R. Morriss & C. Hollis

  5. ARC-EM, School of Medicine, University of Nottingham, Nottingham, UK

    B. Guo & R. Morriss

Authors
  1. J. A. Andrews
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. P. Craven
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. R. Lang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. B. Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. R. Morriss
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. C. Hollis
    View author publications

    You can also search for this author in PubMed Google Scholar

Consortia

The RADAR-CNS Consortium

Contributions

The survey was designed by AL, MC, RM and CH. The survey was disseminated by AL, JA and MC. The results were analysed by JA, MC and BG. The manuscript was drafted by JA. Comments on the manuscript were provided by MC, BG and CH. All authors read and approved the final manuscript.

Corresponding author

Correspondence to J. A. Andrews.

Ethics declarations

Ethics approval and consent to participate

This study was conducted in accordance with the Declaration of Helsinki and received a favourable review from the University of Nottingham Research Ethics Committee (ref 277-1802) and from the Health Research Authority (Ref 19/HRA/5041). Respondents provided informed consent to take part in the study by reading the information provided on the first page of the study and indicating consent using the questions listed on the first page of the online questionnaire.

Consent for publication

Survey respondents remained anonymous and as such this section is not applicable.

Competing interests

There are no competing interests to declare.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1

. Survey instrument, presented to respondents using the JISC online surveys platform (www.onlinesurveys.ac.uk).

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Andrews, J.A., Craven, M.P., Lang, A.R. et al. Making remote measurement technology work in multiple sclerosis, epilepsy and depression: survey of healthcare professionals. BMC Med Inform Decis Mak 22, 125 (2022). https://doi.org/10.1186/s12911-022-01856-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12911-022-01856-z

Keywords

BMC Medical Informatics and Decision Making

ISSN: 1472-6947

Contact us