Background
Methods
Search strategy and selection criteria
Data analysis
-
General characteristics of the paper: authors, year of publication, country;
-
Type of study: development, validation, or implementation of electronic tools;
-
eHealth tool: name, length of assessment, internet connection requirement, self-assessment vs. instructor-mediated assessment, validated vs. non-validated in a population, availability (i.e., platform);
-
Participants: sample size, mean age and gender distribution if applicable;
-
Context: setting of the research, source of funding;
-
Outcome: sign/symptom assessed, type of output variable (e.g., score, measurement on a continuous scale);
-
Technical characteristics and availability: licensing status, maintenance strategy, accessing link.
Role of the funding source
Findings
Tool Name | Components screened | Validation and measures | Sample Age Mean (SD) or Median (IQR)/Range | Sample size (Comparison) | Measurement Unit/Output Variable |
---|---|---|---|---|---|
Cognitive function tools | |||||
Adaptive cognitive evaluation (ACE) [15] | CI in MS: Attention and Processing Speed | Partially validated. Healthy vs. MS patients with and without cognitive impairment, against standard measures (SDMT, PASAT) | HC: 46.04 (3.72); MS CI: 50.87 (2.51); MS no CI: 52.68 (2.35) | 77 participants (3 groups) | Numerical mean scores for attention, and RT in milliseconds |
Babyscreen [16] | CI in children: Precision and Processing Speed | Partially validated. Healthy children, performance differentiated between age group according to scores obtained | Median (IQR)–31 months (26–34) | 112 participants (2 groups) | Total item completion, speed and accuracy |
C3-PAD [17] | CI: EM, WM and Processing Speed | Validated. Healthy participants vs. standardized neuropsychological tests: ANART, TMT, VFDT, ADCS PACC, FCSRT, MMSE, and SDMT | 71.2 (7.6) | 49 participants (1 group) | Composite Z-scores for each subtest |
Cognition reaction (CoRe) [18] | CI in MS: Precision and Processing Speed | Validated. Healthy vs. MS patients, against paper-and-pencil version of the SDMT | HC: 38.1 (11.9); MS: 44.0 (11.0) | 147 participants (2 groups) | Numerical scores for accuracy, and RT in milliseconds |
DementiaTest [19] | CI in Dementia: Orientation | Not validated. Proposed development only. Based on the 6-CIT and SCID | NA | NA | Numerical scores with predefined cut-offs |
Digital TMT Black and White (dTMT-B&W) [20] | CI: EF | Partially validated. Healthy vs cognitively impaired, against paper-and-pencil versions showing concurrent validity | HC: 53.0 (1.5); MCI – 67.2 (6.0) | 44 participants (2 groups) | Scores for typical TMT (errors, total time) |
EVO Monitor [21] | CI in MS: Visuomotor Tracking, Perceptual Discrimination, Multitasking | Partially validated. Healthy vs. MS patients with and without cognitive impairment, against standard measures: BICAMS – SDMT and MS Functional Composite + MRI | HC: 46.0 (3.7); MS CI: 49.0 (2.3); MS no CI: 53.8 (1.4) | 124 participants (3 groups) | Numerical scores for each task |
FatigueApp [22] | Fatigue in MS: EF, Memory and Verbal Fluency | Not validated. MS patients, against PROMIS short form | 49.0 (10.9) | 32 participants (1 group) | Numerical scores following PROMIS |
iVitality [23] | CI in Dementia: EF and Memory | Partially validated. Healthy but at risk of Dementia participants, against standard measures (MMSE, 15-WVLT, TMT A&B and Stroop-Color-Word) | 57.3 (5.3) | 151 participants (1 group) | Numerical scores for each task, errors and total time for TMT |
Karolinska WakeApp (KWA) [24] | CI in Sleep Deprivation: EF, EM and WM | Not validated. Healthy participants were assigned into groups (sleep deprived, non-deprived) and completed the test 3 times | Non-deprived: 25.3 (6.8); Deprived: 25.4 (5.2) | 182 participants (2 groups) | Numerical scores for each task |
MindLAMP [25] | CI in PD: EF | Validated. Healthy participants, against UPDRS, MoCA, Trails-B and WMS-III spatial span | 63.2 (8.7) | 27 participants (1 group) | Numerical scores, errors and total time for Trails |
Mobile Cognitive Screening [26] | General Cognitive Screening in Dementia | Validated. Healthy vs. dementia patients, against paper-and-pencil measures (MoCA, MMSE) and computerised measures (ANAM, CANS-MCI, CANTAB, CNVS, CNTB, CGS, CSI, MCIS, MicroCog & Mindstreams) | HC: 72.6 (9.6) Dementia: 81.8 (4.8) | 23 participants (2 groups) | Numerical general score out of 33 |
MOST-96120 [27] | CI: Memory and Orientation | Not validated. Patients with diverse diagnosis, against paper-and-pencil MOST, WAIS, Logical Memory-II & Visual Reproduction-II (WMS), delayed recall of 12-item Shopping List Test, 8-item proverb interpretation test (D-KEFS), and MMSE | 76.8 (7.4) | 98 participants (1 group) | Mean score for the memory orientation test |
NIHTB-CB [28] | CI: EF and WM | Not validated. Healthy veterans (web-first vs iPad first), against web-based version of the battery – Dimensional Change Card Sorting Test, Flanker Inhibitory Control and Attention Test, List Sort Working Memory Test, Pattern Comparison Processing Speed | Web first: 41.6 (9.0); iPad first: 39.0 (9.2) | 49 participants (2 groups) | Numerical scores for each task |
Oxford cognitive screen-plus (OCS-Plus) [29] | General Cognitive Screening | Validated. Healthy participants, against ACE-R, CERAD, ROCF and Star Cancellation Test | 62.7 (13.8) | 320 participants (1 group) | Numerical scores for each task |
SMART [30] | General Cognitive Screening and Language | Validated. Healthy vs MCI patients, against neuropsychological tests – Number Span Forwards, TMT-A, Stroop, Immediate/Delayed Recall, Benson Complex Figure Delayed Recall, Multilingual Naming Test, Category/Phonemic Fluency, and MoCA | HC: 72.4 (5.2); MCI: 74.0 (6.0) | 69 participants (2 groups) | Composite Z-scores for each function |
TabletWebApp [31] | CI in Dementia/MCI: EF, Visual Perception | Validated. Healthy vs MCI vs Dementia patients, against paper-and-pencil versions of TMT-A & B, and Bells Test | HC: 76.2 (4.2); MCI: 78.0 (5.4); Dementia: 78.6 (4.0) | 83 participants (3 groups) | Numerical scores, errors and total time for TMT |
UX-TMT [32] | CI in Dementia/PD: EF | Validated. Healthy vs PD patients vs MCI/Dementia patients, against MMSE-J, MoCA-J, SF-12 & PANAS20-J | HC: 55.8 (13.7); PD: 68.6 (6.7); MCI/D: 79.4 (7.6) | 84 participants (3 groups) | Errors and total completion time |
Voxtester [33] | Language/Speech impairment in PD | Not validated. Healthy young vs healthy elderly vs PD patients, against UPDRS speech scores | Median (IQR) – HYoung: 20.8 (19–29); HElder: 67.1 (60–77); PD: 67.2 (40–80) | 65 participants (3 groups) | Numerical scores for error rate in word reading; speech duration time, number of words read, and characters per second |
Motor function tools | |||||
DNVS App [36] | Upper Extremity Bradykinesia and Processing Speed | Partially validated. PD patients, against vMDS-UPDRS III | 68.4 (7.8) | 23 participants (1 group) | Numerical scores for the two tasks |
FiMS [37] | Fine Motor Skills: Tapping a moving target, dragging a target to a goal, moving a target through a maze, drag two separate targets | Validated. Healthy vs Myelopathic patients, against the mJOA | HC: 58.0 (9.1) Myelopathic: 60.5 (9.3) | 93 participants (2 groups) | Numerical scores for each of the four tasks |
Itremorsense [38] | Upper limb tremor in PD | Validated. Healthy vs PD patients (+ PD hospitalised), against gold standard UPDRS | HC: 67.2 (6.3); PD: 70.9 (11.8); PH hospitalised: 80.0 (4.2) | 45 participants (3 groups) | Quantification of tremor using a sensor |
Kassavetis et al. [39] | Motor Symptoms in PD (tremor, bradykinesia) | Partially validated. PD patients, against MDS-UPDRS | Median (IQR) – 54.7 (34–75) | 14 participants (1 group) | Numerical scores for the two screened components |
Smartphone Tapper (SmT) [40] | Bradykinesia in PD | Validated. Healthy vs PD patients, against gold standard UPDRS + two mechanical tappers | HC: 53.4 (14.8); PD: 65.4 (9.0) | 144 participants (2 groups) | Kinematic measurements: total distance finger movement, inter-tap distance, inter-tap dwelling |
Sentient Tracking of Parkinson’s (STOP) [41] | Hand Tremor Intensity | Partially validated. PD patients, against UPDRS-II general score and Tremor item on UPDRS | Range – 52–73 | 11 participants (1 group) | Measures for tremor intensity |
Visual acuity tools | |||||
Linder et al. [42] | Visual Impairment in mTBI | Validated. Healthy participants, against clinical/ruler measurements (reading point of convergence, reading fluency and comprehension) | 21.9 (2.0) | 50 participants (1 group) | Numerical scores for static and dynamic visual acuity, and other mentioned tasks |
StrokeVision [43] | Visual Acuity in Stroke | Validated. Stroke patients, against the gold standard for formal kinetic perimetry (GVFT or OVFA) + pencil-and-paper tests of inattention (Albert’s Test, Star Cancelation Test and Line Bisection) | Median (IQR) – 63 (54–72) | 48 participants (1 group) | Screenshot to be assessed by a clinician |
Gait and coordination tools | |||||
6WT app [44] | Spine Abnormality: Back and lower-extremity pain, walking abnormality | Validated. Healthy participants, against PROMs – VAS for low-back and lower-extremity pain, COMI, ZCQ, and subjective walking distance and duration | 44.2 (18.6) | 330 participants (1 group) | Numerical overall score for 6WT test, measures for walking distance and duration |
APP-Coo-Balance-Test [45] | Balance and Coordination impairment: static and dynamic balance | Partially validated. Healthy vs Cerebellar Ataxia patients, against BBS and SARA + validated static balance evaluating systems | HC: 39.3 (11.4); Cereb. Ataxia: 40.7 (10.9) | 120 participants (2 groups) | Quantification of Static and Dynamic balance with sensor |
Encephalog [46] | Fall Occurrence, stand-up time and mediolateral sway | Not validated. PD patients (fallers + non-fallers), against UPDRS-III scoring, Hoehn and Yahr Scale, and disease duration | Median (IQR) – Non-fallers: 66 (58.5–71.8); Fallers: 53.5 (50.5–60.3) | 33 participants (2 groups) | Scores for the timed-up-and-go test (stand-up time, mediolateral sway), and fall occurrence |
Bourke et al. [47] | Gait impairment: spatial and spatiotemporal characteristics | Not validated. Healthy vs MS patients, gait differentiating measures | HC: 34.9 (9.3): MS: 39.5 (7.9) | 101 participants (2 groups) | Smartphone sensor measures for spatial and spatiotemporal gait characteristics |
FallSkip [48] | Balance, Gait & functional abnormalities in PD | Not validated. Healthy vs Mild to Moderate PD patients, against no gold standard | HC: 67.2 (8.2); PD: 68.9 (9.0) | 60 participants (2 groups) | Smartphone sensor data quantification |
Hokoukeisoku-app [49] | Gait impairment: speed and daily cycle | Not validated. Does not screen for impairment (yet), simply quantifies gait | 48.8 (12.8) | 186 participants (1 group) | Scores for Daily Gait Speed, Daily Gait Cycle, Average of Daily Cadence |
iTUG [50] | Gait impairment: standing, walking, turning, sitting | Not validated. Healthy vs Probable idiopathic normal-pressure hydrocephalus, against manual Timed-up and Go | HC: 79.4 (7.0); Idiopathic: 77.6 (5.5) | 119 participants (2 groups) | Total time for task; stand, go, turn, come, and sit times |
Sagittalmeter pro [51] | Balance Impairment: lumbar lordosis, pelvic tilt, sacral slope and pelvic incidence | Validated. Spine radiography patients, against radiograph examination by 3 experts and the Web-based PACS | 50.9 (17.6) | 30 participants (1 group) | Scores for several measurements – Lumbar lordosis, Pelvic Tilt, Sacral slope, and Pelvic incidence |
Su et al. [52] | Gait impairment in PD: walking normally (single task) and while performing a serial-subtraction (dual task) | Validated. PD patients, against walking assessment, UPDRS-III, and MoCA | 63.0 (10.0) | 52 participants (1 group) | Scores for gait (single task), and while performing a serial-subtraction (dual task) |
Composite tools | |||||
ElevateMS [53] | MS Signs and Symptoms: finger tapping, walking and balance, and cognition | Not validated. Healthy vs MS patients (self-reported + clinically referred), against baseline assessments – PDDS, Cognitive, Upper & Lower Extremity assessment + functional tests (finger-to-nose, walk and balance) | HC: 39.3 (11.4); Self-reported: 45.2 (11.6); Clinically referred: 48.9 (11.2) | 629 participants (3 groups) | Numerical scores for performance in each task: finger tapping, finger to nose, walk and balance, Digit Symbol Substitution Test |
Fast-ED App [54] | Large Vessel Occlusion: Stroke Signs and Symptoms | Validated. Stroke patients, against FAST-ED original, RACE, CPSS, 3-ISS, and NIHSS | NA | 2815 participants (retrospective data) | Numerical overall score |
ICTUS3R [55] | Stroke signs: facial palsy, asymmetric arm weakness, speech and visual disturbance, headaches | Not validated. Tool based on the CPSS | NA | NA | Numerical overall score estimating the absolute risk of stroke |
M.A.L [56] | PD Signs and Symptoms: speech, posture, gait, finger tapping, and processing speed | Validated. Healthy vs PD patients, against gold standard (UPDRS) | HC: 57.7 (14.3); PD: 65.1 (9.8) | 20 participants (2 groups) | Scores for each of the five tasks: Voice (voice measures), Posture, Gait (acceleration, movement measures), Finger tapping (position and RT), Reaction Time in milliseconds |
MICK App [57] | Concussion Signs and Symptoms: Naming Pictures and Numbers | Not validated. Healthy participants, against paper-and-pencil instrument counterparts – MULES and SUN | 39.0 (16.0) | 59 participants (1 group) | Numerical scores for the two tasks |
PD Dr [58] | Hand tremor, walking and turning | Partially validated. PD patients, previously screened with UPDRS | 68.5 (9.5) | 40 participants (1 group) | Uses motion data from smartphone 3D accelerometer to differentiate performance (hand tremor test, walking test, turning test) |
Tool name | Internet requirement | Self-assessment | Length of assessment | Platform used | Country of study (language) |
---|---|---|---|---|---|
Cognitive function tools | |||||
Adaptive cognitive evaluation (ACE) | Yes | Yes | Approximately 30 min | Platform not specified; Tablet-based | United States of America (English) |
Babyscreen | Unknown | Instructor aided | Unknown | Platform not specified, administered on iPad | Ireland (English) |
C3-PAD | No | Instructor explains, self-assessment after | Approximately 30 min | Developed for iOS 11, administered on iPad | United States of America (English) |
Cognition reaction (CORE) | No | Instructor present in a study but not needed for the platform itself | Approximately 90 s | Platform not specified, administered on iPad | United Kingdom (English) |
Dementiatest | Yes | Yes, or caregiver/family member | Unknown | Android OS and iOS | New Zealand (English) |
Digital TMT Black and White (dTMT-B&W) | Unknown | Yes | Approximately 5 min | Android OS | South Korea (English and Korean) |
EVO Monitor | Unknown | Yes | Approximately 7 min | Platform not specified; administered on iPad | United States of America (English) |
FatigueApp | Yes | Instructor explains, self-assessment after | 15 to 20 min | Web-based | United States of America (English) |
iVitality | Yes | Yes | Unknown | Web-based, available for smartphone | The Netherlands |
Karolinska WakeApp (KWA) | Unknown | Instructor practices with the participant first. Self-assessment after | Approximately 10 min | Web-based, but runs safely on Safari for iPhone and Chrome for Android | Sweden and Denmark |
mindLAMP | Unknown | Instructor explains first, then it's self-assessment | Approximately 10 min | Android OS and iOS | United States of America (English) |
Mobile cognitive screening | Unknown | Yes | Unknown | Android OS | Turkey (Turkish) |
MOST-96120 | Yes | Instructor aided | Approximately 30 min | iOS | United States of America (English) |
NIHTB-CB | Unknown | Instructor aided | Unknown | Platform not specified, administered on iPad | United States of America (English) |
Oxford cognitive screen-plus (OCS-Plus) | No | Instructor aided | Approximately 25 min | Android OS | Germany (German, Shangaan and English) |
SMART | Yes | Yes | Approximately 5 min | Web-based | United States of America (English) |
TabletWebApp | Yes | Yes, with vocal automatised instructions | Approximately 15 min | Web-based | Italy (Italian, English) |
UX-TMT | Unknown | Yes, but the instructor is present for clarifications | Approximately 10 min | Android OS | Japan (Japanese) |
Voxtester | Yes | Instructor aided | Unknown | Web-based, available for Android | Italy (Italian) |
Visual acuity tools | |||||
Linder et al | Unknown | Instructor aided | Unknown | Developed for iOS 11, administered on iPad | United States of America (English) |
StrokeVision | Unknown | Unknown | Approximately 7 min | Android OS | United Kingdom (English) |
Gait and coordination tools | |||||
6WT app | Unknown | Yes | Approximately 8 min | Android OS and iOS | Switzerland (English, French and German) |
APP-Coo-Balance-Test | Unknown | Instructor aided | Approximately 10 min | Android OS and iOS | Italy |
Bourke et al | Unknown | Yes | Approximately 2 min | Android OS | Switzerland |
Encephalog | Unknown | Yes | Approximately 5 min | Android OS and iOS | Italy |
FallSkip | Unknown | Instructor aided | Approximately 15 min | Android OS | Spain |
Hokoukeisoku-APP | Unknown | Yes | Unknown | Android OS and iOS | Japan |
iTUG | Yes | Instructor aided | Approximately 7 min | iOS | Japan |
SagittalMeter Pro | Unknown | Instructor aided | Approximately 1 min | Android OS and iOS | South Korea |
Su et al | Yes | Yes | Unknown | iOS | China |
Motor function tools | |||||
DNVS App | Unknown | Yes | Unknown | iOS | United States of America (English) |
FiMS | Unknown | Instructor aided | Approximately 1.5 min | Platform not specified, administered on iPad | United States of America (English) |
Itremorsense | Yes | Yes | Unknown | Android OS and iOS; Web-based | Greece |
Kassavetis et al | No | Instructor explained each task | Approximately 5 min | Android OS | United Kingdom (English) |
Smartphone Tapper (SmT) | Yes | Instructor aided | Approximately 1 min | Android OS | South Korea (English) |
STOP (Sentient Tracking of Parkinson’s) | Unknown | Yes | Unknown | Android OS and iOS | Finland and United Kingdom (English) |
Composite tools | |||||
Elevatems | Unknown | Yes | Approximately 5 min | iOS | United States of America (English) |
FAST-ED App | Unknown | Unknown | Unknown | Unknown | Germany |
ICTUS3R | Yes | Yes | Approximately 2 min | Android OS and iOS | Italy (Italian) |
M.A.L | Yes | Instructor explains first. Self-assessment after | Approximately 5 min | Android OS | United States of America (English) |
MICK App | Unknown | Instructor aided | Unknown | Platform not specified, administered on a tablet | United States of America (English) |
PD Dr | Yes | Yes | Approximately 5 min | Android OS | United States of America (English) |
Tool Name | Source of Funding | Licensing | Last Maintained* | Maintenance Date Info | Availability | URL |
---|---|---|---|---|---|---|
ElevateMS | Private | Non-Profit Organisation | Unknown | Unknown | Active Website | Website |
iTUG | Private | Proprietary | Mar 3, 2019 | App Store Update | Active – New Name | App Store |
Bourke et al | Private | Unknown | Unknown | Unknown | Unknown | Unknown |
HOKOUKEISOKU-APP | Private | Unknown | Unknown | Unknown | Unknown | Unknown |
Itremorsense | Public | Open Source | Aug 25, 2015 | APK Date of Publishing | Active APK and Github | APK Github |
Smartphone Tapper (SmT) | Public | Open Source | Jun 28, 2016 | Github | Active Github | Github |
Karolinska WakeApp (KWA) | Public | Open Source | Mar 31, 2021 | Github Update | No consumer-ready version available; Active Github | Github |
DementiaTest | Public | Proprietary | Dec 1, 2022/Dec 10, 2022 | App Store Update/Play Store Update | Active | App Store Play Store |
MindLAMP | Public | Proprietary | Jul 13, 2022/Oct 19, 2022 | App Store Update/Play Store Update | Active | App Store Play Store |
STOP (Sentient Tracking of Parkinsons) | Public | Proprietary | Aug 30, 2019 | App Store Update | Active | App Store |
EVO Monitor | Public | Proprietary | Unknown | Unknown | Active – Upon Request | NA |
Linder et al | Public | Proprietary | Unknown | Unknown | Developer Website Accessible | Developer Website |
iVitality | Public | Unknown | Nov 21, 2014 | APK Date of Publishing | Active APK | APK |
StrokeVision | Public | Unknown | Jun 2, 2017 | APK Date of Publishing | Active APK | APK |
Digital TMT Black & White (dTMT-B&W) | Public | Unknown | Unknown | Unknown | Unknown | Unknown |
SMART | Public | Unknown | Unknown | Unknown | Unknown | Unknown |
TabletWebApp | Public | Unknown | Unknown | Unknown | Unknown | Unknown |
UX-TMT | Public | Unknown | Unknown | Unknown | Unknown | Unknown |
M.A.L | Public | Unknown | Unknown | Unknown | Unknown | Unknown |
MICK App | Public | Unknown | Unknown | Unknown | Unknown | Unknown |
Adaptive Cognitive Evaluation (ACE) | Public & Private | Proprietary | Apr 21, 2022 | App Store Update | Active | App Store |
NIHTB-CB | Public & Private | Proprietary | Jul 11, 2022 | App Store Update | Active | App Store |
Oxford Cognitive Screen-Plus (OCS-Plus) | Public & Private | Proprietary | May 3, 2022 | App Store Update/Play Store Update | Active | Website App Store Play Store |
6WT app | Public & Private | Proprietary | Mar 19, 2020/Sep 23, 2019 | App Store Update/Play Store Update | Active | App Store Play Store |
ICTUS3R | Public & Private | Proprietary | May 24, 2022 | Play Store Update | Active | Website Play Store |
Babyscreen | Public & Private | Proprietary | Unknown | Unknown | Active – Upon Request | Website |
C3-PAD | Public & Private | Unknown | Unknown | Unknown | Unknown | Unknown |
FallSkip | Public & Private | Unknown | Unknown | Unknown | Unknown | Unknown |
MOST-96120 | Unknown | Proprietary | Mar 28, 2018 | App Store Update | Active | Website |
APP-Coo-Balance-Test | Unknown | Proprietary | Sep 13, 2022 | Play Store Update | Active | App Store Play Store |
SagittalMeter Pro | Unknown | Proprietary | Aug 26, 2019 | Play Store Update | Active | Play Store |
FAST-ED App | Unknown | Proprietary | Nov 10, 2022 | App Store Update | Active – New Name | App Store |
Encephalog | Unknown | Proprietary | Dec 7, 2022 | App Store Update | Active – Successor App | App Store |
Su et al | Unknown | Unknown | Unknown | Unknown | Unknown | Unknown |
Voxtester | Unknown | Unknown | Unknown | Unknown | Material Available Upon Request | NA |
Cognition Reaction (CoRe) | Unknown | Unknown | Unknown | Unknown | Unknown | Unknown |
FatigueApp | Unknown | Unknown | Unknown | Unknown | Unknown | Unknown |
Mobile Cognitive Screening | Unknown | Unknown | Unknown | Unknown | Unknown | Unknown |
FiMS | Unknown | Unknown | Unknown | Unknown | Unknown | Unknown |
Kassavetis et al | Unknown | Unknown | Unknown | Unknown | Unknown | Unknown |
PD Dr | Unknown | Unknown | Unknown | Unknown | Unknown | Unknown |