Mixed Reality Serious Games: The Therapist Perspective
The objective of this paper is to present a Mixed Reality System (MRS) for rehabilitation of the upper limb after stroke. The system answers the following challenges: (i) increase motivation of patients by making the training a personalized experience; (ii) take into account patients’ impairments by offering intuitive and easy to use interaction modalities; (iii) make it possible to therapists to track patient’s activities and to evaluate/track their progress; (iv) open opportunities for telemedicine and tele rehabilitation; (v) and provide an economically acceptable system by reducing both equipment and management costs. In order to test this system a pilot study has been conducted in conjunction with a French hospital in order to understand the potential and benefits of mixed reality. The pilot involved 3 therapists who ‘played the role’ of patients. Three sessions, one using conventional rehabilitation, another using an ad hoc developed game on a PC, and another using a mixed reality version of the same game were held. Results have shown the MRS and the PC game to be accepted more than physical rehabilitation.
💡 Research Summary
The paper presents a Mixed Reality System (MRS) designed to support upper‑limb rehabilitation after stroke and evaluates it from the therapist’s perspective. The authors identify five design goals: (1) increase patient motivation through game‑based, personalized experiences; (2) accommodate motor impairments with intuitive, low‑effort interaction; (3) enable therapists to monitor activity and track progress with objective metrics; (4) open the door to tele‑rehabilitation and remote clinical support; and (5) keep the solution economically viable by reducing hardware and management costs.
The technical architecture combines a commercial mixed‑reality headset (e.g., Microsoft HoloLens) with hand‑tracking sensors, a Unity‑based serious‑game that maps reaching and grasping motions onto virtual objects, and a therapist dashboard that visualises joint angles, movement velocity, success rates, and other performance indicators in real time. The game adapts difficulty on the fly according to the user’s current ability, providing continuous visual and auditory feedback. A network module allows remote access, so a therapist can observe a session, adjust parameters, and deliver feedback without being physically present.
To obtain preliminary usability data, a pilot study was conducted in collaboration with a French hospital. Three experienced physical therapists acted as “patients” and performed three separate training sessions: (i) conventional physical therapy using standard tools, (ii) a PC‑based version of the same game controlled with keyboard/mouse, and (iii) the mixed‑reality version using the headset and hand tracking. After each session, participants completed questionnaires covering usability, immersion, motivation, and therapist satisfaction.
Results indicated that both the PC game and the MR game were preferred over traditional therapy, with the MR version receiving the highest scores for visual feedback, spatial immersion, and perceived therapeutic value. Therapists highlighted the system’s ability to capture fine‑grained kinematic data, which they felt would enable more precise tailoring of exercise programs. The remote‑monitoring feature generated strong interest, and the cost analysis suggested that the MR solution could be considerably cheaper than robot‑assisted rehabilitation platforms. Negative feedback centered on headset ergonomics (weight, comfort), limited field of view, and the time required for initial calibration.
The authors acknowledge several limitations. The “patients” were therapists without neurological deficits, so the motor constraints typical of stroke survivors were not fully represented. The sample size (n = 3) and single‑session per condition preclude statistical inference and do not control for learning or order effects. Outcome measures were limited to subjective acceptance and short‑term impressions, lacking objective functional assessments (e.g., Fugl‑Meyer scores) or long‑term follow‑up. Moreover, potential issues such as cybersickness, fatigue, and integration into existing clinical workflows were not explored in depth.
Future work is outlined as follows: (1) conduct a large‑scale, longitudinal clinical trial with actual stroke patients to evaluate functional recovery and retention; (2) enrich data collection with electromyography, force sensors, or wearable inertial units to quantify muscle activation and effort; (3) develop collaborative or competitive multiplayer scenarios to foster therapist‑patient interaction; (4) improve user experience by adopting lighter headsets, expanding the field of view, and mitigating motion‑induced discomfort; and (5) pursue open‑source software and low‑cost hardware strategies to standardise the platform and facilitate widespread adoption.
In summary, the study demonstrates that a mixed‑reality serious‑game can increase therapist satisfaction, provide richer quantitative feedback, and enhance patient engagement compared with conventional therapy. While promising, the approach remains at a prototype stage; rigorous clinical validation, usability refinements, and cost‑effectiveness analyses are required before the technology can be deployed broadly in stroke rehabilitation settings.