Objective:

This pilot project aims to assess the feasibility and utility of using a head-worn augmented reality (AR) device utilizing eye-gaze input control and assess user feedback about its potential as an AAC method.

Background:

Augmentative and alternative communication (AAC) methods are used by people with motor neuron disease (MND). These include low-technology approaches like flashcards or notepads, and high-technology eye-tracking speech generation devices (SDGs).  Current eye tracking devices are cumbersome, sensitive to lighting conditions, and require frequent recalibration.

Design/Methods:

 Adults with a diagnosis of MND  who had significant limitations to speech and/or handwriting that required regular use of AAC were recruited. Subjects described their history of AAC use, then wrote or typed a standardized sentence using their current AAC method.  After a period of training with the AR device, participants typed the same sentence using the eye-gaze control of the native Notes application.  The primary endpoint in this pilot was the typing efficacy with each device, quantified by the writing speed and errors.  Secondary outcomes concerned device feasibility assessed by patient/caregiver interview.

Results:

One patient exclusively used an eye-gaze system for communication, while the others employed dexterous control of smartphones or dedicated SDGs.  The average sentence typing speed with current AAC devices was 54.73± 10.82 (N=4) selections per minute, which was faster than the 13.88 ± 5.89 (N=4) achieved with the AR headset.  More typing errors occurred on average with the AR headset (6.25 ± 4.92) compared to the current AAC (0.33 ± 0.58). Participant ratings of feasibility were similar between the AR headset (38.8 ± 12.1) and current AAC (45.3 ± 6.3).

Conclusions:

We highlight the experiences of AAC users using a novel head-mounted eye tracking device as a communication tool. Although immediately useful for general computing, subjects require modification to device form and function to make it suitable as a dedicated AAC.