SBIR-STTR Award

Compatibility Between Brain-Computer Interface and High Efficiency Augmentative and Alternative Communication Systems
Award last edited on: 11/17/2023

Sponsored Program
STTR
Awarding Agency
NIH : NIDCD
Total Award Amount
$3,331,794
Award Phase
2
Solicitation Topic Code
173
Principal Investigator
Russell T Cross

Company Information

Prentke Romich Company (AKA: PRC)

1022 Heyl Road
Wooster, OH 44691
   (330) 262-1984
   info@prentrom.com
   www.prentrom.com

Research Institution

University of Michigan

Phase I

Contract Number: 1R41DC015142-01A1
Start Date: 9/1/2017    Completed: 6/30/2018
Phase I year
2017
Phase I Amount
$149,968
Brain-computer interfaces (BCI) can now enable text production for people who cannot move, yet they provide only the simplest communication interfaces and have not been widely adopted. Current augmentative and alternative communication (AAC) systems are widely adopted and provide efficient production of precise communication. However, they are operated by voluntary movement, preventing use by people with the most severe impairments, such as advanced amyotrophic lateral sclerosis or severe cerebral palsy. The long-term goal is to create BCI access to all the functions of an existing commercial AAC system to provide high-efficiency functional communication to people whose physical impairments make BCI the most effective means of interacting or communicating with the world. Such a system would allow an individual with a degenerative disease to start using AAC software on a tablet with touch-screen access and maintain access to that communication software as their condition progresses to the point where they need BCI access. The overall objective of this Phase I application is to create and evaluate a prototype of BCI access to the extensive language application and communication system product line of the Prentke Romich Company (PRC). The central hypothesis is that BCIs can provide effective access to the various advanced language applications of the PRC product line that currently are used by AAC speakers. Studies with experienced users of AAC technology will test the central hypothesis and meet the objective of the application through the following specific aims: 1. Develop an AAC-BCI prototype of BCI access to the diverse commercial state-of-the-art AAC language applications on the PRC communication systems that provide high-efficiency communication. 2. Evaluate the effectiveness of the AAC-BCI prototype with experienced AAC speakers to establish the compatibility of BCI access with the complexities of the high-efficiency language applications used in PRC communication interfaces. Identify user interfaces needing Phase II development for compatibility. 3. Determine the compatibility of existing AAC service delivery, technical support, and funding mechanisms with AAC-BCI systems through surveys of prototype test subjects, potential BCI users and caregivers, and through focus groups of clinicians and assistive technology professionals. Identify support structures or product features needing Phase II development to expand AAC user populations through BCI access. This work will create a BCI input accessory for PRC's line of AAC devices. The innovation of this work is merging BCI access with the high-efficiency language production from PRC's AAC user interface designs that are matched to each person' abilities, needs, and preferences. The significance of this work is the extension of quality-of-life communication benefits to those with the most severe physical impairments, providing an AAC- BCI through an established company with a clinical support network to provide services across the lifespan.

Public Health Relevance Statement:
NARRATIVE: The proposed project is relevant to public health because it will create brain-computer interface (BCI) access to an established line of augmentative and alternative communication (AAC) systems to provide a voice to those who are otherwise isolated from society and their family members. The combined AAC-BCI system will provide precise language production supported by a broad network of clinical support personnel for those who cannot communicate through physical movements. This will fulfill the mission of the NIH to reduce disability and enhance health by improving the quality-of-life for those with the most extreme physical impairments by creating an AAC-BCI device designed for compatibility with established communication, product delivery, and funding mechanisms.

Project Terms:
Adopted; Amyotrophic Lateral Sclerosis; Augmentative and Alternative Communication; brain computer interface; Caregivers; Cerebral Palsy; Clinical; Communication; communication device; Computer software; Custom; Degenerative Disorder; design; Development; Device Designs; disability; Effectiveness; Electrodes; experience; Eye; Family member; flexibility; Focus Groups; Funding Mechanisms; Future; Gel; Goals; Hand; Head; Health; Human Resources; Impairment; improved; Individual; innovation; Language; Life; Location; Longevity; Methods; Mission; Movement; Operating System; Outcome; Persons; Phase; phrases; Population; portability; preference; prevent; Production; prototype; Public Health; Quality of life; research and development; Self-Help Devices; Services; Societies; spelling; Structure; support network; Surveys; System; Tablets; Techniques; Technology; Testing; Text; touchscreen; Training Support; United States National Institutes of Health; Voice; Volition; Work

Phase II

Contract Number: 2R42DC015142-02
Start Date: 9/1/2017    Completed: 8/31/2021
Phase II year
2019
(last award dollars: 2023)
Phase II Amount
$3,181,826

Brain-computer interfaces (BCI) enable text production for people who cannot move, but have only simple communication interfaces and are not widely used. Augmentative and alternative communication (AAC) systems are widely used and give efficient and precise communication, but require movement, preventing use by people with severe impairments, such as advanced amyotrophic lateral sclerosis or severe cerebral palsy. Our Phase I STTR created and tested a software prototype of BCI access to the extensive language application and communication system product line of the Prentke Romich Company (PRC). The prototype was evaluated by PRC users, each using the BCI to access a software replica of their everyday device. The overall objective of this Phase II application is to complete the hardware and software prototype of the AAC-BCI along with training and resource materials. Our Phase I efforts showed compatibility of BCI access to PRC software with gel electrode hardware. Users wanted shorter setup times, elimination of gel, and increased interface responsiveness. Clinicians and internet survey participants echoed this feedback and wanted easier setup and calibration, dry electrodes, and convenient training resources. Our central hypothesis is that a commercial-grade implementation of BCI access to PRC language applications using quick-setup dry electrodes with matching training and support resources will meet laboratory testing goals for effective communication and be ready for future clinical trials on its ability to meet desired communication outcomes. Through studies with participants familiar with PRC's AAC software and technology, we plan to test our central hypothesis and meet the objective of the application with the following specific aims: 1. Optimize user interface design to guide BCI setup and calibration, and to refine interface responsiveness and integration of BCI stimuli into existing device displays. 2. Create a commercial grade software implementation that integrates BCI functionally into the existing AAC system. 3. Compare performance and user opinion of dry electrodes versus gel (wet) electrodes as the input peripheral for the AAC-BCI system. 4. Implement and evaluate training and resource materials for AAC-BCI set-up and calibration with input from practitioners, potential users and their support people. This work will finalize a BCI input accessory for PRC's line of AAC devices. The innovation of this work is merging BCI access with the high-efficiency language production from PRC's AAC user interface designs that are matched to each person' abilities, needs, and preferences. The significance of this work is the extension of quality-of-life communication benefits to those with the most severe physical impairments, providing an AAC- BCI through an established company with a clinical support network to provide services across the lifespan.

Public Health Relevance Statement:
NARRATIVE: The proposed project is relevant to public health because it will create brain-computer interface (BCI) access to an established line of augmentative and alternative communication (AAC) systems providing a voice to those who otherwise are isolated from their family members and society. The combined AAC-BCI system will provide precise language production supported by a broad network of clinical support personnel for those who cannot communicate through physical movements. This will fulfill the mission of the NIH to reduce disability and enhance health by improving the quality-of-life for those with the most extreme physical impairments by creating an AAC-BCI device designed for compatibility with established communication, product delivery, and funding mechanisms.

Project Terms:
Adopted; Amyotrophic Lateral Sclerosis; Assisted Living Facilities; Augmentative and Alternative Communication; base; brain computer interface; Calibration; Caregivers; Cerebral Palsy; Client; Clinic; Clinical; clinical decision-making; Clinical Trials; commercialization; Communication; communication device; Computer software; Custom; Degenerative Disorder; design; Device Designs; Devices; disability; Electrodes; Electroencephalogram; experience; Eye; Family member; Feedback; Focus Groups; Funding Mechanisms; Future; gaze; Gel; Generations; Goals; Hand; Head; Health; Home environment; Human Resources; Impairment; improved; Individual; innovation; Internet; Laboratories; Language; Letters; Longevity; Methods; Mission; Movement; novel; Outcome; Participant; Performance; Peripheral; Persons; Phase; preference; prevent; Production; prototype; Public Health; Quality of life; Resources; Services; Small Business Technology Transfer Research; Societies; Stimulus; support network; Support System; Surveys; System; Techniques; Technology; Testing; Text; Time; touchscreen; Training; Training Support; United States National Institutes of Health; User-Computer Interface; Voice; Volition; Work