SBIR-STTR Award

Removing background talker noise for cochlear implant users
Award last edited on: 2/19/2024

Sponsored Program
SBIR
Awarding Agency
NIH : NIDCD
Total Award Amount
$3,543,266
Award Phase
2
Solicitation Topic Code
173
Principal Investigator
Roozbeh Soleymani

Company Information

York Sound Inc

28 Liberty Street
Forest Hills, NY 11375
   (646) 326-9639
   N/A
   www.york-sound.com
Location: Single
Congr. District: 06
County: Queens

Phase I

Contract Number: 1R44DC018761-01
Start Date: 4/25/2020    Completed: 3/31/2022
Phase I year
2020
Phase I Amount
$787,577
When hearing-impaired listeners are properly aided with a hearing aid (HA) or cochlear implant (CI), they are often able to comfortably maintain a conversation in quiet environments. However, in group environments, such as a large family dinner, restaurant, or other environment where multiple people are talking simultaneously, hearing-impaired listeners have great difficulty participating in conversations and frequently withdraw or avoid the situation. As such, it would be highly beneficial to implement an algorithm into HAs or CIs to remove background talkers ("babble") from the signal to reduce listening effort for the hearing-impaired listener and allow them to converse as if they were in a quiet environment. Although HAs and CIs frequently incorporate noise reduction algorithms, these algorithms are not effective when the background is babble. The problem of removing babble involves segregating speech from speech. Hence, the spectral properties of the signal and noise are extremely similar. Despite these challenges, we developed an extremely effective algorithm named SEDA to remove background babble. A prototype of SEDA was implemented on an iPhone and evaluated on 10 CI users. SEDA improved understanding of speech with background talkers at all signal-to-noise ratios (SNRs) tested; on average, word understanding in babble improved by 31 percentage points. By contrast, the state-of-the-art noise reduction systems for CIs provide little to no benefit for understanding speech with babble noise. CI manufacturers have shown great enthusiasm about our successful proof-of-concept of our algorithm. Nevertheless, before commercialization, CI manufacturers want reductions in the computational power required for the algorithm. As CI processors minimize computational processing in order to maximize battery life, it is important to minimize the additional computations required by SEDA. When using SEDA as a front- end for a CI processing strategy (as is the case with our iPhone prototype), redundancy in the required calculations result in increased computations and latency. Specifically, SEDA decomposes the input signal into multiple channels, removes the background babble, and then reassembles them into a single waveform. This waveform is then fed into a CI which again decomposes the signal into multiple channels. Integrating SEDA into the signal processing chain will save computational processing as the signal would only need to be decomposed once and would not need to be reassembled. Additionally, although SEDA is highly successful in typical speech in noise tests, CI manufacturers emphasized the importance of evaluating SEDA in more realistic environments. Two specific aims will address the requirements for commercialization by the CI manufactures: reducing the computational requirements by integrating SEDA into a sound processing algorithm and evaluating SEDA in realistic environments.

Public Health Relevance Statement:
PROJECT NARRATIVE Understanding speech when other people talking in the background is both one of the most critical and difficult issues to address for cochlear implant users. In contrast to commercial algorithms, our proof-of-concept algorithm is highly successful at removing background talkers. The goal of this research is to modify and further evaluate the algorithm such that it is ready for commercialization.

Project Terms:
Algorithms; Bionics; Buffers; Cochlear Implants; Cochlear Prosthesis; Communication; Data Collection; Environment; Family; Goals; Hearing; Hearing Aids; assistive hearing device; assistive listening device; hearing amplification; hearing assistance; hearing assistive device; hearing device; Names; Noise; Periodicity; Cyclicity; Rhythmicity; Quality of life; QOL; Research; Restaurants; Signal Transduction; Cell Communication and Signaling; Cell Signaling; Intracellular Communication and Signaling; Signal Transduction Systems; Signaling; biological signal transduction; sound; Speech; Speech Perception; Testing; Time; improved; Clinical; Evaluation; Visual; Fourier Transform; Life; Auditory; System; preference; Devices; Coding System; Code; Property; Manufacturer; Manufacturer Name; Cell Phone; Cellular Telephone; iPhone; smart phone; smartphone; Cellular Phone; Effectiveness; Hearing Loss; Hypoacuses; Hypoacusis; dysfunctional hearing; hearing defect; hearing deficit; hearing difficulty; hearing disability; hearing dysfunction; hearing impairment; Address; Modification; virtual; prototype; commercialization; signal processing; de-noising; denoising; hearing in noise; speech in background noise; speech in speech recognition; speech recognition in noise; speech in noise

Phase II

Contract Number: 5R44DC018761-02
Start Date: 4/25/2020    Completed: 7/31/2022
Phase II year
2021
(last award dollars: 2023)
Phase II Amount
$2,755,689

When hearing-impaired listeners are properly aided with a hearing aid (HA) or cochlear implant (CI), they are often able to comfortably maintain a conversation in quiet environments. However, in group environments, such as a large family dinner, restaurant, or other environment where multiple people are talking simultaneously, hearing-impaired listeners have great difficulty participating in conversations and frequently withdraw or avoid the situation. As such, it would be highly beneficial to implement an algorithm into HAs or CIs to remove background talkers ("babble") from the signal to reduce listening effort for the hearing-impaired listener and allow them to converse as if they were in a quiet environment. Although HAs and CIs frequently incorporate noise reduction algorithms, these algorithms are not effective when the background is babble. The problem of removing babble involves segregating speech from speech. Hence, the spectral properties of the signal and noise are extremely similar. Despite these challenges, we developed an extremely effective algorithm named SEDA to remove background babble. A prototype of SEDA was implemented on an iPhone and evaluated on 10 CI users. SEDA improved understanding of speech with background talkers at all signal-to-noise ratios (SNRs) tested; on average, word understanding in babble improved by 31 percentage points. By contrast, the state-of-the-art noise reduction systems for CIs provide little to no benefit for understanding speech with babble noise. CI manufacturers have shown great enthusiasm about our successful proof-of-concept of our algorithm. Nevertheless, before commercialization, CI manufacturers want reductions in the computational power required for the algorithm. As CI processors minimize computational processing in order to maximize battery life, it is important to minimize the additional computations required by SEDA. When using SEDA as a front- end for a CI processing strategy (as is the case with our iPhone prototype), redundancy in the required calculations result in increased computations and latency. Specifically, SEDA decomposes the input signal into multiple channels, removes the background babble, and then reassembles them into a single waveform. This waveform is then fed into a CI which again decomposes the signal into multiple channels. Integrating SEDA into the signal processing chain will save computational processing as the signal would only need to be decomposed once and would not need to be reassembled. Additionally, although SEDA is highly successful in typical speech in noise tests, CI manufacturers emphasized the importance of evaluating SEDA in more realistic environments. Two specific aims will address the requirements for commercialization by the CI manufactures: reducing the computational requirements by integrating SEDA into a sound processing algorithm and evaluating SEDA in realistic environments.

Public Health Relevance Statement:
PROJECT NARRATIVE Understanding speech when other people talking in the background is both one of the most critical and difficult issues to address for cochlear implant users. In contrast to commercial algorithms, our proof-of-concept algorithm is highly successful at removing background talkers. The goal of this research is to modify and further evaluate the algorithm such that it is ready for commercialization.

Project Terms:
Algorithms; Bionics; Buffers; Cochlear Implants; Cochlear Prosthesis; Communication; Data Collection; Environment; Family; Goals; Hearing; Hearing Aids; assistive hearing device; assistive listening device; hearing amplification; hearing assistance; hearing assistive device; hearing device; Names; Noise; Periodicity; Cyclicity; Rhythmicity; Quality of life; QOL; Research; Restaurants; Signal Transduction; Cell Communication and Signaling; Cell Signaling; Intracellular Communication and Signaling; Signal Transduction Systems; Signaling; biological signal transduction; sound; Speech; Speech Perception; Testing; Time; improved; Clinical; Evaluation; Visual; Fourier Transform; Life; Auditory; System; preference; Devices; Coding System; Code; Property; Manufacturer; Manufacturer Name; Cell Phone; Cellular Telephone; iPhone; smart phone; smartphone; Cellular Phone; Effectiveness; Hearing Loss; Hypoacuses; Hypoacusis; dysfunctional hearing; hearing defect; hearing deficit; hearing difficulty; hearing disability; hearing dysfunction; hearing impairment; Address; Modification; virtual; prototype; commercialization; signal processing; denoising; de-noising; speech in noise; hearing in noise; speech in background noise; speech in speech recognition; speech recognition in noise