EEG SA-Decoding

EEG Selective Attention Decoding for CI Users

Abstract logo of a head ans EEG

The cochlear implant (CI) acts as a kind of artificial cochlea, transforming the acoustic signals, captured by a microphone into electric pulses, thereby bypassing the damaged structures of the ear and directly stimulating the auditory nerve. Most CI users obtain good speech understanding in the absence of background noise. However, CI users still face difficulties in understanding speech in more challenging listening environments with multiple speakers, background noise and reverberation (i.e., the cocktail party problem). In such situations, normal-hearing (NH) listeners can focus on one target speaker and effectively suppress other present speakers. This effect is called selective attention. The ability to selectively attend is probably impaired in CI users and may be one of the reasons for the limitations in speech understanding in challenging listening environments.

This project investigates the possibilities of decoding selective attention in NH listeners and CI users. It has been shown that neural activity in the cerebral cortex, especially in the delta (1–4 Hz) and theta (4–8 Hz) frequency bands, tracks the amplitude envelope of a complex auditory stimulus such as speech. Therefore, electroencephalography (EEG) data can be used to track an attended speech source in NH listeners and CI users using high-density EEG caps. The selective attention can be further decoded by designing spatio-temporal filters, also called decoder, which serve to reconstruct the speech from the EEG data. The goal of this project is to investigate different types of decoders, including linear forward/backward models or non-linear models such as deep neural networks. Moreover, different methods to record and further to decode selective attention are investigated. Promising recording systems are the cEEGrid system, which represents portable EEG recording device or invasive electrode located on the temporal lobe.


This project is funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany's Excellence Strategy - EXC 2177/1 - Project number 390895286.

Head of Research Group:
[Prof. Dr.-Ing. Waldo Nogueira]

DHZ-Deutsches HörZentrum Hannover
Karl-Wiechert-Allee 3
30625 Hannover
Phone: +49 (0)511 532 8025
Fax: +49 (0)511 532 6833


About The VIANNA research team