VIANNA 
MusIC: Making Music More Accessible for Cochlear Implant Users
- Enhancing the signing voice of music to improve music appreciation for CI users
- Real-time music source separation to apply enhancement on singing voice
- Parametrization of CI sound coding strategies for singing music
- Sound Coding Strategy for music
Music Source Separation Using Deep Neural Networks:
Music samples of the Real-time Music Source Separation experiment. In this experiment a multilayer perceptron has been used to separate the singing voice from the instrumental accompaniment to remix the music track. It has been shown that CI users enjoy music more, when the singing voice is enhanced with respect to the background instruments. Our results indicate that CI users enjoy music more when the singing voice is 8 dB enhanced with respect to the background accompaniment.
Audio Example:
Below is a demo of the music tracks used in this experiment.
| Music Track | Example 1 | Example 2 |
|---|---|---|
| Original Mixture | ||
| Enhanced Mixture | ||
| Vocals Signal | ||
| Instruments Signal |
Music4u
- Difficult to enjoy complex music as i.e. classical pieces for CI-users.
- Investigating, which musical component (i.e. melody) in instrumental classical music CI-users want to enhance.
- Testing, if selective attention decoding is possible for CI-users.
- Feeding EEG-data into neural networks to enhance source separation of attended sound source.
Team Members
Publications:
-
S. Tahmasebi, T. Gajȩcki, W. Nogueira. Design and Evaluation of a Real-Time Audio Source Separation Algorithm to Remix Music for Cochlear Implant Users. Frontiers in Neuroscience. 14, 434. doi: 110.3389/fnins.2020.00434. Epub 2020 May 14.
-
W. Nogueira, A. Nagathi, R. Martin. Making Music More Accessible for Cochlear Implant Listeners: Recent Developments., in IEEE Signal Processing Magazine, vol. 36, no. 1, pp. 115-127, Jan. 2019, doi: 10.1109/MSP.2018.2874059.
-
T. Gajęcki, W. Nogueira. Deep learning models to remix music for cochlear implant users., The Journal of the Acoustical Society of America, 143(6), 3602-3615. June 2018.
-
J. Pons, J. Janer, T. Rode, W. Nogueira. Remixing music using source separation algorithms to improve the musical experience of cochlear implant users, The Journal of the Acoustical Society of America, 140(6), 4338-4349. December 2016.
| Contact | |
|---|---|
| Head of Research Group: |
Prof. Dr.-Ing. Waldo Nogueira |
| Address: |
DHZ-Deutsches HörZentrum Hannover Karl-Wiechert-Allee 3 30625 Hannover |
| Phone: | +49 (0)511 532 8025 |
| Fax: | +49 (0)511 532 6833 |
| E-Mail: | nogueiravazquez.waldo@mh-hannover.de |
