TY - JOUR
T1 - Binaural Sound Localization Based on Reverberation Weighting and Generalized Parametric Mapping
AU - Pang, Cheng
AU - Liu, Hong
AU - Zhang, Jie
AU - Li, Xiaofei
N1 - Accepted Author Manuscript
PY - 2017
Y1 - 2017
N2 - Binaural sound source localization is an important technique for speech enhancement, video conferencing, and human-robot interaction, etc. However, in realistic scenarios, the reverberation and environmental noise would degrade the precision of sound direction estimation. Therefore, reliable sound localization is essential to practical applications. To deal with these disturbances, this paper presents a novel binaural sound source localization approach based on reverberation weighting and generalized parametric mapping. First, the reverberation weighting as a preprocessing stage, is used to separately suppress the early and late reverberation, while preserving interaural cues. Then, two binaural cues, i.e., interaural time and intensity differences, are extracted from the frequency-domain representations of dereverberated binaural signals for the online localization. Their corresponding templates are established using the training data. Furthermore, the generalized parametric mapping is proposed to build a generalized parametric model for describing relationships between azimuth and binaural cues analytically. Finally, a two-step sound localization process is introduced to refine azimuth estimation based on the generalized parametric model and template matching. Experiments in both simulated and real scenarios validate that the proposed method can achieve better localization performance compared to state-of-the-art methods.
AB - Binaural sound source localization is an important technique for speech enhancement, video conferencing, and human-robot interaction, etc. However, in realistic scenarios, the reverberation and environmental noise would degrade the precision of sound direction estimation. Therefore, reliable sound localization is essential to practical applications. To deal with these disturbances, this paper presents a novel binaural sound source localization approach based on reverberation weighting and generalized parametric mapping. First, the reverberation weighting as a preprocessing stage, is used to separately suppress the early and late reverberation, while preserving interaural cues. Then, two binaural cues, i.e., interaural time and intensity differences, are extracted from the frequency-domain representations of dereverberated binaural signals for the online localization. Their corresponding templates are established using the training data. Furthermore, the generalized parametric mapping is proposed to build a generalized parametric model for describing relationships between azimuth and binaural cues analytically. Finally, a two-step sound localization process is introduced to refine azimuth estimation based on the generalized parametric model and template matching. Experiments in both simulated and real scenarios validate that the proposed method can achieve better localization performance compared to state-of-the-art methods.
KW - Binaural localization
KW - reverberation weighting
KW - generalized parametric mapping
KW - template matching
UR - http://www.scopus.com/inward/record.url?scp=85028427960&partnerID=8YFLogxK
UR - http://resolver.tudelft.nl/uuid:cd5e4f56-a96a-4758-b84b-1698e3fa931d
U2 - 10.1109/TASLP.2017.2703650
DO - 10.1109/TASLP.2017.2703650
M3 - Article
AN - SCOPUS:85028427960
VL - 25
SP - 1618
EP - 1632
JO - IEEE - ACM Transactions on Audio, Speech, and Language Processing
JF - IEEE - ACM Transactions on Audio, Speech, and Language Processing
SN - 2329-9290
IS - 8
M1 - 7926345
ER -