Convolutional Recurrent Neural Networks for Polyphonic Sound Event Detection

Cakir, Emre; Parascandolo, Giambattista; Heittola, Toni; Huttunen, Heikki; Virtanen, Tuomas
Abstract

Sound events often occur in unstructured environments where they exhibit wide variations in their frequency content and temporal structure. Convolutional neural networks (CNNs) are able to extract higher level features that are invariant to local spectral and temporal variations. Recurrent neural networks (RNNs) are powerful in learning the longer term temporal context in the audio signals. CNNs and RNNs as classifiers have recently shown improved performances over established methods in various sound recognition tasks. We combine these two approaches in a convolutional recurrent neural network (CRNN) and apply it on a polyphonic sound event detection task. We compare the performance of the proposed CRNN method with CNN, RNN, and other established methods, and observe a considerable improvement for four different datasets consisting of everyday sound events.

Keywords

deep neural networks; sound event detection

Research areas

Year:
2017
Journal:
IEEE-ACm Transactions on Audio Speech and Language Processing
Volume:
25
Number:
6
Pages:
1291-1303
Month:
6
ISSN:
2329-9290
DOI:
10.1109/TASLP.2017.2690575