Skip to Main content Skip to Navigation
Journal articles

One hundred ways to process time, frequency, rate and scale in the central auditory system: a pattern-recognition meta-analysis

Edgar Hemery 1 Jean-Julien Aucouturier 2, * 
* Corresponding author
2 Equipe Perception et design sonores
STMS - Sciences et Technologies de la Musique et du Son
Abstract : The mammalian auditory system extracts features from the acoustic environment based on the responses of spatially distributed sets of neurons in the subcortical and cortical auditory structures. The characteristic responses of these neurons (linearly approximated by their spectro-temporal receptive fields, or STRFs) suggest that auditory representations are formed, as early as in the inferior colliculi, on the basis of a time, frequency, rate (temporal modulations) and scale (spectral modulations) analysis of sound. However, how these four dimensions are integrated and processed in subsequent neural networks remains unclear. In this work, we present a new methodology to generate computational insights into the functional organization of such processes. We first propose a systematic framework to explore more than a hundred different computational strategies proposed in the literature to process the output of a generic STRF model. We then evaluate these strategies on their ability to compute perceptual distances between pairs of environmental sounds. Finally, we conduct a meta-analysis of the dataset of all these algorithms' accuracies to examine whether certain combinations of dimensions and certain ways to treat such dimensions are, on the whole, more computationally effective than others. We present an application of this methodology to a dataset of ten environmental sound categories, in which the analysis reveals that (1) models are most effective when they organize STRF data into frequency groupings—which is consistent with the known tonotopic organization of receptive fields in auditory structures-, and that (2) models that treat STRF data as time series are no more effective than models that rely only on summary statistics along time—which corroborates recent experimental evidence on texture discrimination by summary statistics.
Complete list of metadata

Cited literature [42 references]  Display  Hide  Download
Contributor : Bibliothèque MINES ParisTech Connect in order to contact the contributor
Submitted on : Monday, August 24, 2015 - 4:04:14 PM
Last modification on : Tuesday, March 15, 2022 - 3:20:30 AM
Long-term archiving on: : Wednesday, November 25, 2015 - 6:26:34 PM


Publisher files allowed on an open archive


Distributed under a Creative Commons Attribution 4.0 International License



Edgar Hemery, Jean-Julien Aucouturier. One hundred ways to process time, frequency, rate and scale in the central auditory system: a pattern-recognition meta-analysis. Frontiers in Computational Neuroscience, Frontiers, 2015, 9 (Article 80), 18 p. ⟨10.3389/fncom.2015.00080⟩. ⟨hal-01186328⟩



Record views


Files downloads