The modulation statistics of natural sound ensembles were analyzed by calculating the probability distributions of the amplitude envelope of the sounds and their time-frequency correlations given by the modulation spectra. These modulation spectra were obtained by calculating the two-dimensional Fourier transform of the autocorrelation matrix of the sound stimulus in its spectrographic representation. Since temporal bandwidth and spectral bandwidth are conjugate variables, it is shown that the joint modulation spectrum of sound occupies a restricted space: sounds cannot have rapid temporal and spectral modulations simultaneously. Within this restricted space, it is shown that natural sounds have a characteristic signature. Natural sounds, in general, are low-passed, showing most of their modulation energy for low temporal and spectral modulations. Animal vocalizations and human speech are further characterized by the fact that most of the spectral modulation power is found only for low temporal modulation. Similarly, the distribution of the amplitude envelopes also exhibits characteristic shapes for natural sounds, reflecting the high probability of epochs with no sound, systematic differences across frequencies, and a relatively uniform distribution for the log of the amplitudes for vocalizations. It is postulated that the auditory system as well as engineering applications may exploit these statistical properties to obtain an efficient representation of behaviorally relevant sounds. To test such a hypothesis we show how to create synthetic sounds with first and second order envelope statistics identical to those found in natural sounds.
Skip Nav Destination
Article navigation
December 2003
December 02 2003
Modulation spectra of natural sounds and ethological theories of auditory processing
Nandini C. Singh;
Nandini C. Singh
Department of Psychology and Neuroscience Institute, University of California, Berkeley, 3210 Tolman Hall, Berkeley, California 94720-1650
Search for other works by this author on:
Frédéric E. Theunissen
Frédéric E. Theunissen
Department of Psychology and Neuroscience Institute, University of California, Berkeley, 3210 Tolman Hall, Berkeley, California 94720-1650
Search for other works by this author on:
J. Acoust. Soc. Am. 114, 3394–3411 (2003)
Article history
Received:
April 23 2003
Accepted:
September 15 2003
Citation
Nandini C. Singh, Frédéric E. Theunissen; Modulation spectra of natural sounds and ethological theories of auditory processing. J. Acoust. Soc. Am. 1 December 2003; 114 (6): 3394–3411. https://doi.org/10.1121/1.1624067
Download citation file:
Pay-Per-View Access
$40.00
Sign In
You could not be signed in. Please check your credentials and make sure you have an active account and try again.
Citing articles via
All we know about anechoic chambers
Michael Vorländer
A survey of sound source localization with deep learning methods
Pierre-Amaury Grumiaux, Srđan Kitić, et al.
Does sound symbolism need sound?: The role of articulatory movement in detecting iconicity between sound and meaning
Mutsumi Imai, Sotaro Kita, et al.
Related Content
Eyebrow movements and vocal pitch height: Evidence consistent with an ethological signal
J. Acoust. Soc. Am. (May 2013)
Neural and cognitive mechanisms for vocal communication
J Acoust Soc Am (October 2022)
Acoustic variability and distinguishability among mouse ultrasound vocalizations
J Acoust Soc Am (December 2003)
Combining whistle acoustic parameters to discriminate Mediterranean odontocetes during passive acoustic monitoring
J. Acoust. Soc. Am. (January 2014)
The voice of dominance
J Acoust Soc Am (August 2005)