In this paper, a fundamental frequency (F0) tracking algorithm is presented that is extremely robust for both high quality and telephone speech, at signal to noise ratios ranging from clean speech to very noisy speech. The algorithm is named “YAAPT,” for “yet another algorithm for pitch tracking.” The algorithm is based on a combination of time domain processing, using the normalized cross correlation, and frequency domain processing. Major steps include processing of the original acoustic signal and a nonlinearly processed version of the signal, the use of a new method for computing a modified autocorrelation function that incorporates information from multiple spectral harmonic peaks, peak picking to select multiple F0 candidates and associated figures of merit, and extensive use of dynamic programming to find the “best” track among the multiple F0 candidates. The algorithm was evaluated by using three databases and compared to three other published F0 tracking algorithms by using both high quality and telephone speech for various noise conditions. For clean speech, the error rates obtained are comparable to those obtained with the best results reported for any other algorithm; for noisy telephone speech, the error rates obtained are lower than those obtained with other methods.

1.
Bagshaw
,
P. C.
,
Miller
,
S. M.
, and
Jack
,
M. A.
(
1993
). “
Enhanced pitch tracking and the processing of the F0 contours for computer aided intonation teaching
,” in
Proceedings of EUROSPEECH
, Berlin, Germany,
1003
1006
. The database used in this paper is also available at http://www.cstr.ed.ac.uk/research/projects/fda (last accessed 4/1/2008).
2.
Boersma
,
P.
(
1993
). “
Accurate short-term analysis of the fundamental frequency and the harmonics-to-noise ratio of a sampled sound
,” in
Proceedings of the Institute of Phonetic Sciences
, Vol.
17
,
97
110
.
3.
Boersma
,
P.
, and
Weenink
,
D.
(
2005
). “
PRAAT: Doing phonetics by computer
,” version 4.3.14,
Institute of Phonetic Sciences
, http://www.praat.org (retrieved 5/26/2005).
4.
Chang
,
E.
,
Zhou
,
J.
,
Di
,
S.
,
Huang
,
C.
, and
Lee
,
K. F.
(
2000
). “
Large vocabulary mandarin speech recognition with different approaches in modeling tones
,” in
Proceedings of the Sixth International Conference of Spoken Language Processing
,
Interspeech 2000—ICSLP
,
Beijing, China
,
983
986
.
5.
de Cheveigne
,
A.
, and
Kawahara
,
H.
(
2002
). “
YIN, a fundamental frequency estimator for speech and music
,”
J. Acoust. Soc. Am.
111
,
1917
1930
.
6.
Duda
,
R.
,
Hart
,
P.
, and
Stork
,
D.
(
2000
).
Pattern Classification
(
Wiley-Interscience
,
New York
), pp.
128
137
.
7.
Hermes
,
D. J.
(
1988
). “
Measurement of pitch by subharmonic summation
,”
J. Acoust. Soc. Am.
83
,
257
264
.
8.
Hess
,
W.
(
1983
).
Pitch Determination of Speech Signals
(
Springer-Verlag
,
Berlin
), pp.
310
355
.
9.
Kasi
,
K.
, and
Zahorian
,
S. A.
(
2002
). “
Yet another algorithm for pitch tracking
,” in
Proceedings of the International Conference on Acoustics, Speech, and Signal Processing
,
ICASSP
,
Orlando, Florida
,
361
364
.
10.
Liu
,
D. J.
, and
Lin
,
C. T.
(
2001
). “
Fundamental frequency estimation based on the joint time-frequency analysis of harmonic spectral structure
,”
IEEE Trans. Speech Audio Process.
9
,
609
621
.
11.
Mousset
,
E.
,
Ainsworth
,
W. A.
, and
Fonollosa
,
J. A. R.
(
1996
). “
A comparison of several recent methods of fundamental frequency and voicing decision estimation
,” in
Proceedings of the Fourth International Conference on Spoken Language Processing
,
ICSLP
,
Philadelphia, Pennsylvania
,
1273
1276
.
12.
Nakatani
,
T.
, and
Irino
,
T.
(
2004
). “
Robust and accurate fundamental frequency estimation based on dominant harmonic components
,”
J. Acoust. Soc. Am.
116
,
3690
3700
.
13.
Ostendorf
,
M.
, and
Ross
,
K.
(
1997
). “
A multi-level model for recognition of intonation labels
,” in
Computing Prosody
, edited by
Y.
Sagisaka
,
N.
Campbell
, and
N.
Higuchi
(
Springer-Verlag
,
New York
), pp.
291
308
.
14.
Parsa
,
V.
, and
Jamieson
,
D. G.
(
1999
). “
A comparison of high precision F0 extraction algorithms for sustained vowels
,”
J. Speech Lang. Hear. Res.
42
,
112
126
.
15.
Plante
,
F.
,
Meyer
,
G.
, and
Ainsworth
,
W. A.
(
1995
). “
A pitch extraction reference database
,” in
Proceedings of the Fourth European Conference on Speech Communication and Technology
,
EUROSPEECH
,
Madrid, Spain
,
837
840
;
Information about this database is available at http://www.liv.ac.uk/psychology/hmp/projects/pitch.html (last accessed 4/1/2008).
16.
Rabiner
,
L.
,
Cheng
,
M.
,
Rosenberg
,
A.
, and
McGonegal
,
C.
(
1976
). “
A comparative performance study of several pitch detection algorithms
,”
IEEE Trans. Acoust., Speech, Signal Process.
ASSP-24
,
399
418
.
17.
Rabiner
,
L.
, and
Juang
,
B.-H.
(
1993
).
Fundamentals of Speech Recognition
(
Prentice-Hall
,
Englewood Cliffs, NJ
), pp.
204
208
.
18.
Rabiner
,
L.
, and
Schafer
,
R. W.
(
1978
).
Digital Processing of Speech Signals
(
Prentice-Hall
,
Englewood Cliffs, NJ
), pp.
150
157
.
19.
Ramana
,
R.
, and
Srichand
,
J.
(
1996
). “
Word boundary detection using pitch variations
,” in
Proceedings of the Fourth International Conference on Spoken Language Processing
,
ICSLP
,
Philadelphia, Pennsylvania
,
813
816
.
20.
Shriberg
,
E.
,
Bates
,
R.
, and
Stolcke
,
A.
(
1997
). “
A prosody-only decision-tree model for disfluency detection
,” in
Proceedings of the Fifth European Conference on Speech Communication and Technology
,
EUROSPEECH
,
Rhodes, Greece
,
2383
2386
.
21.
Talkin
,
D.
(
1995
). “
A robust algorithm for pitch tracking (RAPT)
,” in
Speech Coding and Synthesis
, edited by
W. B.
Kleijn
and
K. K.
Paliwal
(
Elsevier Science
,
New York
), pp.
495
518
.
22.
Wang
,
C.
, and
Seneff
,
S.
(
1998
). “
A study of tones and tempo in continuous mandarin digit strings and their application in telephone quality speech recognition
,” in
Proceedings of the Fifth International Conference on Spoken Language Processing
,
ICSLP
,
Sydney, Australia
,
635
638
.
23.
Wang
,
C.
, and
Seneff
,
S.
(
2000
). “
Robust pitch tracking for prosodic modeling in telephone speech
,” in
Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing
,
ICASSP
,
Istanbul, Turkey
,
1143
1146
.
24.
Zahorian
,
S. A.
,
Dikshit
,
P.
, and
Hu
,
H.
(
2006
). “
A spectral-temporal method for pitch tracking
,” in
Proceedings of the Ninth International Conference on Spoken Language Processing
,
Interspeech 2006—ICSLP
,
Pittsburgh, Pennsylvania
,
1710
1713
.
25.
Zahorian
,
S. A.
,
Zimmer
,
A.
, and
Dai
,
B.
(
1998
). “
Personal computer software vowel training aid for the hearing impaired
,” in
Proceedings of the International Conference on Acoustics, Speech, and Signal Processing
,
ICASSP
,
Seattle, Washington
, Vol.
6
,
3625
3628
.
You do not currently have access to this content.