Passive acoustics provides a powerful tool for monitoring the endangered North Atlantic right whale (Eubalaena glacialis), but robust detection algorithms are needed to handle diverse and variable acoustic conditions and differences in recording techniques and equipment. This paper investigates the potential of deep neural networks (DNNs) for addressing this need. ResNet, an architecture commonly used for image recognition, was trained to recognize the time-frequency representation of the characteristic North Atlantic right whale upcall. The network was trained on several thousand examples recorded at various locations in the Gulf of St. Lawrence in 2018 and 2019, using different equipment and deployment techniques. Used as a detection algorithm on fifty 30-min recordings from the years 2015–2017 containing over one thousand upcalls, the network achieved recalls up to 80% while maintaining a precision of 90%. Importantly, the performance of the network improved as more variance was introduced into the training dataset, whereas the opposite trend was observed using a conventional linear discriminant analysis approach. This study demonstrates that DNNs can be trained to identify North Atlantic right whale upcalls under diverse and variable conditions with a performance that compares favorably to that of existing algorithms.

1.
Aulanier
,
F.
,
Simard
,
Y.
,
Roy
,
N.
,
Gervaise
,
C.
, and
Bandet
,
M.
(
2016
). “
Spatio-temporal exposure of blue whale habitats to shipping noise in St. Lawrence system
,” DFO Canadian Science Advisory Secretariat Research Document 2016/090.
2.
Bahoura
,
M.
, and
Simard
,
Y.
(
2010
). “
Blue whale calls classification using short-time Fourier and wavelet packet transforms and artificial neural network
,”
Digit. Signal Process.
20
(
4
),
1256
1263
.
3.
Baumgartner
,
M. F.
,
Bonnell
,
J.
,
Van Parijs
,
S. M.
,
Corkeron
,
P. J.
,
Hotchkin
,
C.
,
Ball
,
K.
,
Pelletier
,
L.-P.
,
Partan
,
J.
,
Peters
,
D.
,
Kemp
,
J.
,
Pietro
,
J.
,
Newhall
,
K.
,
Stokes
,
A.
,
Cole
,
T. V. N.
,
Quintana
,
E.
, and
Kraus
,
S. D.
(
2019
). “
Persistent near real-time passive acoustic monitoring for baleen whales from a moored buoy: System description and evaluation
,”
Meth. Ecol. Evol.
10
,
1476
1489
.
4.
Baumgartner
,
M. F.
,
Fratantoni
,
D. M.
,
Hurst
,
T. P.
,
Brown
,
M. W.
,
Cole
,
T. V. N.
,
Van Parijs
,
S. M.
, and
Johnson
,
M.
(
2013
). “
Real-time reporting of baleen whale passive acoustic detections from ocean gliders
,”
J. Acoust. Soc. Am.
134
,
1814
1823
.
5.
Baumgartner
,
M. F.
, and
Mussoline
,
S. E.
(
2011
). “
A generalized baleen whale call detection and classification system
,”
J. Acoust. Soc. Am.
129
,
2889
2902
.
6.
Bergler
,
C.
,
Schröter
,
H.
,
Cheng
,
R. X.
,
Barth
,
V.
,
Weber
,
M.
,
Nöth
,
E.
,
Hofer
,
H.
, and
Maier
,
A.
(
2019
). “
ORCA-SPOT: An automatic killer whale sound detection toolkit using deep learning
,”
Sci. Rep.
9
,
10997
.
7.
Bermant
,
P. C.
,
Bronstein
,
M. M.
,
Wood
,
R. J.
,
Gero
,
S.
, and
Gruber
,
D. F.
(
2019
). “
Deep machine learning techniques for the detection and classification of sperm whale bioacoustics
,”
Sci. Rep.
9
,
12588
.
8.
COSEWIC
(
2013
). “
COSEWIC assessment and status report on the North Atlantic right whale Eubalaena glacialis in Canada
,” COSEWIC, Ottawa, Canada.
9.
Davis
,
G. E.
,
Baumgartner
,
M. F.
,
Bonnell
,
J. M.
,
Bell
,
J.
,
Berchok
,
C.
,
Bort Thornton
,
J.
,
Brault
,
S.
,
Buchanan
,
G.
,
Charif
,
R. A.
,
Cholewiak
,
D.
,
Clark
,
C. W.
,
Corkeron
,
P.
,
Delarue
,
J.
,
Dudzinski
,
K.
,
Hatch
,
L.
,
Hildebrand
,
J.
,
Hodge
,
L.
,
Klinck
,
H.
,
Kraus
,
S.
,
Martin
,
B.
,
Mellinger
,
D. K.
,
Moors-Murphy
,
H.
,
Nieukirk
,
S.
,
Nowacek
,
D. P.
,
Parks
,
S.
,
Read
,
A. J.
,
Rice
,
A. N.
,
Risch
,
D.
,
Širović
,
A.
,
Soldevilla
,
M.
,
Stafford
,
K.
,
Stanistreet
,
J. E.
,
Summers
,
E.
,
Todd
,
S.
,
Warde
,
A.
, and
Van Parijs
,
S. M.
(
2017
). “
Long-term passive acoustic recordings track the changing distribution of North Atlantic right whales (Eubalaena glacialis) from 2004 to 2014
,”
Sci. Rep.
7
,
13460
.
10.
DCLDE
(
2013
). Unpublished results, https://soi.st-andrews.ac.uk/dclde2013/.
11.
DFO
(
2018
). “
Science advice on timing of the mandatory slow-down zone for shipping traffic in the Gulf of St. Lawrence to protect the North Atlantic right whale
,” DFO Canadian Science Advisory Secretariat Science Response 2017/042, p.
16
.
12.
Gervaise
,
C.
,
Simard
,
Y.
,
Aulanier
,
F.
, and
Roy
,
N.
(
2019a
). “
Optimal passive acoustics systems for real-time detection and localization of North Atlantic right whales in their feeding ground off Gaspé in the Gulf of St. Lawrence
,” Canadian Technical Report of Fisheries and Aquatic Sciences 3345.
13.
Gervaise
,
C.
,
Simard
,
Y.
,
Aulanier
,
F.
, and
Roy
,
N.
(
2019b
). “
Performance study of passive acoustic systems for detecting North Atlantic right whales in seaways: The Honguedo strait in the Gulf of St. Lawrence
,” Canadian Technical Report of Fisheries and Aquatic Sciences 3346.
14.
Gillespie
,
D.
(
2004
). “
Detection and classification of right whale calls using an ‘edge’ detector operating on a smoothed spectrogram
,”
Can. Acoust.
32
,
39
47
, available at https://jcaa.caa-aca.ca/index.php/jcaa/article/view/1586.
15.
Goodfellow
,
I.
,
Bengio
,
Y.
, and
Courville
,
A.
(
2016
).
Deep Learning Book
(
MIT Press
,
Cambridge, MA
).
16.
Halkias
,
X. C.
,
Paris
,
S.
, and
Glotin
,
H.
(
2013
). “
Classification of mysticete sounds using machine learning techniques
,”
J. Acoust. Soc. Am.
134
(
5
),
3496
3505
.
17.
Hayes
,
S. A.
,
Josephson
,
E.
,
Maze-Foley
,
K.
,
Rosel
,
P.
,
Byrd
,
B.
,
Chavez-Rosales
,
S.
,
Cole
,
T.
,
Engleby
,
L.
,
Garrison
,
L.
,
Hatch
,
J.
,
Henry
,
A.
,
Horstman
,
S. C.
,
Litz
,
J.
,
Lyssikatos
,
M. C.
,
Mullin
,
K. D.
,
Orphanides
,
C.
,
Pace
,
R. M.
,
Palka
,
D. L.
,
Soldevilla
,
M.
, and
Wenzel
,
F. W.
(
2018
). “
US Atlantic and Gulf of Mexico marine mammal stock assessments—2017 (second edition)
,” NOAA Technical Memo No. NMFS NE-245, NOAA, Silver Spring, MD.
18.
He
,
K.
,
Zhang
,
X.
,
Ren
,
S.
, and
Sun
,
J.
(
2015
). “
Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification
,” in
Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV)
, December 11–15, Las Condes, Chile, pp.
1026
1034
.
19.
He
,
K.
,
Zhang
,
X.
,
Ren
,
S.
, and
Sun
,
J.
(
2016
). “
Deep residual learning for image recognition
,” in
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
, June 26–July 1, Las Vegas, NV, pp.
770
778
.
20.
Hinton
,
G.
,
Deng
,
L.
,
Yu
,
D.
,
Dahl
,
G. E.
,
Mohamed
,
A.
,
Jaitly
,
N.
,
Senior
,
A.
,
Vanhoucke
,
V.
,
Nguyen
,
P.
,
Sainath
,
T. N.
, and
Kingsbury
,
B.
(
2012
). “
Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups
,”
IEEE Signal Process. Mag.
29
(
6
),
82
97
.
21.
Ioffe
,
S.
, and
Szegedy
,
C.
(
2015
). “
Batch normalization: Accelerating deep network training by reducing internal covariate shift
,” arXiv:1502.03167.
22.
Kingma
,
D. P.
, and
Ba
,
J.
(
2014
). “
Adam: A method for stochastic optimization
,” arXiv:1412.6980.
23.
Ledoit
,
O.
, and
Wolf
,
M.
(
2004
). “
Honey, I shrunk the sample covariance matrix
,”
J. Portf. Manag.
30
(
4
),
110
119
.
24.
Lin
,
M.
,
Chen
,
Q.
, and
Yan
,
S.
(
2013
). “
Network in network
,” arXiv:1312.4400.
25.
Malfante
,
M.
,
Mohammed
,
O.
,
Gervaise
,
C.
,
Dalla Mura
,
M.
, and
Mars
,
J. I.
(
2018
). “
Use of deep features for the automatic classification of fish sounds
,” in
Proceedings of OCEANS'18 MTS/IEEE
, May 28–31, Kobe, Japan.
26.
Martinez
,
A. M.
, and
Kak
,
A. C.
(
2001
). “
PCA versus LDA
,”
IEEE Trans. Pattern Anal.
23
(
2
),
228
233
.
27.
McQuay
,
C.
,
Sattar
,
F.
, and
Driessen
,
P. F.
(
2017
). “
Deep learning for hydrophone big data
,” in
Proceedings of the 2017 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM)
, August 21–23, Victoria, Canada, pp.
1
6
.
28.
Mellinger
,
D. K.
(
2004
). “
A comparison of methods for detecting right whale calls
,”
Can. Acoust.
32
,
55
65
, available at https://jcaa.caa-aca.ca/index.php/jcaa/article/view/1588.
29.
Mouy
,
X.
,
Bahoura
,
M.
, and
Simard
,
Y.
(
2009
). “
Automatic recognition of fin and blue whale calls for real-time monitoring in the St. Lawrence
,”
J. Acoust. Soc. Am.
126
,
2918
.
30.
Nair
,
V.
, and
Hinton
,
G. E.
(
2010
). “
Rectified linear units improve restricted boltzmann machines
,” in
Proceedings of the 27th International Conference on Machine Learning (ICML-10)
, June 21–24, Haifa, Israel, pp.
807
814
.
31.
Pace
,
R. M.
,
Corkeron
,
P. J.
, and
Kraus
,
S. D.
(
2017
). “
State-space mark-recapture estimates reveal a recent decline in abundance of North Atlantic right whales
,”
Ecol. Evol.
7
,
8730
8741
.
32.
Pettis
,
H. M.
,
Pace
,
R. M. I.
, and
Hamilton
,
P. K.
(
2019
). “
North Atlantic right whale consortium 2019 annual report card
,” Report to the North Atlantic Right Whale Consortium, The North Atlantic Whale Consortium.
33.
Potter
,
J. R.
,
Mellinger
,
D. K.
, and
Clark
,
C. W.
(
1994
). “
Marine mammal call discrimination using artificial neural networks
,”
J. Acoust. Soc. Am.
96
,
1255
1262
.
34.
Shiu
,
Y.
,
Palmer
,
K. J.
,
Roch
,
M. A.
,
Fleishman
,
E.
,
Liu
,
X.
,
Nosal
,
E-M.
,
Helble
,
T.
,
Cholewiak
,
D.
,
Gillespie
,
D.
, and
Klinck
,
H.
(
2020
). “
Deep neural networks for automated detection of marine mammal species
,”
Sci. Rep.
10
,
607
.
35.
Simard
,
Y.
,
Roy
,
N.
,
Giard
,
S.
, and
Aulanier
,
F.
(
2019
). “
North Atlantic right whale shift to the Gulf of St. Lawrence in 2015 as monitored by long-term passive acoustics
,”
Endang. Sp. Res.
40
,
271
284
.
36.
Simard
,
Y.
,
Roy
,
N.
,
Giard
,
S.
, and
Yayla
,
M.
(
2014
). “
Canadian year-round shipping traffic atlas for 2013: Volume 1, East Coast marine waters
,” Canadian Technical Report of Fisheries and Aquatic Sciences 3091 (Vol. 1).
37.
Thomas
,
M.
,
Martin
,
B.
,
Kowarski
,
K.
,
Gaudet
,
B.
, and
Matwin
,
S.
(
2019
). “
Marine mammal species classification using convolutional neural networks and a novel acoustic representation
,” arXiv:1907.13188.
38.
Urazghildiiev
,
I. R.
, and
Clark
,
C. W.
(
2006
). “
Acoustic detection of North Atlantic right whale contact calls using the generalized likelihood ratio test
,”
J. Acoust. Soc. Am.
120
,
1956
1963
.
39.
Urazghildiiev
,
I. R.
, and
Clark
,
C. W.
(
2007
). “
Acoustic detection of North Atlantic right whale contact calls using spectrogram-based statistics
,”
J. Acoust. Soc. Am.
122
,
769
776
.
40.
Urazghildiiev
,
I. R.
,
Clark
,
C. W.
, and
Krein
,
T. P.
(
2008
). “
Detection and recognition of North Atlantic right whale contact calls in the presence of ambient noise
,”
Can. Acoust.
36
,
111
117
, available at https://jcaa.caa-aca.ca/index.php/jcaa/article/view/1999.
You do not currently have access to this content.