Optimizing Machine Learning for the Detection of Splashing Sounds for Automatic Monitoring of Fish Spawning

Springer eBooks, pp. 1–13

Abstract

Passive acoustic recordings can play an important role in biodiversity monitoring and management of human activities, with growing potential due to artificial intelligence. The twaite shad Alosa fallax is a clupeiformes fish found from the northwestern Atlantic to the Mediterranean. It spawns in freshwater and migrates upstream from the sea to rivers in spring. Twaite shad are classed as a threatened species. As part of their spawning behavior, males chase females in circles close to the water surface, producing a distinctive splashing sound that can be used for passive acoustic monitoring. In reintroduction programs, this can be used to measure spawning activity and locate spawning sites. As manual identification of shad splashing events in large audio datasets is time-consuming, an automatic shad splashing detection system is required. Here, embeddings from seven pretrained AI models from different source-domains were used to train a classifier for shad splashing detection. The model BirdNET provided the most informative embeddings. A class imbalance in training data composition was beneficial for classifier performance, and filtering for high-quality positive examples was detrimental. This study shows the value of retraining publicly available, pretrained machine learning algorithms to detect novel challenging sound events against a noisy background.

Authors 8

1. Line Weiss Aachen

   Leiden University

   Affiliation as printed

   Leiden University, Leiden, The Netherlands

2. Lisa Dörner corresponding Aachen Institute of Biology Leiden

   Leiden University

   Affiliation as printed

   Leiden University, Institute of Biology, Leiden, The Netherlands

3. Vincent S. Kather Aachen Naturalis Biodiversity Center

   Naturalis Biodiversity Center

   Affiliation as printed

   Naturalis Biodiversity Center, Understanding Evolution, Leiden, The Netherlands

4. Max de Koning

   Wageningen University & Research

   Affiliation as printed

   Wageningen University & Research, Wageningen, The Netherlands

5. Kees te Velde Aachen Naturalis Biodiversity Center

   Naturalis Biodiversity Center

   Affiliation as printed

   Naturalis Biodiversity Center, Leiden, The Netherlands

6. Ine Pauwels

   Research Institute for Nature and Forest

   Affiliation as printed

   Research Institute for Nature and Forest, Brussels, Belgium

7. Christian Tudorache Aachen Institute of Biology Leiden

   Leiden University

   Affiliation as printed

   Leiden University, Institute of Biology, Leiden, The Netherlands

8. Hans Slabbekoorn Aachen Institute of Biology Leiden

   Leiden University

   Affiliation as printed

   Leiden University, Institute of Biology, Leiden, The Netherlands