Unlocking the potential of deep learning for marine ecology: overview, applications, and outlook
The deep learning revolution is touching all scientific disciplines and corners of our lives as a means of harnessing the power of big data. Marine ecology is no exception. These new methods provide analysis of data from sensors, cameras, and acoustic recorders, even in real time, in ways that are reproducible and rapid. Off-the-shelf algorithms can find, count, and classify species from digital images or video and detect cryptic patterns in noisy data. Using these opportunities requires collaboration across ecological and data science disciplines, which can be challenging to initiate. To facilitate these collaborations and promote the use of deep learning towards ecosystem-based management…
Development of a Simulator for Prototyping Reinforcement Learning-Based Autonomous Cars
Autonomous driving is a research field that has received attention in recent years, with increasing applications of reinforcement learning (RL) algorithms. It is impractical to train an autonomous vehicle thoroughly in the physical space, i.e., the so-called ’real world’; therefore, simulators are used in almost all training of autonomous driving algorithms. There are numerous autonomous driving simulators, very few of which are specifically targeted at RL. RL-based cars are challenging due to the variety of reward functions available. There is a lack of simulators addressing many central RL research tasks within autonomous driving, such as scene understanding, localization and mapping, pla…
Temperate Fish Detection and Classification: a Deep Learning based Approach
A wide range of applications in marine ecology extensively uses underwater cameras. Still, to efficiently process the vast amount of data generated, we need to develop tools that can automatically detect and recognize species captured on film. Classifying fish species from videos and images in natural environments can be challenging because of noise and variation in illumination and the surrounding habitat. In this paper, we propose a two-step deep learning approach for the detection and classification of temperate fishes without pre-filtering. The first step is to detect each single fish in an image, independent of species and sex. For this purpose, we employ the You Only Look Once (YOLO) …
Biometric Fish Classification of Temperate Species Using Convolutional Neural Network with Squeeze-and-Excitation
Our understanding and ability to effectively monitor and manage coastal ecosystems are severely limited by observation methods. Automatic recognition of species in natural environment is a promising tool which would revolutionize video and image analysis for a wide range of applications in marine ecology. However, classifying fish from images captured by underwater cameras is in general very challenging due to noise and illumination variations in water. Previous classification methods in the literature relies on filtering the images to separate the fish from the background or sharpening the images by removing background noise. This pre-filtering process may negatively impact the classificat…
Accurate Wound and Lice Detection in Atlantic Salmon Fish Using a Convolutional Neural Network
The population living in the coastal region relies heavily on fish as a food source due to their vast availability and low cost. This need has given rise to fish farming. Fish farmers and the fishing industry face serious challenges such as lice in the aquaculture ecosystem, wounds due to injuries, early fish maturity, etc. causing millions of fish deaths in the fish aquaculture ecosystem. Several measures, such as cleaner fish and anti-parasite drugs, are utilized to reduce sea lice, but getting rid of them entirely is challenging. This study proposed an image-based machine-learning technique to detect wounds and the presence of lice in the live salmon fish farm ecosystem. A new equally di…
Biometric Fish Classification of Temperate Species Using Convolutional Neural Network with Squeeze-and-Excitation
Our understanding and ability to effectively monitor and manage coastal ecosystems are severely limited by observation methods. Automatic recognition of species in natural environment is a promising tool which would revolutionize video and image analysis for a wide range of applications in marine ecology. However, classifying fish from images captured by underwater cameras is in general very challenging due to noise and illumination variations in water. Previous classification methods in the literature relies on filtering the images to separate the fish from the background or sharpening the images by removing background noise. This pre-filtering process may negatively impact the classificat…