Multiple object tracking (MOT) technology has made significant progress in terrestrial applications, but underwater tracking scenarios remain underexplored despite their importance to marine ecology and aquaculture. In this paper, we present Multiple Fish Tracking Dataset 2025 (MFT25), a comprehensive dataset specifically designed for underwater multiple fish tracking, featuring 15 diverse video sequences with 408,578 meticulously annotated bounding boxes across 48,066 frames. Our dataset captures various underwater environments, fish species, and challenging conditions including occlusions, similar appearances, and erratic motion patterns. Additionally, we introduce Scale-aware and Unscented Tracker (SU-T), a specialized tracking framework featuring an Unscented Kalman Filter (UKF) optimized for non-linear swimming patterns of fish and a novel Fish-Intersection-over-Union (FishIoU) matching that accounts for the unique morphological characteristics of aquatic species. Extensive experiments demonstrate that our SU-T baseline achieves state-of-the-art performance on MFT25, with 34.1 HOTA and 44.6 IDF1, while revealing fundamental differences between fish tracking and terrestrial obj
In the context of Mediterranean aquaculture little attention has been paid to the manipulation of feeding frequency at the on-growing phase. The effects of different feeding frequencies: one meal per day, two meals per day, three meals per day on growth, digestive enzyme activity, feed digestibility and plasma biochemistry were studied in gilthead sea bream (Sparus aurata, L. 1758) fed with high and low fishmeal and fish oil levels. Isonitrogenous and isolipidic extruded diets were fed to triplicate fish groups by a fixed ration over 109 days. No significant effects of feeding frequency on overall performance, feed efficiency and feed digestibility during the on-growing of gilthead sea bream fed high or low fishmeal and fish oil dietary level were observed. Pepsin activity showed an apparent decrease in fish receiving more than one meal a day which was not compensated by an increased production of alkaline proteases particularly in fish fed on low FM. Although there were no effects on growth and feed utilisation at increasing feeding frequency, trypsin decreased significantly with an increasing number of meals only under low FMFO diet. Thus, it seemed that consecutive meals could h
Fighting fish is a combinatorial configuration introduced by Duchi, Guerrini, Rinaldi and Schaeffer as a new model of branching surfaces that generalizes directed convex polyominoes. We come up with an alternative construction of fighting fish, using a tree structure built on the so-called stem cells of fighting fish. From this perspective, we establish a bijection between ternary trees and fighting fish with a marked strip of cells, which specializes to a direct bijection between left ternary trees and fighting fish. Using these results, we obtain a combinatorial enumeration of the fighting fish of size $n$ by establishing an $(n+1)$-to-2 bijection with the ternary trees with $n$ nodes. We present some additional enumerative results including that fighting fish with a marked tail and horizontally symmetric fighting fish are equinumerous with ordered pairs of ternary trees having a total of a given number of nodes.
Biology is perhaps the most complex of the sciences, given the incredible variety of chemical species that are interconnected in spatial and temporal pathways that are daunting to understand. Their interconnections lead to emergent properties such as memory, consciousness, and recognition of self and non-self. To understand how these interconnected reactions lead to cellular life characterized by activation, inhibition, regulation, homeostasis, and adaptation, computational analyses and simulations are essential, a fact recognized by the biological communities. At the same time, students struggle to understand and apply binding and kinetic analyses for the simplest reactions such as the irreversible first-order conversion of a single reactant to a product. This likely results from cognitive difficulties in combining structural, chemical, mathematical, and textual descriptions of binding and catalytic reactions. To help students better understand dynamic reactions and their analyses, we have introduced two kinds of interactive graphs and simulations into the online educational resource, Fundamentals of Biochemistry, a multivolume biochemistry textbook that is part of the LibreText c
There is much concern about disruption of endocrine physiology regulated by steroid hormones in humans, other terrestrial vertebrates and fish by industrial chemicals, such as bisphenol A, and pesticides, such as DDT. These endocrine-disrupting chemicals influence steroid-mediated physiology in humans and other vertebrates by competing with steroids for receptor binding sites, disrupting diverse responses involved in reproduction, development and differentiation. Here I discuss that due to evolution of the progesterone receptor (PR) and mineralocorticoid receptor (MR) after ray-finned fish and terrestrial vertebrates diverged from a common ancestor, each receptor evolved to respond to different steroids in ray-finned fish and terrestrial vertebrates. In elephant shark, a cartilaginous fish, ancestral to ray-finned fish and terrestrial vertebrates, both progesterone and 17,20dihydroxyprogesterone activate the PR. During the evolution of ray-finned fish and terrestrial vertebrates, the PR in terrestrial vertebrates continued responding to progesterone and evolved to weakly respond to 17,20dihydroxyprogesterone. In contrast, the physiological progestin for the PR in zebrafish and othe
In recent years, multiplexed Fluorescence In Situ Hybridization (FISH) or FISH-omics methods have rapidly expanded, enabling the quantification of chromatin organization in single cells, often in conjunction with measurements of RNA and protein. These approaches have deepened our understanding of how 3D chromosome architecture relates to transcriptional activity and cell states in health and disease. Despite these advances, results from Chromatin Tracing FISH-omics experiments remain challenging to share, reuse, and analyze due to the absence of standardized data exchange specifications. Building on the release of microscopy metadata standards, we introduce the FISH Omics Format-Chromatin Tracing (FOF-CT), a community-developed standard for processed results from diverse imaging modalities. We describe the FOF-CT file format and present a curated collection of datasets deposited in the 4DN Data Portal and the OME Image Data Resource (IDR). We also highlight their potential for reuse, integration, and modeling by outlining example analysis pipelines and illustrating biological insights enabled by standardized, FAIR-compliant Chromatin Tracing datasets. While this manuscript focuses
Fish detection in water-land transfer has significantly contributed to the fishery. However, manual fish detection in crowd-collaboration performs inefficiently and expensively, involving insufficient accuracy. To further enhance the water-land transfer efficiency, improve detection accuracy, and reduce labor costs, this work designs a new type of lightweight and plug-and-play edge intelligent vision system to automatically conduct fast fish detection with high-speed camera. Moreover, a novel similarity-aware vision Transformer for fast fish detection (FishViT) is proposed to onboard identify every single fish in a dense and similar group. Specifically, a novel similarity-aware multi-level encoder is developed to enhance multi-scale features in parallel, thereby yielding discriminative representations for varying-size fish. Additionally, a new soft-threshold attention mechanism is introduced, which not only effectively eliminates background noise from images but also accurately recognizes both the edge details and overall features of different similar fish. 85 challenging video sequences with high framerate and high-resolution are collected to establish a benchmark from real fish w
Deep learning provides the opportunity to improve upon conflicting reports considering the relationship between the Amazon river's fish and dolphin abundance and reduced canopy cover as a result of deforestation. Current methods of fish and dolphin abundance estimates are performed by on-site sampling using visual and capture/release strategies. We propose a novel approach to calculating fish abundance using deep learning for fish and dolphin estimates from sonar images taken from the back of a trolling boat. We consider a data set of 143 images ranging from 0-34 fish, and 0-3 dolphins provided by the Fund Amazonia research group. To overcome the data limitation, we test the capabilities of data augmentation on an unconventional 15/85 training/testing split. Using 20 training images, we simulate a gradient of data up to 25,000 images using augmented backgrounds and randomly placed/rotation cropped fish and dolphin taken from the training set. We then train four multitask network architectures: DenseNet201, InceptionNetV2, Xception, and MobileNetV2 to predict fish and dolphin numbers using two function approximation methods: regression and classification. For regression, Densenet201
Fish stock assessment often involves manual fish counting by taxonomy specialists, which is both time-consuming and costly. We propose FishNet, an automated computer vision system for both taxonomic classification and fish size estimation from images captured with a low-cost digital camera. The system first performs object detection and segmentation using a Mask R-CNN to identify individual fish from images containing multiple fish, possibly consisting of different species. Then each fish species is classified and the length is predicted using separate machine learning models. To develop the model, we use a dataset of 300,000 hand-labeled images containing 1.2M fish of 163 different species and ranging in length from 10cm to 250cm, with additional annotations and quality control methods used to curate high-quality training data. On held-out test data sets, our system achieves a 92% intersection over union on the fish segmentation task, a 89% top-1 classification accuracy on single fish species classification, and a 2.3cm mean absolute error on the fish length estimation task.
What are the computational foundations of social grouping? Traditional approaches to this question have focused on verbal reasoning or simple (low-dimensional) quantitative models. In the real world, however, social preferences emerge when high-dimensional learning systems (brains and bodies) interact with high-dimensional sensory inputs during an animal's embodied interactions with the world. A deep understanding of social grouping will therefore require embodied models that learn directly from sensory inputs using high-dimensional learning mechanisms. To this end, we built artificial neural networks (ANNs), embodied those ANNs in virtual fish bodies, and raised the artificial fish in virtual fish tanks that mimicked the rearing conditions of real fish. We then compared the social preferences that emerged in real fish versus artificial fish. We found that when artificial fish had two core learning mechanisms (reinforcement learning and curiosity-driven learning), artificial fish developed fish-like social preferences. Like real fish, the artificial fish spontaneously learned to prefer members of their own group over members of other groups. The artificial fish also spontaneously l
Monocular absolute 3D fish pose estimation allows for efficient fish length measurement in the longline fisheries, where fishes are under severe deformation during the catching process. This task is challenging since it requires locating absolute 3D fish keypoints based on a short monocular video clip. Unlike related works, which either require expensive 3D ground-truth data and/or multiple-view images to provide depth information, or are limited to rigid objects, we propose a novel frame-based method to estimate the absolute 3D fish pose and fish length from a single-view 2D segmentation mask. We first introduce a relative 3D fish template. By minimizing an objective function, our method systematically estimates the relative 3D pose of the target fish and fish 2D keypoints in the image. Finally, with a closed-form solution, the relative 3D fish pose can help locate absolute 3D keypoints, resulting in the frame-based absolute fish length measurement, which is further refined based on the statistical temporal inference for the optimal fish length measurement from the video clip. Our experiments show that this method can accurately estimate the absolute 3D fish pose and further measu
While mathematical models, in particular self-propelled particle (SPP) models, capture many of the observed properties of large fish schools, they do not always capture the interactions of smaller shoals. Nor do these models tend to account for the observation that, when swimming alone or in smaller groups, many species of fish use intermittent locomotion, often referred to as burst and coast or burst and glide. Recent empirical studies have suggested that burst and glide movement is indeed pivotal to the social interactions of individual fish. In this paper, we propose a model of social burst and glide motion by combining a well-studied model of neuronal dynamics, the FitzHugh-Nagumo model, with a model of fish motion. We begin by showing that the model can capture the motion of a single fish swimming down a channel. By then extending to a two fish model, where visual stimuli of the position of the other fish affect the internal burst or glide state of the fish, we find that our model captures a rich set of swimming dynamics found in many species of fish. These include: leader-follower behaviour; periodic changes in leadership; apparently random (i.e. chaotic) leadership change; a
Fish migration is a dynamic phenomenon observed in many surface water bodies on the earth, while its understanding is still insufficient. Particularly, the biological mechanism behind fish migration is not fully understood. Moreover, its observation is often conducted visually and hence manually, raising questions of accuracy and interpretation of the data sampled. We address the two issues, mechanism and observation, of fish migration based on a recently developed mathematical model. The results obtained in this short paper show that fish migration can be characterized through a minimization principle and evaluate the error of its manual observations. The minimization principle we hypothesize is an optimal control problem where the migrating fish population dynamically changes its size and fluctuation. We numerically investigate alternating and intensive observation schemes as case studies, demonstrating that in some realistic conditions the estimate of total fish count is not reliable. We believe that this paper contributes to a deeper understanding of fish migration.
Marine scientists use remote underwater video recording to survey fish species in their natural habitats. This helps them understand and predict how fish respond to climate change, habitat degradation, and fishing pressure. This information is essential for developing sustainable fisheries for human consumption, and for preserving the environment. However, the enormous volume of collected videos makes extracting useful information a daunting and time-consuming task for a human. A promising method to address this problem is the cutting-edge Deep Learning (DL) technology.DL can help marine scientists parse large volumes of video promptly and efficiently, unlocking niche information that cannot be obtained using conventional manual monitoring methods. In this paper, we provide an overview of the key concepts of DL, while presenting a survey of literature on fish habitat monitoring with a focus on underwater fish classification. We also discuss the main challenges faced when developing DL for underwater image processing and propose approaches to address them. Finally, we provide insights into the marine habitat monitoring research domain and shed light on what the future of DL for unde
Until recently, the only examples of inverted biomass pyramids have been in freshwater and marine planktonic communities. In 2002 and 2008 investigators documented inverted biomass pyramids for nearly pristine coral reef ecosystems within the NW Hawaiian islands and the Line Islands, where apex predator abundance comprises up to 85% of the fish biomass. We build a new refuge based predator-prey model to study the fish biomass structure at coral reefs and investigate the effect of fishing on biomass pyramids. Utilizing realistic life history parameters of coral reef fish, our model exhibits a stable inverted biomass pyramid. Since the predators and prey are not well mixed, our model does not incorporate homogeneous mixing and the inverted biomass pyramid is a consequence of the refuge. Understanding predator-prey dynamics in nearly pristine conditions provides a more realistic historical framework for comparison with fished reefs. Finally, we show that fishing transforms the inverted biomass pyramid to be bottom heavy.
Integration of technological solutions aims to improve accuracy, precision and repeatability in farming operations, and biosensor devices are increasingly used for understanding basic biology during livestock production. The aim of this study was to design and validate a miniaturized tri-axial accelerometer for non-invasive monitoring of farmed fish with re-programmable schedule protocols.The device was attached to the operculum of gilthead sea bream and European sea bass juveniles for monitoring their physical activity by measurements of movement accelerations in x and y-axes, while records of operculum beats served as a measurement of respiratory frequency. Data post-processing of exercised fish in swimming test chambers revealed an exponential increase of fish accelerations with the increase of fish speed from 1 body-length to 4 body-lengths per second, while a close relationship between oxygen consumption and opercular frequency was consistently found.The usefulness of low computational load for data pre-processing with on-board algorithms was verified from low to submaximal exercise, increasing this procedure the autonomy of the system up to 6 h of data recording with differen
Accurate phenotypic analysis in aquaculture breeding necessitates the quantification of subtle morphological phenotypes. Existing datasets suffer from limitations such as small scale, limited species coverage, and inadequate annotation of keypoints for measuring refined and complex morphological phenotypes of fish body parts. To address this gap, we introduce FishPhenoKey, a comprehensive dataset comprising 23,331 high-resolution images spanning six fish species. Notably, FishPhenoKey includes 22 phenotype-oriented annotations, enabling the capture of intricate morphological phenotypes. Motivated by the nuanced evaluation of these subtle morphologies, we also propose a new evaluation metric, Percentage of Measured Phenotype (PMP). It is designed to assess the accuracy of individual keypoint positions and is highly sensitive to the phenotypes measured using the corresponding keypoints. To enhance keypoint detection accuracy, we further propose a novel loss, Anatomically-Calibrated Regularization (ACR), that can be integrated into keypoint detection models, leveraging biological insights to refine keypoint localization. Our contributions set a new benchmark in fish phenotype analysis
This study investigates a method to guide and control fish schools using virtual fish trained with reinforcement learning. We utilize 2D virtual fish displayed on a screen to overcome technical challenges such as durability and movement constraints inherent in physical robotic agents. To address the lack of detailed behavioral models for real fish, we adopt a model-free reinforcement learning approach. First, simulation results show that reinforcement learning can acquire effective movement policies even when simulated real fish frequently ignore the virtual stimulus. Second, real-world experiments with live fish confirm that the learned policy successfully guides fish schools toward specified target directions. Statistical analysis reveals that the proposed method significantly outperforms baseline conditions, including the absence of stimulus and a heuristic "stay-at-edge" strategy. This study provides an early demonstration of how reinforcement learning can be used to influence collective animal behavior through artificial agents.
The increasing demand for aquaculture production necessitates the development of innovative, intelligent tools to effectively monitor and manage fish health and welfare. While non-invasive video monitoring has become a common practice in finfish aquaculture, existing intelligent monitoring methods predominantly focus on assessing body condition or fish swimming patterns and are often developed and evaluated in controlled tank environments, without demonstrating their applicability to real-world aquaculture settings in open sea farms. This underscores the necessity for methods that can monitor physiological traits directly within the production environment of sea fish farms. To this end, we have developed a computer vision method for monitoring ventilation rates of Atlantic salmon (Salmo salar), which was specifically designed for videos recorded in the production environment of commercial sea fish farms using the existing infrastructure. Our approach uses a fish head detection model, which classifies the mouth state as either open or closed using a convolutional neural network. This is followed with multiple object tracking to create temporal sequences of fish swimming across the f
Traditionally, studies in experimental physiology have been conducted in small groups of human participants, animal models or cell lines. Identifying optimal study designs that achieve sufficient power for drawing proper statistical inferences to detect group level effects with small sample sizes has been challenging. Moreover, average effects derived from traditional group-level inference do not necessarily apply to individual participants. Here, we introduce N-of-1 trials as an innovative study design that can be used to draw valid statistical inference about the effects of interventions on individual participants and can be aggregated across multiple study participants to provide population-level inferences more efficiently than standard group randomized trials. N-of-1 trials have been used in healthcare settings since the late 1980s, but without large-scale adoption and with few applications in experimental physiology research settings. In this manuscript, we introduce the key components and design features of N-of-1 trials, describe statistical analysis and interpretations of the results, and describe some available digital tools to facilitate their use using examples from exp