ScannerVision: Scanner-based image acquisition of medically important arthropods for the development of computer vision and deep learning models

A - Papers appearing in refereed journals

Ong, S., Pinoy, N., Lim, M. H., Bjerge, K., Peris-Felipo, F. J., Lind, R., Cuff, J. P., Cook, S. M. and Hoye, T. T. 2025. ScannerVision: Scanner-based image acquisition of medically important arthropods for the development of computer vision and deep learning models. Current Research in Parasitology & Vector-Borne Diseases. 7, p. 100268. https://doi.org/10.1016/j.crpvbd.2025.100268

AuthorsOng, S., Pinoy, N., Lim, M. H., Bjerge, K., Peris-Felipo, F. J., Lind, R., Cuff, J. P., Cook, S. M. and Hoye, T. T.
Abstract

Computer vision methods offer great potential for rapid image-based identification of medically important arthropod specimens. However, imaging large numbers of specimens is time consuming, and it is difficult to achieve the high image quality required for machine learning models. Conventional imaging methods for identifying and digitizing arthropods, such as insects and spiders, use a stereomicroscope or macro lenses with a camera. This method is challenging due to the narrow field of view, especially when large numbers of arthropods need to be processed. In this paper, we present a high-throughput scanner-based method for capturing images of arthropods that can be used to generate large datasets suitable for training machine learning algorithms for identification. We demonstrate the ability of this approach to image arthropod samples collected with different sampling methods, such as sticky traps (unbaited, in different colors), baited mosquito traps as used by the US Centers for Disease Control and Prevention (CDC) and BioGents-Sentinel (BGS), and UV light traps with a sticky pad. Using different strategies to place the arthropods on a charge-coupled device (CCD) flatbed scanner and optimized settings that balance processing time and image quality, we captured high-resolution images of various arthropods and obtained morphological details with resolution and magnification similar to a stereomicroscope. We validate the method by comparing the performance of three different deep learning models (InceptionV3, ResNet and MobileNetV2) on two different datasets, namely the scanned images from this study and the images captured with a camera of a stereomicroscope. The results show that the performance of the models trained on the two datasets is not significantly different, indicating that the quality of the scanned images is comparable to that of a stereomicroscope.

KeywordsMachine learning; Entomology; Biodiversity; Digitization; Aedes; Anopheles; Culex
Year of Publication2025
JournalCurrent Research in Parasitology & Vector-Borne Diseases
Journal citation7, p. 100268
Digital Object Identifier (DOI)https://doi.org/10.1016/j.crpvbd.2025.100268
Web address (URL)https://www.sciencedirect.com/science/article/pii/S2667114X25000287?via%3Dihub#sec7
Open accessPublished as ‘gold’ (paid) open access
FunderEuropean Union
Funder project or codeEcostack
Publisher's version
Accepted author manuscript
Supplemental file
Output statusPublished
Publication dates
Online08 May 2025
Publication process dates
Accepted07 May 2025
PublisherElsevier
ISSN2667-114X

Permalink - https://repository.rothamsted.ac.uk/item/993q1/scannervision-scanner-based-image-acquisition-of-medically-important-arthropods-for-the-development-of-computer-vision-and-deep-learning-models

30 total views
4 total downloads
9 views this month
0 downloads this month
Download files as zip