Automated underwater vision system for detection and classification of marine life using CNN YOLO-based model / Mohamed Syazwan Asyraf Rosli

The exploration of underwater ecosystems requires thorough observation and investigation for different marine habitats leads to the usage of an underwater vision system. This method is superior as a non-destructive approach for video monitoring technique that takes advantage from the advancement of...

Full description

Saved in:
Bibliographic Details
Main Author: Rosli, Mohamed Syazwan Asyraf
Format: Thesis
Language:English
Published: 2022
Subjects:
Online Access:https://ir.uitm.edu.my/id/eprint/75907/1/75907.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
id my-uitm-ir.75907
record_format uketd_dc
spelling my-uitm-ir.759072023-05-09T07:15:49Z Automated underwater vision system for detection and classification of marine life using CNN YOLO-based model / Mohamed Syazwan Asyraf Rosli 2022 Rosli, Mohamed Syazwan Asyraf Optical data processing Electronics The exploration of underwater ecosystems requires thorough observation and investigation for different marine habitats leads to the usage of an underwater vision system. This method is superior as a non-destructive approach for video monitoring technique that takes advantage from the advancement of camera vision technology. However, manual processing of real-time or recorded video is a time-consuming, laborious, and highly possible for fatigue errors during analysis. This is due to the water murkiness and low-light projection that yield low visibility, hence limits the ability to precisely explore the underwater environments. Driven by these challenges, there is a need for an automated real-time method that can replace the manual analyzing process and be able to work under constraints environments. Recently, the integration of computer vision and machine learning has given solutions to improve the underwater detection system by using intelligent classifier algorithm in real-time computer vision to detect underwater animals with challenging environments. Therefore, this study is proposed to develop an automated underwater object detection model based on Deep Convolutional Neural Network (DCNN) by using You Only Look Once (YOLO). In this research, several single-stage detectors of YOLO models namely as YOLOv3, YOLOv4, YOLOv5 including their subset models were evaluated for benchmarking and comparison purpose. All models were trained and tested using three open-source datasets for assessing the models’ performances based on quantitative metrices and image processing speed. Hence, the proposed YOLO model is further improved based on the model optimization using a challenging The Brackish Dataset. The Adaptive Moment Estimation (Adam) optimizer and Learning Rate on Plateau are employed to optimize the model's training regime. Significantly, the comparison results show that YOLOv5s outperformed others in terms of mean average precision (mAP) up to 97.7% and inference speed of up to 125 Frame Per Second (FPS). Meanwhile, the Adam optimizer with a detailed learning rate and momentum fine-tuning provides sufficient convergence rate and assisting YOLOv5s achieve better performance of mAP which is 0.6% higher than SGD implementation and 13.72% better than original author for The Brackish Dataset implementation. As a conclusion, the proposed YOLO model is successfully improved with high precision performance for detecting underwater object in a challenging underwater environment. Thus, the model also provides sufficient image processing and speed capability at real-time which will help marine biologists in elevating underwater research for analyzing underwater video with minimal human intervention. 2022 Thesis https://ir.uitm.edu.my/id/eprint/75907/ https://ir.uitm.edu.my/id/eprint/75907/1/75907.pdf text en public masters Universiti Teknologi MARA (UiTM) Faculty of Electrical Engineering Isa, Iza Sazanita
institution Universiti Teknologi MARA
collection UiTM Institutional Repository
language English
advisor Isa, Iza Sazanita
topic Optical data processing
Electronics
spellingShingle Optical data processing
Electronics
Rosli, Mohamed Syazwan Asyraf
Automated underwater vision system for detection and classification of marine life using CNN YOLO-based model / Mohamed Syazwan Asyraf Rosli
description The exploration of underwater ecosystems requires thorough observation and investigation for different marine habitats leads to the usage of an underwater vision system. This method is superior as a non-destructive approach for video monitoring technique that takes advantage from the advancement of camera vision technology. However, manual processing of real-time or recorded video is a time-consuming, laborious, and highly possible for fatigue errors during analysis. This is due to the water murkiness and low-light projection that yield low visibility, hence limits the ability to precisely explore the underwater environments. Driven by these challenges, there is a need for an automated real-time method that can replace the manual analyzing process and be able to work under constraints environments. Recently, the integration of computer vision and machine learning has given solutions to improve the underwater detection system by using intelligent classifier algorithm in real-time computer vision to detect underwater animals with challenging environments. Therefore, this study is proposed to develop an automated underwater object detection model based on Deep Convolutional Neural Network (DCNN) by using You Only Look Once (YOLO). In this research, several single-stage detectors of YOLO models namely as YOLOv3, YOLOv4, YOLOv5 including their subset models were evaluated for benchmarking and comparison purpose. All models were trained and tested using three open-source datasets for assessing the models’ performances based on quantitative metrices and image processing speed. Hence, the proposed YOLO model is further improved based on the model optimization using a challenging The Brackish Dataset. The Adaptive Moment Estimation (Adam) optimizer and Learning Rate on Plateau are employed to optimize the model's training regime. Significantly, the comparison results show that YOLOv5s outperformed others in terms of mean average precision (mAP) up to 97.7% and inference speed of up to 125 Frame Per Second (FPS). Meanwhile, the Adam optimizer with a detailed learning rate and momentum fine-tuning provides sufficient convergence rate and assisting YOLOv5s achieve better performance of mAP which is 0.6% higher than SGD implementation and 13.72% better than original author for The Brackish Dataset implementation. As a conclusion, the proposed YOLO model is successfully improved with high precision performance for detecting underwater object in a challenging underwater environment. Thus, the model also provides sufficient image processing and speed capability at real-time which will help marine biologists in elevating underwater research for analyzing underwater video with minimal human intervention.
format Thesis
qualification_level Master's degree
author Rosli, Mohamed Syazwan Asyraf
author_facet Rosli, Mohamed Syazwan Asyraf
author_sort Rosli, Mohamed Syazwan Asyraf
title Automated underwater vision system for detection and classification of marine life using CNN YOLO-based model / Mohamed Syazwan Asyraf Rosli
title_short Automated underwater vision system for detection and classification of marine life using CNN YOLO-based model / Mohamed Syazwan Asyraf Rosli
title_full Automated underwater vision system for detection and classification of marine life using CNN YOLO-based model / Mohamed Syazwan Asyraf Rosli
title_fullStr Automated underwater vision system for detection and classification of marine life using CNN YOLO-based model / Mohamed Syazwan Asyraf Rosli
title_full_unstemmed Automated underwater vision system for detection and classification of marine life using CNN YOLO-based model / Mohamed Syazwan Asyraf Rosli
title_sort automated underwater vision system for detection and classification of marine life using cnn yolo-based model / mohamed syazwan asyraf rosli
granting_institution Universiti Teknologi MARA (UiTM)
granting_department Faculty of Electrical Engineering
publishDate 2022
url https://ir.uitm.edu.my/id/eprint/75907/1/75907.pdf
_version_ 1783736090307330048