Human detection for search and rescue operations using embedded artificial intelligence

Unmanned aerial vehicles (drones) have been increasingly used in search and rescue operations as a tool to detect humans in an area of disaster where the rescue team is unable to reach them. Human detection is the most important task in a rescue plan. Currently, deep learning and Internet of Things...

Full description

Saved in:
Bibliographic Details
Main Author: Al-Azzani, Ahmed Abdullah Hussein
Format: Thesis
Language:English
Published: 2021
Subjects:
Online Access:http://eprints.utm.my/id/eprint/99514/1/AhmedAbdullahHusseinMKE2021.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
id my-utm-ep.99514
record_format uketd_dc
spelling my-utm-ep.995142023-02-27T08:10:37Z Human detection for search and rescue operations using embedded artificial intelligence 2021 Al-Azzani, Ahmed Abdullah Hussein TK Electrical engineering. Electronics Nuclear engineering Unmanned aerial vehicles (drones) have been increasingly used in search and rescue operations as a tool to detect humans in an area of disaster where the rescue team is unable to reach them. Human detection is the most important task in a rescue plan. Currently, deep learning and Internet of Things (IoT) technologies are used to automatically detect humans from footage taken from drones, however, the hardware used in such methods consumes high power, requires high processing capability, long computational time, and a constant internet connection which are not effective to be deployed in all scenarios. This project aims to utilize transfer learning to build a human detection model with mean average precision (mAP@0.5) above 90% and compare deep learning models in aspects of the size of the model, computational requirement, and mAP. Furthermore, to compress the final model to be deployed to an edge device for the propose of using edge computing where the computation requirement for the deep learning model is all made on-chip. The development of this project is based on multi-datasets using the TensorFlow v2 framework and virtual machine Google Colaboratory. The dataset used in this project is extracted from two datasets named SARD and SeaDroneSee both are aerial images of humans, and the labeling of the dataset is made using the Roboflow platform. The models used are pre-trained single shot detector models namely MobileNet v2 and EfficientDet-D1, the last shows a better accuracy of 97.3% mAP@0.5 however MobileNet v2 consumes much less GPU for training at around 4.6 GB while maintaining relatively high accuracy of 95.5% mAP@0.5. Lastly, the trained MobileNet v2 model is quantized to 6.4 MB. At the end of this project, a deep learning model for human detection for search and rescue operations is compressed and ready to be deployed to an embedded artificial intelligence device. 2021 Thesis http://eprints.utm.my/id/eprint/99514/ http://eprints.utm.my/id/eprint/99514/1/AhmedAbdullahHusseinMKE2021.pdf application/pdf en public http://dms.library.utm.my:8080/vital/access/manager/Repository/vital:149964 masters Universiti Teknologi Malaysia Faculty of Engineering - School of Electrical Engineering
institution Universiti Teknologi Malaysia
collection UTM Institutional Repository
language English
topic TK Electrical engineering
Electronics Nuclear engineering
spellingShingle TK Electrical engineering
Electronics Nuclear engineering
Al-Azzani, Ahmed Abdullah Hussein
Human detection for search and rescue operations using embedded artificial intelligence
description Unmanned aerial vehicles (drones) have been increasingly used in search and rescue operations as a tool to detect humans in an area of disaster where the rescue team is unable to reach them. Human detection is the most important task in a rescue plan. Currently, deep learning and Internet of Things (IoT) technologies are used to automatically detect humans from footage taken from drones, however, the hardware used in such methods consumes high power, requires high processing capability, long computational time, and a constant internet connection which are not effective to be deployed in all scenarios. This project aims to utilize transfer learning to build a human detection model with mean average precision (mAP@0.5) above 90% and compare deep learning models in aspects of the size of the model, computational requirement, and mAP. Furthermore, to compress the final model to be deployed to an edge device for the propose of using edge computing where the computation requirement for the deep learning model is all made on-chip. The development of this project is based on multi-datasets using the TensorFlow v2 framework and virtual machine Google Colaboratory. The dataset used in this project is extracted from two datasets named SARD and SeaDroneSee both are aerial images of humans, and the labeling of the dataset is made using the Roboflow platform. The models used are pre-trained single shot detector models namely MobileNet v2 and EfficientDet-D1, the last shows a better accuracy of 97.3% mAP@0.5 however MobileNet v2 consumes much less GPU for training at around 4.6 GB while maintaining relatively high accuracy of 95.5% mAP@0.5. Lastly, the trained MobileNet v2 model is quantized to 6.4 MB. At the end of this project, a deep learning model for human detection for search and rescue operations is compressed and ready to be deployed to an embedded artificial intelligence device.
format Thesis
qualification_level Master's degree
author Al-Azzani, Ahmed Abdullah Hussein
author_facet Al-Azzani, Ahmed Abdullah Hussein
author_sort Al-Azzani, Ahmed Abdullah Hussein
title Human detection for search and rescue operations using embedded artificial intelligence
title_short Human detection for search and rescue operations using embedded artificial intelligence
title_full Human detection for search and rescue operations using embedded artificial intelligence
title_fullStr Human detection for search and rescue operations using embedded artificial intelligence
title_full_unstemmed Human detection for search and rescue operations using embedded artificial intelligence
title_sort human detection for search and rescue operations using embedded artificial intelligence
granting_institution Universiti Teknologi Malaysia
granting_department Faculty of Engineering - School of Electrical Engineering
publishDate 2021
url http://eprints.utm.my/id/eprint/99514/1/AhmedAbdullahHusseinMKE2021.pdf
_version_ 1776100609140719616