Development of real-time multi pose face recognition and tracking system

The birth of telepresence robots in healthcare industries has made a significant transformation in the last few decades. Telepresence robot is remotely connected and embodied to perform several task such as patient monitoring, diagnosis, surgery and other task. Due to poor infrastructure especial...

Full description

Saved in:
Bibliographic Details
Main Author: Manimehala Nadarajan
Format: Thesis
Language:English
Published: 2016
Subjects:
Online Access:https://eprints.ums.edu.my/id/eprint/12859/1/Development%20of%20real-time%20multi%20pose.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
id my-ums-ep.12859
record_format uketd_dc
spelling my-ums-ep.128592017-10-27T08:11:44Z Development of real-time multi pose face recognition and tracking system 2016 Manimehala Nadarajan TA Engineering (General). Civil engineering (General) The birth of telepresence robots in healthcare industries has made a significant transformation in the last few decades. Telepresence robot is remotely connected and embodied to perform several task such as patient monitoring, diagnosis, surgery and other task. Due to poor infrastructure especially in the interior of developing countries, a Medical Telediagnosis Robot (MTR) which works with a low bandwidth and on a low cost platform was developed. Unlike other tele-presence robots, MTR is capable of performing remote diagnosis during medical emergencies as it is equipped with basic medical instruments and dual vision system which comprises of a visual diagnostic system and a visual communication system. Visual communication system in MTR provides a basic face-to-face communication. The application of biometric system using face can greatly improve the current visual communication system as it is currently limited for only manual face recognition and tracking. It is difficult for the remote medical specialist to keep the patient and medical staff in an ideal field of view (FOV). It is also necessary for the remote medical specialist to identify the correct patient and medical staffs for diagnosis and verbal communication. To circumvent this problem, a real time face detection, recognition and tracking system (DRiT) is developed. To achieve a real time system, the DRiT system is designed with four modules which are operated in sequence and thus minimizing the execution time. Other challenges that were circumvented by the DRiT system are multi face pose, varying background condition during camera movement and changes in environment lighting with respect to time. DRiT is fully designed in LabVIEW platform which integrates software, hardware and GUI modules to complement with the current MTR platform. The background, lighting conditions and face pose were solved using hybrid approach utilizing skin color information to detect face. Neural Network was deployed to identify the profile of a person in multi poses and distances. A hardware together with software based face tracking is designed to ensure that the face region is still within the tracking view. Tracking a person continuously in a wider angle is a challenging task but this has been successfully achieved with DRiT system using a pan and tilt unit. DRiT is a standalone platform which is activated once the robot is navigated to the desired area. DRiT system creates a better visual communication between remote specialist and hospital members as the remote medical specialist will no longer require to execute manual control of the robot. The developed DRiT system was experimentally teste in real time and it yields an accuracy of 98% with an execution time of 56 ms. 2016 Thesis https://eprints.ums.edu.my/id/eprint/12859/ https://eprints.ums.edu.my/id/eprint/12859/1/Development%20of%20real-time%20multi%20pose.pdf text en public other masters Universiti Malaysia Sabah Faculty of Engineering
institution Universiti Malaysia Sabah
collection UMS Institutional Repository
language English
topic TA Engineering (General)
Civil engineering (General)
spellingShingle TA Engineering (General)
Civil engineering (General)
Manimehala Nadarajan
Development of real-time multi pose face recognition and tracking system
description The birth of telepresence robots in healthcare industries has made a significant transformation in the last few decades. Telepresence robot is remotely connected and embodied to perform several task such as patient monitoring, diagnosis, surgery and other task. Due to poor infrastructure especially in the interior of developing countries, a Medical Telediagnosis Robot (MTR) which works with a low bandwidth and on a low cost platform was developed. Unlike other tele-presence robots, MTR is capable of performing remote diagnosis during medical emergencies as it is equipped with basic medical instruments and dual vision system which comprises of a visual diagnostic system and a visual communication system. Visual communication system in MTR provides a basic face-to-face communication. The application of biometric system using face can greatly improve the current visual communication system as it is currently limited for only manual face recognition and tracking. It is difficult for the remote medical specialist to keep the patient and medical staff in an ideal field of view (FOV). It is also necessary for the remote medical specialist to identify the correct patient and medical staffs for diagnosis and verbal communication. To circumvent this problem, a real time face detection, recognition and tracking system (DRiT) is developed. To achieve a real time system, the DRiT system is designed with four modules which are operated in sequence and thus minimizing the execution time. Other challenges that were circumvented by the DRiT system are multi face pose, varying background condition during camera movement and changes in environment lighting with respect to time. DRiT is fully designed in LabVIEW platform which integrates software, hardware and GUI modules to complement with the current MTR platform. The background, lighting conditions and face pose were solved using hybrid approach utilizing skin color information to detect face. Neural Network was deployed to identify the profile of a person in multi poses and distances. A hardware together with software based face tracking is designed to ensure that the face region is still within the tracking view. Tracking a person continuously in a wider angle is a challenging task but this has been successfully achieved with DRiT system using a pan and tilt unit. DRiT is a standalone platform which is activated once the robot is navigated to the desired area. DRiT system creates a better visual communication between remote specialist and hospital members as the remote medical specialist will no longer require to execute manual control of the robot. The developed DRiT system was experimentally teste in real time and it yields an accuracy of 98% with an execution time of 56 ms.
format Thesis
qualification_name other
qualification_level Master's degree
author Manimehala Nadarajan
author_facet Manimehala Nadarajan
author_sort Manimehala Nadarajan
title Development of real-time multi pose face recognition and tracking system
title_short Development of real-time multi pose face recognition and tracking system
title_full Development of real-time multi pose face recognition and tracking system
title_fullStr Development of real-time multi pose face recognition and tracking system
title_full_unstemmed Development of real-time multi pose face recognition and tracking system
title_sort development of real-time multi pose face recognition and tracking system
granting_institution Universiti Malaysia Sabah
granting_department Faculty of Engineering
publishDate 2016
url https://eprints.ums.edu.my/id/eprint/12859/1/Development%20of%20real-time%20multi%20pose.pdf
_version_ 1747836442281771008