Development of real-time multi pose face recognition and tracking system
The birth of telepresence robots in healthcare industries has made a significant transformation in the last few decades. Telepresence robot is remotely connected and embodied to perform several task such as patient monitoring, diagnosis, surgery and other task. Due to poor infrastructure especial...
Saved in:
Main Author: | |
---|---|
Format: | Thesis |
Language: | English |
Published: |
2016
|
Subjects: | |
Online Access: | https://eprints.ums.edu.my/id/eprint/12859/1/Development%20of%20real-time%20multi%20pose.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my-ums-ep.12859 |
---|---|
record_format |
uketd_dc |
spelling |
my-ums-ep.128592017-10-27T08:11:44Z Development of real-time multi pose face recognition and tracking system 2016 Manimehala Nadarajan TA Engineering (General). Civil engineering (General) The birth of telepresence robots in healthcare industries has made a significant transformation in the last few decades. Telepresence robot is remotely connected and embodied to perform several task such as patient monitoring, diagnosis, surgery and other task. Due to poor infrastructure especially in the interior of developing countries, a Medical Telediagnosis Robot (MTR) which works with a low bandwidth and on a low cost platform was developed. Unlike other tele-presence robots, MTR is capable of performing remote diagnosis during medical emergencies as it is equipped with basic medical instruments and dual vision system which comprises of a visual diagnostic system and a visual communication system. Visual communication system in MTR provides a basic face-to-face communication. The application of biometric system using face can greatly improve the current visual communication system as it is currently limited for only manual face recognition and tracking. It is difficult for the remote medical specialist to keep the patient and medical staff in an ideal field of view (FOV). It is also necessary for the remote medical specialist to identify the correct patient and medical staffs for diagnosis and verbal communication. To circumvent this problem, a real time face detection, recognition and tracking system (DRiT) is developed. To achieve a real time system, the DRiT system is designed with four modules which are operated in sequence and thus minimizing the execution time. Other challenges that were circumvented by the DRiT system are multi face pose, varying background condition during camera movement and changes in environment lighting with respect to time. DRiT is fully designed in LabVIEW platform which integrates software, hardware and GUI modules to complement with the current MTR platform. The background, lighting conditions and face pose were solved using hybrid approach utilizing skin color information to detect face. Neural Network was deployed to identify the profile of a person in multi poses and distances. A hardware together with software based face tracking is designed to ensure that the face region is still within the tracking view. Tracking a person continuously in a wider angle is a challenging task but this has been successfully achieved with DRiT system using a pan and tilt unit. DRiT is a standalone platform which is activated once the robot is navigated to the desired area. DRiT system creates a better visual communication between remote specialist and hospital members as the remote medical specialist will no longer require to execute manual control of the robot. The developed DRiT system was experimentally teste in real time and it yields an accuracy of 98% with an execution time of 56 ms. 2016 Thesis https://eprints.ums.edu.my/id/eprint/12859/ https://eprints.ums.edu.my/id/eprint/12859/1/Development%20of%20real-time%20multi%20pose.pdf text en public other masters Universiti Malaysia Sabah Faculty of Engineering |
institution |
Universiti Malaysia Sabah |
collection |
UMS Institutional Repository |
language |
English |
topic |
TA Engineering (General) Civil engineering (General) |
spellingShingle |
TA Engineering (General) Civil engineering (General) Manimehala Nadarajan Development of real-time multi pose face recognition and tracking system |
description |
The birth of telepresence robots in healthcare industries has made a significant
transformation in the last few decades. Telepresence robot is remotely connected
and embodied to perform several task such as patient monitoring, diagnosis, surgery
and other task. Due to poor infrastructure especially in the interior of developing
countries, a Medical Telediagnosis Robot (MTR) which works with a low bandwidth
and on a low cost platform was developed. Unlike other tele-presence robots, MTR
is capable of performing remote diagnosis during medical emergencies as it is
equipped with basic medical instruments and dual vision system which comprises of
a visual diagnostic system and a visual communication system. Visual
communication system in MTR provides a basic face-to-face communication. The
application of biometric system using face can greatly improve the current visual
communication system as it is currently limited for only manual face recognition and
tracking. It is difficult for the remote medical specialist to keep the patient and
medical staff in an ideal field of view (FOV). It is also necessary for the remote
medical specialist to identify the correct patient and medical staffs for diagnosis and
verbal communication. To circumvent this problem, a real time face detection,
recognition and tracking system (DRiT) is developed. To achieve a real time system,
the DRiT system is designed with four modules which are operated in sequence and
thus minimizing the execution time. Other challenges that were circumvented by the
DRiT system are multi face pose, varying background condition during camera
movement and changes in environment lighting with respect to time. DRiT is fully
designed in LabVIEW platform which integrates software, hardware and GUI
modules to complement with the current MTR platform. The background, lighting
conditions and face pose were solved using hybrid approach utilizing skin color
information to detect face. Neural Network was deployed to identify the profile of a
person in multi poses and distances. A hardware together with software based face
tracking is designed to ensure that the face region is still within the tracking view.
Tracking a person continuously in a wider angle is a challenging task but this has
been successfully achieved with DRiT system using a pan and tilt unit. DRiT is a
standalone platform which is activated once the robot is navigated to the desired
area. DRiT system creates a better visual communication between remote specialist
and hospital members as the remote medical specialist will no longer require to
execute manual control of the robot. The developed DRiT system was experimentally
teste in real time and it yields an accuracy of 98% with an execution time of 56
ms. |
format |
Thesis |
qualification_name |
other |
qualification_level |
Master's degree |
author |
Manimehala Nadarajan |
author_facet |
Manimehala Nadarajan |
author_sort |
Manimehala Nadarajan |
title |
Development of real-time multi pose
face recognition and tracking
system |
title_short |
Development of real-time multi pose
face recognition and tracking
system |
title_full |
Development of real-time multi pose
face recognition and tracking
system |
title_fullStr |
Development of real-time multi pose
face recognition and tracking
system |
title_full_unstemmed |
Development of real-time multi pose
face recognition and tracking
system |
title_sort |
development of real-time multi pose
face recognition and tracking
system |
granting_institution |
Universiti Malaysia Sabah |
granting_department |
Faculty of Engineering |
publishDate |
2016 |
url |
https://eprints.ums.edu.my/id/eprint/12859/1/Development%20of%20real-time%20multi%20pose.pdf |
_version_ |
1747836442281771008 |