Study of hand gesture recognition using impulse radio ultra wideband (IRUWB) radar sensor

Hand gesture recognition technology has gained significant attention in recent years due to its potential to revolutionize human-computer interaction by offering a natural and intuitive means of communication. This work addresses the limitations of existing systems and focuses on developing a novel...

Full description

Saved in:
Bibliographic Details
Main Author: Terence Jerome Daim
Format: Thesis
Language:English
English
Published: 2023
Subjects:
Online Access:https://eprints.ums.edu.my/id/eprint/39094/1/24%20PAGES.pdf
https://eprints.ums.edu.my/id/eprint/39094/2/FULLTEXT.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
id my-ums-ep.39094
record_format uketd_dc
institution Universiti Malaysia Sabah
collection UMS Institutional Repository
language English
English
topic TK5101-6720 Telecommunication Including telegraphy
telephone
radio
radar
television
spellingShingle TK5101-6720 Telecommunication Including telegraphy
telephone
radio
radar
television
Terence Jerome Daim
Study of hand gesture recognition using impulse radio ultra wideband (IRUWB) radar sensor
description Hand gesture recognition technology has gained significant attention in recent years due to its potential to revolutionize human-computer interaction by offering a natural and intuitive means of communication. This work addresses the limitations of existing systems and focuses on developing a novel hand gesture recognition system that leverages Impulse Radio Ultra-Wide Band (IR-UWB) radar sensors. The primary objective of this work is to create a comprehensive hand gesture recognition system capable of accurately recognizing a wide range of hand gestures while distinguishing between them based on gesture speed. To achieve this, this work defines three key objectives. First objective is to determine the optimal setup for IR-UWB radar sensor data acquisition, considering factors such as sensor placement and configuration. Second objective is to develop and assess hand gesture recognition models using seven different classifiers to achieve accurate and reliable recognition of hand gestures. Third objective is to analyse the performance of the developed classifiers in comparison to existing research in the field, with a focus on recognizing both hand gestures and their associated speeds. The work begins by providing insights into the state of the art in hand gesture recognition and IR-UWB radar sensor technology. Data collection experiments yield a diverse dataset of hand gestures, including variations in speed, essential for algorithm development. The developed algorithms interpret raw IR-UWB radar sensor data and associate it with specific hand gestures, addressing the core objective of gesture recognition. Speed recognition integration further enhances the system's ability to distinguish between gestures performed at different speeds. The resulting hand gesture recognition system is rigorously evaluated and compared to existing methods, demonstrating its effectiveness. Documentation of the development process ensures the methodology and findings are well-documented for reference and replication. While this research makes significant contributions to the field of hand gesture recognition, it also identifies several areas for future work. These include exploring recognition of gestures performed by two hands simultaneously, scalability to different environments, optimal sensor placement, and addressing user variability. Seven classification algorithms (K-Nearest Neighbour, Logistic Regression, Naive Bayes, Gradient Boosting, AdaBoost, Bagging, and Linear Discriminant Analysis) were meticulously explored for hand gesture recognition. The evaluation, based on macro F1 scores to balance precision and recall, aimed to assess their effectiveness. Linear Discriminant Analysis proved most accurate, especially in fast hand gestures, emphasizing its significance in real-time applications. In contrast, AdaBoost exhibited weaker performance, indicating areas for improvement. A slight accuracy decrease for "Up-Down" and "Down-Up" gestures compared to existing literature. However, it significantly outperforms certain literature by 16.28% for "Left-Right" gestures at slow speeds, showcasing improved recognition and robustness. Additionally, the research enhances system functionality, enabling intricate interactions. A developed application allows users to visualize executed hand gestures, paving the way for future integration of complex interaction sub-systems in various gesture recognition applications. In summary, this work advances the field of hand gesture recognition by introducing a novel IR-UWB radar-based system that accurately recognizes hand gestures and distinguishes their speeds, offering improved performance and usability for a wide range of applications.
format Thesis
qualification_name Doctor of Philosophy (PhD.)
qualification_level Doctorate
author Terence Jerome Daim
author_facet Terence Jerome Daim
author_sort Terence Jerome Daim
title Study of hand gesture recognition using impulse radio ultra wideband (IRUWB) radar sensor
title_short Study of hand gesture recognition using impulse radio ultra wideband (IRUWB) radar sensor
title_full Study of hand gesture recognition using impulse radio ultra wideband (IRUWB) radar sensor
title_fullStr Study of hand gesture recognition using impulse radio ultra wideband (IRUWB) radar sensor
title_full_unstemmed Study of hand gesture recognition using impulse radio ultra wideband (IRUWB) radar sensor
title_sort study of hand gesture recognition using impulse radio ultra wideband (iruwb) radar sensor
granting_institution Universiti Malaysia Sabah
granting_department Faculty of Engineering
publishDate 2023
url https://eprints.ums.edu.my/id/eprint/39094/1/24%20PAGES.pdf
https://eprints.ums.edu.my/id/eprint/39094/2/FULLTEXT.pdf
_version_ 1804890371677749248
spelling my-ums-ep.390942024-07-15T02:22:10Z Study of hand gesture recognition using impulse radio ultra wideband (IRUWB) radar sensor 2023 Terence Jerome Daim TK5101-6720 Telecommunication Including telegraphy, telephone, radio, radar, television Hand gesture recognition technology has gained significant attention in recent years due to its potential to revolutionize human-computer interaction by offering a natural and intuitive means of communication. This work addresses the limitations of existing systems and focuses on developing a novel hand gesture recognition system that leverages Impulse Radio Ultra-Wide Band (IR-UWB) radar sensors. The primary objective of this work is to create a comprehensive hand gesture recognition system capable of accurately recognizing a wide range of hand gestures while distinguishing between them based on gesture speed. To achieve this, this work defines three key objectives. First objective is to determine the optimal setup for IR-UWB radar sensor data acquisition, considering factors such as sensor placement and configuration. Second objective is to develop and assess hand gesture recognition models using seven different classifiers to achieve accurate and reliable recognition of hand gestures. Third objective is to analyse the performance of the developed classifiers in comparison to existing research in the field, with a focus on recognizing both hand gestures and their associated speeds. The work begins by providing insights into the state of the art in hand gesture recognition and IR-UWB radar sensor technology. Data collection experiments yield a diverse dataset of hand gestures, including variations in speed, essential for algorithm development. The developed algorithms interpret raw IR-UWB radar sensor data and associate it with specific hand gestures, addressing the core objective of gesture recognition. Speed recognition integration further enhances the system's ability to distinguish between gestures performed at different speeds. The resulting hand gesture recognition system is rigorously evaluated and compared to existing methods, demonstrating its effectiveness. Documentation of the development process ensures the methodology and findings are well-documented for reference and replication. While this research makes significant contributions to the field of hand gesture recognition, it also identifies several areas for future work. These include exploring recognition of gestures performed by two hands simultaneously, scalability to different environments, optimal sensor placement, and addressing user variability. Seven classification algorithms (K-Nearest Neighbour, Logistic Regression, Naive Bayes, Gradient Boosting, AdaBoost, Bagging, and Linear Discriminant Analysis) were meticulously explored for hand gesture recognition. The evaluation, based on macro F1 scores to balance precision and recall, aimed to assess their effectiveness. Linear Discriminant Analysis proved most accurate, especially in fast hand gestures, emphasizing its significance in real-time applications. In contrast, AdaBoost exhibited weaker performance, indicating areas for improvement. A slight accuracy decrease for "Up-Down" and "Down-Up" gestures compared to existing literature. However, it significantly outperforms certain literature by 16.28% for "Left-Right" gestures at slow speeds, showcasing improved recognition and robustness. Additionally, the research enhances system functionality, enabling intricate interactions. A developed application allows users to visualize executed hand gestures, paving the way for future integration of complex interaction sub-systems in various gesture recognition applications. In summary, this work advances the field of hand gesture recognition by introducing a novel IR-UWB radar-based system that accurately recognizes hand gestures and distinguishes their speeds, offering improved performance and usability for a wide range of applications. 2023 Thesis https://eprints.ums.edu.my/id/eprint/39094/ https://eprints.ums.edu.my/id/eprint/39094/1/24%20PAGES.pdf text en public https://eprints.ums.edu.my/id/eprint/39094/2/FULLTEXT.pdf text en validuser dphil doctoral Universiti Malaysia Sabah Faculty of Engineering