Mask segmentation and classification with enhanced grasshopper optimization of 3D hand gestures

The difficulties associated with extracting 3D hand meshes from depth image utilizing 2D convolutional neural networks. The precision of such estimations is frequently hampered by visual distortions caused by nonrigidity, complex backdrops, and shadows. This research provides a unique methodology...

Full description

Saved in:

Bibliographic Details
Main Author:	Salam Khan, Fawad
Format:	Thesis
Language:	English English English
Published:	2023
Subjects:	T Technology (General)
Online Access:	http://eprints.uthm.edu.my/11036/1/24p%20FAWAD%20SALAM%20KHAN.pdf http://eprints.uthm.edu.my/11036/2/FAWAD%20SALAM%20KHAN%20COPYRIGHT%20DECLARATION.pdf http://eprints.uthm.edu.my/11036/3/FAWAD%20SALAM%20KHAN%20WATERMARK.pdf
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my-uthm-ep.11036
record_format	uketd_dc
spelling	my-uthm-ep.110362024-05-29T02:25:56Z Mask segmentation and classification with enhanced grasshopper optimization of 3D hand gestures 2023-04 Salam Khan, Fawad T Technology (General) The difficulties associated with extracting 3D hand meshes from depth image utilizing 2D convolutional neural networks. The precision of such estimations is frequently hampered by visual distortions caused by nonrigidity, complex backdrops, and shadows. This research provides a unique methodology that combines the enhanced grasshopper optimization method for feature optimization with MASK-RCNN and FCN for segmenting and classifying 3D hand gestures to address these problems. In order to evaluate the proposed method, a 3D gesture data set is generated. In addition, a skeleton model for RGB hand gestures is constructed by estimating the degree of freedom (DoF) using human kinematics. The segmentation of 3D hand gestures is computed using the ResNet50 backbone network, and the Overlap Coefficient (OC) is employed as an evaluation metric. On the other hand, the ResNet101 backbone network is used to calculate the classification of 3D hand gestures. Experimental results reveal that the proposed method achieves greater accuracy in segmenting and classifying 3D hand gestures than existing methods. The study also emphasizes the significance of using feature optimization approaches and developing skeletal models to estimate (DoF) in order to improve the precision of 3D hand gesture analysis. This study provides a promising approach for robust and precise 3D hand gesture recognition, with potential applications in disciplines such as human-computer interaction and virtual reality. The test results show best accuracy for 3D hand gesture classification and segmentation. On the private dataset, the classification accuracy is 99.05 %, whereas 99.29 % on the Kinect dataset, 99.39 % and 99.29% using SKIG and ChaLearn dataset during validation. The OC is 88.16 % and 88.19 %, respectively which is the highest available accuracy compared with other methods. The mAP of ChaLearn 93.26%, private 81.48%, SKIG 75.21% and Kinect 66.74% 2023-04 Thesis http://eprints.uthm.edu.my/11036/ http://eprints.uthm.edu.my/11036/1/24p%20FAWAD%20SALAM%20KHAN.pdf text en public http://eprints.uthm.edu.my/11036/2/FAWAD%20SALAM%20KHAN%20COPYRIGHT%20DECLARATION.pdf text en staffonly http://eprints.uthm.edu.my/11036/3/FAWAD%20SALAM%20KHAN%20WATERMARK.pdf text en validuser phd doctoral Universiti Tun Hussein Onn Malaysia Fakulti Kejuruteraan Elektrik dan Elektronik
institution	Universiti Tun Hussein Onn Malaysia
collection	UTHM Institutional Repository
language	English English English
topic	T Technology (General)
spellingShingle	T Technology (General) Salam Khan, Fawad Mask segmentation and classification with enhanced grasshopper optimization of 3D hand gestures
description	The difficulties associated with extracting 3D hand meshes from depth image utilizing 2D convolutional neural networks. The precision of such estimations is frequently hampered by visual distortions caused by nonrigidity, complex backdrops, and shadows. This research provides a unique methodology that combines the enhanced grasshopper optimization method for feature optimization with MASK-RCNN and FCN for segmenting and classifying 3D hand gestures to address these problems. In order to evaluate the proposed method, a 3D gesture data set is generated. In addition, a skeleton model for RGB hand gestures is constructed by estimating the degree of freedom (DoF) using human kinematics. The segmentation of 3D hand gestures is computed using the ResNet50 backbone network, and the Overlap Coefficient (OC) is employed as an evaluation metric. On the other hand, the ResNet101 backbone network is used to calculate the classification of 3D hand gestures. Experimental results reveal that the proposed method achieves greater accuracy in segmenting and classifying 3D hand gestures than existing methods. The study also emphasizes the significance of using feature optimization approaches and developing skeletal models to estimate (DoF) in order to improve the precision of 3D hand gesture analysis. This study provides a promising approach for robust and precise 3D hand gesture recognition, with potential applications in disciplines such as human-computer interaction and virtual reality. The test results show best accuracy for 3D hand gesture classification and segmentation. On the private dataset, the classification accuracy is 99.05 %, whereas 99.29 % on the Kinect dataset, 99.39 % and 99.29% using SKIG and ChaLearn dataset during validation. The OC is 88.16 % and 88.19 %, respectively which is the highest available accuracy compared with other methods. The mAP of ChaLearn 93.26%, private 81.48%, SKIG 75.21% and Kinect 66.74%
format	Thesis
qualification_name	Doctor of Philosophy (PhD.)
qualification_level	Doctorate
author	Salam Khan, Fawad
author_facet	Salam Khan, Fawad
author_sort	Salam Khan, Fawad
title	Mask segmentation and classification with enhanced grasshopper optimization of 3D hand gestures
title_short	Mask segmentation and classification with enhanced grasshopper optimization of 3D hand gestures
title_full	Mask segmentation and classification with enhanced grasshopper optimization of 3D hand gestures
title_fullStr	Mask segmentation and classification with enhanced grasshopper optimization of 3D hand gestures
title_full_unstemmed	Mask segmentation and classification with enhanced grasshopper optimization of 3D hand gestures
title_sort	mask segmentation and classification with enhanced grasshopper optimization of 3d hand gestures
granting_institution	Universiti Tun Hussein Onn Malaysia
granting_department	Fakulti Kejuruteraan Elektrik dan Elektronik
publishDate	2023
url	http://eprints.uthm.edu.my/11036/1/24p%20FAWAD%20SALAM%20KHAN.pdf http://eprints.uthm.edu.my/11036/2/FAWAD%20SALAM%20KHAN%20COPYRIGHT%20DECLARATION.pdf http://eprints.uthm.edu.my/11036/3/FAWAD%20SALAM%20KHAN%20WATERMARK.pdf
_version_	1804890139197964288

Mask segmentation and classification with enhanced grasshopper optimization of 3D hand gestures

Similar Items