Upper Limb Assessment in Virtual Reality

People who have suffered a stroke may face upper limb motor impairments. Many daily life’s tasks involve the use of the upper limbs. Therefore, rehabilitation is necessary to improve motor ability and recovery of stroke patients. However, stroke patient may become bored and unmotivated when doing th...

Full description

Saved in:

Bibliographic Details
Main Author:	Lew, Kai Liang
Format:	Thesis
Published:	2021
Subjects:	QA75.5-76.95 Electronic computers Computer science
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my-mmu-ep.11149
record_format	uketd_dc
spelling	my-mmu-ep.111492023-02-24T05:53:00Z Upper Limb Assessment in Virtual Reality 2021-02 Lew, Kai Liang QA75.5-76.95 Electronic computers. Computer science People who have suffered a stroke may face upper limb motor impairments. Many daily life’s tasks involve the use of the upper limbs. Therefore, rehabilitation is necessary to improve motor ability and recovery of stroke patients. However, stroke patient may become bored and unmotivated when doing the same rehabilitation tasks repeatedly for a long duration. Most rehabilitation exercises used devices such as Microsoft Kinect and leap sensor which were not equipped with immersive technology. The rehabilation can be more labour intensive and time consuming for the physiotherapist to monitor the patient during rehabilitation without the use of biosignal technology. Moreover, biosginals required a pre-processing method before a signal value can be obtained. The whole process could be time consuming. This study presents an evaluation of the performance based on a virtual reality (VR) upper limb assessment, feedback from forty human subjects and biosignal image classification by using deep learning. Therefore, an assessment was created from Unreal Engine 4 (UE4), the Virtual Reality (VR) Upper Limb Assessment. There were four VR games namely ‘Pick and Place’ (PNP) game, ‘Mirror Pick and Place’ (MPNP) game, ‘Hit the Ball’ (HTB) game, and ‘Wall Climbing’ (WC) game. Before performing the assessment, the precision and accuracy of the virtual reality devices need to be quantified. Pre-assessment was performed to show the upper limb length measurements and the position and rotation of the upper limb were estimated correctly. The upper limb assessment evaluates the performance of the user and gives feedback to the user. During the assessment, the users were attached with the biosignal devices namely, electroencephalogram (EEG), electromyographic (EMG), and electrocardiographic (ECG). The three raw biosignals were collectively represented as images and were used to train deep learning models (namely, convolutional neural network and long-short term memory). Based on the four games, the stroke group archived a better score in the MPNP game compared to the other games. A NASALoad Task Index shows that HTB game has the highest task load while MPNP game has the lowest task load. Feedback from users shows that the system was easy to use, full of fun and helpful. The classification performance of the deep neural network in classifying the biosignals is highly accurate and precise. 2021-02 Thesis http://shdl.mmu.edu.my/11149/ http://erep.mmu.edu.my/ masters Multimedia University Faculty of Engineering and Technology EREP ID: 9878
institution	Multimedia University
collection	MMU Institutional Repository
topic	QA75.5-76.95 Electronic computers Computer science
spellingShingle	QA75.5-76.95 Electronic computers Computer science Lew, Kai Liang Upper Limb Assessment in Virtual Reality
description	People who have suffered a stroke may face upper limb motor impairments. Many daily life’s tasks involve the use of the upper limbs. Therefore, rehabilitation is necessary to improve motor ability and recovery of stroke patients. However, stroke patient may become bored and unmotivated when doing the same rehabilitation tasks repeatedly for a long duration. Most rehabilitation exercises used devices such as Microsoft Kinect and leap sensor which were not equipped with immersive technology. The rehabilation can be more labour intensive and time consuming for the physiotherapist to monitor the patient during rehabilitation without the use of biosignal technology. Moreover, biosginals required a pre-processing method before a signal value can be obtained. The whole process could be time consuming. This study presents an evaluation of the performance based on a virtual reality (VR) upper limb assessment, feedback from forty human subjects and biosignal image classification by using deep learning. Therefore, an assessment was created from Unreal Engine 4 (UE4), the Virtual Reality (VR) Upper Limb Assessment. There were four VR games namely ‘Pick and Place’ (PNP) game, ‘Mirror Pick and Place’ (MPNP) game, ‘Hit the Ball’ (HTB) game, and ‘Wall Climbing’ (WC) game. Before performing the assessment, the precision and accuracy of the virtual reality devices need to be quantified. Pre-assessment was performed to show the upper limb length measurements and the position and rotation of the upper limb were estimated correctly. The upper limb assessment evaluates the performance of the user and gives feedback to the user. During the assessment, the users were attached with the biosignal devices namely, electroencephalogram (EEG), electromyographic (EMG), and electrocardiographic (ECG). The three raw biosignals were collectively represented as images and were used to train deep learning models (namely, convolutional neural network and long-short term memory). Based on the four games, the stroke group archived a better score in the MPNP game compared to the other games. A NASALoad Task Index shows that HTB game has the highest task load while MPNP game has the lowest task load. Feedback from users shows that the system was easy to use, full of fun and helpful. The classification performance of the deep neural network in classifying the biosignals is highly accurate and precise.
format	Thesis
qualification_level	Master's degree
author	Lew, Kai Liang
author_facet	Lew, Kai Liang
author_sort	Lew, Kai Liang
title	Upper Limb Assessment in Virtual Reality
title_short	Upper Limb Assessment in Virtual Reality
title_full	Upper Limb Assessment in Virtual Reality
title_fullStr	Upper Limb Assessment in Virtual Reality
title_full_unstemmed	Upper Limb Assessment in Virtual Reality
title_sort	upper limb assessment in virtual reality
granting_institution	Multimedia University
granting_department	Faculty of Engineering and Technology
publishDate	2021
_version_	1776101398365077504

Upper Limb Assessment in Virtual Reality

Similar Items