Gesture recognition of everyday activities
Multimodal recognition system is becoming a more common interaction tools in the fields of ubiquitous and wearable computing. Recent technologies and development of multimodal in human computer interaction have encouraged the notion and analysis of multimodal in human daily life activities. This...
Saved in:
| Main Author: | |
|---|---|
| Format: | Thesis |
| Language: | English |
| Subjects: | |
| Online Access: | http://dspace.unimap.edu.my:80/xmlui/bitstream/123456789/40860/1/Page%201-24.pdf http://dspace.unimap.edu.my:80/xmlui/bitstream/123456789/40860/2/Full%20text.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| id |
my-unimap-40860 |
|---|---|
| record_format |
uketd_dc |
| spelling |
my-unimap-408602016-02-04T04:48:13Z Gesture recognition of everyday activities Ku Nurul Fazira, Ku Azir Multimodal recognition system is becoming a more common interaction tools in the fields of ubiquitous and wearable computing. Recent technologies and development of multimodal in human computer interaction have encouraged the notion and analysis of multimodal in human daily life activities. This thesis explores the concept of multimodal i.e. speech and gesture recognition in everyday life activities. It propose an approach to recognize goal of activity based on detecting and analyzing sequence of gesture, speech, object, actions and locations that are being manipulated by the users. In domains such as cooking, where there are involve many similar and repeated of objects and actions can be a valuable and interest area to study in determining the concept of multimodal in everyday activities. An experiment of gesture and speech in cooking activity were analysed in term of object manipulation and sequence of actions by using video analysis and RFID tagged objects. There were compared with multimodal in computerized interaction. This study has demonstrate multimodal also been used during cooking activity. Combination of speech and gesture results set sequence of actions which be used to determine the goal of activity through ontology multimodal. It also demonstrate a set of actions, objects and locations sequence guide to a new multimodalities in real life activities. University of Birmingham 2008-08 Thesis en http://dspace.unimap.edu.my:80/xmlui/handle/123456789/40860 http://dspace.unimap.edu.my:80/xmlui/bitstream/123456789/40860/3/license.txt 8a4605be74aa9ea9d79846c1fba20a33 http://dspace.unimap.edu.my:80/xmlui/bitstream/123456789/40860/1/Page%201-24.pdf f53ca60a2966a658937a846df45c6cdb http://dspace.unimap.edu.my:80/xmlui/bitstream/123456789/40860/2/Full%20text.pdf b162932d3fd0b7a9a0a21193329e1baf Gesture recognition Multimodal recognition system Interaction tools Human computer interaction Faculty of Electronic, Electrical and Computer Engineering |
| institution |
Universiti Malaysia Perlis |
| collection |
UniMAP Institutional Repository |
| language |
English |
| topic |
Gesture recognition Multimodal recognition system Interaction tools Human computer interaction |
| spellingShingle |
Gesture recognition Multimodal recognition system Interaction tools Human computer interaction Ku Nurul Fazira, Ku Azir Gesture recognition of everyday activities |
| description |
Multimodal recognition system is becoming a more common interaction tools
in the fields of ubiquitous and wearable computing. Recent technologies and
development of multimodal in human computer interaction have encouraged
the notion and analysis of multimodal in human daily life activities.
This thesis explores the concept of multimodal i.e. speech and gesture
recognition in everyday life activities. It propose an approach to recognize
goal of activity based on detecting and analyzing sequence of gesture,
speech, object, actions and locations that are being manipulated by the users.
In domains such as cooking, where there are involve many similar and
repeated of objects and actions can be a valuable and interest area to study
in determining the concept of multimodal in everyday activities. An experiment
of gesture and speech in cooking activity were analysed in term of object
manipulation and sequence of actions by using video analysis and RFID
tagged objects. There were compared with multimodal in computerized
interaction.
This study has demonstrate multimodal also been used during cooking
activity. Combination of speech and gesture results set sequence of actions
which be used to determine the goal of activity through ontology multimodal. It
also demonstrate a set of actions, objects and locations sequence guide to a
new multimodalities in real life activities. |
| format |
Thesis |
| author |
Ku Nurul Fazira, Ku Azir |
| author_facet |
Ku Nurul Fazira, Ku Azir |
| author_sort |
Ku Nurul Fazira, Ku Azir |
| title |
Gesture recognition of everyday activities |
| title_short |
Gesture recognition of everyday activities |
| title_full |
Gesture recognition of everyday activities |
| title_fullStr |
Gesture recognition of everyday activities |
| title_full_unstemmed |
Gesture recognition of everyday activities |
| title_sort |
gesture recognition of everyday activities |
| granting_institution |
University of Birmingham |
| granting_department |
Faculty of Electronic, Electrical and Computer Engineering |
| url |
http://dspace.unimap.edu.my:80/xmlui/bitstream/123456789/40860/1/Page%201-24.pdf http://dspace.unimap.edu.my:80/xmlui/bitstream/123456789/40860/2/Full%20text.pdf |
| _version_ |
1747836811280908288 |