Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation

The increasing amount of multimodal data such as text documents, annotated images and web pages have necessitated the development of effective techniques for their manipulation. The ineffectiveness of low-level image and textual features is one of the main issues as these features are commonly insuf...

Full description

Saved in:
Bibliographic Details
Main Author: Shareha, Ahmad Adel Ahmad Abu
Format: Thesis
Language:English
Published: 2012
Subjects:
Online Access:http://eprints.usm.my/41342/1/AHMAD_ADEL_AHMAD_ABU_SHAREHA.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
id my-usm-ep.41342
record_format uketd_dc
spelling my-usm-ep.413422018-08-16T06:48:39Z Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation 2012-03 Shareha, Ahmad Adel Ahmad Abu QA75.5-76.95 Electronic computers. Computer science The increasing amount of multimodal data such as text documents, annotated images and web pages have necessitated the development of effective techniques for their manipulation. The ineffectiveness of low-level image and textual features is one of the main issues as these features are commonly insufficient for effective data manipulation. Therefore, obtaining sufficient and significant information from the multimodal data, and then further using this information in the proper manner is penultimate in data manipulation tasks. This thesis proposes a multimodal semantics integration (MSI) process to extract and integrate the semantics from the image and text modalities, and to use these semantics for manipulation tasks. The proposed process firstly extracts a textual representation from the textual and image modalities, followed by mapping the representation to concepts in a condensed knowledge source using a semantic-based alignment sub-process. 2012-03 Thesis http://eprints.usm.my/41342/ http://eprints.usm.my/41342/1/AHMAD_ADEL_AHMAD_ABU_SHAREHA.pdf application/pdf en public phd doctoral Universiti Sains Malaysia Pusat Pengajian Sains Komputer
institution Universiti Sains Malaysia
collection USM Institutional Repository
language English
topic QA75.5-76.95 Electronic computers
Computer science
spellingShingle QA75.5-76.95 Electronic computers
Computer science
Shareha, Ahmad Adel Ahmad Abu
Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation
description The increasing amount of multimodal data such as text documents, annotated images and web pages have necessitated the development of effective techniques for their manipulation. The ineffectiveness of low-level image and textual features is one of the main issues as these features are commonly insufficient for effective data manipulation. Therefore, obtaining sufficient and significant information from the multimodal data, and then further using this information in the proper manner is penultimate in data manipulation tasks. This thesis proposes a multimodal semantics integration (MSI) process to extract and integrate the semantics from the image and text modalities, and to use these semantics for manipulation tasks. The proposed process firstly extracts a textual representation from the textual and image modalities, followed by mapping the representation to concepts in a condensed knowledge source using a semantic-based alignment sub-process.
format Thesis
qualification_name Doctor of Philosophy (PhD.)
qualification_level Doctorate
author Shareha, Ahmad Adel Ahmad Abu
author_facet Shareha, Ahmad Adel Ahmad Abu
author_sort Shareha, Ahmad Adel Ahmad Abu
title Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation
title_short Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation
title_full Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation
title_fullStr Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation
title_full_unstemmed Multimodal Semantics Integration Using Ontologies Enhanced By Ontology Extraction And Cross Modality Disambiguation
title_sort multimodal semantics integration using ontologies enhanced by ontology extraction and cross modality disambiguation
granting_institution Universiti Sains Malaysia
granting_department Pusat Pengajian Sains Komputer
publishDate 2012
url http://eprints.usm.my/41342/1/AHMAD_ADEL_AHMAD_ABU_SHAREHA.pdf
_version_ 1747820915502088192