Integrating Context Knowledge With Concepts Ontology For Handling Lexical Semantic Ambiguity Of Natural Language Interface In Question Answering (QA) System
Question Answering(QA) Systems allow the user to ask questions in a natural language and obtain an exact answers. In general, the QA system is composed of four modules, they are namely: question processing, documents processing, passages processing, and answer processing. Question processing modu...
Saved in:
| Main Author: | |
|---|---|
| Format: | Thesis |
| Language: | en_US |
| Subjects: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| id |
my-usim-ddms-13146 |
|---|---|
| record_format |
uketd_dc |
| spelling |
my-usim-ddms-131462024-05-29T05:42:07Z Integrating Context Knowledge With Concepts Ontology For Handling Lexical Semantic Ambiguity Of Natural Language Interface In Question Answering (QA) System Omar Mohammad Hilal Alharbi Question Answering(QA) Systems allow the user to ask questions in a natural language and obtain an exact answers. In general, the QA system is composed of four modules, they are namely: question processing, documents processing, passages processing, and answer processing. Question processing module is considered the most fundamental component in the natural language interface of the QA system, and its quality impacts the performance of the overall QA system. This module receives natural language questions (NLQs). The most difficult problem in developing a QA system is so hard to find an exact answer to the NLQ. One of the most challenging problems in returning answers is how to resolve lexical semantic ambiguity in the NLQs. Lexical semantic ambiguity may occurs when a user's NLQ contains words that have more than one meaning. As a result, QA system performance can be negatively affected by these ambiguous words. In this research, we aim to resolve this problem by introducing CKCO (Context Knowledge & Concepts Ontology) approach. This approach integrates context knowledge and concepts ontology of the proposed domain, into a shallow natural language processing (SNLP) technique. Concepts ontology represents real world facts that describe the proposed domain, while context knowledge contains a set of words with their senses obtained from WordNet Domain and a group of words within the proposed domain serve as context labels, and it is determined based on neighborhood words in the NLQ. SNLP technique includes shallow syntactic analysis based on chunking method, and shallow semantic analysis using semantic role labeling method. Experimental results show that CKCO approach has 78.2% accuracy on a test set of 150 NLQs. We applied CKCO approach to a QA prototype in a university domain for new students to examine the impact of our approach in retrieving correct answers. The QA prototype was evaluated based on two aspects: prototype performance and acceptance of users. Experimental results show that the CKCO approach together with other components of our QA system yield a result which is 77.3% for accuracy which is 4.7% above the accuracy yielded by the same prototype without disambiguation. Acceptance aspect was evaluated based on its user's perspective, to determine the perceived ease of use (PEU), perceived satisfaction (PS), and perceived usefulness (PU) of the QA system that we developed. The results from the respondents reflect that our QA prototype was acceptable. Universiti Sains Islam Malaysia 2013-07 Thesis en_US https://oarep.usim.edu.my/handle/123456789/13146 https://oarep.usim.edu.my/bitstreams/766d06b2-3728-4f29-9573-3263f8445089/download 8a4605be74aa9ea9d79846c1fba20a33 Question-answering systems Semantics Computational linguistics |
| institution |
Universiti Sains Islam Malaysia |
| collection |
USIM Institutional Repository |
| language |
en_US |
| topic |
Question-answering systems Semantics Computational linguistics |
| spellingShingle |
Question-answering systems Semantics Computational linguistics Omar Mohammad Hilal Alharbi Integrating Context Knowledge With Concepts Ontology For Handling Lexical Semantic Ambiguity Of Natural Language Interface In Question Answering (QA) System |
| description |
Question Answering(QA) Systems allow the user to ask questions in a natural
language and obtain an exact answers. In general, the QA system is composed of four
modules, they are namely: question processing, documents processing, passages
processing, and answer processing. Question processing module is considered the
most fundamental component in the natural language interface of the QA system, and
its quality impacts the performance of the overall QA system. This module receives
natural language questions (NLQs). The most difficult problem in developing a QA
system is so hard to find an exact answer to the NLQ. One of the most challenging
problems in returning answers is how to resolve lexical semantic ambiguity in the
NLQs. Lexical semantic ambiguity may occurs when a user's NLQ contains words
that have more than one meaning. As a result, QA system performance can be
negatively affected by these ambiguous words. In this research, we aim to resolve
this problem by introducing CKCO (Context Knowledge & Concepts Ontology)
approach. This approach integrates context knowledge and concepts ontology of the
proposed domain, into a shallow natural language processing (SNLP) technique.
Concepts ontology represents real world facts that describe the proposed domain,
while context knowledge contains a set of words with their senses obtained from
WordNet Domain and a group of words within the proposed domain serve as context
labels, and it is determined based on neighborhood words in the NLQ. SNLP
technique includes shallow syntactic analysis based on chunking method, and shallow
semantic analysis using semantic role labeling method. Experimental results show
that CKCO approach has 78.2% accuracy on a test set of 150 NLQs. We applied
CKCO approach to a QA prototype in a university domain for new students to
examine the impact of our approach in retrieving correct answers. The QA prototype
was evaluated based on two aspects: prototype performance and acceptance of users.
Experimental results show that the CKCO approach together with other components
of our QA system yield a result which is 77.3% for accuracy which is 4.7% above the
accuracy yielded by the same prototype without disambiguation. Acceptance aspect
was evaluated based on its user's perspective, to determine the perceived ease of use
(PEU), perceived satisfaction (PS), and perceived usefulness (PU) of the QA system
that we developed. The results from the respondents reflect that our QA prototype was
acceptable. |
| format |
Thesis |
| author |
Omar Mohammad Hilal Alharbi |
| author_facet |
Omar Mohammad Hilal Alharbi |
| author_sort |
Omar Mohammad Hilal Alharbi |
| title |
Integrating Context Knowledge With Concepts Ontology For Handling Lexical Semantic Ambiguity Of Natural Language Interface In Question Answering (QA) System |
| title_short |
Integrating Context Knowledge With Concepts Ontology For Handling Lexical Semantic Ambiguity Of Natural Language Interface In Question Answering (QA) System |
| title_full |
Integrating Context Knowledge With Concepts Ontology For Handling Lexical Semantic Ambiguity Of Natural Language Interface In Question Answering (QA) System |
| title_fullStr |
Integrating Context Knowledge With Concepts Ontology For Handling Lexical Semantic Ambiguity Of Natural Language Interface In Question Answering (QA) System |
| title_full_unstemmed |
Integrating Context Knowledge With Concepts Ontology For Handling Lexical Semantic Ambiguity Of Natural Language Interface In Question Answering (QA) System |
| title_sort |
integrating context knowledge with concepts ontology for handling lexical semantic ambiguity of natural language interface in question answering (qa) system |
| granting_institution |
Universiti Sains Islam Malaysia |
| _version_ |
1812444671024037888 |