Computational cardio-physiological model of emotion using phonocardiography /

Several studies on physiological-based human emotion have suggested that emotion causes variations in various physiological parameters. As one of the physiological parameters, heart sound signals (also referred to as phonocardiography) may infer emotions and can possibly be used for emotion recognit...

Full description

Saved in:
Bibliographic Details
Main Author: Suryady, Zeldi (Author)
Format: Thesis Book
Language:English
Published: Kuala Lumpur Kulliyyah of Inforrmation and Communication Technology, International Islamic University Malaysia, 2022
Subjects:
Online Access:http://studentrepo.iium.edu.my/handle/123456789/11490
Tags: Add Tag
No Tags, Be the first to tag this record!
LEADER 05141nam a2200385 4500
008 230720s2022 my a f m 000 0 eng d
040 |a UIAM   |b eng   |e rda  
041 |a eng  
043 |a a-my--- 
100 1 |9 574968  |a Suryady, Zeldi  |e author 
245 |a Computational cardio-physiological model of emotion using phonocardiography /  |c by Zeldi Suryady 
264 1 |a Kuala Lumpur  |b Kulliyyah of Inforrmation and Communication Technology, International Islamic University Malaysia,  |c 2022 
300 |a xviii, 179 leaves :  |b illustrations ;   |c 30cm. 
336 |a text   |2 rdacontent 
337 |a unmediated   |2 rdamedia 
337 |a computer   |2 rdamedia 
338 |a volume   |2 rdacarrier 
338 |a online resource   |2 rdacarrier 
347 |a text file   |b PDF   |2 rdaft 
500 |a Abstracts in English and Arabic.  
500 |a "A thesis submitted in fulfilment of the requirement for the degree of Doctor of Philosophy in Computer Science." --On title page.  
502 |a Thesis (Ph.D)--International Islamic University Malaysia, 2022.  
504 |a Includes bibliographical references (leaves 154-177).  
520 |a Several studies on physiological-based human emotion have suggested that emotion causes variations in various physiological parameters. As one of the physiological parameters, heart sound signals (also referred to as phonocardiography) may infer emotions and can possibly be used for emotion recognition. For this purpose, the use of Phonocardiography (PCG) signal is substantially cheaper, and the process of acquiring the signal for heart sound analysis is comfortable as compared to other physiological measures. Capturing heart-sound signals using PCG does not require touching the surface of the human body directly. Hence it offers a convenient and practical usage in various applications of emotion recognition. Additionally, unlike the use of electrocardiography (ECG) that reflects only heartbeats through the electrically conductive system of the heart, the PCG can also reflect the muscle contraction sound of the heart. Nevertheless, the use of PCG in the emotion recognition domain is still scarce in the research literature. As such, this thesis explored usability and methods for modelling emotion recognition using PCG signals. The thesis is developed with four major phases. (i) Since PCG data for emotion recognition are not widely available, the first phase performs the creation of the corpus for both PCG and EEG, hence, the performance for both modalities can be compared. (ii) The second phase investigates the most suitable method for building a computational model for PCG-based emotion recognition. Three cepstral-based features, namely, MFCC, LFCC, and GFCC, are considered in the experiment. The DNN, XGBoost, and Decision tree are selected as the classifiers. The initial experiments of this research indicate that the best model for recognizing emotion is achieved at 87% accuracy rate by using combination of MFCC feature extraction and DNN classifier, (iii) The third phase compares PCG-based emotion recognition using heart sound signal (PCG) with EEG modality. The experimental results implied that with techniques used in phase two, the PCG signal could achieve comparatively robust performance in recognizing emotion as compared to the EEG modality. (iv) In the fourth phase, a new computational approach is proposed and implemented by incorporating signal decomposition techniques such as Empirical Mode Decomposition (EMD). As the main issue with this approach is feature dimensionality, the PCA feature reduction technique is adopted in the proposed method. The proposed method demonstrated a robust and optimal performance of a PCG-based emotion recognition model, achieving overall accuracy rate at 98%. Overall, this research has highlighted the potential use of PCG signals for emotion recognition as an alternative to other commonly discussed modalities such as EEG. Additionally, the thesis also empirically proved that with proper methods in pre-processing the signal and the right feature extraction process and the suitable classifier, the PCG signal could achieve optimal performance in recognizing emotion. As future works, the proposed approach can be used to build a wide range of practical application of emotion recognition such as Ambient Assisted Living (AAL), whereby the patient’s mental state is required to be continuously monitored.  
655 0 |9 64  |a Theses, IIUM local 
690 |9 19519  |a Dissertations, Academic  |x Kulliyyah of Information and Communication Technology  |z IIUM 
700 0 |a Abdul Wahab Abdul Rahman  |e degree supervisor 
700 0 |a Norzaliza Md.Nor  |e degree supervisor 
700 0 |a Raini Hassan  |e degree supervisor  |9 9769 
710 2 |9 169  |a International Islamic University Malaysia  |b Kulliyyah of Information and Communication Technology 
856 1 4 |u http://studentrepo.iium.edu.my/handle/123456789/11490 
900 |4 sz to asbh 
942 |2 lcc  |c THESIS  |n 0 
999 |c 516110  |d 547527 
952 |0 0  |1 0  |2 lcc  |4 0  |7 5  |8 IIUMTHESIS  |9 1015674  |a IIUM  |b IIUM  |c THESIS  |d 2023-06-07  |e MGIFT  |g 0.00  |p 11100383877  |r 2023-06-07  |w 2023-06-07  |y THESIS