Discriminative classification model of filled pause and elongation for Malay language spontaneous speech / Raseeda Hamzah

Automated speech recognition (ASR) for spontaneous speech poses extra challenge compared to read speech as it contains varied speaking rates, poor phonation and disfluencies. Studies have shown that filled pause is one of the most common disfluencies of spontaneous speech characteristic where it pre...

Full description

Saved in:
Bibliographic Details
Main Author: Hamzah, Raseeda
Format: Thesis
Language:English
Published: 2016
Online Access:https://ir.uitm.edu.my/id/eprint/17786/1/TP_RASEEDA%20HAMZAH%20CS%2016_5.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
id my-uitm-ir.17786
record_format uketd_dc
spelling my-uitm-ir.177862018-09-24T06:57:24Z Discriminative classification model of filled pause and elongation for Malay language spontaneous speech / Raseeda Hamzah 2016 Hamzah, Raseeda Automated speech recognition (ASR) for spontaneous speech poses extra challenge compared to read speech as it contains varied speaking rates, poor phonation and disfluencies. Studies have shown that filled pause is one of the most common disfluencies of spontaneous speech characteristic where it presents considerable problems for ASR performance. In many filled pause studies, the hindering factor is that filled pause being often recognized as short words which particularly has semantic meaning, such as 'urn' can be recognized as 'thumb' or 'arm'. This problem becomes especially pertinent where a vowel sound of normal word being relatively long at any position in an utterance, both within a word as well as between words which formerly known as elongation. The existence of elongation causes normal word falsely detected as filled pause due to their similar acoustical feature patterns. Classifying elongation as filled pause affects ASR's performance as eliminating normal words from recognition may modify the intended context of a speech. Therefore, the main aim of this research is to classify filled pause and elongation into its own classes by constructing a discriminative classification model from the extracted acoustical features. A large number of signal features have been employed for the problem of discriminating filled pause and elongation. Several well-established features such as Formant Frequency (FF), Fundamental Frequency (FO), Mel Frequency Cepstral Coefficients (MFCC), Zero Crossing Rates (ZCR) and Short Time Energy (STE) were used in this research. These features are carefully chosen to emphasize signal characteristics that differ between filled pause and elongation. In most speech research, extracting speech energy feature is still remains as challenging task due to it typically has a great deal of variance which include loudness as well as the variance in the signal energy between different phoneme which contains vowel or/and consonant sounds. One of the ways of detecting vowel and consonant is through its energy level. Beside the common way of quantifying the speech energy by calculating the sum of energy of the short interval centered on each interval, we proposed new technique namely, Local Maxima Energy (LM-E) to exploit the speech energy feature of filled pause and elongation. Experimentally, this can be done by measuring its amplitude transition from one frame to another by setting a threshold as height difference between peaks of the speech signal. Unlike other acoustical features, LM-E has shown its performance to classify elongation better by detecting the expressive contour of the elongation that is caused by the transition from consonant to vowel of the elongation. A rigorous feature performance evaluation shows that LM-E significantly increased the classification performance when fused with ZCR. Therefore, these two features are incorporated into discriminative Naive-Bayes model for filled pause and elongation classification. The discriminative model of LM-E and ZCR improved the classification performance by 7% error rate reduction, and average of 7% accuracy increments compared to single feature classification performance. This model can further be used to improve disfluencies detection for a better ASR performance. 2016 Thesis https://ir.uitm.edu.my/id/eprint/17786/ https://ir.uitm.edu.my/id/eprint/17786/1/TP_RASEEDA%20HAMZAH%20CS%2016_5.pdf text en public phd doctoral Universiti Teknologi MARA Faculty of Computer and Mathematical Sciences
institution Universiti Teknologi MARA
collection UiTM Institutional Repository
language English
description Automated speech recognition (ASR) for spontaneous speech poses extra challenge compared to read speech as it contains varied speaking rates, poor phonation and disfluencies. Studies have shown that filled pause is one of the most common disfluencies of spontaneous speech characteristic where it presents considerable problems for ASR performance. In many filled pause studies, the hindering factor is that filled pause being often recognized as short words which particularly has semantic meaning, such as 'urn' can be recognized as 'thumb' or 'arm'. This problem becomes especially pertinent where a vowel sound of normal word being relatively long at any position in an utterance, both within a word as well as between words which formerly known as elongation. The existence of elongation causes normal word falsely detected as filled pause due to their similar acoustical feature patterns. Classifying elongation as filled pause affects ASR's performance as eliminating normal words from recognition may modify the intended context of a speech. Therefore, the main aim of this research is to classify filled pause and elongation into its own classes by constructing a discriminative classification model from the extracted acoustical features. A large number of signal features have been employed for the problem of discriminating filled pause and elongation. Several well-established features such as Formant Frequency (FF), Fundamental Frequency (FO), Mel Frequency Cepstral Coefficients (MFCC), Zero Crossing Rates (ZCR) and Short Time Energy (STE) were used in this research. These features are carefully chosen to emphasize signal characteristics that differ between filled pause and elongation. In most speech research, extracting speech energy feature is still remains as challenging task due to it typically has a great deal of variance which include loudness as well as the variance in the signal energy between different phoneme which contains vowel or/and consonant sounds. One of the ways of detecting vowel and consonant is through its energy level. Beside the common way of quantifying the speech energy by calculating the sum of energy of the short interval centered on each interval, we proposed new technique namely, Local Maxima Energy (LM-E) to exploit the speech energy feature of filled pause and elongation. Experimentally, this can be done by measuring its amplitude transition from one frame to another by setting a threshold as height difference between peaks of the speech signal. Unlike other acoustical features, LM-E has shown its performance to classify elongation better by detecting the expressive contour of the elongation that is caused by the transition from consonant to vowel of the elongation. A rigorous feature performance evaluation shows that LM-E significantly increased the classification performance when fused with ZCR. Therefore, these two features are incorporated into discriminative Naive-Bayes model for filled pause and elongation classification. The discriminative model of LM-E and ZCR improved the classification performance by 7% error rate reduction, and average of 7% accuracy increments compared to single feature classification performance. This model can further be used to improve disfluencies detection for a better ASR performance.
format Thesis
qualification_name Doctor of Philosophy (PhD.)
qualification_level Doctorate
author Hamzah, Raseeda
spellingShingle Hamzah, Raseeda
Discriminative classification model of filled pause and elongation for Malay language spontaneous speech / Raseeda Hamzah
author_facet Hamzah, Raseeda
author_sort Hamzah, Raseeda
title Discriminative classification model of filled pause and elongation for Malay language spontaneous speech / Raseeda Hamzah
title_short Discriminative classification model of filled pause and elongation for Malay language spontaneous speech / Raseeda Hamzah
title_full Discriminative classification model of filled pause and elongation for Malay language spontaneous speech / Raseeda Hamzah
title_fullStr Discriminative classification model of filled pause and elongation for Malay language spontaneous speech / Raseeda Hamzah
title_full_unstemmed Discriminative classification model of filled pause and elongation for Malay language spontaneous speech / Raseeda Hamzah
title_sort discriminative classification model of filled pause and elongation for malay language spontaneous speech / raseeda hamzah
granting_institution Universiti Teknologi MARA
granting_department Faculty of Computer and Mathematical Sciences
publishDate 2016
url https://ir.uitm.edu.my/id/eprint/17786/1/TP_RASEEDA%20HAMZAH%20CS%2016_5.pdf
_version_ 1783733598381146112