Neuromorphic learning machine based on stochastic reservoir computing for time series data processing and classification

Neuromorphic computing is a potential alternative to conventional von Neumann computers for specialised sensory-processing or classification applications. Neuromorphic systems replicate the biophysics of neurobiological networks by replicating the information processing mechanism of biological neuro...

Full description

Saved in:
Bibliographic Details
Main Author: Saw, Chia Yee
Format: Thesis
Language:English
English
Published: 2023
Subjects:
Online Access:http://eprints.utem.edu.my/id/eprint/27733/1/Neuromorphic%20learning%20machine%20based%20on%20stochastic%20reservoir%20computing%20for%20time%20series%20data%20processing%20and%20classification.pdf
http://eprints.utem.edu.my/id/eprint/27733/2/Neuromorphic%20learning%20machine%20based%20on%20stochastic%20reservoir%20computing%20for%20time%20series%20data%20processing%20and%20classification.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
id my-utem-ep.27733
record_format uketd_dc
spelling my-utem-ep.277332024-11-12T10:19:30Z Neuromorphic learning machine based on stochastic reservoir computing for time series data processing and classification 2023 Saw, Chia Yee T Technology (General) TA Engineering (General). Civil engineering (General) Neuromorphic computing is a potential alternative to conventional von Neumann computers for specialised sensory-processing or classification applications. Neuromorphic systems replicate the biophysics of neurobiological networks by replicating the information processing mechanism of biological neurons and synapses, resulting in high connection and parallelism on a smaller footprint. These characteristics contribute to the implementation of neuromorphic architectures in hardware development for time series data classification and recognition. However, hardware implementation of neural network suffers from resource constraints because to the typically large number of nodes utilised in RC networks and the high chip area required for each processing node. Moreover, a high number of features in time series data classification introduces computational burden and leads to excessive hardware calculation overhead. In this work, a reservoir computing based stochastic spiking neural network (SSNN) has been proposed for time series data processing and classification, enabling a more efficient hardware implementation with low computation overhead caused by minimum extracted features. The proposed neuron reservoir is implemented in two applications including ventricular heartbeat classification and human activity recognition (HAR). The 43 recordings of Electrocardiogram (ECG) signals that included both normal and arrhythmic beats from MIT-BIH arrhythmia database obtained from Physio-Net were used in this work for heartbeat classification. Baseline drift and power line interference that are frequently emphasized in ECG readings are minimized by signal denoising. The single feature, QRS complexes, was extracted and fed into the neural reservoir with 20 neurons in cyclic topology for arrhythmias’ similarity calculation and classification. The HAR is evaluated in order to further validate the proposed SSNN approach. This work proposes feature extraction based on subcarrier correlation and pseudocolor variations caused by human movements depicted in the images using convolution neural network (CNN) without preprocessing applied and enabling low computational complexity and visual observation of entire pattern changes. The extracted features are fed into the neural reservoir for activities recognition. A two-input stochastic neuron is developed for complex machine learning using the stochastic computing (SC) theory. The 20 stochastic neurons are then arranged into a simple cycle reservoir (SCR) architecture to create the SSNN. The proposed system has been implemented in Xilinx Zynq-7000 field-programmable gate array (FPGA) to demonstrate the hardware efficiency leads by the minimum feature size used. The proposed stochastic spiking reservoir achieves an accuracy of 96.91% in heartbeat classification and 92.94% and 93.91% for features based on subcarrier correlation and pseudocolor plot in HAR, demonstrating that the system is accurate and effective at classifying time series data. 2023 Thesis http://eprints.utem.edu.my/id/eprint/27733/ http://eprints.utem.edu.my/id/eprint/27733/1/Neuromorphic%20learning%20machine%20based%20on%20stochastic%20reservoir%20computing%20for%20time%20series%20data%20processing%20and%20classification.pdf text en public http://eprints.utem.edu.my/id/eprint/27733/2/Neuromorphic%20learning%20machine%20based%20on%20stochastic%20reservoir%20computing%20for%20time%20series%20data%20processing%20and%20classification.pdf text en validuser https://plh.utem.edu.my/cgi-bin/koha/opac-detail.pl?biblionumber=123728 mphil masters Universiti Teknikal Malaysia Melaka Faculty of Electronic and Computer Engineering Wong, Yan Chiew
institution Universiti Teknikal Malaysia Melaka
collection UTeM Repository
language English
English
advisor Wong, Yan Chiew
topic T Technology (General)
T Technology (General)
spellingShingle T Technology (General)
T Technology (General)
Saw, Chia Yee
Neuromorphic learning machine based on stochastic reservoir computing for time series data processing and classification
description Neuromorphic computing is a potential alternative to conventional von Neumann computers for specialised sensory-processing or classification applications. Neuromorphic systems replicate the biophysics of neurobiological networks by replicating the information processing mechanism of biological neurons and synapses, resulting in high connection and parallelism on a smaller footprint. These characteristics contribute to the implementation of neuromorphic architectures in hardware development for time series data classification and recognition. However, hardware implementation of neural network suffers from resource constraints because to the typically large number of nodes utilised in RC networks and the high chip area required for each processing node. Moreover, a high number of features in time series data classification introduces computational burden and leads to excessive hardware calculation overhead. In this work, a reservoir computing based stochastic spiking neural network (SSNN) has been proposed for time series data processing and classification, enabling a more efficient hardware implementation with low computation overhead caused by minimum extracted features. The proposed neuron reservoir is implemented in two applications including ventricular heartbeat classification and human activity recognition (HAR). The 43 recordings of Electrocardiogram (ECG) signals that included both normal and arrhythmic beats from MIT-BIH arrhythmia database obtained from Physio-Net were used in this work for heartbeat classification. Baseline drift and power line interference that are frequently emphasized in ECG readings are minimized by signal denoising. The single feature, QRS complexes, was extracted and fed into the neural reservoir with 20 neurons in cyclic topology for arrhythmias’ similarity calculation and classification. The HAR is evaluated in order to further validate the proposed SSNN approach. This work proposes feature extraction based on subcarrier correlation and pseudocolor variations caused by human movements depicted in the images using convolution neural network (CNN) without preprocessing applied and enabling low computational complexity and visual observation of entire pattern changes. The extracted features are fed into the neural reservoir for activities recognition. A two-input stochastic neuron is developed for complex machine learning using the stochastic computing (SC) theory. The 20 stochastic neurons are then arranged into a simple cycle reservoir (SCR) architecture to create the SSNN. The proposed system has been implemented in Xilinx Zynq-7000 field-programmable gate array (FPGA) to demonstrate the hardware efficiency leads by the minimum feature size used. The proposed stochastic spiking reservoir achieves an accuracy of 96.91% in heartbeat classification and 92.94% and 93.91% for features based on subcarrier correlation and pseudocolor plot in HAR, demonstrating that the system is accurate and effective at classifying time series data.
format Thesis
qualification_name Master of Philosophy (M.Phil.)
qualification_level Master's degree
author Saw, Chia Yee
author_facet Saw, Chia Yee
author_sort Saw, Chia Yee
title Neuromorphic learning machine based on stochastic reservoir computing for time series data processing and classification
title_short Neuromorphic learning machine based on stochastic reservoir computing for time series data processing and classification
title_full Neuromorphic learning machine based on stochastic reservoir computing for time series data processing and classification
title_fullStr Neuromorphic learning machine based on stochastic reservoir computing for time series data processing and classification
title_full_unstemmed Neuromorphic learning machine based on stochastic reservoir computing for time series data processing and classification
title_sort neuromorphic learning machine based on stochastic reservoir computing for time series data processing and classification
granting_institution Universiti Teknikal Malaysia Melaka
granting_department Faculty of Electronic and Computer Engineering
publishDate 2023
url http://eprints.utem.edu.my/id/eprint/27733/1/Neuromorphic%20learning%20machine%20based%20on%20stochastic%20reservoir%20computing%20for%20time%20series%20data%20processing%20and%20classification.pdf
http://eprints.utem.edu.my/id/eprint/27733/2/Neuromorphic%20learning%20machine%20based%20on%20stochastic%20reservoir%20computing%20for%20time%20series%20data%20processing%20and%20classification.pdf
_version_ 1818612053021032448