Face emotion recognition using artificial intelligence techniques

Recently, there has been tremendous growth in the area of Human Computer Interaction (HCI). Many HCI applications were documented, and among them, the Face Emotion Recognition(FER) is one of the well known areas. Seven face emotions are considered universally in FER research: they are happy, sad, an...

Full description

Saved in:

Bibliographic Details
Main Author:	Kartigayan Muthukaruppan
Format:	Thesis
Language:	English
Subjects:	Artificial intelligence Face Emotion Recognition(FER) Detectors Genetic algorithm (GA) Neural network Biomedical sensors
Online Access:	http://dspace.unimap.edu.my:80/xmlui/bitstream/123456789/1480/1/Page%201-24.pdf http://dspace.unimap.edu.my:80/xmlui/bitstream/123456789/1480/2/Full%20text.pdf
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my-unimap-1480
record_format	uketd_dc
institution	Universiti Malaysia Perlis
collection	UniMAP Institutional Repository
language	English
topic	Artificial intelligence Face Emotion Recognition(FER) Detectors Genetic algorithm (GA) Neural network Biomedical sensors
spellingShingle	Artificial intelligence Face Emotion Recognition(FER) Detectors Genetic algorithm (GA) Neural network Biomedical sensors Kartigayan Muthukaruppan Face emotion recognition using artificial intelligence techniques
description	Recently, there has been tremendous growth in the area of Human Computer Interaction (HCI). Many HCI applications were documented, and among them, the Face Emotion Recognition(FER) is one of the well known areas. Seven face emotions are considered universally in FER research: they are happy, sad, angry, fear, surprise, disgust and neutral. The FER can find applications in hospital and in home (for senior citizens, bed ridden persons and severely injured patients) and in analyzing the personal emotion psychology. The FER comes with various approaches and methods in the way to have a good recognition package. However, there are various reasons for the failures in the packages and one of them is due to face features that change with age, color, mental state and individual face expressions. In this research, the problem is focused on the personalized face emotion and some studies are extended for better emotion recognition. FER is achieved in two parts, they are image processing part and classification part. The first part investigates a set of image processing methods suitable for recognizing the face emotion. The acquired images have gone through few preprocessing methods. The edge detection has to be successful even when the intensity of light is uneven. So, to overcome the difficulty of uneven lighting, the histogram equalized image is split into two regions of interest (ROI) – eye and lip regions. These two regions have been applied with the same preprocessing methods but with different threshold values. The human eye and lip configurations are found to be more of towards ellipses. With the objective of finding the changes in eye and lip areas, a set of new forms for ellipse fitness function is proposed. The fitness functions find changes in the minor axes of both eye and lip images. The fitness functions are utilized by genetic algorithm (GA) to find the optimized values of minor axes. Three fitness functions are developed, one for the eye and two for the lip (top and bottom lip). These fitness functions are applied on eye and lip images of South East Asian, Japanese and Chinese subjects. Observation of various emotions of the three subjects leads to a unique characteristic of eye and lip. Outcome of optimized values indicate the ratios of the minor axes with respect to neutral emotion for the SEA, Japanese and Chinese subjects. It is found, from the optimized data, that there is no common pattern to recognize emotions within among the three subjects. The absence of common patterns leads to studies on emotion personalized to an ethnic. In order to understand the personalized face emotion recognition, the developed fitness functions are applied on two SEA subjects. However, it is found that some emotion range overlaps with other emotion ranges. In order to circumvent this problem in recognizing the emotions, two Artificial Intelligence (AI) classification techniques such as neural network and fuzzy clustering are employed. Various forms of neural networks have been applied and one of them is found to perform well in achieving a success rate of 91.42% for SEA1 and 89.76% for SEA2. In the case of second classification technique, two forms of fuzzy c-mean clustering are considered and their performances are compared. One of them performs better by achieving a 90% success rate for both SEA1 and SEA2. It is concluded that the analysis of personalized emotion through facial features of two subjects indicate higher rate of success compared to a general form of analysis that is applied to varieties of faces of several ethnic personalities.
format	Thesis
author	Kartigayan Muthukaruppan
author_facet	Kartigayan Muthukaruppan
author_sort	Kartigayan Muthukaruppan
title	Face emotion recognition using artificial intelligence techniques
title_short	Face emotion recognition using artificial intelligence techniques
title_full	Face emotion recognition using artificial intelligence techniques
title_fullStr	Face emotion recognition using artificial intelligence techniques
title_full_unstemmed	Face emotion recognition using artificial intelligence techniques
title_sort	face emotion recognition using artificial intelligence techniques
granting_institution	Universiti Malaysia Perlis
granting_department	School of Mechatronic Engineering
url	http://dspace.unimap.edu.my:80/xmlui/bitstream/123456789/1480/1/Page%201-24.pdf http://dspace.unimap.edu.my:80/xmlui/bitstream/123456789/1480/2/Full%20text.pdf
_version_	1747836768341721088
spelling	my-unimap-14802008-10-15T03:29:36Z Face emotion recognition using artificial intelligence techniques Kartigayan Muthukaruppan Recently, there has been tremendous growth in the area of Human Computer Interaction (HCI). Many HCI applications were documented, and among them, the Face Emotion Recognition(FER) is one of the well known areas. Seven face emotions are considered universally in FER research: they are happy, sad, angry, fear, surprise, disgust and neutral. The FER can find applications in hospital and in home (for senior citizens, bed ridden persons and severely injured patients) and in analyzing the personal emotion psychology. The FER comes with various approaches and methods in the way to have a good recognition package. However, there are various reasons for the failures in the packages and one of them is due to face features that change with age, color, mental state and individual face expressions. In this research, the problem is focused on the personalized face emotion and some studies are extended for better emotion recognition. FER is achieved in two parts, they are image processing part and classification part. The first part investigates a set of image processing methods suitable for recognizing the face emotion. The acquired images have gone through few preprocessing methods. The edge detection has to be successful even when the intensity of light is uneven. So, to overcome the difficulty of uneven lighting, the histogram equalized image is split into two regions of interest (ROI) – eye and lip regions. These two regions have been applied with the same preprocessing methods but with different threshold values. The human eye and lip configurations are found to be more of towards ellipses. With the objective of finding the changes in eye and lip areas, a set of new forms for ellipse fitness function is proposed. The fitness functions find changes in the minor axes of both eye and lip images. The fitness functions are utilized by genetic algorithm (GA) to find the optimized values of minor axes. Three fitness functions are developed, one for the eye and two for the lip (top and bottom lip). These fitness functions are applied on eye and lip images of South East Asian, Japanese and Chinese subjects. Observation of various emotions of the three subjects leads to a unique characteristic of eye and lip. Outcome of optimized values indicate the ratios of the minor axes with respect to neutral emotion for the SEA, Japanese and Chinese subjects. It is found, from the optimized data, that there is no common pattern to recognize emotions within among the three subjects. The absence of common patterns leads to studies on emotion personalized to an ethnic. In order to understand the personalized face emotion recognition, the developed fitness functions are applied on two SEA subjects. However, it is found that some emotion range overlaps with other emotion ranges. In order to circumvent this problem in recognizing the emotions, two Artificial Intelligence (AI) classification techniques such as neural network and fuzzy clustering are employed. Various forms of neural networks have been applied and one of them is found to perform well in achieving a success rate of 91.42% for SEA1 and 89.76% for SEA2. In the case of second classification technique, two forms of fuzzy c-mean clustering are considered and their performances are compared. One of them performs better by achieving a 90% success rate for both SEA1 and SEA2. It is concluded that the analysis of personalized emotion through facial features of two subjects indicate higher rate of success compared to a general form of analysis that is applied to varieties of faces of several ethnic personalities. Universiti Malaysia Perlis 2008 Thesis en http://dspace.unimap.edu.my/123456789/1480 http://dspace.unimap.edu.my:80/xmlui/bitstream/123456789/1480/1/Page%201-24.pdf b48513fa47ed7e11fa4eb9e1f16041f7 http://dspace.unimap.edu.my:80/xmlui/bitstream/123456789/1480/2/Full%20text.pdf 83d41f499072da670d4a75f55abeab4f http://dspace.unimap.edu.my:80/xmlui/bitstream/123456789/1480/3/license.txt 13ddc5256307194ab3f065fb568b1f8d Artificial intelligence Face Emotion Recognition(FER) Detectors Genetic algorithm (GA) Neural network Biomedical sensors School of Mechatronic Engineering

Face emotion recognition using artificial intelligence techniques

Similar Items