Forensic Sketch To Mugshot Matching Algorithm Based On Dynamic Difference Of Gaussian Oriented Gradient Histogram

An automatic photo retrieval system based on facial sketch has very useful application in criminal investigations. The face sketch and photograph are from different modality. In inter-modality matching approach, it is unclear which descriptor is the most modality-invariant. Next, the real-world phot...

Full description

Saved in:
Bibliographic Details
Main Author: Setumin, Samsul
Format: Thesis
Language:English
Published: 2019
Subjects:
Online Access:http://eprints.usm.my/55422/1/Forensic%20Sketch%20To%20Mugshot%20Matching%20Algorithm%20Based%20On%20Dynamic%20Difference%20Of%20Gaussian%20Oriented%20Gradient%20Histogram_Samsul%20Setumin.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
id my-usm-ep.55422
record_format uketd_dc
spelling my-usm-ep.554222022-10-26T05:07:04Z Forensic Sketch To Mugshot Matching Algorithm Based On Dynamic Difference Of Gaussian Oriented Gradient Histogram 2019-07-01 Setumin, Samsul T Technology TK Electrical Engineering. Electronics. Nuclear Engineering An automatic photo retrieval system based on facial sketch has very useful application in criminal investigations. The face sketch and photograph are from different modality. In inter-modality matching approach, it is unclear which descriptor is the most modality-invariant. Next, the real-world photo may be exposed to lighting variation and the sketch may experience some degrees of shape exaggeration with very less accurate details. With these effects, the retrieval rate reduces significantly. In this research work, at the beginning, the most modality-invariant local hand craftedde scriptor is determined. Next, a new fiducial points for face alignment and a newdescriptor called Difference of Gaussian Oriented Gradient Histogram (DoGOGH) are introduced to reduce the factor of shape exaggeration and to minimize the illumination effects, respectively. It is followed by new feature extraction methods called Dynamic DoGOGH (D-DoGOGH) and Cascaded Static and Dynamic DoGOGH (C-DoGOGH) to really cater for the shape exaggeration effects. The accuracy and speed are improved further after incorporating feature fusion, Patch of Interest (PoI) and score fusion into the proposed method. The experimental results for CUHK Face Sketch Database (CUFS) and CUHK Face Sketch FERET Database (CUFSF) datasets demonstrate that the proposed method outperforms the state-of-the-art methods. It gives rank-1 accuracy of 100% and 95.48% for the CUFS and CUFSF datasets, respectively. The evaluation is extended further to semi-forensic and forensic sketch datasets to indicate that the proposed method is feasible to be used in the real-world criminal investigations. It gives rank-1 accuracy improvements of 28.56% and 66.77% for the semi-forensic and forensic sketch datasets, respectively. 2019-07 Thesis http://eprints.usm.my/55422/ http://eprints.usm.my/55422/1/Forensic%20Sketch%20To%20Mugshot%20Matching%20Algorithm%20Based%20On%20Dynamic%20Difference%20Of%20Gaussian%20Oriented%20Gradient%20Histogram_Samsul%20Setumin.pdf application/pdf en public phd doctoral Universiti Sains Malaysia Pusat Pengajian Kejuruteraan Elektrik dan Elektronik
institution Universiti Sains Malaysia
collection USM Institutional Repository
language English
topic T Technology
T Technology
spellingShingle T Technology
T Technology
Setumin, Samsul
Forensic Sketch To Mugshot Matching Algorithm Based On Dynamic Difference Of Gaussian Oriented Gradient Histogram
description An automatic photo retrieval system based on facial sketch has very useful application in criminal investigations. The face sketch and photograph are from different modality. In inter-modality matching approach, it is unclear which descriptor is the most modality-invariant. Next, the real-world photo may be exposed to lighting variation and the sketch may experience some degrees of shape exaggeration with very less accurate details. With these effects, the retrieval rate reduces significantly. In this research work, at the beginning, the most modality-invariant local hand craftedde scriptor is determined. Next, a new fiducial points for face alignment and a newdescriptor called Difference of Gaussian Oriented Gradient Histogram (DoGOGH) are introduced to reduce the factor of shape exaggeration and to minimize the illumination effects, respectively. It is followed by new feature extraction methods called Dynamic DoGOGH (D-DoGOGH) and Cascaded Static and Dynamic DoGOGH (C-DoGOGH) to really cater for the shape exaggeration effects. The accuracy and speed are improved further after incorporating feature fusion, Patch of Interest (PoI) and score fusion into the proposed method. The experimental results for CUHK Face Sketch Database (CUFS) and CUHK Face Sketch FERET Database (CUFSF) datasets demonstrate that the proposed method outperforms the state-of-the-art methods. It gives rank-1 accuracy of 100% and 95.48% for the CUFS and CUFSF datasets, respectively. The evaluation is extended further to semi-forensic and forensic sketch datasets to indicate that the proposed method is feasible to be used in the real-world criminal investigations. It gives rank-1 accuracy improvements of 28.56% and 66.77% for the semi-forensic and forensic sketch datasets, respectively.
format Thesis
qualification_name Doctor of Philosophy (PhD.)
qualification_level Doctorate
author Setumin, Samsul
author_facet Setumin, Samsul
author_sort Setumin, Samsul
title Forensic Sketch To Mugshot Matching Algorithm Based On Dynamic Difference Of Gaussian Oriented Gradient Histogram
title_short Forensic Sketch To Mugshot Matching Algorithm Based On Dynamic Difference Of Gaussian Oriented Gradient Histogram
title_full Forensic Sketch To Mugshot Matching Algorithm Based On Dynamic Difference Of Gaussian Oriented Gradient Histogram
title_fullStr Forensic Sketch To Mugshot Matching Algorithm Based On Dynamic Difference Of Gaussian Oriented Gradient Histogram
title_full_unstemmed Forensic Sketch To Mugshot Matching Algorithm Based On Dynamic Difference Of Gaussian Oriented Gradient Histogram
title_sort forensic sketch to mugshot matching algorithm based on dynamic difference of gaussian oriented gradient histogram
granting_institution Universiti Sains Malaysia
granting_department Pusat Pengajian Kejuruteraan Elektrik dan Elektronik
publishDate 2019
url http://eprints.usm.my/55422/1/Forensic%20Sketch%20To%20Mugshot%20Matching%20Algorithm%20Based%20On%20Dynamic%20Difference%20Of%20Gaussian%20Oriented%20Gradient%20Histogram_Samsul%20Setumin.pdf
_version_ 1747822324499873792