Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow

Optical flow is a traditional problem in computer vision. It is often formulated elegantly in a Markov Random Formulation and divided into two algorithms: i) local method with data term and ii) global method with both data and smoothness terms. In a local method, it is fuelled by the patch match to...

Full description

Saved in:

Bibliographic Details
Main Author:	Eng, Wei Yong
Format:	Thesis
Published:	2020
Subjects:	TA1501-1820 Applied optics Photonics
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my-mmu-ep.11411
record_format	uketd_dc
spelling	my-mmu-ep.114112023-05-19T08:30:32Z Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow 2020-11 Eng, Wei Yong TA1501-1820 Applied optics. Photonics Optical flow is a traditional problem in computer vision. It is often formulated elegantly in a Markov Random Formulation and divided into two algorithms: i) local method with data term and ii) global method with both data and smoothness terms. In a local method, it is fuelled by the patch match to find the most similar patch between input image pairs. The corresponding patch pairs are sought for all the patches in a reference image within a search range. The exhaustive search for the corresponding pair is computationally expensive. Previous literature focused on reducing the computational load and removing its dependency on the window size and search range, during the search process. Inspired by the PatchMatch and guided filter, PatchMatch Filter explored the possibility of a simultaneous computational reduction in both search range and window size dimensions. Most research works focus on solving small displacement optical flow problem as it involves mostly translational movement and little or no scale and orientation changes. Recently more and more researchers have explored large displacement optical flow as it is closer to a realistic environment and of more general usage. Large displacement optical flow is more challenging in that it involves significant geometric distortion such as scale and orientation changes. Pixel-based matching method is typically used to solve small displacement optical flow and it has accurate spatial precision as well as it is computationally efficient. Some research works adopted descriptor-based matching sparsely to deal with the significant scale and orientation changes, in which pure pixel-based matching might fails. Descriptor-based matching is known to deal with geometric variation at the cost of spatial resolution, which is an inherent limitation of the histogram computation nature. This work proposes to adopt non-histogram based features like pixel colour and gradient into typical histogram-based feature matching to obtain high precision flow. In the proposed method, the label space is parameterised in an affine motion model which includes scaling, orientation, horizontal and vertical translations. Also, Daisy descriptor is employed to deal with geometric changes. 2020-11 Thesis http://shdl.mmu.edu.my/11411/ http://erep.mmu.edu.my/ phd doctoral Multimedia University Faculty of Engineering and Technology (FET) EREP ID: 9889
institution	Multimedia University
collection	MMU Institutional Repository
topic	TA1501-1820 Applied optics Photonics
spellingShingle	TA1501-1820 Applied optics Photonics Eng, Wei Yong Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow
description	Optical flow is a traditional problem in computer vision. It is often formulated elegantly in a Markov Random Formulation and divided into two algorithms: i) local method with data term and ii) global method with both data and smoothness terms. In a local method, it is fuelled by the patch match to find the most similar patch between input image pairs. The corresponding patch pairs are sought for all the patches in a reference image within a search range. The exhaustive search for the corresponding pair is computationally expensive. Previous literature focused on reducing the computational load and removing its dependency on the window size and search range, during the search process. Inspired by the PatchMatch and guided filter, PatchMatch Filter explored the possibility of a simultaneous computational reduction in both search range and window size dimensions. Most research works focus on solving small displacement optical flow problem as it involves mostly translational movement and little or no scale and orientation changes. Recently more and more researchers have explored large displacement optical flow as it is closer to a realistic environment and of more general usage. Large displacement optical flow is more challenging in that it involves significant geometric distortion such as scale and orientation changes. Pixel-based matching method is typically used to solve small displacement optical flow and it has accurate spatial precision as well as it is computationally efficient. Some research works adopted descriptor-based matching sparsely to deal with the significant scale and orientation changes, in which pure pixel-based matching might fails. Descriptor-based matching is known to deal with geometric variation at the cost of spatial resolution, which is an inherent limitation of the histogram computation nature. This work proposes to adopt non-histogram based features like pixel colour and gradient into typical histogram-based feature matching to obtain high precision flow. In the proposed method, the label space is parameterised in an affine motion model which includes scaling, orientation, horizontal and vertical translations. Also, Daisy descriptor is employed to deal with geometric changes.
format	Thesis
qualification_name	Doctor of Philosophy (PhD.)
qualification_level	Doctorate
author	Eng, Wei Yong
author_facet	Eng, Wei Yong
author_sort	Eng, Wei Yong
title	Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow
title_short	Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow
title_full	Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow
title_fullStr	Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow
title_full_unstemmed	Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow
title_sort	improved precision dense descriptor-based matching for large displacement flow
granting_institution	Multimedia University
granting_department	Faculty of Engineering and Technology (FET)
publishDate	2020
_version_	1776101402192379904

Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow

Similar Items