Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow

Optical flow is a traditional problem in computer vision. It is often formulated elegantly in a Markov Random Formulation and divided into two algorithms: i) local method with data term and ii) global method with both data and smoothness terms. In a local method, it is fuelled by the patch match to...

Full description

Saved in:
Bibliographic Details
Main Author: Eng, Wei Yong
Format: Thesis
Published: 2020
Subjects:
Tags: Add Tag
No Tags, Be the first to tag this record!
id my-mmu-ep.11411
record_format uketd_dc
spelling my-mmu-ep.114112023-05-19T08:30:32Z Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow 2020-11 Eng, Wei Yong TA1501-1820 Applied optics. Photonics Optical flow is a traditional problem in computer vision. It is often formulated elegantly in a Markov Random Formulation and divided into two algorithms: i) local method with data term and ii) global method with both data and smoothness terms. In a local method, it is fuelled by the patch match to find the most similar patch between input image pairs. The corresponding patch pairs are sought for all the patches in a reference image within a search range. The exhaustive search for the corresponding pair is computationally expensive. Previous literature focused on reducing the computational load and removing its dependency on the window size and search range, during the search process. Inspired by the PatchMatch and guided filter, PatchMatch Filter explored the possibility of a simultaneous computational reduction in both search range and window size dimensions. Most research works focus on solving small displacement optical flow problem as it involves mostly translational movement and little or no scale and orientation changes. Recently more and more researchers have explored large displacement optical flow as it is closer to a realistic environment and of more general usage. Large displacement optical flow is more challenging in that it involves significant geometric distortion such as scale and orientation changes. Pixel-based matching method is typically used to solve small displacement optical flow and it has accurate spatial precision as well as it is computationally efficient. Some research works adopted descriptor-based matching sparsely to deal with the significant scale and orientation changes, in which pure pixel-based matching might fails. Descriptor-based matching is known to deal with geometric variation at the cost of spatial resolution, which is an inherent limitation of the histogram computation nature. This work proposes to adopt non-histogram based features like pixel colour and gradient into typical histogram-based feature matching to obtain high precision flow. In the proposed method, the label space is parameterised in an affine motion model which includes scaling, orientation, horizontal and vertical translations. Also, Daisy descriptor is employed to deal with geometric changes. 2020-11 Thesis http://shdl.mmu.edu.my/11411/ http://erep.mmu.edu.my/ phd doctoral Multimedia University Faculty of Engineering and Technology (FET) EREP ID: 9889
institution Multimedia University
collection MMU Institutional Repository
topic TA1501-1820 Applied optics
Photonics
spellingShingle TA1501-1820 Applied optics
Photonics
Eng, Wei Yong
Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow
description Optical flow is a traditional problem in computer vision. It is often formulated elegantly in a Markov Random Formulation and divided into two algorithms: i) local method with data term and ii) global method with both data and smoothness terms. In a local method, it is fuelled by the patch match to find the most similar patch between input image pairs. The corresponding patch pairs are sought for all the patches in a reference image within a search range. The exhaustive search for the corresponding pair is computationally expensive. Previous literature focused on reducing the computational load and removing its dependency on the window size and search range, during the search process. Inspired by the PatchMatch and guided filter, PatchMatch Filter explored the possibility of a simultaneous computational reduction in both search range and window size dimensions. Most research works focus on solving small displacement optical flow problem as it involves mostly translational movement and little or no scale and orientation changes. Recently more and more researchers have explored large displacement optical flow as it is closer to a realistic environment and of more general usage. Large displacement optical flow is more challenging in that it involves significant geometric distortion such as scale and orientation changes. Pixel-based matching method is typically used to solve small displacement optical flow and it has accurate spatial precision as well as it is computationally efficient. Some research works adopted descriptor-based matching sparsely to deal with the significant scale and orientation changes, in which pure pixel-based matching might fails. Descriptor-based matching is known to deal with geometric variation at the cost of spatial resolution, which is an inherent limitation of the histogram computation nature. This work proposes to adopt non-histogram based features like pixel colour and gradient into typical histogram-based feature matching to obtain high precision flow. In the proposed method, the label space is parameterised in an affine motion model which includes scaling, orientation, horizontal and vertical translations. Also, Daisy descriptor is employed to deal with geometric changes.
format Thesis
qualification_name Doctor of Philosophy (PhD.)
qualification_level Doctorate
author Eng, Wei Yong
author_facet Eng, Wei Yong
author_sort Eng, Wei Yong
title Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow
title_short Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow
title_full Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow
title_fullStr Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow
title_full_unstemmed Improved Precision Dense Descriptor-Based Matching For Large Displacement Flow
title_sort improved precision dense descriptor-based matching for large displacement flow
granting_institution Multimedia University
granting_department Faculty of Engineering and Technology (FET)
publishDate 2020
_version_ 1776101402192379904