Speed-up robust features based 3D object recognition for grasping by three fingered robot hand / Nurul Hanani Remeli

The ability to manipulate objects is one of the important requirements for industrial robots. Robot that exhibits human-like abilities needs the application of multiple sensors to recognise objects or environment for their tasks. In previous work, a 7-Degree Of Freedom (DOF) three fingered robot han...

Full description

Saved in:
Bibliographic Details
Main Author: Remeli, Nurul Hanani
Format: Thesis
Language:English
Published: 2018
Online Access:https://ir.uitm.edu.my/id/eprint/89924/1/89924.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
id my-uitm-ir.89924
record_format uketd_dc
spelling my-uitm-ir.899242024-04-22T09:13:52Z Speed-up robust features based 3D object recognition for grasping by three fingered robot hand / Nurul Hanani Remeli 2018 Remeli, Nurul Hanani The ability to manipulate objects is one of the important requirements for industrial robots. Robot that exhibits human-like abilities needs the application of multiple sensors to recognise objects or environment for their tasks. In previous work, a 7-Degree Of Freedom (DOF) three fingered robot hand had been developed for a grasping task. The reference position of the robot hand however was programmed based on predetermined motor positions of the joints for grasping two different shapes of object. The work showed successful grasping by the robot but was unable to generate the motor position on its own since no external sensor was used to recognise the position of the targeted object, hence it is not fully automated. Thus, vision as one of the sensors that can provide rich information was adopted to the robot system where two object image processing methods which are the Speed-Up Robust Features (SURF) and Scale Invariant Feature Transform (SIFT) algorithms were investigated for 2D image recognition of target object in a cluttered environment. Both methods are compared based on the detection performance on several orientations of object in real scene. The information from the method with less detection error is later selected to calculate the object position. Next, the 3D position and grasping points of target object was determined by combining the recognised positions from two 2D SURF images and the triangulation method .The identified object grasping points were then converted to robot space using the robot’s transformation equation derived based on the locations and orientation of robot and camera in the 3D workplace. The proposed method was verified through real-time grasping experiments where the target object was displaced for several positions along the x-axis and y-axis directions. Meanwhile, the strength of the gripping force is measured by comparing the result of motor position angle with the voltage from a force sensor attached at each of the robot finger tips. The result proved that the capability of the SURF algorithm to be better in recognising 100% of the target object without fail for nine random images but it has produced accumulated error throughout the steps in getting the 3D position. However, the errors that occurred in the 3D positions were due to the limitation in SURF and human error during manual measurements with the highest error observed at 3.90 cm. Meanwhile, the transformation equation has successfully calculated that object positions to be inclined towards the direction of the actual measured position in the robot’s coordinates. Finally, the real-time experiment result proved the capability of robot to perform grasping task in real-time autonomous operations with the highest object’s position error produced by SURF was 1.24cm in x axis direction. All of the fingers grasped the object at the same time and lifted the object according to the reference position provided by vision. 2018 Thesis https://ir.uitm.edu.my/id/eprint/89924/ https://ir.uitm.edu.my/id/eprint/89924/1/89924.pdf text en public masters Universiti Teknologi MARA (UiTM) Faculty of Electrical Engineering Ahmad Shauri, Ruhizan Liza
institution Universiti Teknologi MARA
collection UiTM Institutional Repository
language English
advisor Ahmad Shauri, Ruhizan Liza
description The ability to manipulate objects is one of the important requirements for industrial robots. Robot that exhibits human-like abilities needs the application of multiple sensors to recognise objects or environment for their tasks. In previous work, a 7-Degree Of Freedom (DOF) three fingered robot hand had been developed for a grasping task. The reference position of the robot hand however was programmed based on predetermined motor positions of the joints for grasping two different shapes of object. The work showed successful grasping by the robot but was unable to generate the motor position on its own since no external sensor was used to recognise the position of the targeted object, hence it is not fully automated. Thus, vision as one of the sensors that can provide rich information was adopted to the robot system where two object image processing methods which are the Speed-Up Robust Features (SURF) and Scale Invariant Feature Transform (SIFT) algorithms were investigated for 2D image recognition of target object in a cluttered environment. Both methods are compared based on the detection performance on several orientations of object in real scene. The information from the method with less detection error is later selected to calculate the object position. Next, the 3D position and grasping points of target object was determined by combining the recognised positions from two 2D SURF images and the triangulation method .The identified object grasping points were then converted to robot space using the robot’s transformation equation derived based on the locations and orientation of robot and camera in the 3D workplace. The proposed method was verified through real-time grasping experiments where the target object was displaced for several positions along the x-axis and y-axis directions. Meanwhile, the strength of the gripping force is measured by comparing the result of motor position angle with the voltage from a force sensor attached at each of the robot finger tips. The result proved that the capability of the SURF algorithm to be better in recognising 100% of the target object without fail for nine random images but it has produced accumulated error throughout the steps in getting the 3D position. However, the errors that occurred in the 3D positions were due to the limitation in SURF and human error during manual measurements with the highest error observed at 3.90 cm. Meanwhile, the transformation equation has successfully calculated that object positions to be inclined towards the direction of the actual measured position in the robot’s coordinates. Finally, the real-time experiment result proved the capability of robot to perform grasping task in real-time autonomous operations with the highest object’s position error produced by SURF was 1.24cm in x axis direction. All of the fingers grasped the object at the same time and lifted the object according to the reference position provided by vision.
format Thesis
qualification_level Master's degree
author Remeli, Nurul Hanani
spellingShingle Remeli, Nurul Hanani
Speed-up robust features based 3D object recognition for grasping by three fingered robot hand / Nurul Hanani Remeli
author_facet Remeli, Nurul Hanani
author_sort Remeli, Nurul Hanani
title Speed-up robust features based 3D object recognition for grasping by three fingered robot hand / Nurul Hanani Remeli
title_short Speed-up robust features based 3D object recognition for grasping by three fingered robot hand / Nurul Hanani Remeli
title_full Speed-up robust features based 3D object recognition for grasping by three fingered robot hand / Nurul Hanani Remeli
title_fullStr Speed-up robust features based 3D object recognition for grasping by three fingered robot hand / Nurul Hanani Remeli
title_full_unstemmed Speed-up robust features based 3D object recognition for grasping by three fingered robot hand / Nurul Hanani Remeli
title_sort speed-up robust features based 3d object recognition for grasping by three fingered robot hand / nurul hanani remeli
granting_institution Universiti Teknologi MARA (UiTM)
granting_department Faculty of Electrical Engineering
publishDate 2018
url https://ir.uitm.edu.my/id/eprint/89924/1/89924.pdf
_version_ 1804889820149841920