Object Isolation In A Random Environment Using Manipulation Primitives Approach

As autonomous robots become less task specific to able to handle a larger variety of task that it may come across in the world, its ability to isolate the environmental objects from the object of interest becomes an increasingly important ability to have. This is in comparison to the current literat...

Full description

Saved in:
Bibliographic Details
Main Author: Quah, Jit Shen
Format: Thesis
Language:English
English
Published: 2019
Subjects:
Online Access:http://eprints.utem.edu.my/id/eprint/24617/1/Object%20Isolation%20In%20A%20Random%20Environment%20Using%20Manipulation%20Primitives%20Approach.pdf
http://eprints.utem.edu.my/id/eprint/24617/2/Object%20Isolation%20In%20A%20Random%20Environment%20Using%20Manipulation%20Primitives%20Approach.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
id my-utem-ep.24617
record_format uketd_dc
institution Universiti Teknikal Malaysia Melaka
collection UTeM Repository
language English
English
topic T Technology (General)
T Technology (General)
spellingShingle T Technology (General)
T Technology (General)
Quah, Jit Shen
Object Isolation In A Random Environment Using Manipulation Primitives Approach
description As autonomous robots become less task specific to able to handle a larger variety of task that it may come across in the world, its ability to isolate the environmental objects from the object of interest becomes an increasingly important ability to have. This is in comparison to the current literature interest which focuses on the isolation of the object from the environment due to its precise nature. This method often consists of two distinct actions which is the action to improve the robot’s perception followed by another to manipulate the object of interest. This however becomes a problem when considering it might be impossible or undesirable to manipulate the object of interest such as the case of cleaning up archeological finds or even rescue missions of earthquake victims. In cases such as those, the precise nature of the actuation becomes a hindrance due to the long duration needed in order to manipulation every single object in the field one object at a time. This research explores the idea of combining both actions to improve perception as well as action to manipulate the object into one single motion with the added goal of manipulating as many objects as possible in a single action with minimal/no effect towards the object of interest. This research proposes three novel algorithms on a robot to plot out the position for each unwanted objects and its destined position as well as its trajectory and then utilizes manipulation primitives (pushing motion) to move said object along the planned trajectory. The algorithm was demonstrated using a KUKA Youbot with a camera fitted above the workspace. Results from the experiment indicated that all proposed algorithms successfully reduced the number of manipulations per object up to 0.605 manipulations albeit with a small tradeoff in accuracy from 97.7% to 93% which translates to average of 0.85cm/actuation for MSMAPPS, 0.75cm/actuation for MSMAPOS and finally 0.27cm/actuation for BSMAPOS. These results indicate a relatively small displacement per actuation at 4.35% displacement per actuation, 3.75% displacement per actuation, and 1.35% displacement per actuation relative to the workspace respectively. As a conclusion, the proposed methods is shown to be significantly more efficient then current methods employed in the field of object isolation in exchange for a small reduction in performance in terms of accuracy of actuation.
format Thesis
qualification_name Master of Philosophy (M.Phil.)
qualification_level Master's degree
author Quah, Jit Shen
author_facet Quah, Jit Shen
author_sort Quah, Jit Shen
title Object Isolation In A Random Environment Using Manipulation Primitives Approach
title_short Object Isolation In A Random Environment Using Manipulation Primitives Approach
title_full Object Isolation In A Random Environment Using Manipulation Primitives Approach
title_fullStr Object Isolation In A Random Environment Using Manipulation Primitives Approach
title_full_unstemmed Object Isolation In A Random Environment Using Manipulation Primitives Approach
title_sort object isolation in a random environment using manipulation primitives approach
granting_institution Universiti Teknikal Malaysia Melaka
granting_department Faculty Of Electrical Engieering
publishDate 2019
url http://eprints.utem.edu.my/id/eprint/24617/1/Object%20Isolation%20In%20A%20Random%20Environment%20Using%20Manipulation%20Primitives%20Approach.pdf
http://eprints.utem.edu.my/id/eprint/24617/2/Object%20Isolation%20In%20A%20Random%20Environment%20Using%20Manipulation%20Primitives%20Approach.pdf
_version_ 1747834078737989632
spelling my-utem-ep.246172021-10-05T11:23:30Z Object Isolation In A Random Environment Using Manipulation Primitives Approach 2019 Quah, Jit Shen T Technology (General) TA Engineering (General). Civil engineering (General) As autonomous robots become less task specific to able to handle a larger variety of task that it may come across in the world, its ability to isolate the environmental objects from the object of interest becomes an increasingly important ability to have. This is in comparison to the current literature interest which focuses on the isolation of the object from the environment due to its precise nature. This method often consists of two distinct actions which is the action to improve the robot’s perception followed by another to manipulate the object of interest. This however becomes a problem when considering it might be impossible or undesirable to manipulate the object of interest such as the case of cleaning up archeological finds or even rescue missions of earthquake victims. In cases such as those, the precise nature of the actuation becomes a hindrance due to the long duration needed in order to manipulation every single object in the field one object at a time. This research explores the idea of combining both actions to improve perception as well as action to manipulate the object into one single motion with the added goal of manipulating as many objects as possible in a single action with minimal/no effect towards the object of interest. This research proposes three novel algorithms on a robot to plot out the position for each unwanted objects and its destined position as well as its trajectory and then utilizes manipulation primitives (pushing motion) to move said object along the planned trajectory. The algorithm was demonstrated using a KUKA Youbot with a camera fitted above the workspace. Results from the experiment indicated that all proposed algorithms successfully reduced the number of manipulations per object up to 0.605 manipulations albeit with a small tradeoff in accuracy from 97.7% to 93% which translates to average of 0.85cm/actuation for MSMAPPS, 0.75cm/actuation for MSMAPOS and finally 0.27cm/actuation for BSMAPOS. These results indicate a relatively small displacement per actuation at 4.35% displacement per actuation, 3.75% displacement per actuation, and 1.35% displacement per actuation relative to the workspace respectively. As a conclusion, the proposed methods is shown to be significantly more efficient then current methods employed in the field of object isolation in exchange for a small reduction in performance in terms of accuracy of actuation. 2019 Thesis http://eprints.utem.edu.my/id/eprint/24617/ http://eprints.utem.edu.my/id/eprint/24617/1/Object%20Isolation%20In%20A%20Random%20Environment%20Using%20Manipulation%20Primitives%20Approach.pdf text en public http://eprints.utem.edu.my/id/eprint/24617/2/Object%20Isolation%20In%20A%20Random%20Environment%20Using%20Manipulation%20Primitives%20Approach.pdf text en validuser https://plh.utem.edu.my/cgi-bin/koha/opac-detail.pl?biblionumber=117087 mphil masters Universiti Teknikal Malaysia Melaka Faculty Of Electrical Engieering 1. Al-Halimi, R. and Moussa, M. 2017. Performing Complex Tasks by Users with Upper-Extremity Disabilities Using a 6-DOF Robotic Arm: A Study. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 25(6), pp.686-693. 2. Alambeigi, F., Wang, Z., Hegeman, R., Liu, Y. H., Armand, M. 2018. A robust data-driven approach for online learning and manipulation of unmodeled 3-D heterogeneous compliant objects. IEEE Robotics and Automation Letters, 3(4), pp.4140-4147. 3. Ali, N. M. Jun, S. W. Karis, M. S. Ghazaly M. M. and Aras, S. M. 2016. Object Classification and Recognition Using Bag-Of-Words (Bow) Model, 2016 IEEE 12th International Colloquium on Signal Processing & Its Applications (CSPA), pp. 216-220. 4. Buchholz, D., Futterlieb, M., Winkelbach, S. and Wahl, F. 2013. Efficient Bin-Picking and Grasp Planning Based on Depth Data. 2013 IEEE International Conference on Robotics and Automation. 5. Chang, L. Smith J. R. and Fox, D. 2012. "Interactive Singulation Of Objects from A Pile," 2012 IEEE International Conference on Robotics and Automation, pp. 3875-3882. 6. Cherubini, A. and Chaumette, F. 2011. Visual Navigation with Obstacle Avoidance. 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems. 7. Cherubini, A., Spindler, F. and Chaumette, F., 2012. A New Tentacles-Based Technique for Avoiding Obstacles During Visual Navigation. 2012 IEEE International Conference on Robotics and Automation. 8. Contreras, S. and De La Rosa, F. 2016. Using Deep Learning for Exploration and Recognition of Objects Based on Images, 2016 XIII Latin American Robotics Symposium and IV Brazilian Robotics Symposium (LARS/SBR), pp. 1-6. 9. Devang, P., Gokul, N., Ranjana, M., Swaminathan, S. and Binoy, B. 2010. Autonomous Arecanut Tree Climbing and Pruning Robot. INTERACT-2010. 10. Dornhege, C. and Kleiner, A. 2011. A Frontier-Void-Based Approach for Autonomous Exploration In 3d. 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics, pp. 351-356. 11. Dunn, G. B., Segen, J, 1988. Automatic Discovery of Robotic Grasp Configurations, 1988 IEEE International Conference on Robotics and Automation, pp. 396-401. 12. Elliott, S. Valente, M. and Cakmak, M. 2016. Making Objects Graspable in Confined Environments Through Push and Pull Manipulation with A Tool, 2016 IEEE International Conference on Robotics and Automation (ICRA), pp. 4851-4858. 13. Gao, F. and Shen, S., 2016. Online Quadrotor Trajectory Generation and Autonomous Navigation on Point Clouds. 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR). 14. Gao, M., Schamm, T. and Zollner, J., 2015. Online and Incremental Contextual Task Learning and Recognition for Sharing Autonomy to Assist Mobile Robot Teleoperation. 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO). 15. Ge, S. S. Cui, Y. J. 2000. New Potential Functions for Mobile Robot Path Planning, IEEE Transaction on Robotics and Automation, 16(1), pp.615-620. 16. Ghommam, J., Fethalla, N. and Saad, M., 2016. Quadrotor Circumnavigation of An Unknown Moving Target Using Camera Vision-Based Measurements. IET Control Theory & Applications, 10(15), pp.1874-1887. 17. Gilbert, E., Johnson, D. 1985. Distance Functions and Their Application to Robot Path Planning in The Presence of Obstacles. IEEE Journal on Robotics and Automation, 1(1), pp. 21-30. 18. Gupta, M. and Sukhatme, G. S. 2012. Using Manipulation Primitives for Brick Sorting In Clutter, IEEE International Conference on Robotics and Automation, pp. 3883-3889. 19. Gupta, M. Müller, J. and Sukhatme, G. S. 2015. Using Manipulation Primitives for Object Sorting in Cluttered Environments, IEEE Transactions on Automation Science and Engineering, 12(2), pp. 608-614. 20. Jamaluddin, M. H. Shimono, T. and Motoi, N. 2014. An Integration Method Between Vision-Based Disturbance Observer and Bilateral Haptic System for Robust Tracking of Target Object, 2014 IEEE 13th International Workshop on Advanced Motion Control (AMC), pp. 723-728. 21. Jamaluddin, M. H. Shimono, T. and Motoi, N. 2014. Motion Navigation in Haptic Bilateral System Based On Vision-Based Force Compliance Controller Taking Object Coordinate Into Account, 2014 IEEE 23rd International Symposium on Industrial Electronics (ISIE), pp. 2238-2243. 22. Juntao, L., Tingting, D., Yuanyuan, L. and Yan, H., 2016. Study on Robot Path Collision Avoidance Planning Based on the Improved Ant Colony Algorithm. 2016 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC). 23. Jwu-Sheng Hu, Ming-Chih Chien, Yung-Jung Chang, Yen-Chung Chang, Shyh-Haur Su, Jwu-Jiun Yang and Chen-Yu Kai 2010. A Robotic Ball Catcher with Embedded Visual Servo Processor. 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems. 24. Katz, D. Kazemi, M., Bagnell, J. A. and Stentz A., 2013. Clearing A Pile of Unknown Objects Using Interactive Perception, 2013 IEEE International Conference on Robotics and Automation, pp. 154-161. 25. Kehoe, B., Matsukawa, A., Candido, S., Kuffner, J., Goldberg, K. 2013. Cloud-Based Robot Grasping with The Google Object Recognition Engine. 2013 IEEE International Conference in Robotics and Automation (ICRA), pp. 4263-4270. 26. Kragic, D., Björkman, M., Christensen, H. I., Eklundh, J. O.,2005. Vision for Robotic Object Manipulation in Domestic Settings. Robotics and autonomous Systems, 52(1), pp. 85-100. 27. Krivic, S. Ugur, E. and Piater, J. 2016. A Robust Pushing Skill for Object Delivery Between Obstacles, 2016 IEEE International Conference on Automation Science and Engineering (CASE), pp. 1184-1189. 28. Levihn, M. Nishiwaki, K. Kagami, S. and Stilman, M. 2014. Autonomous Environment Manipulation to Assist Humanoid Locomotion, 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 4633-4638. 29. Lin, Y. Min, H. Zhou, H. Pei, F. 2018. A Human-Robot-Environment Interactive Reasoning Mechanism for Object Sorting Robot, IEEE Transactions on Cognitive and Developmental Systems, 10(3), pp.611-623. 30. Lumelsky, V. J., Stepanov, A. A., 1987. Path-Planning Strategies for A Point Mobile Automaton Moving Amidst Unknown Obstacles of Arbitrary Shape. Algorithmica, 2(1-4), pp. 403-430. 31. Lutscher, E. and Cheng, G., 2014. Constrained Manipulation in Unstructured Environment Utilizing Hierarchical Task Specification for Indirect Force Controlled Robots. 2014 IEEE International Conference on Robotics and Automation (ICRA). 32. Maneewarn T. and Rittipravat, P. 2003. Sorting Objects by Multiple Robots Using Voronoi Separation and Fuzzy Control, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) 2(1), pp. 2043-2048. 33. Matveev, A., Semakova, A. and Savkin, A., 2016. Environmental Boundary Tracking Approach to Close Circumnavigation of a Group of Unknown Moving Targets Using Range Measurements. 2016 35th Chinese Control Conference (CCC). 34. Matveev, A., Semakova, A. and Savkin, A., 2015. Range-Measurement-Based Localization and Circumnavigation of Multiple Irregularly Moving Unknown Targets. 2015 10th Asian Control Conference (ASCC). 35. Miskon M. F. and Russell, R. A. 2009. Mapping Normal Sensor Measurement Using Regions, 2009 IEEE International Conference on Industrial Technology, pp. 1-6. 36. Monkman, G. J.; Hesse, S.; Steinmann, R.; Schunk, H., 2007. Robot Grippers. Wiley-VCH. 37. Morales, A., Prats, M., Sanz, P., Pobil, A. P., 2007. An Experiment in The Use of Manipulation Primitives and Tactile Perception for Reactive Grasping. In Robotics: Science and Systems, Workshop on Robot Manipulation: Sensing and Adapting to the Real World. 38. Murooka, M., Noda, S., Nozawa, S., Kakiuchi, Y., Okada, K. and Inaba, M. 2014. Manipulation Strategy Learning for Carrying Large Objects Based on Mapping from Object Physical Property to Object Manipulation Action in Virtual Environment. 2014 IEEE International Conference on Automation Science and Engineering (CASE). 39. Nozawa, S., Murooka, M., Noda, S., Okada, K. and Inaba, M. 2013. Description and Execution of Humanoid's Object Manipulation Based on Object-Environment-Robot Contact States. 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems. 40. Okada, K. Haneda, A. Nakai, H. Inaba M., and Inoue, H. 2004. Environment Manipulation Planner for Humanoid Robots Using Task Graph That Generates Action Sequence. 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2(1), pp. 1174-1179. 41. Pei-Wen Wu, Yu-Chi Lin, Chia-Ming Wang and Li-Chen Fu 2013. Grasping the Object with Collision Avoidance of Wheeled Mobile Manipulator in Dynamic Environments. 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems. 42. Quah, J. S., Ghazaly, M. M., FKE, F. K. E. 2018. Development and Analysis of Face Recognition System on a Mobile Robot Environment. Journal of Mechanical Engineering, 15(2), 169-189. 43. Rahmatizadeh, R., Abolghasemi, P., Bölöni, L., Levine, S. 2018. Vision-based multi-task manipulation for inexpensive robots using end-to-end learning from demonstration. 2018 IEEE International Conference on Robotics and Automation (ICRA) pp. 3758-3765. 44. Rasid, F. A. Miskon, M. F. Jamaluddin, M. H. Bahar M. B. Shen, Q. J. 2018. The Investigation of Circular Path Generation and Hand Motion Tracking Problem Using Vision Based Robot. International Journal of Mechanical & Mechatronics Engineering IJMME-IJENS, 18(2), pp.121-130. 45. Romay, A., Kohlbrecher, S., Conner, D., Stumpf, A. and von Stryk, O. 2014. Template-Based Manipulation in Unstructured Environments for Supervised Semi-Autonomous Humanoid Robots. 2014 IEEE-RAS International Conference on Humanoid Robots. 46. Ronghao and Dong, 2014. Circumnavigation by A Mobile Robot Using Bearing Measurements. 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems. 47. Sha'abani M. N. A. H. and Miskon, M. F. 2011. The Effect of Anomaly Detection Accuracy in Varying the Angular Resolution of Sonar Using Repetitive Observation Strategy, 2011 IEEE Symposium on Industrial Electronics and Applications, pp. 669-674. 48. Shafii, N., Kasaei, S. and Lopes, L. 2016. Learning to Grasp Familiar Objects Using Object View Recognition and Template Matching. 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 49. Shames, I., Dasgupta, S., Fidan, B. and Anderson, B. 2012. Circumnavigation Using Distance Measurements Under Slow Drift. IEEE Transactions on Automatic Control, 57(4), pp.889-903. 50. Shen Q. J. 2016. Development and Analysis of Face Recognition System on A Mobile Robot Environment (Degree dissertation, Universiti Teknikal Malaysia Melaka). 51. Stentz, A. 1994. Optimal and Efficient Path Planning for Partially-Known Environments. IEEE International Conference on Robotics and Automation (IRCA), 94(1), pp. 3310-3317. 52. Stoican, F., Prodan, I. and Popescu, D. 2015. Flat Trajectory Generation for Way-Points Relaxations and Obstacle Avoidance. 2015 23rd Mediterranean Conference on Control and Automation (MED). 53. Tanaka, D., Matsubara, T., Ichien, K. and Sugimoto, K. 2014. Object Manifold Learning with Action Features for Active Tactile Object Recognition. 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems. 54. Vazquez, A., Torres, R., Adan, A. and Cerrada, C. 2006. Path Planning for Manipulation Environments Through Interpolated Walks. 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems. 55. Yong.K.Hwang, 1992. A Potential Field Approach to Path Planning, 1992 IEEE Transaction on Robotics and Automation, 8(1), pp. 23 – 32. 56. Zhu, H., Guan, Y., Wu, W., Zhou, X., Zhang, L., Zhang, X. and Zhang, H. 2011. The Superior Mobility and Function Of W-Climbing Robot; A Bio-Inspired Modular Biped Wall-Climbing Robot. 2011 IEEE International Conference on Robotics and Biomimetics. 57. Zuqiang, Y., Zhou, F. and Ping, L. 2015. A Bio-Inspired Collision-Free 4D Trajectory Generation Method for Unmanned Aerial Vehicles Based on Tau Theory. 2015 34th Chinese Control Conference (CCC).