Dynamic partitioning and data allocation method on heterogeneous architecture / Muhammad Helmi Rosli

In recent years, processing large data set to produce result in a timely manner poses a lot of challenges to ICT researchers. Currently most organization has an elaborate local network system whose computers are underutilized. These network form cluster of computing resources that simulates supercom...

Full description

Saved in:

Bibliographic Details
Main Author:	Rosli, Muhammad Helmi
Format:	Thesis
Language:	English
Published:	2015
Subjects:	Supercomputers High performance computing
Online Access:	https://ir.uitm.edu.my/id/eprint/15723/1/TM_MUHAMMAD%20HELMI%20ROSLI%20CS%2015_5.PDF
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my-uitm-ir.15723
record_format	uketd_dc
spelling	my-uitm-ir.157232022-03-10T00:24:45Z Dynamic partitioning and data allocation method on heterogeneous architecture / Muhammad Helmi Rosli 2015 Rosli, Muhammad Helmi Supercomputers. High performance computing In recent years, processing large data set to produce result in a timely manner poses a lot of challenges to ICT researchers. Currently most organization has an elaborate local network system whose computers are underutilized. These network form cluster of computing resources that simulates supercomputer. Processing images are computationally complex due to its data and task intensive nature. This can be solved by parallelizing the process in cluster environment. Most cluster environment have a variety of computer hardware specification namely heterogeneous environment.Optimizing the resources in heterogeneous environment during parallel processing is not a simple task. These involves partitioning and allocating task to each cluster node.The aim of these research is to investigate various method of partitioning and allocating task in cluster environment and produce a dynamic partitioning and allocating method. Initial stage of the research consist of exploring the heuristic performance of cluster and multi-threading involving five experiments; homogeneous architecture with node partitioning; heterogeneous architecture with node partitioning; heterogeneous architecture with node partitioning including multi-threading; heterogeneous architecture with node and core partitioning; heterogeneous architecture with node and core partitioning including multi-threading.The performances use sequential processing speed as a benchmark. Each experiment highlight the advantages and disadvantages of the experimental architecture.The disadvantages from each experiment prompts the design of dynamic parallel partitioning and allocating framework. The case study use for this experiment is Sobel edge detection algorithm. The test data set focuses on processing images of three different sizes; (IK x IK), (2K x 2K) and (3K x 3K). The performance evaluation is based on the processing speed in second, speedup, and efficiency. In conclusion, it is found that in idle situation heterogeneous architecture with node and core partitioning including multi-threading perform better from other experiment. However, in real working condition where some computer are serving users processes, the dynamic algorithm provides a potential alternative. 2015 Thesis https://ir.uitm.edu.my/id/eprint/15723/ https://ir.uitm.edu.my/id/eprint/15723/1/TM_MUHAMMAD%20HELMI%20ROSLI%20CS%2015_5.PDF text en public mphil masters Universiti Teknologi MARA Perpustakaan Tun Abdul Razak
institution	Universiti Teknologi MARA
collection	UiTM Institutional Repository
language	English
topic	Supercomputers High performance computing
spellingShingle	Supercomputers High performance computing Rosli, Muhammad Helmi Dynamic partitioning and data allocation method on heterogeneous architecture / Muhammad Helmi Rosli
description	In recent years, processing large data set to produce result in a timely manner poses a lot of challenges to ICT researchers. Currently most organization has an elaborate local network system whose computers are underutilized. These network form cluster of computing resources that simulates supercomputer. Processing images are computationally complex due to its data and task intensive nature. This can be solved by parallelizing the process in cluster environment. Most cluster environment have a variety of computer hardware specification namely heterogeneous environment.Optimizing the resources in heterogeneous environment during parallel processing is not a simple task. These involves partitioning and allocating task to each cluster node.The aim of these research is to investigate various method of partitioning and allocating task in cluster environment and produce a dynamic partitioning and allocating method. Initial stage of the research consist of exploring the heuristic performance of cluster and multi-threading involving five experiments; homogeneous architecture with node partitioning; heterogeneous architecture with node partitioning; heterogeneous architecture with node partitioning including multi-threading; heterogeneous architecture with node and core partitioning; heterogeneous architecture with node and core partitioning including multi-threading.The performances use sequential processing speed as a benchmark. Each experiment highlight the advantages and disadvantages of the experimental architecture.The disadvantages from each experiment prompts the design of dynamic parallel partitioning and allocating framework. The case study use for this experiment is Sobel edge detection algorithm. The test data set focuses on processing images of three different sizes; (IK x IK), (2K x 2K) and (3K x 3K). The performance evaluation is based on the processing speed in second, speedup, and efficiency. In conclusion, it is found that in idle situation heterogeneous architecture with node and core partitioning including multi-threading perform better from other experiment. However, in real working condition where some computer are serving users processes, the dynamic algorithm provides a potential alternative.
format	Thesis
qualification_name	Master of Philosophy (M.Phil.)
qualification_level	Master's degree
author	Rosli, Muhammad Helmi
author_facet	Rosli, Muhammad Helmi
author_sort	Rosli, Muhammad Helmi
title	Dynamic partitioning and data allocation method on heterogeneous architecture / Muhammad Helmi Rosli
title_short	Dynamic partitioning and data allocation method on heterogeneous architecture / Muhammad Helmi Rosli
title_full	Dynamic partitioning and data allocation method on heterogeneous architecture / Muhammad Helmi Rosli
title_fullStr	Dynamic partitioning and data allocation method on heterogeneous architecture / Muhammad Helmi Rosli
title_full_unstemmed	Dynamic partitioning and data allocation method on heterogeneous architecture / Muhammad Helmi Rosli
title_sort	dynamic partitioning and data allocation method on heterogeneous architecture / muhammad helmi rosli
granting_institution	Universiti Teknologi MARA
granting_department	Perpustakaan Tun Abdul Razak
publishDate	2015
url	https://ir.uitm.edu.my/id/eprint/15723/1/TM_MUHAMMAD%20HELMI%20ROSLI%20CS%2015_5.PDF
_version_	1783733446729793536

Dynamic partitioning and data allocation method on heterogeneous architecture / Muhammad Helmi Rosli

Similar Items