Multifactor approach to prioritize event sequence test cases
Software testing consumes 40 to 70 percent of the development effort, time, and cost, especially for large software systems. Test Case Prioritization (TCP) is a method to prioritize and schedule test cases in order to run test cases of higher priority to minimize time, cost, and effort during the...
Saved in:
Main Author: | |
---|---|
Format: | Thesis |
Language: | English |
Published: |
2018
|
Subjects: | |
Online Access: | http://psasir.upm.edu.my/id/eprint/83409/4/FSKTM%202018%2083%20-%20ir.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my-upm-ir.83409 |
---|---|
record_format |
uketd_dc |
spelling |
my-upm-ir.834092022-01-06T04:13:21Z Multifactor approach to prioritize event sequence test cases 2018-12 Ahmad, Johanna Software testing consumes 40 to 70 percent of the development effort, time, and cost, especially for large software systems. Test Case Prioritization (TCP) is a method to prioritize and schedule test cases in order to run test cases of higher priority to minimize time, cost, and effort during the software testing phase. Numerous TCP techniques have been proposed with a variety of criteria and evaluation metrics. However, in the context of prioritizing the event sequences test cases, most researchers agree that testing the event sequences test cases is more complex than the single event test cases. Meanwhile, one of the most significant issues in TCP is how researchers handle the same priority value issues. Most researchers either applied the random technique or did not provide any information regarding the same priority value issues in their research. Due to that reason, this research proposed Multifactor Weighted Approach (MFWA) using six factors: complexity, redundancy, frequency, permutations, fault matrix, and distance to improve the existing TCP technique that used random technique to break the ties once the same priority value exists during the prioritization process. The aim of this research is to combine all six factors to produce a unique weight for each test case. The ordered suite will be based on the final test case weight. The test case that has the highest weight will be executed first compared to the others. The mutation testing approach is selected to compare and evaluate the random technique and MFWA technique. Both techniques will execute the same test suites and codes. The effectiveness of both techniques is measured in terms of the capability to detect faults using the Average Percentage Faults Detected (APFD). Meanwhile, the efficiency refers to how quickly each technique is capable of detecting faults by referring to the position of the test case that managed to kill all the live mutants. The Jaccard Distance approach was managed to solve same priority value by measuring the similarities of the data state value among test cases. The new ordering of test case after the implementation of Jaccard Distance approach has been proof can detect faults earlier than others based on the Fault Detection table. In fact, the empirical results indicated that the MFWA technique is more effective and efficient than the random technique. Computer software - Testing 2018-12 Thesis http://psasir.upm.edu.my/id/eprint/83409/ http://psasir.upm.edu.my/id/eprint/83409/4/FSKTM%202018%2083%20-%20ir.pdf text en public doctoral Universiti Putra Malaysia Computer software - Testing Baharom, Salmi |
institution |
Universiti Putra Malaysia |
collection |
PSAS Institutional Repository |
language |
English |
advisor |
Baharom, Salmi |
topic |
Computer software - Testing |
spellingShingle |
Computer software - Testing Ahmad, Johanna Multifactor approach to prioritize event sequence test cases |
description |
Software testing consumes 40 to 70 percent of the development effort, time, and cost,
especially for large software systems. Test Case Prioritization (TCP) is a method to
prioritize and schedule test cases in order to run test cases of higher priority to
minimize time, cost, and effort during the software testing phase. Numerous TCP
techniques have been proposed with a variety of criteria and evaluation metrics.
However, in the context of prioritizing the event sequences test cases, most researchers
agree that testing the event sequences test cases is more complex than the single event
test cases. Meanwhile, one of the most significant issues in TCP is how researchers
handle the same priority value issues. Most researchers either applied the random
technique or did not provide any information regarding the same priority value issues
in their research. Due to that reason, this research proposed Multifactor Weighted
Approach (MFWA) using six factors: complexity, redundancy, frequency,
permutations, fault matrix, and distance to improve the existing TCP technique that
used random technique to break the ties once the same priority value exists during the
prioritization process. The aim of this research is to combine all six factors to produce
a unique weight for each test case. The ordered suite will be based on the final test
case weight. The test case that has the highest weight will be executed first compared
to the others. The mutation testing approach is selected to compare and evaluate the
random technique and MFWA technique. Both techniques will execute the same test
suites and codes. The effectiveness of both techniques is measured in terms of the
capability to detect faults using the Average Percentage Faults Detected (APFD).
Meanwhile, the efficiency refers to how quickly each technique is capable of detecting
faults by referring to the position of the test case that managed to kill all the live
mutants. The Jaccard Distance approach was managed to solve same priority value by
measuring the similarities of the data state value among test cases. The new ordering
of test case after the implementation of Jaccard Distance approach has been proof can
detect faults earlier than others based on the Fault Detection table. In fact, the empirical results indicated that the MFWA technique is more effective and efficient
than the random technique. |
format |
Thesis |
qualification_level |
Doctorate |
author |
Ahmad, Johanna |
author_facet |
Ahmad, Johanna |
author_sort |
Ahmad, Johanna |
title |
Multifactor approach to prioritize event sequence test cases |
title_short |
Multifactor approach to prioritize event sequence test cases |
title_full |
Multifactor approach to prioritize event sequence test cases |
title_fullStr |
Multifactor approach to prioritize event sequence test cases |
title_full_unstemmed |
Multifactor approach to prioritize event sequence test cases |
title_sort |
multifactor approach to prioritize event sequence test cases |
granting_institution |
Universiti Putra Malaysia |
publishDate |
2018 |
url |
http://psasir.upm.edu.my/id/eprint/83409/4/FSKTM%202018%2083%20-%20ir.pdf |
_version_ |
1747813392838557696 |