A selection framework for software programmer applicants based on multi-criteria analysis

This research aimed to propose a framework based on the multi-criteria analysis to aiddecision-makers in selecting suitable software programmer applicants. In this study, an experimentwas conducted on the basis of several stages. First, decision matrix was proposed for selectingsuitable programming...

Full description

Saved in:
Bibliographic Details
Main Author: Fayiz Mohad Said Hamed Momani
Format: thesis
Language:eng
Published: 2019
Subjects:
Online Access:https://ir.upsi.edu.my/detailsg.php?det=6167
Tags: Add Tag
No Tags, Be the first to tag this record!
id oai:ir.upsi.edu.my:6167
record_format uketd_dc
institution Universiti Pendidikan Sultan Idris
collection UPSI Digital Repository
language eng
topic QA Mathematics
spellingShingle QA Mathematics
Fayiz Mohad Said Hamed Momani
A selection framework for software programmer applicants based on multi-criteria analysis
description This research aimed to propose a framework based on the multi-criteria analysis to aiddecision-makers in selecting suitable software programmer applicants. In this study, an experimentwas conducted on the basis of several stages. First, decision matrix was proposed for selectingsuitable programming applicants based on multi-measurement criteria (structured programming, object-oriented programming, data structure, database system, and courseware engineering),with each criterion comprising two sub- criteria (GPA and Soft skills). In addition, anumber of alternatives were generated based on the intersection of the criteria of theapplicants. Then, the proposed decision matrix was developed by distributing the courses based onthe Software Engineering Body of Knowledge (SWEBOK) standard and expert opinions.Subsequently, the ranking of the applicants was performed by the developed decision matrix usingMulti- Criteria Decision Making (MCDM) techniques, namely the integrated AnalyticHierarchy Process (AHP), to weight the multi-measurement criteria, and the Technique for OrderPreference by Similarity to Ideal Solution (TOPSIS) was used to rank the alternatives. Dataconsisting of five main courses as the required criteria were collected from 60 softwareengineering students, who had graduated from Universiti Pendidikan Sultan Idris (UPSI) in 2016. Theresearch findings showed that the integration of Multi- Layer AHP and Group-TOPSIS was effective insolving the problems associated with the selection of applicants, as evidenced by the systematicranking of the 60 students. In conclusion, the internal and external aggregations of Group-TOPSISused in different contexts were able to generate the results of students ranking thatwere similar. Furthermore, the validated ranking results showed four groups of students have beenequally and systematically ranked. The implication of the study is that the programmer could usesuch a novel framework to improve the quality of software and to reduce thetime and cost in the selection process of applicants.
format thesis
qualification_name
qualification_level Doctorate
author Fayiz Mohad Said Hamed Momani
author_facet Fayiz Mohad Said Hamed Momani
author_sort Fayiz Mohad Said Hamed Momani
title A selection framework for software programmer applicants based on multi-criteria analysis
title_short A selection framework for software programmer applicants based on multi-criteria analysis
title_full A selection framework for software programmer applicants based on multi-criteria analysis
title_fullStr A selection framework for software programmer applicants based on multi-criteria analysis
title_full_unstemmed A selection framework for software programmer applicants based on multi-criteria analysis
title_sort selection framework for software programmer applicants based on multi-criteria analysis
granting_institution Universiti Pendidikan Sultan Idris
granting_department Fakulti Seni, Komputeran dan Industri Kreatif
publishDate 2019
url https://ir.upsi.edu.my/detailsg.php?det=6167
_version_ 1747833248225951744
spelling oai:ir.upsi.edu.my:61672021-08-13 A selection framework for software programmer applicants based on multi-criteria analysis 2019 Fayiz Mohad Said Hamed Momani QA Mathematics This research aimed to propose a framework based on the multi-criteria analysis to aiddecision-makers in selecting suitable software programmer applicants. In this study, an experimentwas conducted on the basis of several stages. First, decision matrix was proposed for selectingsuitable programming applicants based on multi-measurement criteria (structured programming, object-oriented programming, data structure, database system, and courseware engineering),with each criterion comprising two sub- criteria (GPA and Soft skills). In addition, anumber of alternatives were generated based on the intersection of the criteria of theapplicants. Then, the proposed decision matrix was developed by distributing the courses based onthe Software Engineering Body of Knowledge (SWEBOK) standard and expert opinions.Subsequently, the ranking of the applicants was performed by the developed decision matrix usingMulti- Criteria Decision Making (MCDM) techniques, namely the integrated AnalyticHierarchy Process (AHP), to weight the multi-measurement criteria, and the Technique for OrderPreference by Similarity to Ideal Solution (TOPSIS) was used to rank the alternatives. Dataconsisting of five main courses as the required criteria were collected from 60 softwareengineering students, who had graduated from Universiti Pendidikan Sultan Idris (UPSI) in 2016. Theresearch findings showed that the integration of Multi- Layer AHP and Group-TOPSIS was effective insolving the problems associated with the selection of applicants, as evidenced by the systematicranking of the 60 students. In conclusion, the internal and external aggregations of Group-TOPSISused in different contexts were able to generate the results of students ranking thatwere similar. Furthermore, the validated ranking results showed four groups of students have beenequally and systematically ranked. The implication of the study is that the programmer could usesuch a novel framework to improve the quality of software and to reduce thetime and cost in the selection process of applicants. 2019 thesis https://ir.upsi.edu.my/detailsg.php?det=6167 https://ir.upsi.edu.my/detailsg.php?det=6167 text eng closedAccess Doctoral Universiti Pendidikan Sultan Idris Fakulti Seni, Komputeran dan Industri Kreatif Abdeljaber, H. A., & Ahmad, S. (2017). Program Outcomes Assessment Method forMulti-Academic Accreditation Bodies: Computer Science Program as a Case Study. InternationalJournal of Emerging Technologies in Learning, 12(5).Abdullah, S. A., Yaakub, A., & Wahil, Z. (2015). Evaluating Students Need in Using Computer AidedSoftware in Landscape Design Course. Procedia-Social and Behavioral Sciences, 195, 828-836.Abdullateef, B. N., Elias, N. F., Mohamed, H., Zaidan, A., & Zaidan, B. (2016). An evaluation andselection problems of OSS-LMS packages. SpringerPlus, 5(1), 248.Abran, A., Moore, J. W., Bourque, P., Dupuis, R., & Tripp, L. (2004). Softwareengineering body of knowledge. IEEE Computer Society, Angela Burgess.Adams, N. E. (2015). Blooms taxonomy of cognitive learning objectives. Journal of the MedicalLibrary Association: JMLA, 103(3), 152.Addo-Atuah, J., Dutta, A., & Kovera, C. (2014). A global health elective course in a PharmDcurriculum. American journal of pharmaceutical education, 78(10), 187.Aggarwal, R. (2013). Selection of IT Personnel through Hybrid Multi-attribute AHP- FLP approach.International Journal of Soft Computing and Engineering, 2(6), 11-17.Ahmadi, H., Nilashi, M., & Ibrahim, O. (2015). Organizational decision to adopt hospital information system: An empirical investigation in the case of Malaysian publichospitals. International journal of medical informatics, 84(3), 166-188.Ahn, H., & Kim, H.-Y. (2015). Implementation and outcome evaluation of high-fidelity simulationscenarios to integrate cognitive and psychomotor skills for Korean nursing students. Nurseeducation today, 35(5), 706-711.Al-Mohrej, A., & Agha, S. (2016). Are Saudi medical students aware of middle east respiratorysyndrome coronavirus during an outbreak? Journal of infection and public health.Alarifi, A., Zarour, M., Alomar, N., Alshaikh, Z., & Alsaleh, M. (2016). SECDEP:Software engineering curricula development and evaluation process usingSWEBOK. Information and Software Technology, 74, 114-126.Aldlaigan, A. H., & Buttle, F. A. (2002). SYSTRA-SQ: a new measure of bank servicequality. International Journal of Service Industry Management, 13(4), 362-381.Altunok, T., zpeynirci, ., Kazano?lu, Y., & Y?lmaz, R. (2010). Comparative analysisof multicriteria decision making methods for postgraduate student selection.Armstrong, P. (2016). Blooms taxonomy. Vanderbilt University Center for Teaching. Arndt, T.(2018). Big Data and software engineering: prospects for mutual enrichment.Iran Journal of Computer Science, 1(1), 3-10.Aruldoss, M., Lakshmi, T. M., & Venkatesan, V. P. (2013). A survey on multi criteria decisionmaking methods and its applications. American Journal of Information Systems, 1(1), 31-43.Bakarman, A. A. (2011). Attitude, skill, and knowledge:(ASK) a new model for design education.Proceedings of the Canadian Engineering Education Association.Ball, L. S., & Kilger, L. (2016). Analyzing Nursing Student Learning Over Time in Simulation.Nursing Education Perspectives, 37(6), 328-330.Baltussen, R., & Niessen, L. (2006). Priority setting of health interventions: the need formulti-criteria decision analysis. Cost effectiveness and resource allocation, 4(1), 1.Baneres, D. (2016). Towards a particular prediction system to evaluate students success.Paper presented at the International Conference on P2P, Parallel, Grid, Cloud and InternetComputing.Banerjee, S., Ramanathan, C., & Rao, N. (2015). An approach to automatic evaluation of highercognitive levels assessment items. Paper presented at the MOOCs, Innovation and Technologyin Education (MITE), 2015 IEEE 3rd International Conference on.Barlybayev, A., Sharipbay, A., Ulyukova, G., Sabyrov, T., & Kuzenbayev, B. (2016). Student'sPerformance Evaluation by Fuzzy Logic. Procedia Computer Science, 102, 98-105.Barrios, M. A. O., De Felice, F., Negrete, K. P., Romero, B. A., Arenas, A. Y., &Petrillo, A. (2016). An AHP-topsis integrated model for selecting the most appropriate tomography equipment. International Journal of Information Technology & Decision Making,15(04), 861-885.Baumann-Birkbeck, L., Karaksha, A., Anoopkumar-Dukie, S., Grant, G., Davey, A.,Nirthanan, S., & Owen, S. (2015). Benefits of e-learning in chemotherapypharmacology education. Currents in Pharmacy Teaching and Learning, 7(1),106-111.Behnaz, F., Mohammadzade, G., & Mohammadzadeh, M. (2014). Assessment ofknowledge, attitudes and practices regarding tuberculosis among final year students inYazd, central Iran. Journal of epidemiology and global health, 4(2), 81-85.Behzadian, M., Otaghsara, S. K., Yazdani, M., & Ignatius, J. (2012). A state-of the-art survey ofTOPSIS applications. Expert systems with applications, 39(17), 13051-13069.Beikkhakhian, Y., Javanmardi, M., Karbasian, M., & Khayambashi, B. (2015). The applicationof ISM model in evaluating agile suppliers selection criteria and ranking suppliersusing fuzzy TOPSIS-AHP methods. Expert systems with applications, 42(15-16), 6224-6236.Belton, V., & Stewart, T. (2002). Multiple criteria decision analysis: an integratedapproachKluwer Academic Publishers: Boston.Bennett, C. (2016). Assessment rubrics: thinking inside the boxes. Learning and Teaching,9(1), 50-72.Blackwell, A. F. (2002). First steps in programming: A rationale for attentioninvestment models. Paper presented at the Human Centric Computing Languages andEnvironments, 2002. Proceedings. IEEE 2002 Symposia on.Blanco-Pieiro, P., Daz-Pereira, M. P., & Martnez, A. (2015). Common postural defectsamong music students. Journal of bodywork and movement therapies, 19(3), 565-572.Blazek, M., Bess, J., Hirshbein, L., Chiang, C., Sastry, D., & Ravindranath, D. (2014). TheShort-Answer Vignette Examination (SAVE): an assessment tool for the core psychiatry clerkship.Academic Psychiatry, 38(5), 615-618.Boles, W. W., Goncher, A., & Jayalath, D. (2015). Categorising conceptual assessments under theframework of blooms taxonomy.Bourque, P., & Fairley, R. E. (2014). Guide to the software engineering body ofknowledge (SWEBOK (R)): Version 3.0: IEEE Computer Society Press.Buede, D. M., & Miller, W. D. (2016). The engineering design of systems: models andmethods: John Wiley & Sons.Burke, Q., Bailey, C., Lyon, L. A., & Greeen, E. (2018). Understanding the SoftwareDevelopment Industry's Perspective on Coding Boot Camps versus Traditional 4-year Colleges. Paperpresented at the Proceedings of the 49th ACM Technical Symposium on Computer Science Education.Butler, K. L., Hirsh, D. A., Petrusa, E. R., Yeh, D. D., Stearns, D., Sloane, D. E., . . . de Moya,M. A. (2017). Surgery clerkship evaluations are insufficient for clinical skills appraisal: thevalue of a medical student surgical objective structured clinical examination. Journal ofsurgical education, 74(2), 286-294.Cain, A. (2013). Developing assessment criteria for portfolio assessed introductoryprogramming. Paper presented at the Teaching, Assessment and Learning for Engineering (TALE), 2013IEEE International Conference on.al??kan, H. (2013). Selection of boron based tribological hard coatings using multi- criteriadecision making methods. Materials & Design, 50, 742-749.Campbell, S. H., Pagano, M. P., O'Shea, E. R., Connery, C., & Caron, C. (2013).Development of the Health Communication Assessment Tool: Enhancing relationships,empowerment, and power-sharing skills. Clinical Simulation in Nursing, 9(11), e543-e550.Carrion, C., Soler, M., & Aymerich, M. (2013). Association of professional training evaluation tocontent evaluation. Procedia-Social and Behavioral Sciences, 93, 1911-1915.Carrion, C., Soler, M., & Aymerich, M. (2014). Professionalism Evaluation in Medical Students.Procedia-Social and Behavioral Sciences, 116, 1880-1884.Carroll, D. (2013). Business students attitudes to criteria based self-assessment andself-efficacy. Paper presented at the ASCILITE-Australian Society for Computers inLearning in Tertiary Education Annual Conference.Carter, A. G., Creedy, D. K., & Sidebotham, M. (2016). Development and psychometric testing of the Carter Assessment of Critical Thinking in Midwifery (Preceptor/Mentor version).Midwifery, 34, 141-149.Carter, L. (2011). Ideas for adding soft skills education to service learning and capstone coursesfor computer science students. Paper presented at the Proceedings of the 42nd ACM technicalsymposium on Computer science education.Casey, M., Wilkinson, D., Fitzgerald, J., Eley, D., & Connor, J. (2014). Clinicalcommunication skills learning outcomes among first year medical students are consistentirrespective of participation in an interview for admission to medicalschool. Medical teacher, 36(7), 640-642.Chakraborty, B., & Sinha, M. (2016). STUDENT EVALUATION MODEL USINGBAYESIAN NETWORK IN AN INTELLIGENT E-LEARNING SYSTEM.Journal of Institute of Integrative Omics and Applied Biotechnology (IIOAB), 7, 2.Chandrasekaran, S., Long, J. M., & Joordens, M. A. (2015). Evaluation of studentlearning outcomes in fourth year engineering mechatronics through design based learningcurriculum. Paper presented at the Frontiers in Education Conference (FIE), 2015 IEEE.Chao, S.-Y., Liu, H.-Y., Wu, M.-C., Clark, M. J., & Tan, J.-Y. (2013). Identifyingcritical thinking indicators and critical thinker attributes in nursing practice. Journalof Nursing Research, 21(3), 204-210.Chen, H.-J., She, J.-L., Chou, C.-C., Tsai, Y.-M., & Chiu, M.-H. (2013). Development andapplication of a scoring rubric for evaluating students experimental skills in organic chemistry:An instructional guide for teaching assistants. Journal of Chemical Education, 90(10), 1296-1302.Chen, J.-K., & Chen, I.-S. (2010). Using a novel conjunctive MCDM approach based on DEMATEL, fuzzyANP, and TOPSIS as an innovation support system for Taiwanese higher education. Expert Systemswith Applications, 37(3), 1981- 1990.Chen, S.-M., & Lee, L.-W. (2010). Fuzzy multiple attributes group decision-making based on theinterval type-2 TOPSIS method. Expert systems with applications, 37(4), 2790-2798.Chen, Y., Pan, C.-C., Yang, G.-K., & Bai, J. (2014). Intelligent decision system for accessing academic performance of candidates for early admission to university. Paperpresented at the Natural Computation (ICNC), 2014 10th International Conference on.Chen, Y.-C., Kiersma, M. E., & Abdelmageed, A. (2015). Evaluation of student perceptionsof standardized patient simulation on patient counseling confidence during introductory pharmacypractice experiences. Currents in Pharmacy Teaching and Learning, 7(6), 811-818.Chheda, S., Carver, K., & Ashok, R. (2016). Energy-focused compiler-assisted branch prediction:Google Patents.Clark, C. A. (2015). Evaluating nurse practitioner students through objective structuredclinical examination. Nursing Education Perspectives, 36(1), 53-54.Cockerham, M. E. (2015). Effect of faculty training on improving the consistency ofstudent assessment and debriefing in clinical simulation. Clinical Simulation in Nursing, 11(1),64-71.Crosthwaite, P., Boynton, S., & Cole, S. (2017). Exploring rater conceptions of academicstance and engagement during group tutorial discussion assessment. Journal of English for AcademicPurposes, 28, 1-13.Daif, A. R., & Rizkaa, M. A. (2013). An enhanced model for monitoring learners'performance in a collaborative e-Learning environment. Paper presented at the e-Learning and e-Technologies in Education (ICEEE), 2013 Second International Conference on.Daly, M., Salamonson, Y., Glew, P. J., & Everett, B. (2016). Hawks and doves: The influence ofnurse assessor stringency and leniency on pass grades in clinical skills assessments. Collegian.Damaj, I., & Yousafzai, J. (2016). Simple and accurate student outcomes assessment: A unifiedapproach using senior computer engineering design experiences. Paper presented at the GlobalEngineering Education Conference (EDUCON), 2016 IEEE.Dance, B., Davis, E., Fagerheim, B., Hedrich, A., Lundstrom, K., Martin, P., &Holliday, W. (2015). An information literacy snapshot: Authentic assessment across the curriculum.College & Research Libraries, 76(2), 170-187.DeGeeter, M., Taylor, S. R., Wilson, J. A., Rodgers, P. T., & Leadon, K. I. (2016). Student pharmacist perceptions of therapeutic lifestyle change (TLC) counseling abilities andpersonal health status. Currents in Pharmacy Teaching and Learning, 8(6), 750-756.Deliktas, D., & Ustun, O. (2015). Student selection and assignment methodology based on fuzzyMULTIMOORA and multichoice goal programming. International Transactions in OperationalResearch.Deni, W., Sudana, O., & Sasmita, A. (2013). Analysis and implementation fuzzy multi- attributedecision making SAW method for selection of high achieving students in faculty level.International Journal of Computer Science Issues (IJCSI), 10(1), 674.DiDonato, K. L., Ruehter, V. L., Odum, L. E., Brownfield, A. M., & Lindsey, C. C. (2013). Assessingstudent confidence and understanding with the immunization process through implementation of animmunization protocol at a school ofpharmacy. Currents in Pharmacy Teaching and Learning, 5(5), 417-423.Dolan, J. G., Boohaker, E., Allison, J., & Imperiale, T. F. (2013). Patients preferences andpriorities regarding colorectal cancer screening. Medical Decision Making, 33(1), 59-70.Dray, B. J., Lowenthal, P. R., Miszkiewicz, M. J., Ruiz?Primo, M. A., & Marczynski,K. (2011). Developing an instrument to assess student readiness for online learning: Avalidation study. Distance Education, 32(1), 29-47.Dubosh, N. M., Fisher, J., Lewis, J., & Ullman, E. A. (2017). Faculty EvaluationsCorrelate Poorly with Medical Student Examination Performance in a Fourth- Year Emergency MedicineClerkship. The Journal of emergency medicine.Duke, J. M., & Aull-Hyde, R. (2002). Identifying public preferences for landpreservation using the analytic hierarchy process. Ecological Economics, 42(1), 131-145.Durning, S. J., Dong, T., Hemmer, P. A., Gilliland, W. R., Cruess, D. F., Boulet, J. R., & Pangaro,L. N. (2015). Are commonly used premedical school or medical school measures associated withboard certification? Military medicine, 180(4S), 18-23.El Sayed, K. A., & Chelette, C. T. (2014). Laboratory exercises to teach clinicallyrelevant chemistry of antibiotics. American journal of pharmaceutical education,78(2), 37.Elkins, K. M., & Murphy, K. L. (2016). Use of the Online Version of an ACS General Chemistry Exam:Evaluation of Student Performance and Impact on the Final Exam Technology and Assessment Strategiesfor Improving Student Learning in Chemistry (pp. 211-223): ACS Publications.Elliott, A. M. (2017). Identifying Professional Values in Nursing: An Integrative Review.Teaching and Learning in Nursing.Epstein, M. J., Buhovac, A. R., & Yuthas, K. (2010). Implementing sustainability: The role ofleadership and organizational culture. Strategic finance, 91(10), 41.Ezechil, L. (2013). New perspectives on evaluation and certifying the competences of highereducation graduates. Procedia-Social and Behavioral Sciences, 76, 7-12.Fairley, R. (2014). A Software E ngineering Competency Model (SWECOM). IEEE Computer Society.Faiz, M. M. U., Mansoor, U. B., Asad, S. M., & Mahmood, K. (2014). Using faculty course assessmentreport for the assessment of an associate degree course in engineering technology program. Paperpresented at the Engineering Education), 2014 IEEE 6th Conference on.Falk, K., Falk, H., & Ung, E. J. (2016). When practice precedes theoryA mixedmethods evaluation of students' learning experiences in an undergraduate study program in nursing.Nurse education in practice, 16(1), 14-19.Farland, M. Z., Barlow, P. B., Levi Lancaster, T., & Franks, A. S. (2015). Comparison ofanswer-until-correct and full-credit assessments in a team-based learning course. Americanjournal of pharmaceutical education, 79(2), 21.Farland, M. Z., Franks, A. S., Barlow, P. B., Rowe, A. S., & Chisholm-Burns, M.(2015). Assessment of student learning patterns, performance, and long-term knowledge retentionfollowing use of didactic lecture compared to team-based learning. Currents in Pharmacy Teachingand Learning, 7(3), 317-323.Fauzi, S. N. F. M. (2013). Students Performance in Practical Training: Academicians Evaluation.Procedia-Social and Behavioral Sciences, 93, 1275-1280.Felemban, S., Gardner, M., & Callaghan, V. (2016). An event detection approach for identifyinglearning evidence in collaborative virtual environments. Paper presented at the ComputerScience and Electronic Engineering (CEEC), 2016 8th.Fonseca, D., Villagrasa, S., Vails, F., Redondo, E., Climent, A., & Vicent, L. (2014). Engineeringteaching methods using hybrid technologies based on the motivation and assessment ofstudent's profiles. Paper presented at the Frontiers in Education Conference (FIE), 2014 IEEE.Galal, S. M., Lai, P., Go, C., Patel, R. A., Gundersen, B., Carr-Lopez, S. M., & Woelfel,J. A. (2017). Assessing student knowledge, confidence, accuracy, and proficiencyin providing Medicare Part D assistance. Currents in Pharmacy Teaching and Learning, 9(2),272-281.Garca, A. S., Garca-lvarez, M. T., & Moreno, B. (2014). Analysis of assessment opportunities oflearning spaces: On-line versus face to face methodologies. Computers in Human Behavior,30, 372-377.Gbanie, S. P., Tengbe, P. B., Momoh, J. S., Medo, J., & Kabba, V. T. S. (2013).Modelling landfill location using geographic information systems (GIS) and multi-criteriadecision analysis (MCDA): case study Bo, Southern Sierra Leone. Applied Geography, 36, 3-12.George, N. M., Drahnak, D. M., Schroeder, D. L., & Katrancha, E. D. (2016). EnhancingPrelicensure Nursing Students' Use of an Electronic Health Record.Clinical Simulation in Nursing, 12(5), 152-158.Gibb, S. (2014). Soft skills assessment: theory development and the research agenda.International journal of lifelong education, 33(4), 455-471.Giddens, J. F., Lauzon-Clabo, L., Morton, P. G., Jeffries, P., McQuade-Jones, B., & Ryan, S.(2014). Re-envisioning clinical education for nurse practitioner programs: themes from anational leaders' dialogue. Journal of Professional Nursing, 30(3), 273-278.Gilal, A. R., Jaafar, J., Abro, A., Umrani, W. A., Basri, S., & Omar, M. (2017). Making ProgrammerEffective for Software Development Teams: An Extended Study. Journal of Information Science andEngineering, 33(6), 1447-1463.Godfrey, B., AVNER, L. I., LIU, C. C., TANABE, D., SIMMONS, J. L., ZELINKA,M., . . . NELSON, J. (2000). Emergency Medical Guidelines, Third Edit. Sunshine Act ofFlorida. p.245.Gonzlez-Marcos, A., Alba-Elas, F., Navaridas-Nalda, F., & Ordieres-Mer, J. (2016). Studentevaluation of a virtual experience for project management learning: An empirical study for learningimprovement. Computers & Education, 102, 172- 187.Gurupur, V. P., Jain, G. P., & Rudraraju, R. (2015). Evaluating student learning using conceptmaps and Markov chains. Expert systems with applications, 42(7), 3306-3314.Ha, E.-H. (2016). Undergraduate nursing students' subjective attitudes to curriculum forSimulation-based objective structured clinical examination. Nurse education today, 36, 11-17.Hambach, J., Diezemann, C., Tisch, M., & Metternich, J. (2016). Assessment of StudentsLean Competencies with the Help of Behavior Video AnalysisAre Good Students Better ProblemSolvers? Procedia CIRP, 55, 230-235.Hamidi, S., Shaffiei, Z., Sarif, S., & Ashar, N. (2013). Exploratory study of assessment inteaching and learning. Paper presented at the Research and Innovation in Information Systems(ICRIIS), 2013 International Conference on.Hanselin, M. R., Martell, C. W., Knutsen, S., Haight, R. C., & Moote, R. (2016).Development of a capstone course to improve student confidence andpharmacotherapy knowledge prior to advanced pharmacy practice experiences. Currents in PharmacyTeaching and Learning, 8(3), 323-331.Haralambopoulos, D., & Polatidis, H. (2003). Renewable energy projects: structuring amulti-criteria group decision-making framework. Renewable energy, 28(6),961-973.Harper, C. (2015). Organizations: Structures, processes and outcomes: Routledge.Hasan, S., AlSabbagh, R., AlHumaidi, R., AlMallah, M., & Khan, F. (2016). Objective StructuredClinical Examination (OSCE) in assessing pharmacy students competence of asthma managementin English and Arabic languages. Pharmacy Education, 16.Hassan, C. N. (2015). An Evaluation of Soft Skills Development of a Degree Programme in a PublicHigher Education Institution. Universiti Sains Malaysia.Hassanien, M. A., Al-Hayani, A., Abu-Kamer, R., & Almazrooa, A. (2013). A six step approach fordeveloping computer based assessment in medical education. Medical teacher, 35(sup1),S15-S19.Hatcliff, J., Wassyng, A., Kelly, T., Comar, C., & Jones, P. (2014). Certifiably safesoftware-dependent systems: challenges and directions. Paper presented at the Proceedings of the onFuture of Software Engineering.He, P. (2012). Evaluating students online discussion performance by using social networkanalysis. Paper presented at the Information Technology: New Generations (ITNG),2012 Ninth International Conference on.Heflin, H., Shewmaker, J., & Nguyen, J. (2017). Impact of mobile technology on studentattitudes, engagement, and learning. Computers & Education, 107, 91- 99.Helminen, K., Coco, K., Johnson, M., Turunen, H., & Tossavainen, K. (2016). Summativeassessment of clinical practice of student nurses: A review of the literature. Internationaljournal of nursing studies, 53, 308-319.Herath, G., & Prato, T. (2006). Using multi-criteria decision analysis in naturalresource management: Ashgate Publishing, Ltd.Hernick, M., Hylton, A. C., & Justice, M. (2016). A process for curricular improvement based on evaluation of student performance on milestone examinations. American journal ofpharmaceutical education, 80(9), 159.Hilgerink, M. P., Hummel, M. J., Manohar, S., Vaartjes, S. R., & IJzerman, M. J.(2011). Assessment of the added value of the Twente Photoacoustic Mammoscope inbreast cancer diagnosis. Medical devices (Auckland, NZ), 4, 107.Hill, A. E., Davidson, B. J., McAllister, S., Wright, J., & Theodoros, D. G. (2014).Assessment of student competency in a simulated speech-language pathologyclinical placement. International journal of speech-language pathology, 16(5),464-475.Hiller, K. M., Waterbrook, A., & Waters, K. (2016). Timing of Emergency MedicineStudent Evaluation Does Not Affect Scoring. The Journal of emergency medicine, 50(2),302-307.Him, N. R. N., Hamzah, F., Manaf, S. F. A., & Anuar, N. (2015). Chemical Engineering studentssoft-skills in Integrated Project (IP) Part 4. Paper presented at the EngineeringEducation (ICEED), 2015 IEEE 7th International Conference on.Hirsch, A. C., & Parihar, H. S. (2014). A capstone course with a comprehensive and integratedreview of the pharmacy curriculum and student assessment as a preparation for advancedpharmacy practice experiences. American journal of pharmaceutical education, 78(10), 192.Ho, D. W., Whitehill, T. L., & Ciocca, V. (2014). Performance of speech-languagepathology students in problem-based learning tutorials and in clinical practice. Clinicallinguistics & phonetics, 28(1-2), 102-116.Hoda, R., & Murugesan, L. K. (2016). Multi-level agile project managementchallenges: A self-organizing team perspective. Journal of Systems and Software,117, 245-257.Holmes, N., Ives, J., & Bonn, D. (2014). The impact of targeting scientific reasoning on studentattitudes about experimental physics. Paper presented at the 2014 Physics Education ResearchConference Proceedings.Hu, Y.-H., Lo, C.-L., & Shih, S.-P. (2014). Developing early warning systems to predict studentsonline learning performance. Computers in Human Behavior, 36, 469- 478.Hugill, A., & Yang, H. (2013). The creative turn: new challenges for computing.International Journal of Creative Computing, 1(1), 4-19.Hummel, M. J., Volz, F., van Manen, J. G., Danner, M., Dintsios, C.-M., IJzerman, M. J., & Gerber,A. (2012). Using the analytic hierarchy process to elicit patient preferences. The Patient:Patient-Centered Outcomes Research, 5(4), 225-237.Hurrell, S. A. (2016). Rethinking the soft skills deficit blame game: Employers, skills withdrawaland the reporting of soft skills gaps. Human Relations, 69(3), 605- 628.Ibrahim, F. M., Aziz, A. A., Zubairi, Y. Z., & Zaharim, A. (2012). Using the Rasch model to assessexamination Beyond students' scores. Paper presented at theGlobal Engineering Education Conference (EDUCON), 2012 IEEE.Ibrahim, F. M., Shariff, A. A., & Tahir, R. M. (2015). Using Rasch model to analyzethe ability of pre-university students in vector. Paper presented at the AIP ConferenceProceedings.Ingoley, S. N., & Bakal, J. W. (2013a). Evaluating students' performance using four- node fuzzycontroller. Paper presented at the Engineering (NUiCONE), 2013 Nirma University InternationalConference on.Ingoley, S. N., & Bakal, J. W. (2013b). A novel method for inferring strict and lenient marks intonormal marks using fuzzy logic. Paper presented at the Engineering (NUiCONE), 2013 Nirma UniversityInternational Conference on.Ingram, S., Cicek, J. S., & Sepehri, N. (2012). The Attribute assessment process at the Universityof Manitoba. Proceedings of the Canadian Engineering Education Association.Ito, M., Naoe, N., Imazawa, A., & Matsushita, O. (2015). Introduction of adaptingdesign thinking into the education in Kanazawa Technical College. Paper presented at theEngineering Education (ICEED), 2015 IEEE 7th International Conference on.Jackson, H., Tarhini, K., Zelmanowitz, S., & Hatfield, C. (2012). Developing a simple and effectivemethod of assessing Civil Engineering student outcomes. Paper presented at the Frontiers inEducation Conference (FIE), 2012.Jadhav, A., & Sonar, R. (2009). Analytic hierarchy process (AHP), weighted scoring method (WSM),and hybrid knowledge based system (HKBS) for software selection: a comparative study.Paper presented at the 2009 Second International Conference on Emerging Trends inEngineering & Technology.Jeong, H. (2017). Narrative and expository genre effects on students, raters, andperformance criteria. Assessing Writing, 31, 113-125.Jin, S.-H., SONG, K., DO HYOUNG, S., & Shin, S. (2015). A Performance-Based Evaluation Rubric forAssessing and Enhancing Engineering Design Skills in Introductory Engineering Design Courses.INTERNATIONAL JOURNAL OF ENGINEERING EDUCATION, 31(4), 1007-1020.Johnsen, E., Nilsen, M., Hjelseth, E., & Merschbrock, C. (2016). Exploring a simple visualizationtool for improving conceptual understanding of classical beam theory. Procedia Engineering,164, 172-179.Judge, M., Polifroni, E., Maruca, A., Hobson, M., Leschak, A., & Zakewicz, H. (2015). Evaluationof students' receptiveness and response to an interprofessionallearning activity across health care disciplines: An approach toward teamdevelopment in healthcare. International Journal of Nursing Sciences, 2(1), 93-98.Jumaah, F., Zadain, A., Zaidan, B., Hamzah, A., & Bahbibi, R. (2018). Decision-making solution based multi-measurement design parameter for optimization of GPS receivertracking channels in static and dynamic real-time positioning multipath environment.Measurement, 118, 83-95.Kadry, S. (2015). Systematic assessment of student outcomes in mathematics forengineering students. Paper presented at the Global Engineering Education Conference(EDUCON), 2015 IEEE.Kakani, B., Dalal, D., & Dabhi, A. (2016). Improved solution on students answer sheet assessmentusing fuzzy rules. Paper presented at the Advances in Signal Processing (CASP), Conferenceon.Kalaani, Y., & Haddad, R. J. (2014). A Unified Approach to the Assessment of Student LearningOutcomes in Electrical Engineering Programs.Kalid, N., Zaidan, A., Zaidan, B., Salman, O. H., Hashim, M., Albahri, O., & Albahri,A. (2018). Based on Real Time Remote Health Monitoring Systems: A New Approach for PrioritizationLarge Scales Data Patients with Chronic Heart Diseases Using Body Sensors and CommunicationTechnology. Journal of medical systems, 42(4), 69.Kanaparan, G. (2016). Self-efficacy and engagement as predictors of studentprogramming performance: An international perspective.Kandakoglu, A., Celik, M., & Akgun, I. (2009). A multi-methodological approach for shippingregistry selection in maritime transportation industry. Mathematical and Computer Modelling,49(3), 586-597.Kazi, L., & Radulovic, B. (2011). Information system based on Balanced Scorecard for studentteamwork software project management. Paper presented at the MIPRO, 2011 Proceedings of the 34thInternational Convention.Keeney, R. L., & Raiffa, H. (1993). Decisions with multiple objectives: preferences and valuetrade-offs: Cambridge university press.Khatimin, N., Zaharim, A., Aziz, A. A., Sahari, J., & Rahmat, R. A. O. (2013). Setting the standardfor project design course using rasch measurement model. Paper presented at the Global EngineeringEducation Conference (EDUCON), 2013IEEE.Kiani, L. S., & Menke, C. (2015). Refining scientific writing skills with feedback that works forstudents and instructors. Paper presented at the Education and Training in Optics andPhotonics.Kianto, A., Vanhala, M., & Heilmann, P. (2016). The impact of knowledgemanagement on job satisfaction. Journal of Knowledge Management, 20(4), 621-636.Kibble, J. D. (2017). Best practices in summative assessment: Am Physiological Soc.Kim, K., Kyung, T., Kim, W., Shin, C., Song, Y., Lee, M. Y., . . . Cho, Y. (2009).Efficient management design for swimming exercise treatment. The Korean Journal ofPhysiology & Pharmacology, 13(6), 497-502.Kim, S.-J., Kim, S., Kang, K.-A., Oh, J., & Lee, M.-N. (2016). Development of asimulation evaluation tool for assessing nursing students' clinical judgment in caring for childrenwith dehydration. Nurse education today, 37, 45-52.Kim, W., Han, S. K., Oh, K. J., Kim, T. Y., Ahn, H., & Song, C. (2010). The dual analytic hierarchyprocess to prioritize emerging technologies. Technological Forecasting and Social Change, 77(4),566-577.Kitamura, Y. (2010). Decision?making process of patients with gynecological cancer regarding theircancer treatment choices using the analytic hierarchy process. Japan Journal of Nursing Science,7(2), 148-157.Kohoutek, J. (2014). European standards for quality assurance and institutional practicesof student assessment in the UK, the Netherlands and the Czech Republic. Assessment &Evaluation in Higher Education, 39(3), 310-325.Kron, F. W., Fetters, M. D., Scerbo, M. W., White, C. B., Lypson, M. L., Padilla, M. A., . . .Wallace, A. M. (2017). Using a computer simulation for teaching communication skills: A blinded multisite mixed methods randomized controlled trial. Patient education andcounseling, 100(4), 748-759.Kumar, V. D. (2017). Software Engineering for Big Data Systems. University of Waterloo.Lahby, M., Cherkaoui, L., & Adib, A. (2013). A Novel Ranking Algorithm Based NetworkSelection For Heterogeneous Wireless Access. JNW, 8(2), 263-272.Lam, K., & Zhao, X. (1998). An application of quality function deployment to improve the qualityof teaching. International Journal of Quality & Reliabilitygement, 15(4), 389-413.Larkin, T. L. (2013). Breaking with tradition: Using the conference paper as a case foralternative assessment in physics. Paper presented at the InteractiveCollaborative Learning (ICL), 2013 International Conference on.Lebeuf, C. R. (2018). A taxonomy of software bots: towards a deeper understanding ofsoftware bot characteristics.Lengelle, R., Meijers, F., Poell, R., & Post, M. (2014). Career writing: Creative,expressive and reflective approaches to narrative identity formation in studentsin higher education. Journal of Vocational Behavior, 85(1), 75-84.Lesmes, D., Castillo, M., & Zarama, R. (2009). Application of The Analytic NetworkProcess (ANP) to Establish Weights In Order To Re-Accredit A Program Of AUniversity. Paper presented at the Proceedings of the International Symposiumon the Analytic Hierarchy Process.Leyva Lpez, J. C. (2005). Multicriteria decision aid application to a student selectionproblem. Pesquisa Operacional, 25(1), 45-68.Liao, S.-W., Chang, K.-Y., Ting, C.-K., Tsou, M.-Y., Chen, E.-T., Chan, K.-H., &Chang, W.-K. (2014). Comparison of proficiency in an anesthesiology courseacross distinct medical student cohorts: Psychometric approaches to testequating. Journal of the Chinese Medical Association, 77(3), 150-154.Liberatore, M. J., & Nydick, R. L. (2008). The analytic hierarchy process in medicaland health care decision making: A literature review. European Journal ofOperational Research, 189(1), 194-207.Lile, R., & Bran, C. (2014). The assessment of learning outcomes. Procedia-Social andBehavioral Sciences, 163, 125-131.Lin, F.-Y., Wu, W.-W., Lin, H.-R., & Lee, T.-Y. (2014). The learning experiences ofstudent nurses in pediatric medication management: A qualitative study. Nurseeducation today, 34(5), 744-748.Linaker, K. L. (2015). Student Evaluations, Outcomes, and National LicensureExaminations in Radiology Education: A Narrative Review of the Literature.Journal of chiropractic humanities, 22(1), 17-21.Liu, Y., Han, C., Huang, L., Wang, B., & Zhu, Z. (2012). Research and development ofstudent assessment system based on knowledge, ability and mentality. Paperpresented at the Computer Science & Education (ICCSE), 2012 7thInternational Conference on.Lizer, M., Ayers, G., Pierce, R. J., & Elsobky, T. (2016). Pharmacy student preferenceson instructional strategies in a mental health elective. Currents in Pharmacy Teaching andLearning, 8(1), 133-138.Lotriet, M., Erasmus, H., & Mostert, S. N. (2016). Tutoring targets the challenge of evaluatingsuccess. Journal for New Generation Sciences, 14(1), 63-76.Luo, Y., & Wu, W. (2015). Sustainable Design with BIM Facilitation in Project-based Learning.Procedia Engineering, 118, 819-826.Macek, O., & Kom, M. (2012). Evaluation of student teamwork. Paper presented at the SoftwareEngineering Education and Training (CSEE&T), 2012 IEEE 25th Conference on.Macfarlane, B. (2016). The performative turn in the assessment of student learning: a rightsperspective. Teaching in Higher Education, 21(7), 839-853.Mahboob, T., Irfan, S., & Karamat, A. (2016). A machine learning approach for student assessmentin E-learning using Quinlan's C4. 5, Naive Bayes and Random Forest algorithms. Paperpresented at the Multi-Topic Conference (INMIC), 2016 19th International.Mahmood, K., Khan, K. M., Khan, K. S., & Kiani, S. (2015). Implementation of outcomebased education in Pakistan: A step towards Washington Accord. Paper presented at theEngineering Education (ICEED), 2015 IEEE 7th International Conference on.Maier, M. W. (2006). System and software architecture reconciliation. Systems Engineering,9(2), 146-159.Malczewski, J. (1999). GIS and multicriteria decision analysis: John Wiley & Sons. Maria, T.,Dimitris, P., Garifallos, F., Athanasios, G., & Roumeliotis, M. (2015).Collaboration learning as a tool supporting value co-creation. Evaluatingstudents learning through concept maps. Procedia-Social and Behavioral Sciences, 182,375-380.Markenson, D., Woolf, S., Redlener, I., & Reilly, M. (2013). Disaster medicine and public healthpreparedness of health professions students: a multidisciplinary assessment of knowledge,confidence, and attitudes. Disaster medicine and public health preparedness, 7(5), 499-506.Mecwan, A., Shah, D., & Fataniya, B. (2015). Innovations in evaluation: An integral part of outcome based education. Paper presented at the Engineering(NUiCONE), 2015 5th Nirma University International Conference on.Mehta, S., Clarke, F., & Fleming, P. (2016). An assessment of student experiences andlearning based on a novel undergraduate e-learning resource. British dental journal,221(3), 131-136.Mikasa, A. W., Cicero, T. F., & Adamson, K. A. (2013). Outcome-based evaluation tool to evaluatestudent performance in high-fidelity simulation. Clinical Simulation in Nursing, 9(9),e361-e367.Misut, M., & Misutova, M. (2017). Software Solution Improving Productivity and Qualityfor Big Volume Students' Group Assessment Process. International Journal of EmergingTechnologies in Learning, 12(4).Molins-Ruano, P., Rodriguez, P., Atrio, S., & Sacha, G. (2016). Modelling experts'behavior with e-valUAM to measure computer science skills. Computers in Human Behavior,61, 378-385.Moustroufas, E., Stamelos, I., & Angelis, L. (2015). Competency profiling for software engineers: literature review and a new model. Paper presented at the Proceedings of the 19thPanhellenic Conference on Informatics.Murray, K., McKenzie, K., & Kelleher, M. (2016). The evaluation of a framework for measuring thenon-technical ward round skills of final year nursing students: An observational study. Nurseeducation today, 45, 87-90.Myers, B. A., Stefik, A., Hanenberg, S., Kaijanaho, A.-J., Burnett, M., Turbak, F., & Wadler, P.(2016). Usability of Programming Languages: Special Interest Group (SIG) Meeting at CHI 2016.Paper presented at the Proceedings of the 2016 CHI Conference Extended Abstracts on HumanFactors in Computing Systems.Myers, J. A., Vigneswaran, Y., Gabryszak, B., Fogg, L. F., Francescatti, A. B., Golner, C., &Bines, S. D. (2014). NBME subject examination in surgery scores correlate with surgeryclerkship clinical experience. Journal of surgical education, 71(2), 205-210.Myler, L. A., & Seurynck, K. (2016). Student Evaluation of Simulation in a NewHospital-Based Simulation Center. Nursing Education Perspectives, 37(6), 335- 336.Naber, J., & Wyatt, T. H. (2014). The effect of reflective writing interventions on the criticalthinking skills and dispositions of baccalaureate nursing students. Nurseeducation today, 34(1), 67-72.Najjar, R. H., Docherty, A., & Miehl, N. (2016). Psychometric properties of anobjective structured clinical assessment tool. Clinical Simulation in Nursing, 12(3),88-95.Nallasamy, M. (2014). A study on threshold concepts in teaching and learning in TAFE- industrytraining. Paper presented at the Teaching, Assessment and Learning (TALE), 2014 InternationalConference on.Narula, M., & Nagar, P. (2015). Fuzzy logic based expert system for students'performance evaluation. Paper presented at the Computing for Sustainable Global Development(INDIACom), 2015 2nd International Conference on.Navazesh, M., Rich, S. K., Chopiuk, N. B., & Keim, R. G. (2013). Triple jumpexaminations for dental student assessment. Journal of dental education, 77(10), 1315-1320.Nikoomaram, H., Mohammadi, M., Taghipourian, M. J., & Taghipourian, Y. (2009). Training performanceevaluation of administration sciences instructors by fuzzy MCDM approach. Contemporary EngineeringSciences, 2(12), 559-575.Nilsson, H., Nordstrm, E.-M., & hman, K. (2016). Decision support for participatory forestplanning using AHP and TOPSIS. Forests, 7(5), 100.O'Brocta, R., & Swigart, S. (2013). Student perceptions of a Top 200 Medication Courseutilizing active learning techniques. Currents in Pharmacy Teaching and Learning, 5(1),49-53. e42.Oermann, M. H., Kardong-Edgren, S., & Rizzolo, M. A. (2016). Towards an Evidence- Based Methodologyfor High-Stakes Evaluation of Nursing Students' Clinical Performance Using Simulation. Teaching andLearning in Nursing, 11(4), 133- 137.Oliveira, M., Fontes, D. B., & Pereira, T. (2014). Multicriteria decision making: a case study inthe automobile industry. Annals of Management Science, 3(1), 109.Ortz, M. A., Cmbita, J. P., Hoz, . l. A. D. l., Felice, F. D., & Petrillo, A. (2016). Anintegrated approach of AHP-DEMATEL methods applied for the selection of allied hospitals in outpatient service. International Journal of Medical Engineering and Informatics, 8(2),87-107.P.-E., J., & M. Mollaghasemi. (1997). Technical Briefing: Making Multiple Objective Decisions.Retrieved from Los Alamitos, California:Paturusi, S., Chisaki, Y., & Usagawa, T. (2014). Development and evaluation of online quizzes toenhance learning performance: A survey of student assessmentthrough MOODLE in Indonesian National University. Paper presented at theInformation, Communication Technology and System (ICTS), 2014International Conference on.Paudel, S. (2016). VULNERABLE WEB APPLICATIONS AND HOW TO AUDITTHEM: Use of OWASP Zed Attack Proxy effectively to find the vulnerabilities of web applications.Paul, S. A. (2014). Assessment of critical thinking: a Delphi study. Nurse education today, 34(11),1357-1360.Peasah, S. K., & Marshall, L. L. (2017). The use of debates as an active learning tool in acollege of pharmacy healthcare delivery course. Currents in Pharmacy Teaching and Learning.Pejcinovic, B., Duncan, D., Wong, P. K., Faust, M., & Recktenwald, G. (2014).Assessment of student preparedness for freshman engineering courses through assessment of mathbackground. Paper presented at the Frontiers in Education Conference (FIE), 2014 IEEE.Petrovic-Lazarevic, S., & Abraham, A. (2004). Hybrid fuzzy-linear programming approach for multi criteria decision making problems. arXiv preprint cs/0405019.Petrudi, S. H. J., Pirouz, M., & Pirouz, B. (2013). Application of fuzzy logic forperformance evaluation of academic students. Paper presented at the Fuzzy Systems (IFSC),2013 13th Iranian Conference on.Phillips, L. D., & e Costa, C. A. B. (2007). Transparent prioritisation, budgeting and resource allocation with multi-criteria decision analysis and decision conferencing. Annals ofOperations Research, 154(1), 51-68.Pirzadeh, L. (2010). Human factors in software development: a systematic literature review.Poole, C., & Boland, J. (2016). What influences assessors' internalised standards?Radiography, 22(2), e99-e105.Potenza, R., Guermani, A., Peluso, M., Casciola, A., Ginosa, I., Sperlinga, R., &Donadio, P. (2015). Effectiveness of an education program on donation and transplant aimedat students of the nursing degree course. Paper presented at the Transplantation proceedings.Puthal, D., Sahoo, B., Mishra, S., & Swain, S. (2015). Cloud computing features, issues, andchallenges: a big picture. Paper presented at the Computational Intelligenceand Networks (CINE), 2015 International Conference on.Qader, M., Zaidan, B., Zaidan, A., Ali, S., Kamaluddin, M., & Radzi, W. (2017). AMethodology for Football Players Selection Problem Based on Multi- MeasurementsCriteria Analysis. Measurement.Qin, X.-S., Huang, G. H., Chakma, A., Nie, X., & Lin, Q. (2008). A MCDM-based expert system forclimate-change impact assessment and adaptation planning A case study for the Georgia Basin,Canada. Expert Systems with Applications, 34(3), 2164-2179.Qu, L., & Chen, Y. (2008). A hybrid MCDM method for route selection of multimodal transportationnetwork. Paper presented at the International Symposium on Neural Networks.Rajaee, N., Sabri, M. F. M., Ping, K. H., & Husin, M. H. (2013). Assessment of student learningoutcomes in digital signal processing course in PKEK, UNIMAS. Paper presented at the EngineeringEducation (ICEED), 2013 IEEE 5th Conference on.Rakbamrung, P., Puekkong, J., & Thepnuan, P. (2015). Students Understanding Physics Concept of Traction Therapy. Procedia-Social and Behavioral Sciences, 197, 135-139.Rana, S., & Garg, R. (2016). Application of Hierarchical Clustering Algorithm toEvaluate Students Performance of an Institute. Paper presented at theComputational Intelligence & Communication Technology (CICT), 2016 Second InternationalConference on.Rasmani, K. A., Shahari, N. A., Garibaldi, J. M., & Shen, Q. (2013). Practicality issues in usingfuzzy approaches for aggregating students academic performance. Procedia-Social andBehavioral Sciences, 83, 398-402.Rauf, A., Shamim, M. S., Aly, S. M., Chundrigar, T., & Alam, S. N. (2014). Formative assessment inundergraduate medical education: concept, implementation and hurdles. J Pak Med Assoc, 64(64),72-75.Redmond, C., Davies, C., Cornally, D., Adam, E., Daly, O., Fegan, M., & O'Toole, M. (2018). Usingreusable learning objects (RLOs) in wound care education: Undergraduate student nurse'sevaluation of their learning gain. Nurse education today, 60, 3-10.Reid, C. M., Kim, D. Y., Mandel, J., Smith, A., & Bansal, V. (2014). Correlatingsurgical clerkship evaluations with performance on the National Board ofMedical Examiners examination. Journal of Surgical Research, 190(1), 29-35.Ren, J., & Sovacool, B. K. (2015). Prioritizing low-carbon energy sources to enhance Chinas energysecurity. Energy Conversion and Management, 92, 129-136.Roberts, C., Shadbolt, N., Simpson, P., & Clark, T. (2014). The reliability and validity of aportfolio designed as a programmatic assessment of performance in an integrated clinicalplacement. BMC medical education, 14(1), 197.Roszkowska, E. (2013). Rank ordering criteria weighting methodsa comparative overview.Saad, M. I. M., Baharom, S., & Mokhsein, S. E. (2017). Scientific reasoning skills based onsocio-scientific issues in the biology subject. INTERNATIONAL JOURNAL OF ADVANCED AND APPLIEDSCIENCES, 4(3), 13-18.Saaty, T. L. (1977). A scaling method for priorities in hierarchical structures. Journal ofmathematical psychology, 15(3), 234-281.Saaty, T. L. (1980). The Analytic Hierarchy Process, New York: McGrew Hill.International, Translated to Russian, Portuguesses and Chinese, Revised edition, Paperback(1996, 2000), Pittsburgh: RWS Publications.Saaty, T. L., & Ozdemir, M. S. (2003). Why the magic number seven plus or minus two. Mathematicaland Computer Modelling, 38(3-4), 233-244.Saceda-Corralo, D., Fonda-Pascual, P., Moreno-Arrones, ., Alegre-Snchez, A.,Hermosa-Gelbard, ., Jimnez-Gmez, N., . . . Jan-Olasolo, P. (2017). ObjectiveStructured Clinical Examination as an Assessment Tool for Clinical Skills in Dermatology. Actasdermo-sifiliograficas, 108(3), 237-243.Sajid, M. R., Laheji, A. F., Abothenain, F., Salam, Y., AlJayar, D., & Obeidat, A.(2016). Can blended learning and the flipped classroom improve student learning andsatisfaction in Saudi Arabia? International journal of medical education, 7, 281.Saksrisathaporn, K., Bouras, A., Reeveerakul, N., & Charles, A. (2016). Application of a decisionmodel by using an integration of AHP and TOPSIS approaches within humanitarian operation life cycle. International Journal of Information Technology & Decision Making, 15(04), 887-918.Salvador, G., Ba, M., Contero, M., & Camba, J. (2014). Evaluation of a distributed collaborativeworkspace as a creativity tool in the context of design education. Paper presented at the Frontiersin Education Conference (FIE), 2014 IEEE.Salzmann?Erikson, M., Bjuhr, M., & Mrtensson, G. (2017). Developing, and Evaluating the Educational Module Students ActiveLearning via Internet Observations (SALIO) in Undergraduate NursingEducation. Perspectives in psychiatric care, 53(2), 104-110.Samarakou, M., Prentakis, P., Mitsoudis, D., Karolidis, D., & Athinaios, S. (2017).Application of fuzzy logic for the assessment of engineering students. Paper presented atthe Global Engineering Education Conference (EDUCON), 2017 IEEE.Sample, S. J., Bleedorn, J. A., Schaefer, S. L., Mikla, A., Olsen, C. W., & Muir, P. (2014). Students' Perception of Case?Based Continuous Assessment and Multiple?Choice Assessmentin a Small Animal Surgery Course for Veterinary Medical Students. Veterinary surgery, 43(4),388-399.San Miguel, C., & Rogan, F. (2015). Assessing students' English language proficiency duringclinical placement: A qualitative evaluation of a language framework. Nurse education today, 35(6),771-776.Sedelmaier, Y., & Landes, D. (2014). Software engineering body of skills (SWEBOS). Paper presentedat the Global Engineering Education Conference (EDUCON), 2014 IEEE.Sharma, K., Banerjee, K., Mandal, C., & Vikas, I. (2015). A benchmark programming assignment suitefor quantitative analysis of student performance in early programming courses. Paper presented at the MOOCs, Innovation and Technology in Education (MITE), 2015 IEEE 3rdInternational Conference on.Sherekar, V., Tatikonda, M., & Student, M. (2016). Impact of Factor Affecting on LabourProductivity in Construction Projects by AHP Method. International Journal of EngineeringScience and Computing, 6.Shih, H.-S., Shyur, H.-J., & Lee, E. S. (2007). An extension of TOPSIS for groupdecision making. Mathematical and Computer Modelling, 45(7), 801-813.Shin, H., Park, C. G., & Kim, H. (2015). Validation of Yoon's Critical ThinkingDisposition Instrument. Asian nursing research, 9(4), 342-348.Simonova, I., & Poulova, P. (2016). Assessment preferences of IT and management students. Paperpresented at the e-Learning, e-Management and e-Services (IC3e), 2016 IEEE Conference on.Sin, C., & Manatos, M. (2014). Student assessment in Portugal: academic practice and Bolognapolicy. Higher Education Policy, 27(3), 323-340.Singh, S., Dolan, J. G., & Centor, R. M. (2006). Optimal management of adults with pharyngitisamulti-criteria decision analysis. BMC Medical Informatics andDecision Making, 6(1), 14.Singh, U., & Wassermann, J. (2016). A story of a journey in implementing an e-assessment system at a South African university. Africa Education Review, 13(3-4), 1-16.Skelley, J. W. (2014). A small group assignment gives students a novel opportunity to demonstratecurrent clinical controversies in a self-care course. American journal of pharmaceuticaleducation, 78(10), 193.Skladttir, H., & Svavarsdttir, M. H. (2016). Development and validation of a ClinicalAssessment Tool for Nursing Education (CAT-NE). Nurse education in practice, 20, 31-38.Smith, J., Cook, A., & Packer, C. (2010). Evaluation criteria to assess the value ofidentification sources for horizon scanning. International journal of technology assessment inhealth care, 26(3), 348-353.Smith, J., Wolfe, C. L., Springer, S., Martin, M., Togno, J., Bramstedt, K. A., . .. Murphy, B. (2015). Using cultural immersion as the platform for teaching Aboriginaland Torres Strait Islander health in an undergraduate medical curriculum. Rural and remotehealth, 15(3), 1.Smith, S., Farra, S., Ten Eyck, R., & Bashaw, M. (2015). Development of an instrument to measurenursing student teamwork skills. Clinical Simulation in Nursing, 11(12), 507-512.Stal-Le Cardinal, J., Mousseau, V., & Zheng, J. (2011). An application of constrained multicriteriasorting to student selection Portfolio Decision Analysis (pp. 213- 240): Springer.Stoet, G., & Geary, D. C. (2017). Students in countries with higher levels of religiosity performlower in science and mathematics. Intelligence, 62, 71-78.Stupple, E. J., Maratos, F. A., Elander, J., Hunt, T. E., Cheung, K. Y., & Aubeeluck, A.V. (2017). Development of the Critical Thinking Toolkit (CriTT): A measure of student attitudesand beliefs about critical thinking. Thinking Skills and Creativity, 23, 91-100.Sundeen, T., Vince Garland, K. M., & Wienke, W. D. (2016). A Multi-Year Evaluation of StudentPerceptions of University and Special Education Doctoral Websites. Teacher Education and SpecialEducation, 39(4), 259-275.Suskie, L. (2018). Assessing student learning: A common sense guide: John Wiley &Sons.Sutton, P. A., Mason, J., Vimalachandran, D., & McNally, S. (2014). Attitudes,motivators, and barriers to a career in surgery: a national study of UK undergraduatemedical students. Journal of surgical education, 71(5), 662-667.Tafiadis, D., Chronopoulos, S. K., Siafaka, V., Drosos, K., Kosma, E. I., Toki, E. I., & Ziavra, N.(2017). Comparison of voice handicap index scores between female students of speech therapy andother health professions. Journal of Voice, 31(5), 583-588.Talib, A. M., Alomary, F. O., & Alwadi, H. F. (2018). Assessment of StudentPerformance for Course Examination Using Rasch Measurement Model: A Case Study ofInformation Technology Fundamentals Course. Education Research International, 2018.Terry, V. R., Moloney, C., Bowtell, L., & Terry, P. C. (2016). Online intravenous pump emulator: Aseffective as face-to-face simulation for training nursing students. Nurse education today, 40,198-203.Tews, M. C., Treat, R. W., & Nanes, M. (2016). Increasing Completion Rate of an M4 Emergency Medicine Student End-of-Shift Evaluation Using a Mobile Electronic Platform andReal-Time Completion. Western Journal of Emergency Medicine, 17(4), 478.Thokala, P., Devlin, N., Marsh, K., Baltussen, R., Boysen, M., Kalo, Z., . . . Watkins,J. (2016). Multiple Criteria Decision Analysis for Health Care Decision MakingAnIntroduction: Report 1 of the ISPOR MCDA Emerging Good Practices Task Force. Value inhealth, 19(1), 1-13.Thomas, R. E., Teel, T. L., & Bruyere, B. L. (2014). Seeking excellence for the land of paradise:integrating cultural information into an environmental education program in a rural Hawaiiancommunity. Studies in Educational Evaluation, 41, 58-67.Towey, D., Chen, T. Y., Kuo, F.-C., Liu, H., & Zhou, Z. Q. (2016). Metamorphictesting: A new student engagement approach for a new software testing paradigm. Paperpresented at the Teaching, Assessment, and Learning for Engineering (TALE), 2016 IEEEInternational Conference on.Triantaphyllou, E. (2000). Multi-criteria decision making methods Multi-criteria DecisionMaking Methods: A Comparative Study (pp. 5-21): Springer.Triantaphyllou, E., Shu, B., Sanchez, S. N., & Ray, T. (1998). Multi-criteria decision making: anoperations research approach. Encyclopedia of electrical andelectronics engineering, 15, 175-186.van Til, J. A., Renzenbrink, G. J., Dolan, J. G., & IJzerman, M. J. (2008). The use ofthe analytic hierarchy process to aid decision making in acquired equinovarus deformity. Archivesof physical medicine and rehabilitation, 89(3), 457-462.Vaughan, B. (2016). Confirmatory factor analysis of the Study Process Questionnaire in anAustralian osteopathy student population. International Journal of Osteopathic Medicine, 20,62-67.Vaughan, B., & Morrison, T. (2015). Assessment in the final year clinical practicum of an Australian osteopathy program. International Journal of Osteopathic Medicine, 18(4),278-286.Velasquez, M., & Hester, P. T. (2013). An analysis of multi-criteria decision making methods.International Journal of Operations Research, 10(2), 56-66.Velayo, B. C., Stark, P. C., Eisen, S. E., & Kugel, G. (2014). Using dental students preclinicalperformance as an indicator of clinical success. Journal of dental education, 78(6), 823-828.Veltri, L., Kaakinen, J. R., Shillam, C., Arwood, E., & Bell, K. (2016). ControlledPostpartumNewborn Simulation With Objective Evaluation Exchanged for Clinical Learning.Clinical Simulation in Nursing, 12(5), 177-186.Viennet, E., & Petrucci, L. (2014). Monitoring students performances in French Institutesof Technology using the ScoDoc software. Paper presented at the Information TechnologyBased Higher Education and Training (ITHET), 2014.Vuc, G., Baloi, F., & Litcanu, M. (2015). Adapting Methods of Student Evaluation and Grading inElectrical Power Engineering. Procedia-Social and Behavioral Sciences, 191, 147-151.Vyatkin, V. (2013). Software engineering in industrial automation: State-of-the-art review.IEEE Transactions on Industrial Informatics, 9(3), 1234-1249.Walia, S., & Marks-Maran, D. (2014). Leadership development through action learning sets: Anevaluation study. Nurse education in practice, 14(6), 612-619.Wang, J.-J., Jing, Y.-Y., Zhang, C.-F., & Zhao, J.-H. (2009). Review on multi-criteria decisionanalysis aid in sustainable energy decision-making. Renewable and Sustainable EnergyReviews, 13(9), 2263-2278.Wang, M.-H., Wang, C.-S., Lee, C.-S., Lin, S.-W., & Hung, P.-H. (2014). Type-2 fuzzy setconstruction and application for adaptive student assessment system. Paper presented at theFuzzy Systems (FUZZ-IEEE), 2014 IEEE InternationalConference on.Whitlock, B., & Ebrahimi, N. (2016). Beyond the library: using multiple, mixedmeasures simultaneously in a college-wide assessment of information literacy.College & Research Libraries, 77(2), 236-262.Wilbur, K., Hassaballa, N., Mahmood, O. S., & Black, E. K. (2017). Describing student performance:a comparison among clinical preceptors across cultural contexts. Medical Education, 51(4), 411-422.Wind, Y., & Saaty, T. L. (1980). Marketing applications of the analytic hierarchyprocess. Management science, 26(7), 641-658.Wirth, K., Malone, B., Turner, C., Schulze, R., Widmann, W., & Sanni, A. (2015). A structuredteaching curriculum for medical students improves their performance on the National Board ofMedical Examiners shelf examination in surgery. The American Journal of Surgery, 209(4), 765-770.Worrachananun, M., Yan, F., & Zhaoming, B. (2015). A qualitative assessment ofstudent-centered approach: High-level Question Assessment Method among Chinese and MacaneseStudents in Macao. Paper presented at the Educational Innovation through Technology (EITT), 2015International Conference of.Yildiz, Z., & Baba, A. F. (2014). Evaluation of student performance in laboratoryapplications using fuzzy decision support system model. Paper presented at the Global EngineeringEducation Conference (EDUCON), 2014 IEEE.Yoon, K. P., & Hwang, C.-L. (1995). Multiple attribute decision making: an introduction(Vol. 104): Sage publications.Zaidan, A., Karim, H. A., Ahmad, N., Zaidan, B., & Kiah, M. M. (2015). RobustPornography Classification Solving the Image Size Variation Problem Based on Multi-Agent Learning.Journal of Circuits, Systems and Computers, 24(02), 1550023.Zaidan, A., Zaidan, B., Al-Haiqi, A., Kiah, M. L. M., Hussain, M., & Abdulnabi, M. (2015).Evaluation and selection of open-source EMR software packages based on integrated AHP and TOPSIS.Journal of biomedical informatics, 53, 390- 404.Zaidan, A., Zaidan, B., Hussain, M., Haiqi, A., Kiah, M. M., & Abdulnabi, M. (2015). Multi-criteriaanalysis for OS-EMR software selection problem: A comparative study. Decision Support Systems, 78,15-27.Zasadny, M. F., & Bull, R. M. (2015). Assessing competence in undergraduate nursing students: TheAmalgamated Students Assessment in Practice model. Nurseeducation in practice, 15(2), 126-133.Zhang, L. N., & Yang, B. (2014). Research on the Evaluation of Students DevelopmentBased on Support Vector Machine. Paper presented at the Applied Mechanics and Materials.Zhou, S., Han, J., Koenig, K., Raplinger, A., Pi, Y., Li, D., . . . Bao, L.(2016). Assessment of scientific reasoning: The effects of task context, data, and design onstudent reasoning in control of variables. Thinking Skills and Creativity, 19, 175-187.Zionts, S. (1979). MCDM-If not a Roman Numeral, then what? Interfaces, 9(4), 94- 101.Zomorodi, M., de Saxe Zerden, L., Nance-Floyd, B., Alexander, L., Wilfert, R., &Byerley, J. (2017). Impact of an interprofessional population health course and clinical immersionexperience: Students and practice outcomes. Journal ofInterprofessional Education & Practice, 9, 91-94.