Impact of Automated Essay Scorer with Feedback for Essay Writing

Immediacy in feedback is necessary to ensure the recursive cycles of improvement in essay writing in line with the process writing approach that enables the cognition of information. However, grading and providing immediate feedback to students’ essays are time consuming and laborious and often lea...

Full description

Saved in:
Bibliographic Details
Main Author: Ng, Sing Yii
Format: Thesis
Language:English
Published: 2018
Subjects:
Online Access:http://ir.unimas.my/id/eprint/26604/1/Ng%20Sing%20Yii%20ft.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
id my-unimas-ir.26604
record_format uketd_dc
spelling my-unimas-ir.266042023-05-17T08:22:45Z Impact of Automated Essay Scorer with Feedback for Essay Writing 2018 Ng, Sing Yii LB Theory and practice of education Immediacy in feedback is necessary to ensure the recursive cycles of improvement in essay writing in line with the process writing approach that enables the cognition of information. However, grading and providing immediate feedback to students’ essays are time consuming and laborious and often lead to teacher burnout. This study aimed to develop and customise a computational method of grading to provide immediate feedback to students called the Automated Essay Scoring Feedback (AESF) and examine its impact on students writing achievement, motivation to write and their acceptance toward AESF. Differences in students’ writing achievement, motivation to write and acceptance of AESF based on gender, English proficiency and computer use experience were also investigated using a quasi-experimental research approach. Teachers’ views on the usability of AESF were also collected through interviews. Participants consisted of 360 Upper 6 students and 24 teachers from five schools in Kuching, Sarawak. Data were collected using a pre-test and a post-test (for writing achievement), Instructional Material Motivation Survey (IMMS) (for motivation for writing), Technology Acceptance Model questionnaire (TAM) (for acceptance of AESF) and general demographics such as gender, English proficiency and computer use experience Data were analysed using the Statistical Packages for the Social Sciences (SPSS). As the data violated parametric tests assumptions, data were analysed using nonparametric tests of Wilcoxon Signed Rank Test, Mann Whitney-U Test, Kruskal Wallis and Spearman’s Rank Correlation Coefficient Test. Students who used the AESF showed better writing achievement, especially in males and students with lower English proficiency. Students using AESF were found to be moderately motivated, and those who preferred immediate paragraph level scoring by AESF have higher motivation to write. Students have moderate acceptance of AESF regardless of gender, language proficiency and computer use experience. Students’ motivation to write was strongly and positively correlated to their acceptance of AESF. Teachers in this study also agreed that AESF could be used as a teaching and assessment tool but opined that it should not be solely depended on to determine students’ writing achievement for summative purposes. Hence, AESF should be further developed and fine-tuned to cater for students need for ongoing writing practise and help teachers make essay marking and feedback provision more manageable. Universiti Malaysia Sarawak (UNIMAS) 2018 Thesis http://ir.unimas.my/id/eprint/26604/ http://ir.unimas.my/id/eprint/26604/1/Ng%20Sing%20Yii%20ft.pdf text en validuser phd doctoral Universiti Malaysia Sarawak (UNIMAS) Faculty of Cognitive Sciences and Human Development
institution Universiti Malaysia Sarawak
collection UNIMAS Institutional Repository
language English
topic LB Theory and practice of education
spellingShingle LB Theory and practice of education
Ng, Sing Yii
Impact of Automated Essay Scorer with Feedback for Essay Writing
description Immediacy in feedback is necessary to ensure the recursive cycles of improvement in essay writing in line with the process writing approach that enables the cognition of information. However, grading and providing immediate feedback to students’ essays are time consuming and laborious and often lead to teacher burnout. This study aimed to develop and customise a computational method of grading to provide immediate feedback to students called the Automated Essay Scoring Feedback (AESF) and examine its impact on students writing achievement, motivation to write and their acceptance toward AESF. Differences in students’ writing achievement, motivation to write and acceptance of AESF based on gender, English proficiency and computer use experience were also investigated using a quasi-experimental research approach. Teachers’ views on the usability of AESF were also collected through interviews. Participants consisted of 360 Upper 6 students and 24 teachers from five schools in Kuching, Sarawak. Data were collected using a pre-test and a post-test (for writing achievement), Instructional Material Motivation Survey (IMMS) (for motivation for writing), Technology Acceptance Model questionnaire (TAM) (for acceptance of AESF) and general demographics such as gender, English proficiency and computer use experience Data were analysed using the Statistical Packages for the Social Sciences (SPSS). As the data violated parametric tests assumptions, data were analysed using nonparametric tests of Wilcoxon Signed Rank Test, Mann Whitney-U Test, Kruskal Wallis and Spearman’s Rank Correlation Coefficient Test. Students who used the AESF showed better writing achievement, especially in males and students with lower English proficiency. Students using AESF were found to be moderately motivated, and those who preferred immediate paragraph level scoring by AESF have higher motivation to write. Students have moderate acceptance of AESF regardless of gender, language proficiency and computer use experience. Students’ motivation to write was strongly and positively correlated to their acceptance of AESF. Teachers in this study also agreed that AESF could be used as a teaching and assessment tool but opined that it should not be solely depended on to determine students’ writing achievement for summative purposes. Hence, AESF should be further developed and fine-tuned to cater for students need for ongoing writing practise and help teachers make essay marking and feedback provision more manageable.
format Thesis
qualification_name Doctor of Philosophy (PhD.)
qualification_level Doctorate
author Ng, Sing Yii
author_facet Ng, Sing Yii
author_sort Ng, Sing Yii
title Impact of Automated Essay Scorer with Feedback for Essay Writing
title_short Impact of Automated Essay Scorer with Feedback for Essay Writing
title_full Impact of Automated Essay Scorer with Feedback for Essay Writing
title_fullStr Impact of Automated Essay Scorer with Feedback for Essay Writing
title_full_unstemmed Impact of Automated Essay Scorer with Feedback for Essay Writing
title_sort impact of automated essay scorer with feedback for essay writing
granting_institution Universiti Malaysia Sarawak (UNIMAS)
granting_department Faculty of Cognitive Sciences and Human Development
publishDate 2018
url http://ir.unimas.my/id/eprint/26604/1/Ng%20Sing%20Yii%20ft.pdf
_version_ 1783728316722708480