UM
Automated Essay Evaluation for English Language Learners:A Case Study of MY Access
Hoang,Giang Thi Linh1; Kunnan,Antony John2
2016-10-01
Source PublicationLanguage Assessment Quarterly
ISSN15434311 15434303
Volume13Issue:4Pages:359-376
AbstractComputer technology made its way into writing instruction and assessment with spelling and grammar checkers decades ago, but more recently it has done so with automated essay evaluation (AEE) and diagnostic feedback. And although many programs and tools have been developed in the last decade, not enough research has been conducted to support or evaluate the claims of the developers. This study examined the effectiveness of automated writing instructional programs in consistent scoring of essays and appropriate feedback to student writers. It examined the scoring and instructional program called MY Access! Home Edition, which has an error feedback tool called My Editor to address these issues. The study combined a quantitative study of agreement and correlational analyses with an analysis of content and topic. Participants included 114 English language learners who wrote 147 essays to three writing prompts, which were graded by trained EFL raters and MY Access. From the sample, 15 randomly selected essays were also used for an error analysis comparing My Editor with human annotations to examine My Editor’s accuracy. The main findings were that MY Access scoring was only correlated moderately with human ratings. Furthermore, because MY Access scoring is limited to the recognition of content words, not how these words are organized at the discourse level, it did not detect slightly off-topic essays and plagiarism. Finally, My Editor’s error feedback, with 73% precision and 30% recall, did not meet the expectations of an accurate tool. In conclusion, the home edition of MY Access was not found to be useful as an independent instructional tool. These findings give us pause regarding the effectiveness of MY Access.
DOI10.1080/15434303.2016.1230121
URLView the original
Language英语
Fulltext Access
Citation statistics
Cited Times [WOS]:10   [WOS Record]     [Related Records in WOS]
Document TypeJournal article
CollectionUniversity of Macau
Corresponding AuthorHoang,Giang Thi Linh
Affiliation1.Hue University,,Hue,Viet Nam
2.University of Macau,,Macao
Recommended Citation
GB/T 7714
Hoang,Giang Thi Linh,Kunnan,Antony John. Automated Essay Evaluation for English Language Learners:A Case Study of MY Access[J]. Language Assessment Quarterly,2016,13(4):359-376.
APA Hoang,Giang Thi Linh,&Kunnan,Antony John.(2016).Automated Essay Evaluation for English Language Learners:A Case Study of MY Access.Language Assessment Quarterly,13(4),359-376.
MLA Hoang,Giang Thi Linh,et al."Automated Essay Evaluation for English Language Learners:A Case Study of MY Access".Language Assessment Quarterly 13.4(2016):359-376.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Hoang,Giang Thi Linh]'s Articles
[Kunnan,Antony John]'s Articles
Baidu academic
Similar articles in Baidu academic
[Hoang,Giang Thi Linh]'s Articles
[Kunnan,Antony John]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Hoang,Giang Thi Linh]'s Articles
[Kunnan,Antony John]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.