Automated Essay Scoring (AES); A Semantic Analysis Inspired Machine Learning Approach: An automated essay scoring system using semantic analysis and machine learning is presented in this research

Castle, Billy and Ikram, Ahsan (2020) Automated Essay Scoring (AES); A Semantic Analysis Inspired Machine Learning Approach: An automated essay scoring system using semantic analysis and machine learning is presented in this research. In: ICETC'20: 2020 12th International Conference on Education Technology and Computers. Association for Computing Machinery (ACM), New York, pp. 147-151. ISBN 9781450388276

[img] Text (Peer Reviewed Version)
9508 Castle and Ikhram (2021) Automated-Essay-Scoring-(AES)-A-Semantic-Analysis-Inspired-Machine-Learning-Approach.pdf - Accepted Version
Restricted to Repository staff only
Available under License All Rights Reserved.

Download (383kB)

Abstract

With the advancements in Artificial Intelligence (AI), ‘Automated Essay Scoring’ (AES) systems have become more and more prevalent in recent years. This research proposes an extension to the Coh-Metrix algorithm AES, with a focus on feature lists. Technical features, such as, referential cohesion, lexical diversity, and syntactic complexity are evaluated. Furthermore, it proposes the use of four novel semantic measures, including estimating the topic overlap between an essay and its brief. A prototype implementation, using neural networks, is used to test the individual and comparative performance of the newly proposed AES system. The results show a considerable improvement on the results obtained in the existing research for the original Coh-Metrix algorithm; from an adjacent accuracy of 91%, to an adjacent accuracy of 97.5% (and a QWK of 0.822). This suggests that the new features and the proposed system have the potential to improve essay grading and would be a good area for further research.

Item Type: Book Section
Article Type: Article
Uncontrolled Keywords: Python; Natural Language Processing; Semantic Analysis
Related URLs:
Subjects: L Education > L Education (General)
Q Science > QA Mathematics > QA76 Computer software
T Technology > T Technology (General)
Divisions: Schools and Research Institutes > School of Computing and Engineering > Technical & Applied Computing
Research Priority Areas: Applied Business & Technology
Depositing User: Kate Greenaway
Date Deposited: 26 Mar 2021 09:46
Last Modified: 27 Oct 2021 13:00
URI: https://eprints.glos.ac.uk/id/eprint/9508

University Staff: Request a correction | Repository Editors: Update this record

University Of Gloucestershire

Bookmark and Share

Find Us On Social Media:

Social Media Icons Facebook Twitter Google+ YouTube Pinterest Linkedin

Other University Web Sites

University of Gloucestershire, The Park, Cheltenham, Gloucestershire, GL50 2RH. Telephone +44 (0)844 8010001.