Innovation in Automated Essay Scoring for Writing Assessment: A Case Study at SMA Negeri 1 Genteng

Lestari Andhini; Reza Maulana; Naufal Rizky Pratama

Authors

Lestari Andhini State University of Malang Author
Reza Maulana State University of Malang Author
Naufal Rizky Pratama State University of Malang Author

Keywords:

Automated Essay, Scoring, Bi-LSTM, Teacher Perception, Writing Assessment, Artificial Intelligence

Abstract

This study aims to developt evaluate a Bidirectional Long Short-Term Memory (Bi-LSTM) based Automated Essay Scoring (AES) system to enhance the efficiency and objectivity of student writing assessment. A case study was conducted at SMA Negeri 1 Genteng using student essays graded by teachers as the ground truth. Evaluation results show QWK 0.83, MAE 0.41, and PCC 0.86, indicating a high agreement between model and manual scores. Beyond quantitative results, teachers and students perceived AES as efficient, objective, and supportive of writing improvement. All teachers (100%) agreed that AES speeds up grading, and 90% of students stated that automatic feedback helps them revise their writing. However, creativity still requires human judgment. Overall, the Bi-LSTM based AES system is feasible as an intelligent assessment tool in secondary education.

Downloads

Download data is not yet available.

References

Aini, D. L., Sukmawati, K., & Amroni, T. W. (2025). Innovative Reading Aloud Approach for Enhancing Pronunciation and Speaking Fluency of Students. JINEA: Journal of Innovation in Education and Learning, 1(1), 9–18. https://jurnal.ihsancahayapustaka.id/index.php/jinea

Chamidah, N., Yulianti, E., & Budi, I. (2023). Evaluating the Impact of Sentence Tokenization on Indonesian Automated Essay Scoring Using Pretrained Sentence Embeddings. Revue d’Intelligence Artificielle, 37(5), 1101–1108. https://doi.org/10.18280/ria.370502

Dhini, B. F., Girsang, A. S., Sufandi, U. U., & Kurniawati, H. (2023). Automatic essay scoring for discussion forum in online learning based on semantic and keyword similarities. Asian Association of Open Universities Journal, 18(3), 262–278. https://doi.org/10.1108/AAOUJ-02-2023-0027

Doewes, A., Kurdhi, N. A., & Saxena, A. (2023). Evaluating Quadratic Weighted Kappa as the Standard Performance Metric for Automated Essay Scoring. International Educational Data Mining Society, 103–113. https://doi.org/10.5281/zenodo.8115784

Fatqurhohman, F., Syam, H., Puspasari, R., Niam, F., & Surur, A. M. (2025). STEM Digital Collaboration to Enhance Critical Thinking Skills of Secondary School Students: A Literature Review. JINEA: Journal of Innovation in Education and Learning, 1(1), 37–50. https://jurnal.ihsancahayapustaka.id/index.php/jinea

Hiver, P., Al-Hoorie, A. H., Vitta, J. P., & Wu, J. (2024). Engagement in language learning: A systematic review of 20 years of research methods and definitions. Language Teaching Research, 28(1), 201–230. https://doi.org/10.1177/13621688211001289

Hussein, M. A., Hassan, H., & Nassef, M. (2019). Automated language essay scoring systems: A literature review. PeerJ Computer Science, 5, e208. https://doi.org/10.7717/peerj-cs.208

Jayadianti, H., Santosa, B., Cahyaning, J., Saifullah, S., & Drezewski, R. (2023). Essay auto-scoring using N-Gram and Jaro Winkler based Indonesian Typos. MATRIK: Jurnal Manajemen, Teknik Informatika Dan Rekayasa Komputer, 22(2), 325–338. https://doi.org/10.30812/matrik.v22i2.2473

Margareta, L., Avatus Marheni, R., & Purwitasari, H. (2025). Evaluation of Digital Learning Integration to Improve Junior High School Students’ Digital Literacy. JINEA: Journal of Innovation in Education and Learning, 1(1), 19–28. https://jurnal.ihsancahayapustaka.id/index.php/jinea

Pradani, K. A., & Suadaa, L. H. (2023). Automated Essay Scoring Menggunakan Semantic Textual Similarity Berbasis Transformer Untuk Penilaian Ujian Esai. Jurnal Teknologi Informasi Dan Ilmu Komputer, 10(6), 1177–1184. https://doi.org/10.25126/jtiik.1067338

Rajagede, R. A. (2021). Improving Automatic Essay Scoring for Indonesian Language using Simpler Model and Richer Feature. Kinetik: Game Technology, Information System, Computer Network, Computing, Electronics, and Control, 6(1), 11–18. https://doi.org/10.22219/kinetik.v6i1.1196

Ramesh, D., & Sanampudi, S. K. (2022). An Automated Essay Scoring Systems: A Systematic Literature Review. Artificial Intelligence Review, 55(3), 2495–2527. https://doi.org/10.1007/s10462-021-10068-2

Semba, D. L. (2024). Implementasi Long-Short Term Memory (LSTM) Untuk Generasi Feedback Berbahasa Indonesia Pada Sistem Penilaian Esai. Jurnal FASILKOM, 14(1), 101–113. https://doi.org/10.37859/jf.v14i1.6906

Sidik, D. P., Irawijayanti, F., & Baihaqi, A. (2025). Digital Learning 5.0: Leveraging Adaptive, Immersive, and Inclusive Technologies to Overcome Educational Inequity. JINEA: Journal of Innovation in Education and Learning, 1(2), 75–92. https://jurnal.ihsancahayapustaka.id/index.php/jinea

Sidik, D. P., Utaminingrum, F., & Muflikhah, L. (2023). Penggunaan Variasi Model pada Arsitektur EfficientNetV2 untuk Prediksi Sel Kanker Serviks. Jurnal Pengembangan Teknologi Informasi Dan Ilmu Komputer, 7(5), 2116–2121. http://j-ptiik.ub.ac.id

Susilawati, E., Lubis, H., Kesuma, S., & Pratama, I. (2022). Antecedents of Student Character in Higher Education: The role of the Automated Short Essay Scoring (ASES) digital technology-based assessment model. Eurasian Journal of Educational Research, 2022(98). https://doi.org/10.14689/ejer.2022.98.013

Verdikha, N. A., Dwiagam, J. H., & Hasudungan, R. (2024). Indonesian Automated Essay Scoring with Bag of Word and Support Vector Regression. JSE: Journal of Science and Engineering, 1(2), 95–100. https://doi.org/10.30650/jse.v1i2.3841

Vo, Y., Rickels, H., Welch, C., & Dunbar, S. (2023). Human scoring versus automated scoring for english learners in a statewide evidence-based writing assessment. Assessing Writing, 56, 100719. https://doi.org/10.1016/j.asw.2023.100719

Wiratmo, A., & Fatichah, C. (2020). Indonesian Short Essay Scoring Using Transfer Learning Dependency Tree LSTM. International Journal of Intelligent Engineering and Systems, 13(2). https://doi.org/10.22266/ijies2020.0430.27

Xiao, C., Ma, W., Song, Q., Xu, S. X., Zhang, K., Wang, Y., & Fu, Q. (2025). Human-AI Collaborative Essay Scoring: A Dual-Process Framework with LLMs. LAK ’25: Proceedings of the 15th International Learning Analytics and Knowledge Conference, 293–305. https://doi.org/10.1145/3706468.3706507