The Role of Automated Writing Assessment: University Students’ Views on Writing Performance and Self-Regulation
DOI:
https://doi.org/10.61987/educazione.v3i1.1192Keywords:
Automated Writing, Self – Regulation, University Students’, Writing PerformanceAbstract
This study investigates how artificial intelligence (AI) supports students’ self-regulated writing (SRW) practices in academic contexts, particularly in thesis writing. Adopting a qualitative case study design, the research involved six final-year students in an English Language Education program, selected through purposive sampling to represent varying levels of AI reliance. Data were collected through Likert-scale questionnaires and semi-structured interviews, then analyzed using descriptive statistics and thematic analysis. The findings indicate that students predominantly use AI tools for text-processing tasks such as grammar correction, paraphrasing, and translation, which contribute to improved writing accuracy, efficiency, and confidence. However, AI is less consistently utilized for higher-order processes, including idea development and progress monitoring, reflecting varied levels of metacognitive engagement. The results also reveal that students strongly prefer combining AI-generated feedback with input from teachers and peers, particularly for conceptual and substantive revisions. While AI enhances motivation and supports certain aspects of self-regulation, concerns about over-reliance and reduced critical engagement persist. These findings suggest that AI functions most effectively as a complementary tool within a broader pedagogical framework rather than as a substitute for human interaction. The study highlights the importance of integrating AI literacy and metacognitive training into academic writing instruction to ensure that students can use AI tools critically and strategically.
References
Abuzar, M., Mahmudulhassan, & Muthoifin. (2025). University Students’ Trust in AI: Examining Reliance and Strategies for Critical Engagement. International Journal of Interactive Mobile Technologies, 19(7), 70–82. https://doi.org/10.3991/ijim.v19i07.52875
Al-Eisawi, D. (2022). A Design Framework for Novice Using Grounded Theory Methodology and Coding in Qualitative Research: Organisational Absorptive Capacity and Knowledge Management. International Journal of Qualitative Methods, 21. https://doi.org/10.1177/16094069221113551
Berger, C., & Hartgerink, C. (2022). Corrected Data Collected from Sustainability Reports (Informa, RELX, Sage, Springer Nature, Wiley). ResearchEquals. https://doi.org/10.53962/pzgw-a32k
Byrne, T. (2025). The Risks of Phenomenology in Qualitative Research: Methods and Concepts. Qualitative Inquiry. https://doi.org/10.1177/10778004251407098
Chen, H., Wang, Y., & Chang, C. (2025). Enhancing Qualitative Inquiry: AI-Assisted Focus Group Data Collection. Qualitative Research Journal, 1–17. https://doi.org/10.1108/QRJ-04-2025-0145
Chen, K., Gu, L., Zuo, H., & Bai, Q. (2021). Can Word-Word Space Facilitate L2 Chinese Reading: Evidence from the Two Empirical Studies by Advanced L2 Learners of Mandarin Chinese. SAGE Open, 11(4). https://doi.org/10.1177/21582440211059150
Gebremariam, H. T. (2024). Exploring the Effects of Written Corrective Feedback Types on Grammatical Accuracy in L2 Writing: Evidence from Ethiopian High School Students. SAGE Open, 14(3). https://doi.org/10.1177/21582440241274331
Gretschel, P., Ramugondo, E. L., & Galvaan, R. (2023). Linking Paradigms and Methodologies in a Qualitative Case Study Focused on Exploring the Operation of Power in Human Actions During the Design of a New Occupational Therapy Intervention. International Journal of Qualitative Methods, 22, 16094069231187590. https://doi.org/10.1177/16094069231187590
Han, L. (2024). Metacognitive Writing Strategy Instruction in the EFL Context: Focus on Writing Performance and Motivation. SAGE Open, 14(2). https://doi.org/10.1177/21582440241257081
Hillman, J. G., & MacDonald, T. K. (2025). The Multidimensional Forgiveness Inventory: A Model for the Assessment of Incongruent and Incomplete Forgiveness. SAGE Open, 15(3). https://doi.org/10.1177/21582440251358572
Hughes, J., Homan, L., O’Reilly, M., & Hughes, K. (2025). AI Voice Methodology: Using Generative AI in Qualitative Social Research. Qualitative Inquiry. https://doi.org/10.1177/10778004251401842
Inan-Karagul, B., & Seker, M. (2021). Improving Language Learners’ Use of Self-Regulated Writing Strategies Through Screencast Feedback. SAGE Open, 11(4). https://doi.org/10.1177/21582440211064895
Intan Palullu, A., & Bahri, A. (2023). Profile of Self-Efficacy, Metacognitive Skills, Self-Regulated Learning, and Biology Cognitive Learning Outcomes of Public High School Students. International Journal of Science and Research (IJSR), 12(9), 1158–1163. https://doi.org/10.21275/sr23830084550
Kashiha, H. (2025). From Algorithms to Annotations: Rethinking Feedback Practices in Academic Writing Through AI-Human Comparison. Journal of Second Language Writing, 70, 101254. https://doi.org/10.1016/j.jslw.2025.101254
Ke, Y., & Zhou, X. (2025). From Argument to Algorithm: L2 Teachers’ Cognitive Bootstrapping in Validity Argument in Writing Assessment. SAGE Open, 15(1). https://doi.org/10.1177/21582440251328082
Kokutse, F. (2022). Coal and Sewage Waste Process Explored. Nature Africa. https://doi.org/10.1038/d44148-022-00175-9
Kullman, S. M., & Chudyk, A. M. (2025). Participatory Member Checking: A Novel Approach for Engaging Participants in Co-Creating Qualitative Findings. International Journal of Qualitative Methods, 24. https://doi.org/10.1177/16094069251321211
Mahdi, H. S., Milad, M., & Saeed, A. T. (2025). Evaluating the Effectiveness of AI Tools Across the Essay Writing Process: A Comparative Study of Pre-Writing, Drafting, and Post-Writing Stages. International Journal of Computer-Assisted Language Learning and Teaching, 15(1), 1–20. https://doi.org/10.4018/IJCALLT.391354
Mekheimer, M. (2025). Generative AI-Assisted Feedback and EFL Writing: A Study on Proficiency, Revision Frequency and Writing Quality. Discover Education, 4(1). https://doi.org/10.1007/s44217-025-00602-7
Naeem, M., Ozuem, W., Howell, K., & Ranfagni, S. (2024). Demystification and Actualisation of Data Saturation in Qualitative Research Through Thematic Analysis. International Journal of Qualitative Methods, 23. https://doi.org/10.1177/16094069241228777
Naeem, M., & Thomas, L. (2025). Case Study Research and Artificial Intelligence: A Step-by-Step Process to Using ChatGPT in the Development of Case Studies in Qualitative Research. International Journal of Qualitative Methods, 24. https://doi.org/10.1177/16094069251371478
Nahas, K. (2024). Can AI-Generated Podcasts Boost Science Engagement? Nature. https://doi.org/10.1038/d41586-024-03960-8
Najafov, R., Mulay, P., Joshi, R., & Chaudhari, A. (2025). A Comparative Study of Journal Finder (JF) Systems’ Effectiveness in Fulfilling Authors’ Submission Requirements: Evidence from Elsevier, Sage, Brill, Springer, Taylor & Francis, MDPI, Wiley, and Other Platforms. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.5393368
O’Brien, G. (2025). Threats to Scientific Software from Over-Reliance on AI Code Assistants. Nature Computational Science, 5(9), 701–703. https://doi.org/10.1038/s43588-025-00845-2
Özeren, E. B., & Özeren, Ö. (2025). ChatGPT as a Jury? Multi-Modal AI Versus Human Evaluation in an Architectural Design Competition. SAGE Open, 15(4). https://doi.org/10.1177/21582440251409859
Polat, A. (2025). Thematic Analysis in Qualitative Research: Common Pitfalls and Practical Insights for Academic Writing. International Journal of Qualitative Methods, 24. https://doi.org/10.1177/16094069251372835
Prillaman, M. (2023). ‘ChatGPT Detector’ Catches AI-Generated Papers with Unprecedented Accuracy. Nature. https://doi.org/10.1038/d41586-023-03479-4
Qin, J., & Groombridge, T. (2023). Deconstructing Summary Writing: Further Exploration of L2 Reading and Writing. SAGE Open, 13(4). https://doi.org/10.1177/21582440231200935
Ramirez-Arellano, A. (2024). Effects of Personality and Motivation on Students’ Academic Engagement and Metacognitive-Cognitive Strategies. SAGE Open, 14(4). https://doi.org/10.1177/21582440241285845
Shen, B., & Bai, B. (2024). Enhancing Chinese University Students’ Writing Performance and Self-Regulated Learning (SRL) Writing Strategy Use Through a Strategy-Based Intervention. System, 122, 103249. https://doi.org/10.1016/j.system.2024.103249
Smith, J., Braithwaite, J., O’Brien, T. A., Smith, S., Tyrrell, V. J., Mould, E. V. A., Long, J. C., & Rapport, F. (2022). Re-Imagining the Data Collection and Analysis Research Process by Proposing a Rapid Qualitative Data Collection and Analytic Roadmap Applied to the Dynamic Context of Precision Medicine. International Journal of Qualitative Methods, 21. https://doi.org/10.1177/16094069221103097
Star, J., Ringaert, L., & Larcombe, L. (2025). Qualitative Methods Case Study: Using MAXQDA in Indigenous HIV Journey Mapping Research. International Journal of Qualitative Methods, 24. https://doi.org/10.1177/16094069251356667
Stockless, A., & Brière, S. (2024). How to Encourage Inclusion in a Qualitative Research Project Using a Design-Based Research Methodology. International Journal of Qualitative Methods, 23. https://doi.org/10.1177/16094069241227852
Summers, E., Armstrong, S., Fard, S. M., & Garza, M. (2024). Beyond Reactionary: Sage Practices for Intentional Reflexivity in Online Qualitative Data Collection. New Trends in Qualitative Research, 20(1), e976. https://doi.org/10.36367/ntqr.20.1.2024.e976
Tavsanli, O. F. (2025). Investigating Turkish Primary School Teachers’ Beliefs About L1 Writing Instruction Through Attribution Theory: Process-Oriented Versus Product-Oriented Perspectives. SAGE Open, 15(3). https://doi.org/10.1177/21582440251360060
Teng, M. F. (2021). The Effectiveness of Incorporating Metacognitive Prompts in Collaborative Writing on Academic English Writing Skills. Applied Cognitive Psychology, 35(3), 659–673. https://doi.org/10.1002/acp.3789
Truman, S. E. (2023). Undisciplined: Research-Creation and What It May Offer (Traditional) Qualitative Research Methods. Qualitative Inquiry, 28(1), 95–104. https://doi.org/10.1177/10778004221098380
Udayanga, S. (2025). Reflexive and Iterative Thematic Analysis (RITA): A Design-Framework for Qualitative Research. Qualitative Research. https://doi.org/10.1177/14687941251377282
Wang, G., & Hu, G. (2022). Citations and the Nature of Cited Sources: A Cross-Disciplinary and Cross-Linguistic Study. SAGE Open, 12(2). https://doi.org/10.1177/21582440221093350
Zhang, X., & Zhang, R. (2023). Feedback, Response, and Learner Development: A Sociocultural Approach to Corrective Feedback in Second Language Writing. SAGE Open, 13(1). https://doi.org/10.1177/21582440231157680
Zhu, P., & Sun, X. (2025). Investigating Writing Self-Efficacy and Writing Self-Regulated Learning Strategies Across Different Writing Proficiency Levels in Chinese English Majors: A Mixed-Methods Design. SAGE Open, 15(4). https://doi.org/10.1177/21582440251406353
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Sari Ziadah Rohmah, Alfan Zuhairi
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
