Evaluating Academicians’ Perspectives on Education-based Assessments Strategies with Generative AI (GenAI)

  • Zhang Guangtian
  • Xiao Min
  • Zuraidah Abdullah
  • Kenny S.L Cheah

Abstract

This study investigates the use of Generative AI (GenAI), in university assessments in Malaysia to understand its impact on evaluations. It explores the implications, challenges and academic viewpoints related to this advancement. The research methodology involves a combination of methods, including gathering feedback from education experts at three universities using a 5-point Likert scale. The main results show that educators generally see AI as beneficial for improving assessment accuracy but highlight some considerations that need attention. Additionally, the findings suggest that while AI can enhance assessments by providing optimized learning experiences ethical issues such as data privacy and excessive automation need to be addressed. Educators also acknowledge the importance of training programs to help them develop the skills needed to integrate AI into their practices effectively. The study concludes that although AI shows potential for transforming education, maintaining a balance between technology and human-centered learning is crucial for implementation.

References

Alam, A. (2021). Should Robots Replace Teachers? Mobilisation of AI and Learning Analytics in Education. 2021 International Conference on Advances in Computing, Communication, and Control (ICAC3), 1-12.
Anuyahong, B., Rattanapong, C., & Patcha, I. (2023). Analyzing the Impact of Artificial Intelligence in Personalized Learning and Adaptive Assessment in Higher Education. International Journal of Research and Scientific Innovation.
Ayanwale, M. A., Sanusi, I. T., Adelana, O. P., Aruleba, K. D., & Oyelere, S. S. (2022). Teachers’ readiness and intention to teach artificial intelligence in schools. Computers and Education: Artificial Intelligence, 3, 100099.
Bacevich, A. J. (1996). Morality and high technology. The National Interest (45), 37-47.
Barrett, M. D. (2020). The Evolving Assessment Landscape and Adaptive Instructional Systems - Moving Beyond Good Intentions. Interacción,
Benjamins, R., & Salazar, I. A. (2020). Towards a framework for understanding societal and ethical implications of Artificial Intelligence. ArXiv, abs/2001.09750.
Borenstein, J., & Howard, A. M. (2020). Emerging challenges in AI and the need for AI ethics education. Ai and Ethics, 1, 61 - 65.
Chen, L., Chen, P., & Lin, Z. (2020). Artificial Intelligence in Education: A Review. IEEE Access, 8, 75264-75278.
Chowdhery, J., Jasmin, A., Jaiswal, A., & Jothi, J. A. A. (2021). Automatic Student Performance Prediction System Using Data Mining Techniques. 2021 International Conference on Computing and Communications Applications and Technologies (I3CAT), 57-65.
Crompton, H., & Song, D. (2021). The Potential of Artificial Intelligence in Higher Education. Revista Virtual Universidad Católica del Norte.
Dilmurod, R., & Fazliddin, A. (2021). Prospects for the introduction of artificial intelligence technologies in higher education. ACADEMICIA: AN INTERNATIONAL MULTIDISCIPLINARY RESEARCH JOURNAL.
Gardner, J., O’Leary, M., & Yuan, L. (2021). Artificial intelligence in educational assessment: 'Breakthrough? Or buncombe and ballyhoo?'. J. Comput. Assist. Learn., 37, 1207-1216.
Garrote Jurado, R., Pettersson, T., & Zwierewicz, M. (2023). STUDENTS' ATTITUDES TO THE USE OF ARTIFICIAL INTELLIGENCE. ICERI2023 Proceedings.
Hooda, M., Rana, C., Dahiya, O., Rizwan, A., & Hossain, M. S. (2022). Artificial Intelligence for Assessment and Feedback to Enhance Student Success in Higher Education. Mathematical Problems in Engineering.
Huang, J., Saleh, S., & Liu, Y. (2021). A Review on Artificial Intelligence in Education. Academic Journal of Interdisciplinary Studies, 10, 206-206.
Jokhan, A. D., Chand, A. A., Singh, V., & Mamun, K. A. (2022). Increased Digital Resource Consumption in Higher Educational Institutions and the Artificial Intelligence Role in Informing Decisions Related to Student Performance. Sustainability.
Karadağ, N. (2023). The impact of artificial intelligence on online assessment: A preliminary review. Journal of Educational Technology and Online Learning, 6(4), 822-837.
Kousa, P., & Niemi, H. M. (2022). AI ethics and learning: EdTech companies’ challenges and solutions. Interactive Learning Environments, 31, 6735 - 6746.
Lampou, R. (2023). The Integration of Artificial Intelligence in Education: Opportunities and Challenges. Review of Artificial Intelligence in Education.
Lazanyi, K. (2018). Readiness for artificial intelligence. 2018 IEEE 16th international symposium on intelligent systems and informatics (SISY),
Malik, A. R., Pratiwi, Y., Andajani, K., Numertayasa, I. W., Suharti, S., & Darwis, A. (2023). Exploring Artificial Intelligence in Academic Essay: Higher Education Student's Perspective. International Journal of Educational Research Open, 5, 100296.
Mansor, A. N., Vikaraman, S., Medina, N., & Alias, B. S. (2019). Managing school-based assessment: Challenges and solutions for educational practice. International Journal of Innovation, Creativity and Change, 7(7), 63-84.
Meerah, T. S. M., & Halim, L. (2011). Improve feedback on teaching and learning at the university through peer group. Procedia-Social and Behavioral Sciences, 18, 633-637.
Owan, V. J., Abang, K. B., Idika, D. O., Etta, E. O., & Bassey, B. A. (2023). Exploring the potential of artificial intelligence tools in educational measurement and assessment. EURASIA Journal of Mathematics, Science and Technology Education, 19(8), em2307.
Pedro, F., Subosa, M., Rivas, A., & Valverde, P. (2019). Artificial intelligence in education: Challenges and opportunities for sustainable development.
Razali, M. N. B., Zakariah, H., Hanapi, R., & Rahim, E. A. (2022). Predictive Model of Undergraduate Student Grading Using Machine Learning for Learning Analytics. 2022 4th International Conference on Computer Science and Technologies in Education (CSTE), 260-264.
Rizvi, M. (2023). Investigating AI-Powered Tutoring Systems that Adapt to Individual Student Needs, Providing Personalized Guidance and Assessments. The Eurasia Proceedings of Educational and Social Sciences.
Silva, A. d. O., & Janes, D. d. S. (2020). Exploring the Role of Artificial Intelligence in Education: A Comprehensive Perspective. Review of Artificial Intelligence in Education.
Singh, K. (2019). Lecturer's Feedback and Its Impact on Student Learning: A Study of a Public University in Sarawak, Malaysia. Asian Journal of University Education, 15(3), 83-91.
St-Hilaire, F., Vu, D. D., Frau, A., Burns, N., Faraji, F., Potochny, J., Robert, S., Roussel, A., Zheng, S., Glazier, T., Romano, J. V., Belfer, R., Shayan, M., Smofsky, A., Delarosbil, T., Ahn, S., Eden-Walker, S., Sony, K., Ching, A. O., . . . Kochmar, E. (2022). A New Era: Intelligent Tutoring Systems Will Transform Online Learning for Millions. ArXiv, abs/2203.03724.
Sulaiman, T., Kotamjani, S. S., Rahim, S. S. A., & Hakim, M. N. (2020). Malaysian Public University Lecturers' Perceptions and Practices of Formative and Alternative Assessments. International Journal of Learning, Teaching and Educational Research, 19(5), 379-394.
Suparyati, A., Widiastuti, I., Saputro, I. N., & Pambudi, N. A. (2023). The Role of Artificial Intelligence (AI) in Vocational Education. Jurnal Ilmiah Pendidikan Teknik dan Kejuruan.
Tarisayi, K. S. (2023). Strategic leadership for responsible artificial intelligence adoption in higher education. CTE Workshop Proceedings.
Tiwari, R. (2023). The integration of AI and machine learning in education and its potential to personalize and improve student learning experiences. INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT.
Wu, X. (2021). Application of Artificial Intelligence in Modern Vocational Education Technology. Journal of Physics: Conference Series, 1881.
Xuan, P. Y., Fahumida, F., Ismath, M., Al Nazir Hussain, M. I., Jayathilake, N. T., Khobragade, S., Soe, H. H. K., Moe, S., Htay, N., & Nu, M. (2023). Readiness Towards Artificial Intelligence Among Undergraduate Medical Students in Malaysia. Education in Medicine Journal, 15(2).
Zaman, B. U. (2023). Transforming Education Through AI, Benefits, Risks, and Ethical Considerations.
Zulnaidi, H., Mafarja, N., & Oktavika, E. (2024). The readiness of IR4. 0: Morality and technology integration among mathematics teachers. STEM Education, 4(1), 1-19.
Published
2024-06-01
How to Cite
GUANGTIAN, Zhang et al. Evaluating Academicians’ Perspectives on Education-based Assessments Strategies with Generative AI (GenAI). Asian Journal of Research in Education and Social Sciences, [S.l.], v. 6, n. 2, p. 246-262, june 2024. Available at: <https://myjms.mohe.gov.my/index.php/ajress/article/view/26861>. Date accessed: 26 july 2024.
Section
English Section