Mapping Research Agenda of Educational AI Chatbots for Academic Performance：A Bibliometrics Insight
Keywords:
Educational AI chatbots, Academic performance, Bibliometric analysis, Co-citation analysis, Trend analysisAbstract
AI chatbots are gaining traction as transformative tools in the educational domains, yet limited attention has been given to the evolving research focus and future directions within this field through bibliometric analysis. This study aims to explore the research landscape and developmental trajectories of educational AI chatbots for academic performance through systematic bibliometric analysis. Data was retrieved from Web of Science (WoS) using defined search terms related to educational AI chatbots, and CiteSpace was employed for co-citation and trend analysis, and we identified 965 publications between 2019 and 2024, with a significant increase in research outputs since 2021. The study highlights dominant categories such as Education, Psychology, and Computer Science, alongside emerging interdisciplinary themes in healthcare, ethics, and linguistics. Collaboration networks identify influential institutions and authors, including central contributors like the University of Hong Kong and leading researchers such as Waleed Mugahed Al-Rahmi. Country collaboration networks underscore the active participation of nations such as the USA, China, and England, with increasing contributions from Asian countries like Taiwan and India. Keyword analysis reveals evolving research priorities: early studies focused on user acceptance and trust, while recent trends emphasize privacy, ethics, and advanced AI technologies like large language models. The keyword bursts further indicate dynamic shifts in academic interest, highlighting innovation and sustainability as emerging areas.The results explained research trends, mapped collaborations of authors, institutions, countries, and most publications focus on education, psychology, and computer science. Key findings include prominent research themes such as AI chatbot integration in teaching, user interaction design, and ethical concerns. Future directions highlight the need for addressing security and privacy challenges, improving user engagement technologies, and expanding applications to support diverse educational needs. This study provides researchers with a comprehensive understanding of educational AI chatbots and offers valuable insights to guide future research in this emerging field.
References
Ahmad, S. F., Alam, M. M., Rahmat, M. K., Mubarik, M. S., & Hyder, S. I. (2022). Academic and Administrative Role of Artificial Intelligence in Education. Sustainability, 14(3). https://doi.org/10.3390/su14031101
Akiba, D., & Fraboni, M. C. (2023). AI-Supported Academic Advising: Exploring ChatGPT’s Current State and Future Potential toward Student Empowerment. Education Sciences, 13(9). https://doi.org/10.3390/educsci13090885
Chang, D. H., Lin, M. P.-C., Hajian, S., & Wang, Q. Q. (2023). Educational Design Principles of Using AI Chatbot That Supports Self-Regulated Learning in Education: Goal Setting, Feedback, and Personalization. Sustainability, 15(17). https://doi.org/10.3390/su151712921
Chiu, Y.-T., Zhu, Y.-Q., & Corbett, J. (2021). In the hearts and minds of employees: A model of pre-adoptive appraisal toward artificial intelligence in organizations. International Journal of Information Management, 60. https://doi.org/10.1016/j.ijinfomgt.2021.102379
Diem, A., & Wolter, S. C. (2012). The Use of Bibliometrics to Measure Research Performance in Education Sciences. Research in Higher Education, 54(1), 86-114. https://doi.org/10.1007/s11162-012-9264-5
Dindorf, C., Bartaguiz, E., Gassmann, F., & Frohlich, M. (2022). Conceptual Structure and Current Trends in Artificial Intelligence, Machine Learning, and Deep Learning Research in Sports: A Bibliometric Review. Int J Environ Res Public Health, 20(1). https://doi.org/10.3390/ijerph20010173
Farhat, F., Sohail, S. S., & Madsen, D. Ø. (2023). How trustworthy is ChatGPT? The case of bibliometric analyses. Cogent Engineering, 10(1). https://doi.org/10.1080/23311916.2023.2222988
Fosso Wamba, S., Queiroz, M. M., Pappas, I. O., & Sullivan, Y. (2024). Artificial Intelligence Capability and Firm Performance: A Sustainable Development Perspective by the Mediating Role of Data-Driven Culture. Information Systems Frontiers. https://doi.org/10.1007/s10796-023-10460-z
Frandsen, T. F., Jacobsen, R. H., Wallin, J. A., Brixen, K., & Ousager, J. (2015). Gender differences in scientific performance: A bibliometric matching analysis of Danish health sciences Graduates. Journal of Informetrics, 9(4), 1007-1017. https://doi.org/10.1016/j.joi.2015.09.006
Fryer, L. K., Thompson, A., Nakao, K., Howarth, M., & Gallacher, A. (2020). Supporting self-efficacy beliefs and interest as educational inputs and outcomes: Framing AI and Human partnered task experiences. Learning and Individual Differences, 80. https://doi.org/10.1016/j.lindif.2020.101850
Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2022). Interacting with educational chatbots: A systematic review. Education and Information Technologies, 28(1), 973-1018. https://doi.org/10.1007/s10639-022-11177-3
Li, W., Aste, T., Caccioli, F., & Livan, G. (2019). Early coauthorship with top scientists predicts success in academic careers. Nat Commun, 10(1), 5170. https://doi.org/10.1038/s41467-019-13130-4
Liu, L., & Duffy, V. G. (2023). Exploring the Future Development of Artificial Intelligence (AI) Applications in Chatbots: A Bibliometric Analysis. International Journal of Social Robotics, 15(5), 703-716. https://doi.org/10.1007/s12369-022-00956-0
Lo, C. K. (2023). What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature. Education Sciences, 13(4). https://doi.org/10.3390/educsci13040410
Long, R., Crawford, A., White, M., & Davis, K. (2008). Determinants of faculty research productivity in information systems: An empirical analysis of the impact of academic origin and academic affiliation. Scientometrics, 78(2), 231-260. https://doi.org/10.1007/s11192-007-1990-7
Mendoza, S., Sanchez-Adame, L. M., Urquiza-Yllescas, J. F., Gonzalez-Beltran, B. A., & Decouchant, D. (2022). A Model to Develop Chatbots for Assisting the Teaching and Learning Process. Sensors (Basel), 22(15). https://doi.org/10.3390/s22155532
Mohammadyari, S., & Singh, H. (2015). Understanding the effect of e-learning on individual performance: The role of digital literacy. Computers & Education, 82, 11-25. https://doi.org/10.1016/j.compedu.2014.10.025
Mohd Rahim, N. I., A. Iahad, N., Yusof, A. F., & A. Al-Sharafi, M. (2022). AI-Based Chatbots Adoption Model for Higher-Education Institutions: A Hybrid PLS-SEM-Neural Network Modelling Approach. Sustainability, 14(19). https://doi.org/10.3390/su141912726
Prasetio, A. P., Azis, E., Fadhilah, D. D., & Fauziah, A. F. (2017). Lecturers’ Professional Competency and Students’ Academic Performance in Indonesia Higher Education. International Journal of Human Resource Studies, 7(1). https://doi.org/10.5296/ijhrs.v7i1.10902
Rodríguez-Hernández, C. F., Cascallar, E., & Kyndt, E. (2020). Socio-economic status and academic performance in higher education: A systematic review. Educational Research Review, 29. https://doi.org/10.1016/j.edurev.2019.100305
Salgado-Fernandez, A., Vazquez-Amor, A., Alvarez-Peregrin, C., Martinez-Perez, C., Villa-Collar, C., & Angel Sanchez-Tena, M. (2022). Influence of eye movements on academic performance: A bibliometric and citation network analysis. J Eye Mov Res, 15(4). https://doi.org/10.16910/jemr.15.4.4
Tao, X., Hanif, H., Ahmed, H. H., & Ebrahim, N. A. (2021). Bibliometric Analysis and Visualization of Academic Procrastination. Front Psychol, 12, 722332. https://doi.org/10.3389/fpsyg.2021.722332
Tonta, Y. (2014). Use and misuse of bibliometric measures for assessment of academic performance, tenure and publication support. The Metrics 2014: Workshop on Informetric and Scientometric Research. 77th Annual
Meeting of the Association for Information Science and Technology.
Wu, J., Ou, G., Liu, X., & Dong, K. (2022). How does academic education background affect top researchers’ performance? Evidence from the field of artificial intelligence. Journal of Informetrics, 16(2). https://doi.org/10.1016/j.joi.2022.101292
Xu, L., Sanders, L., Li, K., & Chow, J. C. L. (2021). Chatbot for Health Care and Oncology Applications Using Artificial Intelligence and Machine Learning: Systematic Review. JMIR Cancer, 7(4), e27850. https://doi.org/10.2196/27850
