The Effect of Artificial Intelligence–Based Learning on Students’ Mathematical Thinking in Secondary Education

Monoko Haguchi; Nur Chalim Wachidah; Gandha Satria Adi; Fitri Irawijayanti; Fatqurhohman Fatqurhohman

doi:10.66031/jinea.v2i1.160

Authors

Monoko Haguchi Meiji University Author
Nur Chalim Wachidah Kyushu Institute of Technology Author
Gandha Satria Adi Universitas Gadjah Mada Author
Fitri Irawijayanti Universitas Gadjah Mada Author
Fatqurhohman Universitas Muhammadiyah Jember Author

DOI:

https://doi.org/10.66031/jinea.v2i1.160

Keywords:

Artificial Intelligence, AI-Based Learning, Mathematical Thinking, Secondary Education, Mathematics Education

Abstract

The rapid integration of artificial intelligence (AI) in secondary education has transformed mathematics learning through adaptive and personalized instructional support. This study investigates the effect of AI-based learning on students’ mathematical thinking by comparing AI performance with student performance across different mathematical problem types. A quantitative experimental–comparative design with a pretest–posttest control group approach was employed, involving 120 secondary school students assigned to experimental and control groups. The experimental group engaged in AI-assisted learning using ChatGPT, while the control group received conventional instruction. Mathematical thinking was assessed using accuracy, response time, and consistency across multiple-choice, short-answer, and essay tasks, with digital literacy examined as a mediating variable. The results reveal significant performance differences, with AI demonstrating higher accuracy, faster response times, and greater consistency, particularly on essay-based problems requiring higher-order reasoning. Mediation analysis further indicates that digital literacy significantly influences students’ mathematical thinking and partially mediates the relationship between AI interaction and learning outcomes. These findings suggest that AI-based learning can effectively enhance mathematical thinking when integrated with strong digital literacy development, highlighting implications for adaptive pedagogy and future longitudinal research.

Downloads

Download data is not yet available.

References

Ali, R., & Wardat, Y. (2024). Opportunities and Challenges of Integrating Generative Artificial Intelligence in Education. International Journal of Religion, 5(7), 784–793.

Arvin, N., Hoseinabady, M., Bayat, B., & Zahmatkesh, E. (2023). Teacher Experiences With AI-Based Educational Tools. AI and Tech in Behavioral and Social Sciences, 1(2), 26–32.

Chan, C. K. Y. (2023). A Comprehensive AI Policy Education Framework for University Teaching and Learning. International Journal of Educational Technology in Higher Education, 20(1), 38.

Chau, D. B., Luong, V. T., Long, T. T., & Linh, N. T. T. (2025). Personalized Mathematics Teaching eith The Support of AI Chatbots to Improve Mathematical Problem-Solving Competence for High School Students in Vietnam. European Journal of Educational Research, 14(1), 323–333.

Chen, F., & Xie, H. (2020). Effects of AI-Assisted Mathematics Learning on Students’ Problem-Solving Ability. International Journal of Artificial Intelligence in Education, 30(4), 617–635.

Chen, L., Chen, P., & Lin, Z. (2020). Artificial Intelligence in Education: A review. IEEE Access, 8, 75264–75278.

Chiu, T. K. F., & Chai, C. (2020). Sustainable Curriculum Planning for Artificial Intelligence Education: A Self-Determination Theory Perspective. Sustainability, 12(14), 5568.

Chiu, T. K. F., Meng, H., Chai, C.-S., King, I., Wong, S., & Yam, Y. (2022). Creation and Evaluation of a Pretertiary Artificial Intelligence (AI) Curriculum. IEEE Transactions on Education, 65(1), 30–39.

Cukurova, M., Luckin, R., & Kent, C. (2020). Impact of an Artificial Intelligence Research Frame on The Perceived Credibility of Educational Research Evidence. International Journal of Artificial Intelligence in Education, 30(2), 205–235.

Eden, C. A., Chisom, O. N., & Adeniyi, I. S. (2024). Integrating AI in Education: Opportunities, Challenges, and Ethical Considerations. Magna Scientia Advanced Research and Reviews, 10(2), 6–13.

Egara, F. O., & Mosimege, M. (2024). Exploring The Integration of Artificial Intelligence-Based ChatGPT into Mathematics Instruction: Perceptions, Challenges, and Implications for Educators. Education Sciences, 14, 742.

Fatkurochman, H., Zakaria, Z., Fatqurhohman, F., Huda, H., Desfita, V., Indarsih, F., Prabowo, J., Ni’mah, K., Sidik, D. P., Apriliyanto, R., Wardhani, W. D. L., & Susetyo, A. M. (2026). Transformasi Pendidikan Progresif Indonesia di Era Modern. CV. Ihsan Cahaya Pustaka.

Fatqurhohman, F., & Firdaus, H. P. E. (2024). Analysis of Imperfection of Mathematical Identity in Problem-Solving. Matematika dan Pembelajaran, 12(2), 166–182.

Fatqurhohman, F., Damayanti, N. W., & Chen, X. (2025). Innovation digital and virtual reality based instructional design for high school students. JINEA: Journal of Innovation in Education and Learning, 1(2), 63–74. https://doi.org/10.66031/jinea.v1i2.10

Fatqurhohman, F., Murniasih, T. R., Anwar, R. B., & Halim, F. A. (2025). The Role of UbD in Developing Students’ Mathematical Problem-Solving Skills: A Literature Review. RESET: Review of Education, Science, and Technology, 1(1), 29–42. https://doi.org/10.66031/reset.v1i1.18

Hidayatullah, E., Untari, R., & Fifardin, F. (2024). Effectiveness of AI in Solving Math Problems at The Secondary School Level: A Comparative Study with Student Performance. Union: Jurnal Ilmiah Pendidikan Matematika, 12(2), 350–360.

Ifenthaler, D., Majumdar, R., Gorissen, P., Judge, M., Mishra, S., Raffaghelli, J., & Shimada, A. (2024). Artificial Intelligence in Education: Implications for Policymakers, Researchers, and Practitioners. Technology, Knowledge and Learning, 1–18.

Jia, X.-H., & Tu, J.-C. (2024). Towards a New Conceptual Model of AI-Enhanced Learning for College Students: The Roles of Artificial Intelligence Capabilities, General Self-Efficacy, Learning Motivation, and Critical Thinking Awareness. Systems, 12(3), 74.

Kasneci, E., Sessler, K., Kitchenham, B., & Kasneci, G. (2023). ChatGPT for Good? on Opportunities and Challenges of Large Language Models for Education. Computers and Education: Artificial Intelligence, 4, 100179.

Kim, S.-W. (2024). Development of a TPACK educational program to enhance pre-service teachers’ teaching expertise in Artificial Intelligence convergence education. International Journal on Advanced Science, Engineering & Information Technology, 14(1).

Lee, J., Park, H., & Kim, S. (2022). The Effect of AI-Based Learning on STEM Achievement Among Korean High School Students. Journal of Science Education and Technology, 31(6), 821–835.

Lin, H. (2022). Influences of Artificial Intelligence in Education on Teaching Effectiveness: The Mediating Effect of Teachers’ Perceptions of Educational Technology. International Journal of Emerging Technologies in Learning, 17(24), 144.

Long, D., Blunt, T., & Magerko, B. (2021). Co-Designing AI Literacy Exhibits for Informal Learning Spaces. Proceedings of the ACM on Human-Computer Interaction, 5(CSCW2), 1–35.

Naamati-Schneider, L., & Alt, D. (2024). Beyond Digital Literacy: The Era of AI-Powered Assistants and Evolving User Skills. Education and Information Technologies, 29(16), 21263–21293.

Nasir, M., Hasan, M., Adlim, A., & Syukri, M. (2024). Utilizing Artificial Intelligence in Education to Enhance Teaching Effectiveness. Proceedings of International Conference on Education, 2(1), 280–285.

Nazaretsky, T., Ariely, M., Cukurova, M., & Alexandron, G. (2022). Teachers’ Trust In AI‐Powered Educational Technology and a Professional Development Program to Improve It. British Journal of Educational Technology, 53(4), 914–931.

Niu, W., Zhang, W., Zhang, C., & Chen, X. (2024). The Role of Artificial Intelligence Autonomy in Higher Education: A Uses and Gratification Perspective. Sustainability, 16(3).

Orhani, S. (2024). Personalization of Math Tasks for Each Student Through AI. Research Inventory: International Journal of Engineering and Science, 14(3), 8–15.

Owan, V. J., Abang, K. B., Idika, D. O., Etta, E. O., & Bassey, B. A. (2023). Exploring The Potential of Artificial Intelligence Tools in Educational Measurement and Assessment. EURASIA Journal of Mathematics, Science and Technology Education, 19(8), em2307.

Peng, M., Xie, J., Xiong, M., & Liu, Y. (2023). Artificial Intelligence Education in Primary and Secondary Schools from The Perspective of Thinking Quality. Journal of Contemporary Educational Research, 7(4), 41–46.

Sarwoedi, S., Syamsir, S., Sholihin, M., Wanto, D., & Warsah, I. (2025). The Impact of Artificial Intelligence on Students’ Interest and Achievement in Learning Mathematics. Math-UMB.EDU: Journal of Mathematics Education, 13(1), 1–10.

Saidi, S., Suryowati, E., Sholihah, U., & Fatqurhohman, F. (2025). Literature Review on The Role of School Principals in The Society 5.0: Strategies and Future Challenges. RESET: Review of Education, Science, and Technology, 1(1), 55–64. https://doi.org/10.66031/reset.v1i1.20

Seo, K., Tang, J., Roll, I., Fels, S., & Yoon, D. (2021). The Impact of Artificial Intelligence on Learner–Instructor Interaction in Online Learning. International Journal of Educational Technology in Higher Education, 18, 1–23.

Sidik, D. P., Irawijayanti, F., & Fatqurhohman, F. (2025). The Role of Artificial Intelligence in Enhancing Digital and Data Literacy Among Secondary School Students: A Systematic Literature Review. JINEA: Journal of Innovation in Education and Learning, 1(3), 173–188. https://doi.org/10.66031/jinea.132025.38

Sidik, D. P., Rozak, A., Fatqurhohman, F., & Fatkurochman, H. (2025). Literature Review of Artificial Intelligence in Learning: Trends and opportunities. RESET: Review of Education, Science, and Technology, 1(1), 43–54. https://doi.org/10.66031/reset.v1i1.19

Sriwisathiyakun, K. (2023). Utilizing Design Thinking to Create Digital Self-Directed Learning Environment for Enhancing Digital Literacy in Thai Higher Education. Journal of Information Technology Education: Innovations in Practice, 22, 201–214.

Xu, W., & Ouyang, F. (2022). The Application of AI Technologies in STEM Education: A Systematic Review From 2011 to 2021. International Journal of STEM Education, 9(1), 59.

Yang, X., Sun, T., & Liu, J. (2021). The Role of AI in Mathematics Education: Feedback and Student Confidence. International Journal of Educational Technology in Higher Education, 18(1), 1–15.

Yuskovych-Zhukovska, V., Poplavska, T., Diachenko, O., Mishenina, T., Topolnyk, Y., & Gurevych, R. (2022). Application of Artificial Intelligence in Education: Problems and Opportunities for Sustainable Development. BRAIN: Broad Research in Artificial Intelligence and Neuroscience, 13(1Sup1), 339–356.

Zebua, N., Ibrohim, I., & Sulisetijono, S. (2025). Exploring The Level of AI Digital Literacy and Creative Thinking Skills in High School Students. Bioscientist: Jurnal Ilmiah Biologi, 13(1), 510–520