Abstract

As part of mathematics teaching and learning, students frequently encounter challenges in solving problems that demand High-Order Thinking Skills (HOTS). They often struggle to grasp concepts and analyze pattern relationships within complex problems, particularly in the topic of number patterns. Concurrent with advancements in artificial intelligence technology, ChatGPT has emerged as a potential solution and learning aid. ChatGPT help students to interact and develop evaluation and critical thinking skills to solve HOTS mathematics problems. This research aims to analyze the effectiveness of ChatGPT in assisting students to solve HOTS mathematics problems related to number patterns. The study employed a Quasi-Experimental method with a posttest-only control group design. Eighth-grade students from SMP N 4 Purwokerto constituted the subjects of this research, where Class VIII A served as the experimental group (utilizing ChatGPT), while Class VIII F acted as the control group. The instrument deployed was a set of HOTS mathematics problems that had been aligned with the revised Bloom's Taxonomy. Based on data analysis using a t-test, a significance value of 0.000 (below 0.05) was obtained. This figure confirms that ChatGPT significantly impacts student learning outcomes. Therefore, it can be concluded that ChatGPT is effective in supporting students in solving HOTS problems concerning number patterns. It is noteworthy that research on ChatGPT's effectiveness typically focuses on enhancing critical thinking among university students, thus specific studies on its influence on the HOTS abilities of middle school students remain quite limited. Therefore, it is necessary to start thinking about how to integrate AI into mathematics learning.

There is no Figure or data content available for this article

References

• Abraham, I., Tjalla, A., & Indrajit, R. E. (2021). HOTS (High Order Thingking Skill) dalam Paedagogik Kritis. JISIP (Jurnal Ilmu Sosial Dan Pendidikan), 5(3). https://doi.org/10.36312/jisip.v5i3.2211
• Arly, A., Dwi, N., & Andini, R. (2023). Implementasi Penggunaan Artificial Intelligence Dalam Proses Pembelajaran Mahasiswa Ilmu Komunikasi di Kelas A. Prosiding Seminar Nasional Ilmu-Ilmu Sosial (SNIIS), 2, 362–374.
• Auna, H. S., Kuswandi, D., & Hamzah, N. (2024). Studi Perspektif Siswa Terhadap Efektivitas Pembelajaran Matematika dengan Penerapan ChatGPT. Hinef: Jurnal Rumpun Ilmu Pendidikan, 3 (1), 13-25. https://doi.org/10.37792/hinef.v3i1.1160
• Barana, A., Marchisio, M., & Roman, F. (2023). Fostering Problem Solving and Critical Thinking in Mathematics through Generative Artificial Intelligence. 20th International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2023), Celda, 377–385.
• Darman, R. (2024). Peran ChatGPT Sebagai Artificial Intelligence Dalam Menyelesaikan Masalah Pertanahan dengan Metode Studi Kasus dan Black Box Testing. Tunas Agraria, 7(1), 18–46. https://doi.org/10.31292/jta.v7i1.256
• Defianti, A., & Putri, D. H. (2023). Penerapan Model Pembelajaran Kooperatif Tipe Jigsaw dengan Case Method untuk Melatihkan Keterampilan Berkomunikasi Mahasiswa. Jurnal Penelitian Pembelajaran Fisika, 14(1), 107–112. https://doi.org/10.26877/jp2f.v14i1.14734
• Deng, R., Jiang, M., Yu, X., Lu, Y., Liu, S. (2025). Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies. Computers and Education 227 105224, 1-35. https://doi.org/10.1016/j.compedu.2024.105224
• Diantama, S. (2023). Pemanfaatan Artificial Intelegent (AI) dalam Dunia Pendidikan, IJEN: Indonesian Journal on Education and Learning, 1 (1), 11-19.
• Dini Amaliya, N., & Anas, N. (2024). Pengaruh Metode Eksperimen terhadap Kemampuan Berpikir Kritis Peserta Didik Usia Madrasah Ibtidaiyah. In Jurnal Kependidikan Didaktik, 13 (2), 2037-2048. https://doi.org/10.58230/27454312.752
• Doc, N. Van, Thi, N., Nam, H., Thanh, N. T., & Giam, N. M. (2023). International Journal of Current Science Research and Review Teaching Mathematics with the Assistance of an AI Chatbot to Enhance Mathematical Thinking Skills for High School Students. 06(12), 8574–8580. https://doi.org/10.47191/ijcsrr/V6-i12-102
• Faizien, M. I., Fuad, Y., & Sofro, A. (2023). Pengaruh Kreativitas Siswa terhadap Kemampuan Siswa dalam Menyelesaikan Soal Tipe HOTS. Journal Focus Action of Research Mathematic (Factor M), 6(2), 59–72. https://doi.org/10.30762/f_m.v6i2.1365
• Farizi, Z. A., Nurfadilah, Arifin, A. S., & Fitriani, N. (2025). Optimizing Students’ HOTS Skills through AI and IoT Integration in Digital Technology Learning. Jurnal Pendidikan MIPA, 25(January), 1719–1737. https://doi.org/http://dx.doi.org/10.23960/jpmipa/v25i4.pp1719-1737
• Fricticarani, A., Hayati, A., Hoirunisa, I., & Mutiara Rosdalina, G. (2023). Strategi Pendidikan untuk Sukses di Era Teknologi 5.0. JIPTI: Jurnal Inovasi Pendidikan dan Teknologi Informasi, 4(1), 56-68. https://doi.org/10.52060/pti.v4i1.1173
• Guo, Y., & Lee, D. (2023). Leveraging ChatGPT for Enhancing Critical Thinking Skills. Journal of Chemical Education, 100(12), 4876–4883. https://doi.org/10.1021/acs.jchemed.3c00505
• Hanila, S., Afif Alghaffaru, M., Ekonomi, F., & Manajemen, P. (2023). Pelatihan Penggunaan Artificial Intelligence (AI) Terhadap Perkembangan Teknologi Pada Pembelajaran Siswa Sma 10 Sukarami Kota Bengkulu. In Jurnal Dehasen Mengabdi, 2 (2), 222-226. https://doi.org/10.37676/jdm.v2i2.4890
• Maritsa, A., Hanifah Salsabila, U., Wafiq, M., Rahma Anindya, P., & Azhar Ma’shum, M. (2021). Pengaruh Teknologi Dalam Dunia Pendidikan. Al-Mutharahah: Jurnal Penelitian Dan Kajian Sosial Keagamaan, 18(2), 91–100. https://doi.org/10.46781/al-mutharahah.v18i2.303
• Mehrvarz, M., Salimi, G., Abdoli, S., McLaren, B. M. (2025). How does students’ perception of ChatGPT shape online learning engagement and performance? Computers and Education: Artificial Intelligence 9 100459, 1-15. https://doi.org/10.1016/j.caeai.2025.100459
• Miller, C. J., Smith, S. N., & Pugatch, M. (2020). Experimental and quasi-experimental designs in implementation research. Psychiatry Research, 283(June 2019), 112452. https://doi.org/10.1016/j.psychres.2019.06.027
• Noviyana, H., Nurdiana, A., Haya Zakia, A., Pgri, S., & Lampung, B. (2024). Kemampuan Penalaran Matematis Siswa dalam Menyelesaikan Soal HOTS melalui Model Pembelajaran IMPROVE. Jurnal Edumath, 10(2), 152–160. https://doi.org/10.52657/je.v10i2.2456
• Rahmaini, N., & Chandra, S. O. (2024). Pentingnya Berpikir Kritis Dalam Pembelajaran Matematika. Griya Journal of Mathematics Education and Application, 4(1), 1-8. https://mathjournal.unram.ac.id/index.php/Griya/indexGriya
• Rohyati & Purwanto, J. (2023). The Effect of PBL Model on Students' Mathematical Problem-Solving Ability Based on HOTS Questions. AlphaMath: Journal of Mathematics Education, 9 (2), 183-188. https://doi.org/10.30595/alphamath.v9i2.19119
• Rostikawati, Y., Kartiwi, Y. M., Syaridah, E. F. (2021). Kemampuan Berpikir Kritis Mahasiswa dalam Menyelesaikan Soal-Soal High Order Thinking Skill (HOTS). Diglosia: Jurnal Pendidikan, Kebahasaan, dan Kesusastraan Indonesia, 5 (1), 59-68.
• Sembiring, B. O. & Napitupulu, E. E. (2022). Development of Interactive Student’s Worksheets to Improve Mathematical HOTS of Tenth Grade Students in Trigonometry Topic. AlphaMath: Journal of Mathematics Education, 8 (2), 99-110 https://doi.org/10.30595/alphamath.v8i2.14363
• Setiawan, A., & Luthfiyani, U. K. (2023). Penggunaan ChatGPT Untuk Pendidikan di Era Education 4.0: Usulan Inovasi Meningkatkan Keterampilan Menulis. JURNAL PETISI (Pendidikan Teknologi Informasi), 4(1), 49–58. https://e-journal.unimudasorong.ac.id/index.php/jurnalpetisi/article/view/784
• Simsek A.C., Anders G., Göth J., Specht L. & Huff M. (2025). Is ChatGPT a good study companion? The role of AI-generated summaries and reflective prompts in learning from educational videos. Computers and Education: Artificial Intelligence, 1-15. https://doi.org/10.1016/j.caeai.2025.100512
• Sitompul, E. S., Panjaitan, S. M., Purnamasari, C., Sitepu, (2023). Analisis Kemampuan Berpikir Tingkat Tinggi (HOTS) Standar Pisa Siswa dalam Menyelesaikan Soal Cerita pada Materi Operasi Aljabar di Kelas VII SMP Negeri 1 Sipispis. Innovative: Journal of Social Science Research, 3 (2), 1-15. https://j-innovative.org/index.php/Innovative/article/view/1413
• Sriyanti Konoras, R., Eka Chandra, F., Afandi, A., Studi Pendidikan Matematika, P., Khairun, U., & Author, C. (2022). Analisis kemampuan berpikir kritis matematis siswa dalam pemecahan masalah matematika pada materi sistem persamaan linear dua variabel (SPLDV). Jurnal Didactical Mathematics, 11(1), 282-294. https://doi.org/10.31949/dm.v5i2.5907
• Suharmawan, W. (2023). Pemanfaatan Chat GPT Dalam Dunia Pendidikan. Education Journal : Journal Educational Research and Development, 7(2), 158–166. https://doi.org/10.31537/ej.v7i2.1248
• Suryokta, E., Taruklimbong, W., & Sihotang, H. (2023). Peluang dan Tantangan Penggunaan AI (Artificial Intelligence) dalam Pembelajaran Kimia. Jurnal Pendidikan Tambusai, 7 (3), 26745-26756. https://doi.org/10.31004/jptam.v7i3.11167
• Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10(1), 1-24. https://doi.org/10.1186/s40561-023-00237-x
• van den Berg, G., & du Plessis, E. (2023). ChatGPT and Generative AI: Possibilities for Its Contribution to Lesson Planning, Critical Thinking and Openness in Teacher Education. Education Sciences, 13(10), 1-12. https://doi.org/10.3390/educsci13100998
• Wiwin Rif’atul Fauziyati. (2023). Dampak Penggunaan Artificial Intelligence (AI) dalam Pembelajaran Pendidikan Agama Islam. Jurnal Review Pendidikan dan Pengajaran, 6(4), 2180-2186. https://doi.org/10.31004/jrpp.v6i4.21623

How to Cite This

Article Metrics

Download Statistics

Other Statistics

Copyright and Permissions

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors published in this journal agree to the following terms:

• The copyright of each article is retained by the author (s) without restrictions
• The journal allows the author(s) to retain publishing rights without restrictions
• The author grants the journal the first publication rights with the work simultaneously licensed under the Creative Commons Attribution License, allowing others to share the work with an acknowledgement of authorship and the initial publication in this journal.
• Authors may enter into separate additional contractual agreements for the non-exclusive distribution of published journal versions of the work (for example, posting them to institutional repositories or publishing them in a book), with acknowledgement of their initial publication in this journal
• Authors are permitted and encouraged to post their work online (For example in the Institutional Repository or on their website) before and during the submission process, as this can lead to productive exchanges, as well as earlier and larger citations of published work
• Articles and all related material published are distributed under a Creative Commons Attribution-4.0 International Public License (CC - BY 4.0).

License

AlphaMath: Journal of Mathematics Education is licensed under a Creative Commons Attribution- 4.0 International Public License (CC - BY 4.0).

You are free to :

Share — copy and redistribute the material in any medium or format

Adapt — remix, transform, and build upon the material for any purpose, even commercially

Data Availability