ChatGPT Use and Critical Thinking Among Undergraduate Students: A Mixed Methods Study
This study examined undergraduate students' academic ChatGPT practices across critical thinking score categories, focusing on verification, use regulation, and perceived dependence. An observational mixed-methods approach combined a critical thinking test comprising sixteen items, a questionnaire comprising fifteen items, and interviews. Pilot testing involved forty students; Cronbach's alpha coefficients were 0.852 and 0.912 for the test and questionnaire, respectively. The presented interview accounts showed variation within and across score categories. High-scoring interviewees described checking information or limiting use, whereas the moderate-scoring interviewee reported accepting answers without verification. The lower-scoring interviewee reported correcting outputs and prompting again. Several interviewees described perceived dependence or reduced independent engagement, but these accounts did not establish cognitive decline. The original Wilcoxon comparisons did not establish an association or causal effect between use and critical thinking. The study's originality lies in distinguishing answer acceptance, iterative prompting, and independent verification rather than assigning uniform practices to score categories. It contributes contextual evidence for investigating responsible AI engagement and evaluating guidance on source checking and independent reasoning, while acknowledging measurement limitations and restricted generalizability beyond participants.
Downloads
References
Abbas, M., Jam, F. A., & Khan, T. I. (2024). Is it harmful or helpful? Examining the causes and consequences of generative AI usage among university students. International Journal of Educational Technology in Higher Education, 21, Article 10. https://doi.org/10.1186/s41239-024-00444-7
Abu A’la, B., & Makhshun, T. (2022). Transformasi pendidikan: Mentradisikan digitalisasi pendidikan Islam. JOIES (Journal of Islamic Education Studies), 7(2), 159–170. https://doi.org/10.15642/joies.2022.7.2.159-170
Ahiri, Y., Ahiri, J., Harjun, Lewa, M. J., & Syata, W. M. (2026). Pengaruh penggunaan ChatGPT terhadap kemampuan berpikir kritis mahasiswa pendidikan ekonomi. Educational Journal, 1(2), 167–182. https://doi.org/10.63822/9rezm712
Alatas, M., Crismono, P. C., Faisol, A., & Yakoh, M. (2026). Integrating religious moderation values into Islamic STEM education: Its impact on students’ critical thinking skills and scientific literacy. Edusoshum: Journal of Islamic Education and Social Humanities, 6(2), 1443–1454. https://doi.org/10.52366/edusoshum.v6i2.557
Arka Putri, Z. H., Pradana, N. R., Yustraini, Y. A., & Efansyah, A. D. (2024). Analisis pengaruh Chat GPT terhadap keterampilan, kolaborasi, dan kreativitas mahasiswa: Metode systematic literature review identifikasi dampak dan pengaruh. Innovative: Journal of Social Science Research, 4(2), 7983–7999. https://doi.org/10.31004/innovative.v4i2.10268
Arumsari, D., Utama, C. P., Wulandani, D., Kumalsari, S., Syukria, I., & Fajar. (2024). Fenomena penggunaan ChatGPT dalam praktik pendidikan: Antara sisi positif dan negatif. Jurnal Pendidikan Sosiologi Undiksha, 6(1), 70–84. https://doi.org/10.23887/jpsu.v6i1.96086
Asisah, N., Raihani, S. L., & Haliq, A. (2025). Persepsi siswa terhadap penggunaan Chat GPT sebagai belajar di era digital. Pendas: Jurnal Ilmiah Pendidikan Dasar, 10(2), 302–315. https://doi.org/10.23969/jp.v10i02.25043
Bastani, H., Bastani, O., Sungu, A., Ge, H., Kabakcı, Ö., & Mariman, R. (2025). Generative AI without guardrails can harm learning: Evidence from high school mathematics. Proceedings of the National Academy of Sciences, 122(26), Article e2422633122. https://doi.org/10.1073/pnas.2422633122
Bazeley, P. (2024). Conceptualizing integration in mixed methods research. Journal of Mixed Methods Research, 18(3), 225–234. https://doi.org/10.1177/15586898241253636
BP, A. R., Munandar, S. A., Fitriani, A., Karlina, Y., & Yumriani. (2022). Pengertian pendidikan, ilmu pendidikan dan unsur-unsur pendidikan. Al-Urwatul Wutsqa: Kajian Pendidikan Islam, 2(1), 1–8. https://journal.unismuh.ac.id/index.php/alurwatul/id/article/view/7757/0
Creswell, J. W. (2007). Qualitative inquiry and research design: Choosing among five approaches (2nd ed.). SAGE Publications.
Crismono, P. C. (2023). Statistik pendidikan. UIJ Kyai Mojo. https://penerbit.uij.ac.id/index.php?id=4&keywords=&p=show_detail
Crismono, P. C. (2024). Metode penelitian pendidikan: Pendekatan kuantitatif, kualitatif, PTK, dan penelitian pengembangan (F. Hanifiyah & I. Erdiansyah, Eds.). KHD Production.
Crismono, P. C. (2025). Statistik pendidikan (A. N. Budiono, Ed.). Nanopedia.
Crismono, P. C., Hudi, S., Yanuardianto, E., & Ilyas, M. (2025). Research trends in Islamic-based mathematics education: Global studies and academic collaboration networks. International Journal of Current Science Research and Review, 8(3), 1091–1105. https://doi.org/10.47191/ijcsrr/V8-i3-12
Crismono, P., Pitasari, M. A. R., Hanifiyah, F., & Febriyanti, B. (2024). Literacy acceleration: Interactive learning through fairy tale video shows using technology adaptation in elementary school education: Akselerasi literasi: Pembelajaran interaktif melalui tayangan video dongeng menggunakan adaptasi teknologi di pendidikan sekolah dasar. Journal of Community Empowerment for Multidisciplinary (JCEMTY), 2(1), 6–13. https://doi.org/10.53713/jcemty.v2i1.161
DeJonckheere, M., Vaughn, L. M., James, T. G., & Schondelmeyer, A. C. (2024). Qualitative thematic analysis in a mixed methods study: Guidelines and considerations for integration. Journal of Mixed Methods Research, 18(3), 258–269. https://doi.org/10.1177/15586898241257546
Febrianty, C., Sari, M. T. P., & Syarafi, R. H. (2025). Analisis dampak ChatGPT terhadap proses pembelajaran mahasiswa: Systematic literature review. JATI (Jurnal Mahasiswa Teknik Informatika), 9(1), 949–961. https://doi.org/10.36040/jati.v9i1.12513
Guo, Y., Huang, L., Zhang, C., Li, Q., & Chen, M. (2026). ChatGPT in education: A systematic review of its impact on critical thinking skills and dispositions. Thinking Skills and Creativity, 60, Article 102106. https://doi.org/10.1016/j.tsc.2025.102106
Hadarmawandi, Rompegading, A. B., Sir, P., Anita, Y., & Irfandi, R. (2025). Pengaruh penerapan ChatGPT dalam pembelajaran biologi terhadap kemampuan berpikir kritis siswa. Venn: Journal of Sustainable Innovation on Education, Mathematics and Natural Sciences, 4(3), 131–138. https://doi.org/10.53696/venn.v4i3.279
Hanifiyah, F., & Hudi, S. (2023). Bimbingan belajar dengan model GI (Group Investigation) dalam meningkatkan hasil belajar siswa Madrasah Tsanawiyah Gebang Patrang Jember. FAJAR Jurnal Pendidikan Islam, 3(2), 150–159. https://doi.org/10.56013/fj.v3i2.2476
Hanifiyah, F., & Nasrodin. (2021). Implikasi integrasi imtaq dan iptek dalam perkembangan pendidikan Islam. FAJAR Jurnal Pendidikan Islam, 1(1), 1–15. https://doi.org/10.56013/fj.v1i1.1097
Hasnida, S. S., Adrian, R., & Siagian, N. A. (2024). Tranformasi pendidikan di era digital. Jurnal Bintang Pendidikan Indonesia, 2(1), 110–116. https://doi.org/10.55606/jubpi.v2i1.2488
Iriyani, S. A., Patty, E. N. S., Akbar, A. R., Idris, R., & Priyudahari, B. A. P. (2023). Studi literatur: Pemanfaatan teknologi Chat GPT dalam pendidikan. UPGRADE: Jurnal Pendidikan Teknologi Informasi, 1(1), 9–16. https://doi.org/10.30812/upgrade.v1i1.3151
Khaerunnisa, I., Haslan, M. M., & Hudori, A. (2026). Penggunaan artificial intelligence dan dampaknya terhadap kemampuan berpikir kritis mahasiswa PPKn Universitas Mataram. Jurnal Pendidikan, Sains, Geologi, dan Geofisika (GeoScienceEd Journal), 7(3), 4248–4256. https://doi.org/10.29303/goescienceed.v7i3.2703
Kusuma, E., Handayani, A., & Rakhmawati, D. (2024). Pentingnya pengembangan kemampuan berpikir kritis pada siswa sekolah dasar: Sebuah tinjauan literatur. Jurnal Wawasan Pendidikan, 4(2), 369–379. https://doi.org/10.26877/jwp.v4i2.17971
Mairisiska, T., & Qadariah, N. (2023). Persepsi mahasiswa FTIK IAIN Kerinci terhadap penggunaan ChatGPT untuk mendukung pembelajaran di era digital. Jurnal Teknologi Pembelajaran Indonesia, 13(2), 107–124. https://doi.org/10.23887/jurnal_tp.v13i2.2653
Nurlina, Huda, N., Brenda, I., Rohmah, N. L. H., & Putra, W. (2024). Media dependency: Analisis literatur melalui metadata Scopus dan pemetaan ScientoPy. Comdent: Communication Student Journal, 2(1), 81–99. https://doi.org/10.24198/comdent.v2i1.58263
Peters, M., & Fàbregues, S. (2024). Missed opportunities in mixed methods EdTech research? Visual joint display development as an analytical strategy for achieving integration in mixed methods studies. Educational Technology Research and Development, 72(5), 2477–2497. https://doi.org/10.1007/s11423-023-10234-z
Ramadhan, F. K., Faris, M. I., Wahyudi, I., & Kamayani, M. (2023). Pemanfaatan Chat GPT dalam dunia pendidikan. Jurnal Ilmiah Flash, 9(1), 25–30. https://doi.org/10.32511/flash.v9i1.1069
Rochmawati, D. R., Arya, I., & Zakariyya, A. (2023). Manfaat kecerdasan buatan untuk pendidikan. Jurnal Teknologi Komputer dan Informatika, 2(1), 124–134. https://doi.org/10.59820/tekomin.v2i1.163
Rohmah, K., Hanifiyah, F., & Crismono, P. C. (2026). Pesantren culture and character building of female students. Intelektual: Jurnal Pendidikan dan Studi Keislaman, 16(2), 325–340. https://doi.org/10.33367/ji.v16i2.9547
Sadriani, A., Ahmad, M. R. S., & Arifin, I. (2023). Peran guru dalam perkembangan teknologi pendidikan di era digital. Seminar Nasional Dies Natalis 62, 1, 32–37. https://doi.org/10.59562/semnasdies.v1i1.431
Sahril, M. (2026). Pengaruh ChatGPT terhadap kemampuan berpikir kritis mahasiswa pendidikan ekonomi UIN Suka Riau [Skripsi sarjana, Universitas Islam Negeri Sultan Syarif Kasim Riau]. Universitas Islam Negeri Sultan Syarif Kasim Riau Repository. https://repository.uin-suska.ac.id/93093/
Salmi, J., & Setiyanti, A. A. (2023). Persepsi mahasiswa terhadap penggunaan ChatGPT di era pendidikan 4.0. Jurnal Ilmiah Wahana Pendidikan, 9(19), 399–406. https://doi.org/10.5281/zenodo.8403233
Sandy, F., Palangi, W. A., Liling, D., & Pratama, M. P. (2023). Impelentasi penggunaan kecerdasan buatan dalam pendidikan tinggi. Prosiding Universitas Kristen Indonesia Toraja, 3(3), 111–117. https://doi.org/10.47178/prosidingukit.v3i3.2295
Sari, S. Y. N., Pitasari, M. A. R., Crismono, P. C., & Dahri, H. (2026). Problem based learning in Islamic education to enhance critical and creative thinking. Conciencia, 26(1), 33–42. https://doi.org/10.19109/7ysn6c40
Setiyanti, A. A., & Pipa, S. (2025). Implikasi ketergantungan siswa terhadap penggunaan Chat GBT sebagai alat bantu pembelajaran dalam pendidikan di era digital. JIIP: Jurnal Ilmiah Ilmu Pendidikan, 8(3), 3481–3487. https://doi.org/10.54371/jiip.v8i3.7527
Sugiyono. (2023). Metode penelitian kombinasi (mixed methods) dengan 9 desain (Edisi ke-2). Alfabeta.
Suharmawan, W. (2023). Pemanfaatan Chat GPT dalam dunia pendidikan. Education Journal: Journal Education Research and Development, 7(2), 158–166. https://doi.org/10.31537/ej.v7i2.1248
Suryono, M. N. R. N., Bhagaskara, R. E., Pratama, M. A., & Pratama, A. (2023). Analisis pengaruh ChatGPT terhadap produktivitas mahasiswa. Prosiding Seminar Nasional Teknologi dan Sistem Informasi, 3(1), 364–373. https://doi.org/10.33005/sitasi.v3i1.511
Syaadah, R., Ary, M. H. A. A., Silitonga, N., & Rangkuty, S. F. (2022). Pendidikan formal, pendidikan non formal dan pendidikan informal. PEMA: Jurnal Pendidikan dan Pengabdian Kepada Masyarakat, 2(2), 125–131. https://doi.org/10.56832/pema.v2i2.298
Syofiyanti, D., Firdaus, F. N., Julita, R., & Fitri, R. Y. (2026). Analisis AI ChatGPT dan implikasinya terhadap keterampilan berpikir kritis mahasiswa. Amorti: Jurnal Studi Islam Interdisipliner, 5(2), 118–131. https://doi.org/10.59944/amorti.v5i2.861
Ungranesia, J. M., Tan, R. N., Lie, D. E., Yosefian, R. I., & Hariyanto. (2025). Pengaruh Chat GPT terhadap kemampuan berpikir kritis dan analisis mahasiswa. Aletheia Christian Educators Journal, 6(2), 73–83. https://doi.org/10.9744/aletheia.6.2.73-83
Vornika, M., Indasari, L., & Mirawati. (2026). Implementasi literasi digital berbasis kecerdasan buatan AI melalui “Chat GPT” dalam pengembangan HOTS dan berpikir historis mahasiswa pendidikan agama Islam pada mata kuliah Islam dan ilmu sosial humaniora di IAIN Kerinci. Edu Research, 7(2), 46–58. https://doi.org/10.47827/jer.v7i2.2563
Wahid, R., Hikamudin, E., & Hendriani, A. (2023). Analisis penggunaan Chat-GPT oleh mahasiswa terhadap proses pendidikan di perguruan tinggi. Jurnal Pedagogik Indonesia, 1(2), 112–117.
Wu, X., Zhu, P., Zhang, J., Yin, M., & Wang, Y. (2026). ChatGPT’s impact on student learning outcomes: A meta-analysis of 35 experimental studies. Humanities and Social Sciences Communications, 13, Article 684. https://doi.org/10.1057/s41599-026-07019-z
Yanuardianto, E., Wibowo, D. R., & Crismono, P. C. (2024). Innovation in Islamic religious education in the digital era for students’ religious tolerance character building in elementary school: An implementation of Beyond the Wall learning model. JIP Jurnal Ilmiah PGMI, 10(2), 49–61. https://doi.org/10.19109/jip.v10i2.25306
Yasa, I. P. R. P. (2025). Analisis perspektif guru terhadap Chat GPT di SMK Negeri 1 Bangli. Edukasi Elita: Jurnal Inovasi Pendidikan, 2(1), 55–62. https://doi.org/10.62383/edukasi.v2i1.937
Yulianti, G., Benardi, Permana, N., & Wijayanti, F. A. K. (2023). Transformasi pendidikan Indonesia: Menerapkan potensi kecerdasan buatan (AI). Journal of Information Systems and Management (JISMA), 2(6), 102–106. https://jisma.org/index.php/jisma/article/view/1076
Zahra Salsabilla, K. A., Hadi, T. D. F., Pratiwi, W., & Mukaromah, S. (2023). Pengaruh penggunaan kecerdasan buatan terhadap mahasiswa di perguruan tinggi. Prosiding Seminar Nasional Teknologi dan Sistem Informasi, 3(1), 168–175. https://doi.org/10.33005/sitasi.v3i1.371
Downloads
Section
Copyright (c) 2026 Fauzan Adima, Fitriyatul Hanifiyah, Prima Crismono, Saiful Bahri

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.


