When More Is Not Better: The Nonlinear Association Between Classroom ICT Use and Digital Literacy Across 35 Education Systems
DOI:
https://doi.org/10.59519/mper8202Keywords:
ICT, computer and information literacy, ICILS2023Abstract
This study examined the association between students' classroom use of general ICT applications and computer and information literacy (CIL) across 35 education systems participating in ICILS 2023. Jurisdiction-specific weighted regression models were estimated using all five CIL plausible values and 75 jackknife replicate weights while adjusting for socioeconomic background, sex, and age. Jurisdiction-specific coefficients were synthesized using random-effects meta-analysis. Linear models indicated a modest positive association between classroom ICT use and CIL, but quadratic models consistently provided a better fit. The quadratic coefficient was negative in 34 of the 35 jurisdictions, yielding a pooled estimate of −5.66 (95% CI −6.58 to −4.74). Predicted CIL increased with classroom ICT use to approximately the midpoint of the international scale, after which gains diminished and CIL gradually declined. This nonlinear pattern was remarkably consistent across education systems and did not vary meaningfully by socioeconomic background. These findings suggest that the educational value of classroom ICT use depends not only on how often digital technologies are used, but also on how they are integrated into teaching and learning.
References
1. Aydin, M. (2022). A multilevel modeling approach to investigating factors impacting computer and information literacy: ICILS Korea and Finland sample. Education and Information Technologies, 27(2), 1675-1703. https://doi.org/10.1007/s10639-021-10690-1
2. Abedi, E. A. (2024). Tensions between technology integration practices of teachers and ICT in education policy expectations: implications for change in teacher knowledge, beliefs and teaching practices. Journal of Computers in Education, 11(4), 1215-1234. https://doi.org/10.1007/s40692-023-00296-6
3. Bernard, R. M., Borokhovski, E., Schmid, R. F., & Tamim, R. M. (2023). Gauging the effectiveness of educational technology integration in education: What the best-quality meta-analyses tell us. In Learning, design, and technology: An international compendium of theory, research, practice, and policy (pp. 3929-3952). Cham: Springer International Publishing.
4. Bundsgaard, J., & Gerick, J. (2017). Patterns of students’ computer use and relations to their computer and information literacy: Results of a latent class analysis and implications for teaching and learning. Large-scale Assessments in Education, 5(1), 16. https://doi.org/10.1186/s40536-017-0052-8
5. Cabellos, B., Siddiq, F., & Scherer, R. (2023). The moderating role of school facilitating conditions and attitudes towards ICT on teachers’ ICT use and emphasis on developing students’ digital skills. Computers in Human Behavior, 150, 107994–107994. https://doi.org/10.1016/j.chb.2023.107994
6. Caponera, E., Colonnello, V., Annunziata, F., Palmerio, L., & Russo, P. M. (2026). Digital literacy and ICT use: key predictors of mathematics achievement in schoolchildren. European Journal of Psychology of Education, 41(1), 14. https://doi.org/10.1007/s10212-025-01055-0
7. Caponera, E., Colonnello, V., Palmerio, L., & Russo, P. M. (2026, July). The “golden mean” of ICT use: how moderate use and digital competence predict mathematics achievement. In Frontiers in Education, Vol. 11, p. 1860483. https://doi.org/10.3389/feduc.2026.1860483
8. Chen, M., Christiansen, A., Rožman, M., & Strietholt, R. (2025). Scaling procedures for ICILS 2023 questionnaire items. IEA International Computer and Information Literacy Study 2023: Technical Report, 209-267.
9. Chinonso, O. E., Theresa, A. M.-E., & Aduke, T. C. (2023). ChatGPT for Teaching, Learning and Research: Prospects and Challenges. Global Academic Journal of Humanities and Social Sciences, 5(2), 33–40. https://doi.org/10.36348/gajhss.2023.v05i02.001
10. Conrads, J., Rasmussen, M., Winters, N., Geniets, A., & Langer, L. (2017). Digital education policies in Europe and beyond: Key design principles for more effective policies. Publications office of the European Union.
11. Consoli, T., Schmitz, M. L., Antonietti, C., Gonon, P., Cattaneo, A., & Petko, D. (2025). Quality of technology integration matters: Positive associations with students’ behavioral engagement and digital competencies for learning. Education and Information Technologies, 30(6), 7719-7752. https://doi.org/10.1007/s10639-024-13118-8
12. Dontre, A. J. (2021). The influence of technology on academic distraction: A review. Human Behavior and Emerging Technologies, 3(3), 379-390. https://doi.org/10.1002/hbe2.229
13. Drossel, K., Eickelmann, B., & Vennemann, M. (2020). Schools overcoming the digital divide: in depth analyses towards organizational resilience in the computer and information literacy domain. Large-Scale Assessments in Education, 8(1). https://doi.org/10.1186/s40536-020-00087-w
14. Eger, L., Klement, M., Tomczyk, Ł., Pisoňová, M., & Petrova, G.S. (2018). Different User Groups of University Students and Their ICT Competence: Evidence from Three Countries in Central Europe. Journal of Baltic Science Education, 17(5), 851- 866. https://doi.org/10.33225/jbse/18.17.851
15. Fraillon, J., & Duckworth, D. (2024). Computer and information literacy framework. In IEA International Computer and Information Literacy Study 2023: Assessment framework (pp. 21-34). Cham: Springer Nature Switzerland.
16. Fraillon, J., Rožman, M., Meyer, S., Musu, L., Liaw, Y.-L., Christiansen, A., & Tieck, S. (Eds.). (2026). IEA International Computer and Information Literacy Study 2023 technical report (revised 3 July 2026). IEA.
17. Fraillon, J., Ainley, J., Schulz, W., Friedman, T., & Duckworth, D. (2020). Preparing for life in a digital world: IEA international computer and information literacy study 2018 international report. Springer.
18. Fraillon, J., Ainley, J., Schulz, W., Duckworth, D., & Friedman, T. (2019). IEA international computer and information literacy study 2018 assessment framework (p. 74). Springer Nature.
19. Gebhardt, E., Thomson, S., Ainley, J., & Hillman, K. (2019). Gender differences in computer and information literacy: An in-depth analysis of data from ICILS. Springer Open. https://doi.org/10.1007/978-3-030-26203-7
20. Gorjón, L., & Osés, A. (2023). The negative impact of information and communication technologies overuse on student performance: Evidence from OECD countries. Journal of Educational Computing Research, 61(4), 723-765. https://doi.org/10.1177/07356331221133408
21. Harris, J., Mishra, P., & Koehler, M. (2009). Teachers’ Technological Pedagogical Content Knowledge and Learning Activity Types: Curriculum-based Technology Integration Reframed. Journal of Research on Technology in Education, 41(4), 393–416. https://doi.org/10.1080/15391523.2009.10782536
22. Hatlevik, O. E., Throndsen, I., Loi, M., & Gudmundsdottir, G. B. (2018). Students’ ICT self-efficacy and computer and information literacy: Determinants and relationships. Computers & Education, 118, 107-119. https://doi.org/10.1016/j.compedu.2017.11.011
23. Koehler, M. J., Mishra, P., & Cain, W. (2013). What is technological pedagogical content knowledge (TPACK)?. Journal of Education, 193(3), 13-19. https://doi.org/10.1177/002205741319300303
24. McKnight, K., O'Malley, K., Ruzic, R., Horsley, M. K., Franey, J. J., & Bassett, K. (2016). Teaching in a digital age: How educators use technology to improve student learning. Journal of Research on Technology in Education, 48(3), 194-211. https://doi.org/10.1080/15391523.2016.1175856
25. Meyer, S., Daniel, T., & Tieck, S. (Eds.). (2025b). ICILS 2023 user guide for the international database: Supplements. IEA.
26. Mirazchiyski, P. V. (2025). Students’ Self-Efficacy in General ICT Use as a Mediator Between Computer Experience, Learning ICT at School, ICT Use in Class, and Computer and Information Literacy. Education Sciences, 15(8), 1081. https://doi.org/10.3390/educsci15081081
27. Okoye, K., Haruna, H., Arrona‐Palacios, A., Quintero, H. N., Ortega, L. O. P., Sanchez, A. L., Ortiz, E. A., Escamilla, J., & Hosseini, S. (2022). Impact of digital technologies upon teaching and learning in higher education in Latin America: an outlook on the reach, barriers, and bottlenecks. Education and Information Technologies, 28(2), 2291–2360. https://doi.org/10.1007/s10639-022-11214-1
28. Pérez‐Sanagustín, M., Nussbaum, M., Hilliger, I., Alario‐Hoyos, C., Heller, R. S., Twining, P., & Tsai, C. (2016). Research on ICT in K-12 schools – A review of experimental and survey-based studies in computers & education 2011 to 2015. Computers & Education, 104. https://doi.org/10.1016/j.compedu.2016.09.006
29. R Core Team. (2021). A language and environment for statistical computing. R Foundation for Statistical Computing.
30. Rafiq-uz-Zaman, M. (2023). The Impact of Digital Literacy on Students’ Learning Outcomes: A Comprehensive Review. Inverge Journal of Social Sciences, 2(2), 194-205. https://doi.org/10.63544/ijss.v2i2.210
31. Reddy, P., Sharma, B., & Chaudhary, K. (2020). Digital Literacy. International Journal of Technoethics, 11(2), 65–94. https://doi.org/10.4018/ijt.20200701.oa1
32. Rohatgi, A., Scherer, R., & Hatlevik, O. E. (2016). The role of ICT self-efficacy for students' ICT use and their achievement in a computer and information literacy test. Computers & Education, 102, 103-116. https://doi.org/10.1016/j.compedu.2016.08.001
33. Santos, A. I., & Serpa, S. (2017). The Importance of Promoting Digital Literacy in Higher Education. International Journal of Social Science Studies, 5(6), 90–90. https://doi.org/10.11114/ijsss.v5i6.2330
34. Schmid, R., & Petko, D. (2019). Does the use of educational technology in personalized learning environments correlate with self-reported digital skills and beliefs of secondary-school students?. Computers & education, 136, 75-86. https://doi.org/10.1016/j.compedu.2019.03.006
35. Selwyn, N. (2016). Digital downsides: Exploring university students’ negative engagements with digital technology. Teaching in Higher Education, 21(8), 1006-1021. https://doi.org/10.1080/13562517.2016.1213229
36. Sibagariang, S. A., Pohan, F., Lubis, M. J., & Zainuddin, Z. (2023). Information and communication technology in the world of education: a theoretical and empirical overview–a literature review. Education and Human Development Journal, 8(3), 12-24. https://doi.org/10.33086/ehdj.v8i3.5384
37. Timotheou, S., Miliou, O., Dimitriadis, Y., Villagrá-Sobrino, S., Giannoutsou, N., Cachia, R., Martínez-Monés, A., & Ioannou, A. (2023). Impacts of digital technologies on education and factors influencing schools' digital capacity and transformation: A literature review. Education and Information Technologies, 28(6), 6695–6726. https://doi.org/10.1007/s10639-022-11431-8
38. Tınmaz, H., Lee, Y.-T., Fanea‐Ivanovici, M., & Baber, H. (2022). A systematic review on digital literacy. Smart Learning Environments, 9(1), 21–21. https://doi.org/10.1186/s40561-022-00204-y
39. Tondeur, J., Aesaert, K., Pynoo, B., Braak, J. van, Fraeyman, N., & Erstad, O. (2015). Developing a validated instrument to measure preservice teachers’ ICT competencies: Meeting the demands of the 21st century. British Journal of Educational Technology, 48(2), 462–472. https://doi.org/10.1111/bjet.12380
40. Valverde-Berrocoso, J., Acevedo-Borrega, J., & Cerezo-Pizarro, M. (2022, June). Educational technology and student performance: A systematic review. Frontiers in Education, Vol. 7, p. 916502. https://doi.org/10.3389/feduc.2022.916502
41. Wang, J., & Fan, W. (2025). The Effectiveness of Technology‐Supported Learning in Improving Students' Digital Literacy—A Meta‐Analysis of 56 Experimental and Quasi‐Experimental Studies. Journal of Computer Assisted Learning, 41(6), e70137. https://doi.org/10.1111/jcal.70137
42. Yeung, K. L., Carpenter, S. K., & Corral, D. (2021). A comprehensive review of educational technology on objective learning outcomes in academic contexts. Educational Psychology Review, 33(4), 1583-1630. https://doi.org/10.1007/s10648-020-09592-4
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Selmir Hadžić, Azur Kuduzović, Inga Ibralic, Haris Memisevic (Author)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
