SOFTWARE AND PEDAGOGICAL FOUNDATIONS OF THE USE OF MULTIMODAL ARTIFICIAL INTELLIGENCE TECHNOLOGIES IN THE EDUCATIONAL PROCESS
Keywords:
multimodal artificial intelligence, educational process, software foundation, pedagogical foundation, cognitive load, multimedia learning theory, TPACK, UNESCO competency framework, digital didactics, learning analytics.Abstract
The article analyses the software and pedagogical foundations of using multimodal artificial intelligence (AI) technologies in the educational process. The study aims to substantiate the correspondence between the technical architecture of multimodal models and the principles of learning theory, and to identify the pedagogical conditions for their integration into teaching. The theoretical analysis describes the software basis of multimodal AI systems through a three-stage scheme: encoding of modalities, fusion in a shared semantic space, and response generation. R. Mayer’s cognitive theory of multimedia learning and J. Sweller’s cognitive load theory are applied as the pedagogical basis, with an interpretation of the modality, redundancy, coherence and segmenting principles under multimodal AI conditions. UNESCO’s AI competency frameworks for teachers and for students are compared. A four-stage implementation model is proposed, together with five key risks and pedagogical solutions for mitigating them.
References
1.Resolution No. PQ-358 of the President of the Republic of Uzbekistan dated 14 October 2024 “On approval of the Strategy for the Development of Artificial Intelligence Technologies until 2030”. – Tashkent, 2024.
2.UNESCO. AI competency framework for teachers. – Paris: UNESCO, 2024. – 66 p.
3.UNESCO. AI competency framework for students. – Paris: UNESCO, 2024. – 58 p.
4.Mayer R.E. Multimedia Learning. – 3rd ed. – Cambridge: Cambridge University Press, 2021. – 372 p.
5.Mayer R.E. Cognitive theory of multimedia learning // The Cambridge Handbook of Multimedia Learning. – Cambridge: Cambridge University Press, 2014. – P. 43–71.
6.Sweller J. Cognitive load theory // Psychology of Learning and Motivation. – 2011. – Vol. 55. – P. 37–76.
7.Mishra P., Koehler M.J. Technological Pedagogical Content Knowledge: A framework for teacher knowledge // Teachers College Record. – 2006. – Vol. 108, № 6. – P. 1017–1054.
8.UNESCO. Guidance for generative AI in education and research. – Paris: UNESCO, 2023. – 44 p.
9.OECD. Digital Education Outlook 2023: Towards an Effective Digital Education Ecosystem. – Paris: OECD Publishing, 2023. – 194 p.
10.Baidoo-Anu D., Owusu Ansah L. Education in the era of generative artificial intelligence // Journal of AI. – 2023. – Vol. 7, № 1. – P. 52–62.