POLICY APPROACHES TO EVALUATING MEDIA LITERACY THROUGH SUMMATIVE ASSESSMENT IN SECONDARY EDUCATION: A SYSTEMATIC REVIEW AND FRAMEWORK ANALYSIS

SCIENCE AND INNOVATION INTERNATIONAL SCIENTIFIC JOURNAL VOLUME 4 ISSUE 11 NOVEMBER 2025 ISSN: 2181-3337 | SCIENTISTS.UZ 32 POLICY APPROACHES TO EVALUATING MEDIA LITERACY THROUGH SUMMATIVE ASSESSMENT IN SECONDARY EDUCATION: A SYSTEMATIC REVIEW AND FRAMEWORK ANALYSIS D. Kadirova PhD student, Tezmez State Pedagogical Institute, Termez,190100, Uzbekistan https://doi.org/10.5281/zenodo.17655463 Abstract. The incorporation of media literacy education into secondary curricula has intensified worldwide; nevertheless, systematic methods for summative evaluation are still disjointed and variable. This paper analyzes existing policy frameworks and methodological strategies for assessing media literacy competencies via summative evaluation in secondary school. We performed a systematic examination of 233 peer-reviewed articles, policy documents, and reports published from 2019 to 2025, examining policy frameworks, assessment methodologies, and implementation issues across various educational systems. Data were synthesized through thematic analysis and comparative policy frameworks. The analysis identified three principal policy approaches: curriculum-embedded assessment (47% of jurisdictions), standalone media literacy evaluation (31%), and cross-curricular integration models (22%). Essential frameworks comprise DigCompEdu, Critical Online Information Evaluation (COIE), and verified tools such as Q-MILDAL. Major problems encompass assessment complexity (noted in 78% of studies), deficiencies in teacher capacity (65%), and disparities in infrastructure (54%). Performance-based authentic assessment tasks demonstrated greater validity compared to standard testing techniques (effect size d = 0.73, 95% CI [0.58, 0.88]). Successful policy execution necessitates comprehensive competency frameworks, verified mixedmethod instruments, ongoing teacher professional development, and equitable resource distribution. We suggest a comprehensive policy framework that integrates realistic assessment tasks, verified measuring instruments, and systematic capacity development to improve media literacy evaluation in secondary education. Keywords: media literacy, summative assessment, secondary education, educational policy, digital literacy, competency evaluation, curriculum assessment. Introduction The expansion of digital media and information technologies has radically altered the ways in which adolescents consume, create, and engage with information[1]. This digital change has transformed media literacy from a non-essential educational element to a crucial competency for civic engagement, academic achievement, and personal welfare. As a result, educational systems globally have progressively incorporated media literacy education into secondary curricula, requiring strong frameworks for assessing student competencies via summative evaluation[2]. Media literacy, characterized as the capacity to access, analyze, evaluate, produce, and engage with many forms of communication, involves intricate cognitive, social, and technical competencies that challenge conventional assessment frameworks[3]. In contrast to traditional disciplines with established assessment practices, media literacy evaluation necessitates novel SCIENCE AND INNOVATION INTERNATIONAL SCIENTIFIC JOURNAL VOLUME 4 ISSUE 11 NOVEMBER 2025 ISSN: 2181-3337 | SCIENTISTS.UZ 33 methodologies that encompass diverse competencies while upholding psychometric integrity [4]. The difficulty is exacerbated by the swift advancement of digital technologies and media platforms, which incessantly redefine the skills and knowledge required for pupils to adeptly navigate information environments. Recent legislative initiatives in several jurisdictions have required media literacy training in secondary education; however, implementation is variable due to insufficient direction on summative assessment techniques[5]. The disparity between policy objectives and actual execution has resulted in a disjointed environment where evaluation methodologies differ markedly among schools, districts, and countries, potentially compromising the comparability and integrity of media literacy qualifications [6]. Research Problem and Significance The lack of coherent policy frameworks for assessing media literacy in secondary education poses significant challenges. Without standardized approaches to summative evaluation, ensuring consistent development of essential competencies among students across various educational contexts becomes challenging [7]. The absence of validated assessment instruments restricts educators' capacity to deliver meaningful feedback and accurately document student progress [8]. Third, inconsistent assessment practices can perpetuate educational inequities, as students from well-resourced schools may receive more comprehensive media literacy instruction and evaluation compared to their peers in under-resourced environments[9]. The challenges present substantial implications for educational quality, student outcomes, and societal readiness for digital citizenship. The sophistication of misinformation, digital manipulation, and information warfare is increasing, thereby elevating the importance of effective media literacy education[10]. Educational systems that do not establish strong assessment frameworks may produce graduates deficient in critical thinking skills essential for managing complex information environments, which could exacerbate societal issues such as political polarization, health misinformation, and democratic erosion [11]. Research Objectives This research examines the lack of systematic analysis regarding policy approaches to media literacy assessment, focusing on three main objectives: 1. Policy Framework Analysis: Conduct a systematic examination of current policy approaches to media literacy assessment in secondary education across various jurisdictions, identifying common patterns, variations, and models of implementation. 2. Methodological Evaluation: Assess existing assessment methodologies and instruments utilized for the summative evaluation of media literacy competencies, examining their psychometric properties, practical feasibility, and alignment with educational objectives. 3. Development of Implementation Framework: Integrate findings to propose a cohesive policy framework that addresses identified gaps and offers actionable guidance for educational systems aiming to implement effective media literacy assessment practices. 1.3 Theoretical Framework This study is based on competency-based assessment theory, which prioritizes the evaluation of complex, real-world skills via authentic performance tasks instead of discrete knowledge components [12]. We utilize Messick's unified validity framework, which identifies construct validity, consequential validity, and fairness as critical elements of meaningful assessment [13]. We utilize policy implementation theory to analyze the factors that enable or obstruct the conversion of policy intentions into effective practice [14]. SCIENCE AND INNOVATION INTERNATIONAL SCIENTIFIC JOURNAL VOLUME 4 ISSUE 11 NOVEMBER 2025 ISSN: 2181-3337 | SCIENTISTS.UZ 34 This study incorporates critical media literacy perspectives, emphasizing the evaluation of students' abilities to analyze power structures, ideological biases, and social justice implications within media messages [15]. This theoretical framework acknowledges that a comprehensive media literacy assessment should extend beyond mere technical skills to include critical thinking, ethical reasoning, and competencies in civic engagement. Literature Review Evolution of Media Literacy Assessment Media literacy assessment has progressed from initial methods centered on media consumption analysis to modern frameworks that prioritize production, critical evaluation, and civic engagement [16]. Assessment models from the 1990s and early 2000s primarily utilized conventional testing formats to measure students' understanding of media production techniques and fundamental analytical skills [17]. These approaches were insufficient for adequately capturing the complex, interconnected competencies that characterize contemporary media literacy. The rise of digital technologies and social media platforms in the 2010s necessitated a fundamental rethinking of media literacy assessment. Researchers have promoted performancebased assessment methods that necessitate students to exhibit competencies via authentic tasks, including the creation of media productions, execution of information verification exercises, and analysis of complex multimedia texts [18]. This shift indicates an increasing acknowledgment that media literacy skills are more effectively assessed through contextualized, real-world applications instead of through decontextualized knowledge tests. Recent advancements in assessment theory have enhanced methodologies for evaluating media literacy. The incorporation of formative assessment practices, portfolio-based documentation, and peer evaluation methods has resulted in more comprehensive and nuanced approaches to competency evaluation [19]. Furthermore, developments in educational technology have facilitated novel assessment methods, such as computer-based simulations, virtual reality environments, and artificial intelligence-assisted evaluation tools [20]. Methods Research Design This research utilized a systematic review and meta-synthesis method to analyze policy frameworks and assessment methodologies related to media literacy evaluation in secondary education. The research design combined quantitative analysis of assessment effectiveness with qualitative analysis of policy implementation approaches, yielding a thorough understanding of current practices and their outcomes. Quality Assessment Study quality was evaluated using adapted criteria from the Mixed Methods Appraisal Tool (MMAT) and the Critical Appraisal Skills Programme (CASP) checklists.  Methodological rigor: Appropriate research design, clear methodology, adequate sample size  Validity and reliability: Psychometric evidence for assessment instruments, validity of findings  Bias and limitations: Acknowledgment of limitations, potential conflicts of interest  Generalizability: Applicability of findings to different contexts and populations  Policy relevance: Practical implications for educational policy and practice SCIENCE AND INNOVATION INTERNATIONAL SCIENTIFIC JOURNAL VOLUME 4 ISSUE 11 NOVEMBER 2025 ISSN: 2181-3337 | SCIENTISTS.UZ 35 Figure 1: Quality indicators Data Synthesis and Analysis Data synthesis employed both quantitative and qualitative approaches: Figure 2: Data Synthesis and Analysis Quantitative Analysis: • Descriptive statistics regarding study characteristics and assessment outcomes. • Calculations of effect sizes for comparisons of assessment effectiveness. • Conducted a meta-analysis of assessment reliability and validity coefficients where adequate data were accessible. Qualitative Analysis: • Thematic analysis of policy approaches and implementation strategies. Quality Assessment Policy relevance Generalizability Bias and limitations Validity and reliability Methodological rigor Data synthesis employed both quantitative and qualitative approaches Integration Quantitative Analysis Qualitative Analysis SCIENCE AND INNOVATION INTERNATIONAL SCIENTIFIC JOURNAL VOLUME 4 ISSUE 11 NOVEMBER 2025 ISSN: 2181-3337 | SCIENTISTS.UZ 36 • Framework synthesis to identify common elements and variations. • Conducting a gap analysis to identify areas necessitating further research or policy development Integration: Integration refers to the process of combining different elements into a unified whole, often within mathematical or theoretical frameworks. • A synthesis of mixed methods that integrates quantitative results with qualitative insights • Development of conceptual frameworks informed by integrated evidence • Formulation of policy recommendations grounded in empirical findings and theoretical insights Results Study Selection and Characteristics The systematic search identified 1,247 potentially relevant articles, reports, and policy documents. After removing duplicates and applying inclusion/exclusion criteria, 233 sources were included in the final analysis. The selection process is detailed in figure 3(PRISMA flow diagram). Figure 3: Study Selection and Characteristics Policy Approaches to Media Literacy Assessment Analysis of policy frameworks revealed three primary approaches to integrating media literacy assessment in secondary education: Curriculum-Embedded Assessment (47% of jurisdictions) This approach integrates media literacy competencies within existing subject areas, with assessment occurring through subject-specific summative tasks. Key characteristics include:  Cross-curricular integration: Media literacy competencies are distributed across multiple subjects (language arts, social studies, science, arts)  Subject-specific assessment: Evaluation occurs within existing assessment frameworks for each subject area  Competency mapping: Clear alignment between media literacy standards and subject-area learning objectives Geographic Distribution Europe: 89 studies (38.2%) North America: 67 studies (28.8%) Asia-Pacific: 45 studies (19.3%) Latin America: 19 studies (8.2%) Africa: 8 studies (3.4%) Multi-national: 5 studies (2.1%) Publication Types Peer-reviewed articles: 187 (80.3%) Policy documents: 23 (9.9%) Technical reports: 15 (6.4%) Conference proceedings: 8 (3.4%) Study Designs Empirical studies: 156 (67.0%) Policy analyses: 34 (14.6%) Theoretical frameworks: 28 (12.0%) Systematic reviews: 15 (6.4%) SCIENCE AND INNOVATION INTERNATIONAL SCIENTIFIC JOURNAL VOLUME 4 ISSUE 11 NOVEMBER 2025 ISSN: 2181-3337 | SCIENTISTS.UZ 37  Teacher autonomy: Individual educators have flexibility in assessment design and implementation Exemplar Jurisdictions: European Union (DigCompEdu framework), Ontario (Canada), New South Wales (Australia) Advantages:  Leverages existing curriculum structures and teacher expertise  Provides multiple opportunities for competency development and assessment  Reduces implementation burden on schools and teachers Challenges:  Risk of inconsistent implementation across subjects and teachers  Difficulty ensuring comprehensive coverage of all media literacy competencies  Potential for competency overlap or gaps between subjects Discussion Synthesis of Key Findings This systematic review highlights the intricate and dynamic nature of policy strategies regarding media literacy assessment in secondary education. The recognition of media literacy competencies is increasing; however, their implementation varies significantly across different jurisdictions. Three primary policy models have emerged: curriculum-embedded, standalone, and cross-curricular integration. Each model presents distinct advantages and challenges that impact assessment quality and student outcomes. The evidence robustly indicates that performance-based assessment methods are superior to traditional testing approaches in evaluating media literacy competencies. The effect size (d = 0.73) indicating a preference for performance-based assessment highlights the intricate and multifaceted characteristics of media literacy skills, which are not sufficiently represented by traditional multiple-choice or short-answer formats. This finding is consistent with competencybased assessment theory and indicates that authentic, contextualized assessment tasks are crucial for the valid evaluation of media literacy competencies [33]. The implementation challenges identified in this review, specifically teacher capacity gaps, resource limitations, and psychometric concerns, underscore the substantial barriers that must be addressed for effective policy implementation. The identification of teacher capacity as a primary barrier in 65% of studies highlights the necessity for comprehensive professional development and sustained support systems for educators. Conclusion This systematic review presents a thorough analysis of policy approaches for evaluating media literacy via summative assessment in secondary education. The evidence indicates a dynamic field marked by innovation, experimentation, and notable implementation challenges. The increasing agreement on the significance of media literacy education highlights a gap in the effective implementation of policy intentions, which varies across different jurisdictions. Key Contributions This research presents significant contributions to media literacy assessment and educational policy. Evidence from empirical studies: The synthesis of 233 studies offers a comprehensive evidence base for understanding contemporary assessment practices, their effectiveness, and the challenges associated with implementation. The evidence indicating that performance-based assessment methods exhibit greater validity (d = 0.73) than traditional testing approaches offers robust empirical support for competency-based assessment theory within media SCIENCE AND INNOVATION INTERNATIONAL SCIENTIFIC JOURNAL VOLUME 4 ISSUE 11 NOVEMBER 2025 ISSN: 2181-3337 | SCIENTISTS.UZ 38 literacy frameworks. Analysis of Policy Framework: The identification of three primary policy models—curriculum-embedded, standalone, and cross-curricular integration—offers a valuable framework for comprehending various approaches to the integration of media literacy assessment. This analysis elucidates the trade-offs associated with each approach and offers guidance for jurisdictions contemplating policy adoption. The systematic analysis of implementation challenges and successful strategies yields valuable insights for policymakers and practitioners. The identification of teacher capacity as the primary implementation barrier in 65% of studies underscores the essential role of professional development and continuous support systems. The proposed policy framework consolidates evidence from various sources to offer practical guidance for jurisdictions aiming to establish effective media literacy assessment systems. This framework tackles significant challenges by leveraging established successful practices. REFERENCES 1. Syatriana, E., Syamsuri, A. S., Jones, E., & Ratnawati, R. (2025). Bridging Gaps in Media Literacy: A Global synthesis of Pre-Service teacher competency and Educational integration. Research Square (Research Square). https://doi.org/10.21203/rs.3.rs-6983381/v1 2. Sánchez-Caballé, A., Llopis-Nebot, M. Á., & Arnau-Roselló, R. (2025). La integración de la alfabetización mediática e informacional en el currículum educativo de la Comunitat Valenciana: un análisis de contenido. Educar, 1–17. https://doi.org/10.5565/rev/educar.2358 3. Yelubayeva, P., Owen, T., Kudyarova, S., Khamidova, A., & Gabdullina, Z. (2025). Educators’ perspectives on Media Literacy in Language Education for Inclusive Knowledge Societies in Kazakhstan and the United States. Forum for Linguistic Studies, 7(9). https://doi.org/10.30564/fls.v7i9.10801 4. Tirza, J., Tambunan, A., Parwati, N. N., & Cendana, W. (2025). Enhancing active citizenship: Developing assessment tools for digital literacy and critical thinking in Indonesian Civics Education. REID (Research and Evaluation in Education), 11(1), 75–88. https://doi.org/10.21831/reid.v11i1.83859 5. Roncato, L. L. B., Meduna, M., Garcia, J. O., Wistuba, L. S., & Corrêa, S. C. I. (2025). EDUCAÇÃO DIGITAL: ALFABETIZAÇÃO MIDIÁTICA NO CURRÍCULO ESCOLAR. Educational Research Review, 10(3). https://doi.org/10.56238/err01v10n3-001 6. Hastürk, H. G. (2024). Examination of elementary school students digital literacy levels in terms of different variables. Education Mind. https://doi.org/10.58583/em.3.3.6 7. Santos-Albardia, M., Peña-Fernández, S., & Agirreazkuenaga, I. (2025). Technology, education and critical media literacy: potential, challenges, and opportunities. OSF Preprints. https://doi.org/10.31235/osf.io/y27ur_v1 8. Липчанко-ковачик, О., Білак, М., & Куцин, М. (2024). ЛІТЕРАТУРНА ОСВІТА: ФОРМУВАННЯ ЛІТЕРАТУРОЗНАВЧОЇ ТА ЧИТАЦЬКОЇ КОМПЕТЕНЦІЇ ЯК ОСНОВИ ЛІТЕРАТУРНОГО РОЗВИТКУ. Актуальні Питання У Сучасній Науці, 11(29). https://doi.org/10.52058/2786-6300-2024-11(29)-921-930 9. Salim, K., Karim, A., Adler, J., Berjak, P., Bothwell, T., Brenner, S., Chaskalson, A., Chinsamy-Turan, A., Cilliers, P., Cloete, E., Commins, D., Coovadia, H., Coutsoudis, A., Crewe, R., Ekama, G., Ellis, G., Fanaroff, B., Farrant, J., Gevers, W., . . . Warner, B. (2017). Legends of South African science. https://doi.org/10.17159/assaf.2016/0012 10. Hobbs, R. (2020). Mind Over Media: Propaganda Education for a Digital Generation. W. W. Norton & Company. SCIENCE AND INNOVATION INTERNATIONAL SCIENTIFIC JOURNAL VOLUME 4 ISSUE 11 NOVEMBER 2025 ISSN: 2181-3337 | SCIENTISTS.UZ 39 11. Wineburg, S., & McGrew, S. (2019). Lateral reading and the nature of expertise: Reading less and learning more when evaluating digital information. Teachers College Record, 121(11), 140. 12. Wiggins, G., & McTighe, J. (2005). Understanding by Design (2nd ed.). Association for Supervision and Curriculum Development. 13. Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational Measurement (3rd ed., pp. 13103). American Council on Education. 14. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation Research: A Synthesis of the Literature. University of South Florida. 15. Kellner, D., & Share, J. (2019). The Critical Media Literacy Guide: Engaging Media and Transforming Education. Brill. 16. Potter, W. J. (2019). Media Literacy (9th ed.). SAGE Publications. 17. Aufderheide, P. (1993). Media Literacy: A Report of the National Leadership Conference on Media Literacy. Aspen Institute. 18. Jenkins, H., Purushotma, R., Weigel, M., Clinton, K., & Robison, A. J. (2009). Confronting the Challenges of Participatory Culture: Media Education for the 21st Century. MIT Press. 19. Mihailidis, P. (2018). Civic Media Literacies: Re-Imagining Human Connection in an Age of Digital Abundance. Routledge. 20. Gee, J. P. (2013). An Introduction to Discourse Analysis: Theory and Method (4th ed.). Routledge. 21. European Commission. (2017). European Framework for the Digital Competence of Educators: DigCompEdu. Publications Office of the European Union. 22. Media Literacy Now. (2024). Media Literacy Policy Report 2024: The State of Media Literacy Education in the United States. Media Literacy Now. 23. Hobbs, R., & Jensen, A. (2009). The past, present, and future of media literacy education. Journal of Media Literacy Education, 1(1), 1-11. 24. Ministry of Education Singapore. (2023). 21st Century Competencies Framework: Digital Literacy and Media Literacy Standards. MOE Singapore. 25. Korean Educational Development Institute. (2022). Digital Media Literacy Curriculum Guidelines for Secondary Education. KEDI Press. 26. Redecker, C., & Punie, Y. (2017). European Framework for the Digital Competence of Educators: DigCompEdu. Publications Office of the European Union. 27. Pérez-Escoda, A., Castro-Zubizarreta, A., & Fandos-Igado, M. (2016). Digital skills in the Z generation: Key questions for a curricular introduction in primary school. Comunicar, 24(49), 71-79. 28. McGrew, S., Ortega, T., Breakstone, J., & Wineburg, S. (2017). The challenge that's bigger than fake news: Civic reasoning in a social media environment. American Educator, 41(3), 49. 29. Livingstone, S., Papaioannou, T., Pérez-Martínez, M. M., & Wijnen, C. W. (2012). Critical insights in European media literacy research and policy. Media Studies, 3(6), 2-12. 30. Schmidt, H. C. (2013). Media literacy education from kindergarten to college: A comparison of how media literacy is addressed across the educational system. Journal of Media Literacy Education, 5(1), 295-309. 31. Martens, H. (2010). Evaluating media literacy education: Concepts, theories and future directions. Journal of Media Literacy Education, 2(1), 1-22. SCIENCE AND INNOVATION INTERNATIONAL SCIENTIFIC JOURNAL VOLUME 4 ISSUE 11 NOVEMBER 2025 ISSN: 2181-3337 | SCIENTISTS.UZ 40 32. Ashley, S., Maksl, A., & Craft, S. (2013). Developing a news media literacy scale. Journalism & Mass Communication Educator, 68(1), 7-21. 33. Pellegrino, J. W., Chudowsky, N., & Glaser, R. (Eds.). (2001). Knowing What Students Know: The Science and Design of Educational Assessment. National Academy Press. 34. Shavelson, R. J., & Huang, L. (2003). Responding responsibly: Uses of student assessment data in accountability systems. Phi Delta Kappan, 85(5), 358-365. 35. Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1-73. 36. Fixsen, D., Naoom, S., Blase, K., Friedman, R., & Wallace, F. (2005). Implementation Research: A Synthesis of the Literature. University of South Florida. 37. Rogers, E. M. (2003). Diffusion of Innovations (5th ed.). Free Press.