Developing and Validating Four Resource Model-Based Critical Literacy Assessment Instruments for EFL Learners
Keywords:
assessment, critical literacy, foreign language,, literacy assessment, pedagogyAbstract
This research was done using the Four Resource Model as a framework to validate tools for assessing literacy awareness in English learners. The study employed a mixed methodology, integrating qualitative elements with quantitative validation, and focused on fourth year English students at Oda Bultum University. Tools, including a questionnaire, observation checklist and test items, were developed for the purpose of assessing the level of literacy and tools’ worthiness in reading classroom. A preliminary study of 16 participants demonstrated the reliability of the questionnaire and Cronbach’s alpha of .71 indicated initial feasibility. The results underlined the importance of the Four Resource Model as a theoretical basis for the design of assessments and to promote literacy that goes beyond decoding to include socially-contextualized and critically engaged practice. From the teaching point of view, the study highlighted the need for context-sensitive tools that not only assess but also improve the ability of learners to analyze texts, thus facilitating the transformation of English as Foreign Language learning. More research into long-term methods may be needed to bridge this gap and to check the long-term consequences of theoretical and pedagogical views in the English as a Foreign Language context.
Downloads
References
Luke, A. (2018). Critical literacy in Australia: A matter of context and standpoint: In Critical literacy, schooling, and social justice (pp. 168-188): Routledge.
Bacon, C. K. (2017). Multilanguage, multipurpose: A literature review, synthesis, and framework for critical literacies in English language teaching. Journal of Literacy Research, 49(3), 424-453.
Griva, E., & Papadopoulos, I. (2019):" MulDiLanguaging" for Fostering Intercultural Communicative Competence in Second/Foreign Language Education: Language Teaching Research Quarterly, 11, 54- 67.
Luke, A. (2013): Defining critical literacy. In Moving critical literacies forward (pp. 19-31): Routledge.
Shin, H., & Crookes, G. (2005): Exploring the possibilities for EFL critical pedagogy in Korea: A two-part case study. Critical inquiry in language studies: An international journal, 2(2), 113-136.
Gadotti, M., & Torres, C. A. (2009): Paulo Freire: education for development: Development and change, 40(6), 1255- 1267.
Shor, I., & Freire, P. (1987): What is the “dialogical method” of teaching: Journal of education, 169(3), 11- 31?
Janks, H. (2010): Language, power and pedagogies: Sociolinguistics and language education, 1(3), 40-61.
Brown, C. W., & Alford, J. (2023): Critical Literacy in the Language Classroom: Possibilities for Intercultural Learning through Symbolic Competence. Intercultural Communication Education, 6(2), 36-52.
Saito, S. (2022): Language Awareness and High School English Teaching in Japan: Taking a Translanguaging Lens to a'Monolingual'Setting (Doctoral dissertation, Monash University).
Lee, N. A. A., Tazijan, F. N., Adam, A. F. M., Ikhsanudin, I., & Bakar, R. A. (2025). Comparative analysis of digital literacy and 21st-century skills among university graduates in Malaysia and Indonesia: The role of collaboration, critical thinking, communication, and creativity. Journal of Nusantara Studies (JONUS), 10(1), 166-191.
Ma, Q., Crosthwaite, P., Sun, D., & Zou, D. (2024): Exploring ChatGPT literacy in language education: A global perspective and comprehensive approach. Computers and education: Artificial intelligence, 7, 100278.
Gee, J. P. (1999). Critical issues: Reading and the new literacy studies: Reframing the national academy of sciences report on reading: Journal of literacy research, 31(3), 355-374.
Street, B. (2003). What’s ‘new’in new literacy studies? Critical approaches to literacy in theory and practice: Current issues in comparative education, 5(2).
Guba, E. G., & Lincoln, Y. S. (1994): Competing paradigms in qualitative research: Handbook of qualitative research, 2(163-194), 105.
Polit, D. F., & Beck, C. T. (2010): Essentials of nursing research: Appraising evidence for nursing practice: Lippincott Williams & Wilkins.
Al-Osail, A. F., Ibrahim, A. M., Al-Dosari, M. N., Ibrahim, A. R., Abdellatif, M. S., Tashtoush, M. A., ... & Nemt-Allah, M. A. (2026). Statistical Analysis of the Academic Procrastination Scale Demonstrates its Psychometric Properties Through a Rigorous Four- Factor Validation Study.
Sato, K., Mutoh, A. N., & Kleinsasser, R. C. (2022): Longitudinal research on EFL teacher professional development in (Japanese) contexts: Collaborative action research projects: Language Teaching Research, 26(3), 477-503.
Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice: Journal of black psychology, 44(3), 219-246.
Messick, S. (1996): Validity and washback in language testing: Language testing, 13(3), 241-256.
Smith, M. K., Jones, F. H., Gilbert, S. L., & Wieman, C. E. (2013): The Classroom Observation Protocol for Undergraduate STEM (COPUS): A new instrument to characterize university STEM classroom practices. CBE—Life Sciences Education, 12(4), 618-627.
Wang, X., & Wang, S. (2024): Exploring Chinese EFL learners’ engagement with large language models: A self- determination theory perspective: Learning and Motivation, 87, 102014.
Taherdoost, H. (2016): Validity and reliability of the research instrument; how to test the validation of a questionnaire/survey in a research: International journal of academic research in management (IJARM), 5.
Nijakowska, J., Tsagari, D., & Spanoudis, G. (2020): Cross-country comparison of EFL teacher preparedness to include dyslexic learners: Validation of a questionnaire. Studies in Second Language Learning and Teaching, 10(4), 779-805.
Razavipour, K., & Raji, B. (2022): Reliability of measuring constructs in applied linguistics research: A comparative study of domestic and international graduate theses: Language Testing in Asia, 12(1), 16.
Santos, J. S., Andrade, W. L., Brunet, J., & Melo, M. R. A. (2020, October).A systematic literature review of methodology of learning evaluation based on item response theory in the context of programming teaching: In 2020 IEEE Frontiers in Education Conference (FIE) (pp. 1-9) IEEE.
Banitalebi, Z., Estaji, M., & Brown, G. T. (2025): Measuring teacher assessment literacy in digital environments: Development and validation of a scenario- based instrument. Educational Technology & Society, 28(2), 169-215.
Kato, M. (2022): Examining the Dependability and Practicality of Analytic Rubric of Summary Writing Using Multivariate Generalizability Theory: Focusing on Japanese University Students with Lower-Intermediate Proficiency in English. English Language Teaching, 15(9), 82-94.
Kormos, J., & Indrarathne, B. (2025): Specific learning differences in learning, teaching, and assessing additional languages. Language Teaching, 1-25.
Razavipour, K., & Raji, B. (2022): Reliability of measuring constructs in applied linguistics research: A comparative study of domestic and international graduate theses: Language Testing in Asia, 12(1), 16.
López-Nuñez. J. A., Alonso-García, S; Berral- Ortiz, B., and Victoria-Maldonado, J. J (2024): A systematic review of digital competence evaluation in higher education: Education Sciences, 14(11), 1181.
Bobkina, J., & Stefanova, S. (2016). Literature and critical literacy pedagogy in the EFL classroom: Towards a model of teaching critical thinking skills: Studies in second language learning and teaching, 6(4), 677-696.
Novianti, N., Thomas, A., & To, V. (2020): Addressing challenges in the practice of critical literacy in EFL classrooms: A new framework.
Papadopoulos, I., & Griva, E. (2017): Promoting critical literacy in the EFL context: Implementing a project to young learners: European Journal of Language and Literature, 7(1), 107.
Silvhiany, S., Huzaifah, S., & Ismet, I. (2021): Critical digital literacy: EFL students’ ability to evaluate online sources: Indonesian Journal of EFL and Linguistics, 6(1), 249.
Gee, J. P. (2004): Learning language as a matter of learning social languages within discourses. Language learning and teacher education: A sociocultural approach, 18, 13-31.
Janks, H. (2013): Critical literacy in teaching and research1. Education inquiry, 4(2)- 225-242.
Morrell, E. (2015). Critical literacy and urban youth: Pedagogies of access, dissent, and liberation: Routledge.
Creswell, J. W., & Plano Clark, V. L. (2018): Designing and conducting mixed methods research (3rd ed.). Thousand Oaks, CA: Sage.
Dörnyei, Z. (2007): Research methods in applied linguistics. Oxford: Oxford University Press.
Johnson, R. B., & Onwuegbuzie, A. J. (2004): Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14–26.
Comber, B. (2015): Critical literacy and social justice: Routledge.
Vasquez, V. M. (2017): Critical literacy across the K–6 curriculum: Routledge.
