Developing and Validating Four Resource Model-Based Critical Literacy Assessment Instruments for EFL Learners

Authors

Keywords:

assessment, critical literacy, foreign language,, literacy assessment, pedagogy

Abstract

This research was done using the Four Resource Model as a framework to validate tools for assessing literacy awareness in English learners. The study employed a mixed methodology, integrating qualitative elements with quantitative validation, and focused on fourth year English students at Oda Bultum University. Tools, including a questionnaire, observation checklist and test items, were developed for the purpose of assessing the level of literacy and tools’ worthiness in reading classroom. A preliminary study of 16 participants demonstrated the reliability of the questionnaire and Cronbach’s alpha of .71 indicated initial feasibility. The results underlined the importance of the Four Resource Model as a theoretical basis for the design of assessments and to promote literacy that goes beyond decoding to include socially-contextualized and critically engaged practice. From the teaching point of view, the study highlighted the need for context-sensitive tools that not only assess but also improve the ability of learners to analyze texts, thus facilitating the transformation of English as Foreign Language learning. More research into long-term methods may be needed to bridge this gap and to check the long-term consequences of theoretical and pedagogical views in the English as a Foreign Language context.

Downloads

Download data is not yet available.

Author Biographies

Ashenafi Shimeles, Haramaya University

Ph.D Candidate at School of Foreign Language and Journalism, Haramaya University, Haramaya, Ethiopia.

Dereje Tadesse, Haramaya University

Associate Professor, School of Foreign Language and Journalism, Haramaya University, Haramaya, Ethiopia.

Alemayehu Getachew, Haramaya University

Assistant Professor, School of Foreign Language and Journalism, Haramaya University, Haramaya, Ethiopia.

Abera Admasu, Haramaya University

Assistant Professor, School of Foreign Language and Journalism, Haramaya University, Haramaya, Ethiopia.

References

Luke, A. (2018). Critical literacy in Australia: A matter of context and standpoint: In Critical literacy, schooling, and social justice (pp. 168-188): Routledge.

Bacon, C. K. (2017). Multilanguage, multipurpose: A literature review, synthesis, and framework for critical literacies in English language teaching. Journal of Literacy Research, 49(3), 424-453.

Griva, E., & Papadopoulos, I. (2019):" MulDiLanguaging" for Fostering Intercultural Communicative Competence in Second/Foreign Language Education: Language Teaching Research Quarterly, 11, 54- 67.

Luke, A. (2013): Defining critical literacy. In Moving critical literacies forward (pp. 19-31): Routledge.

Shin, H., & Crookes, G. (2005): Exploring the possibilities for EFL critical pedagogy in Korea: A two-part case study. Critical inquiry in language studies: An international journal, 2(2), 113-136.

Gadotti, M., & Torres, C. A. (2009): Paulo Freire: education for development: Development and change, 40(6), 1255- 1267.

Shor, I., & Freire, P. (1987): What is the “dialogical method” of teaching: Journal of education, 169(3), 11- 31?

Janks, H. (2010): Language, power and pedagogies: Sociolinguistics and language education, 1(3), 40-61.

Brown, C. W., & Alford, J. (2023): Critical Literacy in the Language Classroom: Possibilities for Intercultural Learning through Symbolic Competence. Intercultural Communication Education, 6(2), 36-52.

Saito, S. (2022): Language Awareness and High School English Teaching in Japan: Taking a Translanguaging Lens to a'Monolingual'Setting (Doctoral dissertation, Monash University).

Lee, N. A. A., Tazijan, F. N., Adam, A. F. M., Ikhsanudin, I., & Bakar, R. A. (2025). Comparative analysis of digital literacy and 21st-century skills among university graduates in Malaysia and Indonesia: The role of collaboration, critical thinking, communication, and creativity. Journal of Nusantara Studies (JONUS), 10(1), 166-191.

Ma, Q., Crosthwaite, P., Sun, D., & Zou, D. (2024): Exploring ChatGPT literacy in language education: A global perspective and comprehensive approach. Computers and education: Artificial intelligence, 7, 100278.

Gee, J. P. (1999). Critical issues: Reading and the new literacy studies: Reframing the national academy of sciences report on reading: Journal of literacy research, 31(3), 355-374.

Street, B. (2003). What’s ‘new’in new literacy studies? Critical approaches to literacy in theory and practice: Current issues in comparative education, 5(2).

Guba, E. G., & Lincoln, Y. S. (1994): Competing paradigms in qualitative research: Handbook of qualitative research, 2(163-194), 105.

Polit, D. F., & Beck, C. T. (2010): Essentials of nursing research: Appraising evidence for nursing practice: Lippincott Williams & Wilkins.

Al-Osail, A. F., Ibrahim, A. M., Al-Dosari, M. N., Ibrahim, A. R., Abdellatif, M. S., Tashtoush, M. A., ... & Nemt-Allah, M. A. (2026). Statistical Analysis of the Academic Procrastination Scale Demonstrates its Psychometric Properties Through a Rigorous Four- Factor Validation Study.

Sato, K., Mutoh, A. N., & Kleinsasser, R. C. (2022): Longitudinal research on EFL teacher professional development in (Japanese) contexts: Collaborative action research projects: Language Teaching Research, 26(3), 477-503.

Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice: Journal of black psychology, 44(3), 219-246.

Messick, S. (1996): Validity and washback in language testing: Language testing, 13(3), 241-256.

Smith, M. K., Jones, F. H., Gilbert, S. L., & Wieman, C. E. (2013): The Classroom Observation Protocol for Undergraduate STEM (COPUS): A new instrument to characterize university STEM classroom practices. CBE—Life Sciences Education, 12(4), 618-627.

Wang, X., & Wang, S. (2024): Exploring Chinese EFL learners’ engagement with large language models: A self- determination theory perspective: Learning and Motivation, 87, 102014.

Taherdoost, H. (2016): Validity and reliability of the research instrument; how to test the validation of a questionnaire/survey in a research: International journal of academic research in management (IJARM), 5.

Nijakowska, J., Tsagari, D., & Spanoudis, G. (2020): Cross-country comparison of EFL teacher preparedness to include dyslexic learners: Validation of a questionnaire. Studies in Second Language Learning and Teaching, 10(4), 779-805.

Razavipour, K., & Raji, B. (2022): Reliability of measuring constructs in applied linguistics research: A comparative study of domestic and international graduate theses: Language Testing in Asia, 12(1), 16.

Santos, J. S., Andrade, W. L., Brunet, J., & Melo, M. R. A. (2020, October).A systematic literature review of methodology of learning evaluation based on item response theory in the context of programming teaching: In 2020 IEEE Frontiers in Education Conference (FIE) (pp. 1-9) IEEE.

Banitalebi, Z., Estaji, M., & Brown, G. T. (2025): Measuring teacher assessment literacy in digital environments: Development and validation of a scenario- based instrument. Educational Technology & Society, 28(2), 169-215.

Kato, M. (2022): Examining the Dependability and Practicality of Analytic Rubric of Summary Writing Using Multivariate Generalizability Theory: Focusing on Japanese University Students with Lower-Intermediate Proficiency in English. English Language Teaching, 15(9), 82-94.

Kormos, J., & Indrarathne, B. (2025): Specific learning differences in learning, teaching, and assessing additional languages. Language Teaching, 1-25.

Razavipour, K., & Raji, B. (2022): Reliability of measuring constructs in applied linguistics research: A comparative study of domestic and international graduate theses: Language Testing in Asia, 12(1), 16.

López-Nuñez. J. A., Alonso-García, S; Berral- Ortiz, B., and Victoria-Maldonado, J. J (2024): A systematic review of digital competence evaluation in higher education: Education Sciences, 14(11), 1181.

Bobkina, J., & Stefanova, S. (2016). Literature and critical literacy pedagogy in the EFL classroom: Towards a model of teaching critical thinking skills: Studies in second language learning and teaching, 6(4), 677-696.

Novianti, N., Thomas, A., & To, V. (2020): Addressing challenges in the practice of critical literacy in EFL classrooms: A new framework.

Papadopoulos, I., & Griva, E. (2017): Promoting critical literacy in the EFL context: Implementing a project to young learners: European Journal of Language and Literature, 7(1), 107.

Silvhiany, S., Huzaifah, S., & Ismet, I. (2021): Critical digital literacy: EFL students’ ability to evaluate online sources: Indonesian Journal of EFL and Linguistics, 6(1), 249.

Gee, J. P. (2004): Learning language as a matter of learning social languages within discourses. Language learning and teacher education: A sociocultural approach, 18, 13-31.

Janks, H. (2013): Critical literacy in teaching and research1. Education inquiry, 4(2)- 225-242.

Morrell, E. (2015). Critical literacy and urban youth: Pedagogies of access, dissent, and liberation: Routledge.

Creswell, J. W., & Plano Clark, V. L. (2018): Designing and conducting mixed methods research (3rd ed.). Thousand Oaks, CA: Sage.

Dörnyei, Z. (2007): Research methods in applied linguistics. Oxford: Oxford University Press.

Johnson, R. B., & Onwuegbuzie, A. J. (2004): Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14–26.

Comber, B. (2015): Critical literacy and social justice: Routledge.

Vasquez, V. M. (2017): Critical literacy across the K–6 curriculum: Routledge.

Downloads

Published

2026-09-25

How to Cite

Shimeles, A., Tadesse, D., Getachew, A., & Admasu, A. (2026). Developing and Validating Four Resource Model-Based Critical Literacy Assessment Instruments for EFL Learners. Journal of Social Science and Humanities, 2(2), 57–76. Retrieved from https://journals.wgu.edu.et/index.php/sshr/article/view/2326