CONTENT ANALYSIS OF ENGLISH ASSESSMENT RUBRICS USED IN SENIOR HIGH SCHOOLS RELIABILITY, TRANSPARENCY, AND LEARNING OUTCOME ALIGNMENT
DOI:
https://doi.org/10.36526/sosioedukasi.v14i4.6704Keywords:
assessment rubrics, reliability, transparency, alignmentAbstract
This study examines the quality of English assessment rubrics used in senior high schools through an in-depth qualitative content analysis focusing on three key dimensions: reliability, transparency, and alignment with learning outcomes. A total of 12 rubrics were collected from public and private schools and analyzed alongside semi-structured interviews with English teachers. The findings reveal substantial inconsistencies in rubric construction, with only a minority of rubrics demonstrating clearly differentiated performance descriptors. Most rubrics employ vague evaluative terms and lack operational indicators, reducing their usefulness in guiding both assessment and student learning. Alignment with the Merdeka Curriculum was also limited, as several rubrics did not fully represent mandated competencies such as logical reasoning, content organization, and coherence. Interview data further highlight systemic challenges, including limited teacher training, time constraints, and reliance on generic online rubrics. These issues collectively undermine rubric reliability and transparency, resulting in subjective scoring and misaligned evaluations. The study underscores the need for standardized rubric development guidelines, targeted professional development, and stronger institutional support to ensure high-quality assessment practices. The findings contribute to enhancing the integrity of English assessment and provide practical insights for teachers, schools, and policymakers committed to implementing curriculum-aligned, competency-based evaluation systems.
References
Adie, L., & Cumming, J. (2022). Assessment alignment in competency-based education: A review. Assessment in Education, 29(4), 482–499.
Airasian, P., & Russell, M. (2012). Classroom assessment: Concepts and applications (7th ed.). McGraw-Hill.
Andrade, H. (2019). A critical review of research on student self-assessment. Frontiers in Education, 4(87), 1–13. https://doi.org/10.3389/feduc.2019.00087
Andrade, H., & Brookhart, S. (2020). Classroom assessment as the core of pedagogy. Routledge.
Ariyanti, G., & Retnawati, H. (2022). The quality of English assessment rubrics used by teachers: A document analysis. Indonesian Journal of English Education, 9(2), 245–260.
Baird, J., Andrich, D., Hopfenbeck, T., & Stobart, G. (2020). Assessment and learning: Research foundations for a future-oriented competence model. Educational Review, 72(5), 627–646.
Bakker, T., & van der Veen, C. (2023). Evaluating rubric transparency in EFL classrooms: A cross-national study. Language Assessment Quarterly, 20(2), 145–162.
Boud, D., & Dawson, P. (2021). What happens when students are given rubric criteria? Effects on learning and assessment. Higher Education Research & Development, 40(3), 489–503.
Bowen, G. A. (2019). Document analysis as a qualitative research method. Qualitative Research Journal, 9(2), 27–40.
Brookhart, S. M. (2018). How to create and use rubrics for formative assessment and grading. ASCD.
Carmichael, P., Luo, J., & Griffiths, H. (2023). Teacher learning communities and assessment literacy: A systematic review. Teaching and Teacher Education, 121, 103964.
Creswell, J. W., & Poth, C. (2018). Qualitative inquiry and research design: Choosing among five approaches (4th ed.). SAGE Publications.
Dawson, P. (2021). Reliability issues in rubric-based assessment: A global synthesis of research. Assessment & Evaluation in Higher Education, 46(7), 1081–1094.
DeLuca, C., & Braund, H. (2023). Improving teacher assessment literacy: Evidence from professional development interventions. Studies in Educational Evaluation, 76, 101220.
Harding, L., & Kremmel, B. (2023). Developments in language assessment literacy: Implications for EFL teachers. Language Testing, 40(1), 97–120.
Hidayati, N., & Prihantoro, R. (2023). Translating curriculum standards into assessment criteria: Challenges for Indonesian EFL teachers. TESOL Journal, 14(1), e00700.
Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2(2), 130–144.
Khoiruman, M. A., Irawan, D. H., & Istiari, N. R. (2025). Implementasi Pembelajaran Bahasa dengan Metode Mind Mapping dan Tpack (Technological Pedagogical Content Knowledge) Pada Siswa SMA Nu Gombengsari Kalipuro Banyuwangi. Jurnal Medika: Medika, 4(3), 275-282.
Kohnke, L., & Zou, D. (2023). Validity considerations in digital language assessment environments. Computer Assisted Language Learning, 36(6), 579–596.
Krippendorff, K. (2019). Content analysis: An introduction to its methodology (4th ed.). SAGE Publications.
Moskal, B. M., & Leydens, J. (2000). Scoring rubric development: Validity and reliability. Practical Assessment, Research, and Evaluation, 7(10), 1–7.
Myyry, L., Tynjälä, P., & Collin, K. (2021). The impact of rubric transparency on student learning and engagement. Assessment & Evaluation in Higher Education, 46(4), 606–620.
Nicol, D., & McCallum, S. (2023). Calibration and feedback literacy in performance assessment. Assessment in Education, 30(2), 202–219.
Nitko, A. J., & Brookhart, S. M. (2020). Educational assessment of students (8th ed.). Pearson.
Oktaviani, R., & Fitriana, L. (2022). Aligning rubrics with curriculum standards in Indonesian EFL classrooms. Journal of ELT Research, 7(2), 101–118.
Palinkas, L. A., et al. (2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health, 42(5), 533–544.
Panadero, E., & Jonsson, A. (2013). The use of rubrics to increase transparency and reduce anxiety. Assessment in Education, 20(1), 79–98.
Peterson, E., & Peterson, P. (2022). The motivational role of transparent assessment criteria in language classrooms. Applied Linguistics Review, 13(3), 411–430.
Popham, W. J. (2019). Classroom assessment: What teachers need to know (8th ed.). Pearson.
Putri, D. R., & Hardini, I. (2022). Challenges in rubric development for English teachers in Indonesia. Jurnal Pendidikan Bahasa, 12(1), 55–68.
Saldaña, J. (2021). The coding manual for qualitative researchers (4th ed.). SAGE Publications.
Schreier, M. (2020). Qualitative content analysis in practice (2nd ed.). SAGE Publications.
Suryani, A., & Wijaya, A. (2021). Issues in rubric-based assessment in Indonesian schools. International Journal of Instruction, 14(3), 827–844.
Tai, J., Ajjawi, R., & Boud, D. (2022). Rubrics and the reliability dilemma: A meta-analytic review. Educational Assessment, 27(2), 95–118.
Wahyuni, S., Marzuki, A., & Lestari, M. (2020). Evaluating EFL classroom rubrics in Indonesian secondary schools. Studies in English Language and Education, 7(2), 345–359.
Wilson, M., & Scalise, K. (2024). Designing assessment systems for complex competencies: Challenges and future directions. Educational Measurement: Issues and Practice, 43(1), 45–58.
.png)
