Raters’ Rating Quality in Assessing Students’ Assignment: An Application of Multi-Facet Rasch Measurement

Raters’ Rating Quality in Assessing Students’ Assignment: An Application of Multi-Facet Rasch Measurement

Authors

Chan Kuan Loong

Jabatan Ilmu Pendidikan, Institut Pendidikan Guru Kampus Tengku Ampuan Afzan (Malaysia)

Abdul Jalil Mohamad

Jabatan Ilmu Pendidikan, Institut Pendidikan Guru Kampus Tengku Ampuan Afzan (Malaysia)

Mohd Syafiq bin Zainuddin

Jabatan Ilmu Pendidikan, Institut Pendidikan Guru Kampus Tengku Ampuan Afzan (Malaysia)

Navindran a/l Ramanujan

Jabatan Ilmu Pendidikan, Institut Pendidikan Guru Kampus Tengku Ampuan Afzan (Malaysia)

Ikmal Hisham bin Mat Idera

Jabatan Ilmu Pendidikan, Institut Pendidikan Guru Kampus Tengku Ampuan Afzan (Malaysia)

Publication Information

Journal Title: International Journal of Research and Innovation in Social Science (IJRISS)
Author(s): Loong,Chan Kuan ;Mohamad, Abdul Jalil ;Zainuddin, Mohd Syafiq bin ;Ramanujan,Navindran a/l ;Idera,Ikmal Hisham bin Mat
Published On: 02/02/2026
Volume: 9
Issue: 10
First Page: 2330
Last Page: 2342
ISSN: 2454-6186

Cite this Article Loong,Chan Kuan ;Mohamad, Abdul Jalil ;Zainuddin, Mohd Syafiq bin ;Ramanujan,Navindran a/l ;Idera,Ikmal Hisham bin Mat, Raters’ Rating Quality in Assessing Students’ Assignment: An Application of Multi-Facet Rasch Measurement
, Volume 9 Issue 10, International Journal of Research and Innovation in Social Science (IJRISS),2330-2342, Published on 02/02/2026, Available at https://rsisinternational.org/journals/ijriss/view/raters-rating-quality-in-assessing-students-assignment-an-application-of-multi-facet-rasch-measurement

Abstract

Assessing students’ assignments is essential as it reflects students’ understanding and achievements. This study evaluates the marking quality among lecturers at the Teacher Education Institute (IPG) using the Multi-Facet Rasch Measurement (MFRM) model. Two hundred thirty-two students from the Postgraduate Diploma in Education (PDPP) program submitted written assignments, which were assessed by experienced lecturers. The analysis was conducted using FACETS 4.1.1 software, involving three main facets: candidates, raters, and assessment criteria. The findings indicate that the instrument used is valid in terms of construct and meets unidimensionality requirements. The reliability value of the raters was high (0.81), and the rater separation index exceeded the set threshold (2.09), indicating stability in marks given by lecturers. However, two raters were identified as showing misfit and overfit patterns respectively, suggesting inaccuracies in scoring. The Wright map and unexpected response analysis also revealed differences in the severity among raters and potential bias. These findings are valuable for the IPG in improving monitoring of inter-rater reliability and marking consistency. This study also shows that MFRM can provide comprehensive information and contribute to understanding the analysis of assessor consistency with quantitative evidence. MFRM is a suitable alternative model to overcome the limitations of the Classical Test Theory (CTT) statistical model, especially in analyses involving multiple raters.

Keywords: Rating quality, lecturers, MFRM

Comments

  • No comments yet.
  • Add a comment