Jabatan Ilmu Pendidikan, Institut Pendidikan Guru Kampus Tengku Ampuan Afzan (Malaysia)
Jabatan Ilmu Pendidikan, Institut Pendidikan Guru Kampus Tengku Ampuan Afzan (Malaysia)
Jabatan Ilmu Pendidikan, Institut Pendidikan Guru Kampus Tengku Ampuan Afzan (Malaysia)
Jabatan Ilmu Pendidikan, Institut Pendidikan Guru Kampus Tengku Ampuan Afzan (Malaysia)
Jabatan Ilmu Pendidikan, Institut Pendidikan Guru Kampus Tengku Ampuan Afzan (Malaysia)
Publication Information
Journal Title: International Journal of Research and Innovation in Social Science (IJRISS)
Author(s): Loong,Chan Kuan ;Mohamad, Abdul Jalil ;Zainuddin, Mohd Syafiq bin ;Ramanujan,Navindran a/l ;Idera,Ikmal Hisham bin Mat
Published On: 02/02/2026
Volume: 9
Issue: 10
First Page: 2330
Last Page: 2342
ISSN: 2454-6186
Cite this Article Loong,Chan Kuan ;Mohamad, Abdul Jalil ;Zainuddin, Mohd Syafiq bin ;Ramanujan,Navindran a/l ;Idera,Ikmal Hisham bin Mat, Raters’ Rating Quality in Assessing Students’ Assignment: An Application of Multi-Facet Rasch Measurement
, Volume 9 Issue 10, International Journal of Research and Innovation in Social Science (IJRISS),2330-2342, Published on 02/02/2026, Available at https://rsisinternational.org/journals/ijriss/view/raters-rating-quality-in-assessing-students-assignment-an-application-of-multi-facet-rasch-measurement
Assessing students’ assignments is essential as it reflects students’ understanding and achievements. This study evaluates the marking quality among lecturers at the Teacher Education Institute (IPG) using the Multi-Facet Rasch Measurement (MFRM) model. Two hundred thirty-two students from the Postgraduate Diploma in Education (PDPP) program submitted written assignments, which were assessed by experienced lecturers. The analysis was conducted using FACETS 4.1.1 software, involving three main facets: candidates, raters, and assessment criteria. The findings indicate that the instrument used is valid in terms of construct and meets unidimensionality requirements. The reliability value of the raters was high (0.81), and the rater separation index exceeded the set threshold (2.09), indicating stability in marks given by lecturers. However, two raters were identified as showing misfit and overfit patterns respectively, suggesting inaccuracies in scoring. The Wright map and unexpected response analysis also revealed differences in the severity among raters and potential bias. These findings are valuable for the IPG in improving monitoring of inter-rater reliability and marking consistency. This study also shows that MFRM can provide comprehensive information and contribute to understanding the analysis of assessor consistency with quantitative evidence. MFRM is a suitable alternative model to overcome the limitations of the Classical Test Theory (CTT) statistical model, especially in analyses involving multiple raters.
Keywords: Rating quality, lecturers, MFRM
Copyright © 2023 Gyaanarth.com