Differential Item Functioning (DIF) Using Rasch Model in Diagnostic Test Instrument
DOI:
https://doi.org/10.61841/vxdcgt83Keywords:
Reliability, Differential Item Functioning – DIf, Gender-Biased,, DIF Critical t Value, FairnessAbstract
Detecting differential item is one way of determining the reliability of an instrument. The researcher used Rasch model (Differential Item Functioning Analysis – DIF) to identify the items which are gender- biased in the Diagnostic Test of Lower Secondary Bahasa Melayu System (DTLSBMS) instrument. Gender-biased detection is done on all items since the study found the existence of different academic performance based on gender and the analyses of public examination results like UPSR, PMR and SPM. Female students’ performance was better than male students. The items in the instrument should be fair to all test takers. This instrument has 289 items and six constructs which were verified by seven experts. The samples were 935 Form One students from ten districts in Pahang, Malaysia. Alpha Cronbach index values (KR20) for the whole items were 0.98 while the Alpha Cronbach index values for each construct was between 0.71 and 0.95. The result of the study found that four items of Morphology construct and two items of syntax had critical DIF t-value (more than ±2.0 logits) whereby the DIF contrast value was still at ±0.5. In short, UDSBMR instrument has good reliability and fairness as a diagnostic test tool.
Downloads
References
1. Abdul Ghafar, M. N. (2011). Pembinaan dan Analisis Ujian Bilik Darjah. Johor: Universiti Teknologi
Malaysia Press.
2. Ariffin, S. R. (2008). Inovasi Dalam Pengukuran dan Penilaian Pendidikan. Selangor: Universiti
Kebangsaan Malaysia.
3. Ahmad, A. (2014). Pentaksiran Pendidikan. Kuala Lumpur: Dewan Bahasa dan Pustaka.
4. Bachman, L. F., Lyle, F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing
useful language tests. Oxford University Press.
5. Bond, T. G., & Fox, C. M. (2007). Applying the Rasch model: Fundamental measurement in the human
sciences. East Sussex: Psychology Press.
6. Brown, H. D., & Abeywickrama, P. (2010). Principles of language assessment. In Language Assessment:
Principles and Classroom Practices. Abeywickrama, P. & Brown, H. D. (Eds.), New York: Pearson Longman pp. 25-51.
7. Ebel, R. L., & Frisbie, D. A. (1991). Essentials of Educational Measurement. New Jersey: Prentice Hall.
8. Fisher Jr, W. P. (2007). Rasch measurement transaction. Transaction of the Rasch Measurement SIG
American Educational Research Association, 21(1), 1095.
9. Fisher, W. P. (2007). Rating scale instrument quality criteria. Rasch Measurement Transactions, 21(1),
1095.
10. Gronlund, N. E. (1993). How to make achievement tests and assessments. Boston: Allyn & Bacon.
11. Gronlund, N. E., & Linn, R. L. (1990). Measurement and Evaluation in Teaching. New York: McMillan
Publishing Company.
12. Henning, G. (1987). A guide to language testing: Development, evaluation, research. Massachusetts:
Newberry House Publishers.
13. Kementerian Pelajaran Malaysia. (2006). Manual Prosedur Pengendalian Ujian Diagnostik Pengajaran- Pembelajaran Sains dan Matematik Dalam Bahasa Inggeris (PPSMI) 2006. Putrajaya: Lembaga
Peperiksaan Malaysia.
14. Linacre, J. M. (1997). KR-20/Cronbach Alpha or Rasch person reliability: Which tells the “truth”. Rasch
Measurement Transactions, 11(3), 580-581.
15. Linacre, J. M. (1999). Understanding Rasch measurement: Estimation methods for Rasch
measures. Journal of Outcome Measurement, 3, 382-405.
16. Linacre, J. M., Stone, M. H., William, J., Fisher, P., & Tesio, L. (2002). Rasch Measurement. Rasch
Measurement Transactions, 16, .
17. Linacre, J. M. (2004). Estimation methods for Rasch measures. Introduction to Rasch Measurement, 25-
48.
18. Linacre, J. M. (2004). Test validity, and Rasch measurement: Construct, content, etc. Rasch Measurement
Transactions, 18(1), 970-971.
19. Linacre, J. M. (2010). Predicting responses from Rasch measures. Journal of Applied Measurement, 11(1),
1-10.
20. Linacre, J. M. (2010). When to stop removing items and persons in Rasch misfit analysis. Rasch
Measurement Transactions, 23(4), 1241.
21. Lembaga Peperiksaan Malaysia. (2018). Laporan Peperiksaan SPM 2017. Putrajaya: Lembaga
Peperiksaan Malaysia.
22. Nordin, A.B. & Abu Bakar, B. (2008). Pentaksiran dalam Bilik Darjah. Selangor: Longman.
23. Noll, V. H., Scannell, D. P., & Craig, R. C. (1979). Introduction to educational measurement.
Massachusetts: Houghton Mifflin Harcourt (HMH).
24. Neukrug, E. S., & Fawcett, R. C. (2014). Essentials of testing and assessment: A practical guide for
counselors, social workers, and psychologists. Tennessee: Nelson Education.
25. Wright, B. D., & Stone, M. H. (2004). Making measures. Chicago: Phaneron Press.
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format for any purpose, even commercially.
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
- Attribution — You must give appropriate credit , provide a link to the license, and indicate if changes were made . You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation .
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.
