Validation of The Academic Success Instrument Using Polytomous Item Response Theory
DOI:
https://doi.org/10.61841/6r9w1v34Keywords:
validation, academic success instrument, polytomous IRT.Abstract
Several instruments that measuring an academic success have been developed and published. However, a psychometrically sound instrument to measure academic success that suitable for the Malaysian context needs to be validated. Therefore, this study aimed to validate on Academic Success Inventory for College Students (ASICS) instrument which contains 49 items in Malaysian context. The sample comprised 305 students from three schools. Data was analyzed based on the Polytomous Item Response Theory (IRT) using the Xcalibre software. Based on the chi-square, p-value, and the -2 LogLikelihood, Samejima's Graded Rating Model was found to be the most fit model with the data. Unidimensionality assumption and local independence were tested using the exploratory factor analysis and were fulfilled. The instrument’s reliability was overall very satisfactory (α=0.89) and the construct validity was also fulfilled with the value of 0.86. Therefore, this instrument adds to the limited collection of locally validated instruments in the field of educational assessment and evaluation.
Downloads
References
Cohen, R. J., & Swerdlik, M. E. (2002). Psychological Testing and Assessment: An Introduction to Test and Measurement
(5th ed.). McGraw-Hill Companies, Inc.
de Ayala, R. J. (2009). The Theory and Practice of Item Response Theory. New York: The Guilford Press.
Demirtaşlı, N., Yalçın, S., & Ayan, C. (2016). The development of IRT based attitude scale towards educational measurement course. Journal of Measurement and Evaluation in Education and Psychology, 7(1), 133-144.
Embretson, S. E., & Reise, S. P. (2000). Item Response Theory for Psychologists. Mahwah, New Jersey: Lawrence Erlbaum Associates, Inc.
Griethuijsen, R. v., Eijck, M. v., Haste, H., Brok, P. d., Skinner, N. C., Mansour, N., . . . BouJaoude, S. (2015). Global patterns in students’ views of science and interest in science. Research in Science Education, 45(4), 581–603. doi:10.1007/s11165-014-9438-6
Guyer, R., & Thompson, N. A. (2013). User’s Manual for Xcalibre™ Item Response Theory Calibration Software, Version 4.2. Woodbury MN: Assessment Systems Corporation.
Hambleton, R. K., Rogers, H. J., & Swaminathan, H. (1991). Fundamentals of Item Response Theory. USA: Sage Publication.
Hishamuddin Ahmad; Siti Eshah Mokshein. (2016). Is 3PL IRT an appropriate model for dichotomous item analysis of A&P final exam? Malaysian Science & Mathematics Education Journal, 6(1), 13-23.
John, C., Greg, B., Linda, W., Elizabeth, V., & Karen, H. (2014). Development of an instrument to measure student use of academic success skills: An exploratory factor analysis. Measurement and Evaluation in Counseling and Development, 47(3), 171-180. doi:10.1177/0748175613505622
Kelley, T. L. (1927). Interpretation of Educational Measurements. New York: World Book Company.
Ostini, R., & Nering, M. L. (2006). Polytomous Item Response Theory Models. Thousand Oaks, California: Sage Publications, Inc.
Prevatt, F., Huijun, L., Welles, T., Festa-Dreher, D., Yelland, S., & Lee, J. (2011). The academic success inventory for college students: Scale development and practical implications for use with students. Journal of College Admission, 26-31.
Sadeghi-Gandomani, H., & Adib- Hajbaghery, M. (2018). Psychometric properties of Persian version of academic success inventory for college students. Nursing and Midwifery Studies, 7(4), 174-179.
Taber, S. K. (2017). The use of Cronbach’s alpha when developing & reporting research instruments in science education.
Research in Science Education, 1-24. doi:10.1007/s11165-016-9602-2
Travis, T. Y., Charles, G., & Susan, R. (2015). Defining and measuring academic success. Practical Assessment, Research & Evaluation, 20(5), 1-20.
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format for any purpose, even commercially.
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
- Attribution — You must give appropriate credit , provide a link to the license, and indicate if changes were made . You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation .
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.
