Validity and Reliability of the Design and Technology Instrument
DOI:
https://doi.org/10.61841/z3dwvx22Keywords:
Design and Technology, D&T, Validity, Reliability, Rasch Measurement ModelAbstract
This study was conducted to generate empirical evidence on the validity and reliability of the items for new instrument in Design and Technology (D&T) subject. The measurement of RBT subject instruments that had been prepared consisted of 41 skill items is distributed to 100 teachers. Cluster random sampling and simple random sampling methods were utilized in selecting a total of 100 secondary school teachers all over Peninsular Malaysia who teach the subject of D&T. Two stages of processes were used to identify and validate constructs. The first stage involved the identification of constructs using exploratory factor analysis method and the second stage was construct validation stage using the Rasch measurement model. The purpose of the establishment of this instrument is to measure the four main constructs of this study, which is; (1) Designing skill; (2) Sketching skill; (3) Applying Technology skill; (4) Designing in marketing skill. At the end of the analysis, it is found that there is a total of 13 polytomous items that were discarded because they did not fulfil the inspection criteria specified in accordance to the Rasch Model. The final instrument recorded a total of 27 polytomous items subsequently that can only be used to measure the four constructs of the study. In conclusion, this study has established valid constructs for development of instruments for measuring design and technology subject.
Downloads
References
[1] Arasinah Kamis, Che Ghani Che Kob, Haryanti Mohd Affandi, Faizal Amin Nur Yunus, Paiman &
Widihastuti. (2019). The Effect of Implementing the Green Skills Module on Design andTechnology
Subject: Assessing the pupils’ green skills practices. Journal of Engineering Science andTechnology
Special Issue on ICEES2018, 14 (Special Issue), 18-25. ISSN: 1823-4690.
[2] Alwi, A., Kamis, A., & Ismail, B. L. H. (2018). Effects of Green Skills Module in Design and Technology
Subjects on the Student’s Knowledge in Primary School. International Journal of Academic Research in
Business and Social Sciences, 8(11), 1701–1712.
[3] Arasinah K, Ab. Rahim B, Ramlah H, Soaib A, Norhaily Ab. H (2014) Technical Skills, Knowledge
Competencies and Expected Changes in the Clothing Industry. BEST: International Journal Humanities,
Arts, Medicine & Sciences 2(1), 1-12.
[4] Azrilah Abdul Aziz, Mohd Saidfudin Masodi, & Azami Zaharim (2015). Asas model pengukuran Rasch.
UKM, Bangi.
[5] Benson, C. (2009). Design and technology: A ‘new’ subject for the English national curriculum. In A. Jones
& M. de Vries (Eds.), International handbook of research and development in technology education (pp. 17–
30). Rotterdam: Sense.
[6] Bond, T. G. & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human
sciences (3rd ed.). Mahwah, New Jersey: Lawrence Erlbaum Associates.
[7] Conrad, K. J., Conrad K. M., Mazza, J., Riley, B. B., Funk, R., Stein, M. A., & Dennis, M. L.
(2012). Dimensionality,hierarchical structure, age generalizability, and criterion validity of the
GAIN's Behaviioral Complexity Scale. Psychological Assessment, 24(4), 913-924, doi:10.1037/a0028196
[8] DeVellis, R. F. (2012). Scale Development: Theory and Applications, 3rd ed. Thousand Oaks, CA: Sage
Publications, ch. 3, pp. 31-58
[9] Fisher, W. P. Jr. (2007). Rating Scale Instrument Quality Criteria. Rasch measurement
transaction,21(1),1095. Retrieved from http://www.rasch.org/rmt/rmt211m.htm
[10] Huei, O.K., Rus, R.C., & Kamis, A. (2019). Need Analysis: Competency Development measurement
Instrument in Mastering the Content of Design and Technology Subject in High School. International
Journal of Academic Research in Business and Social Sciences, 9(6), 1043–1052
[11] Jones, L. C. R. (2016). An investigation into the knowledge and skill requirements for effective teaching of
technology in English secondary schools (Version 1). figshare. Retrieved
fromhttps://hdl.handle.net/2134/21101
[12] Kamis, A., Mohamed, S. M., Hanapi, Z., Kob, C. G. C., & Jamaluddin, R. (2017). Fashion and clothing
instrument for Malaysian fashion lecturers: An analysis of the instructors’ competency scale. Geografia:
Malaysian Journal of Society and Space, 12(3).
[13] Kamis, A., Ahmad Puad, F. N., Mohamed, S., Che’Rus, R., Bujeng, B., Syamwil, R., & Budiastuti, E.
(2018). Items’ Validity and Reliability Using Rasch Measurement Model for Factors that Influence Clothing
Disposal Behaviour. Indian Journal of Public Health Research & Development, 9(11). 1344-1353
[14] Linacre, J. M. (2004). Test validity and Rasch measurement: construct, content, etc. Rasch Measurement
Transactions, 18(1), 970-971
[15] Linacre, J. M. (2007). A user’s guide to WINSTEPS Rasch-model computer programs. Chicago, Illinois:
MESA Press.
[16] Martin, M. (2008). “Competence in Question: The Relevance of the Design and Technology Association
Minimum Competences to Initial Teacher Education." figshare. https://hdl.handle.net/2134/3520.
[17] Mohd Kashfi Mohd Jailani. (2011). Manual Pengenalan Pengukuran Rasch & Winsteps. Pengukuran dan
Penilaian dalam Pendidikan. Fakulti Pendidikan Universiti Kebangsaan Malaysia.
[18] Yasin, R. M., Yunus, F. A. N., Rus, R. C., Ahmad, A., & Rahim, M. B. (2015). Validity and reliability
learning transfer item using a rasch measurement model. Procedia-Social and Behavioral Sciences, 204,
212217.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Author
This work is licensed under a Creative Commons Attribution 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format for any purpose, even commercially.
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
- Attribution — You must give appropriate credit , provide a link to the license, and indicate if changes were made . You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation .
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.
