A Meta-Analysis on Developing Effective Hots Questioning Skills for Stem Teachers in Malaysia
DOI:
https://doi.org/10.61841/71y31772Keywords:
STEM Education, Questioning Skills, Higher-order Thinking Skills (HOTS), STEM Pedagogical DevelopmentAbstract
In developing 21st-century skills, improvement of STEM education is in demand in most countries for solving complex global issues and global economic development. Effective questioning skills by STEM teachers could help to engage and scaffold students in learning and higher-level thinking processes. However, most STEM teachers in Malaysia still applied lower-order and closed-ended questions in teaching and learning sessions because of their lack of knowledge and skills in HOTS questioning. This paper provided an overview of effective strategies to develop HOTS questioning skills. The research methodology was based on a literature review search strategy through ERIC and online databases and journals such as EBSCOhost, ScienceDirect, Scopus, SpringerLink, Web of Science (WoS), SAGE, Taylor & Francis Online, and Wiley Online Library. The keywords used for this research were STEM education, questioning skills, higher-order thinking skills (HOTS), and STEM pedagogical development. From the meta-analysis, the results showed that the promote inquiry approach, proper wait time, pedagogical content knowledge, and recognition were the dominant strategies in questioning, which helped to develop students’ cognitive and HOTS abilities. Findings from this review will guide the STEM teachers to enhance their pedagogical skills, especially in HOTS questioning, and strengthen the quality of STEM education in the future.
Downloads
References
[1] C. McDonald. STEM Education: A Review of the Contribution of the Disciplines of Science, Technology,
Engineering and Mathematics. Sci. Educ. Int., 27(4), 2016, pp.530–569.
[2] E. Hafizan, M. Shahali, I. Ismail, L. Halim. Policy Trajectories and Initiatives in STEM Education. STEM
Education in Malaysia : Policy , Trajectories and Initiatives, 2020, pp.122–133.
[3] S. Chapoo. Enhancement of 9th grader students’ 21st century skills through inquiry-based questions in
integrated STEM activity. AIP Conf. Proc, Vol. 2081, 2019.
[4] R. Yager. The Role of Exploration in the Classroom (STEM). Society, 52(3), 2015, pp.210–218,.
[5] S. Bahrum, N. Wahid, N. Ibrahim. Integration of STEM Education in Malaysia and Why to STEAM, 7(6),
2017, pp.645–654.
[6] T. R. Kelley, J. G. Knowles. A conceptual framework for integrated STEM education. Int. J. STEM Educ.,
2016.
[7] L. Thibaut, H. Knipprath, W. Dehaene, F. Depaepe. The influence of teachers’ attitudes and school
context on instructional practices in integrated STEM education. Teach. Teach. Educ.,71, 2018, pp.190–
205.
[8] Widya, R. Rifandi, Y. Laila Rahmi. STEM education to fulfil the 21 st century demand: a literature review.
J. Phys. Conf. Ser.,1317, 2019, p. 012208.
[9] Ministry of Education Malaysia. Annual Report 2018 Malaysian Educational Blueprint 2013-2025, 2018.
[10] K. C. Margot, T. Kettler. Teachers’ perception of STEM integration and education: a systematic literature
review. Int. J. STEM Educ., 6(1), 2019.
[11] A. Dean, A. Dean. Preceptor Questioning and Student Critical Thinking. 18(3), 2002, pp.176–181.
[12] W. W. Wilen. Review Effective Questions and Questioning : A Research Review. No. April 2015, 2012,
pp.37–41.
[13] S. Merisier, C. Larue, L. Boyer. Nurse Education Today How does questioning in fl uence nursing students
’ clinical reasoning in problem-based learning ? A scoping review. Nurse Educ. Today,65, 2018, pp.108–
115.
[14] J. S. Napp. The Importance of Questioning in Developing Critical Thinking Skills. Int. J. Prof. Educ.,
84(1), 2017, pp.30–41.
[15] T. Tofade, J. Elsner, S. T. Haines. Best Practice Strategies for Effective Use of Questions as a Teaching
Tool. 77(7), 2013.
[16] A. Wang. Exploring the impact of teacher experience on questioning techniques in a Knowledge Building
classroom. J. Comput. Educ., 2016.
[17] Y. Liu. Using reflections and questioning to engage and challenge online graduate learners in education.
Res. Pract. Technol. Enhanc. Learn., 14(1), 2019.
[18] C. P. Magas, L. D. Gruppen, M. Barret, H. Priya. Intraoperative Questioning to Advance Higher-Order
Thinking. Am. J. Surg., 2016.
[19] N. E. Adams. Asking a Great Question : A Librarian Teaches Questioning Skills to First-Year Medical
Students. Medical Reference Services Quarterly, 34(4), 2015, pp.418-427.
[20] A. Sahin. The Effects of Quantity and Quality of Teachers’ Probing and Guiding Questions on Student
Performance. Sak. Univ. J. Educ., 5(1), 95, 2015.
[21] N. . Rajendran. Teaching & Acquiring Higher-Order Thinking Skills Theory & Practice, 3rd Edition.
Tanjong Malim: Penerbit UPSI, 2013.
[22] J. P. Ferguson, V. Prain. Revisiting Peirce’s account of scientific creativity to inform classroom practice.
Educ. Philos. Theory, 0, 2019, pp.1–11.
[23] P. K. Agarwal. Retrieval practice & Bloom’s taxonomy: Do students need fact knowledge before higher
order learning?. J. Educ. Psychol., 111(2), 2019, pp. 189–209.
[24] B. Döş, E. Bay, C. Aslansoy, B. Tiryaki, N. Çetin, C. Duman. An analysis of teachers ’ questioning
strategies. 11(22), 2016, pp. 2065–2078.
[25] H. Pedrosa-de-jesus, A. Moreira, B. Lopes. So much more than just a list : exploring the nature of critical
questioning in undergraduate sciences. Research in Science & Technological Education, 32(2), 2014,
pp.115-134.
[26] M. Shahrill. Review of effective teacher questioning in mathematics classrooms. Int. J. Humanit. Soc. Sci.,
3(17), 2013, pp.224–231.
[27] S. Olusegun. Constructivism Learning Theory : A Paradigm for Teaching and Learning. 5(6), 2015, pp.66–
70.
[28] N. M. Tajudin, M. Puteh, M. Adnan. Developing Themes of Guiding Principles to Foster Higher Order
Thinking Skills in Teaching and Learning of Mathematics. Int. J. Acad. Res. Progress. Educ. Dev., 6(4), 2017, pp.195–199.
[29] G. D. Hendry. Constructivism and educational practice. 40(1), 1996, pp.19–45.
[30] A. A. Yenmez, A. K. Erbas, E. Cakiroglu, C. Alacaci. Mathematics teachers ’ knowledge and skills about questioning in the context of modeling activities. Teach. Dev.,4530, 2017, pp.1–22.
[31] F. Cumhur, S. M. Matteson. Mathematics and Science Teacher Candidates ’ Beliefs of Developing
Questioning Skills in Turkey. Journal of Teacher Education and Educators, 6(3), 2017, pp.297–318.
[32] A. Arase, N. Kamarudin, A. Hassan. The Development of Students’ Capabalities in Higher Order Thinking
Skill (HOTS) Through Science Education. J. Pemikir Pendidik.,7, 2016, pp.1–18.
[33] G. M. Saido, S. Siraj, A. Bakar, B. Nordin, O. Saadallah. Higher Order Thinking Skills Among Secondary
School Students in Science Learning. 3(3), 2015, pp.13–20.
[34] T. Sulaiman, V. Muniyan, D. Madhvan, S. D. Ehsan. Implementation of Higher Order Thinking Skills in
Teaching of Science: A Case Study in Malaysia. International Research Journal of Education and Sciences
( IRJES ), 1(1), 2017.
[35] W. M. W. Yusoff, S. C. Seman. Teachers ’ Knowledge of Higher Order Thinking and Questioning Skills :
A Case Study at a Primary School in Teachers ’ Knowledge of Higher Order Thinking and Questioning
Skills : A Case Study at a Primary School in Terengganu , Malaysia. J. Acad. Res. Progress. Educ. Dev.,
7(2), 2018, pp.1–19.
[36] K. Osman, R. M. Saat. Science technology, engineering and mathematics (STEM) education in Malaysia.
Eurasia J. Math. Sci. Technol. Educ.,10(3), 2014, pp.153–154.
[37] A. Schleicher. PISA 2018 Insights and Interpretations, 2018.
[38] L. D. H. Perera, M. N. Asadullah. Mind the gap: What explains Malaysia’s underperformance in Pisa?. Int.
J. Educ. Dev.,65, 2019 , pp.254–263.
[39] S. L. W. Sim, M. Y. Arshar. A preliminary study of chemistry teachers’ question in inquiry teaching. Sains
Humanika, 2(4), 2010, pp.217–224.
[40] B. Thomas, J. J. Watters. Perspectives on Australian, Indian and Malaysian approaches to STEM education.
Int. J. Educ. Dev., 45, 2015, pp.42–53.
[41] T. J. Lee, N. Kamarudin, O. Talib, A. Hassan. How Does Inquiry-Based Instruction Affect Learning in a
Secondary School Science Class? Empowering 21st Century Learners Through Holistic and Enterprising
Learning, 2017, pp.103–113.
[42] A. M. Ahmad, N. Yakob, N. J. Ahmad. Science, Technology, Engineering and Mathematic (STEM)
Education in Malaysia: Preparing the Pre-service Science Teachers. J. Nat. Sci. Integr., 1(2), 2019, p.159.
[43] N. Baharin, N. Kamarudin, U. K. A. Manaf. Integrating STEM Education Approach in Enhancing Higher
Order Thinking Skills. Int. J. Acad. Res. Bus. Soc. Sci., 8(7), 2018, pp.810–821.
[44] J. Maruthai. Stem Education in Malaysia: Barrier and challenges. Proc. Int. Conf. Glob. Educ. VII
“Humanising Technol. IR 4.0, 2017, 2019, pp.1–2.
[45] K. Jayarajah, R. M. Saat, R. Amnah, A. Rauf. A Review of Science , Technology , Engineering &
Mathematics ( STEM ) Education Research from 1999 – 2013 : A Malaysian Perspective. 10(3), 2014,
pp.155–163.
[46] P. Fatin Aliah, A. Mohd Salleh, A. Mohammad Bilal, S. Salmiza. Faktor penyumbang kepada kemerosotan
penyertaan pelajar dalam aliran. Sains Humanika, 2(4), 2014, pp.63–71.
[47] N. Eliasson, K. G. Karlsson, H. Sørensen. The role of questions in the science classroom–how girls and
boys respond to teachers’ questions. Int. J. Sci. Educ., 39(4), 2017, pp.433–452.
[48] L. Halim, T. S. M. Meerah. Science Education Research and Practice in Malaysia. Science Education
Research and Practice in Asia, Springer International Publishing. Bangi, 2016.
[49] T. S. Yen, S. H. Halili. Effective Teaching of Higher-Order Thinking (HOT) in Education. Online J.
Distance Educ. e-Learning, 3(2), 2015, pp.41–47.
[50] L. W. Anderson, D. R. Krathwohl. A Taxonomy For Learning, Teaching and Accessing (A Revision of
Bloom’s Taxonomy of Educational Objectives), Complete. New York:Longman, 2001.
[51] A. Halim, Yusrizal, H. Mazlina, Melvina, Zainaton. Questioning skill of science teacher from the students
perscpective in senior high school. J. Phys. Conf. Ser., 1088, 2018.
[52] M. M. Chabeli. Higher order thinking skills competencies required by outcomes-based education from
learners. Curationis, 29(3), 2006, pp.78–86.
[53] D. Shukla, P. Dungsungnoen. Students Perceived Level and Teachers Teaching Strategies of Higher Order
Thinking Skills; A Study on Higher Educational Institutions in Thailand. J. Educ. Pr., 7(12), 2016, pp.211–
219.
[54] K. Keong, A. Ong, C. E. Hart, P. K. Chen. Promoting Higher-Order Thinking Through Teacher
Questioning: a Case Study of a Singapore Science Classroom. New Waves Educ. Res. Dev., 19(1), 2016,
pp.1–19.
[55] J. B. Hill. Questioning Techniques : A Study of Instructional Practice. 7930, 2016.
[56] D. Gough. Thinking About Thinking. 1991.
[57] M. Aziza. An Analysis of A Teacher’s Questioning Related to Students’ Responses and Mathematical
Creativity in An Elementary School in The UK. 10(4), 2018, pp.475–487.
[58] S. E. Kastberg, A. E. Lischka, S. L. Hillman. Exploring Mathematics Teacher Educator Questioning as a
Relational Practice : Acknowledging Imbalances Exploring Mathematics Teacher Educator Questioning as
a Relational Practice : Acknowledging Imbalances. Stud. Teach. Educ., 00(00), 2018, pp.1–15.
[59] J. H. Van Driel, A. Berry. Pedagogical content knowledge. Int. Encycl. Educ., 1, 2010, pp.656–661.
[60] D. L. Zeidler. STEM education: A deficit framework for the twenty first century? A sociocultural
socioscientific response. Cult. Stud. Sci. Educ.,11(1), 2016, pp.11–26.
[61] P. Pimthong, J. Williams. Preservice teachers’ understanding of STEM education. Kasetsart J. Soc. Sci.,
2018, pp.1–7.
[62] J. H. Stronge, L. W. Grant, X. Xu. Teacher Behaviours and Student Outcomes, Second Edi.Elsevier, 2015,
Vol. 23.
[63] A. H. Abdullah, M. Mokhtar, N. D. A. Halim, D. F. Ali, L. M. Tahir, U. H. A. Kohar. Mathematics
teachers’ level of knowledge and practice on the implementation of higher-order thinking skills (HOTS).
Eurasia J. Math. Sci. Technol. Educ., 13(1), 2017, pp.3–17.
[64] Y. Zeegers, K. Elliott. Who’s asking the questions in classrooms? Exploring teacher practice and student
engagement in generating engaging and intellectually challenging questions. Pedagogies, 14(1), 2019,
pp.17–32.
[65] B. Yıldırım. An Analyses and Meta-Synthesis of Research on STEM Education. J. Educ. Pract., 7(34),
2016, pp.23–33.
[66] H. Chick, K. Beswick. Teaching teachers to teach Boris: a framework for mathematics teacher educator
pedagogical content knowledge. J. Math. Teach. Educ., 21(5), 2018, pp.475–499.
[67] M. A. Ab Kadir. What Teacher Knowledge Matters in Effectively Developing Critical Thinkers in the 21 st
Century Curriculum? Think. Ski. Creat., 23, 2017, pp.79–90.
[68] S. M. Wechsler et al. Creative and critical thinking: Independent or overlapping components? Think. Ski.
Creat.,27, 2018, pp.114–122.
[69] C. D. Van Booven. Revisiting the Authoritative – Dialogic Tension in Inquiry-Based Elementary Science
Teacher Questioning. International Journal of Science, 2015, pp.37–41.
[70] L. Roets, J. Maritz. Facilitating the development of higher-order thinking skills (HOTS) of novice nursing
postgraduates in Africa. Nurse Educ. Today,49, 2017, pp.51–56.
[71] M. Hähkiöniemi, M. Hähkiöniemi. Student teachers ’ types of probing questions in inquiry-based
mathematics teaching with and without GeoGebra mathematics teaching with and without GeoGebra. Int.
J. Math. Educ. Sci. Technol.,0(0), 2017, pp.1–15.
[72] N. Rutten, J. T. van der Veen, W. R. van Joolingen. Inquiry-Based Whole-Class Teaching with Computer
Simulations in Physics. Int. J. Sci. Educ.,37(8), 2015, pp.1225–1245.
[73] K. Nichols, G. Burgh, C. Kennedy. Comparing Two Inquiry Professional Development Interventions in
Science on Primary Students’ Questioning and Other Inquiry Behaviours. Res. Sci. Educ., 47(1), 2017.
[74] J. P. Bywater, J. L. Chiu, J. Hong, V. Sankaranarayanan. The Teacher Responding Tool: Scaffolding the
teacher practice of responding to student ideas in mathematics classrooms. Comput. Educ.,139, 2019,
pp.16–30.
[75] C. Gaspard and J. Gainsburg. Abandoning questions with unpredictable answers. J. Math. Teach.
Educ.,2019.
[76] C. P. Magas, L. D. Gruppen, M. Barrett, P. H. Dedhia. Intraoperative questioning to advance higher-order
thinking. The American Journal of Surgery, 213(2), 2017, pp.222–226,
[77] K. Festo. Question Classification Taxonomies as Guides to Formulating Questions for Use in Chemistry
Classrooms. Eur. J. Sci. Math. Educ.,4(3), 2016, pp.353–364.
[78] G. Ernst-slavit, K. L. Pratt. Teacher questions : Learning the discourse of science in a linguistically diverse
elementary classroom. Linguist. Educ.,40, 2017, pp.1–10.
[79] S. W. Dohrn, N. B. Dohn. The role of teacher questions in the chemistry classroom. Chem. Educ. Res.
Pract., 19(1), 2018, pp.352–363.
[80] M. Shahrill. Review of teacher questioning in mathematics classrooms. International Journal of
Humanities and Social Science, 3(17), 2013, pp.224-231.
[81] T. R. . Handayani. Adopting Lesson Study to Enhance Pre-Service Teachers’ Pedagogical Knowledge. New
Educ. Rev., 56(2), 2019, pp.244–254.
[82] Y. Chen, M. J. Benus, J. Hernandez. Managing uncertainty in scientific argumentation. Sci. Educ., 103(5), 2019, pp.1235–1276.
[83] S. Cite, E. Lee, D. Menon, D. L. Hanuscin. Learning from Rookie Mistakes: Critical Incidents in
Developing Pedagogical Content Knowledge for Teaching Science to Teachers. Stud. Teach. Educ.,13(3),
2017, pp.275–293.
[84] I. Jo, S. W. Bednarz. Developing pre-service teachers’ pedagogical content knowledge for teaching spatial
thinking through geography. J. Geogr. High. Educ., 38(2), 2014, pp.301–313.
[85] S. Degener, J. Berne. Complex Questions Promote Complex Thinking. The Reading Teacher, 70(5), 2017,
pp.595–599.
[86] G. Singh, R. Shaikh, K. Haydock. Understanding student questioning. Cultural Studies of Science
Education, 14(3), 2019, pp.643-697.
[87] A. Kawalkar, J. Vijapurkar. Scaffolding Science Talk: The role of teachers’ questions in the inquiry
classroom. Int. J. Sci. Educ., 35(12), 2013, pp.2004–2027.
[88] H. Retnawati, H. Djidu, E. Apino, R. D. Anazifa. Teachers' Knowledge about Higher-Order Thinking Skills
and its Learning Strategy. Problems of Education in the 21st Century, 76(2) , 2018, pp.215-230.
[89] Y. Furman Shaharabani, A. Yarden. Toward narrowing the theory–practice gap: characterizing evidence
from in-service biology teachers’ questions asked during an academic course. Int. J. STEM Educ., 6(1),
2019.
[90] Y. Cleovoulou, P. Beach. Teaching critical literacy in inquiry-based classrooms: Teachers’ understanding
of practice and pedagogy in elementary schools. Teach. Teach. Educ.,83, 2019, pp.188–198.
[91] K. A. Hamblen. An Art Criticism Questioning Strategy Within the Framework of Bloom ’ s Taxonomy.
Journal Studies in Art Education, 26(1), 2015, pp.41–50.
[92] R. J. Marzano, J. A. Simms. Questioning Sequences in the classroom. Bloomington, 2014.
[93] H.-W. Hu, C.-H. Chiu, G.-F. Chiou. Effects of question stem on pupils’ online questioning, science
learning, and critical thinking. J. Educ. Res.,112(4), 2019, pp.1–10.
[94] D.-Y. Yip. Implications of Students’ Questions for Science Teaching. Sch. Sci. Rev., 81(294), 1999, pp.49–
53.
[95] A. Makhene. The use of the Socratic inquiry to facilitate critical thinking in nursing education. Health SA
Gesondheid, 24, 2019, pp.1–6.
[96] L. Elder, R. Paul. The Role of Socratic Questioning in Thinking , Teaching , and Learning.The Clearing
House: A Journal of Educational Strategies, Issues and Ideas, 71(5), 2010, pp.297-301.
[97] R. J. Marzano. A Different Kind of Classroom Teaching in Dimension of Learning Model, Association for
Supervision and Curriculum Development. Alexandria,Va, 1992.
[98] S. Ramdiah, M. Royani, U. M. Malang, D. Kleij. Understanding , Planning , and Implementation of HOTS
by Senior High School Biology Teachers in Banjarmasin-Indonesia. International Journal of Instruction,
12(1), 2019, pp.425–440.
[99] C. K. Looi, D. Sun, P. Seow, G. Chia. Enacting a technology-based science curriculum across a grade
level: The journey of teachers’ appropriation. Comput. Educ., 71, 2014, pp.222–236.
[100] S. Harvey, R. L. Light. Questioning for learning in game-based approaches to teaching and coaching. AsiaPacific J. Heal. Sport Phys. Educ., 6(2), 2015, pp.175–190.
[101] L. Devangi, H. Perera, M. N. Asadullah. Mind the gap : What explains Malaysia's underperformance in
Pisa? International Journal of Educational Development, 65(C), 2019,pp.254-263.
Downloads
Published
Issue
Section
License
Copyright (c) 2020 AUTHOR

This work is licensed under a Creative Commons Attribution 4.0 International License.
You are free to:
- Share — copy and redistribute the material in any medium or format for any purpose, even commercially.
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
- Attribution — You must give appropriate credit , provide a link to the license, and indicate if changes were made . You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation .
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.