Development Of The Three Tier Diagnostic Test Based 'Higher Order Thinking Skills' Instrument

Ni Wayan Novita Sari, Sunyono Sunyono

Abstract


This study developed a knowledge assessment instrument of three tier diagnostic tests based on higher order thinking skills (HOTS) which aims to diagnose students' understanding in higher-order thinking and reduce misconceptions. The research method uses ADDIE (Analysis-Design-Develop-Implement-Evaluate) and the subject is class VII junior high school students with 2017 odd semester curriculum materials. This study used HOTS-based knowledge assessment instruments of three tier diagnostic tests of 20 items. The results of the instrument expert validation test based on aspects of content, construct, and language assessment have an average score of 90, 88, and 89 with a proper assessment. The data were analyzed using rasch model and the item reliability index was 0.89, the reliability index of the respondents was 0.91, and Cronbach's alpha value was 0.93, which meant the reliability of the questions obtained was good. The results of the students 'answer patterns are six criteria: understanding concepts, misconceptions (+), misconceptions (-), misconceptions, guessing / lack of confidence / luck, and not understanding the concepts used to diagnose learners' understanding in measuring high-level thinking skills (HOTS) which is integrated with the dimensions of factual, conceptual and procedural knowledge. Misconceptions that occur in students have three criteria, namely misconception (+), misconception (-), and misconception, and the most experienced by students is a misconception (-) in the C4 cognitive level which is integrated with the conceptual knowledge dimension on the substance characteristic material . This misconception (-) can be reduced through the correct concept with the right reasons.

Keywords


high order thinking, three tier diagnostic test,

References


[1] Abraham, M. R. Grzybowski, E. B., Renner, J. W. & Marek, E. A. 1992. Understanding and Misunderstanding of Eigth Grader of Five Chemistry Concept Found in Textbook. Journal of Research in Science Teaching. 29 (2), 105-120

[2] Anderson, J. O., Huann-Shyang Lin, D. F. Treagust, S.P. Ross, & L. D. Yore. 2007. Using Large-Scale Assessment Datasets For Research In Science and Mathematics Education : Programme For International Student Assessment (PISA). International Journal of Science and Mathematics Education. Taiwan. 5, 591-614

[3] Arslan, H. O., Cigdemoglu, C. & Moseley, C. 2012. A Three-Tier Diagnostic Test to Assess PreService Teachers’ Misconceptions about Global Warming, Greenhouse Effect, Ozone Layer Depletion, and Acid Rain. International Journal of Science Education. 34 (11), 1667–1686.

[4] Aydeniz, M., Bilican, K., & Kirbulut, Z. D. 2017. Exploring Pre-Service Elementary Science Teachers’ Conceptual. International Journal of Education in Mathematics, Science and Technology, 5 (3), 221-234.

[5] Bunawan, W., Setiawan, A., Rusli, A., & Nahadi. 2014. Pengembangan instrumen Tes Diagnostik Pilihan Ganda Tiga Tingkat untuk Mengakses Kemampuan Mahasiswa Calon Guru Fisika. EDUSAINS, 6 (2), 138-144.

[6] Boone, W. J., Staver, J. R., dan Yale, M. S. 2014. Rasch Analysis in the Human Science. Dordrecht: Springer.

[7] Canas, A. J., P. Reiska, & A. Möllits. 2017. Developing Higher-Order Thinking Skills With Concept Mapping: A Case of Pedagogic Frailty. Knowledge Management & E-Learning: An International Journal (KM&EL). 9 (3), 348-365

[8] Cowlishaw, S., S.S. Merkouris, N.A. Dowling, S. Rodda, A. Suomi, & S.L Thomas. 2019. Locating gambling problems across a continuum of severity: Rasch analysis of the Quinte Longitudinal Study (QLS). Elsevier, Journal Homepage: www.elsevier.com/locate /addictbeh, 92, 32-37

[9] Dubas, J.M. & S.A. Toledo. 2016. Taking Higher Order Thinking Seriously: Using Marzano’s Taxonomy In The Economics Classroom. International Review of Economics Education, 12-20

[10] Hazrul, I. 2016. html. Retrieved 1 15, 2018, from http://www.ubaya.ac.id/2014 /content/ articles_detail/230/Sekelumit-Dari-Hasil-PISA-2015-Yang-Baru-Dirilis.

[11] Hayati, S. & Lailatussaadah. 2016. Validitas dan Reliabilitas Instrumen Pengetahuan Pembelajaran Aktif, Kreatif, dan Menyenangkan (PAKEM) Menggunakan Model Rasch. Jurnal Ilmiah Didaktika, Aceh, 16 (2), 169-179

[12] Heong, Y. M.,Othman, W.D.,Md Yunos, J., Kiong, T.T., Hassan, R., & Mohamad, M.M. 2011. The Level of Marzano Higher Order Thinking Skills Among Technical Education Students . International Journal of Social and humanity, 1 (2), 121-125

[13] Istiyono, E., D. Mardapi, & Suparno. 2014. Pengembangan Tes Kemampuan Berpikir Tingkat Tinggi Fisika (PysTHOTS) Siswa SMA. Jurnal Penelitian dan Evaluasi Pendidikan. Indonesia,18 (1)

[14] Kertayasa, I. K. 2018. Pengembangan Soal Model PISA Berbasis Online. Retrieved from www.indonesiapisacenter.com/2014/03/tentang-website.html.

[15] Lailly, N. R., & Wisudawati, A. W. 2015. Analisis Soal Tipe Higher Order Thinking Skills (HOTS) dalam Soal UN Kimia SMA Rayon B Tahun 2012/2013. Kaunia, 11 (1), 27-39.

[16] Misajon, RA., J. Pallant, & A-M. Bliuc. 2016. Rasch Analysis of the Personal Wellbeing Index. Springer International Publishing Switzerland, Australia. 25, 2565-2569

[17] Mohamad, M.M., N.L. Sulaiman, L.C. Sern, & K.M. Salleh. 2015. Measuring the Validity and Reliability of Research Instruments. Procedia Social and Behavioral Sciences, Malaysia. 204, 164-171

[18] Mubarak, S., E. Susilaningsing, & E. Cahyono. 2016. Pengembangan Tes Diagnostik Three Tier Multiple Choice untuk Mengidentifikasi Miskonsepsi Siswa Kelas XI, Journal of Innovative Science Education (JISE), 5 (2), 101-110

[19] OECD. 2016. PISA 2015 Results in Focus. [Online]. Tersedia: http://www.oecd. org/pisa/keyfindings/pisa-2015-results-overview.pdf.

[20] Pesman, H., & Eryilmaz, A. 2010. Development of a Three-Tier Test. The Journal of Educational Research, 208-222.

[21] Putra, I. E., Adlim, & Halim, A. 2016. Analisis Miskonsepsi dan Upaya Remediasi Pembelajaran. Jurnal Pendidikan Sains Indonesia, 4 (2), 13-19.

[22] Ramadhan, D & Wasis. 2013. Analisis Perbandingan Level Kognitif dan Keterampilan Proses Sains dalam Standar Isi (SI), Soal Ujian Nasional (UN), dan Soal Programme For International Student Assessment (PISA). Jurnal Inovasi Pendidikan Fisika. 2 (1), 20-25

[23] Rosidin, U. 2016. Penilaian Otentik (Authentic Assessment). Yogyakarta: Media Akademia.

[24] Saldo, G.M., S. Siraj, A.B.B. Nordin, & O. S. Al_Amedy. 2015. Higher Order Thinking Skills Among Secondary School Students in Science Learning. The Malaysian Online Journal of Educational ScienceI, MalaysiaI. 3(3)

[25] Saptono, S., Rustaman, N., & Wibowo, S. D. 2016. Memfasilitasi Higerh Order Thinking Skills dalam Perkuliahan Biologi Sel Melalui Metode Integrasi Atribut Asesmen Formatif. Unnes Science Education Journal, 5 (3)

[26] Smiley, J. 2015. Classical Test Theory or Rasch: A Personal Account From A Novice User. SHIKEN. 1 (2), 16-31.

[27] Sumintono, B., dan Widhiarso, W. 2014. Aplikasi Model Rasch Untuk Penelitian Ilmu-Ilmu Sosial. Cimahi: Trimkomunikata.

[28] .2015. Aplikasi Permodelan Rasch Pada Assessment Pendidikan. Cimahi: Trimkomunikata.

[29] Sunyono, Tania, L., & Saputra, A. 2016. A Learning Exercise Using Simple and Real-Time Vizualization Tool To Counter Misconceptions About Orbitals and Quantum Numbers. Journal Of Baltic Science Education, 15 (4), 453-463.

[30] Syahrul, D. A. & Setyarsih, W. 2015. Identifikasi Miskonsepsi dan Penyebab Miskonsepsi Siswa dengan Three Tier Diagnostic Test Pada Materi Dinamika Rotasi. Jurnal Inovasi Pendidikan Fisika. 4. (03), 67-70.

[31] Tajudin, N.M. & M. Chinnappan. 2016. The Link between Higher Order Thinking Skills, Representation and Concepts in Enhancing TIMSS Tasks. International Journal of Instruction. 9(2), 199-214

[32] Thien, L.M, I. G. N. Darmawan, & M. Y. Ong. 2015. Affective Characteristics and Mathematics Performance in Indonesia, Malaysia, and Thailand: What Can PISA 2012 Data Tell Us?. A Springer Open Journal, 3 (3), 1-16

[31] Vaske, J.J., J. Beaman, & C.C. Sponarski. 2017. Rethinking Internal Consistency in Cronbach’s Alpha. Leisure Sciences An Interdisciplinary Journal. Amerika, 39 (2), 163-173

[32] Zohar, A. & Y.J. Dori. 2003. Higher Order Thinking Skills and Low-Achieving Students: Are TheyMutually Exclusive?. The Journal of The Learning Sciences, 12(2), 145-181


Full Text: PDF

DOI: 10.30595/dinamika.v11i2.5053

Copyright (c) 2019 Ni Wayan Novita Sari, Sunyono Sunyono

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

ISSN: 2655-870X