Development Of The Three Tier Diagnostic Test Based 'Higher Order Thinking Skills' Instrument
DOI:
https://doi.org/10.30595/dinamika.v11i2.5053Keywords:
high order thinking, three tier diagnostic test,Abstract
This study developed a knowledge assessment instrument of three tier diagnostic tests based on higher order thinking skills (HOTS) which aims to diagnose students' understanding in higher-order thinking and reduce misconceptions. The research method uses ADDIE (Analysis-Design-Develop-Implement-Evaluate) and the subject is class VII junior high school students with 2017 odd semester curriculum materials. This study used HOTS-based knowledge assessment instruments of three tier diagnostic tests of 20 items. The results of the instrument expert validation test based on aspects of content, construct, and language assessment have an average score of 90, 88, and 89 with a proper assessment. The data were analyzed using rasch model and the item reliability index was 0.89, the reliability index of the respondents was 0.91, and Cronbach's alpha value was 0.93, which meant the reliability of the questions obtained was good. The results of the students 'answer patterns are six criteria: understanding concepts, misconceptions (+), misconceptions (-), misconceptions, guessing / lack of confidence / luck, and not understanding the concepts used to diagnose learners' understanding in measuring high-level thinking skills (HOTS) which is integrated with the dimensions of factual, conceptual and procedural knowledge. Misconceptions that occur in students have three criteria, namely misconception (+), misconception (-), and misconception, and the most experienced by students is a misconception (-) in the C4 cognitive level which is integrated with the conceptual knowledge dimension on the substance characteristic material . This misconception (-) can be reduced through the correct concept with the right reasons.References
[1] Abraham, M. R. Grzybowski, E. B., Renner, J. W. & Marek, E. A. 1992. Understanding and Misunderstanding of Eigth Grader of Five Chemistry Concept Found in Textbook. Journal of Research in Science Teaching. 29 (2), 105-120
[2] Anderson, J. O., Huann-Shyang Lin, D. F. Treagust, S.P. Ross, & L. D. Yore. 2007. Using Large-Scale Assessment Datasets For Research In Science and Mathematics Education : Programme For International Student Assessment (PISA). International Journal of Science and Mathematics Education. Taiwan. 5, 591-614
[3] Arslan, H. O., Cigdemoglu, C. & Moseley, C. 2012. A Three-Tier Diagnostic Test to Assess PreService Teachers’ Misconceptions about Global Warming, Greenhouse Effect, Ozone Layer Depletion, and Acid Rain. International Journal of Science Education. 34 (11), 1667–1686.
[4] Aydeniz, M., Bilican, K., & Kirbulut, Z. D. 2017. Exploring Pre-Service Elementary Science Teachers’ Conceptual. International Journal of Education in Mathematics, Science and Technology, 5 (3), 221-234.
[5] Bunawan, W., Setiawan, A., Rusli, A., & Nahadi. 2014. Pengembangan instrumen Tes Diagnostik Pilihan Ganda Tiga Tingkat untuk Mengakses Kemampuan Mahasiswa Calon Guru Fisika. EDUSAINS, 6 (2), 138-144.
[6] Boone, W. J., Staver, J. R., dan Yale, M. S. 2014. Rasch Analysis in the Human Science. Dordrecht: Springer.
[7] Canas, A. J., P. Reiska, & A. Möllits. 2017. Developing Higher-Order Thinking Skills With Concept Mapping: A Case of Pedagogic Frailty. Knowledge Management & E-Learning: An International Journal (KM&EL). 9 (3), 348-365
[8] Cowlishaw, S., S.S. Merkouris, N.A. Dowling, S. Rodda, A. Suomi, & S.L Thomas. 2019. Locating gambling problems across a continuum of severity: Rasch analysis of the Quinte Longitudinal Study (QLS). Elsevier, Journal Homepage: www.elsevier.com/locate /addictbeh, 92, 32-37
[9] Dubas, J.M. & S.A. Toledo. 2016. Taking Higher Order Thinking Seriously: Using Marzano’s Taxonomy In The Economics Classroom. International Review of Economics Education, 12-20
[10] Hazrul, I. 2016. html. Retrieved 1 15, 2018, from http://www.ubaya.ac.id/2014 /content/ articles_detail/230/Sekelumit-Dari-Hasil-PISA-2015-Yang-Baru-Dirilis.
[11] Hayati, S. & Lailatussaadah. 2016. Validitas dan Reliabilitas Instrumen Pengetahuan Pembelajaran Aktif, Kreatif, dan Menyenangkan (PAKEM) Menggunakan Model Rasch. Jurnal Ilmiah Didaktika, Aceh, 16 (2), 169-179
[12] Heong, Y. M.,Othman, W.D.,Md Yunos, J., Kiong, T.T., Hassan, R., & Mohamad, M.M. 2011. The Level of Marzano Higher Order Thinking Skills Among Technical Education Students . International Journal of Social and humanity, 1 (2), 121-125
[13] Istiyono, E., D. Mardapi, & Suparno. 2014. Pengembangan Tes Kemampuan Berpikir Tingkat Tinggi Fisika (PysTHOTS) Siswa SMA. Jurnal Penelitian dan Evaluasi Pendidikan. Indonesia,18 (1)
[14] Kertayasa, I. K. 2018. Pengembangan Soal Model PISA Berbasis Online. Retrieved from www.indonesiapisacenter.com/2014/03/tentang-website.html.
[15] Lailly, N. R., & Wisudawati, A. W. 2015. Analisis Soal Tipe Higher Order Thinking Skills (HOTS) dalam Soal UN Kimia SMA Rayon B Tahun 2012/2013. Kaunia, 11 (1), 27-39.
[16] Misajon, RA., J. Pallant, & A-M. Bliuc. 2016. Rasch Analysis of the Personal Wellbeing Index. Springer International Publishing Switzerland, Australia. 25, 2565-2569
[17] Mohamad, M.M., N.L. Sulaiman, L.C. Sern, & K.M. Salleh. 2015. Measuring the Validity and Reliability of Research Instruments. Procedia Social and Behavioral Sciences, Malaysia. 204, 164-171
[18] Mubarak, S., E. Susilaningsing, & E. Cahyono. 2016. Pengembangan Tes Diagnostik Three Tier Multiple Choice untuk Mengidentifikasi Miskonsepsi Siswa Kelas XI, Journal of Innovative Science Education (JISE), 5 (2), 101-110
[19] OECD. 2016. PISA 2015 Results in Focus. [Online]. Tersedia: http://www.oecd. org/pisa/keyfindings/pisa-2015-results-overview.pdf.
[20] Pesman, H., & Eryilmaz, A. 2010. Development of a Three-Tier Test. The Journal of Educational Research, 208-222.
[21] Putra, I. E., Adlim, & Halim, A. 2016. Analisis Miskonsepsi dan Upaya Remediasi Pembelajaran. Jurnal Pendidikan Sains Indonesia, 4 (2), 13-19.
[22] Ramadhan, D & Wasis. 2013. Analisis Perbandingan Level Kognitif dan Keterampilan Proses Sains dalam Standar Isi (SI), Soal Ujian Nasional (UN), dan Soal Programme For International Student Assessment (PISA). Jurnal Inovasi Pendidikan Fisika. 2 (1), 20-25
[23] Rosidin, U. 2016. Penilaian Otentik (Authentic Assessment). Yogyakarta: Media Akademia.
[24] Saldo, G.M., S. Siraj, A.B.B. Nordin, & O. S. Al_Amedy. 2015. Higher Order Thinking Skills Among Secondary School Students in Science Learning. The Malaysian Online Journal of Educational ScienceI, MalaysiaI. 3(3)
[25] Saptono, S., Rustaman, N., & Wibowo, S. D. 2016. Memfasilitasi Higerh Order Thinking Skills dalam Perkuliahan Biologi Sel Melalui Metode Integrasi Atribut Asesmen Formatif. Unnes Science Education Journal, 5 (3)
[26] Smiley, J. 2015. Classical Test Theory or Rasch: A Personal Account From A Novice User. SHIKEN. 1 (2), 16-31.
[27] Sumintono, B., dan Widhiarso, W. 2014. Aplikasi Model Rasch Untuk Penelitian Ilmu-Ilmu Sosial. Cimahi: Trimkomunikata.
[28] .2015. Aplikasi Permodelan Rasch Pada Assessment Pendidikan. Cimahi: Trimkomunikata.
[29] Sunyono, Tania, L., & Saputra, A. 2016. A Learning Exercise Using Simple and Real-Time Vizualization Tool To Counter Misconceptions About Orbitals and Quantum Numbers. Journal Of Baltic Science Education, 15 (4), 453-463.
[30] Syahrul, D. A. & Setyarsih, W. 2015. Identifikasi Miskonsepsi dan Penyebab Miskonsepsi Siswa dengan Three Tier Diagnostic Test Pada Materi Dinamika Rotasi. Jurnal Inovasi Pendidikan Fisika. 4. (03), 67-70.
[31] Tajudin, N.M. & M. Chinnappan. 2016. The Link between Higher Order Thinking Skills, Representation and Concepts in Enhancing TIMSS Tasks. International Journal of Instruction. 9(2), 199-214
[32] Thien, L.M, I. G. N. Darmawan, & M. Y. Ong. 2015. Affective Characteristics and Mathematics Performance in Indonesia, Malaysia, and Thailand: What Can PISA 2012 Data Tell Us?. A Springer Open Journal, 3 (3), 1-16
[31] Vaske, J.J., J. Beaman, & C.C. Sponarski. 2017. Rethinking Internal Consistency in Cronbach’s Alpha. Leisure Sciences An Interdisciplinary Journal. Amerika, 39 (2), 163-173
[32] Zohar, A. & Y.J. Dori. 2003. Higher Order Thinking Skills and Low-Achieving Students: Are TheyMutually Exclusive?. The Journal of The Learning Sciences, 12(2), 145-181
Downloads
Published
How to Cite
Issue
Section
License
Authors who publish with this journal agree to the following terms:
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
Dinamika Jurnal Ilmiah Pendidikan Dasar is licensed under a Creative Commons Attribution 4.0 International License.
