1. Home
  2. Vol 15, No 1 (2021)
  3. Jannah

An item analysis on multiple-choice questions: a case of a junior high school English try-out test in Indonesia

Rohmatul Jannah, Didin Nuruddin Hidayat, Nida Husna, Imam Khasbani

Abstract


The present study aims to analyze multiple-choice questions obtained from a trial testing conducted in a state junior high school in Indonesia. The study seeks to reveal the level of difficulty, discriminating power and distractor efficiency of the selected test items by employing item analysis. The result of the study discovers that levels of difficulty on the question items are varied. Some question tended to be easy and moderately difficult while the others are difficult to answer. It also uncovers that, in regard to discriminating power, some questions are well constructed while the others are ambiguously worded that can potentially cause the questions to fail to evaluate the students’ ability. The analysis on distractor efficiency presents information how the chosen multiple-choice questions were frequently constructed with less effective distractors that caused more high achieving students to choose wrong answers.


Keywords


discriminating power; distractor efficiency; item analysis; level of difficulty; multiple-choice questions

References


Abdul, R., Ayesha, A., & Syed Hammad, H. (2018). Item analysis of multiple choice questions. Pakistan Oral & Dental Journal, 38(2), 291–293. Ali, S. H., Carr, P. A., & Ruit, K. G. (2016). Validity and reliability of scores obtained on multiple-choice questions: Why functioning distractors matter. Journal of the Scholarship of Teaching and Learning, 16(1), 1–14. https://doi.org/10.14434/josotl.v16i1.19106 Arikunto, S. (2013). Dasar-dasar evaluasi pendidikan. Bumi Perkasa. Assessment, O. E. (2016). Understanding item analyses. University of Washington. Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice. Oxford University Press. Bowen, G. . (2009). Document Analysis as a Qualitative Research Method. Qualitative Research Journal, 9(2), 27–40. Brown, H. D. (2004). Language Assessment: Principles and Classroom Practices. Pearson Education. Crocker, M. (2019). The importance of evaluation and testing in an educational system. International TEFL and TESOL Training. Danuwijaya, A. A. (2018). Item analysis of reading comprehension test for post-graduate students. English Review: Journal of English Education, 7(1), 29–40. https://doi.org/10.25134/erjee.v7i1.1493. Dulger, M., & Deniz, H. (2017). Assessing the validity of multiple-choice questions in measuring fourth graders’ ability to interpret graphs about motion and temperature. International Journal of Environmental and Science Education, 12(2), 177–193. Frost, R. (2005). The question types. British Council. Fulcher, G., & Davidson, F. (2007). Language testing and assessment: An advanced resource book. Routledge. Gronlund, F. (1998). Assessment of student achievement (6th ed.). Allyn & Bacon. Haladyna, T. M., & Downing, S. M. (1993). How many options are enough for a multiple-choice test item? Educational Psychology Measurement, 53(4), 999–1010. Harris, D. P. (1969). Testing English as a Second Language. McGraw-Hill. Hartati, N., & Yogi, H. P. S. (2019). Item analysis for a better quality test. English Language in Focus (ELIF), 2(1), 59–70. https://doi.org/10.24853/elif.2.1.59-70 Hemmati, F., & Ghaderi, E. (2014). The effect of four formats of multiple-choice questions on the listening comprehension of EFL learners. Procedia - Social and Behavioral Sciences, 98, 637–644. https://doi.org/10.1016/j.sbspro.2014.03.462 Javid, L. (2014). The comparison between Multiple-Choice (MC) and Multiple True-false (MTF) Test Formats in Iranian Intermediate EFL learners’ vocabulary learning. Procedia - Social and Behavioral Sciences, 98, 784–788. https://doi.org/10.1016/j.sbspro.2014.03.482 Jayanti, D., Husna, N., & Hidayat, D. N. (2019). The validity and reliability analysis of English National Final Examination for junior high school. VELES Voices of English Language Education Society Journal, 3(2), 128–135. https://doi.org/10.29408/veles.v3i2.1551 Klufa, J. (2015). Multiple choice question tests-Advantages and disadvantages. Mathematics and Computers in Sciences and Industry, 91–94. Madsen, H. S. (1983). Techniques in testing. Oxford University Press. Malau-Aduli, B. S., & Zimitat, C. (2012). Peer review improves the quality of MCQ examinations. In Assessment and Evaluation in Higher Education (Vol. 37, Issue 8, pp. 919–931). https://doi.org/10.1080/02602938.2011.586991 Manalu, D., Sipayung, K. T., & Lestari, F. D. (2019). An analysis of students reading final examination by using item analysis program of eleventh grade of SMA Negri 8 Medan. JETAL: Journal of English Teaching & Applied Linguistics, 1(1), 13–19. McNamara, T. (2000). Language testing. Oxford University Press. Muhson, A., Lestari, B., Supryiyanto, & Baroroh, K. (2017). The development of practical item analysis program for Indonesian teachers. Journal of Instruction, 10(2), 199–210. O’Leary, Z. (2014). The essential guide to doing your research project (2nd ed.). Sage Publications. Odukoya, J. A., Adekeye, O., Igbinoba, A. O., & Afolabi, A. (2017). Item analysis of university-wide multiple choice objective examinations : the experience of a Nigerian private university. Quality & Quantity, 1–15. https://doi.org/10.1007/s11135-017-0499-2 Purpura, J. E. (2017). Assessing meaning. In E. Shohamy, I. G. Or, & S. May (Eds.), Language Testing and Assessment (3rd ed., pp. 33–61). Springer. Shin, J., Guo, Q., & Gierl, M. J. (2019). Multiple-Choice Item Distractor Development Using Topic Modeling Approaches. 10(April), 1–14. https://doi.org/10.3389/fpsyg.2019.00825 Toksöz, S., & Ertunç, A. (2017). Item analysis of a multiple-choice exam. Advances in Language and Literary Studies, 8(6), 141–146. Weimer, M. (2018). Multiple-choice tests: Revisiting the pros and cons. Faculty Focus. Yumelking, M. (2019). Test items analysis constructed by EFL teachers of private senior high school in Kupang , Indonesia. International Journal of English Literature and Social Sciences, 4(6), 1746–1752. https://doi.org/10.22161/ijels.46.19 Zajda, J. (2006). Learning and teaching. James Nicholas Publisher Pty Ltd.


Full Text: pdf

DOI: 10.30595/lks.v15i1.8768

Copyright (c) 2021 Leksika: Jurnal Bahasa, Sastra dan Pengajarannya

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

ISSN: 2620-4037