IJCRR - 8(13), July, 2016
ITEM ANALYSIS OF MCQS - MYTHS AND REALITIES WHEN APPLYING THEM AS AN ASSESSMENT TOOL FOR MEDICAL STUDENTS
Author: Priya S. Patil, Manisha R. Dhobale , Nitin R. Mudiraj
Multiple choice questions [MCQs’] form one of the tools for evaluation of medical graduates. The widespread use of MCQs’ raises the question of their validity and authenticity. The present study was focused on MCQ validation with an attempt to highlight the importance of item analysis and discuss the myths and realities of MCQs'. Aim: The aim was to perform Item analysis while probing into myths and realities of MCQ as an assessment tool for first year medical students. A total of hundred students underwent MCQ test as part of their first periodic assessment.
Methodology: A total of hundred students underwent MCQ test as part of their first periodic assessment. A pre-validated MCQ test was given to students and a post-validation was done through item analysis. The indices were calculated using Microsoft excel and various indices compared.
Results: Inspite of using a well-designed MCQ test validated by senior faculty and colleagues, after item analysis the difficulty index of 65 % items and discrimination index of 75 % items was in the acceptable range. The distractor efficacy showed that 9 out of 120 distractors needed revision.
Conclusions: Item analysis must be routinely implemented to validate MCQs’. The myths like shortfalls of MCQ framing, only four options in clinical setting or cueing effect are duly considered and the realities like strict and elaborate protocol for MCQ construction, stimulating critical and lateral thinking of students should be implemented. An integrated approach can help to achieve an ideal assessment tool for the benefit of students.
Keywords: MCQ validation, Difficulty index, Discrimination index
Priya S. Patil, Manisha R. Dhobale , Nitin R. Mudiraj. ITEM ANALYSIS OF MCQS - MYTHS AND REALITIES WHEN APPLYING THEM AS AN ASSESSMENT TOOL FOR MEDICAL STUDENTS International Journal of Current Research and Review. 8(13), July, 12-16
1. Mehta G, Mokhasi V. Item analysis of multiple choice questions- an assessment of the assessment tool. Int J Health Sci Res. 2014; 4(7):197-202.
2. Sadaf S, Khan S, Ali SK. Tips for Developing a Valid and Reliable Bank of Multiple Choice Questions (MCQs). Educ Health 2012; 25:195-7.
3. Srivastava A, Dhar A, Aggarwal CS. Why MCQ? Indian J Surg 2004; 66:246-8.
4. Bloom, B., Englehart, M. Furst, E., Hill, W., and Krathwohl, D. (1956). Taxonomy of educational objectives: The classification of educational goals. Handbook I: Cognitive domain. New York, Toronto: Longmans, Green.
5. Barrows HS, Tamblyn RM. Problem based learning: An approach to medical education. Springer Publishing Company New York 1980.
6. Poulomi Mukherjee, Saibendu Kumar Lahiri. Analysis of Multiple Choice Questions (MCQs): Item and Test Statistics from an assessment in a medical college of Kolkata, West Bengal IOSRJDMS, Volume 2015; 14(12): 47–52.
7. Parag Chavda, Shobha Misra, Bithika Duttaroy. Item Analysis of MCQs’ South East AsianJourn al of Medical Education.2015; Vol. 9 (1):66-68.
8. Agu, A. U., Esom, E. A., Nto, J. N., Anyanwu, G. E., Ezugworie, J. O., Adiri, C. O. and Ozoemena, F. N. Students preference for various types of assessments in anatomy examination. International Journal of Development Research, 2014; Vol. 4 :1377- 1379.
9. Elstein AS. Beyond multiple-choice questions and essays: The need for a new way to assess clinical competence. AcadMed 1993;68:244-9.
10. Baig M, Ali SK, Ali S, Huda N. Evaluation of Multiple Choice and Short Essay Question items in Basic Medical Sciences. Pak J MedSci 2014;30(1):3-6.
11. Walke YSC, Kamat AS, Bhounsule SA. A retrospective comparative study of multiple choice questions versus short answer questions as assessment tool in evaluating the performance of the students in medical pharmacology. Int J Basic Clin Pharmacol. 2014; 3(6): 1020-1023.
12. Duff, Jonathan P., et al. “Development and validation of a multiple choice examination assessing cognitive and behavioural knowledge of pediatric resuscitation: A report from the EXPRESS pediatric research collaborative.”Resuscitation 84.3 (2013): 365-368.
13. Newble DI and Jaeger K (1983). The assessment and examinations on the learning medical students. Medical Education; 17:165-171.
14. Gajjar S, Sharma R, Kumar P, Rana M. Item and test analysis to identify quality Multiple Choice Questions (MCQs) from an assessment of medical students of Ahmadabad, Gujarat. Indian journal of Community Medicine 2014;39:17-20.
15. Walubo A, Burch V, Parmar P, Raidoo D, Cassimjee M, Onia R, et al. A model for selecting assessment methods for evaluating medical students in African medical schools. Acad Med. 2003;78(9):899-906.
16. Singh, T. and Anshu (2012) Principles of Assessment in Medical Education, New Delhi: Jaypee Brothers Medical Publishers.
17. Anbar M. Comparing assessments of students’ knowledge by computerized open-ended and multiple-choice tests. Acad Med. 1991;66(7):420-2.
18. Khan MZ, Aljarallah BM. MEQs and MCQ as a tool for assessing the cognitive skills of undergraduate medical students. Int J Heal Sci.2011;5(1):45-50.