Link to TOC: Current module is Multiple-Choice Questions
     
 
   
 

E. Item Analysis

   
          In addition to the Item Difficulty index (percentage of students answering a question correctly), multiple-choice questions should be examined using a distractor analysis to determine the effectiveness of the various distractors that were provided. It is necessary to consider the philosophy of the teacher when evaluating the effectiveness of the individual distractors. If the teacher uses criterion-referenced grading, with the intent that all students achieve mastery, there is less pressure to make sure students select all of the distractors on a fairly equal basis than if the teacher grades on the curve (norm-referenced) and wants scores to be distributed more widely.
   
  Distractor Analysis
   
          After the students have completed the questions, use a simple chart,  Not a link: Current module is Multiple-Choice Questionssuch as the one below, to record the frequency with which each response was chosen for each question. Highlight, circle, or use some other method to denote the cell representing the correct answer.
 
 
    Answers to 5 Multiple-choice Questions
     A C A B D (<- correct answers)
  Students                    Q1      Q2      Q3      Q4      Q5       
                     
  Linda A C A B D  
  Connie A B B B D  
  Josh A C C D D  
  Dennis A B D D D  
  Mark A C A D D  
  Mickey B C B B A  
  Minnie C C C D A  
  Donald D C D D B  
               
   
 
    
A
B
C
D
    
  
  
  
  
  Q#1
5**
1
1
1
    
  
  
  
  
  Q#2
0
2
6**
0
    
  
  
  
  
  Q#3
2**
2
2
2
    
  
  
  
  
  Q#4
0
3**
0
5
    
  
  
  
  
  Q#5
2
1
0
5**
** Denotes Correct Answer    
   
 

        Question 1 shows over 50% of the students answered correctly, and each of the distractors was selected. The distractors have functioned as they should. The teacher may be less than satisfied with only 5 of 8 students answering correctly, but a class would generally have more than eight students and could well have a higher percentage of correct answers while still having effective distractors.

         In general, it is not desirable to have one of the distractors chosen more often than the correct answer, as occurred with question 4. This indicates a potential problem with the question. It may be misleading.

        If students do not know the correct answer and are purely guessing, their answers would be expected to be distributed among the distractors as well as the correct answer, perhaps as for question 3.

        If one or more distractors are not chosen, as occurs in questions 2, 4, and 5, the unselected distractors probably are not plausible and, if the teacher wants to make the test more difficult, should be replaced in subsequent tests.

   
   
  THIS CONCLUDES THE INFORMATION ON ITEM ANALYSIS. GO TO THE NEXT SECTION FOR A PRACTICE ACTIVITY ON THIS TOPIC.
 
Back to Top of Page
 
Previous Section: D
Next Section: F
 
Copyright © 2001-2002 Alabama Department of Education
All Rights Reserved.