ExamOMR is used to score a multiple-choice examination. Class lists and test results from an OMR reader can be read and analyzed using an intuitive point-and-click interface. Test may be scored with a variety of options including: multiple test masters and multiple responses and weights per question. Finally, results can be analyzed and reported.
ExamOMR is a Microsoft Access application with versions available for Office XP and Office 2007. You must have Microsoft Access on your PC in order to use the package. ExamOMR may be retrieved from the ist download directory.
Note that this application requires a system file called comdlg32.ocx. If your system does not have this file installed, the Common Dialog Web page will download the file from the Microsoft Web site.
Refer to Appendix B for a log of the changes leading to the current version (V4.1.8) of the application.
ExamOMR processes two files: the raw data file created by the OMR reader and a file containing the names and IDs of students in the course (refer to appendix A for the layout of these two files). In preparing to have your OMR sheets read by the OMR reader, remember to:
To start ExamProc, double click on the "OMR Exam Processing" icon.
The "Score OMR Exam" menu identifies each step in the scoring process. Note that as each step is completed, a check mark will appear beside the corresponding button.
Note that a small ToolBar will appear containing the buttons: Info, Classlist, Scores, Master and Help. Move this to a convenient location on your screen so that you can select any of these forms at any time.
Info will describe input data, scoring parameters and scoring results. ClassList will show the students registered in the course (use the scrollbar to move to the end of the list if you need to add late registered students). Scores will display total scores by student and Master will display the correct responses.
Delete records from the scoring of a previous test. If you are scoring the results from another course, delete records from course registration table.
Press the file selection icon 
to select the filename of the student names file and import the class list. The number of students read will be displayed. Press the ClassList button on the toolbar to review this list.
From the "Score OMR Exam" form, press the OMR button if you are processing a new set of OMR results. If you are loading in the saved test details from an exam that you have already processed using ExamProc, press the save button.
Use the File Selector icon to identify the file created by your OMR scanner. This will scan the file for errors. Note the number of Test Masters (student id = 99000000) and student results read and the number of questions detected will be displayed.
Edit the raw OMR data file to correct coding errors in the student ID field. Non-numeric or duplicate IDs must be corrected before loading the test results.Note that the OMR sheet number is displayed to the left of each record requiring correction. This sheet number is printed on the lower left of each OMR card.
Examine the OMR sheets of students who are displayed as Not Registered to ensure that the student ID was coded correctly. Simply make the necessary corrections to the student IDs and press Exit when you are finished. The underlying tables containing the data are updated as you make your changes; no need to "save" your results.
It is useful to open the "Not Registered" window and the "No Test" window at the same time. If a student incorrectly codes their student ID, their incorrect ID will appear in the "Not Registered" window and the correct ID will appear in "No Test Results".
Specify Test ParametersVerify and, if necessary, correct the number of questions in the test and the default weight of each question. The default weight of each question is "1".
Load Test ResultsPress Load Scores to build the Test Master and student Test Results tables used in the scoring process.
Press Exit to return to the Score OMR Exam form.
If you are reprocessing a saved file of test results from ExamProc, load the results and registration file as described below.
Import Test ScoresEnter the name of the ExamProc saved test detail file and press Load Scores.
Note: this file does NOT contain weights and penalty factors associated with the test master. If you have altered these factors in your previous work with the test, you will need to re-edit the test master before scoring the test.
Import Student NamesEnter the name of the file containing the course registration file and press Import Names.
From the "Score OMR Exam" form, press Edit/Score to correct coding errors and score the test.
Report Grouping and Sequence
Select report grouping and sequence options (e.g., sequence by name or ID). You may ignore section numbers and work with test results as a single group (select "No" from Group Reports by Section). You may also group by the section number from the class list or the section number filled in by the student on the OMR sheet. Within section, reports may be sequenced by the sheets as read by the OMR scanner or by Student ID or Name.
Edit Multiple/Omitted Responses
You may examine and make corrections to individual question responses. Press Multiple or Omitted to display a list of OMR coding sheets with multiple responses (often caused by an attempted erasure) and omitted responses.
Detail Question Responses
Press the button ALL Details to examine or make corrections to any response. You may also correct student IDs, and insert or delete results for students.
Edit the Test Master to make any changes to the weights, penalty or acceptable answers. For each question, identify the number of required responses, the acceptable responses, weights and penalty.
The number of required responses (ReqResp) is normally set to 1 (e.g. questions 1 and 2 above) but may have a value up to 5 if more than one response is required for the question. For example, in question 3 above, there are 2 required responses, 'C' and 'D'. Set the ReqResp to zero (0) to give everyone a mark for the question (e.g. question 4 above).
Check and, if necessary, make corrections to the acceptable responses ('A' through 'E'). Note that more than one response may be checked (e.g. question 2 and 3 above). The number of acceptable responses may exceed the number of required responses. For example, 'B' or 'C' are both acceptable answers for question 2 but only 1 response is may be given by the student. In question 3, two responses are required, 'C' and 'D'.
The response weight for a question is normally set to 1 for the correct response and 0 for incorrect responses. However, different weights may be assigned to each acceptable response. For example in question 2, 'B' is given a response weight of 1 while 'C' (presumably a less acceptable answer) is given a weight of 0.5.
Check, and if necessary correct the question weight. Set the weight to 0 to exclude a question (e.g. question 5). Note that the sum of the weights is used to determine what the test is being marked out of.
You may set penalty for incorrect responses for particular questions (e.g. question 6). This will override the default penalty set when you score the test.
Examomr supports a Test Master Mapping table that you may use to identify corresponding questions on each test master. Note that a Mapping table is not required, however if you create one, this table may be used to: (optionally) generate the permutted test masters (2-n), compare the test masters using the mapping table to spot inconsistent marking (if you have read in all of test masters), map test results so that a single analysis by question may be provided.
Since the creation of the mapping table can be very tedius and exacting, you may choose to create the permutations of the test 1 master using the supported formula. By clicking "using Offset to map question number" you may specify an offset that will be used in the generation of the mapping table.
For example, if offset is set to '1', then: question 1 of test master 2 will be mapped to question 2 of test master 1; question 2 will be mapped to question 3....
If you specify a negative value (e.g. -1), this value and the test master number will be subtracted. For example, question 2 of test master 2 will be mapped to question 1 of test master 1.
Editing the Master Mapping TablePress the Mapping button to establish the question mapping.
For each question on the permutted masters (2-n), identify the location of the question on the 1st master. For example, question 1 on test master 2 may be question 15 on test master 1 - enter 15 in the "Question Number" column.
Identify a penalty for incorrect answers (zero is the default). Press the Score Test button. Press the Info or Scores button on the toolbar for a quick look at your test results.
You may Edit the student test scores for each student. This may be necessary, for example, if a student has written an alternative to the OMR exam and you would like the results included with the other students. Do NOT re-score after doing this as these results are recreated by the scoring operation.
Press Exit when the scoring has been completed.
From the "Score OMR Exam" form, press the Reports button to examine your test results.
Report Grouping and Sequence
Select report grouping and sequence options (e.g., sequence by name or ID). You may ignore section numbers and work with test results as a single group. You may also group by the section number from the Student Record File (SRF) class list or the section number filled in by the student on the OMR sheet. Within section, reports may be sequenced by the sheets as read by the scanner or by student id or name.
Detail Responses
The report of "Detail Responses" shows the individual student responses for each question, the raw score, the percent, the rank, the number of correct responses (#R), the number of incorrect responses (#W), the number of omitted responses(#O) and the number of deleted questions (#D). This report may be printed one page/student. Select the appropriate print format and press Detail.
SECTION Student# 9213406 Smith, John Score 36 72.00%
#R 36 #W 14 #O 0 #D Percentile 14
12345678901234567890123456789012345678901234567890
Your Answers: DABBDCBDCBBADDCBDCABDBAACADDBDADCDAAABCBADACABBBBD
Correct Answers: DABBDCBDCDBADDABDAAABBCBCADDBDCDABDAABCBDDABABBBBA
Note: you can significantly reduce the time required to produce the reports if you choose a "Generic Text Printer" rather than, for example, PostScript.
Student Test Scores
This summary shows the total test score and percent for each student. Optionally, the name and ranking may be shown and may be sorted by rank. Select the appropriate options and press Score. Press the Graph button to obtain an X/Y plot of the distribution of raw marks and percentiles.
Export for Web
Exporting either the summary or detail responses by questions results in the creation of a comma-delimited file formatted for easy display on the web. See "Making you term marks accessible from the Web" for a description of the procedure.
Statistical Summary
This summary includes statistics such as: mean, lowest and highest scores, standard deviation, variance, skewness, kurtosis and the number of students who passed the test.
Analysis by Question
This analysis shows correct and incorrect responses for each question as well as Point-BiSerial scores. Responses by question of the upper range of results (default 27%) are compared with the lower range. Point biserial scores are a measure of how effective the question discriminated between better and poorer students. Generally, the higher the score, the better the discrimination. Values greater than .2 and .3 are considered to be good, to very good.
Point Biserials are calculated as where: Mp = mean of students who answered question correctly, Mq = mean of students who answered question incorrectly, Np = number of student who answered question correctly, Nq = number of students who answered question incorrectly, N = number of students and is the standard deviation of the test scores.
General Item Analysis
This analysis shows, for each question, the correct response, the number of responses for each choice, the number of responses for the question, the percentage of responses for each choice, the number of correct selections, the number of wrong selections, the number of times the question was omitted and the discrimination factor.
Table of Marks
This analysis shows the number of students and the percentage of students who had a given number of correct answers.
Press Exit to return to the Score OMR Exam form.
To export your test results, use the file selector button to specify an output filename. Each exported record will contain: Student ID, Name,and Score.
If you want to save the details of your test, use the file selector button to specify an output filename.
The file contains one record for each student with the response for each question of the test. Since it is a simple text file, it can be edited or printed, and if necessary, reloaded into ExamProc for further analysis.
Note that the file does NOT contain question weights or penalty factors from the test master. If you need to reload a test, and you have made changes to either of these fields, you will need to re-edit the test master before re-scoring the test.
Once the OMR marking and reporting is completed, the tables can be cleaned up by pressing Cleanup. All tables used in scoring test can be deleted at this point. If the Gradebook is to be used the contents of the Student Names table should NOT be deleted.
Press Exit to return to the main ExamProc menu.
Note that after you exit ExamProc, you should regularly double click on the "Compact/Repair" icon. This will reduce the size of the EXAMPROC.MDB file and result in faster scoring.
At the the University of Waterloo, OMR exam sheets are scanned by an NCS OpScan 21 Model 75. An output file is created in the following format:
1-5 not used 6-9 OMR sheet number 44-45 Section 51-58 Student ID
64 Test Master Number
65- Question responses coded as a two digit number for each per
question. The binary digits of this number identify whether the
response was left blank ('0') or filled in ('1'). (00=blank,
01=A, 02=B, 03=AB, 04=C, 05=CA, 06=CB, 07=CBA, 08=D, 09=DA,
10=DB, 11=DBA, 12=DC, 13=DCA, 14=DCB, 15=DCBA, 16=E, 17=EA,
18=EB, 19=EBA, 20=EC, 21=ECA, 22=ECB, 23=ECBA, 24=ED, 25= EDA,
26=EDB, 27=EDBA, 28= EDC, 29=EDCA, 30=EDCB, 31=EDCBA
1-8 Student ID 10-13 OMR Card Number 21 Test Master 23- Student question responses (e.g. ACDEFCDAE...)
ExamOMR supports two name file format, the colon-delimited format generated by the UWDir classlist facility, and a simpler comma-delimited format.
UWDir Class List (colon delimited)Note that records must be in a standard DOS/Windows format with a carriage-return (CR) at the end of each record. This CR is supplied when generating the class list using Internet Explorer. When using Netscape, be careful to:
Simple Class List (comma delimited)
Information Systems & Technology
University of Waterloo
200 University Avenue West
Waterloo, Ontario, Canada N2L 3G1
519 888 4567 x37070
Contact Us |
Give Us Feedback |
Privacy Statement