Opscan Evaluation: Frequently Asked Questions
You must check all options that apply to your job. The sections describing the outputs
in details also give more information on the test statistics.
- Print Score on each sheet:
- The student’s total score is printed along the edge of the test sheet.
- Scoring Only:
- Student scores are printed twice, first in order by Social Security number and again
in alphabetical order. The percentage correct, percentile rank, T-scores, mean, and
standard deviation are also printed on the lists of scores. Use this option if you
only want a printout showing students and scores with no statistical analysis.
- Standard Output:
- In addition to the material printed out with the Scoring Only option, Standard
Output will print a frequency distribution of scores and a histogram to show the
overall class performance.
- Long Form Item Analysis:
- Frequencies for all responses, correct and incorrect, are printed for each item
(i.e., question) as well as difficulty level and validity. In addition, the class
is divided into the top scoring 27% of the class, the bottom 27%, and the middle
46%. Responses to each item by members of these three groups are presented in a table.
This option also provides frequencies, difficulty level and validity for each item.
- Short Form Item Analysis:
- Frequencies for all responses, correct and incorrect, are printed for each item.
This option also provides frequencies, point-biserial correlation, difficulty level
and validity for each item.
- Student Test Responses:
- This compact report provides an alphabetical listing of students with their responses
(i.e. answers). Responses are in listed in groups of ten (i.e., questions 1-10 are
shown together, then questions 11-20, etc.) with correct responses being represented
by a dash (-).
- Individual Student Feedback:
- One printout is produced for each student in the class. Students are given their
own responses along with the correct responses for all items. In essence, it is a
graded version of the test for each student. Note: During finals we will not
print individual student feedback at time of scanning as the large volume of printing
significantly slows the entire scanning process. If you are teaching a large class,
carefully consider whether or not you need this printout. We can always print out
individual reports for students if a grade dispute arises, or export to a Word document,
and you can print reports as needed.
- Grade Book:
- If this option is checked, you receive a printout that shows all the tests and scores
for your students for the entire semester. The student summary score program, called
Grade Book, keeps a running record of all test results during a semester. In order
to be on our list of Grade Book users, that option must be checked each time that
a test is processed. Information required on the key (not on the sheets) should be
entered as follows:
- Course: first 5 positions in the University ID field (or Social Security Number
field on older forms), e.g., 10100
- Section: positions 6 and 7 in the University ID field, e.g., 07
- Test number: positions 8 and 9 in the University ID field, e.g., 02
- Department number: in the DEPT field, e.g., 461
- Weight Factor:
- The weighting option allows instructors to assign different point values (other
than the default value of 1) to groups of questions on the answer sheet. Heavy black
lines divide the groups on most forms. Weights can range from .01 to 99.9. If the
total number of points is not an integer, the total number of points is rounded.
For example, if a test has 39 questions and each question is worth 2.5 points, the
total score of 97.5 points is rounded to 98. The maximum number of digits that an
instructor can provide for a weight factor is 3, with a maximum of 2 digits to the
right or left of the decimal point, e.g., 9.00, 6.43, 12.1, or 10.9.
- Multiple Correct Responses:
- It is important to check this option on the job request form and indicate any items
with multiple correct answers, in addition to preparing the key by marking all the
correct answers for those items. While faculty may key more than one correct answer,
students may choose only one answer. Multiple responses by a student will
result in the item being counted as an incorrect answer.
- Number of Forms:
- In this instance a "form" refers to a version of a test. Some instructors
make multiple versions (e.g., an A and B form) of the same test to discourage cheating.
An instructor with an A and B form would mark "2" for his or her number
of forms.
- Number of Keys:
- An instructor teaching two sections of the same class may wish to use the same
key for both classes. In this case, the instructor would mark "2" for "Number
of Forms" and "1" for "Number of Keys". Thus, one job request
form may be filled out for multiple classes, provided the same analysis is desired
for each form.
- Combine Forms:
- This option allows you to get a separate analysis plus one combined list of
scores for multiple sets of tests. For example, this option could be used for test
forms A, B, and C. Please tell us if you also need separate score listings for each
test version.
- Tabulation:
- Tabulation is only marked for non-scoring (no answer key) jobs, such as surveys.
The standard tabulation provides frequencies, means, medians, and standard deviations.
Back to Questions on Filling
Out the Job Request Form
Yes. Check "Copy file to diskette" on the job request form. The test data
can be copied to a floppy diskette in one of two formats: ASCII (plain text) and Excel.
If you do not choose a format, we will assume an Excel file is desired.
The ASCII file contains the students’ names, test scores, and also their answers.
The Excel file is an approximation of the list of scores sorted by last name that would
be printed when choosing the "Scoring Only" or "Standard Output" options
on the job form. You must provide your own diskette.
Back to Questions on Filling
Out the Job Request Form
Yes. Select "E-mail file (Excel only)" and print your email address on the
given line. Selecting this option will give you the Excel file as an e-mail attachment.
Due to privacy issues involving student information, we are required to password-encrypt
the file. When you drop off your test for scoring, we will have you select a password,
and will keep it on file for future use.
Back to Questions on Filling
Out the Job Request Form
Take another copy of the test sheet. It should be filled out with your last name in
the Name field, the department number in the Dept field, and a correct answer for each
test item. Unless "multiple correct responses" is checked on the job request
form, it is assumed that there is one correct answer for each item (see
above). Do not fill in the "University ID " (or "Social Security
Number") field, unless you are using Gradebook. When you turn it in, the key should
be placed on the top of the test sheets.
Back to Questions on Filling
Out the Job Request Form
It is virtually impossible to carry out the functions of our operation without encountering
some error. However, if users observe a number of precautions, the number of errors
can be significantly reduced.
- Carefully stack the sheets so that they all face the same direction. One corner
is cut off to make it easier to stack sheets the same way.
- Make sure that the correct answers are marked on the key, including multiple correct
answers.
- Think carefully about how you want to weight the sections of the test.
- Fill the job form out correctly. Opscan staff will be happy to help you.
- Using rubber bands and paper clips on sheets can tear or warp them. Use envelopes
to keep your sheets together.
- Avoid placing random marks or writing on the key.
- If you are using the Grade Book option, double-check the course, section, and test
numbers on the job request form and the answer key. Also, ask your students to verify
their University ID numbers when they enter the numbers on the sheets.
- Tell your students to use pencil to mark the sheet and to press hard in order to
leave a dark mark in the desired space. If a student needs to change an answer, the
first mark should be erased completely.
Back to Questions on Filling
Out the Job Request Form
Yes. When submitting a job for survey analysis, please check "Tabulation" on
the job request form and indicate the number of questions to be tabulated in the box
marked "Special Instructions." For example, if you have a 12-question survey,
you would write "Q1–Q12" on the job request form. Choosing the Tabulation
option provides a printout with the frequencies, means, medians, and standard deviations
for your data.
Only one bubble should be filled in per question. If multiple bubbles are filled in,
a blank will be recorded for that item.
We can also give you the information from Opscan sheets in an ASCII, SPSS, or Excel
data file for your own analysis. If you wish to receive only the data file and not receive
any of the printed information, please write "Data Only" in the box marked "Special
Instructions." We can give you the file on diskette (which you must provide) or
via e-mail. If there are University ID numbers in the data and you want the data sent
by email, we must password-protect the data file in an Excel file.
Back to Questions on Filling
Out the Job Request Form
Yes, Opscan also handles the processing of course/instructor evaluations at the end
of each semester. Detailed instructions are sent out to each department towards the
end of each semester.
Back to Questions on Filling
Out the Job Request Form
