Exam Building
Piecing together the complex puzzle of an exam
Building a high-stakes exam typically involves selecting questions that fit certain
criteria and placing them appropriately, much like a complicated jigsaw puzzle. Very
often, organizations have an expert panel spread the stack of questions on a conference
table and manually select the questions. Although effective, this process
is time consuming and can be prone to errors due to data entry or management.
ExamDeveloper attempts to improve this process in two ways. First, ExamDeveloper
makes the process more efficient by suggesting "draft" exam versions based on criteria
specified for the project. With the push of one button, up to five versions of the
exam can be developed that meet up to five criteria.
Second, ExamDeveloper simplifies the review process for the expert panel by automating
the question tabulation and data management. When the panel changes a question selection,
the system evaluates the exam blueprint to make sure the new question fits the requirements.
In addition, the panel can see a real-time tally of the questions selected (and
still needed) to fulfill the exam blueprint.
Because these features are exclusive to ExamDeveloper, you will not be able to achieve
this level of sophistication and automation for assembling an exam with any other
software package.
What's more, easy-to-follow tutorials guide the user through the entire process
so there is no room for error.
Next Step
Keep things simple to hold on to your sanity
The degree of complexity in building an exam depends heavily on the number of criteria
you specify for your exam blueprint.
For example, every question must be tagged to a particular statement
in the content
(JTA) outline. This means that there must contain a specific number of questions
from each statement. By adding criteria to this specification (content outline x
cognitive level x etc.), the blueprint can become multi-dimensional, with each
cell requiring a specific number of questions.
Instead of creating a multi-dimensional structure, it is better to require the tabulation
be strictly enforced for the content outline and create "global targets" for the
other criteria.
More information can be found in the tutorials built into the application.