Let's face it; there are many other software packages out there to help you develop
an exam. These software packages all have the ability to write questions, and many
offer the ability to have others review them and provide input on improving
them. When reviewing other software packages, it is important that you keep your
purpose in mind, as it will impact which one best meets your needs.
This software is developed to target those developing high-stakes employment exams.
As such, ExamDeveloper contains many features that improve the validity and maintain
legal defensibility of the exam results. Features such as online job analysis, Exam AdvisorTM,
question validation, automatic exam assembly, and online standard setting are used
when exam quality matters most.
In the table below, you will see the features contained in ExamDeveloper and other
popular packages.
|
|
Exam
Developer v.2 |
QuestionMark
Perception |
Competitor |
|
Job/Task Analysis (JTA) |
|
Manager can import an existing exam blueprint from previous JTA study |
 |
|
|
|
Creates draft Domains, Tasks, Subtasks, Knowledge and Skill statements for review |
|
NO |
|
|
Allows experts to review and validate the content outline statements |
|
NO |
|
|
Calculates weights and recommend options for exam question distribution |
|
NO |
|
|
Cross-validating exam blueprint using a practitioner survey |
(Optional) |
NO |
|
|
|
|
|
|
|
Question Writing |
|
Allows multiple users to collaborate real-time from anywhere in the world |
|
NO |
|
|
Allows existing question banks to be imported using QTI 2.0 Standard |
|
NO |
|
|
Count and Track questions according to exam blueprint |
|
|
|
|
Allows users to input cognitive level, categories, and keywords |
|
NO |
|
|
Allows users to add comments for other users about questions |
|
|
|
|
Allows various question types: matching, fill in blank, multi-select, essay questions |
|
|
|
|
Allows tables, graphics, and text passages anywhere within questions |
|
|
|
|
Links each question to multiple reference
sources |
|
|
|
|
Builds multiple question sets to keep questions together on exam |
|
NO |
|
|
Automatically creates writing assignments for all users based on blueprint needs |
|
Manual Only |
|
|
Automatic email notification to users with work to be performed within the system |
|
NO |
|
|
Provides psychometric checks for improving question quality at the time of writing |
|
NO |
|
|
Provides tutorials on using the exam development software |
|
|
|
|
Provide tutorials on best practice for developing high-quality examinations |
|
NO |
|
|
|
|
|
|
|
Question Review |
|
Allows users to add comments about questions during review |
|
|
|
|
Maintains question "history" to see and track changes of all previous versions |
|
|
|
|
Provides psychometric checks to ensure question quality during review process |
|
NO |
|
|
Manager can set number of people needed to approve or reject a question |
|
NO |
|
|
Manager can be a "ghost" reviewer to change questions without affecting status |
|
|
|
|
|
|
|
|
|
Question Validation |
|
Allows users to rate question quality on up to three validity scales |
|
NO |
|
|
Provides a numerical and "star" based values of question quality |
|
NO |
|
|
Allows user's performance to be evaluated according to quality of questions written |
|
NO |
|
|
|
|
|
|
|
Assembling Exam Versions |
|
Automatically assembles multiple exam versions using psychometric criteria |
|
NO |
|
|
Allows multiple users to simultaneously review exams and suggest updates |
|
NO |
|
|
"Publish" exam versions to prevent changes to questions being administered |
|
|
|
|
Provides multiple output formats of exam versions and graphics (rtf, html, xml, etc) |
|
|
|
|
|
|
|
|
|
Standard Setting (Cut Score) |
|
Allows multiple users to participate in standard setting study |
|
NO |
|
|
Administers exam to users to simulate what candidates will experience |
|
NO |
|
|
Uses Angoff methodology to establish valid passing standard |
|
NO |
|
|
Shows users their ratings in comparison to others to reduce outlier data |
|
NO |
|
|
Automatically identifies "outlier" ratings and allow users to adjust if necessary |
|
NO |
|
|
Provides a recommended passing score and range of possible alternatives |
|
NO |
|
|
|
|
|
|
|
Project Management |
|
Allows manager real-time access to view and edit all questions submitted |
|
|
|
|
"Dashboard" view of project and user performance with color-coded status indicators
(red, yellow, green) |
|
NO |
|
|
Makes changes to writing assignments (add users, add questions, etc.) during project |
|
|
|
|
Question bank functionality: Managers can add, search, and update questions |
|
|
|