We realize that test development and psychometrics can seem like a foreign language to those that are simply trying to build a good test! We offer a full range of psychometric services and make it as easy as possible for you.
Job Task Analysis
what does the job require?
It's a process that has several names (JTA, Practice Analysis, Role Delineation Study), but only one purpose: To determine what knowledge, skills, and abilities are needed to be successful in a specific job role.
We can conduct, or assist you in conducting, the multiple steps necessary to complete a JTA that meets best practice standards. We will make sure that you understand all the necessary steps, and that your JTA process matches your program scope and goals.
At the end of this process, you will have an exam blueprint that is relevant, valid, and concise.
item writing
let our industry experts help yours
Writing test items (questions) is not as easy as it may seem. Developing good multiple-choice items is paramount to the integrity of any program . . . they are the building blocks of any test.
We can help you answer the questions of "Who should write items for us?" and "How can we get this done efficiently?"
Not only are we available to conduct in-person item-writing workshops with your industry experts, we have extensive experience conducting this iterative process virtually - where appropriate - saving both time and money.
Looking for innovative item types and ready to move past multiple-choice questions? Our psychometricians have years of experience in the testing industry designing and integrating innovative methods of test- and item-level measurement.
standard setting
setting the bar has never been easier
Standard setting, also known as setting a cut score or conducting a passing point study, is one of the final steps to developing a certification test.
There are many methods of deciding the score by which candidates fail or pass the exam, and we can help you decide which one is the best for your program.
Once the methodology has been decided, our experts will design custom materials for your experts to efficiently carry out the process. Like item writing, this can be done in-person or virtually, depending on the scope and maturity of the program.
administration decisions
so many options to choose from
Computer-based or performance-based?
Paper-and-pencil?
Virtual / remote proctoring?
There are many options with regard to test format and administration, and the decision is usually straightforward... if you know the factors to be considered.
We help you weigh the options and consider all factors - time, cost, scoring, and candidate population. We can even help you select third-party vendors to provide testing services.
test maintenance
keep things running smoothly
Once a test is released and being used to certify people, statistical procedures must be conducted to ensure the scores remain reliable and valid.
Such procedures involve examining item- and test-level data for any signs of cheating or other security concerns, bias, and consistent pass rates. The exact procedures can be customized depending on the specific program.
The timing of these maintenance "checks" is also customized, and varies according to the test content and the candidate population. We will create a long-term project plan to best estimate the time, resources, and budget involved.
complex psychometrics
The challenging (but still fun) stuff...
Our psychometricians specialize in customizing psychometric processes to each testing program we work with - and that may involve complex psychometric tasks.
Our team members have specific experience with the following design and analysis methodologies:
Item Response Theory (IRT) - unidimensional and multidimensional
Computer Adaptive Testing (CAT)
Linear-on-the-Fly Testing (LOFT)
Equating (multiple methods)
Differential Item Functioning (DIF)
Generalizability Theory
Exploratory and Confirmatory Factor Analyses
Structural Equation Modeling (SEM)