A table to help determine which tools are best for you.
By Dr. Charles Handler and Dr. Steven Hunt Comments 0 | Recommend 0
ith so many different types of assessment tools available, deciding which
ones to use can be confusing. Is it better to use background checks, talent
measures, or structured interviews? Are drug screens better than knowledge tests
or job simulations? In general, the answer is "it depends."
There is no single "best" type of assessment tool. Assuming they are
appropriately designed and administered, all of the major types of assessment
tools can effectively predict future candidate behavior. Appropriate use of any
well-designed assessment tool will substantially improve a company’s bottom
line. The challenge is to determine which assessment tools will have the
greatest impact, given your company’s particular needs. Here are some general
guidelines to help you figure out which assessment tool is best for you.
Understanding what you’re trying to predict
The first step in choosing an assessment tool is to determine what your
specific needs are. This means understanding and clearly outlining what kind of
performance you want to predict.
For instance, if theft is the most important issue affecting organizational
performance, then you should look at assessment tools specifically designed to
identify candidates who are likely to steal. These might include background
checks or integrity tests. If customer service has the greatest impact on
revenue, then consider job simulations designed to assess candidates’ ability
to handle difficult customer interactions or talent measures that assess
candidates’ interpersonal style.
This table summarizes the effectiveness of various assessment tools for
predicting different kinds of job performance. It can be used as a general guide
in trying to determine what types of assessment tools to consider.
Qualification
Screens
Structured
Interviews
Job
Simulations
Knowledge
Tests
Talent
Measures
Background
Checks
Drug Screens
Physical Tests
Integrity
Tests
Cultural
Fitness
Attendance/
Reliability
x
x
Tenure
x
x
x
x
Teamwork
x
x
x
Customer
Service
x
x
x
Learning and
Adaptability
x
x
Deviant
Behavior (theft, drug use, violence)
x
x
x
x
Physical
Performance
x
Problem
Solving
x
x
x
Leadership
x
x
x
Motivation/
Work
Ethic
x
x
x
x
Specialist
Knowledge
x
x
The importance of validation
Whatever type of assessment tool you are considering, it is important that it
be validated. Validation is a process for testing and documenting the
effectiveness of an assessment tool in predicting job performance. Any vendor
you are considering should be able to provide detailed "validation" data
demonstrating the effectiveness of its assessment instruments in predicting
different types of job performance.
Validity data tends to be presented in two forms: percentages and validity
coefficients. Percentages show increases in the number of successful hires that
are associated with use of a specific assessment tool. For example, Unicru
conducted research showing that employees hired with their assessment tools had
turnover rates that were 25 percent lower than those of employees hired without
use of these tools. Percentages are easy to interpret, but they demonstrate only
the effectiveness of tools that predict highly objective kinds of performance
such as turnover or sales volume.
Validity coefficients show the effectiveness of assessment tools for
predicting less objective forms of performance such as customer service,
problem-solving, or teamwork. Validity coefficients are an index of an
assessment’s ability to predict performance. They range from 0, which
indicates no relationship between an assessment tool and job performance, to
1.0, which indicates 100 percent accuracy.
The table below provides some general guidelines for interpreting the meaning
of different validity coefficients. The validity coefficients of well-designed
assessment tools usually range from .15 to .60, with most falling between .20
and .40. Beware of anyone claiming validity coefficients above .70, as this
level is unrealistic for practical purposes.
Validity
Coefficient Range
Effectiveness
of Assessment Tool
Below
.10
Not
useful, might as well flip a coin
.11
to .20
Possibly
useful, depending on the circumstances.
.21 to .30
Useful
Above
.30
Very
useful
The advantages of using several tools
It is important to remember that job success almost always depends on several
different kinds of performance. For example, an employee who is very good at
customer service will be of little value if he/she frequently misses work. You
can increase the effectiveness of a selection system by combining assessment
tools that predict different types of job performance. For instance, combining a
personality test with an ability test can increase the overall predictive
ability of your selection system by 20 percent or more. Adding one or two
additional assessment tools can often significantly increase the ROI of your
staffing processes.
It is important to choose assessment tools that predict the various kinds of
performance that are most critical to the job. As a general rule, it is good to
focus on having assessment tools that predict both what candidates "can do"
and what they "will do." This usually means having a mix of assessment tools
that measure "hard skills" such as knowledge and problem-solving ability as
well as "soft skills" such as reliability and customer service.
Of course, as long as it predicts a key area of performance, there is nothing
wrong with using just one kind of assessment tool. However, hiring managers and
recruiters should be careful not to overly emphasize the kinds of performance
predicted by the tool at the expense of other factors that influence success.
For example, if a test of knowledge or ability is used as the only assessment
tool, hiring managers may decide to hire only candidates who score in the top
range. While this will increase the likelihood of hiring good problem-solvers,
it could decrease the number of hires who are likely to show high levels of work
ethic and reliability.
Dr. Charles Handler is the president
and founder of Rocket-Hire, a
consultancy dedicated to helping organizations use technology and best practices
to build effective, legally sound employee selection systems. Before
founding Rocket-Hire, Dr. Handler spent almost a decade developing and
validating employee selection systems for a wide variety of jobs in a number of
settings including, retail, manufacturing, telecommunications, high-tech, and
public safety.Dr. Handler is an
internationally known thought leader in the development of
online screening and assessment technology.
Dr.
Steven Huntis a strategic human resources consultant specializing in
technology enabled methods for hiring, developing, and retaining high performing
talent. He has helped clients implement a variety of Web and PC-based
staffing systems including applicant tracking and pre-screening systems,
employee reliability and customer service measures, predictors of culture fit
and retention, interactive job simulations, and assessments of leadership
potential.
Reproductions and distribution of the above article are strictly prohibited. To order reprints and/or request permission to use the article in full or partial format, please contact our Reprint Sales Manager at (732) 723-0569.
Comments
Guidelines: Comments that include profanity or personal attacks or other inappropriate comments or material will be removed
from the site. We will take steps to block users who violate any of our posting standards, terms of use or privacy policies
or any other policies governing this site. You are fully responsible for the content you post.