Professional Documents
Culture Documents
PsychometriceBook India
PsychometriceBook India
PsychometriceBook India
Corporate Souls
Psychometric
Assessments
1
What are
Psychometric
Assessments?
2
The Big Picture: Why
Use Psychometric
Assessments?
8
Insights: When
Psychometric
Assessments Fail
Table of Content
12
Assessing
Assessments
18
Drawing from Case
Studies
21
Glossary of Terms
27
Parting Note
Every tale starts with the what, a preamble to the story that is to come. This is important,
especially with the topic of Psychometric Assessments being as vast as it is. Bearing this in
mind, the simplest way to define the what of psychometric assessments is to describe them
as a standardized and scientific method used to measure an individuals mental
capabilities and behavioural style.
Mental
As far as the business world is concerned, psychometric assessments are used to measure
attributes about employees that are relevant to the workplace, but less obvious to the nave
observer. In fact, employers use the information collected from a psychometric assessment
to uncover the hidden aspects of candidates that are difficult to extract from a rsum
screen or even a face-to-face interview.
More commonly, psychometric assessments are used in organizations as an early stage
identifier of job applicants unlikely to fill the requirements of the position on offer. Quite the
process for distilling the quality and quantity of said applicants to say the least. Beyond this,
psychometric assessments are also used in leadership development programs, coaching,
and promotions to name a few.
Now. With regards to the business world once mentioned, it is always important to
strengthen the what of anything with the why. Yes. Why use Psychometric Assessments,
indeed?t
Behaviour
No. of Psychometric
Assessments used by HR
Professionals
14
50
20
//
20
Just take a look at the statistics; data is more convincing than opinions, after all.
In a 2014 trends report from SHRM, 62% of human resource professionals used psychometric
assessments for vetting candidates in the hiring process. Compare that to less than 50% in 2010,
according to the Harvard Business Review.
62 % //
10
So, why the sudden percentage increase in use? There are several reasons, but the rising
popularity of psychometric especially personality assessments can be attributed to three factors:
Increasing evidence that personality is an important predictor of work-relevant outcomes such as performance, satisfaction,
organizational commitment, turnover, and leadership.
Increased accessibility through technology, and innovative ways of measuring personality and other psychological attributes of
importance.
The rising awareness that successful hiring, along with other organizational decisions, is all about maximizing probabilities of
success. This comes from considering various predictors of success, including personality, and not just relying on preliminary rsum
screens or job interviews.
Indicators
These are all aspects that weave into a great recruitment and hiring process a spectacular blend of data oriented assessments and due
diligence. Now this is important, but more important than that is what the title of this book is about. What happens if one neglects that?
2x
4x
5x
10x
improper conduct
fighting
Case in Point: There was once a large logistics company that hired 2200 employees using a recruiter
and 2200 employees using a legitimate psychometric assessment. Unsurprisingly, the unscreened
employees were twice likely to be fired for improper conduct, four times more likely to be fired for
fighting, five times more likely to be fired for insubordination, and ten times more likely to be fired
for theft.
Astonishing statistics, we know. However, this very reason pushes psychometric assessments to
widespread use and popularity.
insubordination
theft
If this does not do it for you, consider the following thought example:
Imagine a city thats fallen upon hard times rampant crime, poverty and
desperation taking over as the new normal. Now put yourself in the position of
someone in charge of hiring the citys protector a force strong enough to restore
the crumbing city to its former glory.
You come across an applicant masterful in the field of chemistry, genetics and
nuclear engineering. Add to that his agility, speed, skill in the field of martial arts,
and an ability to cheat death itself we have someone more than capable of
battling in the dark world of criminals.
Genius.
Innovator.
Task Oriented.
Go Getter.
Fearless.
Super-hero?
Ask yourselves, would he have been a spectacular hire? Very likely; at least on the
surface. However, if you did not unearth the layers beneath the surface to
understand his personality or motivations, you may have very well ended up
making a dire mistake.
This of course, is a whimsical example from the fictional world of Batmans
Gotham City. And if you havent already guessed it, our job applicant here is none
other than the notorious villain, the Joker. Fortunately for Gotham however,
superheroes never emerged from job applications. If they did, we would have had
a movie about a man in a purple suit and clown makeup, trigger-happy and
massacring every petty thief on sight, eating a puppy every now and then just
because.
In this case, you as the hiring manager did no wrong. You looked for the best traits to find in a candidate, and found them. The Joker was
the perfect hire; unfortunately, he was not Gothams perfect hire. No rsum screen could have possibly revealed all of the mans
homicidal, psychopathic, ruthless, sadistic, maniacal, and manipulative tendencies.
The thin line between genius and madness has always been a subject of dispute from the eyes of different people. Religious fanatics from
the medieval era scorned scientists as madmen, people who went against the will of Gods; the world of today looks at them as visionaries,
pioneers even. It is not an easy task separating your Batman from the Jokers, and sometimes we just need some help to gain that
perspective.
So, ladies and gentlemen, what do you think can help with that perspective you seek? Your friendly neighbourhood Psychometric
Assessments. It is a superhero to pushing the right genius to the right place, so they can find the greatness they deserve.
Recently, we came to hear about a renowned organization in the IT industry, and a certain Mr. X, who was quite the superstar in this organization. The man was a defined high-performer at work; backed by numbers, loved by peers, and respected by his team. Unsurprisingly,
he had grown at a rapid pace within the organization, and was soon in line to succeed a senior leader. Good story? Not quite.
Now, this organization had just tested their current workforce as part of a local assessment validation and norming effort terms that will
soon be explained in the chapter to come; not to worry.
Profile
Assessment Result
High Performer
Failed
Well Respected
Loyal
10
However, Mr. X could have just as easily been a candidate without performance history, just as easily rejected. This is probably why it is
important to consider two things:
Are you looking at other pieces in the puzzle? Structured behavioural interviews, solid reference checks, and functional knowledge
among others all form key components of the big jigsaw puzzle.
Are you using a scientifically sound psychometric assessment? Is the test you are using valid? Is it reliable?
All very good questions. And at the risk of sounding hypocritical, yes, Psychometric Assessments is still a ship sailing between genius and
greatness. However, for a ship to remain afloat, it needs architectural finesse a feat impossible without experience, effort, time, blood,
sweat and tears. Keep turning the pages to find everything that goes into developing a psychometrically sound assessment.
11
Gary Ridgway
SOUP FOR CORPORATE SOULS: PSYCHOMETRIC ASSESSMENTS
12
Kill Count: 49
Lie Detector: 0
What we need to understand here is that its always better to make educated, backed by hard-science decisions about using Psychometric
assessments. After all, in any science, it is essential to define standards that ensure our tools, methods and inferences are sensible, and
more importantly valuable. In the world of psychometric assessments, what are those standards indeed? Think three words.
To mistrust science & deny the validity of scientific method is to resign your job as a
human. Youd better go look for work as a plant or wild animal.
P. J. OROURKE
Political Satirist and Journalist
13
Reliability
A test is reliable as long as it produces similar results over
time, repeated administration or under similar circumstances.
Would you not expect a line that measures five centimetres on
one scale to measure the same on a different one? The line is
essentially the same, and only a good scale can ensure it
remains the same five centimetres regardless of what or who
measures it. If one equates that to psychometric assessments,
a reliable test is like that scale with the ability to produce
stable results over time.
Over the years, scholars and researchers uncovered multiple
ways to check for reliability. Some include testing the same
participants at different points of time or presenting the
participants different versions of the same test to see how
consistent the results are.
These methods are generally administered by professionals,
and learning any more than that would require a book of its
own. Anyway, suffice it to say that an assessment has to show
demonstrably good reliability in order to qualify for the next
hurdle. What might that be you ask? Do read on.
2 Years Ago
Now
Assessment
Result:
Assessment
Result:
Introvert
Introvert
14
Validity
In the simplest terms, a test is valid if it measures what it is supposed to measure.
It is understandable to expect a test used in organizations to shed light on how a
candidate would perform in a particular job. With this in mind, it is essential to
reiterate the difference between reliability and validity, with the former being a
prerequisite to the latter.
Lets consider a dart player. In repeated trials, he continues to miss the mark
consistently by about two inches. Of course, this implies reliable aim. In what
sense, you wonder? Simply because, each shot hits the board in a region two
inches from the target. That being said, is he doing a valid job as a professional
by not hitting the bullseye as is the aim of all dart players?
Yes, reliability and validity go hand in hand, but reliability by no means indicate
validity. As our example showed, having the first without the second hints at
great consistency, but also inaccurate consistency.
Again, just the same as reliability, there are tests for validity. And again, they
would require a book of their own. On the brighter side of things, however, we
have knocked down two of the three ingredients to a great psychometric
assessment. How about we take a look at the third now?
15
Norming
Wait. This is amazing. You now have a test that is both beautifully reliable and valid. Nevertheless, what about the results? An assessment
fails without quantifiable results, but as stated innumerably human beings are far from quantifiable.
It is hard to quantify in a vacuum, competencies such as ethical integrity or teamwork; similarly, seeing a score on a personality test may
be meaningless without a guide to interpret it. How then do we derive results that distinguish a group of candidates from the other?
Compare them to a standard, of course either among themselves, a relative standard, or an external criterion, an absolute standard.
The first way is to compare people against a population of interest, and this is whats more commonly referred to as norming. Another way
is to have a solid standard against which you measure your assessment, using that standard to make decisions. Either way, it is required of
a test developer to define a cut-off score for hiring or any other decisions dependent on the assessment.
However, even that is a delicate ball game. If you think about it, picking the relatively best apple from a batch of rotten apples would still
yield a rotten apple. How then would you ensure good results from a good test? In psychometric tests, to assess overall performance,
researchers have employed standardization samples, which simply refer to a large sample of test takers who represent the population for
whom the test is intended.
A representative sample means using a group of children when developing a test for children, and an adult group when developing a test
for adults. Also, based on the population, samples are generally made representative based on demographic factors like age, gender,
education, religion, etc.
16
Easy as pie, right? When you get a 94th percentile on a trait like extraversion, you know that you are simply more extraverted than 94% of
the sample group from whom the test makers derived the normal distribution. On the other hand, if you scored 94% on a math test, it simply
implies that you marked about 94 in every 100 questions correctly.
Psychological constructs such as personality have no right or wrong answers associated with them, and can thereby not be marked using
percentages. This is why academics and researchers alike resort to norming among other methods to make sense of scores on personality
assessments.
Nationality
Ethinicity
With growing concerns over costs, conveniences and other logistical challenges, technology-enabled assessments have become popular
over time as well. Simply because they serve to streamline the process, reduce costs, increase efficiencies, allow employers to assess,
and analyse more data points than previously deemed possible.
Having said that, lets get the theoretical out of the way. Its time we turn to a couple of examples of how psychometric assessments were
applied to solve real organizational problems.
SOUP FOR CORPORATE SOULS: PSYCHOMETRIC ASSESSMENTS
17
At Mettl, we could visually understand a beautiful trend with the word ideal through
interactions with lots of our clients. One especially, is one of the biggest names in the Indian
Automobile Manufacturing space. On a yearly basis, they executed an entry-level hiring
mandate for Graduate Engineering Trainees (GET) in sizeable proportions, countrywide, with a
pool of candidates sourced from Tier-I to Tier-III colleges.
However, despite a stellar process, our client remained largely disappointed with heavy
early-stage attrition. It affected more than just their new hires, cascading to poor
implementation of companywide actions and plans. In addition, turnover surged to
astronomical heights after the GETs went through a period of training, which by the way was
unprecedented among competitors in the automotive industry.
Obviously, the folks at Mettl needed to put on their best Sherlock Holmes hat to investigate the
matter. Our research revealed that while the assessments deployed by the client organization
accurately measured for technical and functional competencies, they significantly fell short on
measuring cultural fit assessed along the basis of behavioural and work-style indicators.
With the candidates behavioural competencies out of whack from the organizations, a short
employee life cycle emerged an unsurprising conclusion.
18
Preliminary investigation identified desirable competencies for a successful GET hire based on the clients competency framework and the
Mettl competency library. Focus group discussions with the shareholders began to unveil a plan that allowed us visibility to set achievable
goals. Mettls added suggestion to use aptitude and psychometric assessments allowed the organization to identify stable performers with
the right competencies and proficiency more accurately.
With a custom hiring solution in place, administered to approximately 240 GETs, and after intensive hours of filtration and sorting, our
Psychometric Research and Analysis team generated models for use in predicting the desired parameters. Post-implementation, our client
reported an overwhelming drop in attrition. The change in retention in six months skyrocketed. Mettl Holmes had solved the case.
However, despite a track record of such results, Mettl hit a temporary speed breaker when
Indias biggest pharmaceutical joint venture made an appearance. The organization wanted
to ensure that every hire emerged a top performer; the ask was simple to convert their
recruitment and hiring process into a competitive advantage.
Now, culture fit, as was our problem with the previous organization, was key here as well.
However, the new challenge asked for more than that. Once an ideal solution, no longer viable
this is the mantra people in the assessment business need to digest.
Matching
Frameworks the
Mettl Way
The organization possessed its own competency framework structured and well defined for
optimum output if utilized to perfection. Mettl began by mapping their own extensive
competency set with that of the organizations framework, a smart effort in itself. It ensured
that the right candidates made it through to align with both the cultural and performance
based criteria.
19
After the framework mapping, our suggested solution pushed a customized assessment, optimized against competencies that measured
actual on-the-job performance. An online simulation was also thrown into the mix on our robust and secure platform to reap improved
accuracy with respect to the cut-offs on the competencies identified.
The comprehensive exercise made the pharmaceutical joint venture the first non-IT enterprise to roll out psychometric assessments across
all job roles in the industry.
Isnt that a story to admire? Well, now that you have a rough idea of what psychometric assessments are, why they can emerge a powerful
tool for your people practices, and how you can apply them, it is about time to wrap this all up. That was tiring.
However, we will leave you with a few easy definitions for future reference, and hope that this whets your appetite for more.
20
Glossary of Terms
Psychometric
Pertaining to the
measurement of
psychological
characteristics such as
aptitudes, personality
traits, achievement, skill,
and knowledge.
Assessment
Any systematic method
of obtaining information
from tests and other
sources; used to draw
inferences about
characteristics of
people.
Its time for some fun education. Of course, no one loves being lectured, especially through a book.
Precisely why we hate textbooks, correct? We hope to keep this entertaining, and for that the
glossary has been divided into three major sections of fun.
You have common terms used in the context of psychometric assessments, terminology related to
the process of developing and optimizing their use, and finally a few yardsticks on how to assess
the goodness of these assessments. Yum.
Remember the What of Psychometric Assessments?
Ability
A defined domain of cognitive, perceptual, psychomotor or physical functioning.
Item
The question or statement used in the assessment.
21
Aptitude
A combination of abilities and other characteristics, whether innate or acquired, which indicate an individuals ability to learn or
develop proficiency in some particular area. This is dependent on whether appropriate education or training is provided.
Aptitude tests include those of general academic ability, referred to as Mental Ability or Intelligence Tests. These also include special
abilities such as verbal, numerical, mechanical, or musical. In fact, this also assesses a candidates readiness for learning.
Then again, there are also prognostic tests, usually for a field requiring specific skills such as speaking a foreign language or
nursing.
Criterion
A measure of work performance or behaviour such as productivity, accident rate, absenteeism, tenure, rejection rate, training score,
and supervisory ratings of job relevant behaviours, tasks or activities.
Cut-Off Score
A score at or above which an applicant is selected for further consideration in the selection process. This may be established on the
basis of normative information, relative, or objective standards/criteria, absolute.
22
Now, organizations have often discussed if top-notch performance is hindered more by will than skill. This refers to anyone in possession
of a skillset, but without the will to use it.
Hercule Poirot, Agatha Christies greatest creation, and also the most formidable detective in her fictional world will help us with this
explanation. Within several books, Poirot jested at the suggestion of his ability to commit the perfect crime. His closest aide, and colleagues
from the Scotland Yard almost always concurred to these claims. Does he have the skills and ability to pull it off? Yes. Would he do it,
considering his spirit of character, background as a former police officer, and now detective? Doubtful. You may call this will, which extends
to attitude in and around work.
Norms
Statistics or tabular data, often raw or percentile scores, that summarize performance of a defined group on a selection procedure.
Basically, these are statistics that describe the performance of a group of test takers, called the norm group, for the purpose of
helping test takers and users interpret the scores.
Norm information is often reported in terms of percentile ranks.
Predictor
A measure often the assessment, biographical data or interview results used to predict criteria such as job performance, tenure,
etc.
24
Analysis of Work/Job
Analysis
Standardization
Test Development
Validation
25
Correlation
A statistic that indicated how strongly two measures tend to vary together. A common example would be test scores. Correlation can
range from -1.00, a high score on one measure with a low score on the other, to +1.00, high or low scores on both measures.
When there is no tendency of the scores to vary together, the correlation is .00.
Reliability
The tendency of test scores to be consistent on two or more occasions of testing; that is, if there is no real change in the test takers
attributes.
Validity
The extent to which the scores on a test are appropriate for a particular purpose.
26
Parting Note
A paragraph, a couple of pages, a book can reveal many insights. Reading for example is a
tiresome task, soulful yes, but tiresome nonetheless. Why? Each word, each sentence you process
takes a little bit of your time ages you just a bit. If you have reached this far, we congratulate and
thank you for having made it.
With respect to the context thus far though, it must feel good to have scratched the absolute
surface of psychometric assessments. It is an interesting and vast field, after all.
Having scratched that surface, are you going to dive in deeper? Perhaps use that ability and
capacity to learn, to actually understand if psychometric assessments can be that game changer
you were looking for all along? Hiring, employee engagement, attrition, learning and development
are words synonymous to war in the business world at times. Psychometric Assessments could very
well be your secret weapon in this war.
Do not let it get to your head though. It is merely, as stated a weapon. If you ever think otherwise,
do remember,
27
Thank
You
Trusted by
mettl.com
Contact Us
contact@mettl.com
Plot 97, Sector 44, Gurgaon,
Haryana, India - 122003
And Many More.....