Professional Documents
Culture Documents
2008 PXT Tech Man Reduced
2008 PXT Tech Man Reduced
Technical Manual
Fifth Edition
April 2008
254.751.1644
The ProfileXT® Technical Manual
Table of Contents
- ToC 1 -
The ProfileXT® Technical Manual
Developing the List of Activities for Each Interests Theme .......... 2-5
Interests Theme Coding............................................................... 2-6
The Thinking Styles Section .......................................................................... 2-7
Refinement of the Two Learning Scales to Four Scales .............. 2-8
- ToC 2 -
The ProfileXT® Technical Manual
- ToC 3 -
The ProfileXT® Technical Manual
Utilizing Job Patterns: Effect upon Adverse Impact .............. Appendix B-12
Subsequent Salesperson Study ........................................... Appendix B-16
Appendix D: ADVERSE IMPACT and JOB MATCH PERCENT ..... Appendix D-1
Bibliography
- ToC 4 -
The ProfileXT® Technical Manual
References
Alexander, E.R. & Wilkins, R.D. (1982). Performance rating validity: The relationship of objective
and subjective measure of performance. Group and Organization Studies, 7, 485-498.
Barrick, M.R. & Mount, M.K. (1991). The big five personality dimensions and job performance.
Personnel Psychology, 44,1-26.
Bourdeau, J. (1998). Employment testing manual. Boston, MA: Warren, Gorham & Lamont.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Lawrence
Erlbaum.
Crocker, L. & Algina, J. (1986). Introduction to classical & modern test theory. Orlando, FL: Holt,
Rinehart, and Winston, Inc.
th
Cronbach, L.J. (1984). Essentials of psychological testing (4 edition). San Francisco: Harper &
Row.
Day, D.V. & Silverman, S.B. (1989). Personality and job performance: Evidence of incremental
validity. Personnel Psychology, 42, 25-35.
Edens, J.F. (2004). Effects of response distortion on the assessment of divergent facets of
psychopathy. Assessment, Vol. 11, No. 1 (109-112). Sage Publications.
Ghiselli, E.E., (1973). The validity of aptitude tests in personnel selection. Personnel Psychology,
26, 461-477.
Gordon, L.V. (1978). Gordon personal profile – Inventory manual. New York: Harcourt Brace
Jovanovich.
nd
Gottfredson, G.D. & Holland, J.L. (1989). Dictionary of Holland occupational codes (2 edition).
Odessa, FL: Psychological Assessment Resources.
Guilford, J.P. & Zimmerman, W.S. (1978). The Guilford-Zimmerman temperament survey:
Manual of instructions and interpretations. Beverly Hills, CA: Sheridan Psychological
Services, Inc.
Guilford, J.P. & Zimmerman, W.S. (1976). The Guilford-Zimmerman temperament survey
handbook. San Diego, CA: EDITS.
Heneman, R.L. (1986). The relationship between supervisory ratings and results-oriented
Measures of performance: A meta-analysis. Personnel Psychology, 39, 811-826.
Hogan, R. (1991). Personality and Personality Measurement. M. Dunnette and L. Hough (Eds.)
nd
Handbook of Industrial and Organizational Psychology (2 edition). Palo Alto, CA:
Consulting Psychologists Press.
Holland, J.L. (1970). Vocational preference inventory manual. Palo Alto, CA: Consulting
Psychologists Press.
Holland, J.L. (1985a). Making vocational choices: A theory of vocational personalities and work
environments. Odess, FL: Psychological Assessment Resources.
Holland, J.L. (1985b). The vocational preference inventory. Odessa, FL: Psychological
Assessment Resources.
Holland, J.L. (1994). The self-directed search. Odessa, FL: Psychological Assessment
Resources.
Hunter, J.E. & Schmidt, F.L. (2004). Methods of meta-analysis: Correcting error and bias in
nd
Research findings (2 edition). Newbury Park, CA: Sage.
Hunter, J.E. & Hunter, R.F. (1984). Validity and utility of alternative predictors of job performance.
Psychological Bulletin, 96, 72098.
Terman, L.M. & Merrill, M.A. (1960). Stanford-Binet intelligence scale: Manual for the third
Revision, Form L-M. Boston, MA: Houghton Mifflin.
Thurstone, L.L. (1938). Primary mental abilities: Psychometric monographs, No. 1. Chicago, IL:
U. of Chicago Press.
th
U.S. Department of Labor (1977). Dictionary of occupational titles (4 edition). Washington, DC:
U.S. Government Printing Office.
U.S. Department of Labor (1982). Dictionary of occupational titles (4th edition supplement, 1982).
Washington, DC: U.S. Government Printing Office.
U.S. Department of Labor (1986). Dictionary of occupational titles (4th edtion supplement, 1986).
Washington, DC: U.S. Government Printing Office.
U.S. Department of Labor (2000). The nation’s new resource of occupational information.
Retrieved July 20, 2000 from: http://www.doleta.gov/programs/onet.
U.S. Department of Labor, Employment and Training Administration (1999). Testing and
Assessment: An employer’s guide to good practices. Washington, DC: U.S. Printing
Press.
Vineberg, R. & Joyner, J.H. (1982). Prediction of job performance: Review of military studies.
Alexandria, VA: Human Resources Research Organization.
Wechsler, David. (1944). Measurement of adult intelligence (3rd edition). Baltimore, MD:
Williams & Wilkins.
Wechsler, D. (1958). The measure of adult intelligence (4th edition). Baltimore, MD: Williams &
Wilkins.
Chapter 1: INTRODUCTION
This technical document was revised in 2007 to reflect the latest information available
concerning our ongoing analysis of the ProfileXT®. Further statistical and technical
review will continue, as required, in our effort to keep the assessment and its technical
documentation current. Changes to this document include slight reorganization of the
chapters, updates to the statistical studies with current data, and editorial content
improvements.
In the business world, where it is so easy to duplicate products and undercut prices, the
key strategic advantage for most companies is the performance of their employees.
Employees who are well matched to their position have higher attendance records, less
turnover, higher job satisfaction, and superior job performance. Both the employee and
the employer share the benefits of enhanced person-job fit.
As part of the Profiles International, Inc. line of assessment tools for employers, the
ProfileXT is designed to facilitate achieving the best possible fit for positions in the
working world in which the characteristics measured can be used to help predict job
performance. Our clients use the ProfileXT to develop effective work teams, design
optimal training programs based on the trainees’ style of learning, help supervisors
determine which approach will work best when working with a particular employee, and
help develop succession plans.
The ProfileXT is a psychometric instrument whose history extends over the last 25
years. More than 400,000 job applicants and incumbents have participated in its
development. These sample groups represent a diverse cross section of ages, ethnic
groups, income levels, educational levels, job titles, companies, and industries. The
ProfileXT is the result of collaboration between several test development psychologists
and specialists coordinated by Profiles International, Inc.
The ProfileXT (PXT) is constructed as a test battery and investigates three areas
(Behavioral Traits, Occupational Interests, and Thinking Style) as a part of evaluating
how an individual fits into a particular job. By reviewing broad areas of occupational
interests, behavioral traits, and thinking style, we expand our ability to discover which
areas will be most effective in determining job fit for a given position. By attending to
each of the three areas, we enhance the opportunity to identify the factors that will lead
to the best job fit.
1-1
THE PROFILEXT® TECHNICAL MANUAL
The contribution of each of the three areas to successful job placement is well
documented in the literature. These areas were chosen for inclusion in the ProfileXT
because of their potential contribution to the goal of successful job placement.
Behavioral or personality traits have been studied for many years as potential indicators
of success on the job. Hogan, Hogan, and Roberts (1996) wrote, “The data are
reasonably clear that well constructed personality measures are valid predictors of job
performance…” The concept that personality factors are predictive of job performance is
supported by meta analytic studies reported by others (Barrick and Mount, 1991; Tett,
Jackson and Rothstein, 1991).
Cognitive abilities are often used in job selection because of their demonstrated impact
on job success (Hunter and Hunter, 1984). They found that “… ability tests are valid
across all jobs in predicating job proficiency” (p. 80). These findings were supported by
Ghisell (1973) and Vinebery and Joyner (1982).
1-2
THE PROFILEXT® TECHNICAL MANUAL
Results from the ProfileXT are prominent in the hiring process when used as a part of
the decision making process. All of the three sections provide a unique perception of the
Job Match Pattern, the individual’s results, and the necessary considerations as to the
job match for that individual. While there is some overlap in these three perspectives,
their uniquely different views broaden the information about the individual. When these
perspectives are combined with other available information, the expanded information
yields improved quality in the decision making process.
In general, the overriding theme of the PXT scales is that while cognitive abilities,
occupational interests, and behavioral traits each have demonstrated effectiveness in
predicting success on the job, the combination of their unique perspectives into one
assessment battery greatly enhances the ability to make good job placements.
Together, their combined results offer a greater understanding of the total individual.
A primary use of the ProfileXT, by most clients, is to investigate the potential match an
applicant might have to a specific job. This complex task is easily accomplished through
the use of the PXT software. The result is information that will guide the interviewer or
decision maker to consider important information about the applicant and how well they
will fit to the job. The interview questions and coaching comments generated by the
software provide better information for making good decisions than has typically been
available to the decision maker.
1-3
THE PROFILEXT® TECHNICAL MANUAL
The scoring of all assessment items is done automatically within the software and the
results are presented to the user in the form of STEN scores for each scale and the
percentage of match to the specific job under consideration. The confidential reports
may be delivered to the individual identified by the client. The test-taker may obtain a
copy of the Individual Report which has language describing the test-taker but no
scores or reference to the client’s proprietary Job Match Pattern the client has
developed.
The current population used for norming is made up of our target population who will
make use of this assessment tool. They are the actual employees and applicants for
more than 25,000 organizations in North America. These organizations represent a
diverse range of activities including: manufacturing, software development, financial
services, law enforcement, public and private education facilities, medical services,
professional associations, charities, construction, etc.
The individuals in the norm group have educational attainments ranging from no high
school to doctoral level degrees including Medical Doctor, Doctor of Osteopathy, Doctor
of Philosophy, Doctor of Education, Doctor of Law, Doctor of Chiropractic, etc. They
have developed Job Match Patterns (benchmarks) representing positions at all levels of
an organization. The methods for creating these Job Match Patterns include studies of
concurrent validity and predictive validity, job analysis surveys, and the refinement of
existing Job Match Patterns to fit more perfectly to their situation.
Examples of the more than 25,000 job titles represented in the collection of more than
250,000 Job Match Patterns developed by our clients, include positions found at all
levels of the organizations; from custodian to chief executive officer, unskilled worker to
professional, laborer to manager.
1-4
THE PROFILEXT® TECHNICAL MANUAL
The ProfileXT is currently normed on more than 400,000 individuals who are applicants
for employment with, or employees of, our more than 25,000 client organizations. They
are representative of the working population of North America and also our target
population for the use of the PXT. Because the reporting of demographics is voluntary,
not all individuals who completed the PXT provided this information. However, of those
who completed the PXT, approximately 79% provided their demographic information.
These data are presented in Tables 1.1 thru 1.3.
Table 1.1.
Age % of Total
16-25 11.7
26-35 19.3
36-45 25.4
46-55 21.1
56-65 17.3
66+ 5.2
100
N=639,231.
Table 1.2.
Gender % of Total
Female 46.2
Male 53.8
100
N=639,231.
1-5
THE PROFILEXT® TECHNICAL MANUAL
Table 1.3.
Group % of Total
White 72.4
Black 10.4
Hispanic 6.1
Asian 3.6
Other 7.5
100
N=639,231.
With the available data on such a large number of actual users who have demonstrated
effective use of the PXT, it is clear that our norm group fairly represents the target
population for this assessment. The norming statistics are re-computed and compared
with the norm table currently in use on an annual basis. Any adjustments are applied
when warranted; however, the norming is now quite stable due to the effective
representation of actual users in the norm population.
The ProfileXT uses STEN scores to report assessment results. The raw scores are
converted to scaled scores and presented as STEN scores on the reports. The scores
on each scale of the ProfileXT are reported on a STEN scale ranging from one at the
low end to ten at the high end. The raw scores have been normed so the distribution of
scores for the North American working population will fall on each scale with a normal
distribution. In other words, about two-thirds (68%) of the scores will fall at 4, 5, 6, or 7
(i.e. 4-7 being +/- 1 standard deviation from the mean) on each scale, and as you move
toward either end of the scale, the frequency of scores will taper off to less than 3%
scoring a 1, and less than 3% scoring a 10.
1-6
THE PROFILEXT® TECHNICAL MANUAL
Table 1.4 is an example of the conversion of raw scores to scaled (STEN) scores for
one of the Behavior scales on the ProfileXT.
Table 1.4.
4 to 6 2
7 to 9 3
10 to 12 4
13 to 16 5
17 to 19 6
20 to 21 7
22 to 24 8
25 to 26 9
27 to 28 10
ProfileXT Reliability
Table 1.5 below provides the user with a cursory overview of the reliability of the
ProfileXT. The reliability figures are measured with a Cronbach’s alpha coefficient.
Cronbach’s alpha reliability coefficients typically range between 0 and 1, providing a
measure of the internal consistency of the individual items in a scale. The greater the
Cronbach’s alpha, the greater the scale’s internal consistency. Please refer to the
Behavioral Section (p. 3-2), Interests Section (p. 4-2), and Thinking Section (p. 5-1) for
a more detailed account of scale reliabilities.
1-7
THE PROFILEXT® TECHNICAL MANUAL
Table 1.5.
Thinking Section
Interests Section
Enterprising .84
Financial/Administrative .74
People Service .77
Technical .76
Mechanical .81
Creative .78
Behavior Section
Decisiveness .77
Energy Level .75
Assertiveness .79
Sociability .87
Manageability .77
Attitude .82
Accommodating .73
Independence .83
Objective Judgment .78
N=206,443.
There are 20 scales available in the ProfileXT for use in job matching. Only a few of
these scales, for a given position, are critically important because they have
demonstrated the ability to differentiate between individuals of varying levels of job
performance. Since these scales apply to various job competencies in a variety of ways,
a Job Match Pattern is needed. These patterns are dependent on the specific job and
1-8
THE PROFILEXT® TECHNICAL MANUAL
work environment for each client. By standardizing the job fit process, Job Match
Patterns reveal more than individual scores on each scale. The job match process for
the ProfileXT represents an effective approach which minimizes the time required to
efficiently describe jobs, people, and how well they match. The descriptive process
usually starts by examining the score patterns of those who are most successful and
those who are least successful within a specific position. The resulting pattern of scores
across the various dimensions measured by The ProfileXT serves as the initial pattern,
or benchmark, upon which the job matching is based.
The Job Match process has been proven to be both effective and fair when used
appropriately. In one study, approximately 300 employees were evaluated to
understand the possible impact on minorities when employees were selected using Job
Match Patterns. Individuals representing racially mixed groups applied for jobs at an
organization that had developed patterns for the positions using criterion validity
studies. These positions were at different levels within the organization (i.e.
administrative, customer service, skilled trade, technology, supervisory, and
management). Utilizing the Rule of 4/5th, it was determined there was no adverse
impact on any of the employees studied (i.e. Asian, Black, Hispanic, and White). This
study is presented in detail in Appendix B.
A similar study was conducted using a sample of over 900,000 job matching cases. This
study utilized a statistical Analysis of Variance to observe the degree of difference
between Job Match Percents among ethnic, gender, and age groups. Again, no
appreciable differences were found. Appendix D details the statistical research for this
study.
The ProfileXT software allows a concurrent study analysis of the incumbents’ PXT
scores, the employer completed job analysis survey, and/or a combination of these. The
PXT software provides a method for the analysis of the PXT scores for individuals at all
levels of job performance to facilitate the building of Job Match Patterns. By using
appropriate performance measures for the job under consideration, the patterns help
differentiate between those individuals the client has identified as top performers, and
those whose performance is less than desired. The client provides the appropriate job
performance measure because of their expertise and knowledge of what represents
good performance in the position.
The client builds each Job Match Pattern for use in their organization. There are several
methods for creating the pattern; the software guides the client through the process.
1-9
THE PROFILEXT® TECHNICAL MANUAL
The client typically uses the PXT results from two groups of employees with different job
performance levels to build a Job Match Pattern. This pattern identifies the measured
characteristics that differentiate between these two groups. This Job Match Pattern may
then be used to provide additional information about applicants for the position.
Even with a small sample you have a good place to start the process and can develop
an approach that allows you to further refine the job pattern with ongoing evaluation. It
should be noted that this initial success profile is continuously updated as more
empirical information becomes available. It is important for a business to continually
maintain the job relevance of the process by which employees are placed.
Using a Job Match Pattern makes it easier to quickly identify when individuals will fit
well into positions and when they might have adjustments to make. This information is
important for both job placement and job training. The patterns also help determine
when more information may be required and will generate interview questions to ask the
applicants (Placement Report), or coaching comments for discussion with the
supervisors of incumbents (Coaching Report).
The purpose of a Job Match Pattern (or benchmark) is to identify the characteristics that
differentiate between those who are effective in a position and those who are
challenged by the position. There are several approaches commonly used to establish
the level of job performance for each individual. Generally, they are quantifiable,
behavioral, and directly related to the job.
The Chinese have reported that as far back as 2200 B.C., they were conducting job
analysis to establish the characteristics necessary to be successful as a public official.
Some of the desired characteristics included horsemanship, poetry, music, archery,
arithmetic, and ceremonial rites. It is not reported how these characteristics were
measured in the applicants (DuBois, 1964).
In more modern times, specialists have been used to observe workers to decide on the
characteristics critical to success on the job. Others have used the approach of
interviewing supervisors and other experts to identify the desirable characteristics for
success in a position.
1-10
THE PROFILEXT® TECHNICAL MANUAL
Once the characteristics that predict success were established, the presence of those
characteristics in applicants had to be measured to determine their fit to a position.
While this traditional approach facilitated job placements, its effectiveness depended on
many variables including the expert’s knowledge of which questions to ask supervisors,
the accuracy of the supervisor’s knowledge, correctly identifying the actual behaviors for
success, associating the characteristics in the employees that influence the actual
presence of the desired behaviors, and so forth.
An important trend in the assessment industry has been the use of localized patterns
rather than very broad and generalized descriptions of work to help fit employees to
exact positions. The ProfileXT focuses on this purpose.
For example, we found that if you built a job pattern to fit a salesperson you would get a
wide, generic pattern that poorly differentiates between the effective salesperson selling
wholesale auto parts and the one effective in selling women’s shoes. We have also
found significant regional differences between successful sales people in New York,
California, and Iowa, for example. This is where Job Match Patterns built to fit exact
positions becomes critical for successful placements.
The first important step is to identify the criterion necessary for establishing good job
performance. These are usually provided by the client because they are the expert in
the quality performance they are seeking from their employees. Such quantifiable job
performance measures might include sales quota efficiency, error rates, product
production levels, customer complaints, etc. Often the job performance measures relate
to the presenting problem with which the client is concerned (e.g., poor productivity,
high turnover, frequent customer complaints, etc.).
With good job performance measures and the use of criterion validity studies
(concurrent), it is then possible to identify the Top Performers in a position as well as
those performers who are not as proficient.
The next step is to identify the characteristics of the Top Performers and those of the
Bottom Performers using the capabilities of the PXT software. This is done in a two step
process. After Top Performers have been identified in the computer, the software
produces a preliminary Job Match Pattern (JMP) using proprietary algorithms that
consider the various characteristics of the Top Performers’ scores such as mean,
median, mode, range, etc. The Bottom Performers are also identified in the computer
and the software uses the same algorithms to build a preliminary Job Match Pattern for
1-11
THE PROFILEXT® TECHNICAL MANUAL
this group. The resulting Job Match Patterns are then compared to help identify the
characteristics which differentiate the two groups. With these data, an effective JMP
may be developed for use in assessing applicants for the position. The pattern for the
scales that do not contribute in the differentiation between the two groups may be made
very wide so their impact on the Overall Job Match Percent is minimized.
Examples of the results from this process are shown in Figures 1.1 to 1.3. Figure 1.1
displays the distribution of the results for the Top Performers by indicating how many
scored at each STEN level (i.e., 2 scored a 5, 3 scored a 6, etc). Figure 1.2 shows the
distribution of the results for the Bottom Performers by indicating how many scored at
each STEN level (i.e., 1 scored a 1, 3 scored a 3, etc). These results are graphed in
Figure 1.3 with the results for Bottom Performers shaded blue and the results for top
performers shaded red. The software generated preliminary Job Match Pattern is
indicated as 5, 6, 7, and 8 (shown shaded in yellow).
For the Top Performers, the computer-generated Job Match Pattern happens to be
toward the high end for this trait. (Note that the Sten scores are shown in the top row
and the number of subjects who scored at each Sten level in the bottom row).
Sten score 1 2 3 4 5 6 7 8 9 10
Subjects Per Sten 1 2 3 3 2 1
Note that the computer-generated Job Match Pattern for Bottom Performers happens to
be toward the low end for this trait.
Sten score 1 2 3 4 5 6 7 8 9 10
Subjects per Sten 1 2 3 3 2 1
1-12
THE PROFILEXT® TECHNICAL MANUAL
The results for Bottom Performers are shaded blue and the results for the top
performers shaded red.
While there is an overlap of scoring for these two groups, clearly the Top Performers
scored higher on this particular scale. In this example, the computer suggested a Job
Match Pattern range on this scale of 5 to 8 for STEN scores. In other words, the
software expects those with a good match to this position to have STEN scores of 5, 6,
7, or 8. This means the program will reduce the Job Match Percent of those falling
outside of this range of scores (5 to 8).
These results reflect what is necessary for success in a position. Using this information,
we can build a Job Match Pattern for each scale (or characteristic) in the PXT. This Job
Match Pattern consists of a range along each scale on which the scores of the most
effective performers tend to fall. Because they are not absolute, the typical pattern will
be three to five units wide. The more outside this range a score falls, the less likely
there will be a good fit of the individual to the job in regard to that particular factor.
1-13
THE PROFILEXT® TECHNICAL MANUAL
1. Select Position. The client must select a specific position to use for building a Job
Match Pattern. It should be specific and easy to identify, such as Route Salesperson or
Counter Salesperson, rather than the more generic title of Salesperson.
2. Identify Employees in Position. All employees who are working in the identified
position should be involved in the process.
4. Assign Job Performance Score. Assign a score to each employee based on their
match to the Performance Criterion.
6. All Take the PXT. Have all participants complete the ProfileXT so their results will be
available for the following steps.
7. Create Top and Bottom JMP From PXT Results. Use the software to build a Job
Match Pattern (JMP) for the Top Performers and another JMP for the Bottom
Performers. These will be used to identify the characteristics that help differentiate
between the members of each group.
8. Create Preliminary JMP for Matching to Position. Once a JMP is built, all
participants (Top, Middle, and Bottom) will be matched to the pattern. This process
yields a Job Match Percent for each employee.
The next step in the process is to take the Overall Job Match Percent for each
employee in the position under study and combine this information with the criterion
value established earlier in step four. These two measurements are then analyzed and
their relationship to one another (correlation) is investigated with a concurrent criterion
validation study.
1-14
THE PROFILEXT® TECHNICAL MANUAL
9. Take PXT & Job Performance Scores for all Employees. The two variables
considered in the criterion study are Job Performance (from the employer’s assessment
in step four), and the PXT scores for each employee.
10. and 11. Match each Employee to the Preliminary JMP (created earlier in step
eight). As each employee is matched to a Job Match Pattern (JMP), a Job Match
Percent is computed. This Job Match Percent reflects the degree of fit for the employee
to that particular JMP where the higher the percent match, the greater the match to the
pattern. This Job Match Percent is the dependent variable for the criterion studies.
12. The Job Performance score (from step four) for each employee is the
independent variable for the criterion studies.
13. Appropriate statistics are used to correlate the Job Match Percent scores and the
Job Performance scores. This is the basic design of many of the criterion studies
conducted by the users of the PXT, in both concurrent validity studies, and predictive
validity studies.
The relationship between the Overall Job Match Percent for each employee and their
actual job performance makes the PXT an important part of the decision making
process on future job placements.
1-15
THE PROFILEXT® TECHNICAL MANUAL
Figure 1.4 Flow Chart of Building a Job Match Pattern and Using it in a Criterion
Study
1-16
THE PROFILEXT® TECHNICAL MANUAL
The Overall Job Match Percent is derived by matching the test-taker’s score on each
scale to a Job Match Pattern for a specific position. If the test-taker’s scores fall outside
the benchmark, or pattern, for a scale, the impact is to lower their Job Match Percent.
The further the score falls outside of the pattern, the greater the negative impact on the
Job Match Percent. This applies equally whether they score above the pattern or below
the pattern. Thus, those test-takers with scores closely matching the pattern of scores
defined for the position have a higher percent match than those whose scores fall
outside of the pattern.
In the reports, job match is reported as a percent match to a specific Job Match Pattern.
Therefore, a higher Sten score on any specific scale does not necessarily lead to a
better job match than a lower Sten score on the scale; it is the congruence between the
candidate’s scores and the range of scores of the job pattern which determines the
candidate’s Job Match Percent. This allows for a variation between persons who may
share a good job fit to a position.
The following figure provides a better illustration of the job matching process. The first
shows a Job Match Pattern of 4-7 with a score of 6 falling within the pattern. The
second example shows a score of 3 falling outside (below) the Job Match Pattern of 5-
7.
1-17
THE PROFILEXT® TECHNICAL MANUAL
Once a good Job Match Pattern has been established, it may be used to evaluate
anyone who has taken the ProfileXT. The Job Match Pattern is composed of a range of
scores for each scale. This range represents the area in which those who are expected
to fit most easily into the job will score. The more outside this range (pattern) a score
falls, the less likely there will be a good fit of the individual to the job in regard to that
particular factor. Job Match Percentage points are deducted for scoring outside the
pattern. As mentioned earlier, job match is reported as a percent match to a specific Job
Match Pattern.
The Overall Job Match Percents computed will range from 0% to 100%. A separate
match will be provided for each of the three areas (Thinking Style, Occupational
Interests, and Behavioral Traits), as well as the Overall Job Match Percent. The Overall
Job Match Percent is especially useful to quickly identify individuals who may be a good
match for the job; the percent matches for the three subsections can be used for a more
in depth analysis of job fit. The higher the match reported, the higher the expectancy the
individual will fit well into the job under consideration.
Criterion validity studies (predictive) conducted by our clients have demonstrated that
those individuals with high Overall Job Match Percents have a greater probability of
being successful in that position than those with low Overall Job Match Percents.
The ProfileXT displays an Overall Job Match Percent to a selected Job Match Pattern.
This Job Match Percent number allows for the general comparison of an individual’s
results with a theoretical individual who is an exact match to a specified Job Match
Pattern.
The overall match is computed using a complex formula. The result of this computation
is impacted by several factors including the number of scales under consideration, the
width of the pattern for each scale, and the number of scales in a given section (e.g.
Thinking Style, Occupational Interests, and Behavioral Traits). Understanding the actual
formula is not necessary for a general understanding of the process. For the purpose of
this discussion, let’s simplify the computations and just assume everyone starts as a
percentage match of 100 to the pattern under consideration.
Initially, each scale is considered separately. If the individual’s score falls anywhere
inside the specified pattern, no action is taken, however, if the obtained score is outside
1-18
THE PROFILEXT® TECHNICAL MANUAL
the pattern percentage match points are subtracted from the overall match. As the
obtained score falls a greater distance from the pattern on any scale, more percentage
match points are deducted from the original 100 points.
For instance, if the pattern was from 6 to 8, and the obtained score was a 6, 7, or 8, the
overall match would not be impacted. If the obtained score was a 5 (one STEN outside
of the Pattern), then 2 match points might be deducted while an obtained score of 4
might cause a deduction of 3 match points. Once each scale in a section has been
considered, the total match for that section is computed.
Because the overall match to a Job Match Pattern may be an important part of placing
an individual in a job (up to 1/3 of the decision), comparing the overall match for several
individuals who are being considered for that job is appropriate. The greater the overall
match percent number, the greater the probability the individual will successfully fit into
the job under consideration.
For example, there might be four individuals under consideration for the same position.
Their PXT results may result in Overall Job Match Percent scores of 94, 87, 72, and 68.
It is easy to see which individual is the closest match to the Job Match Pattern under
consideration.
The reports provided by the PXT will help guide the user, as they investigate job fit, by
providing interview questions related to the scales when the applicant scored outside of
the Job Match Pattern. In a placement situation, these interview questions enrich the
quality of the interview by providing focus on areas for potential difficulties associated
with the fit to the job.
Because the interpretations generated by the ProfileXT are provided in reports written in
common business language, they require no psychological interpretation by the user.
This allows the PXT to be used by those with no special psychological training.
While this job pattern approach to matching individuals to a job provides information of
great value and should be a major part of the placement decision, the results from any
test should never make up more than a third of the final placement decision. This is
1-19
THE PROFILEXT® TECHNICAL MANUAL
ProfileXT Validity
Meta-analytic Study
The most accurate and representative data results from the studies conducted by the
actual users of the PXT. Many of these criterion studies are conducted with the support
of our Client Service executives. This provides us with an understanding of how the
study was conducted and gives us confidence in the numbers reports. Because these
studies result from real situations, very often the number of subjects is rather small. A
representative sampling of these studies from actual PXT applications has been
combined in this meta-analysis.
The data for this analysis is the product of case studies provided by the Profiles
International, Inc. Client Services Department. In each of these case studies the
participant’s performance was evaluated by the organization to which they belonged.
Each participant had taken the ProfileXT assessment. An individual pattern was then
built for each position in the study using actual performance results and relevant job
performance measures (for more information on building patterns see pages 14 and 15
in this chapter). A correlational relationship between the Overall Job Match Percents of
the Top and Bottom Performers, and their performance rating, was then calculated for
each study. Using the Hunter and Schmidt Method (Hunter and Schmidt, 2004), the
correlations of each individual study were weighted by the sample size, summed, and
then divided by the number of participants across all samples.
1-20
THE PROFILEXT® TECHNICAL MANUAL
Table 1.6.
Study N r Nxr
Study 3 5 1 5
Dividing the summed, weighted value (77.393) by the total sample size (N=173)
quotient reveals a .447 correlation coefficient. This value indicates a positive,
moderately strong relationship between the measured Overall Job Match Percent and
the Performance rating assigned by the candidate’s organization.
1-21
THE PROFILEXT® TECHNICAL MANUAL
The next step is to calculate credibility intervals by adding or subtracting the square root
of the estimated population variance multiplied by 1.96 (to provide a 95% interval) from
the true study effect of .447.
As suggested by this analysis, the Overall Job Match Percents acquired from this
sample of seven studies and 173 job candidates indicates good predictive utility of the
organizational performance ratings.
The following studies demonstrate typical applications of the ProfileXT. One study was
conducted by a for-profit company and the other by a government organization. The
results demonstrate how the ProfileXT produces information that significantly improves
the employee selection and placement process within an organization. More
importantly, this process saves companies a substantial amount of money and time.
A healthcare organization faced with low employee productivity wished to find a way to
increase the frequency of hiring employees who excelled in their positions. Presented
with this problem, the current study was conducted to examine the relationship between
employee productivity and Job Match according to the ProfileXT.
Participants
The current study was comprised of 60 Enrollment Specialists. In this position, 88% of
the participants were female, 35% Hispanic, 30% Caucasian, and 21% African
American. Seventy eight percent of the sample reported ages between 18 and 44 years
with the highest frequency in the 25-34 age range. Each employee who participated in
the study had taken the ProfileXT and had their performance evaluated on a five-point
rating scale by a superior within the company. These company performance evaluations
revealed 13 employees exceeding expectations (rated four or five) and six employees
1-22
THE PROFILEXT® TECHNICAL MANUAL
failing to meet expectations (rated one or two). The remainder of the sample, 41
individuals, met performance expectations (rated three).
In a concurrent study format, a Job Match Pattern was developed for the Enrollment
Specialist position using the ProfileXT. The 13 current Top Performing Enrollment
Specialists served as the basis to formulate the Job Match Pattern. The pattern now
serves as a benchmark to which other employees can be matched.
Performance Grouping
With the Enrollment Specialist Job Match Pattern created, all 60 Enrollment Specialists
were matched against the pattern. After a review of the sample’s ProfileXT Percent
Matches, an overall Job Match Percent of 78%, or better, best identified Top Performing
employees and was selected as a breakpoint to represent a good match to the Job
Match Pattern.
This study demonstrated that the pattern efficiently identifies top performers:
Of the 60 employees included in the study, 34 met, or exceeded, the benchmark set.
Nine of the thirteen (69%) Top Performers were included in this group while only two of
the six (33%) Bottom Performers were a match for the pattern. Thus, the pattern is
differentiating Top and Bottom performers as delineated by the company’s own
performance evaluations.
Details
The company expressed the belief that their hiring practices have become more
consistent since using the ProfileXT. The organizational leaders of the company feel
more confident and have become more assured in their hiring decisions knowing that
the PXT is based on the objective evaluation of employee attributes.
1-23
THE PROFILEXT® TECHNICAL MANUAL
Summary
Using the ProfileXT to benchmark employees, the organization has shown the ability to
successfully screen Enrollment Specialist candidates. Of the 34 individuals who either
met, or exceeded, the Job Match Pattern benchmark, only 5.8% (2 of 34) of these
employees were bottom performers. Additionally, approximately 70% of the top
performers (9 of 13) were included in this group. Clearly, selection practices can be
improved by using Job Match Patterns created by the ProfileXT.
A large lending firm located in Texas wished to increase its Branch Manager
productivity through improved hiring practices. The firm turned to the ProfileXT, a pre-
employment instrument designed to aid in employee selection through the
measurement of key job related traits, interests, and abilities. A study was conducted to
examine the relationship between employee productivity and Job Match to ProfileXT.
Participants
The study was comprised of 46 Branch Managers. In this position, 66% of the
participants were male, 88% Caucasian, and participants selected the 35-44 age range
with the highest frequency. Each employee who participated in the study had taken the
ProfileXT and had their performance evaluated via an average of the employee’s
revenue generation by a superior from within the company. These company
performance evaluations revealed ten employees as Top Performers and nine
employees as Bottom Performers.
In a concurrent study format, a Job Match Pattern was developed for the Branch
Manager position using the ProfileXT. A sample of the ten current Top Performing
Branch Managers served as the basis to formulate the Job Match Pattern. This pattern
now serves as the benchmark to which others can be matched.
Performance Grouping
With the Branch Manager Job Match Pattern created, all 46 Branch Managers were
matched against the pattern. After a review of the sample’s ProfileXT Percent Matches,
1-24
THE PROFILEXT® TECHNICAL MANUAL
an overall Job Match Percent of 80%, or better, best identified Top Performing
employees and was selected as a breakpoint to represent a good match to the Job
Match Pattern.
Analysis of the data has demonstrated that the pattern efficiently identifies Top
Performers:
Of the 46 employees included in the study, 21 met, or exceeded, the benchmark set.
Seven of the ten (70%) Top Performers were included in this group while only three of
the nine (33%) Bottom Performers had the same match for the pattern. Thus, the
pattern differentiated Top and Bottom performers as defined by the company’s
performance evaluations.
Details
Summary
By using the ProfileXT to benchmark employees, the mortgage lending firm has shown
the ability to successfully screen candidates for the Branch Manager position. Of the 21
individuals who either met, or exceeded, the Job Match Pattern benchmark, only three
of the nine Bottom Performers were included in this group. Additionally, 70% of the Top
Performers (seven of ten) achieved a Job Match Percent above the benchmark. Clearly,
1-25
THE PROFILEXT® TECHNICAL MANUAL
selection practices were improved by using Job Match Patterns created by the
ProfileXT.
A financial services organization located in the Southeast was faced with low employee
productivity. Presented with this problem, a study was conducted to examine the
relationship between employee performance and Job Match to the ProfileXT. Using the
information from the study, a ProfileXT Job Match Pattern was developed to better
select productive employees.
Participants
Thirty-six Mortgage Bankers participated in the study. In this position, 85% of the
participants were male, 52% African American, and 47% Caucasian. The majority of the
sample fell into the 25-34 age range. Each participant’s performance was evaluated by
the financial organization on the basis of a sales goal ratio and a supervisor’s
performance rating on a three point scale (1=Top Performer, 2=Average Performer,
3=Marginal Performer). Eleven participants were rated by the company as Top
Performers, nine were rated as Average Performers, and 16 were rated as Marginal
Performers. The average Top Performer met 97.2% of their sales goals and the
average Marginal Performer met 32.7% of their goals.
Using the ProfileXT, a pattern was developed for the Mortgage Banker position using a
concurrent study format. The pattern was developed with the ProfileXT scores of Top
Performing employees in January 2006. The pattern is now used as the benchmark to
predict Mortgage Banker performance based on the ProfileXT pattern match.
Performance Grouping
Based on the information gathered, a pattern was built which described the attributes of
the existing Top Performers. All 36 Mortgage Bankers were matched to the pattern.
After a review of employee ProfileXT Job Match Percents, an overall Job Match Percent
of 87% best identified Top Performing employees and was selected as the breakpoint to
represent a good match to the Job Match Pattern.
1-26
THE PROFILEXT® TECHNICAL MANUAL
The study demonstrated that the pattern efficiently identifies Top Performers:
Of the 11 Top Performers, seven (7 of 11) met, or exceeded, the 87% Job Match
breakpoint. Of the combined 25 Average Performers and Marginal Performers, only five
(5 of 25) met, or exceeded, the 87% Match breakpoint.
Details
1. 76.1% = the average sales goal ratio achieved by those who met, or exceeded, the
Job Match Percent breakpoint.
2. 48.9% = the average sales goal ratio achieved by those who did not meet, or
exceed, the Job Match Percent benchmark.
Summary
Although the organization’s Top Performers comprised less than one-third of the total
sample of Mortgage Bankers, more Top Performers (seven) who were matched either
met, or exceeded, the Job Match Percent benchmark than both the Average Performers
and Marginal Performers combined (five). Thus, by selecting candidates based on the
Overall Match of the ProfileXT, organizations such as this one are better able to
increase productivity by identifying those who are likely to succeed.
The focus of the ProfileXT is to successfully identify the candidates with the greatest
probability of good productivity based on their traits, interests, and cognitive abilities as
benchmarked by other successful individuals in the position.
A mortgage lending firm in Texas wished to increase the revenue production of their
Loan Originators by using the PXT. A study was conducted by the Profiles International
staff to examine the relationship between employee productivity and the dimensions
measured by the ProfileXT.
1-27
THE PROFILEXT® TECHNICAL MANUAL
Participants
The study was comprised of 116 of the organization’s Loan Originators, a front line
mortgage sales position. In this position, 57% of the participants were male, 79%
Caucasian, and the participants identified themselves as belonging to the 35-44 age
range with the highest frequency. Each Loan Originator completed the ProfileXT and
had their performance evaluated over the course of a year by a superior within the
mortgage firm. Based on the information collected from these organizational
performance evaluations, 11 employees were identified as Top Performing employees;
11 were considered Bottom Performing employees.
Using a concurrent study format, a Job Match Pattern was developed for the Loan
Originator position using the ProfileXT. The sample of current Top Performing Loan
Originator employees served as the basis to formulate the Job Match Pattern. This Job
Match Patten was then further analyzed and refined by the Profiles International staff to
better distinguish the pattern of Top and Bottom scores. This pattern now serves as the
benchmark to which others may be matched.
Performance Grouping
Based on the information gathered from the employer, Profiles International built a
pattern which described the qualities of the existing Top Performers. Next, we matched
all 116 Loan Originators against the pattern. After a review of the results, it was
determined that an overall Job Match Percent of 80 or greater best identified Top
Performing employees. This was selected as the breakpoint to represent a strong fit to
the Job Match Pattern.
This study demonstrated that the pattern efficiently identifies Top Performers:
1-28
THE PROFILEXT® TECHNICAL MANUAL
Of the 116 participants, 62 obtained a Job Match Percent of 80% or greater. Ten of the
11 Top Performing Loan Originator employees, or 91%, were identified as having a
strong fit to the Job Match Pattern. Only 36%, or four of the 11 Bottom Performers,
achieved the same mark.
Details
1. The average annual revenue generated by all Loan Originators in the sample
equaled $10,397,058. Top Performers in the sample averaged $39,221,312 in
sales. Conversely, over the same evaluation period, the Bottom Performers in
this position generated an average of $1,411,084. The average difference in
sales generated by the Top and Bottom performing Loan Originators totaled
$37,810,228.
2. The average revenue generated by the 62 Loan Originators who achieved an
80% Job Match Pattern equaled $11,110,280. The 54 Loan Originators, who did
not achieve an 80% Job Match Pattern, generated an average of $4,879,269.
This is an average difference of $6,231,011 per Loan Originator based solely on
the strength of fit to the PXT Job Match Pattern.
Summary
By using the ProfileXT to benchmark the Loan Originator position, the mortgage lending
firm has shown the ability to successfully screen candidates. Of the 11 Top Performing
Loan Originators in the firm, ten met, or exceeded, the 80% Job Match Percent
breakpoint which identifies a good fit to the position. Conversely, only four of the 11
Bottom Performing Loan Originators were able to achieve the same level. Furthermore,
the 62 individuals who achieved a Job Match Percent of 80% or higher produced, on
average, $6,231,011 more in revenue per Loan Originator over the evaluation period
than those who failed to achieve this same level. Using Job Match Patterns to
benchmark the Loan Originator position, the mortgage lending firm will increase the
odds of selecting Top Performing Loan Originator candidates in the future.
These brief summaries reflect results typical for companies who are using the Job
Match Pattern approach with the ProfileXT. The results for similar studies are reported
in Appendix E.
1-29
THE PROFILEXT® TECHNICAL MANUAL
As discussed earlier, the Job Match Percent is derived by matching the test-taker’s
score on each scale to a Job Match Pattern of scores for a specific position. If the test-
taker’s scores fall outside of the benchmark, or pattern, for a scale, the impact is to
lower their Job Match Percent. The further the score falls outside of the pattern, the
greater the negative impact on the Job Match Percent. This applies equally if they score
above the pattern or below the pattern. Thus, those test-takers with scores closely
matching the pattern of scores defined for the position will have a higher percent match
than those whose scores fall outside of the pattern.
As seen in Table1.7, Table 1.8, and Table 1.9, across a sample of 906,326 test-takers
the mean Job Match Percents of the demographic groups do not differ in any practical
way. The subjects in the study represent individuals who have actually been matched to
Job Match Patterns during the actual use of the PXT in the world of work in the USA.
We have made some assumptions about these job match situations:
1. The applicants have applied for actual positions where they felt they would have
a reasonable fit to the job.
2. The Job Match Patterns for the jobs in question are valid patterns for each
position in the study.
3. Some applicants have misjudged their fit to the position.
4. Not all applicants were placed into the position for which they applied.
1-30
THE PROFILEXT® TECHNICAL MANUAL
Table 1.7.
Distribution of Overall Job Match Percents and Sectional Job Match Percents by Ethnicity
95% Confidence
Interval for Mean
Standard Standard Lower Upper
Ethnicity N Mean Deviation Error Bound Bound
Asian 19717 69.906 11.9108 .0848 69.740 70.073
African
American 39082 71.915 11.4966 .0582 71.801 72.029
Overall
Job Match
Hispanic 22747 72.324 11.7183 .0777 72.171 72.476
Percent
Caucasian 825780 69.887 12.0644 .0133 69.861 69.913
African
Thinking American 39082 68.743 21.9467 .1110 68.525 68.961
Style Job
Match Hispanic 22747 70.039 22.1198 .1467 69.751 70.326
Percent
Caucasian 825780 69.986 22.3144 .0246 69.938 70.034
African
American 39082 73.229 12.8183 0.065 73.102 73.356
Interests
Job Match
Hispanic 22747 73.376 13.4537 0.089 73.202 73.551
Percent
African
American 39082 74.430 15.7272 0.080 74.274 74.586
Behavior
Job Match
Hispanic 22747 74.068 14.9548 0.099 73.873 74.262
Percent
1-31
THE PROFILEXT® TECHNICAL MANUAL
Table 1.8.
Distribution of Overall Job Match Percents and Sectional Job Match Percents by Gender
95% Confidence
Interval for Mean
Standard Standard Lower Upper
Gender N Mean Deviation Error Bound Bound
1-32
THE PROFILEXT® TECHNICAL MANUAL
Table 1.9.
Distribution of Overall Job Match Percents and Sectional Job Match Percents by Age Group
95% Confidence
Interval for Mean
Standard Standard Lower Upper
Age Groups N Mean Deviation Error Bound Bound
Note: The variations in mean scores among the various groups are so small as to have no practical
impact on the Job Match Percent.
1-33
THE PROFILEXT® TECHNICAL MANUAL
Profiles International, Inc. recognizes the need for continuing efforts to ensure the
ProfileXT has no adverse effects on any ethnic, gender, or age group that may take the
assessment. As seen in Table1.7, Table 1.8, and Table 1.9, across a sample of 906,326
test-takers, the mean Job Match Percents of the demographic groups do not differ in
any practical way. These data support our efforts to develop an impartial test for use in
making selection and placement decisions.
1-34
THE PROFILEXT® TECHNICAL MANUAL
This chapter summarizes how we arrived at the current form of the assessment, from its
early days of pen and paper administration to its current status as a dynamic online
assessment. The PXT is an assessment battery composed of three distinct sections.
Each of the three sections of the PXT (Behavioral Traits, Occupational Interests, and
Thinking Style) has its own developmental history, as detailed in this chapter of the
Technical Manual.
The ProfileXT was developed from The Profile by modifying two of the three sections,
Behavioral Traits and Occupational Interests. Details concerning our definitions for the
constructs measured by the PXT may be found in Appendix A.
The presence, or absence, of a particular personality trait is not necessarily good or bad
by itself. However, the degree to which a personality trait is found in an individual can
have a significant impact on their success in a specific job. When success in a job calls
for behaviors related to specific personality characteristics, those who have those
characteristics find the behaviors come more naturally to them. They tend to be more
comfortable in the job than those who have to behave in a manner not typical to their
normal personality.
The Profile, the original instrument, had 218 questions in the Behavioral Traits section.
In the current instrument, the ProfileXT, the number of questions was reduced to 182.
2-1
THE PROFILEXT® TECHNICAL MANUAL
The questions dropped were identified by an item analysis which determined the
removal of these 36 questions would not have a negative effect on either the construct
validity or the reliability of the assessment. This was confirmed with the studies reported
in Chapter 3.
In developing the latest version of the ProfileXT Behavioral Traits section (part one of
the test booklet), a sample of 116,227 individuals from a variety of work environments
were scored using the keys of both The Profile (PTP), and its successor the ProfileXT
(PXT). This analysis demonstrates how the newer version of the test replicates similar
results while containing fewer items than before. Therefore, the accuracy of the earlier
edition is maintained while allowing for shorter administration time. Of greater interest
are the correlations between the PTP scale and its PXT descendant. For example,
when PTP Assertiveness is compared to PXT Assertiveness, a high correlation is
required to demonstrate continued construct representation and a lack of distorted
scoring effects by using the shorter form.
Table 2.1
Assertiveness 0.99*
Sociability 0.99*
Manageability 0.97*
Attitude 0.99*
Accommodating 0.98*
Independence 0.99*
N=116,227.
*.01 level of significance.
2-2
THE PROFILEXT® TECHNICAL MANUAL
The results demonstrate the strength of this update and the ability of the PXT to
maintain the constructs familiar to PTP users. Additionally, the high correlations
between versions of the assessment suggest our previous studies of validity continue to
be relevant for the ProfileXT.
We considered two approaches to measuring and reporting interests when making the
decision about the approach to use in the PXT. Both approaches are well documented
in the literature. The first reports on interests using three categories: people, data, and
things. The second more common approach uses Holland’s six constructs of
enterprising, conventional, social, investigative, realistic, and artistic. The use of six
scales rather than three allows a finer granulation in describing people’s interests and
their fit to the job. Also, research using the Holland scales is widely available in the
literature. This includes the O*NET system which has become very rich in detail.
The Occupational Interests inventory in the ProfileXT parallels the underlying theory
found in the “Vocational Preference Inventory” and related vocational and career
guidance materials such as the “Self-Directed Search” (1994) and the “Dictionary of
Holland Occupational Codes” (1989). The ProfileXT was specifically developed to
measure an individual’s level of interest in the six major occupational themes originated
by Holland’s theory. Psychologists, career counselors, and H.R. consultants who are
familiar with the “Vocational Preference Inventory” and Holland’s occupational
classification system will quickly see the obvious similarities between these two interest
category systems.
2-3
THE PROFILEXT® TECHNICAL MANUAL
Table 2.2
PXT Financial/Administrative (FA) Financial and data more than people; office work.
Earlier versions of the assessment also used a format for identifying interests similar to
Holland’s assessment: namely, preference for occupational titles. However, the PXT
now takes a different approach which assesses test-takers in the working world more
effectively.
2-4
THE PROFILEXT® TECHNICAL MANUAL
The ProfileXT format uses activities rather than occupational titles to assess interests.
Each occupational title as used in other methodologies, while valid, may carry additional
values, meanings, and implications to the test-taker that go beyond basic interest.
Income, status, educational requirements, and other aspects associated with the
occupational title may create spurious responses on an inventory. Therefore, the
ProfileXT uses common, everyday activities easily recognizable and relatable to a
diversity of test-takers.
The Dictionary of Occupational Titles was a primary resource in creating the list of
activities associated with each of the 84 occupations established for use in the Profile.
The list of activities for each occupation was reviewed by each member of a panel of
five psychologists experienced in occupational assessments. The activities determined
to be confusing to an assessment-taker or to have a gender bias were eliminated if a
majority of the panel members voted to eliminate them. This resulted in a list of 276
activities representing all six of Holland’s themes.
Factor analysis of the results revealed six strong clusters and three smaller clusters.
The panel identified the six primary clusters as matching the six Holland interests
groups. The strongest 20 items were identified for each of the six interests groups giving
a total of 120 activities.
The Self Directed Search (SDS) results created a rank-ordering of all six interests for
the 51 individuals who completed that assessment. A Pearson correlation coefficient
2-5
THE PROFILEXT® TECHNICAL MANUAL
comparing these SDS orderings with the rank-ordering results from the 120 item
experimental measure was .83. These 120 items were accepted as having good
equivalence with the SDS results.
It was determined that 55 pairings of statements, using the 110 strongest items, would
provide an acceptable combination of robustness with a realistic consideration of time
restraints for assessing the test-taker in a business setting. The pairings were randomly
assigned to give appropriate exposure to the various combinations of themes.
The items and scales for the PXT Occupational Interests Inventory were developed in
accordance with the following guidelines:
Holland’s six occupational themes were used to form a three-letter code symbolizing a
subject’s three highest interests categories, such as ECS, RIE, and CSE which are
useful when assessing the degree of compatibility between a person’s interests and
thousands of occupational codes contained in the Dictionary of Holland Occupational
Codes (DHOC). The premise is that the closer the match between an individual and an
occupational group, the more likely it is the individual will be well suited to that
occupational group.
2-6
THE PROFILEXT® TECHNICAL MANUAL
The Occupational Interests Inventory found in the ProfileXT also produces three-letter
codes such as EFP, MTE, and FPE that are comparable to the codes contained in the
Dictionary of Holland Occupational Codes. The PXT Interests codes go a step further by
the nature of their relationship to current information gathered by the U.S. Department
of Labor’s Occupational Network (O*Net), as well as to each user’s Job Match Pattern.
The PXT Occupational Interests Inventory can provide a guide to vocational and career
exploration for individuals seeking a general idea of their occupational preferences. It is
also useful for those who have established a career but want to examine similar
careers. The PXT Occupational Interests Inventory may also assist those re-entering
the workforce with a general idea of the type of work they would find interesting and
enjoyable.
As with any measure, the Thinking Style Section of the ProfileXT starts with a definition.
Thinking Style refers to the ability to use old learning applied to new experiences in
order to measure the flexibility of thinking required to grasp concepts in a job or training
setting. It was this definition which prompted the initial research and has specific
applicability to what are considered job-related requirements that all employees must
possess.
The Original Test of General Learning (TOGL) was developed in 1988 by Dr. S.G.
Howard from a large pool of items consisting of numeric and verbal learning items. The
item pool was reviewed by a panel of psychologists as to difficulty and appropriateness
to the work environment.
2-7
THE PROFILEXT® TECHNICAL MANUAL
analysis of these data indicated the best items to be selected by type and level of
difficulty. The items were arranged in increasing difficulty with numeric and verbal items
mixed together.
The resulting question set consisted of 84 items. Of these, 42 made up the Verbal
Learning Scale and 42 the Numerical Learning Scale. The Thinking Style section
consists of multiple-choice questions and began, at its inception, as the Test of General
Learning (TOGL) and the Measurement of General Abilities (MGA). They were
developed as individually administered tests of verbal, numerical, general learning, and
reasoning skills.
These tests have proven to be good measures of a person's cognitive flexibility and
comfort level in different learning settings. Since their initial development, they have
been used to help support selection and career development decisions. When used with
a selection and training program, both the TOGL and the MGA have been shown to be
valuable tools for assessing an employees' potential, as is demonstrated in Chapter 5 of
this document.
The initial development of the Thinking Style scales was conducted in 1988. Using an
approach favored by measures of thinking style and learning potential, a large pool of
questions were developed consisting of both numerical and verbal items. The questions
were submitted to an item analysis in which the best questions were selected by subject
ability covered and level of difficulty. They were then arranged in order of increasing
difficulty with numeric and verbal questions in repeating pattern order.
In their original form, and as the ProfileXT, the assessments in their American English
form are intended for use only with individuals familiar with the English language and
who are literate at or above the sixth grade level. Our international versions follow the
same guidelines: to be used by those fluent in the local language. Details concerning
our definitions for the Thinking Styles constructs measured by the PXT may be found in
Appendix A.
Initially, the test consisted of 42 questions comprising the Numerical Learning Scale and
42 questions comprising the Verbal Learning Scale. The numeric portion of the test
required an individual to respond to number series, calculations, or word problems. For
verbal questions, the scale asked a person to render either a synonym or an antonym.
2-8
THE PROFILEXT® TECHNICAL MANUAL
To facilitate analysis of the results in The Profile, the earliest edition of the current
ProfileXT, these two scales were divided into four scales. The Verbal Learning Scale
became the Verbal Skill Scale (18 questions) and the Verbal Reasoning Scale (20
questions), while the Numerical Learning Scale became the Numerical Ability Scale (22
questions) and the Numeric Reasoning Scale (17 questions). This provided a total of 77
questions for the Thinking Style section. The Learning Index score in the Thinking Style
section is a composite of each of the other four Thinking Style scales. The raw scores
from all four Thinking Style sections (all 77 questions) are combined to create a
Learning Index raw score. This raw score is normed as a fifth, independent score.
The development process of converting from two scales to four scales is covered in
detail in Chapter 5 of this Technical Manual.
2-9
THE PROFILEXT® TECHNICAL MANUAL
Descriptive Statistics
Table 3.1 summarizes the most recent descriptive statistics for the ProfileXT®
Behavioral Traits Section. This sample will continue to increase in size over time, so we
expect the data will constantly solidify in its reliability and applicability as demonstrated
from one version of this technical manual to the next. The current normative sample is a
diverse collection of individuals from tens of thousands of positions in thousands of
industries representing a solid cross section of the working United States’ populous.
They are described in detail in Tables 3.2 to 3.4.
Table 3.1
Standard Standard
ProfileXT Scales Mean Error Deviation Minimum Maximum
N=206,443.
3-1
THE PROFILEXT® TECHNICAL MANUAL
Table 3.2
Table 3.3
3-2
THE PROFILEXT® TECHNICAL MANUAL
Table 3.4
Reliability Analysis
3-3
THE PROFILEXT® TECHNICAL MANUAL
Table 3.5 contains coefficient alpha reliabilities for the nine personality scales for a large
sample of job applicants and incumbents. Internal consistency of the ProfileXT was
determined by calculating coefficient alpha reliability. This analysis indicates the nine
personality scales are reliable and produce consistent and representative results. Due
to the fact the Distortion Scale is evaluated in a different manner, observing ratios of
item response, it was not included in the reliability analysis but will be discussed in a
later section of this chapter.
Table 3.5
Decisiveness .77
Assertiveness .79
Sociability .87
Manageability .77
Attitude .82
Accommodating .73
Independence .83
Average .79
N=206,443.
3-4
THE PROFILEXT® TECHNICAL MANUAL
Table 3.5 reports alpha coefficients for the PXT range from a low of .73 for the
Accommodating Scale to a high of .87 for the Sociability Scale. While an average
coefficient alpha is not always calculated, some consider it to be a useful
summarization. The average coefficient alpha for the PXT in this case was 0.79.
Table 3.6
Gender Percent
Male 48.2
Female 51.8
N=83.
3-5
THE PROFILEXT® TECHNICAL MANUAL
Table 3.7
Ethnicity Percent
White 83.2
Black 6.0
Hispanic 7.2
Other 3.6
N=83.
Table 3.8
N=83.
3-6
THE PROFILEXT® TECHNICAL MANUAL
Table 3.9
Behavioral
Decisiveness .83
Assertiveness .91
Sociability .75
Manageability .77
Attitude .88
Accommodating .83
Independence .85
Interests
Enterprising .77
Financial/Administrative .76
Technical .67
Mechanical .78
Creative .70
N=83.
3-7
THE PROFILEXT® TECHNICAL MANUAL
The results from this study, using employees of a manufacturing company are typical of
out target population. The higher correlation can be explained by their completing the
assessments in a work environment and perhaps taking the task more seriously. These
results show good test-retest reliability for all scales.
Validity
Although there are different methods for evaluating construct validity, two of the most
informative methods include examining the correlation coefficients (1) among the scales
within the new instrument, and (2) between the new instrument and other psychological
measures which have been shown to measure the same or similar constructs in a valid
fashion. The pattern of correlations should be consistent with expectations based on
what these scales were intended to measure. Scales that measure related personality
constructs should be highly correlated whereas scales that measure unrelated
constructs should not correlate highly.
3-8
THE PROFILEXT® TECHNICAL MANUAL
Table 3.10
Accommodating 1 .355*
Independence 1
Objective
Judgment 1
N=206,443.
*correlation is significant at the 0.01 level (2-tailed).
According to Table 3.10 one-fourth (9/36) of the correlations are less than .20 (absolute
value), whereas approximately one-half (17/36) are below .30 (absolute value). In
general, this shows an expected low crossover of the nine constructs, with a few
exceptions.
The highest correlation was between the Energy Level and Decisiveness scales (.805).
A few other scales appear somewhat related, and yet, even at the highest level of
correlation, each scale offers a unique perspective for describing the individual.
Following are a few of the scale pairings with some theory to describe the potential
similarity of scores for some test-takers.
3-9
THE PROFILEXT® TECHNICAL MANUAL
Those individuals whose scores on Decisiveness and Energy Level do not correspond
are likely to demonstrate their stronger trait while being tempered by the other. High
Energy people with low Decisiveness may become distracted by details, breaking down
their ability to make a decision quickly. Highly decisive individuals with a low Energy
Level may not express their sense of urgency, even when decision making comes
rapidly for them, leaving others confused as to the power of their determination.
3-10
THE PROFILEXT® TECHNICAL MANUAL
Because the general tendency appears to be that high scores of Manageability may be
related to high scores in Attitude, one could surmise that trust and compliance are
concurrent features. Likewise, it appears that those who are wary of the agendas of
others are also somewhat wary of personal strictures and unquestioning devotion.
These assumptions follow conventional wisdom, even though the two traits involved are
unique and separate concepts.
The interesting situation is one in which an individual’s scores do not follow the trend;
for example, one is highly trusting (High Attitude) but low in compliance (Low
Manageability), or vice versa, demonstrating very little interpersonal trust while acting in
a compliant fashion. In such a case, this individual’s manager may decide to develop a
productive means for supervising such a person, taking into consideration the
individual’s contrasting perceptions and perceived intentions.
3-11
THE PROFILEXT® TECHNICAL MANUAL
low scores in Manageability may require structure from a superior but have a tendency
to balk when that guidance seems too controlling and rigid. They appreciate guidance
that is neither heavy-handed nor controlling.
Table 3.11
3-12
THE PROFILEXT® TECHNICAL MANUAL
The Profile and the GZTS were administered to 540 job applicants and incumbents over
a one-year period. Table 3.13 contains the correlations among the nine Profile scales
and the ten GZTS scales. Due to the large sample size, many coefficients were
significant beyond the .05 level. Therefore, only coefficients of .40 or higher are included
in Table 3.12. Note that the GZTS scale concerning gender identification does not show
a relationship to PTP scores on any scale. This is good secondary evidence of the
PTP’s lack of adverse impact. More discussion on that topic is found in the Appendices
of this manual.
Table 3.12
Restraint
Social Interest
Emotional Stability
Objectivity .49
.69
Friendliness .79 .45 -.49
Thoughtfulness
Masculinity/Femininity
Both The Profile and the GZTS provide measures of factor-derived personality
dimensions and include a number of scales that are similarly named. Therefore, a
comparison of these two measures is of particular interest. According to Table 3.12, the
patterns of intercorrelations between PTP and the GZTS are largely consistent with
what the scales are purported to measure. For example, for the PTP there is strong
3-13
THE PROFILEXT® TECHNICAL MANUAL
evidence that six of the scales correlate with six of the GZTS scales. These scales are
reiterated in Table 3.13 and are common to all versions of the Profile instrument.
Table 3.13
As might be expected, the PTP Sociability scale correlated with the GZTS Ascendance
Scale, thus indicating both of these scales share an interpersonal/social orientation.
The significant but negative correlations between the GZTS Friendliness scale and the
PTP Independence scale support the view that highly independent, self-sufficient
people tend to be generally less cooperative, accommodating, and agreeable. This is
not a criticism of their performance style but rather a reflection of their willingness to do
what’s best for the organization in a way that is unique to their personal style.
3-14
THE PROFILEXT® TECHNICAL MANUAL
Table 3.14
The Profile and the GPP-I were administered to 320 job applicants and incumbents over
a one-year period. Table 3.15 contains the intercorrelations among the nine PTP scales
and the eight GPP-I scales. Once again, due to the large sample size, only those
coefficients of .40 or higher were included in Table 3.15. According to the data, the
patterns of correlations are consistent with expectations.
3-15
THE PROFILEXT® TECHNICAL MANUAL
Table 3.15
Responsibility
Cautiousness
Original Thinking
Vigor .67
N=320.
For the PTP, there is considerable evidence for five scales that correlate with five of the
GPP-I scales. These scales are recapped in Table 3.16.
Table 3.16
3-16
THE PROFILEXT® TECHNICAL MANUAL
Correlations of the GPP-I Ascendancy scale with the PTP Assertiveness and Sociability
scales are significant. The relationship between the GPP-I Personal Relations scale and
The Profile Attitude scale is more tightly focused on a positive trust in people and
outcomes than the GGP-I documentation suggests for the Personal Relations scale.
The positive relationship between the PTP Objective Judgment scale and the GPP-I
Emotional Stability scale indicates that individuals who are emotionally stable and
relatively free from worries, anxieties, and nervous tension are also more likely to use
objectivity and logic than individuals who utilize subjective, emotional thinking.
For the most part, GPP-I Responsibility, Self-Esteem, Cautiousness, and Original
Thinking show little in common with specific PTP scales. We would expect these scales
to diverge since they purport to measure different constructs.
3-17
THE PROFILEXT® TECHNICAL MANUAL
Table 3.17
3-18
THE PROFILEXT® TECHNICAL MANUAL
Sensitive, individualistic,
Well-organized, conscientious,
informal, restless, distractible,
Norm-favoring conventional, dependable,
seeks stimulation and
controlled, and conscientious
adventure
3-19
THE PROFILEXT® TECHNICAL MANUAL
Table 3.18
Social Presence .352** .449** .564** .102 .226* -.386** .313** .233*
Good Impression -.279** -.244* -.318** .460** .206* .421** -.374** .363**
Achieve via Conform .121 .135 -.142 .219* .323** .067 -.208* .154
Achieve via
Independence -.100 -.001 -.012 .232* .283** .159 .069 .103
Intellectual Efficiency .048 .068 .044 .248* .235** .072 .111 .233*
Psychological-
mindedness -.143 .011 .006 .382** .273** .123 -.011 .239*
3-20
THE PROFILEXT® TECHNICAL MANUAL
Norm
Questioning/Favoring .092 .035 -.234* .014 .015 -.051 -.206* .069
N=52.
*significant at .05 level.
**significant at .01 level.
As demonstrated in Table 3.18, The Profile Behavioral Traits associated with social
effectiveness expectedly correlate well with CPI traits of the same general theme.
Likewise, Behavioral Traits associated with compliance and accommodation relate well
with CPI measures of social responsibility. In general, it appears The Profile Behavioral
Traits section demonstrates good concurrent validity with the CPI.
3-21
THE PROFILEXT® TECHNICAL MANUAL
Concurrent Validity
This section of the Technical Manual reviews the statistical relationship between PTP
scale scores and various performance criteria. These criteria include:
Although the sample sizes of some of the following studies are sometimes less than
ideal, the number of studies and the overall consistency of results argue against there
being spurious relationships due to sampling error. In addition, while this emphasizes
some of the practical limitations of applied research, some would argue the findings
actually generalize better because the studies were conducted in the same environment
and applied in a “real world” setting.
Study 1:
Description of the Project: Seventy-six experienced, new and used auto sales
personnel representing five automobile dealerships completed the assessment. Sales
performance data consisted of total cars sold for (a) 1996, (b) 1997, (c) combined 1996
& 1997, and (d) combined 1996 & 1997 controlling for length of employment.
Results: Table 3.19 contains the statistically significant correlations between the PTP
scale scores and sales performance.
Table 3.19
Tenure
Scales Sales Performance Controlled
1996 1997 1996/1997 1996/1997
3-22
THE PROFILEXT® TECHNICAL MANUAL
N=76.
*p<.05.
**p<.01.
Discussion: According to Table 3.19, the Sociability, Assertiveness, and Energy Level
scales were, as anticipated, significantly related to sales performance. The correlations
ranged from .23 to .47, demonstrating these traits played a part in defining successful
sales performance.
Study 2:
Description of the Project: Sixty quick lube technicians from 15 store locations, were
administered the assessment. Store Managers, three District Managers, and two
Training Managers rated the employees with respect to their ability to persuade
customers to purchase other services in addition to the standard oil change and to
purchase other parts in addition to oil and air filters. These 60 employees were divided
into upper and lower one-third performance groups.
Results: Twenty of the 60 employees were assigned to the upper one-third sales
performance group, whereas 14 of these employees were assigned to the lower one-
third group. Table 3.20 contains the average scale scores and statistically significant
correlations between scale scores and the upper and lower rated groups.
Table 3.20
Sociability 18 14 .42*
Attitude 19 15 .45**
Judgment 19 15 .38*
3-23
THE PROFILEXT® TECHNICAL MANUAL
N=34.
*p<.05.
**p<.01.
Study 3:
Description of the Project: Fifty-two experienced new and used auto sales incumbents
were dichotomized on the basis of the number of cars sold during a 12-month period.
Although 40 of the sales personnel sold between 10 and 12 cars per month, 12 of them
sold between 18 and 22 cars each month. All sales personnel completed the
assessment and scale scores were correlated with sales performance.
Results: Table 3.21 contains the average scale scores and the statistically significant
correlations between the scale scores and sales performance grouping into high and
low performers.
Table 3.21
Assertiveness 25 21 .42**
3-24
THE PROFILEXT® TECHNICAL MANUAL
Sociability 26 21 .45**
N=52.
**p<.01.
The three studies summarized above are in line with what is generally accepted
regarding successful salespeople, particularly for sales positions that require a highly
aggressive sales approach. That is, top salespeople tend to be highly energetic, results-
oriented, and quick to take action. They tend to become impatient with others who do
not share their high sense of urgency. They are assertive, aggressive, and have a
strong need to take command of situations. They tend to be more people-oriented than
data-oriented and are strongly motivated by recognition and acceptance.
Each of the scales has five levels of performance ranging from Poor or Below Standard
(1 point) to Excellent or Well Above Standard (5 points).
Results: Table 3.22 presents the significant correlations between scale scores and
these seven evaluation measures.
Table 3.22
3-25
THE PROFILEXT® TECHNICAL MANUAL
N=122.
**p<.01.
Employees who tend to be friendly and accommodating have a positive attitude and
show good judgment. They received significantly higher evaluation scores for their
interpersonal relations and for their treatment of customers when compared with their
coworkers who scored significantly lower on these scales.
Study 1:
Description of the Project: The assessment was administered to 120 convenience store
managers. Twelve District Managers, four Regional Managers, and five Training/
Human Resource Managers completed annual performance evaluation reports on these
Store Managers. A composite scale was created for the purpose of this project. This
composite scale consisted of the following separate scales:
Twenty-three of the 120 managers received a total evaluation score between 36 and 50
(High Group), whereas 21 of the managers received a total score between 7 and 18
points (Low Group). Table 3.23 lists the average scale scores and correlations for the
most significant relationships.
3-26
THE PROFILEXT® TECHNICAL MANUAL
Results: Table 3.23 contains the average scale scores and correlations for the most
significant relationships between PTP scale scores and the composite rating.
Table 3.23
Judgment 21 15 .44**
N=44.
**p<.01.
Discussion: According to Table 3.23, the composite management evaluation scale was
significantly related to high scores of Objective Judgment and Energy Level. These
anticipated results indicated that top producing convenience Store Managers tend to be
significantly more energetic, results oriented, and concerned with timely results than the
less successful Store Managers. In addition, highly successful Store Managers are
more logical and objective when compared to their less successful counterparts.
Study 2:
Description of the Project: Thirty-six District Managers of a national residential property
management company were administered the assessment. Nine Regional Vice
Presidents rated the District Managers with regard to their overall performance and
results. These District Managers were then divided into upper and lower halves on the
basis of their ratings.
Results: Table 3.24 contains the average scale scores and correlations for the most
significant relationships between scale scores and ratings data.
Table 3.24
3-27
THE PROFILEXT® TECHNICAL MANUAL
Assertiveness 25 21 .45**
Judgment 24 19 .32**
N=36.
**p<.01.
Discussion: According to Table 3.24, the District Managers who represented the upper
half of the performance rating distribution expectedly scored significantly higher on the
Energy Level, Assertiveness, and Objective Judgment scales when compared with
managers who were in the lower one-half of the rating distribution.
Study 3:
Description of the Project: One hundred thirty apartment Property Managers were
administered the assessment. Twenty District Managers, nine Regional Vice
Presidents, and five Training/Human Resource Managers rated the overall performance
and effectiveness of the 130 managers. Table 3.25 contains the average scale scores
and correlations for the most significant relationship between scale scores and the 20
Top and 20 Bottom rated Property Managers.
Results: According to Table 3.25, the Top 20 rated Property Managers scored
significantly higher on the Assertiveness, Objective Judgment, Attitude, and
Accommodating scales when compared with the Bottom 20 rated Property Managers.
The correlations ranged from .35 to .46.
Table 3.25
3-28
THE PROFILEXT® TECHNICAL MANUAL
Top 20 Bottom 20
Managers Managers
Assertiveness 21 15 .45**
Judgment 20 14 .46**
Attitude 21 17 .35*
Accommodating 22 18 .38*
*p<.05.
**p<.01.
Study 4:
Description of the Project: As an extension of Study 3, the raters were asked to identify
from the total group of 130 Property Managers those Property Managers who had the
management capabilities and developmental potential to eventually become District
Managers. The rating procedure resulted in 12 Property Managers being identified as
having future District Manager potential. Table 3.26 contains the most significant
correlations between Property Managers ratings and average scale scores.
Table 3.26
Assertiveness 23 19 .49*
Judgment 23 18 .39*
Independence 18 13 .40*
3-29
THE PROFILEXT® TECHNICAL MANUAL
*p<.01.
Study 5:
Description of the Project: The assessment was administered to 115 commercial
District Managers from a national property management company. Twenty-one
Regional Supervisors identified the Top and Bottom 25 managers with respect to their
overall management effectiveness and results. Table 3.27 contains the most significant
correlations between average scale scores and manager ratings for these two groups of
District Managers.
Results: Table 3.27 indicates significant differences between the Top and Bottom 25
District Managers on Energy Level, Assertiveness, and Judgment.
Table 3.27
Assertiveness 23 19 .58*
Judgment 22 18 .55*
*p<.01.
Discussion: Correlations were all in the .50 range indicating strong relationships
between these three scales and management performance.
3-30
THE PROFILEXT® TECHNICAL MANUAL
Summary: Overall, results of the projects summarized above are highly consistent with
what had been expected and are clearly in line with other validation findings concerning
the relationship between specific personality dimensions and management
performance. Successful managers are energetic, self-motivated, and achievement
oriented; they value time and prefer to interact with others in a direct and decisive
manner. They tend to be highly assertive and have a strong need to take charge, be in
control, and make their own decisions. They are logically-minded and prefer clearly-
defined goals, measurable results, and tangible incentives. Challenging assignments
and opportunities for advancement motivate these managers.
Results: According to Table 3.28, the employees who were still employed after two
years of employment scored significantly higher on the Energy Level, Judgment, and
Attitude scales when compared with the separated employees. The correlations
between these three PTP scales and tenure ranged from .38 to .45.
Table 3.28
Judgment 22 17 .38*
Attitude 21 15 .45*
N=54.
*p<.01.
3-31
THE PROFILEXT® TECHNICAL MANUAL
Table 3.29
3-32
THE PROFILEXT® TECHNICAL MANUAL
N=40.
*p<.05.
**p<.01.
Results: Table 3.29 lists the significant relationships between the status of these three
groups of employees and their scores. Additionally it was found:
Energy Level when compared with the Associates (t=3.2, df=28, p<.01)
Assertiveness when compared with the Project Managers (t=2.9, df=15, p<.01)
and the Associates (t=3.1, df=28, p<.01)
Sociability when compared with the Project Managers (t=3.7, df=15, p<.01) and
with the Associates (t=3.9, df=28, p<.01)
The Project Managers scored significantly higher on:
Discussion: These findings are expected and consistent with the results obtained from
other industries and organizations. For example, Table 3.30 contains average scale
scores for Energy Level, Assertiveness, and Sociability for the top, middle, and lower
status positions across a broad and diverse range of industries. Although t-tests and
correlations were not computed for this data, there is a clear and consistent relationship
between these average scale scores and organizational status. That is, highly
energetic, assertive, and people-oriented individuals are more inclined to move upward
within their respective organizations when compared with individuals who are relatively
less energetic, less assertive, and not as people oriented.
Table 3.30.
Average Energy Level, Assertiveness, and People Service Raw Scores by Job Titles
Executive 24 24 21
Mid-Management 21 20 20
3-33
THE PROFILEXT® TECHNICAL MANUAL
Lower Management 20 19 18
Residential/Commercial
Property Management
Regional V.P. 24 24 22
District Manager 21 22 21
Property Manager 19 20 20
All Industries
Plant Manager 22 22 20
Production Manager 19 20 18
Supervisor/Foreman 17 29 16
Auto Dealerships
General Manager 24 24 25
General Sales Manager 22 22 21
Sales Manager 21 21 20
All Industries
All Industries
Operations Manager 23 24 21
District Manager 21 22 20
Store Manager 19 20 18
3-34
THE PROFILEXT® TECHNICAL MANUAL
The data for this analysis is the product of case studies provided by the Profiles
International, Inc. Client Services Department. Each participant took the PXT and was
evaluated by the organization to which they belonged. A pattern was built for each
position using actual performance results and job performance measures. A
correlational relationship between the Behavioral Traits Job Match Percents of the Top
and Bottom Performers and their performance rating was then calculated for each
study. Using the Hunter and Schmidt Method (Hunter and Schmidt, 2004) the
correlations of each individual study were weighted by the sample size, summed, and
then divided by the number of participants across all samples.
Table 3.31
Dividing the summed, weighted value (68.608) by the total sample size (N=122)
quotient reveals a .598 correlation coefficient. This value indicates a positive,
moderately strong relationship between the measured Behavioral Traits Job Match
Percent and the Performance rating assigned by the candidate’s organization.
The next step is to calculate credibility intervals by adding or subtracting the square root
of the estimated population variance multiplied by 1.96 (to provide a 95% interval) from
the true study effect of .598.
3-35
THE PROFILEXT® TECHNICAL MANUAL
As suggested by this analysis, the Behavioral Traits Job Match Percents acquired from
this sample of seven studies and 122 job candidates indicates good predictive utility of
the organizational performance ratings.
Table 3.32 is a frequency distribution of Distortion scores for the total sample.
Table 3.32
# of Loading Cumulative
Frequency Percent
Responses Percent
3-36
THE PROFILEXT® TECHNICAL MANUAL
According to Table 3.32, 49.7% of the total sample did not respond to any of the seven
Distortion questions in a manner suggesting a desire for positive impression (a loading
response). 22.2% of the total sample responded to one of the questions in this manner.
Finally, 83.2% of the total sample had only three or less atypical Distortion responses,
thus providing considerable support for the infrequent response rationale for the
questions in this scale.
When reported in the ProfileXT reports, the Distortion Scale has a negative load. For
example, a raw score of 0 (zero) yields a Distortion Scale score of 10 (ten). Only a low
Distortion Scale score suggests possible disclosure issues. See the User’s Guide for
details on interpretation.
The second method for analyzing the utility of the Distortion Scale on the ProfileXT
reviews how likely it is that one will select or identify with a particular item on the
Distortion Scale. Unlike the normally distributed item response rates of the Behavioral
Traits scales, selection rates of the Distortion Scale questions should be relatively low if
each item is to be considered a valid component.
The same sample of 206,328 working adults was studied for their Distortion item
response rates. The following table illustrates these response rates and demonstrates
how each individual item may be considered a valid component of the scale.
Table 3.33
3-37
THE PROFILEXT® TECHNICAL MANUAL
Response
Item* Response** Frequency Percent
N=206,328.
*actual item numbers in the test booklet not revealed.
**loading responses are those that are not considered representative of an open
level of disclosure; non-loading responses are those that represent a more
candid level of disclosure.
Adverse Impact
Profiles International, Inc. conducted a study to investigate the effects of age, gender,
and ethnicity on the results of the Behavioral Traits section. The subjects included over
200,000 adults from various sales, support, and management backgrounds. All scores
were acquired from the working population in a variety of industries and corporate
settings across the United States. The sample represents a diversity of males and
females, as well as, Asians, African Americans, Hispanics, and Caucasians.
3-38
THE PROFILEXT® TECHNICAL MANUAL
Table 3.34 and provides frequencies of each ethnic group and percentages of the total
sample group.
Table 3.34
Valid Cumulative
Ethnicity Frequency Percent Percent Percent
No Data
Volunteered 51362 24.9
Table 3.35
Valid Cumulative
Gender Frequency Percent Percent Percent
3-39
THE PROFILEXT® TECHNICAL MANUAL
No Data
Volunteered 42521 20.6
In our sample, 158,016 subjects volunteered information regarding age group. The
distribution of age groups in the sample is displayed in Table 3.36.
Table 3.36
Valid Cumulative
Age Range Frequency Percent Percent Percent
No Data
Volunteered 48428 23.5
Raw scores for the sample were analyzed on the basis of age, gender, and ethnicity
using an analysis of variance (ANOVA) with a Scheffe analysis for post hoc multiple
comparisons for ethnicity and age group. These tests reveal the degree to which groups
tend to differ in score distributions. Statistically significant differences in mean raw
scores are identified (see Appendix C).
3-40
THE PROFILEXT® TECHNICAL MANUAL
We noted how the mean raw score differences between groups on each scale are quite
small; only one or two raw score points difference on average. This has no practical
effect on an individual’s Overall Pattern Match. Although these differences may be
designated as significantly different from a statistical perspective due to the large
sample sizes, the small variances are slight and have no practical effect on an
individual’s selection potential.
That appraisal, in the ProfileXT, is referred to as the Job Match Percent. There are four
appraisal scores used in the ProfileXT: Behavioral, Interests, Thinking Style, and
Overall Job Match Percents. Decision makers may reference these percentages as a
summary estimation of the candidate’s potential in the job. If these percentages
adversely impact individuals, then the assessment is doing both the decision maker and
the candidate a disservice.
A study was conducted which demonstrates the effectiveness of the Job Match
Percents and their associated Job Match Patterns to remove adverse impact despite
the slight variances noted among individual raw scores in the sample. The sample
included over 900,000 administrations of ProfileXT scores matched to Job Match
Patterns. This sample of administrations included a variety of ethnicities, age groups,
and both genders selected from job matching cases across the United States in a
variety of industrial and corporate settings.
In each case, a candidate was matched to a Job Match Pattern. Self-selection for each
job is inherent for each case. In other words, members of the sample chose what
pattern to which they were to be matched by becoming candidates for those jobs.
Approximately 200,000 Job Match Patterns were included in the study representing a
wide range of job types. In every case, each candidate was assumed to be qualified for
candidacy for the job and it’s Job Match Pattern.
3-41
THE PROFILEXT® TECHNICAL MANUAL
Table 3.37
Valid Cumulative
Ethnicity Frequency Percent Percent Percent
Table 3.38
Valid Cumulative
Gender Frequency Percent Percent Percent
Table 3.39
3-42
THE PROFILEXT® TECHNICAL MANUAL
Valid Cumulative
Age Range Frequency Percent Percent Percent
Differences in Job Match Percentages between ethnic, gender, and age groups were
typically one or two percentiles on average which does not impact an individual’s
selection potential at any practical level. Statistical details concerning this study may be
found in Appendix D.
With regard to the validity of the ProfileXT (PXT), an analysis of the intercorrelations
among the nine personality scales indicated a pattern of converging and diverging
relationships that are clearly consistent with expectations based on the constructs being
measured.
The patterns of convergent and divergent correlations between the assessment and
other measures of personality are also largely consistent with expectations based on
the questions and scales of these tests.
Overall, results of our analyses of internal and external validity consistently indicate the
PXT is a valid measure of what it was designed and intended to measure, namely nine
dimensions of “normal” adult personality.
This chapter summarized the results of several validation projects that examined the
relationship between scales of the assessment and a diverse range of criteria. The
3-43
THE PROFILEXT® TECHNICAL MANUAL
results of these projects provided consistent and substantial support for the predictive
validity of the assessment. Correlations between scale scores and measures of sales
success, management performance, customer service, conscientiousness, turnover,
and organizational status were consistently significant. These studies support the
concurrent validity of the PXT when job performance is the criterion.
We observed that the ProfileXT Energy Level and Assertiveness scales tend to be
significantly related to sales success, management performance, and organizational
status, whereas the Attitude, Accommodating, and Objective Judgment scales tend to
be significantly related to customer service effectiveness, employee conscientiousness,
and appropriate turnover/retention.
Statistical analyses of the ProfileXT clearly indicate the PXT job matching process
provides an accurate measure of nine dimensions of “normal” adult personality that are
useful for predicting a number of important business-related criteria without adversely
impacting individuals by virtue of their ethnicity, gender, or age.
3-44
THE PROFILEXT® TECHNICAL MANUAL
Descriptive Statistics
The ProfileXT® Occupational Interests Inventory has been administered to over 400,000
individuals from various work, educational, and job seeking environments. This
normative sample consists of a diverse cross-section of age groups, gender, ethnicities,
educational levels, and occupations. Table 4.1 contains the mean raw scores, standard
deviations, and other descriptive statistics for the six PXT Occupational Interests
Inventory theme-related scales (Enterprising, Financial/Administrative, People Service,
Technical, Mechanical, and Creative) derived from our analysis of this sample.
Table 4.1
Standard Standard
Mean Error Deviation Minimum Maximum
N=206,443.
Reliability Analysis
4-1
THE PROFILEXT® TECHNICAL MANUAL
Table 4.2 contains coefficient alpha correlations for the six Occupational Interest
Inventory scales. A sample of 206,443 participants in the working environment was
used for this study.
Table 4.2
Coefficient Alpha
Enterprising 0.84
Financial/Administrative 0.74
Technical 0.76
Mechanical 0.81
Creative 0.78
This analysis indicates that, as a whole, the PXT Occupational Interests Section is a
reliable measure of occupational interests.
4-2
THE PROFILEXT® TECHNICAL MANUAL
Table 4.3
Gender Percent
Male 48.2
Female 51.8
N=83.
Table 4.4
Ethnicity Percent
White 83.2
Black 6.0
Hispanic 7.2
Other 3.6
N=83.
4-3
THE PROFILEXT® TECHNICAL MANUAL
Table 4.5
High School
Graduate 16.9
Associate Arts
Degree 15.6
N=83.
The test-retest correlations for the Interests Scale are shown in Table 4.6.
Table 4.6
Enterprising 0.74
Financial/Administrative 0.76
Technical 0.71
Mechanical 0.68
N=83.
4-4
THE PROFILEXT® TECHNICAL MANUAL
The results of this study using employees of a manufacturing company are typical of our
target population. The higher level of correlation may be explained by their completing
the assessments in a work environment and perhaps taking the task more seriously.
These results show good test-retest reliability for all scales.
Validity
Validity of assessments concerns how applicable and relevant the results are for actual
decision making purposes. Various methods used for demonstrating the validity of the
PXT Occupational Interest Section are provided below.
Although there are different methods for evaluating construct validity, two of the most
informative methods include examining the correlation coefficients (1) among the scales
within the new instrument and (2) between the new instrument and other psychological
measures which have been shown to measure the same or similar constructs. The
pattern of correlations should be consistent with expectations based on what these
scales were intended to measure. Scales that measure related personality constructs
should be highly correlated whereas scales that measure unrelated constructs should
not correlate well.
4-5
THE PROFILEXT® TECHNICAL MANUAL
Table 4.7
People
Enterprising Finan/Admin Service Technical Mechanical Creative
Creative 1.00
N=206,443.
*significance level <=.01.
Table 4.7 indicates the correlation coefficients ranged from .385 (Financial/
Administrative with Technical) to .013 (Enterprising with Financial/Administrative). The
average level of correlation of these scales is 0.145 overall. Thus, the six Occupational
Interests Scales appear to be sufficiently independent. As predicted, the greatest
commonality exists between Financial/Administrative and Technical, Enterprising and
People Service, and People Service and Creative. These commonalities are likely to
stem from similar work experiences between these Occupational Interests themes.
Enterprising and People Service are both people-oriented themes but differ in their
approach and intent for such interaction. Financial and Technical are both data-oriented
but differ in how the data is used. Finally, People Service and Creative are more about
feelings and expressions but differ in the undertaking. It is likely many Job Match
Patterns reflect the commonality of these Occupational Interests themes in many work
settings. All other correlations yield a null relationship which is desirable for
differentiating one theme from another.
4-6
THE PROFILEXT® TECHNICAL MANUAL
Table 4.8
Correlation
ProfileXT Scales SDS Scales Coefficient
N=190.
*significance level ≤ .01.
The results demonstrate how closely associated the constructs of the PXT Occupational
Interests Section are to the constructs of the SDS. Some inverse relationships exist;
these signify that a high score for a particular PXT interests theme suggests lower
scores on a non-corresponding interests theme for the SDS. For instance, when the
PXT Mechanical scale yields a high score for an individual, you may find their Social (S)
score for the SDS is low. This demonstrates some of the tendencies for the general
population to express what interests them and what, in many cases, is not attractive at
all.
4-7
THE PROFILEXT® TECHNICAL MANUAL
Concurrent Validity
For example, Table 4.9 contains the average scale scores for a group of Sales (N=99)
and Construction (N=74) applicants for a large volume national homebuilder.
Table 4.9
Construction
Sales Applicants Applicants
N=99 N=74
Mechanical 4 9
Technical 4 5
People Service 7 4
Financial/Administrative 3 4
Enterprising 10 7
Creative 7 5
As anticipated, Table 4.9 clearly indicates the average scale score for the Sales
Applicants was significantly higher on the Enterprising (avg=11; t=4.70) and People
Service (avg=7; t=4.20) Scales than for the group of Construction Applicants
(Enterprising avg=7; People Service avg=4). In addition, the Construction Applicant
group scored significantly higher on the Mechanical Scale (avg=9; t=3.20) when
compared with the Sales Applicants (avg=4).
4-8
THE PROFILEXT® TECHNICAL MANUAL
Table 4.10 contains the high point profiles for these two groups of applicants.
Table 4.10
Construction
Sales Applicants Applicants
N=99 N=74
Mechanical 51%
Technical 4% 6%
Financial/Administrative 2%
Creative 12% 8%
According to Table 4.10, 72% of the Sales Applicants had an Enterprising high point
profile, whereas 51% of the Construction Applicants had a Mechanical high point profile.
These findings indicate that, as expected, the Occupational Interest Inventory
categorized job applicants in ways which are compatible with the scale meanings.
Table 4.11 contains the average scale scores for a group of incumbent Chief
Accountants (N=43) and Accounting Managers (N=30) who were employed with an
international wholesale food distributor. Within this organization, Chief Accountants are
primarily financial specialists, whereas Accounting Managers are required to directly
manage a staff of accountants and financial personnel. They are more involved in the
daily business activities of the organization. Thus, both groups of employees would be
expected to share a high Financial/Administrative interests scale score. The Accounting
Manager group, however, would be expected to have a higher average score on the
Enterprising Scale when compared with the Chief Accountants.
4-9
THE PROFILEXT® TECHNICAL MANUAL
Table 4.11
Mechanical 6 6
Technical 5 7
People Service 5 7
Financial/Administrative 8 8
Enterprising 6* 9*
Creative 5 5
*p< .01.
According to Table 4.11, both groups of incumbents had very similar interest patterns.
As predicted, however, the Accounting Managers had a significantly higher average
score on the Enterprising Scale (avg=9; t=2.7) when compared with the Chief
Accountants (avg=6).
Table 4.12 contains the high point profile for the combined Chief Accountant and
Accounting Manager groups (N=73) and a third group of employees consisting of 57
Division Controllers from the same organization.
4-10
THE PROFILEXT® TECHNICAL MANUAL
Table 4.12
Chief
Accountants/Accounting Controllers
Managers
N=73 N=57
Mechanical 14% 4%
People Service 5% 4%
Creative 4% 0%
Table 4.12 indicates the Occupational Interests Inventory produced results which are
consistent with the scale meanings. Both groups of employees had a
Financial/Administrative high point profile.
Analysis of the Occupational Interests Inventory scale scores for a large national multi-
family property development and management company also produced positive results.
Occupational Interests Inventory scales have shown to discriminate among Leasing
Consultants, Property Maintenance Supervisors, and Project Manager/Construction
Superintendent applicants.
Table 4.13 contains the average Occupational Interests Inventory scale scores for
Leasing Consultant (N=65), Maintenance Supervisor (N=34), and Project
Manager/Construction Superintendent (N=33) applicants.
4-11
THE PROFILEXT® TECHNICAL MANUAL
Table 4.13
Project
Leasing Maintenance
Managers/Construction
Consultants Supervisors
Superintendents
N=65 N=34 N=33
Mechanical 3* 9* 8*
Technical 5 6 6
People Service 9* 5* 5*
Financial/Administrative 5 4 6
Enterprising 10* 6* 6*
Creative 8 4* 5*
*p< .01.
Table 4.13 indicates that although there were no significant differences in average scale
scores between the Maintenance Supervisor and Project Manager/Construction
Superintendent groups, the Leasing Consultant group, as expected, had significantly
higher average scores for the Enterprising (avg=10; t=5.1), People Service (avg=9;
t=4.2), and Creative scales (avg=8; t=3.9) when compared with the other two groups of
applicants. Both Maintenance Supervisor and Project Manager/Construction
Superintendent groups scored significantly higher on the Mechanical Scale (avg=9 for
Maintenance Supervisors and avg=8 for the Project Managers/Construction
Superintendents; t=4.2) than the Leasing Consultant group (avg=3; t=4.2).
4-12
THE PROFILEXT® TECHNICAL MANUAL
Table 4.14 contains the high point profile for the Leasing Consultant and combined
Maintenance Supervisor, Project Manager/Construction Superintendent group.
Table 4.14
Mechanical 3% 54%
Technical 7% 10%
Financial/Administrative 14% 5%
Creative 13% 3%
Once again, as anticipated, the high point profile is clearly related to these diverse
occupational groups. Other occupational groups have been assessed with the
Occupational Interests Inventory and have produced results which are consistent with
the scale meanings.
For example, Table 4.15 contains the average Occupational Interests Inventory scale
scores for a large commercial architectural firm consisting of seven Principals, ten
Project Managers, and 23 Associate Architects.
4-13
THE PROFILEXT® TECHNICAL MANUAL
Table 4.15
Mechanical 6 10 8
Technical 8 10 7
People Service 6 4 2
Financial/Administrative 4 6 4
Enterprising 8 9 6
Creative 10 10 8
Table 4.16 contains the high point profile for the total group.
Table 4.16
Total Group
N=40
Mechanical 25%
Technical 6%
Financial/Administrative 6%
Enterprising 19%
Creative 44%
4-14
THE PROFILEXT® TECHNICAL MANUAL
Tables 4.15 and 4.16 indicate the Occupational Interests Inventory scales accurately
classified employed architects in ways which are, as theorized, highly consistent with
the scale meanings. That is, 44 % of the total group of architects had a Creative high
point profile followed by a Mechanical high point profile.
Table 4.17 contains the average Occupational Interests Inventory scale scores for Sales
Applicants, Sales Manager Applicants, and Service/Body Shop Manager Applicants for
four automobile dealerships with 13 locations throughout the southwest.
Table 4.17
Mechanical 5 6 8
Technical 4 5 6
People Service 5 6 4
Financial/Administrative 5 5 5
Creative 6 6 4
*p<.01.
Table 4.17 indicates that the Sales and Sales Manager applicants were, as expected,
significantly higher on the Enterprising Scale (avg=10 for Sales applicants and avg=11
for Sales Manager applicants) when compared with the Service and Body Shop
Manager Applicants (avg=8).
4-15
THE PROFILEXT® TECHNICAL MANUAL
Table 4.18 contains the high point profile for these different groups of applicants.
Table 4.18
Mechanical 4% 8% 36%
Technical 3% 2% 5%
People Service 7% 6% 7%
Financial/Administrative 4% 2% 9%
Table 4.18 indicates more than 70% of the Sales and Sales Manager Applicants had an
Enterprising high point profile compared with 33% of the Service and Body Shop
Manager Applicants; 36% of the Service and Body Shop Manager Applicants had a
Mechanical high point profile compared with only 3% of the Sales and Sales Manager
Applicants.
4-16
THE PROFILEXT® TECHNICAL MANUAL
Table 4.19
Sample
Sample Size Mechanical Technical People Fin/Admin Enterprising Creative
Home Construction 74 9 5 4 4 7 5
Chief Accountants 43 6 5 5 8 6 4
Accounting Managers 30 6 5 5 8 9 5
Leasing Consultants 65 3 5 9 5 10 8
Maintenance Supervisors 34 9 6 5 4 6 4
Project Manager/Construction 33 8 6 5 6 6 5
Superintendents
Architect (Principals) 7 6 8 6 4 8 10
Architect (Associates) 23 8 7 2 4 6 8
Division Controllers 57 5 4 3 7 8 3
Property Managers
(Apartments) 130 3 4 9 5 10 5
District Managers
(Apartments) 26 5 4 7 7 9 5
Property Managers/Leasing 54 3 4 9 4 9 7
Consultants
4-17
THE PROFILEXT® TECHNICAL MANUAL
Predictive Validity
Congruence refers to the degree of fit between a person and a job or organization. It
has been argued the greater the degree of similarity between an employee’s
occupational interests and the interests called for in the job, the more likely it is there
will be a successful match and the employee will perform the job well and feel motivated
to work. Tables 4.20, 4.21, and 4.22 support this argument.
Table 4.20
Employed Separated
N=25 N=29
Mechanical 4 2
Technical 4 4
People Service 9* 7*
Financial/Administrative 5 3
Enterprising 10* 8*
Creative 5 7
*p<.05.
4-18
THE PROFILEXT® TECHNICAL MANUAL
Table 4.20 indicates the average scale score for the 25 employed individuals was, as
expected, significantly higher for People Service (avg=9; t=2.6) and Enterprising
(avg=10; t=2.8) when compared with the separated individuals (People Service avg=7,
Enterprising avg=8).
Table 4.21 contains the average scale scores for a group of 130 Property Managers
who were employed with a large national apartment property management company.
Table 4.21 also contains the average scale score for 12 of these 130 Property
Managers who were identified by their District Managers, Regional Vice Presidents, and
Training Managers as the top producing Property Managers in the organization.
Table 4.21
Mechanical 4 5
Technical 4 6
People Service 5* 8*
Financial/Administrative 6 6
Enterprising 8* 10*
Creative 6 7
*p<.05.
Table 4.21 indicates the top producing Property Managers scored, as anticipated,
significantly higher on the People Service (avg.=8; t=3.6) and Enterprising (avg=10;
t=3.4) Scales of the Occupational Interests Inventory when compared with a large
sample of their coworkers.
Table 4.22 contains the average Occupational Interests Inventory scale scores for a
group of 29 District Property Managers who were rated by their Regional Vice
Presidents as above average performers. These individuals were compared with a
group of 21 District Property Managers who were rated as below average performers.
4-19
THE PROFILEXT® TECHNICAL MANUAL
These two groups of District Managers were employed with a large international
residential property management organization consisting of 90 District Managers.
Table 4.22 indicates that the above average District Managers scored significantly
higher on the People Service (avg=9; t=3.6) and Enterprising (avg=10; t=3.0) Scales of
the Occupational Interests Inventory when compared with the below average District
Managers.
Table 4.22
Mechanical 5 5
Technical 5 4
Financial/Administrative 8 7
Enterprising 10* 7*
Creative 7 6
*p<.05.
**p<.01.
4-20
THE PROFILEXT® TECHNICAL MANUAL
are pooled to create a larger sample. As a statistical given, the larger the sample, the
greater the trust in the results.
The data for this analysis is the product of case studies provided by the Profiles
International, Inc. Client Services Department. In each of these studies, the participant’s
performance was evaluated by the organization to which they belonged; they were then
administered the ProfileXT. An individual pattern was built for each position in the study
using actual performance results and relevant job performance measures (for more
information on building patterns see Chapter 1) resulting in a Job Match Percent. A
correlational relationship between the Occupational Interest Job Match Percents of the
Top and Bottom Performers and their performance rating was then calculated for each
study. Using the Hunter and Schmidt Method (Hunter and Schmidt, 2004) the
correlations of each individual study were weighted by the sample size, summed and
then divided by the number of participants across all samples.
Table 4.23
Dividing the summed, weighted value (35.727) by the total sample size (N=98) quotient
reveals a .365 correlation coefficient. This value indicates a positive, moderately strong
relationship between the measured Occupational Interests Job Match Percent and the
Performance rating assigned by the candidate’s organization.
4-21
THE PROFILEXT® TECHNICAL MANUAL
The next step is to calculate credibility intervals by adding to or subtracting the square
root of the estimated population variance multiplied by 1.96 (to provide a 95% interval)
from the true study effect of .365.
As suggested by this analysis, the Occupational Interests Job Match Percents acquired
from this sample of seven studies and 98 job candidates indicates good predictive utility
of the organizational performance ratings.
4-22
THE PROFILEXT® TECHNICAL MANUAL
Table 4.24
Valid Cumulative
Ethnicity Frequency Percent Percent Percent
Table 4.25
Valid Cumulative
Gender Frequency Percent Percent Percent
4-23
THE PROFILEXT® TECHNICAL MANUAL
Table 4.26
Valid Cumulative
Age Range Frequency Percent Percent Percent
4-24
THE PROFILEXT® TECHNICAL MANUAL
Raw scores for the sample were analyzed using an analysis of variance (ANOVA) with
a Scheffe analysis for post hoc multiple comparisons for ethnicity. These tests reveal to
what degree the groups analyzed tend to differ in score distributions. Statistically
significant differences in mean raw scores are identified.
We found the differences between groups on each scale were quite small, yet often
designated as significantly different. A statistician may appreciate the implication of that
fact, yet in practical terms, these slight differences have no significant effect upon an
individual’s selection potential in the workplace.
That appraisal in the ProfileXT is referred to as the Job Match Percent (JMP). There are
four JMPs used in the ProfileXT: Behavioral JMP, Interests JMP, Thinking Style JMP,
and the Overall JMP. Decision makers may reference these percentages as a summary
estimation of the candidate’s potential in the job. If these percentages adversely impact
individuals, then the assessment is doing both the decision maker and the candidate a
disservice.
A study was conducted which demonstrated the effectiveness of the Job Match
Percents and their associated Job Match Patterns to remove any practical adverse
impact, despite the slight variances noted among raw scores in the sample. The sample
included over 900,000 administrations of PXT scores matched to Job Match Patterns.
This sample included a variety of ethnicities, age groups, and both genders. In each
case, a candidate was matched to a Job Match Pattern which represented a distribution
of scores common among the best performers in each job. In each instance, the
applicant made their own selection of the job because they thought they could
effectively do the job. Approximately 200,000 Job Match Patterns were included in this
study, representing a wide range of job types.
Table 4.27
4-25
THE PROFILEXT® TECHNICAL MANUAL
Valid Cumulative
Ethnicity Frequency Percent Percent Percent
Table 4.28
Valid Cumulative
Gender Frequency Percent Percent Percent
Table 4.29
Valid Cumulative
Age Range Frequency Percent Percent Percent
4-26
THE PROFILEXT® TECHNICAL MANUAL
Differences in Job Match Percentages between ethnic, gender, and age groups were
typically one or two percentiles which do not impact job selection at any practical level.
Statistical details concerning this study may be found in Appendix C.
In conclusion, the data summarized in this manual consistently supports the fact that the
ProfileXT Occupational Interests Inventory consistently measures six general themes of
interests based upon preferences for commonly known activities. The test generates
similar results compared to other tests, while measuring interests in a unique way.
Mean raw score differences, while statistically significant, do not have impact under the
benchmarking system utilized by the PXT. The PXT Occupational Interests Inventory
provides accurate and useful information for preemployment screening and placement,
as well as for occupational and career guidance.
It can be argued the greater the degree of similarity between a person’s occupational
interests and the interests called for in the job, the more likely it is there will be a
successful match and the person will be more satisfied, will feel motivated by their job,
and will perform well. The results of our studies clearly support this best fit job screening
and placement strategy.
Analysis of the PXT Occupational Interests Inventory has indicated the following:
• The Occupational Interests Inventory contains six scales which are internally
consistent and independent from each other.
4-27
THE PROFILEXT® TECHNICAL MANUAL
4-28
THE PROFILEXT® TECHNICAL MANUAL
Descriptive Statistics
For years, the Thinking Styles section of the Profile and the ProfileXT® has proven to
effectively assess the thinking abilities of job candidates and incumbent employees.
Throughout the years of this assessment’s evolution, the Thinking Styles section has
only needed minimal revision. This is primarily due to its consistently high reliability and
validity, and to the practicality and utility of its test form. Table 5.1 shows the descriptive
statistics for the Thinking Styles section scales.
Table 5.1
Standard Standard
Thinking Scales Mean Error Deviation Minimum Maximum
N=206,443.
Reliability Analysis
The reliabilities for each of the four scales in the Thinking Styles section were computed
using the standard coefficient alpha method. The results for over 200,000 assessment
users representing a broad diversity of gender and ethnicity were analyzed. Table 5.2
shows the results of this analysis.
5-1
THE PROFILEXT® TECHNICAL MANUAL
Table 5.2
Average .81
N=206,443.
As noted in Table 5.2, reliabilities ranged from a low of .79 for the Numeric Reasoning
scale to a high of .84 for the Numerical Ability scale. The average reliability for these
four scales was .81. These reliability scores suggest the Verbal and Numerical scales
are reliable and produce consistent results.
Table 5.3
N=157.
5-2
THE PROFILEXT® TECHNICAL MANUAL
These results demonstrate the reliability of the items in the PXT Thinking Style scales to
evoke reasonably consistent responses over time.
Table 5.4
Gender Percent
Male 48.2
Female 51.8
N=83.
Table 5.5
Ethnicity Percent
White 83.2
Black 6.0
Hispanic 7.2
Other 3.6
N=83.
5-3
THE PROFILEXT® TECHNICAL MANUAL
Table 5.6
N=83.
Table 5.7
N=83.
5-4
THE PROFILEXT® TECHNICAL MANUAL
The results from this study using employees of a manufacturing company are typical of
out target population. The higher level of correlation may be explained by their
completing the assessments in a work environment and perhaps taking the task more
seriously. These results indicate good test-retest reliability for all scales.
Validity
Table 5.8
5-5
THE PROFILEXT® TECHNICAL MANUAL
In most cases, these studies were completed within an industrial population that
required specific insight as to learning and training needs. Employers wished to know
how a person would respond to new learning, what areas might prove to be strengths or
weaknesses, and what could be done to overcome any deficits. The results of the
measures were used to highlight these findings and then recommend approaches. For
example, a new supervisor in a bank might require extra time and feedback-style
learning to grasp written materials, whereas his numeric abilities would be suited for the
initial job at hand. In other cases, employers posed the research question “What are the
learning characteristics of our best performers versus our weakest performers?” In
answering this question, the Thinking Style questions were an invaluable part of
assessing group performance versus individual results. This led to the ability on the
employer’s part to gear broad training toward new hires.
The correlation between job performance in various occupations and scores on the
cognitive portion of the assessment showed a positive relationship between learning
characteristics and job performance. Table 5.9 shows the correlation coefficients
between scores and job performance in a wide range of occupations.
5-6
THE PROFILEXT® TECHNICAL MANUAL
Table 5.9
Note: All reported results are significant at the .05 level or better.
5-7
THE PROFILEXT® TECHNICAL MANUAL
The data for this analysis is the product of case studies provided by the Profiles
International, Inc. Client Services Department. In each of these studies the participant’s
performance was evaluated by the organization to which they belonged and then
administered the ProfileXT. An individual pattern was built for each position in the study
using actual performance results and relevant job performance measures (for more
information on building patterns see Chapter 1) resulting in a Job Match Percent. A
correlational relationship between the Thinking Styles Job Match Percents of the Top
and Bottom Performers and their performance rating was then calculated for each
study. Using the Hunter and Schmidt Method (Hunter and Schmidt, 2004) the
correlations of each individual study were weighted by the sample size, summed and
then divided by the number of participants across all samples.
5-8
THE PROFILEXT® TECHNICAL MANUAL
Table 5.10
Dividing the summed, weighted value (41.578) by the total sample size (N=78) quotient
reveals a .535 correlation coefficient. This value indicates a positive, moderately strong
relationship between the measured Thinking Styles Job Match Percent and the
Performance rating assigned by the candidate’s organization.
The next step is to calculate credibility intervals by adding or subtracting the square root
of the estimated population variance multiplied by 1.96 (to provide a 95% interval) from
the true study effect of .535.
As suggested by this analysis, the Thinking Styles Job Match Percents acquired from
this sample of seven studies and 78 job candidates indicates good predictive utility of
the organizational performance ratings.
5-9
THE PROFILEXT® TECHNICAL MANUAL
While the two scale approach had demonstrated its effectiveness in selection, a
decision was made to separate the abstract, or reasoning, portion of each scale from
the ability portion. This was done to provide greater analysis of the cognitive
characteristics of those completing the assessment.
To refine the identification of different aspects of both numerical and verbal abilities,
Numerical and Verbal were sub-divided into two scales. The result was the four scales
currently in use: Verbal Skill, Verbal Reasoning, Numerical Ability, and Numeric
Reasoning.
This new question set was submitted to a group of 137 employees at three different
companies. They ranged in age from 19 to 57, education from High School to Graduate
degree, and were 54% female. Item analysis of the results was used to select the items
for use on each scale. This resulted in the following distribution of the 77 items selected:
Verbal Skill-18, Verbal Reasoning-20, Numerical Ability-22, and Numeric Reasoning-17.
Adverse Impact
Profiles International, Inc. conducted a study to investigate the effects of gender and
ethnicity on the results of the Thinking Styles section. The subjects included over
200,000 adults from various sales, support, and management backgrounds. All scores
were acquired from the working population in a variety of industries and corporate
settings across the United States. The sample represented a diversity of males,
females, Asians, African Americans, Hispanics, and Caucasians.
5-10
THE PROFILEXT® TECHNICAL MANUAL
Table 5.11
Valid Cumulative
Ethnicity Frequency Percent Percent Percent
Table 5.12
Valid Cumulative
Gender Frequency Percent Percent Percent
5-11
THE PROFILEXT® TECHNICAL MANUAL
In our sample, 158,016 subjects volunteered age group demographic information. The
distribution of age groups in the sample is represented in Table 5.13 and provides the
frequencies of age group and percentages of the total sample group.
Table 5.13
Valid Cumulative
Age Group Frequency Percent Percent Percent
Raw scores for the sample were analyzed using an analysis of variance (ANOVA) with
a Scheffe analysis for post hoc multiple comparisons for ethnicity. These tests reveal to
what degree the groups analyzed differ in score distributions. Statistically significant
differences in mean raw scores were identified. The details of this study, including
statistical results, are found in Appendix C.
That appraisal in the ProfileXT is referred to as the Job Match Percent (JMP). There are
four JMPs used in the ProfileXT: Behavioral JMP, Interests JMP, Thinking Styles JMP,
5-12
THE PROFILEXT® TECHNICAL MANUAL
and the Overall JMP. The job match process used by our clients with the PXT utilizes
the Job Match Percent as a measure of how well the prospect fits the job under
consideration. Decision makers may reference these percentages as a summary
estimation of the candidate’s potential in the job. If these percentages adversely impact
individuals in a protected group, then the assessment is doing both the decision maker
and the candidate a disservice.
A study was conducted which demonstrated the effectiveness of the Job Match
Percents and their associated Job Match Patterns to remove any practical adverse
impact, despite the slight variances noted among raw scores in the sample. The sample
included over 900,000 administrations of PXT scores matched to Job Match Patterns.
This sample of administrations included a variety of ethnicities, age groups, and both
genders selected from job matching cases across the United States in a variety of
industrial and corporate settings.
In each case, a candidate was matched to a Job Match Pattern which represents a
distribution of scores common among the best performers in each job. Each candidate
selected the position to which they were matched as representing a position that was a
realistic job for them. Approximately 200,000 Job Match Patterns were included in this
study representing a wide range of job types.
Table 5.14
Valid Cumulative
Ethnicity Frequency Percent Percent Percent
5-13
THE PROFILEXT® TECHNICAL MANUAL
Table 5.15
Valid Cumulative
Gender Frequency Percent Percent Percent
Table 5.16
Valid Cumulative
Age Group Frequency Percent Percent Percent
Differences in Job Match Percentages between ethnic, gender, and age groups were
typically one or two percentiles, which do not impact job selection at any practical level.
Statistical details concerning this study may be found in Appendix D.
5-14
THE PROFILEXT® TECHNICAL MANUAL
Table 5.17 shows the intercorrelation between the Thinking scales. As expected, there
is significant correlation between the four scales suggesting their common relationship
to educational attainment.
Table 5.17
Numerical Reasoning 1
The relationship between test scores and job performance criteria has been
demonstrated across a variety of positions in different industries. This relationship
undoubtedly extends through all revisions of the instrument as the test items remain
unmodified. These results are typical of what the body of research reports.
In its current form, the Thinking Styles section of the ProfileXT has shown statistical
significance between group mean raw scores; the real question of impact on any
protected groups has to do with the percent match of various patterns. Studies reported
in this manual demonstrate this is not an issue (see Appendix B).
By using Job Match Patterns developed with either actual top performers (concurrent
study method) or by analysis of a job by those who know the job well, the ProfileXT
presents representative job patterns for matching. Because the overall match to that
pattern blends information about an individual’s fit in Thinking Styles, Occupational
Interests, and Behavioral Traits, the impact of any one scale is only a small portion of
the total. This helps protect against introducing any disparate impact into the placement
process.
5-15
THE PROFILEXT® TECHNICAL MANUAL
High Scores
• Cooperative
• Wants to make a good impression
• Harmonious
• Likeable
Low Scores
Firm and direct
Willing to disagree
Won’t make peace just to do the accepted thing
High Scores
• Expressive
• Achievement oriented
• Leadership
Low Scores
• Nonassertive
• More a follower than a leader
• Low dominance
• Avoids conflict
Attitude measures the degree to which one is willing to trust others. It relates to
the tendency to suspend judgments about people and outcomes.
High Scores
• Optimistic
• Trusting
• Relaxed
• Affirmative
Appendix A-1
THE PROFILEXT® TECHNICAL MANUAL
Low Scores
Skeptical
Critical
Vigilant for negative outcomes
Questioning
High Scores
• Self-starter
• Multi-tasker
• High vitality
• Self-motivated
Low Scores
• Patient
• Methodical
• Focused
• One thing at a time
High Scores
• Adventurous
• Avoids forced structure from superiors
• Likes to set personal direction
Low Scores
• Seeks support
• Open to having work evaluated
• Accepts supervisory structure
Objective Judgment is the willingness to make use of reason and logic more
than intuition. This is often referred to as the balance between “head” and “gut.”
High Scores
• Uses a logical approach
• Unemotional thinking
• Objective & indifferent
Low Scores
• Subjective
• Follows a “gut” feeling
• Intuitive reasoning
• Non-systematic thinking
Appendix A-2
THE PROFILEXT® TECHNICAL MANUAL
High Scores
• Seeks interpersonal associations
• Motivated by teamwork
• Group oriented
Low Scores
• Distracted by social interruptions
• Sticks to business
• Avoids small talk
• Comfortable working alone
High Scores
• Cooperative and agreeable
• Works within the rules
• Comfortable with authority
Low Scores
Can be cautious with authority figures
Tends to defend point of view
Willing to question when not in agreement with authority
High Scores
• Quick to act
• Accepts the risks in most situations
• Accepts the limited information available for making decisions
• Does not feel the need to gather more information than time allows
Low Scores
Rarely impulsive
Makes deliberate, careful decisions
Tends to pursue problems methodically, taking little risk
Prefers to carefully analyze the situation before making a decision
Appendix A-3
THE PROFILEXT® TECHNICAL MANUAL
The Learning Index score in the Thinking Styles section is a composite of four sub-
scales: Verbal Skill, Verbal Reasoning, Numerical Ability, and Numeric Reasoning. It is
an index of expected learning, reasoning, and problem solving ability. Typically, the
more easily an individual processes information the greater the pace at which they may
learn those skills used on the job. Maximizing learning means finding the approach
which will make the most of a candidate’s available learning skills.
Occupational Interests
Six Occupational Interest areas have been determined to aid in predicting motivation
and satisfaction in various job positions. Each interest area defines a category of
characteristics which identify the unique aspects of work environments. The theories of
Dr. John L. Holland were an essential guide for the development and interpretation of
these Occupational Interests themes. Scores in this section reflect an individual’s
expressed interest in specific occupations from each category represented.
Appendix A-4
THE PROFILEXT® TECHNICAL MANUAL
The People Service scale indicates interest in occupations that help people and
are concerned with the welfare of others.
Characterized by interest in:
• Facilitation
• Helping others
• Social awareness
Appendix A-5
THE PROFILEXT® TECHNICAL MANUAL
Representative occupations sharing this interest include: artists, writers and journalists,
PR consultants, chefs, and advertisers.
The Distortion score refers to the reliability of the results, not the honesty of the
individual. A low score would suggest the individual might have distorted their
responses. This could possibly happen because of an attempt to portray a picture of
how they would like to be seen rather than an accurate picture of how they are. The
Distortion score should never be used as a basis for disqualification of an individual.
Appendix A-6
THE PROFILEXT® TECHNICAL MANUAL
The use of The ProfileXT® and its Job Match Percent (JMP) system help the user
maintain fairness in their placement of people. This section of the PXT Technical
Manual Appendices will discuss some of these considerations and how they are met
with the ProfileXT.
Reliability
The ProfileXT Technical Manual reports on three different types of reliability: test-retest
reliability, split-half reliability, and coefficient alpha reliability. The coefficient alpha
estimates reliability based on the internal consistency of the scales; test-retest
estimates reliability based on two different administrations to the same individuals; and
split-half estimates reliability by testing one half of the questions on each scale against
the other half.
The reported reliabilities are within the guidelines provided by the appropriate agencies.
The total number of questions on the ProfileXT is important because one of the factors
involved in increasing testing reliability is the number of items for each scale. This is
why the more reliable instruments tend to have more questions and take longer to
complete.
Test Validity
There are three types of validity typically considered in test construction and use. They
are content validity, construct validity, and criterion-related validity. Each is defined
briefly below.
Appendix B-1
THE PROFILEXT® TECHNICAL MANUAL
Adverse impact is typically analyzed using the 4/5th rule. What this rule basically
suggests is to first compute the percentage of applicants who were selected from the
most selected group and second, be sure that at least 4/5th percent of all the protected
groups were also selected. To summarize, if there were 20 males and 10 females who
applied for a position and 10 of the males were hired (selection rate =50%), then at least
four of the females should have also been selected (selection rate should equal 4/5th of
50% or 40%).
The Uniform Guideline reviews the results of the overall selection process when they
look for adverse impact. This means the total selection process should be reviewed to
ensure it has no adverse impact on a protected group. This makes it important for an
organization to consistently review the selection process in order to ensure members of
the protected groups are selected at a selection rate that is at least 80% of the selection
rate of the most typically represented group.
Appendix B-2
THE PROFILEXT® TECHNICAL MANUAL
The Job Match Percent represents how closely an individual’s scores across the entire
range of the instrument match a job pattern. Once the job pattern has been developed
for each scale, an individual score can be compared to those patterns. Where their
scores fall outside the pattern there is a decrement made to the percent match. The
further outside the pattern the score falls, the greater the decrement. The sum for all
scales represents the total job match.
In use, this match percent becomes an important piece of the consideration for job
placement. Some users establish a number such as 70%; those who score above this
percentage may be viewed more favorably in the interview process than those who
score below the percentage. In this way, the percentage match to the pattern becomes
one of the important pieces when making a placement decision.
Because the intent of the regulations suggests that the overall process must be
considered when investigating the issue of disparate impact, we reviewed the
relationship of achieving a certain percentage match to a pattern (such as 70%) and
membership in any of the protected groups. It was assumed that achieving a
percentage match of at least 70% was considered for inclusion for this part of the
selection process. Again, the primary interest was whether the members of all groups
would be included at a selection rate within the guidelines provided by the regulations.
To test compliance of The Profile with the Uniform Guidelines two studies were
conducted which analyzed mean percent matches and selection rates for a sample of
diverse candidates with the results presented in the following sections.
In order to understand the analysis of mean scores on The ProfileXT, a look at adverse
impact is necessary. The primary concern is whether a particular group (ethnicity, age,
or gender) is significantly impacted by a specific scale on the assessment. It was also
necessary to remove any secondary factors that may contribute to differences in mean
scores for a group. By categorizing a sample by its job classification the intention was to
remove secondary factors like educational requirements for a particular job which may
spuriously skew the means as demonstrated in previous statistical analyses. If one job
classification requires education and experiences that are rare for another job
classification and the diversity of the two jobs differs, then this may create an erroneous
effect of disparate impact. Thus, by analyzing mean scores within each job classification
Appendix B-3
THE PROFILEXT® TECHNICAL MANUAL
separately, we hope to narrow significant results to just the effects of ethnicity and the
social disadvantages suggested by present-day societal norms. This helps define the
causal factor involved.
Seven job classifications were developed to categorize the sample group’s occupational
composition. These seven groupings were developed by the Research & Development
team with conceptual generalization and representation being our primary concerns.
These groups included Administration, Skilled Labor, Sales, Technology, Professionals,
Management, and Customer Service. Among the original sample, these job
classifications represented the greatest balance of representation and differentiation
possible. In order to be considered acceptably diverse a particular job classification
should have an ethnic composition that sufficiently matches that of the general
population. Only one group did not represent sufficient diversity to be included in this
study: Sales. Thus, with six representative job classifications, the study was ready to
begin. (Note: The Sales Group was investigated in a subsequent study, which is
discussed in the last section of this Appendix.)
Each group’s composite of ethnicity is noted in the following table. Initially, each job
classification was analyzed by comparing the mean scores for each ethnic group for
significant differences. In some cases a specific ethnic group demonstrated a mean
score on a scale higher than the remainder of the sample. While this is of statistical
significance, having higher or lower scores does not necessarily demonstrate adverse
impact against a protected group until benchmarks are utilized for job selection. Of
primary concern was finding instances in which the majority ethnic group (Whites)
demonstrated a mean score significantly different than any or all of the minority groups
(Asian, Black, & Hispanic).
In no case did any scale categorically impact all ethnic minority groups within a
particular job classification. This is positive information but instances of one-to-one
impact (one minority group impacted) are still important to discuss.
Appendix B-4
THE PROFILEXT® TECHNICAL MANUAL
Table B1.
The following tables identify instances in which any ethnic minority group’s mean on a
scale was significantly different when compared to the ethnic majority group. As
previously stated, job classifications were utilized to minimize spurious effects caused
by such factors as differential required education between job classifications.
A value from .00 to .05 demonstrated a statistically significant difference between the
scale score mean of the majority ethnic group and that of a minority ethnic group. The
minority group’s mean will sometimes be significantly higher than the majority group’s
mean, so a *> denotes the relationship. Situations in which an ethnic minority tends to
have higher scores than the ethnic majority are of equal interest to test developers
because higher scores do not always mean “better” scores. The percent match process
described elsewhere in this manual determines the quality of a particular score on The
Profile. Any noted trends will be discussed following presentation of the results.
Appendix B-5
THE PROFILEXT® TECHNICAL MANUAL
Table B2.
Appendix B-6
THE PROFILEXT® TECHNICAL MANUAL
Table B3.
Note: No significant differences were found between the means in the skilled labor job classification.
Appendix B-7
THE PROFILEXT® TECHNICAL MANUAL
Table B4.
Appendix B-8
THE PROFILEXT® TECHNICAL MANUAL
Table B5.
Appendix B-9
THE PROFILEXT® TECHNICAL MANUAL
Table B6.
Appendix B-10
THE PROFILEXT® TECHNICAL MANUAL
Table B7.
Appendix B-11
THE PROFILEXT® TECHNICAL MANUAL
Overall, this analysis demonstrates the significant differences between mean scores of
each ethnic group are not consistent across the various job classifications. Differences
suggest a trend of variance are most notable for individual job classifications but do not
surface across the sample as a whole. The Thinking Section means demonstrate no
conclusive effect against minority groups across all the job classifications. There
appears to be a trend, however, in the Thinking Section so job relevance issues may
need to be addressed by the user when making hiring decisions.
Some trends do seem apparent within individual job classifications including scales in
which a minority ethnic group tends to demonstrate higher scores than the majority
group. One example is the African-American sample of Customer Service employees in
which mean scores are significantly higher for the People Service and Financial
Interests. This is not seen as a disadvantage and should not impact EEOC
compliances.
It is suggested that throughout the selection process and the relevant job criteria are
reviewed by the user to determine which scales are most pertinent for a particular
position, and that these findings are supported by objective performance data. This
criterion for job-relatedness, attributable to inherent relevance to the job, helps to
counter adverse impact. Since there is no evident trend of impact across all job
classifications to be found, the development of relevant benchmarks for a particular job
should demonstrate low, if not negligible, impact against any individual taking the test.
Even if there is a slight impact, there will be no significant effect on the job match
percent or matching to the job. A discussion follows concerning the development of
benchmarks and the relationship to adverse impact, including highlights of a study to
determine the effectiveness of utilizing benchmarks for candidate selection.
The ProfileXT makes use of job patterns to determine the fit of a candidate for a
particular job. The job patterns have been designed to reflect the characteristics of
those who have proven to be effective in a given job. This job matching process
contributes to the overall fairness of the selection tool, while maintaining good utility in
defining how well an individual matches a particular position. Discussion of the
development of the ProfileXT job patterns can be found in the Technical Manual for that
product. For the purposes of this level of the analysis, suffice to say that each job
pattern is developed to represent the combination of traits, interests, and abilities that
Appendix B-12
THE PROFILEXT® TECHNICAL MANUAL
conform to good performance in a particular job. The question then becomes, “Does the
job matching process contribute to any adverse impact against minority groups?”
To investigate this challenge, a sample of 295 individuals was collected randomly from
the pool of over 5,000 business users of the online ProfileXT. To maintain the same
level of diversity present in a normal population of candidates, random sampling was
conducted on a per-ethnicity basis. That is, White candidates for example, were
randomly chosen until the subgroup of this sample represented a proportionate level
when compared to national demographic statistics. This was done for each of the ethnic
groups studied. The final randomly selected sample can be divided into groups as
shown in Table B8.
Three job patterns were compared with each subject’s test results. These job patterns
were Customer Service Representative, Human Resource Manager, and Administrative
Assistant. The premise was to compare the percent match to each job pattern for each
subject with reference to the subject’s ethnicity. Both an analysis of the mean
differences of percent match scores between ethnic groups and an analysis of the
selection rates for each ethnic group were conducted under each job pattern area.
The analysis of variance demonstrates how the job pattern system is both inclusive and
fair with reference to ethnicity. In no case did one group demonstrate significantly higher
matches over another group. Table B9 shows the actual statistical results.
Appendix B-13
THE PROFILEXT® TECHNICAL MANUAL
* Each minority ethnic group is compared with the majority ethnic group (White).
Appendix B-14
THE PROFILEXT® TECHNICAL MANUAL
Following this study, the actual selection results were also investigated. The process
involved a Job Match Percent that determines which candidates are most positively
matched for the particular position. In a true selection process, further tools may be
utilized following testing but the important subject for analysis here is whether the Job
Match Percent and thus the basic utility of this selection tool create any disparate
impact upon minority groups. As discussed previously, a 4/5th rule is utilized to judge the
fairness of the actual process of selection. The scales have been reviewed with
complex statistical analysis, but the final level of analysis involves a simple count of
individuals in our sample who demonstrated percent matches to each position sufficient
for selection. The sums were calculated and then reviewed for ethnic diversity according
to the 4/5th rule of selection ratios. Table B10 demonstrates the final summation of
selected candidates and categorizes by ethnicity. The utility of the 4/5th rule is
demonstrated when selection rates are compared between the ethnic majority and each
minority group. Two different Job Match Percents were analyzed, 70 percent and 80
percent. These represent the range frequently used by the users of this process in
actual practice. Users have found that setting such percent match criteria can enhance
the value of the selection process from an adverse impact perspective.
Table B1. Actual numbers selected compared with numbers predicted by the guidelines
Job Match Asian Black Hispanic White
Percents N=14 N=38 N=36 N=207
Administrative Assistant
Number Selection
ACT PRED ACT PRED ACT PRED Selected Rate
70% 4 3 16 8 15 7 52 25%
80% 1 1 4 2 5 2 13 6%
70% 5 5 21 14 17 13 98 47%
80% 2 2 6 5 4 4 32 15.4%
80% 1 1 3 3 8 3 20 9.7%
Appendix B-15
THE PROFILEXT® TECHNICAL MANUAL
The Rule of 4/5ths was used to derive the predicted number to be selected for each ethnic group. These are
shown in the PRED column of Table B.10. The actual number selected for each percent match value is
shown in the ACT column. These numbers can be compared to understand their relationship. In each case
the actual number selected meets or exceeds the predicted level, supporting the fairness of this job
matching process. As demonstrated by this table, the selection rate for each protected ethnic group was at
least 4/5 the selection rate for the White ethnic group. This is consistent with the guidelines recommended
by the regulations and suggests the job match percent procedure does not contribute to disparity when
used as a part of the selection process.
For this analysis, a Sales Job Match Pattern was used. The White salespersons and the
Black salespersons were matched to this pattern to obtain an Overall Job Match percent
for each individual. These data were then analyzed to determine if the Rule of 4/5ths
indicated the presence of adverse impact for the Black salespersons. For consistency
with the earlier study, two levels were used in this analysis, 70% match to the pattern
and 80% match to the pattern. The results of this analysis are presented in Table B12.
Appendix B-16
THE PROFILEXT® TECHNICAL MANUAL
Table B12. Actual numbers selected compared with numbers predicted by the guidelines
Job Match Black White
Percents N=25 N=219
ACT PRED Number Selected Selection Rate
70% 21 18 197 89%
As discussed in the earlier study, the Rule of 4/5ths was used to derive the predicted
number to be selected for the Black group at both the 70% Job Match level and the 80%
Job Match level. These are shown in the PRED column of Table B12. The actual
number selected for each percent match value is shown in the ACT column. These
numbers can be compared to understand their relationship. In each case the actual
number selected meets or exceeds the predicted level, supporting the fairness of this
job matching process. As demonstrated by both Table B12 and Table B10, the selection
rate for each protected ethnic group studied was at least 4/5 the selection rate for the
White ethnic group. This is consistent with the guidelines recommended by the
regulations and suggests the Job Match Percent procedure does not contribute to
disparity when used as a part of the selection process.
As mentioned earlier, the use of test results should never be weighted as more than one
third of the total selection process. The company must consider the components, as
well as the end result, of the overall process to ensure there is no disparate impact.
Appendix B-17
The ProfileXT® Technical Manual
A study was conducted in 2005 to review the possibility of adverse impact among
raw scores of the assessment in light of ethnicity, gender, and age group.
Chapters 3, 4, and 5 summarize the results of this study. In this appendix the
statistical details of this study are recorded. Behavioral, Occupational Interests,
and Thinking Styles raw scores are displayed, including descriptive statistics and
analyses of variance.
Table C1.
Note that the variations in mean scores among the various groups are so small
as to have no practical impact on the Job Match Percent.
Table C2 reveals the comparative analysis of mean raw scores in the Behavioral
Traits section by ethnic group, flagging each instance of statistically significant
differences. One may note these differences are rather small from a practical
perspective.
Table C2.
Mean Raw
Comparison Std. 95% Confidence
Scale Ethnic Group Score Sig.
Ethnic Group Error Interval
Difference
Afri. Amer. .6283(*) .0582 .000 .466 .791
Asian Hispanic .4526(*) .0627 .000 .277 .628
Caucasian -.0425 .0496 .865 -.181 .096
Asian -.6283(*) .0582 .000 -.791 -.466
Decisiveness
Mean Raw
Comparison Std. 95% Confidence
Scale Ethnic Group Score Sig.
Ethnic Group Error Interval
Difference
Afri. Amer. -2.0535(*) .0628 .000 -2.229 -1.878
Asian Hispanic -1.7226(*) .0677 .000 -1.912 -1.533
Caucasian -1.5507(*) .0535 .000 -1.700 -1.401
Accommodating
Gender
Table C3 displays the descriptive statistics and the results of the analysis of
variance by gender for the Behavioral Traits Section including mean raw scores,
standard deviations, and standard error. This information helps to identify how
each group’s raw scores tended to distribute on each scale and the mean
differences between groups. See Chapter 3 for the detailed analysis and
implications of these data.
Table C3.
Mean Raw
Mean
Score Std. Std.
N Raw Sig.
Difference Deviation Error
Score
M-F
Age Group
Table C4 displays the descriptive statistics by age group for the Behavioral Traits
Section, including mean raw scores, standard deviations, and standard error.
See Chapter 3 for the detailed analysis and implications of these data.
Table C4.
Table C5 reveals each age group’s comparative analysis of mean raw scores in
the Behavioral Traits Section flagging each instance of statistically significant
differences. One may note that these differences are rather small from a practical
perspective.
Note the variations in mean scores among the various groups are so small as to
have no practical impact on the Job Match Percent.
Table C7 reveals each ethnic group’s comparative analysis of mean raw scores
in the Occupational Interests Section, flagging each instance of statistically
significant differences. One may note that these differences are rather small from
a practical perspective.
African American
Caucasian 2.4135(*) .0827 .000 2.182 2.645
Asian .5271(*) .1540 .008 .097 .958
Hispanic Afri. Amer. -.8558(*) .1253 .000 -1.206 -.506
Caucasian 1.5577(*) .1005 .000 1.277 1.839
Asian -1.0305(*) .1218 .000 -1.371 -.690
Caucasian Afri. Amer. -2.4135(*) .0827 .000 -2.645 -2.182
Hispanic -1.5577(*) .1005 .000 -1.839 -1.277
* The mean difference is significant at the .05 level.
Note that the variations in mean scores among the various groups are so small
as to have no practical impact on the Job Match Percent.
Gender
Table C8 displays the descriptive statistics and the results of the analysis of
variance by gender for the Occupational Interests section including mean raw
scores, standard deviations and standard error. This information helps identify
how each group’s raw scores tended to distribute on each scale. The analysis
and implications based on these data may be found in Chapter 4.
Table C8.
Mean
Std.
N Mean Difference Std. Error Sig.
Deviation
(M-F)
Age Group
Table C9 displays the descriptive statistics by age group for the Occupational
Interests section including mean raw scores, standard deviations, and standard
error. See Chapter 4 for the detailed analysis and implications of these data.
Note the variations in mean scores among the various groups are so small as to
have no practical impact on the Job Match Percent.
Table C10 reveals each age group’s comparative analysis of mean raw scores in
the Occupational Interests section, flagging each instance of statistically
significant differences. One may note that these differences are rather small from
a practical perspective.
Table C10.
Note the variations in mean scores among the various groups are so small as to
have no practical impact on the Job Match Percent.
Table C11.
Std.
N Mean Std. Error
Deviation
Note the variations in mean scores among the various groups are so small as to
have no practical impact on the Job Match Percent.
Table C12 reveals each group’s comparative analysis of mean raw scores
flagging each instance of statistically significant differences. One may note that
these differences are rather small from a practical perspective.
Table C12.
Note that the variations in mean scores among the various groups are so small
as to have no practical impact on the Job Match Percent.
Gender
Table C13 displays the descriptive statistics and the results of the analysis of
variance by gender for the Thinking Styles Section including mean raw scores,
standard deviations, and standard error. The analysis and implications based on
these data may be found in Chapter 5.
Table C13.
Note the variations in mean scores among the various groups are so small as to
have no practical impact on the Job Match Percent.
Age Group
Table C14 displays the descriptive statistics by age group for the Thinking Styles
section including mean raw scores, standard deviations, and standard error. This
information helps identify how each group’s raw scores tended to distribute on
each scale. See Chapter 5 for the detailed analysis and implications of these
data.
Table C14.
Table C15 reveals each age group’s comparative analysis of mean raw scores in
the Thinking Styles section, flagging each instance of statistically significant
differences. One may note that these differences are rather small from a practical
perspective.
Table C15.
Note the variations in mean scores among the various groups are so small as to
have no practical impact on the Job Match Percent.
As discussed earlier, the Job Match Percent is derived by matching the test
taker’s score on each scale to a Job Match Pattern of scores for a specific
position. If the test taker’s scores fall outside of the benchmark or pattern for a
scale, the impact is to lower their Job Match Percent. The further the score falls
outside of the pattern, the greater the negative impact on the Job Match Percent.
This applies equally if they score above the pattern or below the pattern. Thus,
those test takers having scores which closely match the pattern of scores defined
for the position will have a higher percent match than those whose scores fall
outside of the pattern.
A study was conducted in 2005 to review the possibility of adverse impact among
cases in which ProfileXT scores were matched to Job Match Patterns. The issue
was to explore the impact, if any, caused by the Job Match Percents in light of
ethnicity, gender, and age.
The subjects in this study represent individuals who have been matched to Job
Match Patterns during actual use of the PXT in the world of work in the USA. We
have made some assumptions about these job match situations:
1. The applicants have applied for real-life positions where they felt they
would have a reasonable fit to the job.
2. The Job Match Patterns for the jobs in question are valid patterns for each
position in the study.
3. Some applicants have misjudged their fit to the position.
4. Not all applicants were placed into the position for which they applied.
Note the variations in mean scores among the various groups are so small as to
have no practical impact on the Job Match Percent.
Table D2 reveals each ethnic group’s comparative analysis of mean Job Match
Percents, flagging each instance of statistically significant differences between
groups. One may note that these differences are rather small from a practical
perspective.
Table D2.
Table D3 displays the descriptive statistics and the results of the analysis of
variance by gender for the Overall Behavioral Traits, Occupational Interests, and
Thinking Styles Job Match Percents, including mean scores, standard deviations,
and standard error. This information helps to identify how each group’s raw
scores tended to distribute on each scale and the differences in mean Job Match
Percent by gender.
Table D3.
Table D4 displays the descriptive statistics by age group for the four Job Match
Percent scores, including mean scores, standard deviations, and standard error.
This information helps to identify how each age group’s Job Match Percents
tended to distribute on each scale.
Table D4.
Note the variations in mean scores among the various groups are so small as to
have no practical impact on the Job Match Percent.
Table D5 reveals each ethnic group’s comparative analysis of mean Job Match
Percents flagging each instance of statistically significant differences between
age groups. One may note that these differences are rather small from a
practical perspective.
Table D5.
Note the variations in mean scores among the various groups are so small as to
have no practical impact on the Job Match Percent.
Participants
The employees and former employees for the services representatives group
were used for this study. They were divided into two groups:
1. Current employees.
2. Employees who had left the company within five months after their
employment began.
Performance Groupings
After analyzing the data, the employer selected an overall Job Match Percent of
75% or greater to represent a good match to the position. In this study,
participants who had a 74% or lower Overall Job Match Percent had an 80%
turnover rate, while participants who had a 75% or greater Overall Job Match
Percent had only a 25% turnover rate. These results suggested that had this
information been available when selecting the employees hired in 2000 and
2001, the resulting reduction in turnover could have saved approximately
$200,000.
Details
1. 60 individuals were hired in 2000-2001.
2. 80% of these (48 individuals) left the company in the first five months of
their employment.
3. The company supplied $6,000 as the conservative cost for each employee
turnover.
Appendix E-1
THE PROFILEXT® TECHNICAL MANUAL
4. 48 turnovers x $6,000 cost for each turnover = $288,000 actual cost for
turnovers.
Summary
These data suggest that had only those who scored an overall Job Match
Percent of 75% or greater been hired, the turnover would have been 25 percent
(25% x 60 hires x $6,000 each hire = $90,000 turnover cost). This would have
resulted in a savings of $198,000.
A mental health facility found itself devoting a great deal of time to a weekly
hiring board. The purpose of this board was to determine the effectiveness of
their Mental Health Workers and then decide which workers to retain. Before the
study began, they let a large number of workers go on a consistent basis.
Turnover was increasing year by year and an intervention was needed. The PXT
was utilized to help identify top performers and decrease the turnover (and the
associated time spent in hiring board meetings) at the facility.
Participants
For this study, 25 current Mental Health Workers were administered the
ProfileXT assessment. Before the study began, turnover had increased to 68.7%.
Involuntary terminations (when the employee was let go as opposed to quitting)
were the number one reason for turnover. Turnover rates were gathered
throughout the period of the study. As each new applicant was reviewed, the
PXT was administered.
Details
1. Turnover was reduced from 47.6% in fiscal year 2001 to 22.9% in
FY2002.
2. The reduction in turnover of 52% yielded a savings in excess of $300,000.
Appendix E-2
THE PROFILEXT® TECHNICAL MANUAL
3. The weekly hiring board meetings now take less time away from the
members’ R.N. duties, increasing their efficiency and better utilizing salary
expenses, saving up to $20,000 annually.
4. An increase in staff performance and in client care resulted from the
increase in overall job match for those hired using these selection
practices.
5. Involuntary termination rates also dropped 70% after the study was
launched, a positive indicator concerning the performance of new hires.
Summary
During the study, new employees maintained better retention rates and
involuntary terminations dropped significantly while the time and expense for
terminations and rehiring also decreased to more favorable and efficient levels.
The process of identifying top performers through a Job Match Pattern proved to
be a valid means for the selection and retention of Mental Health workers.
A travel agency conducted two studies: one for a period of nine months and
another for 12, between March 2001 and September of 2002. The intent of the
first study was to identify trends based on performance data and the relationship
of these trends to the Overall Job Match Percent on the ProfileXT. The second
study focused on analyzing turnover rates and the use of the PXT. Both studies
are discussed here.
Participants
One hundred and fifty-three sales agents were used for this study. Only those
who had completed their trial employment period were studied in this analysis.
Details
1. The top ten Sales Agents’ weekly sales average = $2,648.
2. The bottom ten Sales Agents’ weekly sales average = $ 482.
3. This represents a difference of $2,166.00 per week (a 5.5 to 1 ratio).
4. For every dollar a bottom performer earns, a top performer earns $5.50.
Appendix E-3
THE PROFILEXT® TECHNICAL MANUAL
Summary
By selecting candidates based on an objective Overall Match on the PXT, more
Top Performers can be selected than Bottom Performers, saving on training
budgets and enhancing overall sales performance. The process of identifying
Top Performers through the Job Match Pattern is definitely a valid means for
improving productivity of a sales department.
Participants
One hundred and eighty-one current and former sales agents were used for this
study. Turnover rates were gathered throughout the period of the study. Before
the study began turnover was at 28%.
Details
1. Turnover reduced from 28% to 16% (a 43% reduction).
2. Average cost of hiring is $15,000.
3. At 28%, cost of turnover is $765,000 (51 turnover x $15,000).
4. At 16%, cost of turnover is $435,000 (29 turnover x $15,000).
5. These results indicate a savings of $330,000 from reduced hiring costs.
Summary
During the study, 181 new employees were hired while 29 separated from the
company. This represents a 43% reduction in turnover (from 28% down to 16%).
The company reported a savings of $330,000 in hiring costs alone. The process
of identifying Top Performers through a Job Match Pattern proved to be a valid
means for selection and retention in the study.
Appendix E-4
THE PROFILEXT® TECHNICAL MANUAL
Participants
Three hundred and seventy account managers were used for this study.
Turnover rates were gathered throughout the period of the study. Before the
study began, turnover was at approximately 65%. Performance ratings were
used to identify Top and Bottom Performers, 12 in each group, and were based
on average annual sales ratios.
Details
1. Original turnover was 65% (55 separated/84 hired).
2. During the analysis, 370 candidates were hired.
3. 20 employees separated from the company during the study.
4. The percentage of turnover had dropped to 23% (20 separated/86
selected).
5. The company supplied $15,000/hire as the average cost for hiring an
individual for this position.
Appendix E-5
THE PROFILEXT® TECHNICAL MANUAL
Summary
Matching to a well-developed Job Match Pattern helped to decrease turnover,
save money, and save training time. Additionally, top and bottom performance
could be predicted before a candidate was selected and this greatly enhanced
sales for the company. The process of identifying Top Performers through the
Job Match Pattern was definitely a productive means for selection and retention
at this company.
Participants
A group of 22 RNs was selected and ranked by the VP of Community Health and
Cultural Diversity and the Director of Human Resources. Twelve of these were
identified as Top Performers, seven Moderate Performers, and three Bottom
Performers.
Performance Grouping
An overall Job Match Percent of 83% was selected to represent a good match to
the Job Match Pattern. This suggested a match of 83% or greater should identify
a Top Performer.
Of the 12 Top Performers, ten had Job Match Percent scores of 83% or greater
(10 of 12). Five of the seven Moderate Performers and none of the three Bottom
Performers scored 83% or greater.
Summary
If an Overall Job Match Percent of 83% had been used to select the individuals
into two groups (Top Performers and Bottom Performers), 83% of the Top
Performers would have been selected for the top group, and none (0%) of the
Bottom Performers would have been selected for the top group. Also, 71% of the
Appendix E-6
THE PROFILEXT® TECHNICAL MANUAL
Moderate Performers would have been selected for the Top Group. Clearly,
selection will be enhanced by the identification of potential Top Performers using
the Job Match Pattern system found in the PXT.
Participants
During the 12 month period, 245 individuals took the ProfileXT. Ninety job
applicants were hired. The turnover rate before the use of the ProfileXT was
34.5% costing the company approximately $1,910,000 in 2002.
Details
The cost of replacing a Helper or Operator was calculated at approximately
$18,900. The average tenure of terminated employees was 12 months.
Summary
After using the ProfileXT for one year, turnover was reduced from 34.5% to
25.3% signifying a savings of approximately $550,000. Since the company spent
$24,550 implementing the ProfileXT, their return on investment was more than
22:1.
Appendix E-7
THE PROFILEXT® TECHNICAL MANUAL
Participants
The study was comprised of five current Technical Consultants. Each employee
who participated in the study had been administered the ProfileXT and had their
performance evaluated by both the president of the organization and other
performance indices. The aggregate results of these company evaluations
revealed three employees were performing at a top level and two employees
were performing at a lesser level. Approximately two years later employee
performance was reevaluated using the same aggregate method. Results of the
company performance evaluations revealed the performance of the three top
performing employees remained stable over the two year period while both of the
lesser performing employees had resigned from their positions.
Performance Grouping
With the Technical Professional Job Match Pattern developed, all five employees
in the sample were matched against the pattern. After reviewing the sample’s
PXT Percent Pattern Matches, an overall Job Match Percent of 86% or better
best identified Top Performing employees and was selected as a breakpoint to
represent a good match to the Job Match Pattern.
Of the five employees in the sample, only three met or exceeded a Job Match
Percent of 86%. All three of these employees were Top Performers (100%) as
described by their organization’s own performance measures. Moreover, the two
employees who did not reach a Job Match Percent of 86% were described as
Appendix E-8
THE PROFILEXT® TECHNICAL MANUAL
Details
The president of the organization found this assessment “invaluable for
managing in a fast paced consulting environment.” Additionally, the
implementation of the ProfileXT has accelerated management’s discussions with
candidates saving valuable time and energy in the hiring process.
Summary
Using the ProfileXT to benchmark employees, the organization was able to
demonstrate the effectiveness of the Job Match Pattern. Over a two year period,
the three employees who best matched the Job Match Pattern were all Top
Performing employees as defined by the organization. Conversely, the two
employees who did not match the pattern created were the organization’s less
productive employees and both subsequently resigned before the two year study
had been completed. This organization provides a good example of the
effectiveness of a well built pattern and the impact it can have on predicting
success in the workplace.
Background
An organization specializing in corporate policies and data services wanted a
better way to identify potentially successful Account Executives. Presented with
this task, a study was conducted to examine the relationship between employee
productivity and the ProfileXT®.
Participants
Fourteen Account Executives within the organization served as the sample for
the current study. Each employee in the sample was administered the ProfileXT
and had their performance at meeting sales goals evaluated by the organization.
Based on the organization’s performance evaluations, three members of the
sample were identified as Top Performers, three were identified as Bottom
Performers, and the remaining eight members of the sample were identified as
Average Performers.
Appendix E-9
THE PROFILEXT® TECHNICAL MANUAL
Performance Grouping
Based on the performance information gathered from the employer and the
participants’ ProfileXT scores, a pattern was constructed which described the
qualities of the existing Top Performers. All 14 Account Executives were then
matched to the pattern. After a review of the participants’ Overall Job Match
Percent, a breakpoint of 87% or greater best identified Top Performing Account
Executives. This 87% Job Match benchmark now serves as a standard to which
a candidate is likely to be a good match to the job.
This study has demonstrated the pattern efficiently identifies Top Performers:
Of the 14 participants in this study four obtained a Job Match Percent of 91% or
greater. All three of the Top Performing Account Executives were selected by the
pattern developed. Only two of the Average Performing and none of the Bottom
Performing Account Executives met this same benchmark.
Details
1. According to the information provided to Profiles International by the
organization, the average sales dollars generated by Top Performers in
the Account Executive sample was $1,250,000, while the average Bottom
Performer in this sample generated $850,000 of their performance goals.
2. The average dollars generated by those who did meet or exceed the Job
Match benchmark was $1,310,000. The average dollars generated by
those who did not meet the Job Match benchmark was $840,000. This is
an average difference of $470,000 between those selected and those not
selected by the Job Match Pattern.
Summary
Using the ProfileXT to benchmark employees, the organization has shown the
ability to successfully screen Account Executive candidates. Of the five
individuals who either met or exceeded the Job Match Percentage benchmark,
none were Bottom Performers. Additionally, 100% of the Top Performers were
included in this group. Clearly, selection practices at this organization have been
improved by using the ProfileXT.
Appendix E-10
THE PROFILEXT® TECHNICAL MANUAL
Participants
Ten medical device Sales Associates participated in the current study. Each
Associate completed the ProfileXT and had their sales performance evaluated by
the medical device distribution organization. Based upon the annual sales
information supplied by this organization, four Sales Associates were identified
as Top Performing Sales Associates and six were identified as Bottom
Performing Sales Associates.
Performance Groupings
Using the annual sales data gathered from the employer, Profiles International
built a pattern which described the traits of the existing Top Performing Sales
Associates in the sample. All ten Sales Associates were then matched to the
pattern. After a review of the results, an overall Job Match Percent of 90% or
greater was found to best identify Top Performing employees. This Job Match
Percent now serves as the benchmark to represent a good match to the Job
Match Pattern.
This study has demonstrated that the pattern efficiently identifies Top
Performers:
Of the ten Sales Associates in the sample, only four achieved a Job Match
Percent of 90% or greater. All four of the Top Performing Sales Associates in the
Appendix E-11
THE PROFILEXT® TECHNICAL MANUAL
sample met or exceeded the 90% Job Match Pattern breakpoint while none of
the Bottom Performers achieved the same 90% breakpoint.
Details
The annual sales dollars generated by the four Top Performers in the sample
averaged $668,762. During the same sales period the Bottom Performing
employees in this sample averaged $315,935 in sales. The Top Performing
Sales Associates in this study averaged $352,828 more in sales than the Bottom
Performing employees, more than double the average total sales earnings of the
Bottom Performers. Additionally, this pattern is shown to do an excellent job of
distinguishing the Top Performing Sales Associates from those who are Bottom
Performers. In this sample, all Top Performers met or exceeded the Job Match
Pattern benchmark while none of the Bottom Performers were able to achieve
the same breakpoint.
Summary
The efficacy of the Job Match Pattern is evident; all four of the individuals who
met or exceeded the 90% Job Match Pattern bench mark were Top Performers,
while all six individuals who did not meet the same mark were Bottom
Performers. Moreover, by being able to better screen Sales Associate
candidates, the medical devices distribution organization could more than double
its sales revenue simply by selecting those candidates who possess a similar
pattern of traits to those who are already successful in the position. Thus, the
well-matched Sales Associate candidates are also more likely to enjoy success
by being a good fit to the position.
Participants
Eight pharmaceutical Sales Representatives participated in the current study.
Each participant was administered the ProfileXT and had their performance
evaluated by the organization. Sales Representative performance was evaluated
using two performance measures. First, the sales organization evaluated
employee competencies in a variety of areas determined to be important to
organizational success. Second, each employee’s performance was evaluated in
the form of a sales goal ratio over the first three quarters of the year. When
Appendix E-12
THE PROFILEXT® TECHNICAL MANUAL
Performance Groupings
Using the performance information gathered from the employer, Profiles
International built a pattern which described the qualities of the existing Top
Performers in the sample. All eight Sales Representatives were then matched to
the pattern. After a review of the results, an overall Job Match Percent of 90% or
greater was found to best identify Top Performing employees. This Job Match
Percent now serves as the benchmark to represent a good match to the Job
Match Pattern.
This study has demonstrated that the pattern efficiently identifies Top
Performers:
Of the eight Sales Representatives in the sample, three achieved a Job Match
Percent of 90% or greater. All three of the Top Performing Sales Representatives
in the sample exceeded the 90% Job Match Pattern breakpoint while none of the
five Bottom Performers achieved the same 90% breakpoint.
Details
1. The sales dollars generated by the Top Performing Sales Representatives
over the first three quarters of the year averaged $802,348. During the
same sales period, the Bottom Performing employees averaged $617,786
in sales. The Top Performing Sales Representatives in this study
averaged nearly $185,000 more in sales than the Bottom Performing
Sales Representatives during the sales period.
2. In addition to the gains seen in sales performance by those that were
selected by the Job Match Pattern, those who scored at or above the 90%
benchmark averaged an organizational competency score of nearly 20.
Those Sales Representatives who did not achieve the Job Match Pattern
breakpoint averaged a substantially lower organizational competency
score of 15.4. Thus, the competencies of the Sales Representatives
selected by this pattern are more aligned with organizational goals than
those of the Sales Representatives not selected.
©2008, Profiles International, Inc., Waco, Texas.
Appendix E-13
THE PROFILEXT® TECHNICAL MANUAL
Summary
Using the ProfileXT to benchmark employees, the pharmaceutical sales
organization has shown the ability to better screen Sales Representative
candidates. Using performance information provided by this client, the Profiles
International team was able to build a Job Match Pattern which distinguished the
key success related attributes of the Top Performing Sales Representatives and
those of the less productive members of the organization. Of the eight Sales
Representatives in the sample, only three achieved the Job Match Percent
breakpoint of 90%; all three of these Sales Representatives were Top Performers
in the position. Clearly, this study has shown that by using the ProfileXT this
organization has improved its selection practices.
Participants
Seven currently employed insurance Sales Representatives participated in the
study. Performance was measured by reviewing each subject’s number of sales
and number of accounts managed. The company was able to identify four Top
Performers and three Bottom Performers based upon these criteria.
Performance Grouping
Based on the information gathered, a pattern was built which described the
attributes of the existing Top Performers. The seven insurance Sales
Representatives were then matched to this pattern. After a review of employee
ProfileXT Job Match Percents, an overall Job Match Percent of 79% best
identified Top Performing employees and was selected as a breakpoint to
represent a good match to the Job Match Pattern.
Appendix E-14
THE PROFILEXT® TECHNICAL MANUAL
This study has demonstrated that the pattern efficiently identifies Top
Performers:
Of the four Top Performers, three met or exceeded the 79% Job Match
breakpoint. Of the three Bottom Performers none met or exceeded the 79%
overall Job Match Percent.
Summary
The ProfileXT Job Match Pattern for the insurance company Sales
Representative position correctly identified 75% (3 of 4) of the Top Performers
based on a 79% Job Match Percent. This Job Match Percent also screened out
100% (3 of 3) of the Bottom Performers. A larger sample would increase the
percentage of Top Performers correctly identified by the ProfileXT Job Match
Percent.
Participants
Twenty-six advertising Sales Representatives participated in this study. Each
employee in the study had been administered the ProfileXT and had their
number of new customers, ads sold, and overall dollar volume recorded.
Records indicated four sales people were highest in each of these areas while
seven could be categorized as lowest with the remaining fifteen somewhere in
the middle.
Performance Grouping
With the advertising Sales Representative Job Match Pattern created, all 26
employees were matched against the pattern. After a review of the sample’s
ProfileXT percent matches, an overall Job Match Percent of 86% or better best
Appendix E-15
THE PROFILEXT® TECHNICAL MANUAL
Of the 26 employees included in the study, eight met or exceeded the benchmark
set. All four (100%) Top Performers were included in this group while only one of
the seven (14%) Bottom Performers were able to display the same match for the
pattern. Thus, the pattern is differentiating Top and Bottom performers as
delineated by the company’s own performance evaluations.
Details
The company expressed the belief that their hiring practices have become more
consistent after using the ProfileXT. The organizational leaders of this company
feel better and have become more confident in their hiring decisions knowing the
PXT is based on the firm ground of employee attributes.
Summary
Using the ProfileXT to benchmark employees, the organization has shown the
ability to successfully screen Sales Representative candidates. Of the eight
individuals who either met or exceeded the Job Match Pattern benchmark, only
one of eight of these employees was designated as a Bottom Performer.
Additionally, 100% of the Top Performers (4 of 4) were included in this group.
Clearly, selection practices can be improved by using Job Match Patterns
created by the ProfileXT.
Appendix E-16
THE PROFILEXT® TECHNICAL MANUAL
The PS-I was initially built with construct validity to the Guilford-Zimmerman and
the DF Opinion Survey; both instruments were designed to measure “normal”
personality traits. There were 375 items selected to load on 15 scales and all
were selected by a panel of psychologists without reference to a particular
theory.
Item analysis of the results from testing 653 adult employees and applicants for
employment with 23 organizations was utilized to refine the content. This group
was 46% female, 7% Hispanic, 10% Black, and 83% White. Their educational
levels ranged from some high school to graduate degrees.
Factor analysis of the data reduced the number of scales to ten, with 30 items for
each scale. Coefficient alpha reliabilities ranged from .71 to .83 with an average
of .78. The questions in the PS-1 were derived empirically from previous factor
and item analyses. Factor analytic techniques were used to extract ten
personality factors. These ten personality scales are depicted in Table F1.
Table F1.
Attitude Independence
Conscientiousness Judgment
Appendix F-1
THE PROFILEXT® TECHNICAL MANUAL
Revision of PS-I
Between the mid 1980’s and the early 1990’s more than 15,000 job applicants
and incumbents were administered the PS-I. During this period, ongoing factor,
item, validity, and reliability analyses, combined with practical considerations,
indicated the PS-I needed revision. Beginning in the early 1990’s, a
comprehensive research project was specifically designed to make PS-I not only
more valid and reliable but also more practical and time efficient. The procedures
for accomplishing these objectives included:
The revised edition of PS-I was entitled PS-II. PS-I was reduced from ten scales
to seven scales with 30 questions each. Studies have shown these seven
dimensions were significantly related to:
Samples from various corporate settings were gathered for research efforts to
maintain accurate and timely statistics regarding the validity and impact of the
PS-II test form. Validation studies were conducted at Profiles International, Inc.
Research and Development Division to support the strength of the scales and the
norming data.
Appendix F-2
THE PROFILEXT® TECHNICAL MANUAL
Between 1992 and 1998, more than 12,000 job applicants and incumbents were
administered the PS-II. This sample represented a cross section of ages, income
levels, and educational levels, as well as a diverse range of positions,
companies, and industries.
Manageability:
Responsibility: Reasonable
Takes duties seriously
Socialization: Comfortably accepts ordinary rules
Finds it easy to conform
Self-control: Tries to control emotion and temper
Takes pride in being self-disciplined
Good Impression: Wants to make a good impression
Tries to please others
Psychological-
mindedness: Good at understanding how people feel & think
Appendix F-3
THE PROFILEXT® TECHNICAL MANUAL
Decisiveness:
Continuing studies have supported these findings (see Chapter 3). These results
demonstrated how the Manageability Scale continued to be associated with the
various CPI scales relating to conscientiousness and self-monitoring traits. The
Decisiveness Scale has been noted to relate well with CPI scales associated with
self-acceptance, control, and an external frame of reference or, in other words, a
focus on social poise, while the Manageability Scale remained consistent in its
comparison with the CPI.
The greater the number of questions answered in the “infrequent” direction, the
greater the concern about how candid the individual might have been. When this
©2008, Profiles International, Inc., Waco, Texas.
Appendix F-4
THE PROFILEXT® TECHNICAL MANUAL
Next, the development of the PS-I and PS-II lead to The ProfileTM and, after a few
years of continuing development, Profiles International presented the most
current form of the test, the ProfileXT® (PXT). The ProfileXT demonstrates
greater ease of use and even stronger statistical support with various changes,
including a more efficient number of items (from 218 items to the current 182)
and an easier to use report layout.
Appendix F-5
THE PROFILEXT® TECHNICAL MANUAL
Appendix G
CONFIDENTIAL
PLACEMENT REPORT
Thursday, May 8, 2008
Susie Sample
Any Department
Profiles International
5207 Lake Shore Drive
Waco, TX 76710
254-751-1644
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
Introduction
This report provides information about Susie Sample, presented in a manner to help
you judge her match with a selected position in your organization. Every employable
person will match some positions better than other types of work.
This report reflects the responses provided by Susie Sample when she completed the
ProfileXT® assessment. Results are illustrated on a scale from 1 to 10. The darker
area on the scale represents the “Job Match” target. The enlarged segment of the scale
shows where Susie scored. If the enlarged segment is dark, Susie is in the Job Match
pattern; if it is light, she is not. Information about Susie is reported in these five
categories:
Please consult the User’s Guide for additional information on using these results in
working with Susie.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
1
Placement Report Susie Sample
94% match with Thinking Style Pattern for the Any Department position.
Susie Sample has an 83% overall match for the Any Department position.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
2
Placement Report Susie Sample
Accommodating – Tendency to be
friendly, cooperative, and agreeable; to be 1 2 3 4 5 6 7 8 9 10
a team person.
85% Behavioral Traits Pattern match for the Any Department position.
Susie Sample has an 83% overall match for the Any Department position.
The Distortion Scale Score on this assessment is 9. The Distortion Scale deals with how candid and frank the
respondent was while taking this assessment. The range for this scale is 1 to 10, with higher scores suggesting
greater candor.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
3
Placement Report Susie Sample
When the top three interests are in common, the Job Match Percentage is greater
than if there are fewer than three in common.
Susie Sample has a 59% match with Interest Pattern for the Any Department position.
Susie Sample has an overall match of 83% for the Any Department position.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
4
Placement Report Susie Sample
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
5
Placement Report Susie Sample
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
6
Placement Report Susie Sample
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
7
Placement Report Susie Sample
ο She has a low need to steer the course of what is happening or to change the
direction of events.
ο Susie is slow to make decisions, enforce company policies, and act with
authority. She will be slow to make unpopular decisions when necessary.
ο Ms. Sample prefers not to take action without having the time and opportunity
to process information pertaining to the situation. She prefers to wait for
specific instructions before taking action.
ο Ms. Sample tends to be a quiet, personal producer who works hard for a
leader and a cause.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
8
Placement Report Susie Sample
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
9
Placement Report Susie Sample
ο Ms. Sample is typically decisive and inclined to act. She can be effective in
positions which require timely results.
ο Ms. Sample is capable of responding to an emergency and of solving
problems in a timely manner.
ο She is not inclined to delay important decisions.
ο Susie stands firm on some decisions and may not be inclined to back down
once a decision is made unless under pressure.
Accommodating – Tendency to be
friendly, cooperative, and agreeable; to be 1 2 3 4 5 6 7 8 9 10
a team person.
ο She is generally pleasant, friendly, and patient; she is not inclined to show
temper or frustration.
ο Ms. Sample typically recognizes the need to work with others and she is
usually willing to share resources and information.
ο Susie is modest and not inclined to take or to maintain an extreme opinion or
position.
ο Ms. Sample tends to have a cooperative outlook and is generally prepared to
help others.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
10
Placement Report Susie Sample
ο Ms. Sample has a moderate need for freedom from controls, close
supervision, and organizational constraints.
ο She is usually comfortable handling new problems independently.
ο Susie appreciates some opportunity to challenge the status quo and to cause
a change in something.
ο Ms. Sample prefers to carry out important tasks with minimal supervision. She
can be counted on to meet her commitments without close supervision.
ο Ms. Sample uses judgment that often tends to be more subjective when she
feels pressured.
ο Ms. Sample's judgment will be much more intuitive when addressing critical,
independent decision making responsibilities.
ο Ms. Sample has thinking abilities which can be less effective if she allows
personal biases and opinions to replace sound judgment.
ο Ms. Sample tends to be a subjective thinker and emphasizes personal
opinions more than factual data.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
11
Placement Report Susie Sample
Occupational Interests
The Interest section assesses the relative interests among the six interest areas. The top
three interests for Ms. Sample are shown here along with the top three interests for the
Any Department position. Note that Susie shares ONE top interest with the requirements
of this position.
TOP THREE areas of interest for TOP THREE areas of interest for the position of
Susie Sample. Any Department.
Ms. Sample's interests are focused in the administrative and technical aspects of work. She
demonstrates an interest in the Financial, People Service, and Technical themes. This pattern is
consistent with people who like to work in a fairly structured setting, especially in which there is
a definable chain of command and there are typical office practices to be dealt with. The
preferred work environment is usually defined by a focus on interpersonal dynamics and helping
clients, especially with technical information from a consultative/expert point of view.
With Financial/Administrative as her primary area of interest, Ms. Sample is likely to seek
activities which involve organizing or otherwise dealing with budgets, information, and supplies.
Her primary focus and source of motivation is in classifying and managing information. Second,
she is motivated by the interaction with others that comes with service to an interpersonal cause
as demonstrated by her interest in People Service activities. Helping others or providing them
with services may help energize her in what she does at work. Finally, her interest in Technical
activities rounds out her profile. Other interest areas may have more of an effect on her
motivation, but her interest in Technical pursuits contributes.
Notice:
As discussed in the User’s Guide for this product, this job pattern approach to matching individuals to a position provides information
of great value and should be an important part of the placement decision. However, the user is reminded that the results from any
test should never make up more than a third of the final decision.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
12
Placement Report Susie Sample
Interview Questions
Susie Sample scored outside the position match pattern in the following areas.
When interviewing Susie Sample you should consider the following information:
THINKING
On the Verbal Reasoning scale Ms. Sample is above the designated Profile for this Job
Match Pattern. This suggests her ability to process verbal information is greater than the
position typically requires and she may experience frustration over the lack of challenge.
Discussions with her should explore the possibility the position may not maintain her
interest and/or level of performance.
ο When you write instructions, ideas, or memos, do people ever suggest you
"say it in plain English" or make your meaning more clear? Give an example.
ο How often do you become frustrated because other people don't understand
the words you use to explain a task, idea, or project?
ο When discussing topics with people how often do they have difficulty
understanding your train of thought? How do you know they lost track of your
meaning? How do you get them to understand?
ο Do you ever notice you need to "talk down" to people in order for them to
understand you?
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
13
Placement Report Susie Sample
BEHAVIORAL TRAITS
On the Assertiveness scale Ms. Sample scored below the job profile for this position.
She could find the requirements of a strong presence to be overly challenging.
Determine her willingness to enhance her confidence and leadership skills in the future.
ο Tell me about someone you worked with who was too assertive.
ο Tell me about a time in which you were able to be very persistent in order to
reach goals. Be specific.
ο What does being assertive mean to you?
ο How do you typically handle a situation when you have to be assertive when
giving directions to others?
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
14
Placement Report Susie Sample
On the Attitude scale Ms. Sample is above the designated Profile for this Job Match
Pattern. This suggests her tendency will be to express an overly optimistic attitude
compared to successful individuals in this position. Discussions with her should explore
the possibility she will encounter frustration by the nature of this work.
ο Tell me about a specific time when your ability to encourage others created a
positive attitude.
ο Describe the relationship between attitude and productivity and how that has
applied to a particular experience for you recently.
ο Pick any event from the last five years in which you were an example of a
positive attitude for other people to follow. Be specific. Tell me about the
event.
ο Tell me about a time when you showed high enthusiasm and energy in order
to create positive attitude in others. Give me a specific example.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
15
Placement Report Susie Sample
On the Objective Judgment scale Ms. Sample is below the designated job profile for this
position. This suggests her decision making process is less objective than the position
typically requires and she could have a problem with the pragmatic nature of the job.
Discussions with her should explore the possibility that for Ms. Sample the position may
lead to frustration and a reduction in her level of performance.
OCCUPATIONAL INTERESTS
Ms. Sample's interest in Creative activities is moderate and yet above what is typical for
this Job Match Pattern. The relatively low level of aesthetics in this position may not be
motivational for her.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
16
Placement Report Susie Sample
Activities that involve entrepreneurial pursuits are preferred most by those who match
the Interest Pattern for this position. However, the activities associated with the
Enterprising theme are not among Ms. Sample's primary three interest themes and may
not motivate her as much.
ο How often do you take the role of a persuasive leader in a group? Why so
often or so infrequently?
ο What is most frustrating about leading or persuading others?
ο Describe some motivational aspects of entrepreneurial activities you have
experienced before.
ο How do you feel about using skills of persuasion to convince others to do what
you need?
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
17
CONFIDENTIAL
COACHING REPORT
Thursday, May 8, 2008
Susie Sample
Any Department
Profiles International
5207 Lake Shore Drive
Waco, TX 76710
254-751-1644
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
Introduction
The Coaching Report for Susie Sample provides information that can be helpful in
managing, motivating, and coaching Susie for increased productivity.
This report reflects the responses provided by Susie Sample when she completed the
ProfileXT® assessment. Results are illustrated on a scale from 1 to 10. The darker area
on the scale represents the “Job Match” pattern for the position. The enlarged segment
of the scale shows where Susie scored. If the enlarged segment is dark, Susie is in the
Job Match pattern, if it is light she is not. Information about Susie is reported in these
five categories:
Please consult the User’s Guide for additional information on using these results in
working with Susie.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
1
Coaching Report Susie Sample
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
2
Coaching Report Susie Sample
Accommodating – Tendency to be
friendly, cooperative, and agreeable; to be 1 2 3 4 5 6 7 8 9 10
a team person.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
3
Coaching Report Susie Sample
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
4
Coaching Report Susie Sample
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
5
Coaching Report Susie Sample
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
6
Coaching Report Susie Sample
Behavioral Traits
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
7
Coaching Report Susie Sample
ο She has a low need to steer the course of what is happening, the direction of
events.
ο Susie is slow to make decisions or enforce company policies and act with
authority. She will be slow to make unpopular decisions when necessary.
ο Ms. Sample prefers not to take action without having the time and opportunity
to process information pertaining to the situation. She prefers to wait for
specific instructions before taking action.
ο Ms. Sample tends to be a quiet, personal producer who works hard for a
leader and a cause.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
8
Coaching Report Susie Sample
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
9
Coaching Report Susie Sample
ο Ms. Sample is typically decisive and inclined to act. She can be effective in
positions which require timely results.
ο Ms. Sample is capable of responding to an emergency and of solving
problems in a timely manner.
ο She is not inclined to delay important decisions.
ο Susie stands firm on some decisions and may not be inclined to back down
once a decision is made, unless under pressure.
Accommodating – Tendency to be
friendly, cooperative, agreeable. To be a 1 2 3 4 5 6 7 8 9 10
team person.
ο She is generally pleasant, friendly and patient, not inclined to show temper or
frustration.
ο Ms. Sample typically recognizes the need to work with others and she is
usually willing to share resources and information.
ο Susie is modest, not inclined to take or to maintain an extreme opinion or
position.
ο Ms. Sample tends to have a cooperative outlook and is generally prepared to
help others.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
10
Coaching Report Susie Sample
ο Ms. Sample has a moderate need for freedom from controls, close
supervision, and organizational constraints.
ο She is usually comfortable handling new problems independently.
ο Susie appreciates some opportunity to challenge the status quo and to cause
a change in something.
ο Ms. Sample prefers to carry out important tasks with minimal supervision. She
can be counted on to meet her commitments without close supervision.
ο Ms. Sample uses judgment that often tends to be more subjective when she
feels pressured.
ο Ms. Sample's judgment will be much more intuitive when addressing critical
independent decision making responsibilities.
ο Ms. Sample has thinking abilities that can be less effective if she allows
personal biases and opinions to replace sound judgment.
ο Ms. Sample tends to be a subjective thinker and emphasizes personal
opinions more than factual data.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
11
Coaching Report Susie Sample
Occupational Interests
The Interest section assesses the relative interests among the six interest areas. The top three
interests for Ms. Sample are shown here along with the top three interests for the Any
Department position. Note that Susie shares ONE top interest with the requirements of this
position.
TOP THREE areas of interest for TOP THREE areas of interest for the position of
Susie Sample. Any Department.
Ms. Sample's interests are focused in the administrative and technical aspects of work. She
demonstrates an interest in the Financial, People Service, and Technical themes. This pattern is
consistent with people who like to work in a fairly structured setting, especially in which there is
a definable chain of command and there are typical office practices to be dealt with. The
preferred work environment is usually defined by a focus on interpersonal dynamics and helping
clients, especially with technical information from a consultative/expert point of view.
With Financial/Administrative as her primary area of interest, Ms. Sample is likely to seek
activities that involve organizing or otherwise dealing with budgets, information and/or supplies.
Her primary focus and source of motivation is in classifying and managing information. Second,
she is motivated by the interaction with others that comes with service to an interpersonal cause
as demonstrated by her interest in People Service activities. Helping others or providing them
with services may help energize her in what she does at work. Finally, her interest in Technical
activities rounds out her profile. Other interest areas may have more of an effect on her
motivation, but her interest in Technical pursuits contributes.
Notice:
As discussed in the User’s Guide for this product, this job pattern approach to matching individuals to a position provides information
of great value and should be an important part of the placement decision. However, the user is reminded that the results from any
test should never make up more than a third of the final decision.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
12
Coaching Report Susie Sample
Coaching Comments
Susie Sample scored outside the position match pattern in the following areas. When
working with Susie Sample you might consider the following:
THINKING
On the Verbal Reasoning scale Ms. Sample is above the designated Profile for this Job
Match Pattern. This suggests her ability to process verbal information is greater than the
position typically requires and she may experience frustration over the lack of challenge.
Discussions with her should explore the possibility the position may not maintain her
interest and/or level of performance.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
13
Coaching Report Susie Sample
BEHAVIORAL TRAITS
On the Assertiveness scale, Ms. Sample scored below the job profile for this position.
She could find the requirements of a strong presence to be overly challenging.
Determine her willingness to enhance her confidence and leadership skills in the future.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
14
Coaching Report Susie Sample
On the Attitude scale Ms. Sample is above the designated Profile for this Job Match
Pattern. This suggests her tendency will be to express an overly optimistic attitude
compared to successful individuals in this position. Discussions with her should explore
the possibility she may encounter frustration by the nature of this work.
ο Due to an optimistic regard for the motivations of others, Ms. Sample may not
appraise people appropriately, especially if she is actively negotiating with
someone. Encourage discerning evaluative skills so she may approach
dealings with others with more prudence and confidence.
ο Susie's faith in the results of some projects may be too optimistic, allowing
mistakes and unforeseen conflicts to occur. Training in logical and evaluative
reasoning may provide her with the ability to use better judgment and forecast
potential hazards appropriately.
ο Training in more prudent estimations of the motivations of others will enhance
her quality of work as Susie appears to have higher than average optimism
concerning the motivations of others.
ο Ms. Sample appears overly optimistic and positive compared to most
successful performers in this field about the motivations of others. To help
develop a more realistic attitude concerning competition, encourage her to
observe her more successful coworkers and offer an opportunity to discuss
the differences with you.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
15
Coaching Report Susie Sample
On the Objective Judgment scale Ms. Sample is below the designated job profile for this
position. This suggests her decision making process is less objective than the position
typically requires and she could have a problem with the pragmatic nature of the job.
Discussions with her should explore the possibility that for Ms. Sample the position
could lead to frustration and a reduction in her level of performance.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
16
Coaching Report Susie Sample
OCCUPATIONAL INTERESTS
Ms. Sample's interest in Creative activities is moderate and yet above what is typical for
this Job Match Pattern. The relatively low level of aesthetics in this position may not be
motivational for her.
Activities that involve entrepreneurial pursuits are preferred most by those who match
the Interest Pattern for this position. However, the activities associated with the
Enterprising theme are not among Ms. Sample's primary three interest themes and may
not motivate her as much.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
17
CONFIDENTIAL
SUCCESSION PLANNING REPORT
Thursday, May 8, 2008
Susie Sample
Profiles International
5207 Lake Shore Drive
Waco, TX 76710
254-751-1644
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
Succession Planning Report Susie Sample
Succession Planning
Profiles International, Inc. has developed customized Job Match Patterns for several
positions in the organization. This list shows how Susie Sample matches the Job Match
Patterns for these different positions. The overall percent match reflects her Thinking
Style, Occupational Interests, and Behavioral Traits combined.
You should select appropriate positions from the Job Match Patterns listed here and
generate reports for Susie specific to those positions. These reports will provide very
detailed information about Susie to include coaching comments and interviewing ideas
for succession planning. Please note, this report does not measure or consider the
candidate’s education, training, or experience and does not indicate job skill
requirements.
NOTICE:
As discussed in the User’s Guide for this product, this job pattern approach to matching
individuals to a position provides information of great value and should be an important
part of the placement decision. However, the user is reminded that the results from any
test should never make up more than a third of the final decision.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
1
CONFIDENTIAL
JOB PROFILE SUMMARY REPORT
Thursday, May 8, 2008
Susie Sample
Any Department
Profiles International
5207 Lake Shore Drive
Waco, TX 76710
254-751-1644
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
Job Profile Summary Report Susie Sample
Thinking Style
Learning Index 5 6 7 8 Job Match
Verbal Skill 6 7 8 Percentage
Verbal Reasoning 5 6 7 8 9 94%
Numerical Ability 5 6 7
Numeric Reasoning 6 7 8 9
Behavioral Traits
Energy Level 5 6 7 8 9 Job Match
Assertiveness 2 4 5 6 7 Percentage
Sociability 4 5 6 7 85%
Manageability 2 3 4 5 6
Attitude 5 6 7 8 9 Distortion - 9
Decisiveness 2 3 4 5
Accommodating 6 7 8 9
Independence 5 6 7 8 9
Objective Judgment 2 3 4 5
Occupational Interests
Interests Ranking
Top three interests for this position Job Match
Creative 6 Percentage
Enterprising 1 59%
Technical 7
The Job Matching
Lowest three interests for this position process for Interests is
concerned with the top
People Service 7 three interests of a Job
Match Pattern and how
Financial/Admin 8 a candidate's top three
interests match. The
Mechanical 7 three top interests for
this Pattern are
indicated and ranked
Note: The bolder scores indicate the three highest interests of this individual. from top to bottom.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
1
Job Profile Summary Report Susie Sample
Thinking Style
Learning Index (an index of expected learning, reasoning, and problem solving
potential) Score–7 (in the pattern)
ο Ms. Sample is an effective learner in most situations.
Verbal Skill (a measure of verbal skill through vocabulary) Score–8 (in the
pattern)
ο Susie can build on her basic foundation as the particular communication
skills required in performing the job become familiar.
Behavioral Traits
Energy Level (tendency to display endurance and capacity for a fast pace)
Score–7 (in the pattern)
ο Ms. Sample can be relied upon to complete assignments in a timely
manner.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
2
Job Profile Summary Report Susie Sample
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
3
Job Profile Summary Report Susie Sample
Occupational Interests
Ms. Sample's interests are focused in the administrative and technical aspects of work.
She demonstrates an interest in the Financial, People Service, and Technical themes.
This pattern is consistent with people who like to work in a fairly structured setting,
especially in which there is a definable chain of command and there are typical office
practices to be dealt with. The preferred work environment is usually defined by a focus
on interpersonal dynamics and helping clients, especially with technical information from
a consultative/expert point of view.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
4
CONFIDENTIAL
INDIVIDUAL REPORT
Thursday, May 8, 2008
Susie Sample
Profiles International
5207 Lake Shore Drive
Waco, TX 76710
254-751-1644
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
A Message to Susie Sample
Behavioral science has proven that the most successful people are those who know
themselves, both their strengths and weaknesses. This knowledge is important to them
as they develop the strategies necessary to meet the demands and challenges of
achieving success.
The purpose of this report is to help you identify and make full use of your strengths and
to help you develop an awareness of any areas that could be limiting your effectiveness.
The goal of this report is to help you achieve greater success for yourself.
The information in your report can be useful in planning a self-improvement program for
your professional development and personal growth.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
1
A Profile of the Total Person
Thinking Style
Learning Index (an index of expected learning, reasoning, and problem solving
potential)
ο You handle fairly complex tasks with relative efficiency, demonstrating strong
problem solving abilities.
ο You are an effective learner in most situations.
ο You generally learn by paying attention to detail and determining how the
information applies to various relevant areas of your work.
ο Your understanding and utilization of new information will be better than most
individuals in the general population.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
2
Individual Report Susie Sample
Behavioral Traits
Energy Level (tendency to display endurance and capacity for a fast pace)
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
3
Individual Report Susie Sample
Assertiveness (tendency to take charge of people and situations; leads more than
follows)
ο You express a low need to steer the course of what is happening or the direction
of events.
ο You tend to wait before making decisions, enforcing company policies, and
acting with authority. You may defer unpopular decisions when necessary.
ο You prefer to take action after having the time and opportunity to process
information pertaining to the situation. You likely prefer to wait for specific
instructions before taking action.
ο You tend to be a quiet, personal producer who works hard for a leader and a
cause.
ο You prefer to foster good relations across departments, maintain friendly contact,
and keep up with the issues of common concern.
ο You are moderately inclined to be sociable. You tend to be aware of the
necessity for keeping lines of communication open.
ο You prefer democratic supervision in which two-way dialogue is encouraged.
ο You are generally inclined to promote the benefits of teamwork and to involve the
team in the discussion of how things will be done.
ο You are friendly, accommodating, and should be fairly easy to work with.
Building and Retaining
ο Youthe demonstrate a willingness to conform to company policies without feeling
Highany loss of personal freedom.
-Performance
ο You typically
Companyare willing to accept guidance and suggestions from others.
ο You have a moderately positive attitude concerning organizational constraints
and restrictions.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
4
Individual Report Susie Sample
ο You have a highly positive attitude concerning risk, change, and unexpected
challenges.
ο You demonstrate a highly positive attitude regarding changes in policies and
procedures.
ο You express a positive attitude regarding supervision and external controls.
ο Your attitude is highly compatible with confronting interpersonal problems and
frustrations.
ο You are typically decisive and effective in positions which require timely results.
ο You are capable of responding to an emergency and of solving problems in a
timely manner.
ο You are not inclined to delay important decisions.
ο You stand firm on some decisions and may not be inclined to back down once a
decision is made unless under pressure.
ο You are generally pleasant, friendly, and patient. You are not inclined to show
temper or frustration.
ο You typically recognize the need for working with others and are usually willing to
share resources and information.
ο You tend to be modest, not inclined to take or to maintain an extreme opinion or
ing and Retaining
Buildposition.
ο Youthe tend to have a cooperative outlook and are generally prepared to help
High-Performance
others.
Company
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
5
Individual Report Susie Sample
ο You have a moderate need for freedom from controls, close supervision, and
organization constraints.
ο You are typically comfortable handling new problems independently.
ο You may appreciate the opportunity to challenge tradition and the status quo in
order to cause a change in something.
ο You prefer to carry out important tasks with minimal supervision.
Objective Judgment (the ability to think clearly and be objective in decision making)
ο Your thinking can be most effective when you are aware of how personal biases
and opinions might replace sound judgment.
ο You have a strong tendency to use more subjective judgment when you feel
pressured.
ο You tend to be a subjective thinker and to emphasize personal opinions more
than factual data.
Occupational Interests
Your interests are focused in the administrative and technical aspects of work. You appear to
have an interest in the Financial, People Service, and Technical themes. This pattern is
consistent with people who like to work in a fairly structured setting, especially in which there is
a definable chain of command and there are typical office practices to be dealt with. The
preferred work environment is usually defined by a focus on interpersonal dynamics and helping
clients, especially with technical information from a consultative/expert point of view.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
6
May 29, 2008 Susie Sample
Job Summary Graph
Job Pattern: Any Department
Overall Job Match 83%
Thinking Style
Learning Index 5 6 7 8 Job Match
Verbal Skill 6 7 8 Percentage
Verbal Reasoning 5 6 7 8 9 94%
Numerical Ability 5 6 7
Numeric Reasoning 6 7 8 9
Behavioral Traits
Energy Level 5 6 7 8 9 Job Match
Assertiveness 2 4 5 6 7 Percentage
Sociability 4 5 6 7 85%
Manageability 2 3 4 5 6
Attitude 5 6 7 8 9 Distortion - 9
Decisiveness 2 3 4 5
Accommodating 6 7 8 9
Independence 5 6 7 8 9
Objective Judgment 2 3 4 5
Occupational Interests
Interests Ranking
Top three interests for this position Job Match
Creative 6 Percentage
Enterprising 1 59%
Technical 7
The Job Matching
Lowest three interests for this position process for Interests is
concerned with the top
People Service 7 three interests of a Job
Match Pattern and how
Financial/Admin 8 a candidate's top three
interests match. The
Mechanical 7 three top interests for
this Pattern are
indicated and ranked
Note: The bolder scores indicate the three highest interests of this individual. from top to bottom.
Profiles Office Park • 5205 Lake Shore Drive • Waco, Texas 76710-1732 USA • 254.751.1644 • www.profilesinternational.com
Copyright ©2001-2008 Profiles International, Inc.
1
The ProfileXT® Technical Manual
References
Alexander, E.R. & Wilkins, R.D. (1982). Performance rating validity: The relationship of objective
and subjective measure of performance. Group and Organization Studies, 7, 485-498.
Barrick, M.R. & Mount, M.K. (1991). The big five personality dimensions and job performance.
Personnel Psychology, 44,1-26.
Bourdeau, J. (1998). Employment testing manual. Boston, MA: Warren, Gorham & Lamont.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Lawrence
Erlbaum.
Crocker, L. & Algina, J. (1986). Introduction to classical & modern test theory. Orlando, FL: Holt,
Rinehart, and Winston, Inc.
th
Cronbach, L.J. (1984). Essentials of psychological testing (4 edition). San Francisco: Harper &
Row.
Day, D.V. & Silverman, S.B. (1989). Personality and job performance: Evidence of incremental
validity. Personnel Psychology, 42, 25-35.
Edens, J.F. (2004). Effects of response distortion on the assessment of divergent facets of
psychopathy. Assessment, Vol. 11, No. 1 (109-112). Sage Publications.
Ghiselli, E.E., (1973). The validity of aptitude tests in personnel selection. Personnel Psychology,
26, 461-477.
Gordon, L.V. (1978). Gordon personal profile – Inventory manual. New York: Harcourt Brace
Jovanovich.
nd
Gottfredson, G.D. & Holland, J.L. (1989). Dictionary of Holland occupational codes (2 edition).
Odessa, FL: Psychological Assessment Resources.
Guilford, J.P. & Zimmerman, W.S. (1978). The Guilford-Zimmerman temperament survey:
Manual of instructions and interpretations. Beverly Hills, CA: Sheridan Psychological
Services, Inc.
Guilford, J.P. & Zimmerman, W.S. (1976). The Guilford-Zimmerman temperament survey
handbook. San Diego, CA: EDITS.
Heneman, R.L. (1986). The relationship between supervisory ratings and results-oriented
Measures of performance: A meta-analysis. Personnel Psychology, 39, 811-826.
Hogan, R. (1991). Personality and Personality Measurement. M. Dunnette and L. Hough (Eds.)
nd
Handbook of Industrial and Organizational Psychology (2 edition). Palo Alto, CA:
Consulting Psychologists Press.
Holland, J.L. (1970). Vocational preference inventory manual. Palo Alto, CA: Consulting
Psychologists Press.
Holland, J.L. (1985a). Making vocational choices: A theory of vocational personalities and work
environments. Odess, FL: Psychological Assessment Resources.
Holland, J.L. (1985b). The vocational preference inventory. Odessa, FL: Psychological
Assessment Resources.
Holland, J.L. (1994). The self-directed search. Odessa, FL: Psychological Assessment
Resources.
Hunter, J.E. & Schmidt, F.L. (2004). Methods of meta-analysis: Correcting error and bias in
nd
Research findings (2 edition). Newbury Park, CA: Sage.
Hunter, J.E. & Hunter, R.F. (1984). Validity and utility of alternative predictors of job performance.
Psychological Bulletin, 96, 72098.
Terman, L.M. & Merrill, M.A. (1960). Stanford-Binet intelligence scale: Manual for the third
Revision, Form L-M. Boston, MA: Houghton Mifflin.
Thurstone, L.L. (1938). Primary mental abilities: Psychometric monographs, No. 1. Chicago, IL:
U. of Chicago Press.
th
U.S. Department of Labor (1977). Dictionary of occupational titles (4 edition). Washington, DC:
U.S. Government Printing Office.
U.S. Department of Labor (1982). Dictionary of occupational titles (4th edition supplement, 1982).
Washington, DC: U.S. Government Printing Office.
U.S. Department of Labor (1986). Dictionary of occupational titles (4th edtion supplement, 1986).
Washington, DC: U.S. Government Printing Office.
U.S. Department of Labor (2000). The nation’s new resource of occupational information.
Retrieved July 20, 2000 from: http://www.doleta.gov/programs/onet.
U.S. Department of Labor, Employment and Training Administration (1999). Testing and
Assessment: An employer’s guide to good practices. Washington, DC: U.S. Printing
Press.
Vineberg, R. & Joyner, J.H. (1982). Prediction of job performance: Review of military studies.
Alexandria, VA: Human Resources Research Organization.
Wechsler, David. (1944). Measurement of adult intelligence (3rd edition). Baltimore, MD:
Williams & Wilkins.
Wechsler, D. (1958). The measure of adult intelligence (4th edition). Baltimore, MD: Williams &
Wilkins.