Professional Documents
Culture Documents
Psychometrictestingasapredictorofacademicperformance_ASouthAfricanExperience
Psychometrictestingasapredictorofacademicperformance_ASouthAfricanExperience
net/publication/314467411
CITATIONS READS
0 1,341
2 authors:
All content following this page was uploaded by Frans Maloa on 30 March 2020.
Dr Frans Maloa
University of South Africa
maloaf@unisa.ac.za
Ms. Ciara Bux
University of South Africa
48447196@mylife.unisa.ac.za
WORKING PAPER
ABSTRACT
Student success is a major concern for institutions of higher education worldwide. In South
Africa, graduation rates across all provider types of MBA qualifications are not very high.
What is the cause of less than desired success rate? A range of available arguments and
evidence suggests the lack of an appropriate cognitive selection battery in predicting
academic performance. The application of psychometric testing is required to select MBA
students who are appropriately qualified to enter and complete the program successfully. This
paper explores the current state of psychometric testing as a predictor of academic
performance and suggests an integrated selection framework to improve student selection.
INTRODUCTION
Applications to higher education have increased over the years forcing universities to select
students based on their predicted academic performance (Bischoff, 2012). The production of
university graduates and especially postgraduate students is an essential component of the
national system of innovation in modern industrialized societies (Council on Higher
Education, 2010). The Master of Business Administration (MBA) program has become a
major component of the general credentials that business professionals must have to achieve
success (Christensen, Nance & White, 2012). As a result, the demand for MBA education has
increased considerably.
Student success is a strategic priority for institutions of higher education (Visser & Van Zyl,
2013). According to Davis & Venter (2011), student success rates not only enhance the
reputation of an institution, but also increase government funding. Therefore, in order to
ensure a good reputation, business schools need to select applicants who are most likely to
succeed (Safón, 2012).
However, South African institutions offering MBA programs do not have high graduation
rates (Kotze & Grissel, 2008), this despite the fact that Business Schools strive to admit
students who are most likely to succeed (Bischoff, 2012). A range of available arguments and
evidence suggests the lack of an appropriate cognitive selection battery in predicting
academic performance. The challenge with MBA admissions has thus been to select students
who are appropriately qualified to enter the program (Christensen et al., 2012).
Davis and Venter (2011) contend that selection of students with ability to complete the MBA
program improves when the drivers of student performance are known. Knowledge of factors
differentiating between successful and unsuccessful students can lead to the identification of
focus areas for potential development within institutions and courses (Davis & Venter, 2011).
This knowledge could lead to an improvement in throughput and a reduction in student
dropout (Davis & Venter, 2011). Thus, identifying the best predictors of academic
performance is extremely important as a metric to evaluate the effectiveness of colleges and
universities (Komarraju, Ramsey, and Rinella, 2013).
While the low success rate of MBA students forms part of a major debate in South Africa, the
debate has largely overlooked the process of selection of students. Prior to this research, there
has been limited if any, empirical studies on the selection process and instruments used for
selection. This research paper argues that paying attention to the type of psychological
assessments used to select students at the initial stage of the MBA program may assist in
selecting students that have the capacity to complete the program successfully.
There are three aims for this study. Firstly, the aim is to conceptualize the constructs of
cognitive tests and academic performance in the literature. The second aim is to explain the
theoretical relationship between cognitive tests and the academic performance. The third aim
is to suggest an integrated selection framework to improve student selection on the MBA
program.
Du Plessis’s study (2008), found that the results from the APIL instrument were able to
demonstrate utility in predicting future academic performance of sampled South African
university students, and consequently has utility as a selection method. Additionally, a study
conducted by Aprolab, the test developer of the APIL instrument, amongst a sample of 52
MBA students at the Gordon Institute of Business Science (GIBS) confirmed APIL as a
significant predictor of MBA examination marks at GIBS (Taylor, 2012).
Additionally, Psytech SA (2010) conducted a study on a group of MBA students who
completed the NCR2 prior to enrolling on the course. Their scores on the tests correlated with
their subsequent performance across different MBA courses. The results revealed that the
NCR2 is a statistically significant predictor of performance on an MBA program.
With regard to the CRTB2 Numerical Reasoning Test, authors such as Kotze and Grissel
(2008) concluded that a significantly positive correlation exists between students’ aptitude
test results (numerical) and individual course results, as well as with their average academic
performance on an MBA program. In terms of the CRTB2 Verbal Reasoning Test, authors
Fish and Wilson (2009) concluded that factors that successfully predicted success on a part-
time MBA program included a verbal skills test.
Schaap and Luwes (2013) provided further supporting evidence in their study where a
cognitive ability test, the Learning Potential Computerized Adaptive Test (LPCAT), an
assessment similar to that of the APIL, found cognitive ability to be a statistically significant
predictor of future academic performance of students. Watkins et al. (2007) concluded from
a longitudinal study that intelligence influences future achievement.
In addition, a doctoral dissertation by Mafani (2013) conducted at the Nelson Mandela
Metropolitan university also proved that there is a significant correlation between
psychometric testing and academic performance in the selection of students registered for an
MBA program.
In light of the above, the value of studying the relationship between cognitive tests and the
academic performance of students on an MBA program is evident. However, South African
studies have also indicated that cultural fairness also influences psychometric testing in the
context of South African student selection.
Cultural factor
Psychological assessment in South Africa provokes many strong opinions. It is highly
controversial in South Africa due to past discrimination, unfair, and unbiased use of tests
(Laher & Cockcroft, 2014). Since the first democratic elections in 1994, the country adopted
a new constitution and stronger demands for all psychological testing to be culturally
appropriate (Laher & Cockcroft, 2014). Psychological testing needs to meet stringent
psychometric standards and cater for all age groups in the multicultural society (Foxcroft,
Paterson, le Roux & Herbst, 2004).
However, to ensure the cultural and fair use of assessments in South Africa, regardless of the
context in which it is used, all testing should comply with all the legal imperatives that
regulate psychological testing. The primary South African legislation governing
psychometric assessment use is the Employment Equity Act (no. 55 of 1998), which requires
Dynamic Approach
Envisioning Future
Assessing Current
Scientific
Professional Role
Brand/
Value
Reputation Proposition
Socialization
REFERENCES
Baker, V. L., & Pifer, M. J. (2015). Antecedents and outcomes: theories of fit and the study
of doctoral education. Studies in Higher Education, 40(2), 296-310.
Beaujean, A., Firmin, M. W., Attai, S., Johnson, C. B., Firmin, R. L., & Mena, K. E. (2011).
Using personality and cognitive ability to predict academic achievement in a young adult
sample. Personality and Individual Differences, 51(6), 709-714.
Braxton, J. M., Hirschy, A. S., & McClendon, S. A. (2011). Understanding and reducing
college student departure: ASHE-ERIC Higher Education Report, 30, (3)-16. John Wiley &
Sons.
Bux, C. (2014). The relationship between cognitive tests and the academic performance of
students on an MBA programme. (Masters dissertation, university of South Africa)
Christensen, D. G., Nance, W. R., & White, D. W. (2012). Academic performance in MBA
programs: do prerequisites really matter? Journal of Education for Business, 87(1), 42-47.
Council on Higher Education. (2010). Access and throughput in South African Higher
Education: Three case studies. Higher Education Monitor, 9, (1) 218.
Davis, A., & Venter, P. (2011). The performance and success of postgraduate business
students. Progressio, 33(2), 72-90.
De Beer, M. (2011). The role of the Learning Potential Computerized Adaptive Test
(LPCAT) in the vocational guidance assessment of adolescents. Unpublished manuscript.
UNISA
Foxcroft, C.D., & Roodt, G (2009). An introduction to psychological assessment in the South
African context (3rd ed.). Oxford, UK: Oxford University Press.
Higher Education Act 101 of 1997, 2000 & 2001 Amendment Acts.
Komarraju, M., Karau, S. J., Schmeck, R. R., & Avdic, A. (2011). The Big Five personality
traits, learning styles, and academic achievement. Personality and Individual Differences,
51(4), 472-477.
Kotze, M., & Griessel, L. (2008). The prediction of the academic performance of MBA
students by means of specific aptitudes and competencies. Journal for New Generation
Sciences, 6(2), 60-79.
Kuncel, N.R., Crede, M., & Thomas, L.L. (2007). A meta-analysis of the predictive validity
of the Graduate Management Admissions Test (GMAT) and Undergraduate Grade Point
Average (UGPA) for graduate student academic performance. Academy of Management
Learning and Education, (6), 51-68.
Mafani, M. C. (2013). A Profile for a Successful MBA Candidate at the NMMU Business
School (Doctoral thesis, Nelson Mandela Metropolitan University).
Fiegen, A.M. (2010), "Systematic review of research methods: the case of business
instruction", Reference Services Review, Vol. 38, No. 3, pp. 385-397, ISSN 0090 7324
Psytech SA. (2010). Technical Manual for Critical Reasoning Battery. Psyctech International
Limited.
Safón, V. (2012). Can the reputation of an established business school change? Management
in Education, 26(4), 169-180.
Schaap, P., & Luwes, M. (2013). Learning potential and academic literacy tests as predictors
of academic performance for engineering students. Acta Academica, 45(3), 181-214.
Visser, H., & Van Zyl, D. (2013). Assessment of academic readiness to achieve student
success and retention. In South African Journal of Higher Education: Special Issue: 2011
Forum of the Southern African Association of Institutional Research (Vol. 27, No. 2, pp. 330-
352). Sabinet Online.
Watkins, M. W., Lei, P. W., & Canivez, G. L. (2007). Psychometric intelligence and
achievement: A cross-lagged panel analysis. Intelligence, 35(1), 59-68.
Yang, B., & D. R. Lu. (2001). ‘Predicting Academic Success in Managerial Education: An
Empirical Investigation of MBA Success.’ Journal of Education for Business 77 (1): 15–20.