Download as pdf or txt
Download as pdf or txt
You are on page 1of 6

Asian Journal of Sport and Exercise Psychology 4 (2024) 1–6

Contents lists available at ScienceDirect

Asian Journal of Sport and Exercise Psychology


journal homepage: www.elsevier.com/locate/ajsep

The feudal glove of talent-selection decisions in sport –Strengthening the


link between subjective and objective assessments☆,☆☆
Michael Bar-Eli a, *, Ronnie Lidor a, Franziska Lath b, Jörg Schorer b
a
Levinsky-Wingate Academic College, Israel
b
Institute of Sport Science, Carl von Ossietzky University Oldenburg, Germany

A R T I C L E I N F O A B S T R A C T

Keywords: When making talent-selection decisions in sport, coaches, scouts, program directors, and policymakers typically
Talent selection adopt two approaches: The subjective approach, also known as the coach’s eye, where these professionals select or
Talent development de-select athletes based on their personal observations and impressions; and the objective approach, where they
Judgment and decision making
apply a multi-faceted formula for awarding scores to the athletes’ motor skills (such as agility and coordination)
Sport analytics
Coaches
and psychological capabilities (such as leadership and motivation) – as a mean for predicting their future success.
Scouts These two approaches are often perceived as complementary in the strive to reach optimal selection decisions in
sport. In this conceptualized article, we examine challenges associated with such talent-selection decisions, and
address the coach’s eye as an example of a subjective assessment approach. We also address the concept of fast
and frugal heuristics for making selection decisions in sport, while elaborating on bounded rationality and the
human machine paradigm. Finally, in addition to discussing certain "built-in" limitations in sport-selection de­
cisions, based on judgment and decision-making models, we provide a rationale for adding the big-data
approach, as a mean for enhancing links between the subjective and objective assessments currently used in
talent-selection decisions in sport.

Introduction elite performers. Finally, the term talent selection refers to the ongoing
process of identifying athletes at various stages of their training
Predicting the future of young athletes in years to come poses a main program.
challenge for professionals who are involved in decision-making (DM) Such DM processes typically entail a subjective assessment approach,
relating to talent selection in sport, including coaches, scouts, program an objective assessment approach, or a combination of the two. The
directors, and policymakers. Unfortunately, not all potential athletes subjective approach is mainly based on the assessment of coaches who are
can be provided with the environmental and instructional conditions considered to be key figures in the given sport program (Lath et al.,
that are required for achieving high-level performance in sport. As such, 2021; see also Calvin, 2013, and Malloy, 2011, for anecdotal perspec­
selection decisions must be made carefully – in order to determine who tives). This approach, which is also referred to as the coach’s eye, reflects
will be given the privilege of becoming a part of a highly nurtured the multi-year professional experience of coaches who work with ath­
competitive sport program (Baker, Schorer & Wattie, 2017; Lath, letes in both early and advanced phases of their career development. In
Koopmann, Faber, Baker & Schorer, 2021; Rees et al., 2016). practice, these coaches typically decide who will be selected or
Selection decisions are regularly made in processes that are associ­ de-selected for the sport development program, based on their obser­
ated with early talent development in sport, including talent detection, vations and impressions (Roberts et al., 2019), "making them a key
talent identification, and talent selection. According to Williams and ’gatekeeper’ to further developmental opportunities" (Lath et al., 2021,
Reilly (2000), the term talent detection refers to the discovery of potential p. 2).
performers who are not currently involved in any sport program. The The objective approach, on the other hand, which emerged from early
term talent identification refers to the process of recognizing individuals research conducted in the field of sport sciences, strives to explore the
who are currently involved in sport and have the potential to become so-called holy talent-selection formula (Baker, 2022; Koopmann, Faber,


You, scientists, can only tell me what was, but never what will be.☆☆ Attributed to David Ben-Gurion, Israel’s "Father of the Nation"
* Corresponding author.
E-mail address: mbareli@bgu.ac.il (M. Bar-Eli).

https://doi.org/10.1016/j.ajsep.2023.09.003
Received 17 August 2023; Accepted 18 September 2023
Available online 22 September 2023
2667-2391/Copyright © 2023 The Authors. Publishing services by Elsevier B.V. on behalf of KeAi Communications Co. Ltd. This is an open access article under the
CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
M. Bar-Eli et al. Asia Journal of Sport and Exercise Psychology 4 (2024) 1–6

Baker & Schorer, 2020; Lidor, Côté & Hackfort, 2009). This formula is been overlooked had Kahn not been nominated to the highly influential
composed of objective predictors – mainly scores of tests that assess position of Chief Executive Officer of the Bayern Munich Football Club
motor skills, such as agility, coordination, and speed, and psychological during 2021–2023 (Kahn, 2008); and (c) if health considerations for the
abilities, such as attention, leadership, and motivation (Lath, den Har­ athletes would have been involved in talent-identification development
tigh, Wattie & Schorer, 2021). With this multi-component formula, it is systems, such as appropriateness of the method and aspects of the ath­
assumed that the higher the athletes’ total score, the better their chances letes’ well-being that are associated with early training specialization.
of achieving success in the future. The subjective approach and the In their review of the existing literature on soccer talent identifica­
objective one have been perceived as complementary of one another; it tion, Bergkamp, Niessen, Den Hartigh, Frencken and Meijer (2019)
is, therefore, assumed that combining the two has the potential to pro­ address a number of major methodological issues – especially the ad­
vide decision makers with the most relevant information needed for vantages and limitations of the design, validity, and utility of the
accurately predicting the future success of the athlete. methods applied in such research. Drawing on principles from selection
In this conceptualized article, we re-examine the use of these two psychology that can be practiced in relation to selection decisions across
approaches, in light of a number of judgment and DM models (JDM), domains (e.g., Robertson & Smith, 2001; Vinchur & Brian, 2012), the
including the bounded rationality, the fast and frugal heuristics, and the authors identified four methodological issues associated with selection
human machine paradigm. We argue that in order to strengthen the link decisions in soccer: (a) the operationalization of criterion variables (i.e.,
between the subjective and objective approaches, a third approach the actual performance that needs to be predicted) as performance
should also be applied – the big-data approach (i.e., sport analytics), that levels; (b) the focus on isolated performance indicators as predictors of
can offer innovative tools and knowledge that were not previously soccer performance; (c) the effect of range restriction regarding the
available. Such maximization models, that address multi-faceted validity of predictors used in talent selection; and (d) the effect of the
objective data, should be taken into account in the early phases of the base rate on the implementation of talent-selection procedures. In light
athlete’s development. More specifically, in this article we (a) examine a of their review, these authors propose that future research should
number of challenges associated with talent-selection decisions in sport; consider the use of individual soccer criterion measures, adopt repre­
(b) discuss the term coach’s eye as a unique case of the use of the sub­ sentative and high-fidelity predictors of soccer performance, and take
jective assessment approach; (c) address the use of fast and frugal heu­ the restriction of range and base rate into account.
ristics, which is conceived as a new and upcoming approach for making When conducting talent selection, professionals must seek effective
selection decisions in sport; (d) elaborate on the concepts of bounded means for overcoming these challenges detailed above. To do so, they
rationality and the human machine paradigm; (e) discuss a number of must collect the most important and relevant data about those in­
"built-in" limitations in sport-selection decisions from a JDM perspec­ dividuals who could potentially meet the requirements of the specific
tive; and (f) provide the rationale for adopting a third approach – the sport program, and about those who have the potential to achieve high
big-data approach – for strengthening the link between the subjective levels of performance in the future. As such, the focus should be on how
and objective assessments currently used in talent-selection decisions. these professionals make decisions regarding the selection or de-
selection of the athletes in the early phases of talent development.
Challenges in talent selection in sport
The coach’s eye
The challenges entailed in selecting athletes and predicting their
future success have been impressively illustrated by Koz, Fraser-Thomas The term coach’s eye is used in the literature as a metaphor for the
and Baker (2012), in their analysis of the prediction accuracy of the DM process of coaches. In an attempt to define this term, Lath et al.
future performances of athletes as part of a draft.1 These researchers (2021) reviewed nine studies that offered definitions for this term, and
found that this accuracy ranged between 3 and 17% of the explained then devised the following definition: “[…] the coach’s eye, […], reflects
variance – figures that are presumably considered to be poor. It is the coach’s internal process of assessing and evaluating athletes, resulting in a
important to note that athletes who are selected in the draft are rela­ decision to select or de-select the athlete. This process is based on the coach’s
tively older, leading to potentially better decisions, based on more intuition and subjective experience and has the potential to provide a more
available data regarding the athlete’s past performance, and in turn, holistic profile of athletes” (p. 4). A number of observations were made in
requiring shorter predictions for the following years. However, in most this article. First, the studies on coaches’ DM processes in early phases of
sports, athletes are selected much earlier, and therefore coaches and talent selection tended to be based on qualitative interviews, where the
scouts have to predict a much longer period with less information. coaches talked of their DM processes retrospectively, often long after
The question that arises following the findings of Koz et al. (2012), they had made their selection decisions – thereby possibly inducing
therefore, is why is the accuracy of the athletes’ selection decisions this cognitive bias (Ericsson & Simon, 1980). Moreover, no clear selection
low? Till and Baker (2020) discuss three major challenges for optimizing criteria were reported to have been used during the selection process,
talent selection in sport: (a) unclear definition of the term talent and the and the coaches’ focus was solely on the decision outcome, namely
difficulty to predict how a given field of sport will evolve over time and whether the athletes had been selected or de-selected to the program (e.
what its future demands will be; (b) lack of consensus regarding the most g. Johnston, Wattie, Schorer & Baker, 2018; Siemon & Wessels, 2022).
effective means for identifying, selecting, and developing talented ath­ Finally, studies on the coach’s eye tend to overlook how the decision was
letes, while also considering their bio-psycho-social environment. made, with no information about the decision process being discussed
Moreover, a large range of views (and the lack of related research) exists (Baker, Wattie & Schorer, 2019; Lath et al., 2021).
regarding how the resourcing of talent identification development sys­ With the aim of gathering insights into how coaches actually select or
tems affects the optimal allocation of the systems’ total expenditure de-select athletes, Lath, Koopmann and Schorer (2022) conducted an
(Johnston & Baker, 2020). For example, academies for young talented online experiment using a theoretical JDM framework: the iCodes model
soccer players are considered essential in many European countries (e. (Jekel, Glöckner & Bröder, 2018). This model focuses on the actual DM
g., France, Spain, and the UK). However, former top-soccer player and process, with an emphasis on the necessary information for reaching a
legendary goalkeeper Oliver Kahn has accused these academies of decision. The model assumes that decisions are based on positive or
harming talented players; this minority opinion could possibly have negative criteria and cues in relation to the specific option. Due to the
probabilistic nature of the model, the iCodes model fits the dynamic and
probabilistic features that exist in talent-selection processes in sport.
1
A process used in some countries (especially North America) and sports However, Lath et al. (2022) claim that this computer-based research
(especially in closed leagues) for allocating players for certain teams. method lacks ecological validity – as consensus is still missing among

2
M. Bar-Eli et al. Asia Journal of Sport and Exercise Psychology 4 (2024) 1–6

coaches regarding the criteria that they apply during the DM process. An athlete’s future performance is determined by a large number of
so-called objective variables (as well as the interaction between these
The use of fast and frugal heuristics in selection decisions in variables) that can be measured, more or less reliably, in the present. Yet
sport while these determinants are necessary, they are insufficient in fully
explaining or accurately predicting future athletic performance.
The concept of bounded rationality (e.g., Simon, 1987, 1990), as The practice of combining a series of tests (with a primarily focus on
interpreted by Gigerenzer (2000, 2004), has been characterized via the the physical, physiological, and psychological attributes of an athlete),
fast and frugal heuristics notion (Raab, 2012, 2021) for making decisions combined with the coach’s observations, for the purpose of selecting and
that have good enough ("satisficing") outcomes. This notion is not new, de-selecting athletes for sport programs, is not new (see Johnston &
with its roots planted in the bounded rationality concept that was origi­ Baker, 2020; Leyhr et al., 2021). However, the idea of using fast and
nally addressed in the 1940s by 1978 Nobel Laureate, Herbert Simon. frugal heuristics (Gigerenzer, 2004; Raab, 2012) for capturing coaches’
According to this concept, human rationality – unlike normative ideal talent-selection decisions is indeed an innovative approach. In one
models, is bounded by a limited cognitive ability to process information, study, Schorer, Rienhoff, Fischer and Baker (2017) examined prediction
due to factors such as imperfect data, time constraints, and even emo­ accuracy in team handball, comparing between decisions made by
tions. As explained by Simon (1990), the rationality of human coaches (regional and national), players (novice and advanced), and
decision-makers is bounded "by a scissors whose two blades are the laypersons. The researchers only found small differences between
structure of the task environments and the computational capabilities of regional and national coaches, between novice and advanced players,
the actor" (p. 7). In other words, humans tend to construct simplified and among laypersons in their predictions of future athletic perfor­
interpretations of complex realities, thereby producing easy-to-handle mance. Schorer et al. (2017) interpreted some of these findings as
models regarding complex DM issues (Simon, 1987). According to this possibly being based on simple heuristics.
concept, only a limited number of decision alternatives and outcomes To improve the quality of forecasts made by coaches, DM processes
can be considered, leading decision makers to choose the first alternative should also include subjective expertise (provided, for example, through
that appears to provide an acceptable or good enough solution, rather fast and frugal heuristics), based on the counterintuitive less is more
than seeking an optimal one, as per the Maximization through Optimi­ principle, whereby better decisions are made based on less information
zation Principle (Bar-Eli et al., 2006). (Gigerenzer & Goldstein, 1996). Doing so could reduce possible decision
Bounded rationality provides the major theoretical underpinnings for errors caused by cognitive overload that stems from the environmental
the fast and frugal heuristics concept, with related work deeply rooted in complexity. In fact, this interaction between unboundedly/economi­
ecological approaches, such as that of Egon Brunswick and its extension cally rational tests and boundedly rational coaches is viewed as the most
into DM science by Kenneth Hammond. According to Gigerenzer (2004), promising means for improving efficacy in selection decisions in sport
"The basic tenet of ecological rationality is that the rationality or irra­ (Sieghartsleitner, Zuber, Zibung & Conzelmann, 2019).
tionality of a judgment can only be decided by an analysis of the
structure of the environment" (p. 336), since in the real world, intuitive Bounded rationality and the human machine paradigm
thought processes are considered to be adaptive – as they provide the
best match for the environment in which they are applied. The fast and Selection decisions in sport are rooted in traditional personnel
frugal heuristics concept offers a tool in which bounded rationality enables testing and industrial psychology (e.g., Ghiselli & Brown, 1955; Guion,
quick and effective decisions, that are ecologically (rather than opti­ 1965). This reflects the human machine paradigm that is highly pervasive,
mally) rational. as seen in numerous domains of Western society, including sport
It should be noted that interpretations of both bounded rationality (Remmele, 2003). Indeed, the sport domain is currently viewed as a
(Simon, 1987, 1990) and fast and frugal heuristics (Gigerenzer, 2000, product of scientific thinking and rationale fabrication (see, for example,
2004) are descriptive rather than prescriptive. In other words, while the Bar-Eli, 2018). In his classic work, Hoberman (1992) perceives athletes
traditional normative understanding of rationality optimally focuses on as mortal engines, who attempt to exceed the normal limits of speed and
the prescriptive production of benchmark models for maximizing utility, strength. Hoberman demonstrates how human science and industrial
bounded rationality and fast and frugal heuristics focus on descriptively technology have transformed and de-humanized sport. In line with
reasonable guiding concepts (e.g., Gigerenzer, Czerlinski & Martignon, Hoberman, Bar-Eli et al. (2006) labelled the underlying maximization
2002). These may include concepts of simplicity and frugality, with through optimization principle, arguing that since the ultimate goal of elite
individuals aspiring to make satisfactory (i.e., good enough) decisions. sport is performance maximization, the pursuit of success and excellence
Gigerenzer et al. (2002) maintain that fast and frugal heuristics "violate requires athletes to optimize everything – be it movement techniques,
two maxims of rational reasoning: They do not search for all available arousal levels during competitions, or decisions regarding recovery. This
information and do not integrate information […] but at what price? argument is evident in the context of sport talent selection through the
How much more accurate are benchmark models that use and integrate use of terms such as waste reduction strategies in relation to talent, in the
all information when predicting unknown aspects of real environ­ strive to decrease the efficacy of entire talent identification development
ments?" (p. 565). systems (Johnston & Baker, 2020).
The sport domain lacks a clear set of variables that consistently
predicts future success; moreover, a high degree of variability can be Are optimization models really out?
seen in those factors that discriminate between skilled and less-skilled
individuals (Johnston et al., 2018), which is reasonable due to the na­ Many traditional approaches that are based on the maximization
ture and needs of the different types of sports (Bergkamp, Niessen, den through optimization principle attempt to cope with the significant limi­
Hartigh, Frencken & Meijer, 2018). However, there exists a degree of tation of human JDM, namely mis-aggregation. More specifically, it
variability for the predictive value of different factors for later success seems that due to cognitive overload, people confronted with JDM-tasks
within a sport. For example Cripps, Banyard, Woods, Joyce and Hopper often encounter substantial difficulties in aggregating (i.e., weighting
(2020) couldn’t find a significant predictive value of any physical and and combining) information. Therefore, many of the decision aids that
anthropometric characteristics for career attainment in soccer, whereas have been traditionally proposed reflect the ancient Roman concept of
(Höner, Murr, Larkin, Schreiner & Leyhr, 2021) reported a high pre­ divide et impera (i.e., divide and rule). According to this concept, larger
dictive value for sprint, tactical skills, and dribbling. In addition, the concentrations of power are divided into less-powerful chunks that are
term talent seems to be "a complex and largely misunderstood phe­ easier to conquer and control. Slovic, Fischhoff and Lichtenstein
nomenon lacking robust research evidence" (Till & Baker, 2020, p. 1). ((1977)) named this strategy decomposition, implying that a decision aid

3
M. Bar-Eli et al. Asia Journal of Sport and Exercise Psychology 4 (2024) 1–6

breaks down an entire problem into smaller, structurally related ele­ or no regard for how time-consuming or informationally greedy these
ments. The decision maker is then requested to provide estimates models may be […]. In contrast, bounded rationality suggests designing
regarding only a smaller (if possible, the smallest) number of compo­ models specifically to reflect the peculiar properties and limits of the mind
nents that are simpler to handle, compared to the original much larger and the environment. The decision maker is bounded in time, knowledge
problem. Later, these estimations are combined, in order to make the and computational power. In addition, each environment has a variety of
overall decision, often with the help of computer models (Bar-Eli & irregular informational structures, such as departures from normality (p.
Tenenbaum, 2012). 560).
In their classic article, Slovic and Lichtenstein (1971) present two
However, what if by increasing computational power and sophisti­
approaches to the operationalization of the decomposition strategy,
cation, computers will be able to appropriately address such "greediness"
namely multiple linear regression (e.g., bootstrapping) and Bayesian
in terms of time and information? Like any other new technology (such
models. When comparing the performance of these approaches to that of
as smartphones or cars), it may be expensive to utilize at first, yet as it
fast and frugal heuristics in JDM, linear regression did not present better
becomes more widely available to the public, its cost could greatly
outcomes (even worse, in some cases); the Bayesian models were found
decrease. It should be noted that about 50 years ago, Slovic and Lich­
to be slightly more accurate (e.g., Gigerenzer et al., 2002). Accordingly,
tenstein (1971) showed that if experts are provided with the opportunity
the following argument may arise: in the strive to maximize utilities,
to express their expertise in the right way, as per the decomposition
why attempt to optimize decisions by investing great effort and re­
principle (through bootstrapping, for example), forecasts may become
sources in complex expensive JDM models, when a relatively simple
substantially better – especially if the said decision makers undergo
"cheap" heuristic can deliver reasonably close results?
training, just as weather forecasters do (Slovic et al., 1977; Tetlock &
We are by no means against the notion of implementing fast and
Gardner, 2015). In addition, due to the swift development of computer
frugal heuristics in the context of talent-selection decisions in sport.
technologies, Bayesian methods can be better used to dynamically up­
Paradoxically, this would mean using this descriptive approach in a
date the (evaluated) probability of a talented athlete’s success (Bar-Eli &
rather normative/prescriptive way (as it leads to good enough decisions
Tenenbaum, 2012).
that are the best a person can make). The question is whether sport
Such improvements in human forecasting processes could also help
scientists are already at the stage where the notion of maximization
overcome certain cognitive biases, illusions, and twisted perceptions
through optimization should be abandoned in favor of prediction and
that influence JDM regarding the athlete’s potential. According to
selection models that are based on bounded rationality. In our opinion,
Johnston and Baker (2020), talent "wastage" may increase due to per­
there are at least two aspects that should be taken into consideration
sonal preferences, beliefs, intuition, framing, endowment, illusive con­
before we turn to fast and frugal heuristics:
fidence, time for making predictions, and primacy – which constitute
First, existing models should be improved and optimized by
many of the biases that are investigated by heuristics and biases traditions
including more and more data – a goal that can be greatly promoted
(Kahneman, 2013). One means for overcoming such cognitive biases in
using the continuously increasing computer capabilities. An example of
selection decisions in sport could be the de-biasing of the experts who
this direction can be seen in the work of Elitzur (2020) on the effect of
are involved in the process (Fischhoff, 1982). Eliminating the legitimacy
data analytics in Major League Baseball. This researcher maintains that
of optimal models as benchmarks (Gigerenzer et al., 2002) and replacing
data analytics has seen resurgence over the past two decades, following
them with concepts such as fast and frugal heuristics and adaptive ratio­
movies such as Moneyball (Lewis, 2003), which exposed the public to
nality (Gigerenzer, 2000, 2004; Raab, 2012, 2021) could also offer a
how advanced baseball analytics were used by the Oakland Athletics
positive alternative. However, if we do recognize that talent-selection
baseball team to successfully improve player selection and game man­
decisions may legitimately use unbounded rationality that is operation­
agement. Using rather complex econometric models, the researcher was
alized through optimal decomposition models (e.g., regression/boot­
able to examine whether the organizational knowledge of baseball data
strapping or Bayesian models), then the door is open for utilizing
analytics provides advantages in the competitive Major League Baseball
big-data analyses (e.g., Elitzur, 2020; Morgulev, Azar & Lidor, 2018) –
marketplace, in terms of pay and performance over time (yes, it did),
as a means for maximizing the accuracy of talent-selection decisions
and whether this strategic advantage was sustained once this pro­
regarding the athletes’ professional future. In this regard, and to support
prietary organizational knowledge became public (no, it was not).
JDM processes, implementing machine-based approaches using big-data
Talent-selection decisions could also benefit from such developments (as
analyses could be beneficial (Johnston & Baker, 2020).
demonstrated later in this article). It should be emphasized, however,
that such a multivariate approach to talent selection should be used
"Built-in" limitations in sport-selection decisions from a JDM
wisely and with caution (see Baker et al., 2017, Proposition 5).
perspective
Furthermore, it would also require a major revision in coaches’ and
managers’ education, in order to effectively expose them to rich and
Even if we were to insist on introducing an optimal-maximal JDM
complex databases, after having taught them how to use such data in a
approach (see Bar-Eli et al., 2006) to talent-selection decisions in sport,
case where they already feel somewhat overloaded by much simpler and
we would have to recognize a number of major inherent limitations,
"easy-to-digest" scientific knowledge (as noted, for example, in Ferguson
some of which are related to the three major challenges for optimizing
& Moritz, 2015).
talent selection in sport, addressed by Till and Baker (2020) and dis­
Moreover, human forecasting processes should be improved (Tetlock
cussed above. Human experts – as well as equations – use common
& Gardner, 2015). While human experts may be specialists in their
models relating to skills, such as shared mental models (Gentner &
respective subject matter, they may not necessarily be specialists in
Stevens, 1983; Rouse & Morris, 1986). To illustrate the problematics of
forecasting. Moreover, they may also be subject to bias. Yet such biases
such models, Baker et al. (2017, 2019) introduce the example of Usain
are not recognized by Gigerenzer et al. (2002), who as per their inter­
Bolt: in the pre-Bolt era, talent selection in sprinting largely focused on
pretation of the bounded rationality concept (Simon, 1987, 1990) believe
step frequency, while above-average height was considered a drawback.
that benchmark models of the optimality and rationality traditions, that
Today, however, evidence shows that both step frequency and step length
strive for maximization, are not necessarily better than models that are
explain elite performance in the 100-m sprint, and as such – both vari­
based on principles of simplicity and frugality:
ables now play a role in selection procedures. Similarly, in the 1960s,
The fundamental distinction in approaches to reasonableness is between Valeriy Brumel dominated the high jump, and his perfect performance of
unbounded rationality and bounded rationality […]. Unbounded ratio­ the Straddle technique was considered the benchmark or gold standard.
nality suggests building models that perform as well as possible with little Dick Fosbury, however, was unable to perform this technique (mainly

4
M. Bar-Eli et al. Asia Journal of Sport and Exercise Psychology 4 (2024) 1–6

since he was too tall); instead, he developed the Fosbury Flop, that led negatives) or loss (or waste) of potentially talented athletes (Johnston &
him to eternal fame and glory in the 1968 Olympics, while revolution­ Baker, 2020), who may have been selected and succeeded had they been
izing the track-and-field establishment at that time (Bar-Eli, 2018; a part of a relatively small selection space.
Welch & Fosbury, 2018). When addressing talent-selection processes, a country’s judgment
Additional athletes who excelled in sport, despite performing and DM strategy may simply depend on its size and on the prioritizing of
differently than as per the existing models, include Dirk Nowitzki and the ruling authorities. For example, in the small former German Dem­
his unorthodox coach, Holger Geschwindner, who not only changed the ocratic Republic, athletes were selected like pilots are in Israel. In this
role of the power forwards in basketball, but also the science and practice of respect, Johnston and Baker (2020) also address the political and
coaching in general; and finally, Sergei Bubka, the legendary Ukrainian policy-related issues that the selection systems operate in (also see our
pole vaulter, who dominated this sport for many years, after revolu­ above discussion on resource allocation and the necessity of soccer
tionizing this field and being perceived as a role model who was fol­ academies).
lowed by generations of pole vaulters.
Coaches often share mental models regarding how things should be The rationale for adopting the big-data approach – the feudal
performed (and are confident that they are correct; see Johnston & glove of talent-selection decisions
Baker, 2020). In other words, they are taught to produce more Brumels in
high jumping and more Bubkas in pole vaulting (i.e., athletes who In the previous sections of this article, we address the advantages and
optimize in order to maximize). However, who would have predicted black challenges of the various approaches that view talent-selection decisions
swans (Taleb, 2010), such as Fosbury in the high jump or Nowitzki in as JDM; we now strongly argue for incorporating big data in selection-
basketball? It seems that some athletes excel precisely because they do decision processes in sport, as a mean for improving prediction accu­
not perform in line with these optimizing models that everybody else racy regarding talent selection. This sport analytics approach of big data
uses; for example, by being creative and inventing a "moneyball" that refers to (a) the management of structured historical data related to the
outdoes the existing system (Elitzur, 2020). athlete or team; (b) the application of predictive analytic models that use
To develop talent, you must give room to creativity (Bar-Eli et al., these data, and (c) the implementation of information systems in order
2006); however, how can you – as a teacher or a coach – give room to to provide decision makers (e.g., coaches and scouts) with relevant data,
something that you are not even aware of? By definition, talent-selection as a mean for increasing the accuracy rate of their selection decisions (e.
decisions will always include a certain degree of uncertainty, i.e., as­ g., Morgulev et al., 2018; Winston, Nestler & Pelechrinis, 2022). Such
pects that we are unaware of. Dean Benson, Fosbury’s coach, is reported historical data can be collected from various sources, including bio­
to have forgone certain traditional training methods that were prevalent graphical data, videos, box-score performance, medical reports, and
at the time (Welch & Fosbury, 2018); pleased by Fosbury’s success, scouting reports. These data – both qualitative and qualitative – can be
Benson encouraged him to continue and succeed – even though he "was standardized, centralized and integrated, and analyzed using different
not sure exactly what Fosbury was doing" (Bar-Eli, 2018, p. 203). metrics (Alamar, 2013). Qualitative data, such as coaches’ assessments
and scouts’ reports, combined with modern statistical projections, could
Situational factors and developmental systems lead to more accurate assessments of the athlete’s future performance.
Large databases, which are currently available in many individual and
Talent-selection decisions – in all domains – are strongly impacted by team sports, combined with the reliable and systematic means of anal­
situational factors (Johnston & Baker, 2020), such as the conditions ysis, will provide professionals with a unique opportunity for strength­
where the selection process takes place. Take for example the ening the validity of their DM processes, based on a larger range of
pilot-training system in the Israeli Air Force, where the selection strategy performance variables.
of potential pilots is: If you have doubts, then there is no doubt (i.e., the This is not to say that we oppose the idea of using fast and frugal
answer is “no”). In other words, as a "selector" or instructor, you must heuristics – paradoxically, in a somewhat prescriptive way – for
avoid false positives – where selected individuals do not succeed – at all capturing the coach’s eye in terms of satisfactory, bounded rational de­
costs (Bar-Eli, 2018). Regarding the quality of decisions made via the cisions. Rather, combining different approaches may assist professionals
selection system, weak correlations have been found between the time of who are involved in selection decisions in sport in identifying the
the initial selection and future performance (as well as the infinite se­ "winner of the duel" that begins with the feudal glove being thrown at
lection space – the available manpower) (Bar-Eli, 2018). The only way to one another. In this regard, we concur with Gigerenzer et al. (2002)
decrease false positives is to broaden the acceptance criteria, which will statement whereby optimization and fast and frugal heuristics could, in
also increase false negatives – where de-selected individuals could have principle, live side by side – depending on the specific circumstances
succeeded had they been given the chance. The price of a false negative, under which the actual talent-selection decision is conducted (Sie­
however, is zero – as long as all the pilots who complete their training ghartsleitner et al., 2019). This article, therefore, aimed at contrasting
are the best that Israel could have produced at that point in time – and combining these different approaches in relation to current
positive hits. The price of a false positive, on the other hand, could be fatal. research, as a means for potentially contributing to the field of talent
In contrast, as the selection space within the Armored Corps in the research in sport by enhancing the multi-faceted aspects that are
Israel Defense Force is not infinite, and as such, candidates cannot be de- entailed in the selecting, identifying, and developing of talented
selected following (small) doubts. This is because each tank needs to athletes.
house four soldiers, and the selection space (i.e., the available
manpower) is limited. In this case, the system must strive to exhaust
Declaration of Competing Interest
every possible option of candidates, which can only be achieved by
increasing the above-mentioned correlations, through the expanding of
The authors declare that they have no known competing financial
the selection process, rather than simply relying on the initial accep­
interests or personal relationships that could have appeared to influence
tance criteria.
the work reported in this paper.
From some perspectives, the selection system in the Israeli Air Force
is similar to those seen in sport selection in countries with large pop­
ulations, such as China or the USA. In these countries, top athletes can be References
identified and selected with greater ease – thanks to the very large
Alamar, B. C. (2013). Sport analytics – a guide for coaches, managers, and other decision
number of prospective athletes. In smaller countries, selection must be makers. Columbia University Press.
conducted with much greater caution – to prevent dropouts (i.e., false Baker, J. (2022). The tyranny of talent. Aberrant Press.

5
M. Bar-Eli et al. Asia Journal of Sport and Exercise Psychology 4 (2024) 1–6

Baker, J., Schorer, J., & Wattie, N. (2017). Compromising talent: Issues in identifying and Talent identification and development in sport – international perspectives (2nd ed., pp.
selecting talent in sport. Quest (Grand Rapids, Mich.), 70, 48–63. 50–65). Routledge.
Baker, J., Wattie, N., & Schorer, J. (2019). A proposed conceptualization of talent in Lath, F., Koopmann, T., Faber, I., Baker, J., & Schorer, J. (2021). Focusing on the coach’s
sports: The first step in a long and winding road. Psychology of Sport and Exercise, 43, eye: Towards a working model of coach decision-making in talent selection.
27–33. Psychology of Sport and Exercise, 56. https://doi.org/10.1016/j.
Bar–Eli, M. (2018). BOOST! How the psychology of sports can enhance your performance in psychsport.2021.102011
management and work. Oxford University Press. Lath, F., Koopmann, T., & Schorer, J. (2022). Searching for the best: A first theory-driven
Bar-Eli, M., Lowengart, O., Master-Barak, M., Oreg, S., Goldenberg, J., Epstein, S., et al. experimental study of the information search in talent selection. In The 16th
(2006). Developing peak performance in sports: Optimization versus creativity. D. European Congress of Sport and Exercise Psychology. Padova.
Hackfort & G. Tenenbaum (Eds.). Essential processes for attaining peak performance Lewis, M. (2003). Moneyball: The art of winning an unfair game. Norton.
(pp. 158–177). Meyer & Meyer Sport. Leyhr, D., Bergmann, F., Schreiner, R., Mann, D., Dugandzic, D., & Höner, O. (2021).
Bar-Eli, M., & Tenenbaum, G. (2012). Bayesian approach of measuring competitive crisis. Relative age-related biases in objective and subjective assessments of performance in
G. Tenenbaum, R.C. Eklund, & A. Kamata (Eds.). Measurement in sport and exercise talented youth soccer players. Frontiers in Sports and Active Living, 3. https://doi.org/
psychology (pp. 367–379). Human Kinetics. 10.3389/fspor.2021.664231
Bergkamp, T. L. G., Niessen, A. S. M., den Hartigh, R. J. R., Frencken, W. G. P., & Lidor, R., Côté, J., & Hackfort, D. (2009). To test or not to test? – The use of physical skill
Meijer, R. R. (2018). Comment on: "Talent identification in sport: A systematic tests in talent detection and in early phases of sport development. International
review". Sports Medicine, 48, 1517–1519. https://doi.org/10.1007/s40279-018- Journal of Sport and Exercise Psychology, 7, 131–146.
0868-6 Malloy, S. (2011). The art of scouting. Wiley.
Bergkamp, T. L., Niessen, A. S. M., Den Hartigh, R. J., Frencken, W. G., & Meijer, R. R. Morgulev, E., Azar, O., & Lidor, R. (2018). Sports analytics and the big-data era.
(2019). Methodological issues in soccer talent identification research. Sports International Journal of Data Science and Analytics. https://doi.org/10.1007/s41060-
Medicine, 49, 1317–1335. 017-0093-7
Calvin, M. (2013). The nowhere men. Arrow Books. Raab, M. (2012). Simple heuristics in sports. International Review of Sport and Exercise
Cripps, A. J., Banyard, H. G., Woods, C. T., Joyce, C., & Hopper, L. S. (2020). Does the Psychology, 5, 104–120.
longitudinal development of physical and anthropometric characteristics associate Raab, M. (2021). Judgment, decision making and embodied choices. Elsevier.
with professional career attainment in adolescent Australian footballers? Rees, T., Hardy, L., Güllich, A., Abernethy, B., Côté, J., Woodman, T., et al. (2016). The
International Journal of Sports Science & Coaching, 15, 506–511. https://doi.org/ Great British Medalists Project: A review of the current knowledge on the
10.1177/1747954120927117 developemnt of the world’s best sporting talent. Sports Medicine, 46, 1041–1058.
Elitzur, R. (2020). Data analytics effects in major league baseball. Omega, 90, Article Remmele, B. (2003). Die Entstehung des Maschinen-paradigmas (the rise of the machine-
102001. paradigm). Leske & Budrich.
Ericsson, K. A., & Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87, Roberts, A. H., Greenwood, D. A., Stanley, M., Humberstone, C., Iredale, F., & Raynor, A.
215–251. https://doi.org/10.1037/0033-295X.87.3.215 (2019). Coach knowledge in talent identification: A systematic review and
Ferguson, A., & Moritz, M. (2015). Leading. Hachette. etasynthesis. Journal of Science and Medicine in Sport, 18. https://doi.org/10.1016/j.
Fischhoff, B. (1982). Debiasing. D. Kahneman, P. Slovic, & A. Tversky (Eds.). Judgment jsams.2019.05.008
under uncertainty: Heuristics and biases (pp. 422–444). Cambridge University Press. Robertson, I. T., & Smith, M. (2001). Personnel selection. Journal of Occupational and
Gentner, D., & Stevens, A. (1983). Mental models. Erlbaum. Organizational Psychology, 74, 441–472.
Ghiselli, E. E., & Brown, C. W. (1955). Personnel and industrial psychology. McGraw-Hill. Rouse, W., & Morris, N. (1986). On looking into the black box: Prospects and limits in the
Gigerenzer, G. (2000). Adaptive thinking: Rationality in the real world. Oxford University search of mental models. Psychological Bulletin, 100, 349–363.
Press. Schorer, J., Rienhoff, R., Fischer, L., & Baker, J. (2017). Long term prognostic validity of
Gigerenzer, G. (2004). Fast and frugal heuristics: The tools of bounded rationality. D. & talent selections: Comparing national and regional coaches, laypersons and novices.
J. Koehler & N. Harvey (Eds.). Blackwell handbook of judgment and decision making Frontiers in Psychology, 8, 1146.
(pp. 62–88). Blackwell. Sieghartsleitner, R., Zuber, C., Zibung, M., & Conzelmann, A. (2019). Science or coaches’
Gigerenzer, G., Czerlinski, J., & Martignon, L. (2002). How good are fast and frugal eye? – both! Beneficial collaboration of multidimensional measurements and coach
heuristics?. T. Gilovich, D. Griffin, & D. Kahneman (Eds.). Heuristics and biases: The assessments for efficient talent selection in elite youth football. Journal of Sports
psychology of intuitive judgment (pp. 559–581). Cambridge University Press. Science & Medicine, 18, 32–43.
Gigerenzer, G., & Goldstein, D. G. (1996). Reasoning the fast and frugal way: Models of Siemon, D., & Wessels, J. (2022). Performance prediction of basketball players using
Bounded rationality. Psychological Review, 103, 650–669. automated personality mining with twitter data. Sport, Business and Management.
Guion, R. M. (1965). Personnel testing. McGraw-Hill. An International Journal. https://doi.org/10.1108/sbm-10-2021-0119
Hoberman, J. M. (1992). Mortal engines: The science of performance and dehumanization of Simon, H. A. (1987). Bounded rationality. J. Eatwell, M. Milgate, & P. Newman (Eds.).
sport. Free Press. The new palgrave: A dictionary of economics (pp. 266–268). Macmillan.
Höner, O., Murr, D., Larkin, P., Schreiner, R., & Leyhr, D. (2021). Nationwide subjective Simon, H. A. (1990). Invariants of human behavior. Annual Review of Psychology, 41,
and objective assessments of potential talent predictors in elite youth soccer: An 1–19.
investigation of prognostic validity in a prospective study. Frontiers in Sports and Slovic, P., Fischhoff, B., & Lichtenstein, S. (1977). Behavioral decision theory. Annual
Active Living, 3, Article 638227. https://doi.org/10.3389/fspor.2021.638227 Review of Psychology, 28, 1–39.
Jekel, M., Glöckner, A., & Bröder, A. (2018). A new and unique prediction for cue-search Slovic, P., & Lichtenstein, S. (1971). Comparison of Bayesian and regression approaches
in a parallel-constraint satisfaction network model: The attraction search effect. to the study of information processing in judgment. Organizational Behavior and
Psychological Review, 125. https://doi.org/10.1037/rev0000107 Human Performance, 6, 649–744.
Johnston, K., & Baker, J. (2020). Waste reduction strategies: Factors affecting talent Taleb, N. N. (2010). The black swan: The impact of the highly improbable. Random House.
wastage and the efficacy of talent selection in sport. Frontiers in Psychology, 10, 2925. Tetlock, P. E., & Gardner, D. (2015). Superforecasting. Random House.
https://doi.org/10.3389/fpsyg.2019.02925 Till, K., & Baker, J. (2020). Challenges and [possible] solutions to optimizing talent
Johnston, K., Wattie, N., Schorer, J., & Baker, J. (2018). Talent identification in sport: A identification and development in sport. Frontiers in Psychology, 11, 664.
systematic review. Sports Medicine, 48, 97–109. https://doi.org/10.1007/s40279- Vinchur, A. J., & Brian, L. L. K. (2012). A history of personnel selection and assessment.
017-0803-2 In N. Schmitt (Ed.). Oxford handbook of personnel assessment and selection (pp. 9–30).
Kahneman, D. (2013). Thinking fast and slow. Farrar, Straus & Giroux. Oxford University Press.
Koopmann, T., Faber, I., Baker, J., & Schorer, J. (2020). Assessing technical skills in Welch, B., & Fosbury, D. (2018). The wizard of Foz – Dick Fosbury’s one-man high-jump
talented youth athletes: A systematic review. Sports Medicine, 50, 1593–1611. revolution. Skyhorse Publishing.
Kahn, O. (2008). Ich: Erfolg kommt von Innen (I: Success comes from within). Riva. Williams, A. M., & Reilly, T. (2000). Talent identification and development in soccer.
Koz, D., Fraser-Thomas, J., & Baker, J. (2012). Accuracy of professional sports drafts in Journal of Sports Sciences, 18, 657–667.
predicting career potential. Scandinavian Journal of Medicine and Science in Sports, 22, Winston, W. L., Nestler, S., & Pelechrinis, K. (2022). Mathletics – how gamblers, managers,
e64–e69. and fans use mathematic in sports (2nd ed.). Princeton University Press.
Lath, F., den Hartigh, R., Wattie, N., & Schorer, J. (2021). Talent selection: Making
decisions and prognoses about athletes. J. Baker, S. Cobley, & J. Schorer (Eds.).

You might also like