Download as pdf or txt
Download as pdf or txt
You are on page 1of 11

Use of Partial Least Squares (PLS) in Strategic Management Research: A Review of Four Recent

Studies
Author(s): John Hulland
Source: Strategic Management Journal, Vol. 20, No. 2 (Feb., 1999), pp. 195-204
Published by: Wiley
Stable URL: http://www.jstor.org/stable/3094025
Accessed: 12-02-2016 10:16 UTC

Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at http://www.jstor.org/page/
info/about/policies/terms.jsp

JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content
in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship.
For more information about JSTOR, please contact support@jstor.org.

Wiley is collaborating with JSTOR to digitize, preserve and extend access to Strategic Management Journal.

http://www.jstor.org

This content downloaded from 128.210.126.199 on Fri, 12 Feb 2016 10:16:39 UTC
All use subject to JSTOR Terms and Conditions
Strategic Management Journal
Strat. Mgmt. J., 20: 195-204 (1999)

USE OF PARTIALLEAST SQUARES (PLS) IN


STRATEGICMANAGEMENTRESEARCH:A REVIEW
OF FOUR RECENTSTUDIES
K JOHN HULLAND*
Richard Ivey School of Business, The University of Western Ontario, London,
Ontario, Canada
x

Advances in causal modeling techniques have made it possible for researchers to simultaneously
examine theory and measures. However, researchers must use these new techniques appropri-
ately. In addition to dealing with the methodological concerns associated with more traditional
methods of analysis, researchers using causal modeling approaches must understand their
underlying assumptions and limitations.
Most researchers are well equipped with a basic understandingof LISREL-typemodels. In
contrast, current familiarity with PLS in the strategic management area is low. The current
paper reviewsfour recent studies in the strategic managementarea which use PLS. The review
notes that the technique has been applied inconsistently, and at times inappropriately, and
suggests standards for evaluating future PLS applications. Copyright ? 1999 John Wiley &
Sons, Ltd.

Advances in causal modelling techniques have relationships; (3) they permit a more complete
made it possible for researchers to simultaneously representation of complex theories; and (4) they
examine theory and measures. Such techniques provide a formal framework for constructing and
can be thought of as superior to more traditional testing both theories and measures.
techniques (e.g., multidimensional scaling, factor The best-known causal modeling technique is
analysis) in that they permit: (1) the explicit LISREL (Joreskog and Sorbom, 1989; Hagedoor
inclusion of measurement error, and (2) an ability and Schakenraad, 1994). However, LISREL is
to incorporate abstract and unobservable con- poorly suited to deal with small data samples
structs (Fornell, 1982). Bagozzi (1980) suggests (Forell, 1982), and can yield nonunique or
that causal models provide researchers with four otherwise improper solutions in some cases
key benefits: (1) they make the assumptions, (Forell and Bookstein, 1982). An alternative
constructs, and hypothesized relationships in a causal modeling approach known as Partial Least
theory explicit; (2) they add a degree of precision Squares (PLS) has been developed to avoid some
to a theory, since they require clear definitions of these limitations (Wold, 1974, 1985), although
of constructs, operationalizations, and functional use of PLS requires its own set of assumptions.
PLS has been used both in other business disci-
plines (e.g., Duxbury and Higgins, 1991; Hulland
Key words: causal modeling; measurementissues; and Kleinmuntz, 1994; Smith and Barclay, 1997;
partialleast squares;strategicmanagementresearchis- Zinkhan, Joachimsthaler, and Kinnear, 1987) and
sues in the strategic management area to examine risk-
* Correspondence to: John Hulland, Richard Ivey School of
Business , The University of Western Ontario, London, Onta- return outcomes (Cool, Dierickx,
and Jemison,
rio N6A 3K7, Canada 1989), cooperative ventures (Fornell, Lorange,

CCC0143-2095/99/020195-10 $17.50 Received 4 November 1996


Copyright? 1999 JohnWiley & Sons, Ltd. Final revision received 7 April 1998

This content downloaded from 128.210.126.199 on Fri, 12 Feb 2016 10:16:39 UTC
All use subject to JSTOR Terms and Conditions
196 J. Hulland

and Roos, 1990), global strategy (Johansson and Conceptual model specification
Yip, 1994), and global integration (Birkinshaw,
Morrison, and Hulland, 1995).' The studies by Birkinshaw et al., Cool et al.,
While techniques such as LISREL and PLS and Fornell et al. each present and test a single
can enrich existing methodological approaches to conceptual model. In contrast, Johansson and Yip
conducting strategic management research, they specify (and estimate) eight different conceptual
must be used appropriately. Most researchers are models which follow five seemingly different ba-
well equipped with a basic understanding of LIS- sic forms. There is nothing inherently wrong in
REL-type models. In contrast, current familiarity making use of alternative models. Indeed, in the
with PLS in the strategic management area is early stages of theory refinement such compari-
low, making it difficult for most researchers to sons often play a critical role. However, the
properly evaluate its use by others. Exacerbating approach used by Johansson and Yip in
this problem of limited familiarity, existing appli-presenting their various models is largely ad
cations of PLS in the strategic management area hoc-it is not clear why some models have been
have used the technique inconsistently, and at included while others have not. Furthermore,their
times inappropriately. eight models can all be represented as special
To help shape future application of PLS in the cases of one of the two more general models
strategy area, the following discussion reviews shown in Figure 1.2 Thus, it would be more
use of the technique in four recent studies appropriateto first estimate the two general mod-
(Birkinshaw et al., 1995; Cool et al., 1989; For- els (i.e., 'unrestricted' Models A and B), and to
nell et al., 1990; Johansson and Yip, 1994). This then estimate each of the more specific variants
discussion is organized around two general sets (i.e., 'restricted' models). Although R2 values and
of issues: conceptual and methodological. As path coefficients from entirely different theoretical
Bagozzi (1984) noted, theory and measurement models are not directly comparable, when one
are intimately intertwined, and both must there- model is a subset of (or 'nested within') a more
fore be considered in a causal modeling context. general model the researcher can compare R2
values on the key endogenous construct(s) using
a Chow test. For Johansson and Yip's study,
CONCEPTUAL ISSUES this approach would permit direct comparisons
between Models 1, 2, 3, 4, and 6, and between
Although measures and theory are both important, Models 5, 7, and 8.
the process of model specification necessarily
begins by considering the theoretical model Construct
dimensionality
underlying a particular piece of research. That is,
the causal modeling process begins at the concep- The dimensionality of constructs is a critical con-
tual level. Many of the conceptual issues which sideration in the development of causal models.
apply to all empirical research are also relevant In many cases, researchers can correctly assume
in a causal modeling context. However, we focus that their constructs are unidimensional. However,
here on three issues that play a particularly when a particularconstruct is more properly con-
important role in causal modeling research: con- ceptualized as multidimensional (e.g., business
ceptual model specification, construct dimen- strategy according to Venkatraman, 1989),
sionality, and the distinction between constructs
and measures.
2
Specifically, Models 1, 2, 3, 4, and 6 in Johansson and Yip
(1994) are all nested within Model A shown in the figure.
For example, their Model 1 assumes that only paths 2, 7, 9,
and 10 are nonzero, Model 2 assumes that only paths 3, 6,
8, and 10 are nonzero, and Model 3 assumes that only paths
'For an excellent introduction to the use of PLS in practical 2, 3, 6, 7, 8, 9, and 10 are nonzero. Model 4 assumes that
applications, see Barclay, Higgins, and Thompson (1995). paths 1, 3, 5, 6, 7, 8, and 10 are nonzero, while Model 6
Barclay et al. also provide a thorough description of the assumes that paths 1, 3, 5, 6, 8, 10, 11, and 12 are nonzero.
objectives of PLS, the estimation process, sample size issues, Models 5, 7, and 8 are all nested within model B of the
the relative strengths and weaknesses of both LISREL and figure. Specifically, Model 5 assumes that paths 4, 5, and 6
PLS, and the availability of software. For a good discussion of are zero, Model 7 assumes that path 4 is zero, and Model 8
the model structure employed by PLS, see Cool et al. (1989). assumes that path 5 is zero.

Copyright ? 1999 John Wiley & Sons, Ltd. Strat. Mgmt.J., 20: 195-204 (1999)

This content downloaded from 128.210.126.199 on Fri, 12 Feb 2016 10:16:39 UTC
All use subject to JSTOR Terms and Conditions
Review of PLS Use in Strategic Management Research 197

ModelA

Mode B
7

Figure1. Two comprehensiveconceptualmodels encompassingall eight models estimatedin Johanssonand


Yip

researchers' causal models should include sepa- these four drivers could have a different impact
rate constructs representing each of these dimen- on the other constructs (e.g., global strategy).
sions. However, in the empirical section of their paper,
In general, the four studies reviewed here Johansson and Yip ignore these distinctions, using
assume and use construct unidimensionality. instead a single, higher order (but conceptually
However, an interesting contrast in approaches to undefined) 'industry drivers' construct. In con-
this issue of dimensionality can be seen by com- trast, Birkinshaw et al. include three separate
paring the treatments of the industry structure 'driver' constructs in their model in order to
construct by Johansson and Yip and by Birkin- look at their individual effects on other strategic
shaw et al. Early discussion of their constructs constructs. This latter approach is more consistent
by Johansson and Yip (1994: 580-582) strongly with existing theory while also yielding superior
suggests that industry structure, global strategy, empirical results.
organization structure, management processes,
and performance are all multidimensional. For
Constructs versus measures
example, they clearly identify four separate and
distinct 'drivers' in their discussion of the indus- Although related to one another, constructs and
try structure construct (i.e., government drivers, measures are distinct entities (Bagozzi, 1984).
cost drivers, market drivers, and competitive Much of the work in the four studies reviewed
drivers). Intuitively, it seems likely that each of here properly separates the theoretical and empiri-
Copyright? 1999 John Wiley & Sons, Ltd. Strat. Mgmt. J., 20: 195-204 (1999)

This content downloaded from 128.210.126.199 on Fri, 12 Feb 2016 10:16:39 UTC
All use subject to JSTOR Terms and Conditions
198 J. Hulland

cal planes. However, there are two exceptions be assessed by looking at: (1) individual item
worthy of further discussion. First, although reliabilities, (2) the convergent validity of the
Birkinshaw et al. provide theoretical definitions measures associated with individual constructs,
for their constructs, two (economies of scale and and (3) discriminant validity.
differences in comparative advantage) are meas-
ured empirically by only single items. From a
Item reliability
causal modeling perspective, these measures and
their associated constructs must be viewed as In PLS, individual item reliability is assessed by
interchangeable. Clearly, it is more appropriateto examining the loadings (or simple correlations)
include multiple measures for each construct. of the measures with their respective construct.
Second, Johansson and Yip are inconsistent in A rule of thumb employed by many researchers
how they deal with the effects of 'nationality' on is to accept items with loadings of 0.7 or more,
their other constructs. They appear to be ambiva- which implies that there is more shared variance
lent about whether nationality is more correctly between the construct and its measure than error
viewed as 'an additional construct' (1994: 593) or variance (e.g., Carmines and Zeller, 1979). Since
as 'a possible method bias' (p. 586), employing loadings are correlations, this implies that more
both perspectives in their model estimations. than 50 percent of the variance in the observed
Although such tentativenessis understandablein an variable (i.e., the square of the loading) is due
exploratory study, it renders moot comparisons to the construct.
between models. Researchers need to clearly sep- In practice, it is common to find that at least
arate constructs from measures in order to prop- several measurement items in an estimated model
erly test the nomological validity of both. have loadings below the 0.7 threshold, partic-
ularly when new items or newly developed scales
are employed. A low loading may be the result
METHODOLOGICAL ISSUES of: (1) a poorly worded item, (2) an inappropriate
item, or (3) an improper transfer of an item from
Three general sets of methodological consider- one context to another. The first problem leads
ations are relevant to the application of PLS in to low reliability, the second to poor content (and
a management research context: (1) assessing the construct) validity, and the last to nongeneraliz-
reliability and validity of measures; (2) determin- ability of the item across contexts and/or settings.
ing the appropriate nature of the relationships Even when the researcher has a strong theoretical
between measures and constructs; and (3) inter- rationale for including such items in his or her
preting path coefficients, determining model model, items with extremely low loadings should
adequacy, and selecting a final model from the be carefully reviewed, since they will add very
available set of alternatives. Each of these is dealt little explanatory power to the model while atten-
with below. uating (and therefore biasing) the estimates of
the parameters linking constructs (Nunnally,
1978). In general, items with loadings of less
Reliability and validity than 0.4 (a threshold commonly used for factor
Although PLS estimates parameters for both the analysis results) or 0.5 should be dropped.
links between measures and constructs (i.e., The evidence of high individual item reliability
loadings) and the links between different con- across the four studies reviewed here is somewhat
structs (i.e., path coefficients) at the same time, mixed. Although Birkinshaw et al. do not report
a PLS model is usually analyzed and interpreted individual item reliabilities, they note (1995: 647)
sequentially in two stages: (1) the assessment of that only items with 'individual factor loadings
the reliability and validity of the measurement greater than 0.6 were retained, with most greater
model, followed by (2) the assessment of the than 0.7.' Of the 18 measurement items included
structural model. This sequence ensures that the in the study by Cool et al., only one had a
researcher has reliable and valid measures of loading of less than 0.7, and it was retained for
constructs before attempting to draw conclusions sound theoretical reasons. On the other hand, four
about the nature of the construct relationships. of the 18 item loadings reported by Forell et
The adequacy of the measurement model can al. are less than 0.4, six are less than 0.5, and
Copyright? 1999 John Wiley & Sons, Ltd. Strat. Mgmt. J., 20: 195-204 (1999)

This content downloaded from 128.210.126.199 on Fri, 12 Feb 2016 10:16:39 UTC
All use subject to JSTOR Terms and Conditions
Review of PLS Use in Strategic Management Research 199

only six exceed the 0.7 threshold. Similarly, for Broadly speaking, the convergent validities of
the models reported in Johansson and Yip (1994), the constructs used by Birkinshaw et al., Cool et
about one third of the loadings consistently fall al., and Fornell et al. appear to be acceptable. In
below 0.4, whereas just over half exceed 0.7.3 contrast, most of the constructs used by Johansson
Thus, while most of the measures used in and Yip exhibit poor convergent validity. For
these four studies appear to exhibit satisfactory Models 6 and 8 (their two most preferred
individual item reliabilities, two of the four stud- models), only the measures used to assess per-
ies retained a significant number of low-reliability formance demonstrate sufficient internal consist-
items in their final analyses. Since these low ency to exceed Nunnally's 'modest' standard of
reliabilities can attenuate the estimated relation- 0.70. At the same time, two sets of measures
ships between constructs, results based on the (those representing organizational structure and
retention of low-reliability items must be inter- global strategy) exhibit extremely low internal
preted with caution. consistency (i.e., less than 0.5).
Low internal consistency can result from a
variety of underlying causes, including poor con-
Convergent validity struct definition and/or construct multi-
When multiple measures are used for an individ- dimensionality. In the first case, the faulty con-
ual construct, the researcher should be concerned struct definition severely impairs the
not only with individual measurement item determination of relevant and appropriate meas-
reliability, but also with the extent to which the ures for the construct. In the latter case, if the
measures demonstrate convergent validity. Tra- underlying construct is actually multidimensional,
ditionally, researchers using PLS have generally but it is measured using items which are assumed
reported one or both of two measures of conver- to be linked to a unidimensional construct, the
gent validity (also referred to as composite measures as a group will demonstrate poor inter-
reliability): Cronbach's alpha and the internal nal consistency. Furthermore, while some of the
consistency measure developed by Forell and individual measurement items will have strong
Larcker (1981).4 Fomell and Larcker argue that loadings linking them closely with the construct,
their measure is superior to alpha since it uses others will have loadings which are close to zero,
the item loadings obtained within the nomological or even negative in sign. In such instances, the
network (or causal model). Nonetheless, the inter- researcher should consider either splitting the
pretation of the values obtained is similar, and original construct into new constructs (each with
the guidelines offered by Nunnally (1978) can its own set of measures), or eliminating items
be adopted for both. Specifically, Nunnally sug- until only a unidimensional construct remains.
gests 0.7 as a benchmark for 'modest' composite For example, the organizational structure
reliability, applicable in the early stages of construct-as measured by Johansson and Yip-
research.5 appears to be multidimensional. To rectify this
Although it is not possible to calculate Cron- problem, they could either drop one of their
bach's alphas for the individual constructs in any measures or split the construct into two distinct
of the models reviewed here, internal consistency subconstructs.
values were determined by using the reported
loadings and Forell and Larcker's formula. Discriminant
These values are reported in column one of Table validity
1 for three of these studies. (Birkinshaw et al. The traditional methodological complement to
report internal consistency values in their Table convergent validity is discriminant validity, which
2). represents the extent to which measures of a
given construct differ from measures of other
3 In fact, one of the retained
constructs in the same model. In a PLS context,
loadings reported by Johansson
and Yip is as low as 0.08. one criterion for adequate discriminant validity is
4 Internal consistency = ((X Ay,)2) / ((E Ay,)2+ E var (e,)). that a construct should share more variance with
5
Strictly speaking, this discussion of convergent validity and its measures than it shares with other constructs
the preceding discussion of item reliability can only be applied
to measures that are reflective, rather than formative. This in a given model. To assess discriminant validity,
issue is explored more fully in the next section of this paper. Fornell and Larcker (1981) suggest the use of

Copyright ? 1999 John Wiley & Sons, Ltd. Strat. Mgmt. J., 20: 195-204 (1999)

This content downloaded from 128.210.126.199 on Fri, 12 Feb 2016 10:16:39 UTC
All use subject to JSTOR Terms and Conditions
200 J. Hulland
Table 1. Internalconsistencyand averagevarianceextractedvalues, by construct,for threepublishedstudies

Internalconsistency AVE Root AVE

Cool, Dierickx, and Jemison (1989)


Return 0.96 0.88 0.94
Risk 0.97 0.94 0.97
Organizationalfit 0.68 0.56 0.75
Operationalefficiency 0.96 0.93 0.96
Inputfactorpayments 0.94 0.88 0.94
Product-marketinvestments 0.88 0.72 0.85
Marketshare 0.98 0.96 0.98
Rivalry 0.99 0.98 0.99
Fornell, Lorange, and Roos (1990)
Internalpush 0.61 0.23 0.48
Stakeholderstrength 0.70 0.55 0.74
Analyticalscope 0.80 0.42 0.65
Performance 0.72 0.40 0.64
Johansson and Yip (1994)
Model 6
Industrydrivers 0.55 0.43 0.66
Managementprocesses 0.62 0.46 0.68
Organizationalstructure 0.24 0.42 0.65
Global strategy 0.41 0.23 0.48
Performance 0.85 0.75 0.86
Model 8
Industrydrivers 0.54 0.46 0.68
Global strategy 0.38 0.27 0.52
Managementprocesses 0.62 0.45 0.67
Organizationalstructure 0.40 0.46 0.68
Performance 0.84 0.72 0.85

Average Variance Extracted (i.e., the average Birkinshaw et al. report both average variance
variance shared between a construct and its extracted (AVE) values and inter-constructcorre-
measures).6 lations in their Table 3, providing clear evidence
This measure should be greater than the vari- of discriminant validity. For the other three stud-
ance shared between the construct and other con- ies, the table reports AVE and root AVE values
structs in the model (i.e., the squared correlation for each construct in columns two and three.7
between two constructs). This can be demon- Although none of these studies report inter-
strated in a correlation matrix which includes the construct correlations, it is possible to roughly
correlations between different constructs in the assess the discriminant validity of the constructs
lower left off-diagonal elements of the matrix, using the estimated path coefficients. For
and the square roots of the average variance example, the root AVE values reported for the
extracted values calculated for each of the con- Cool et al. study are all larger than the path
structs along the diagonal. For adequate discrim- coefficients they estimate. Likewise, the root AVE
inant validity, the diagonal elements should be
significantly greater than the off-diagonal 7Cool et al. report AVE as 'convergent validity' in their
elements in the corresponding rows and columns. Table 1. They also report 'discriminant validity' for each
construct. However, this latter measure assesses the average
squared correlation of a particular construct with all other
6
Average variance extracted = constructs in the model. Since this value will vary consider-
Ayi2/
2

ably depending on the other constructs included, it is not really


i2 + S var (,)). appropriateto compare such values to any fixed threshold. In
(I general, the approach described here is preferred.

Copyright ? 1999 John Wiley & Sons, Ltd. Strat. Mgmt.J., 20: 195-204 (1999)

This content downloaded from 128.210.126.199 on Fri, 12 Feb 2016 10:16:39 UTC
All use subject to JSTOR Terms and Conditions
Review of PLS Use in Strategic Management Research 201

values found for the Fomell et al. study all meaningful, rendering irrelevant traditional
exceed their reportedpath coefficients. Thus, it assessmentsof individualitem reliabilityand con-
is possible to conclude that discriminantvalidity vergent validity.
is adequatein both of these studies. This does not give the researchercarte blanche
Such is not the case for the studyby Johansson to arbitrarilylink sets of measuresto constructs,
and Yip. Consider the path coefficient between however. Cohen et al. (1990) suggest that when
global strategyand managementprocessesin their the relationshipis formative,researchersmust be
Model 8 (0.70). If this is taken as a roughproxy careful to employ strong theory (which helps
of the correlationbetween the two constructs, to identify appropriatemeasures) and multiple
then the off-diagonalcorrelationbetween global measures(to ensure acceptablecontent validity).
strategyand managementprocessesis greaterthan Bollen and Lennox (1991: 307) expand on this
the root AVE value for each of the constructs latterpoint by emphasizingthat researchers'need
considered on its own (i.e., 0.48, 0.68). This a census of indicators,not a sample. That is, all
implies that the constructs and their measures constructs that form [the underlying construct]
cannot be adequately discriminated,and it is should be included.'
thereforeentirely inappropriateto view them as The choice between using formativeor reflec-
distinct and separatetheoreticalentities.8 tive indicatorsfor a particularconstructcan at
times be a difficult one to make. The researcher
needs to think carefullyabout whetherit is more
Construct-measurement relationships
correct to think of the underlyingconstruct as
The nature of the links between constructsand 'causing'the observedmeasures(i.e., a reflective
measures are referredto as epistemic relation- relationship)or of the measuresas 'causing' (or
ships, or 'rules of correspondence'(Bagozzi, defining) the construct (i.e., a formative
1984; Fornell, 1982). Two basic types of epis- relationship).An example of the former might
temic relationshipsare relevantto causal mode- be performance,whereasan exampleof the latter
ling: reflectiveindicatorsand formativeindicators. might be social economic status (SES). From a
In the first case, indicators (measures) are statisticalperspective,use of formativeindicators
believed to reflect the unobserved, underlying tends to increasethe R2 value for the endogenous
construct,with the constructgiving rise to (or (i.e., predicted)constructs,althoughthis effect is
'causing') the observed measures. In contrast, usually not large. Thus, use of formative indi-
formativeindicatorsdefine (or 'cause') the con- cators tends to eliminatethe need for the exoge-
struct. A defined constructis completely deter- nous constructs,since all explanationis 'pushed'
mined by a linear combinationof its indicators. towardsthe endogenousvariables.
The discussion to this point has assumed that Whetherresearchersuse formativeor reflective
all indicatorsare reflective. When unobservable, relationshipsin their models, their choice of a
underlyingconstructsare viewed as giving rise particularform of epistemic relationshipshould
to associated measures,it is appropriateto talk be both justifiedclearly and appliedconsistently.
about item reliability and convergent validity. The studies by both Birkinshaw et al. and Cool
However,this is not necessarilytruefor formative et al. fail to describe the epistemic relationships
indicators(Bollen and Lennox, 1991; Cohen et between measures and constructs. However, it
al., 1990; MacCallum and Browne, 1993). In appears quite likely that reflective relationships
fact, formative indicatorsof the same construct were used exclusively in both studies. Conse-
'can have positive, negative, or no correlation' quently, the earlierdiscussions of reliabilityand
with one another(Bollen and Lennox, 1991: 307). validity should hold in both cases.
Consequently,observed correlationsamong the Forell et al. use both formative and reflective
measuresassociatedwith a constructmay not be relationshipsin their model. They providea clear
argument for choosing one form of epistemic
8 In fact, a quick look at the two items used by Johansson relationshipover the other for each of their four
and Yip to measure management processes-global budgeting constructs. Although it is possible to question
and global group meetings-suggests that they are likely to whether or not Fornell et al.'s choice of formative
be closely related to the three items used to measure global
strategy-standardized products, integrated competitive indicatorsis sufficientlycomplete for all of their
moves, and overall global strategy. constructs, the natures of the relationships studied
Copyright ? 1999 John Wiley & Sons, Ltd. Strat. Mgmt.J., 20: 195-204 (1999)

This content downloaded from 128.210.126.199 on Fri, 12 Feb 2016 10:16:39 UTC
All use subject to JSTOR Terms and Conditions
202 J. Hulland

are well defended. Consequently, discussions Bonett, 1980), these statistics are meaningless
about reliability and validity for the three forma- since they are based on the assumption that the
tive indicator constructs they employ are less rel- estimated model parameters are chosen in an
evant.9 attempt to minimize the difference between the
In contrast, Johansson and Yip provide an observed and the reproduced covariance matrices
incomplete justification for considering the indus- (with the latter determined using the estimated
try drivers, global strategy, organization structure, parameter values)-an assumption that is not
and management process constructs as formative warranted for PLS.
in nature, while performance is reflective. They Three of the four studies examined here report
suggest (1994: 587) that the first four of these R2 values for the endogenous constructs studied.
constructs 'combine into broad factors,' whereas These values range from a low of 12 percent
performance 'is more of an abstract perceptual (Birkinshaw et al., 1995) to a high of 64 percent
construct.' Such arguments are neither compelling (Cool et al., 1989). Although Forell et al.
nor complete. Furthermore, Johansson and Yip (1990) include three endogenous constructs in
do not consistently employ the same relationship their model, they only report an R2 value for one
form in all of their models. For example, in of these (performance). In contrast, Johansson
Models 1, 2, 3, 4, and 6 organization structure and Yip do not report R2 values. Instead, they
is viewed as a formative construct (i.e., it is claim (1994: 595) that '... the model choice can
exactly defined empirically by its measures). In focus on goodness-of-fit measures of the "inner"
contrast, in Models 5, 7, and 8 organization model ... the Bentler-Bonett statistic ... and
structure is reflective (i.e., it has surplus meaning the percent explanation of covariation among the
beyond the measures employed). Such arbitrary latent variables'. Such a claim is simply incor-
shifts between relationship forms, without justifi- rect.'0 In general, researchers employing PLS
cation, are simply unacceptable. should report R2 values for all endogenous con-
structs included in their models.
Model goodness-of-fit
LISREL and other covariance structure analysis CONCLUSION
modeling approaches involve parameter esti-
mation procedures which seek to reproduce as By combining and confronting theory with data
closely as possible the observed covariance (Forell, 1982), and by forcing researchers to
matrix. In contrast, PLS has as its primary objec- be explicit about both their measurement and
tive the minimization of error (or, equivalently, theoretical assumptions (Bagozzi, 1980, 1984),
the maximization of variance explained) in all causal models such as PLS can help strategic
endogenous constructs. The degree to which any management researchers to achieve new insights.
particular PLS model accomplishes this objective
can be determined by examining the R2 values
for the dependent (endogenous) constructs. '0 Even if the standards used to evaluate covariance structure
analysis (e.g., LISREL) models could be appropriatelyapplied
One consequence of this difference in objec- to models estimated using PLS, the results presented by
tives between LISREL and PLS is that no proper Johansson and Yip are questionable in at least two respects.
overall goodness-of-fit measures exist for models First, the choice of the Bentler and Bonett (1980) normed fit
index (NFI) as the sole arbiter of model fit is a poor one,
estimated using the latter. Although existing PLS since NFI is easily influenced by sample size and therefore
algorithms report goodness-of-fit statistics such as often biased. After carefully reviewing a wide variety of
the Bentler-Bonett normed fit index (Bentler and goodness-of-fit measures, Gerbing and Anderson (1993) rec-
ommended use of several alternative measures, but not NFI.
Second, although exact standards for evaluating goodness-of-
fit measures have not yet been formally established, various
9 Only the performance construct is modeled as reflective by pragmatic rules of thumb do exist. For example, for the NFI
Fornell et al. As the earlier discussion noted, this construct measure, researchers often suggest that a value of 0.95 or
exhibits acceptable convergent and discriminant validity. How- greater indicates a strong model, a value between 0.90 and
ever, one of the retained items has a very low loading (0.38), 0.949 indicates an adequate model, and a value of less than
and should arguably be dropped. The content validity of 0.90 indicates poor model fit (Hulland, Chow, and Lam,
some of Fornell et al.'s formative constructs (particularly 1996). Johansson and Yip report NFI values ranging from
stakeholder strength, which includes only two rather abstract 0.26 (Model 1) to 0.46 (Models 7 and 8), suggesting that
measures) can also be called into question. none of their models adequately fit the observed data.

Copyright ? 1999 John Wiley & Sons, Ltd. Strat. Mgmt.J., 20: 195-204 (1999)

This content downloaded from 128.210.126.199 on Fri, 12 Feb 2016 10:16:39 UTC
All use subject to JSTOR Terms and Conditions
Reviewof PLS Use in StrategicManagementResearch 203

Although PLS demands a level of rigor and dom on measurement: A structuralequation perspec-
tive', Psychological Bulletin, 110 (2), pp. 305-314.
clarity beyond that required by more traditional
Carmines, E.G. and R.A. Zeller, (1979). 'Reliability
methodological approaches, as the field of stra- and validity assessment'. Sage University Paper Ser-
tegic management continues to mature researchers ies on Quantitative Applications in the Social
need to increasingly rise to the challenge of Sciences, No. 07-017, Sage, Beverly Hills, CA.
meeting such demands. Cohen, P., J. Cohen, J. Teresi, M. Marchi and C. N.
Velez (1990). 'Problems in the measurement of
However, researchers must use these new tech-
latent variables in structural equations causal mod-
niques appropriately. In addition to dealing with els', Applied Psychological Measurement, 14(2),
the methodological concerns associated with more pp. 183-196.
traditional methods of analysis, researchers using Cool, K., I. Dierickx, and D. Jemison (1989). 'Business
causal modeling approaches such as LISREL and strategy, market structure and risk-return relation-
PLS must understand their underlying assump- ships: A structuralapproach', Strategic Management
Journal, 10(6), pp. 507-522.
tions and limitations. As the preceding review of
Duxbury, L.E. and C.A. Higgins (1991). 'Gender
four recent uses of PLS in the strategic man- differences in work-family conflict', Journal of
agement area shows, the technique has been Applied Psychology, 76, pp. 60-74.
applied with considerable variability. The study Fornell, C. (1982). A Second Generation of Multivari-
ate Analysis, Vol. 1. Praeger, New York.
by Cool et al. provides an excellent example for Forell, C. and F. Bookstein (1982). 'Two structural
future applications of PLS. In contrast, some
equations models: LISREL and PLS applied to con-
aspects of Johansson and Yip's use of PLS are sumer exit-voice theory', Journal of Marketing
seriously flawed, providing an important contrast Research, 19, pp. 440-452.
to the work by Cool et al. Forell, C. and D. F. Larcker (February 1981). 'Evalu-
ating structural equation models with unobservable
variables and measurement error', Journal of Mar-
keting Research, 18, pp. 39-50.
ACKNOWLEDGEMENTS Fornell, C., P. Lorange, and J. Roos (1990). 'The
cooperative venture formation process: A latent vari-
The author gratefully acknowledges the financial able structural modeling approach', Management
Science, 36(10), pp. 1246-1255.
support provided by the Social Sciences and
Humanities Research Council of Canada, the Ivey Gerbing, D. W. and J. C. Anderson (1993). 'Monte
Carlo evaluations of goodness-of-fit indices for
Business School, and the Barford Family. He structural equation models'. In K. A. Bollen and
also appreciates the thoughtful comments of two J. S. Long (eds.), Testing Structural Equation Mod-
reviewers and the editor on an earlier version of els. Sage, Newbury Park, CA. pp. 40-65.
this paper. Hagedoor, J. and J. Schakenraad, (1994). 'The effect
of strategic technology alliances on company per-
formance', Strategic Management Journal, 15(4),
pp. 291-309.
REFERENCES Hulland, J.S., Y.H. Chow and S. Lam (1996). 'Use
of causal models in marketing research: A review',
International Journal of Research in Marketing,
Bagozzi, R.P. (1980). Causal Models in Marketing.
13(2), pp. 181-197.
Wiley, New York. Hulland, J. S. and D.N. Kleinmuntz (1994). 'Factors
Bagozzi, R.P. (1984). 'A prospectusfor theory con-
struction in marketing', Journal of Marketing, 48 influencing the use of internal summary evaluations
versus external information in choice', Journal of
(Winter),pp. 11-29. Behavioral Decision Making, 7(2), pp. 79-102.
Barclay,D.W., C. Higgins and R. Thompson(1995).
'The partialleast squares(PLS) approachto causal Johansson, J.K. and G. S. Yip (1994). 'Exploiting glob-
alization potential: U.S. and Japanese strategies',
modeling:Personalcomputeradaptationand use as
an illustration',TechnologyStudies,2(2), pp. 285- Strategic Management Journal, 15(8), pp. 579-601.
309. Joreskog, K. A. and D. Sorbom (1989). LISREL 7
User's Reference Guide (1st ed.). Scientific
Bentler, P.M. and D.G. Bonett (1980). 'Significance
tests andgoodnessof fit in the analysisof covariance Software, Mooresville, IN.
structures', Psychological Bulletin, 88(3), pp. 588- MacCallum, R. C. and M. W. Browne (1993). 'The use
606. of causal indicators in covariance structure models:
Some practical issues', Psychological Bulletin,
Birkinshaw,J., A. Morrisonand J. Hulland (1995).
'Structuraland competitivedeterminantsof a global 114(3), pp. 533-541.
integration strategy', Strategic Management Journal, Nunnally, J. C. (1978). Psychometric Theory (2nd ed.).
McGraw-Hill, New York.
16(8), pp. 637-655.
Bollen, K. and R. Lennox (1991). 'Conventionalwis- Smith, J. B. and D. W. Barclay (January 1997). 'The
effects of organizational differences and trust on the

Copyright ? 1999 John Wiley & Sons, Ltd. Strat. Mgmt. J., 20: 195-204 (1999)

This content downloaded from 128.210.126.199 on Fri, 12 Feb 2016 10:16:39 UTC
All use subject to JSTOR Terms and Conditions
204 J. Hulland
effectiveness of selling partner relationships', Jour- Wold, H. (1985). 'Systems analysis by partial least
nal of Marketing, 61, pp. 3-21. squares'. In P. Nijkamp, L. Leitner, and N. Wrigley
Venkatraman, N. (1989). 'Strategic orientation of busi- (eds.), Measuring the Unmeasurable. Marinus
ness enterprises: The construct, dimensionality, and Nijhoff, Dordrecht, pp. 221-251.
measurement', Management Science, 35(8), Zinkhan, G. M., E. Joachimsthaler, and T. C. Kinnear
pp. 942-962. (May 1987). 'Individual differences and marketing
Wold, H. (1974). 'Causal flows with latent variables', decision support system usage and satisfaction',
European Economic Review, 5, pp. 67-86. Journal of Marketing Research, 24, pp. 208-214.

Copyright ? 1999 John Wiley & Sons, Ltd. Strat. Mgmt.J., 20: 195-204 (1999)

This content downloaded from 128.210.126.199 on Fri, 12 Feb 2016 10:16:39 UTC
All use subject to JSTOR Terms and Conditions

You might also like