Professional Documents
Culture Documents
Convergent Validity With Average Variance
Convergent Validity With Average Variance
Convergent Validity With Average Variance
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 1/1
Overview
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 2/1
Construct Validity
Campbell and Fiske (1959) proposed two aspects to asses the construct
validity of a test:
1 Convergent validity: is the degree of confidence we have that a trait
is well measured by its indicators.
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 3/1
Example: Two-factor CFA model
In a Confirmatory Factor Analysis convergent and discriminant validity
examine the extent to which measures of a latent variable shared their
variance and how they are different from others.
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 5/1
Average Variance Extracted (AVE)
The Average Variance Extracted (AVE) for construct ξj is defined as
follows:
Kj
∑
λ2jk
k=1
AVE ξj = Kj
∑
λ2jk + Θjk
k=1
Where:
Kj is the number of indicators of construct ξj .
λjk are factor loadings
Θjk is the error variance of the k th indicator (k = 1, ..., Kj ) of constuct ξj
Kj
∑
Θjk = 1 − λ2jk
k=1
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 6/1
Composite Reliability (CR)
The Composite Reliability (CR) for construct ξj is defined as follows:
2
Kj
∑
λjk
k=1
ρc ξ j = 2
Kj
∑
λjk + Θjk
k=1
Where:
Kj is the number of indicators of construct ξj .
λjk are factor loadings
Θjk is the error variance of the k th indicator (k = 1, ..., Kj ) of constuct ξj
Kj
∑
Θjk = 1 − λ2jk
k=1
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 7/1
Discriminant validity
AVE ξj ≥ ϕ2ij ∀i ̸= j
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 8/1
Heterotrait-Monotrait ratio
Recently, it has been proposed the Heterotrait-monotrait ratio of the
correlations (HTMT) approach to assess discriminant validity (Henseler,
Ringle & Sarstedt, 2015).
Kj
1 ∑
Ki ∑
ri ,j
Ki Kj g=1 h=1 g h
HTMTij = Kj −1 Kj
i −1 ∑
K∑ Ki ∑ ∑
2 2
rig ,ih rj ,j
Ki (Ki − 1) g=1 h=g+1 Kj (Kj − 1) g=1 h=g+1 g h
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 9/1
Heterotrait-Monotrait ratio
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 10 / 1
Heterotrait-Monotrait ratio
The HTMT is an estimate of the correlation between the constructs ξi and ξj :
HTMT values smaller than 1 show that the true correlation between the two
constructs should differ.
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 12 / 1
avecr: AVE & CR
Figure 3: avecr.sthlp
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 13 / 1
avecr: AVE & CR
Figure 4: avecr.sthlp
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 14 / 1
avecr: AVE & CR
Figure 5: avecr.sthlp
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 15 / 1
htmt: Heterotrait-Monotrait ratio
Figure 6: htmt.sthlp
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 16 / 1
htmt: Heterotrait-Monotrait ratio
Figure 7: htmt.sthlp
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 17 / 1
htmt: Heterotrait-Monotrait ratio
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 18 / 1
Example: Assessing convergent and discriminant validity in
the ADHD-R IV rating scale
Usually, the ratters are parents and teachers. However, it has not been
proven if teenagers affected with ADHD can reliably self-report on these
symptoms.
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 19 / 1
Method
Participants:
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 20 / 1
ADHD-R IV rating scale
The ADHD RS-IV scale consists of 18 items fully consistent with the list
of symptoms of ADHD criterion on the DSM-IV.
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 22 / 1
Model 0: Two-factor model with correlated factors
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 23 / 1
Model 1: Two-factor model with correlated factors and
correlated uniqueness
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 24 / 1
Model 2: Multitrait-multimethod model (MTMM)
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 25 / 1
Models Estimation and Fit
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 27 / 1
avecr for Model 2: Multitrait-multimethod model
(MTMM)
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 28 / 1
avecr for Model 2: Multitrait-multimethod model
(MTMM)
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 29 / 1
avecr for Model 2: Multitrait-multimethod model
(MTMM)
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 30 / 1
AVECR
Table 2: AVECR INDECES SUMMARIZED BY MODEL
√
Model AVE* CR AVE INAT. HYPER. STUD. FAM. TEACH.
Model 1: CFA
Model 3: MTMM**
*There was a lack of convergent validity on inattention and hyperactivity latent variables.
**MTMM model discriminate better the shared variance between. the . .latent
. . . variables.
. . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 31 / 1
htmt for Model 2: Multitrait-multimethod model (MTMM)
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 32 / 1
htmt for Model 2: Multitrait-multimethod model (MTMM)
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 33 / 1
htmt for Model 2: Multitrait-multimethod model (MTMM)
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 34 / 1
HTMT
INATTENTION
HYPERACTIVITY .677
Teacher ratings on ADHD symptoms are more discriminant and less biased
than the other methods
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 35 / 1
Conclusions
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 36 / 1
References
Campbell, D. T. & Fiske, D. W. (1959) Convergent and discriminant validation by the multitrait-multimethod matrix.
Psychological bulletin, 56-81
Fornell, C. & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error.
Journal of marketing research, 39-50.
Gomez, R.; Burns, G. L.; Walsh, J. A. & De Moura, M. A. (2003). Multitrait-multisource confirmatory factor analytic approach
to the construct validity of ADHD rating scales. Psychological Assessment, 3-15.
Henseler, Jö.; Ringle, C. M. & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based
structural equation modeling. Journal of the Academy of Marketing Science, 1-21.
Jöreskog, K. G. (1967). A general approach to confirmatory maximum likelihood factor analysis. ETS Research Bulletin Series,
183-202.
Jöreskog, K. G. (1978). Structural analysis of covariance and correlation matrices. Psychometrika, 43, 443-477.
Kenny, D. A. & Kashy, D. A. (1992). Analysis of the multitrait-multimethod matrix by confirmatory factor analysis.
Psychological Bulletin, 112-165.
Kline, R. B. (2011). Principles and practice of structural equation modeling. New York: Guilford Press. Teo, T. S. H.,
Srivastava, S. C., Jiang, L. (2008). Trust and electronic government success: an empirical study. Journal of Management
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 37 / 1
Thank you!
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 38 / 1
Assessing convergent and discriminant validity in the
ADHD-R IV rating scale:
User-written commands for Average Variance Extracted
(AVE), Composite Reliability (CR), and
Heterotrait-Monotrait ratio of correlations (HTMT).
. . . . . . . . . . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . .
David Alarcón & José A. Sánchez (UPO) Spanish STATA Meeting 2015 October 22, 2015 39 / 1