The Concept of Validity

Validity

→
→

→ Inferences
→ Strategies
→

→
Ecological Validity

→
→ ecological momentary assessment

Validation

Face Validity
Local Validation Studies
Face Validity
→

→
→

E.g., Inkblots to measure personality =  face validity;

Trinitarian View personality test that ask about how introverted or
extroverted a person is =  face validity
Content Validity →

Criterion-Related Validity →
→

→
Construct Validity

→
 Content Validity Valid

Content Validity
Uncontaminated

Concurrent Validity
→

test blueprint
Predictive Validity

CONCURRENT VALIDITY

Concurrent Validity
→ blueprint

→
Criterion-Related Validity

Criterion-Related Validity →

→ Validating Criterion
Criterion

E.g., a test score, a specific behavior or group of PREDICTIVE VALIDITY

behaviors, an amount of time, a rating, a
Predictive Validity
psychiatric diagnosis, etc.
→

→
Relevant
→ →

→ →

→ Validity coefficient squared

→ Base Rate

→ Hit Rate
INCREMENTAL VALIDITY

Incremental Validity

→ Miss Rate

E.g., Medical practitioner is more likely to correctly

→ False Positive diagnose a kidney infection if a urine test is ordered,
rather than relying on a physical examination and
discussion of symptoms alone.

Construct Validity
→ False Negative
Construct Validity

Construct
→

→ →

→
VALIDITY COEFFICIENT

Validity Coefficient the

→
→
 →

Evidence of Homogeneity

EVIDENCE OF PRETEST–POSTTEST CHANGES

Evidence of Changes with Age
Evidence of Pretest–Posttest Changes

Evidence of Pretest–Posttest Changes

→

Known-Group Validity
→

Convergent and Discriminant Validity

KNOW-GROUP VALIDITY

Know-Group Validity

EVIDENCE OF HOMOGENEITY → method of contrasted groups

Homogeneity →

→
→

→ →
CONVERGENT VALIDITY

Convergent Validity

EVIDENCE OF CHANGES WITH AGE

Evidence of Changes with Age

→

→
→
→ Confirmatory Factor Analysis

→ Factor Loading

DISCRIMINANT VALIDITY Validity, Bias, & Fairness

Discriminant Validity →

TEST BIAS
→
Test Bias

→
→

Rating Error
→

Rating

FACTOR ANALYSIS
rating scale
→

Leniency or Generosity Error

Factor Analysis

Severity Error

Central Tendency Error

→ Rankings
→

Exploratory Factor Analysis – it

→
Halo Effect →

→
Relationship between Reliability
and Validity
Proximity Errors →

→ → 𝑟12𝑚𝑎𝑥

→
𝒓𝟏𝟐𝒎𝒂𝒔 = √𝒓𝟏𝟏 𝒓𝟐𝟐

Where 𝒓𝟏𝟏 𝒓𝟐𝟐

→ Order Effect
Primacy Effect or First Impression
→

Contrast Effect

Similarity Error

Negative-Information Bias

TEST FAIRNESS

Test Fairness