Professional Documents
Culture Documents
Kuboki's CRD-Lecture170928
Kuboki's CRD-Lecture170928
Takuo KUBOKI
Chair and Professor
Department of Oral Rehabilitation and Regenerative Medicine,
Okayama University Graduate School of Medicine, Dentistry and
Pharmaceutical Sciences
Diagnostic good
Tools
& bad
Therapy
Unreported Unreported Drop-out
drop-out Drop-out drop-out
6
Today’s Target of This Seminar:
medical/dental version of this textbook
To deliver an
internationally
recognized clinical
evidence (article) to the
world.
It is very important for
us to learn a global
standard for clinical
research.
Seven Taboos of Clinical Research
Considering study design after collecting the data
Unclear and non-specific research question (RQ)
Sampling is not systematic; no criteria of the sampling
method, inclusion and exclusion criteria
No establishment of the major outcome, no considering the
properties of variables
No evaluation of the reliability and validity of measurements
No pre-consideration of statistical analysis, sample size,
power analysis and effect size
Interpretation of the results: clinically meaningful difference
rather than statistical significance
Experi- Inter-
ment vention Observation
Subjects
Pre-experimental
design
Control Observation
△
Experi- Inter-
Subjects ment Observation vention Observation
Experi- Inter-
○
Observation Observation
Quasi- ment vention
experimental Subjects
design Control Observation Observation
Experi- Inter-
ment vention Observation
Random
Subjects Assign-
ment
Control Observation
Experimental
design Experi-
ment Observation Inter-
vention
Observation ◎
Random
Assign-
Subjects ment Control Observation Placebo Observation
Consecutive sample
Often the best option
Convenience
sample
Simple random
sample Judgmental
sample
Outcome variable
Predictor variable
Basis of Measurement
Outcome and predictor variables must
not measure the identical contents.
Un-measurable predictors in research
(i.e., genetic factor ) can be canceled in
a RCT design.
Non-randomized observational studies
(i.e., Cohort study) can not ignore the
effect of un-measurable predictors
(confounders) even if applying multiple
regression analysis.
Soft and Hard Variables
Characteristics of the Individual
Social and
Psychological Supports Economic Social and Psychological Supports
Supports
Nonmedical
Characteristics of the Environment
Factors
Evaluation of Reliability and Validity in
the Measurement
Generally, measurement reliabiliy and validity should be
checked by a preliminary study and/or other precedent
study, even in clinical examination protocol and self-
administered questionnaire.
The preliminary study sample should be equivalent to
the actual study.
Test-retest consistency
Internal consistency
Intra- and inter-examiner reliability (kappa, weighted
kappa, ICC: >0.6 acceptable, >0.8 excellent)
Validity (Specificity, Sensitivity, PPV, NPV)
Criterion-related validity, content validity
responsiveness
Precision and Accuracy
SM
0 1 2 3 1 2 3 4
LB
1 2 3 4 1 2 3 4
Process of saliva collection
Subjects: 35 students (male/female: 19/16,
mean age 25.1 yrs.)
1st Chewing paraffin wax (2 minutes)
collection Saliva collection (1 minutes)
7 minutes Incubation
2nd Chewing paraffin wax (2 minutes) (37℃)
collection Saliva collection (1 minutes)
7 minutes Dct SM (48h)
CHX mouth rinse (30 sampling
second) Dct LB (72h)
5 minutes later, distilled water
mouth rinse (30 second)
3rd CRT SM (48h)
Chewing paraffin wax (2 minutes)
collection
Saliva collection (1 minutes)
CRT LB (48h)
7 minutes
4th Chewing paraffin wax (2 minutes)
collection Saliva collection (1 minutes)
Intra-examiner reliability
1st 2nd
1st collecting
assessment assessment
saliva
Examiner Examiner
2nd collecting Dct SM
saliva #1 #1
Dct LB
CHX CRT SM
CRT LB Examiner Examiner
3 collecting
rd
#2 #2
saliva
4th collecting ⋯ ⋯
saliva
⋯ ⋯
* Combinations are 5 patterns
CHX : chlorhexidine because of 5 examiners
Intra-examiner reliability
1st 2nd
assessment assessment
1st collecting Examiner Examiner
saliva #1 #1
Examiner Examiner
2 collecting
nd
Dct SM #2 #2
saliva Dct LB
CHX CRT SM Examiner Examiner
CRT LB #3 #3
3rd collecting
saliva
Examiner Examiner
#4 #4
4th collecting
saliva Examiner Examiner
#5 #5
1
Score is matched 0
Examiner 1
2
1 0 1 4
Score is out of 1 point 1
3
4 1 0 1
Score is out of 2 point 4
4
9 4 1 0
Score is out of 3 point 9
score
Weighted Kappa Value
Reliability Parameters
More than 0.8 : Excellent
matching
More than 0.6 : Fair matching
0.4 〜 0.6 : Moderate
matching
Less than 0.4 : Unreliable
matching
(Landis and Koch, 1977)
Intra-examiner Reliability
1
0.86
0.80
0.8
Weighted kappa value
0.71
0.6
0.54
0.4
0
SM LB SM LB
Dentocult CRT
Inter-examiner reliability
1st collecting
saliva 1st 2nd
assessment assessment
2nd collecting
saliva Dct SM Examiner Examiner
Dct LB #1 #2
CHX
CRT SM
3rd collecting CRT LB
saliva Examiner Examiner
#2 #3
4th collecting
saliva ⋯ ⋯
⋯ ⋯
* Combinations are 10 patterns
CHX : chlorhexidine because of 5 examiners
Inter-examiner reliability
1st 2nd
1st collecting assessment assessment
saliva
Examiner Examiner
#1 #1
2nd collecting
saliva Dct SM Examiner Examiner
Dct LB #2 #2
CHX
CRT SM
3rd collecting CRT LB Examiner Examiner
saliva #3 #3
Examiner Examiner
4 collecting
th
#4 #4
saliva
Examiner Examiner
#5 #5
CHX : chlorhexidine * Combinations are 10 patterns
because of 5 examiners
Inter-examiner Reliability
1
Weighted kappa value
0.75
0.8
0.72
0.6 0.57
0.44
0.4
0
SM LB SM LB
Dentocult CRT
Intervention/Exposure
Technical appraisal
Need to check the compliance
Medication
Home-care, self-care protocol
Blind (to prevent Hawthorne effect)
Cross-over design ( in case considerable
individual variability)
Control: Placebo group in experimental
researches. Naturally-generated multiple
treatment groups in observational
researches.
Research on the treatment
Efficacy or Effectiveness
Conceptualization of Clinical Decision
Risk factor Invasion Tx. term
Cost
Oral hygiene Post Tx trouble
Parafunction Outcome Effect
( probability ) ( benefit ) Expected
Treatment Satisfaction ( Individual value
Lifestyle option 5 years after Tx philosophy )
occupation
white-collar 5(41.7) 5(20.8) 4(16.7)
blue-collar 2(16.6) 7(29.2) 7(29.2)
unemployed 5(41.7) 12(50.0) 13(54.1) 0.55 *
marital status
married/unmarried 12(100.0)/0(0.0) 22(91.7)/2(8.3) 22(91.7)/2(8.3) —
parcent in parenthesis
* : Chi-squared test
†: One-way Factorical ANOVA
‡: unpaired t-test
Comparison of QOL score among groups
ID group
** *** ** RPD group
** *** ** NR group
(%)
100
90
80
70
60
50
40
30
20
10 ** ***
0
functional physical pain anxiety general mood general health psychological Dental treatment
limitation /discomfort dtsability
Oral Condition Daily Activity
Validation of sample size
No treatment
Pain intensity
Placebo
Active treatment
Population
Disease No disease
Intervention (non-
(alleviation)
group alleviation)
Random assignment
Target sample
(score)
(yrs.)
(mm)
(score)
40 60 6 35
30
50 5
Final sample
30
Target sample
25
Final sample
Final sample
Target sample
Target sample
Final sample
40
Target sample
N.S. 4
20
20 30 3
15
20 2
10 10
10 1 5
0 0 0 0Painless
Age Pain at Pain during Daily activity Maximum Assisted
rest function limitation jaw opening dimension
Baseline Comparison after Assignment N.S.
N.S. N.S. N.S.
60 90 12 50 N.S.
N.S.
80
50 10
70 40
(mm)
40 60 8
(score)
(yrs.)
30
(mm)
50
30 6
N.S
40
. 20
Pharmaco. Tx
Physical Tx
Pharmaco. Tx
Physical Tx
20 30 4
Pharmaco. Tx
Pharmaco. Tx
Physical Tx
Physical Tx
Control
Control
Control
Control
20 10
10 2
10
0 0 0 0
Age Pain at Pain during Daily activity Painles MaximumAssisted
rest function limitation s
Jaw opening dimension
40
20
0
Initial visit 0w 2w 4w 8w (Time)
DAL Score Change among the Groups
Daily Activity Limitation Scores
8 *
* Physical Tx.
7 Pharmaco Tx.
No Tx.
DAL score (Score)
6
5
4
3
2
1
0
First Second Final
observation observation observation
20000
10000
0
Painless Maximum Assisted DAL score Pain at Pain during
Mouth Mouth Mouth rest mastication
opening opening opening
* : p<0.05 (One-way Factorial ANOVA, Bonferroni test)
Weak Points of the Study
Sample size is slightly lower than initially
planed.
Blind fashion would be difficult due to the
treatment nature.
No monitoring the compliance in physical
and pharmacological treatments.
Multicenter sampling would be better to
generalize the findings.
It was so lucky that a similar study performed
in the US indicated the same finding.
Current solution of clinical epidemiology
Need to adjust the baseline data of each
Intergroup study experimental group (Random
assignment , Matching)
Cohort study
+ multivariate analysis (Cox proportional hazard model)
Creugers NH
et al (2005) 96±2 96±2 150 127 5
Jung RE et
al (2007) 93.5 90.2 31 41 8.6
Coronal dentin Coronal dentin Coronal dentin
Fokkinga WA Coronal dentin (+)/(-): (+)/(-): (+)/(-):
et al (2008) (+)/(-): 84/85 17
71/84 57/93 54/64
1. Due to short observation period, observation was potentially aborted
before trouble of build-up material was occurred
2. Due to low sample size (=lack of statistical power), no significant
difference was potentially detected between both treatment
3. Due to variety of cementation, it’s doubtful whether the results was
referred from the difference of build-up material
Core chart
(original medical record regarding build-up procedure)
Remaining coronal dentin
4-grade assessment in core chart
Root stump, remaining 1/5, 2/5, 3/5
In this study, we categorized
Root stump →Coronal dentin (-)
Remaining 1/5, 2/5, 3/5
→Coronal dentin (+)
Core margin
Core margin Positional
relation
between
Crown margin these
margins
Flow of survey
Sampling period Observation period
April 1st 1988 December 31st 1991 November 16th
Build-up procedure 2004
• Dentist of our clinic (n=46) Check the omission of chart
(clinical experience (<5 years/ >5 years: 6/40) (patient ID, patient name , build-
up material)
• Decision of build-up material was depend
on each dentist
Exclusion criteria
・ Omission the information on core chart (patients ID, patients name)
・ Mismatch the contents between core chart and medical record
10 23
patients patients
80
78.7%
60
55.4%
40
25
20
15
10
Resin core (n=1752)
5
Metal core (n=372)
0
0 5 10 15
Follow-up period (years)
Cumulative survival rate from the
remaining coronal dentin
Is confounding factor the choose metal core or
remaining coronal dentin?
100
cumulative survival rate (%)
80
60
40
Number of teeth
Build-up material (metal core/resin core) 187 / 866
Gender ( male/female ) 272 / 781
Coronal dentin ( absent/present ) 289 / 764
Core margin ( below crown
191 / 862
location margin/normal )
Root canal from ( straight/funnel ) 906 / 147
Tooth location ( maxilla/mandible ) 620 / 433
Tooth type ( anterior/posterior ) 353 / 700
DMFT ( mean ± S.D. ) 20.0±5.6
Risk factor analysis for prognosis of Core
Restoration
Cox’s proportional hazard model
Relative risk 95% Cl P-value
Basic Clinical
Research Research
Basic Clinical
Reseach Research
Epidemiology
Epidemiology