Professional Documents
Culture Documents
Leskinen Et Al-2017-Journal of Oral Rehabilitation
Leskinen Et Al-2017-Journal of Oral Rehabilitation
SUMMARY Recently, updated diagnostic criteria for Myofascial pain with referral, headache attributed
temporomandibular disorders (DC/TMD) were to TMD and disc displacement (DD) without
published to assess TMD in a standardised way in reduction without limited opening showed
clinical and research settings. The DC/TMD excellent kappa values (range 087–100). Fair-to-
protocol has been translated into Finnish using good reliability was observed for diagnoses of
specific cultural equivalency procedures. To assess myalgia (k = 067), arthralgia (k = 071) and DD
the interexaminer reliability using the Finnish with reduction (k = 064). The PA was high for all
translations of the DC/TMD-FIN Axis I clinical pain-related diagnoses and DD without reduction
diagnostic assessment instruments. Reliability without limited opening (medians ≥83%), and
assessment data were collected during a 1-day DC/ acceptable for DD with reduction (median 67%).
TMD Examiner Training Course at the University The NA was high (medians ≥87%) for all DC/TMD
of Turku, Finland, in collaboration with the diagnoses, except for myalgia which showed
International DC/TMD Training and Calibration acceptable NA (median 75%). The %A was high for
Center in Malm€ o University. Clinical TMD all assessed diagnoses (medians >85%). The
examinations according to the Finnish pre-final findings of this study showed DC/TMD-FIN Axis I
version of the DC/TMD Axis I assessment protocol to demonstrate sufficiently high reliability for
were performed by four experienced TMD pain-related TMD diagnoses.
specialists on altogether 16 models. Kappa KEYWORDS: DC/TMD, diagnostic criteria, TMD,
coefficient, overall percentage agreement (%A) as reliability, axis I translations
well as positive (PA) and negative (NA)
agreements were used to define the reliability. Accepted for publication 10 April 2017
TMD specialists (KS, PK, RN and TTO) using a strict Table 1. Computation of agreement
and specific procedure by the RDC/TMD Consortium
Examiner A diagnosis
Network (7). One of the four examiners (KS) who
Yes No Total
had earlier participated in the DC/TMD Examiner Examiner B diagnosis Yes a b f₁
Training Course in Malm€ o University, Sweden, acted No c d f₂
as an accredited Reference Standard Examiner (RSE). Total n₁ n₂ N
Furthermore, an oro-facial and TMD specialist (PA) Percentage agreement = (a+d)/N.
from the DC/TMD Training and Calibration Center Positive agreement = 2a/(f₁+n₁).
in Malm€ o University acted as the clinical protocol Negative agreement = 2d/(f₂+n₂).
supervisor, and the translation team leaders (KS, TS)
of the Finnish pre-final version of DC/TMD-FIN
absent. Statistics were performed using IBM SPSS
acted as the accredited Finnish protocol supervisors.
Statistics 21*.
After clinical examinations, the findings of the three
examiners were compared to those obtained by
the RSE. Results
Overall percentage
Kappa Positive agreement Negative agreement agreement
Distribution
Lowest, Median Lowest, Median Lowest, Median Lowest,
DC/TMD diagnosis Median highest (%) highest (%) highest (%) highest n (%)
Myalgia 067 054,085 092 (917%) 087, 096 075 (750%) 067, 089 088 (875%) 081, 094 12 (75%)
Myofascial pain with referral 087 049,087 092 (923%) 071, 092 095 (947%) 078, 095 094 (938%) 075, 094 7 (438%)
Arthralgia 071 061,084 083 (83%) 077, 089 088 (875%) 084, 095 086 (857%) 081, 093 6 (375%)
Headache attributed to TMD 100 100 100 (1000%) 100 100 (1000%) 100 100 (1000%) 100 6 (375%)
DD** with reduction 064 064, 100 067 (667 %) 067, 100 097 (966%) 097, 100 094 (938%) 094, 100 1 (63%)
DD with reduction with intermittent NC* NC NC NC 100 (1000%) 100 100 (1000%) 100 0 (00%)
locking
DD without reduction with limited NC NC NC NC 100 (1000%) 100 100 (1000%) 100 0 (00%)
opening
DD without reduction without limited 100 100 100 (1000.%) 100 100 (1000%) 100 100 (1000%) 100 5 (313%)
opening
Degenerative joint disease*** 0 0 0 (00 %) 0 100 (1000%) 097, 100 100 (1000%) 093, 100 0 (00%)
*no cases.
**disc displacement.
***no cases but one discrete finding.
intra-articular diagnoses, the most prevalent diagnosis diagnoses. High examiner reliability is important to
was disc displacement (DD) without reduction with- avoid misclassification of patients and provide person-
out limited opening (n = 5). Of the 16 participants, alised treatment for patients with TMD (3,11,12).
multiple DC/TMD diagnoses were observed in 10 par- Partly based on this study, the Finnish versions of the
ticipants. There were no cases having diagnoses of DD SQ and pain-related interview and verbal commands
with reduction with intermittent locking or DD with- can be implemented into clinical and research use in
out reduction with limited opening. For degenerative the Axis I clinical diagnostics of TMD (5,6).
joint disease, there was one discrete finding by one The new evidence-based DC/TMD Axis I protocol
examiner. includes additions, deletions and modifications in
comparison to the RDC/TMD (1). To achieve estab-
lished clinical assessment sensitivity and specificity,
Diagnostic reliability
the DC/TMD procedure includes strict commands to
The kappa coefficients showed excellent values for the patient and clinical and diagnostic procedures.
myofascial pain with referral (median k = 087), In the new DC/TMD diagnostics, the concept of ‘fa-
headache attributed to TMD (k = 100) and DD with- miliar pain’ was introduced, indicating pain similar
out reduction without limited opening (k = 100). The to patient’s previous pain within the previous
reliability was fair to good for myalgia (k = 067), 30 days, as a criterion for diagnosing pain-related
arthralgia (k = 071) and DD with reduction TMD in order to minimise false-positive findings. In
(k = 064). The reliability was poor for degenerative addition, for all pain-related diagnoses, the patient
joint disease (k = 0). As there were no cases of DD must have reported pain modified by jaw function
with reduction with intermittent locking and DD or movement in the SQ assessment. The new DC/
without reduction with limited opening, kappa values TMD criteria also include a new diagnosis, that is
were not computed (Table 2). headache attributed to TMD, as there is increasing
The overall %A was high for the assessed Axis I evidence that some forms of headache can be
diagnoses as shown by medians ≥086 (857%). The related to TMD (13,14). This addition to DC/TMD
median of PA was high for the diagnoses of myalgia diagnostics is important and may also contribute to
(917%), myofascial pain with referral (923%), future interdisciplinary research in this field of
arthralgia (830%), headache attributed to TMD study. Furthermore, the concept of ‘referred pain’
(100%) and DD without reduction without limited and the new diagnosis of myofascial pain with
opening (100%). The median PA was acceptable for referral are also included.
DD with reduction (667%). For DD with reduction Kappa estimates, %A as well as PA and NA were
with intermittent locking and DD without reduction computed to assess interrater agreement in order to
with limited opening, PA was not computed due to evaluate the data from multiple aspects (8). The
the low prevalence. For degenerative joint disorder, kappa statistics observes the chance, but is sensitive to
PA was 0. The median NA was high for myofascial prevalence, which is why kappa statistics may not be
pain with referral (947%), arthralgia (875%), head- useful for samples having very high or very low num-
ache attributed to TMD (100%) and intra-articular ber of cases versus non-cases (8). For degenerative
disorders (≥966%). The NA was acceptable for myal- joint disease, the kappa value manifested poor relia-
gia (750%) (Table 2). bility, indicating that only one discrete finding by one
examiner may have a huge impact on kappa values
when there are no findings detected by the other
Discussion
examiners. The reliability study of this type tests the
According to this study, the overall interexaminer operationalised criteria. It should be noted that the
reliability was found to be from acceptable to high for findings by RSE (as presented in Table 3) are simply a
TMD pain-related Axis I diagnoses (based on kappa reference for pair-wise comparisons of each examiner,
estimates, overall %A, PA and NA), whilst more vari- and not ‘the truth’. Therefore, one subject with
ability was found for joint-related diagnoses. Thus, degenerative joint disease is a misclassification, and
the DC/TMD-FIN Axis I seems to demonstrate suffi- the Kappa estimate for the disorder could be com-
ciently high reliability for the pain-related TMD puted. The low kappa values may be due to the low
Table 3. Distribution of the DC/TMD Axis I diagnoses between the participants (n = 16), based on the Reference Standard Examiner
DD DD
DD with without without
reduction reduction reduction
DC/TMD Myofascial Headache with with without
diagnosisPatient pain with attributed DD* with intermittent limited limited Degenerative
ID Myalgia referral Arthralgia to TMD reduction locking opening opening joint disease
1 x x x x x
2 x x
3 x
4
5 x x x
6 x x
7 x x x x x
8 x x
9 x x x
10 x x x x
11
12 x x
13
14 x x x
15 x
16 x x x x
*disc displacement.
prevalence and even only one model exhibiting on rare category, also %A, PA and NA were com-
examiner agreement, as was in the diagnosis of DD puted. The %A was reported as it is the most obvi-
with reduction that manifested fair-to-good reliability. ous, straightforward and easiest-to-understand index
This diagnosis was based on TMJ clicking based on for agreement (10). The %A was demonstrated to be
symptom history and examination. As a limitation, high for all assessed diagnoses. As a disadvantage, %
not all the DD with reduction manifest clinically A does not indicate how the agreements and dis-
detected noises, which may be related to false nega- agreements are distributed (10). This is why the PA
tives (1,15). In the present study, there were no cases and NA were also computed. PA was high for the
having diagnosis of DD with reduction with intermit- pain-related TMD diagnoses and more variable for
tent locking or DD without reduction with limited disc-related diagnoses. As there were no cases of DD
opening. This is why kappa values could not be com- with reduction with intermittent locking and DD
puted. The original DC/TMD article (1) describes that without reduction with limited opening, the denomi-
the detection of intra-capsular diagnoses was low for nator in PA was 0, and PA could not be computed.
most reliability estimates. Further, the validity of disc This happens with rarely occurring diagnoses when
displacements (except for DD without reduction with the RSE and the other examiner agree on the
limited opening) was inadequate. absence of the diagnoses. As there was one discrete
The present study sample had non-optimal ratio of finding for degenerative joint disease, PA was 0.
cases (13 subjects) versus non-cases (three subjects), The reliability assessment of the new evidence-
which is a limitation of the study. The optimal size based DC/TMD protocol is highly important in terms
for reliability testing includes a ratio ranging from of future research projects. Thus far, only two studies
1:1 to no more than 2:1 (7). Consequently, further considering the reliability of the new DC/TMD have
studies on DC/TMD Axis I protocol with more opti- been published. Vilanova et al. (12). evaluated the dif-
mal study design are needed. As the present case ferences in diagnostic reliability of the DC/TMD
versus non-case ratio was not optimal for kappa between groups of self-instructed examiners and
statistics, which may underestimate the agreement examiners taught in training and calibration course.
The results indicated that diagnostic reliability was and specifications, critique. J Craniomandib Disord.
high after both self-instruction and course participa- 1992;6:301–355.
3. Sessle BJ. Editorial:Two new entities: newly developed
tion. Even though the self-instruction group improved
diagnostic criteria for temporomandibular disorders, and the
their reliability after participating in the course, self- journal of oral & facial pain and headache. J Oral Facial
instruction was demonstrated to be sufficient in order Pain Headache. 2014;28:5.
to diagnose the most common TMD diagnoses. Schiff- 4. Ohrbach R, Bjorner J, Metric Q, Jezewski M, John M,
man et al. (1). reported the reliability of pain-related Lobbezoo F. Guidelines for Establishing Cultural equivalency
TMD to be excellent. Reliability coefficients were of Instruments: Updated May 11, 2013. www.rdc-tmdinte
rnational.org, Accessed on January 2, 2016.
above our estimates for myalgia and arthralgia, similar
5. Sipil€a K, Suvinen T. DC/TMD Symptom Questionnaire (DC/
to our results for myofascial pain with referral and TMD-FIN Oirekysely) and Pain-related interview and Exam-
lower than our findings for DD with reduction and iner Commands (DC/TMD-FIN Kliininen protokolla, osa 5).
DD without reduction without limited opening In: Ohrbach R, ed. Diagnostic Criteria for Temporomandibu-
(k = 084). Other intra-articular diagnoses could not lar Disorders: Assessment Instruments. Version 15May2016.
[Diagnostiset Kriteerit Purentaelimist€ on Kivuille ja Toim-
be computed accurately due to the low examiner
intah€airi€
oille (DC/TMD-FIN): Tutkimusinstrumentit: Finnish
detection rates in the study sample. Version 25May2016] Sipil€a K, Suvinen T, Trans. www.rdc-
The linguistically valid translations of the DC/TMD- tmdinternational.org, Accessed on January 2, 2016.
FIN Axis I assessment instruments were the first step 6. Ohrbach R, Gonzalez Y, List T, Michelotti A, Schiffman E.
in the necessary cultural adaptation process. No Diagnostic Criteria for Temporomandibular Disorders (DC/
important discrepancies were found between the TMD) Clinical Examination Protocol: Version 02June2013.
www.rdc-tmdinternational.org, Accessed on March 18, 2015.
source and the target document prior to this reliability
7. Alstergren P, Gonzalez-Stucker Y, Castrillon E, Peck C, Gou-
study. All the Finnish Axis I assessment instruments let J-C, Koutris M. Guidelines for DC/TMD Training and
have recently been published by the International Calibration; www.rdc-tmdinternational.org, Accessed on
RDC/TMD Consortium on the website. The next step January 2, 2016.
in the cultural adaptation process will be the evalua- 8. Chen G, Faris P, Hemmelgarn B, Walker RL, Quan H. Mea-
suring agreement of administrative data with chart data
tion of the validity of the Finnish versions of DC/TMD
using prevalence unadjusted and adjusted kappa. BMC Med
diagnostics together with the Axis II instruments, Res Methodol. 2009;9:5.
based on the currently ongoing field testing in TMD 9. Fleiss JL, Levin B, Paik MC. Statistical methods for rates and
pain patients. proportions. Hoboken, NJ: Wiley-Interscience; 2003:598–626.
In conclusion, the findings of this study showed 10. Feinstein AR. Principles of medical statistics. Boca Raton,
FL: Chapman & Hall/CRC; 2002:413–419.
DC/TMD-FIN Axis I to demonstrate sufficiently high
11. John MT, Dworkin SF, Mancl LA. Reliability of clinical tem-
reliability for pain-related TMD diagnoses. The DC/
poromandibular disorder diagnoses. Pain. 2005;118:61–69.
TMD-FIN Axis I can be used to assess TMD in a stan- 12. Vilanova LS, Garcia RC, List T, Alstergren P. Diagnostic cri-
dardised way in clinical and research settings. teria for temporomandibular disorders: self-instruction or
formal training and calibration? J Headache Pain.
2015;16:505.
Disclosure 13. Schiffman E, Ohrbach R, List T, Anderson G, Jensen R,
John MT et al. Diagnostic criteria for headache attributed to
Turku University Central Hospital approved the study temporomandibular disorders. Cephalalgia. 2012;32:683–
protocol. There is no conflict of interest and no source 692.
of funding. 14. Headache Classification Subcommittee of the International
Headache Society (IHS). The international classification of
headache disorders 3rd ed. Cephalalgia. 2013;33:629–808.
References 15. Okeson JP. Critical commentary 1: evaluation of the
research diagnostic criteria for temporomandibular disorders
1. Schiffman E, Ohrbach R, Truelove E, Look J, Anderson G, for the recognition of an anterior disc displacement with
Goulet JP et al. Diagnostic criteria for temporomandibular reduction. J Orofac Pain. 2009;23:312–315.
disorders (DC/TMD) for clinical and research applications:
recommendations of the international RDC/TMD consor-
tium network* and orofacial pain special interest group†. J Correspondence: Kirsi Sipil€a, Institute of Dentistry, University of
Oral Facial Pain Headache. 2014;28:6–27. Eastern Finland, Kuopio Campus, Box 1627, FIN-70211 Kuopio,
2. Dworkin SF, LeResche L. Research diagnostic criteria for Finland.
temporomandibular disorders: review criteria, examinations E-mail: kirsi.sipila@uef.fi