Download as pdf or txt
Download as pdf or txt
You are on page 1of 7

Journal of Oral Rehabilitation

Journal of Oral Rehabilitation 2017 44; 493–499

Diagnostic criteria for temporomandibular disorders


(DC/TMD): interexaminer reliability of the Finnish version
of Axis I clinical diagnoses
J. LESKINEN*, T. SUVINEN*, T. TEERIJOKI-OKSA†, P. KEMPPAINEN‡§,
€ AN
R . N AP € KANGAS¶**, P. ALSTERGREN††, Y. LE BELL‡‡, H. FORSSELL†‡‡,
€ ¶**§§
R . M Y L L Y K A N G A S * § § , M . T O L V A N E N ‡ ‡ , M . D O E P E L ‡ ‡ & K . S I P I L A* *Institute
of Dentistry, University of Eastern Finland, Kuopio, †Department of Oral Diseases, Turku University Central Hospital, Turku, ‡Institute of
Dentistry, University of Helsinki, Helsinki, §Helsinki University Central Hospital, Helsinki, ¶Research Unit of Oral Health Sciences, University
of Oulu, **Oral and Maxillofacial Department, Medical Research Center Oulu, Oulu University Hospital, Oulu, Finland, ††Department of Oro-
facial Pain and Jaw Function, Malm€o University, Malm€o, Sweden, ‡‡Institute of Dentistry, University of Turku, Turku, and §§Oral and Max-
illofacial Department, Kuopio University Hospital, Kuopio, Finland

SUMMARY Recently, updated diagnostic criteria for Myofascial pain with referral, headache attributed
temporomandibular disorders (DC/TMD) were to TMD and disc displacement (DD) without
published to assess TMD in a standardised way in reduction without limited opening showed
clinical and research settings. The DC/TMD excellent kappa values (range 087–100). Fair-to-
protocol has been translated into Finnish using good reliability was observed for diagnoses of
specific cultural equivalency procedures. To assess myalgia (k = 067), arthralgia (k = 071) and DD
the interexaminer reliability using the Finnish with reduction (k = 064). The PA was high for all
translations of the DC/TMD-FIN Axis I clinical pain-related diagnoses and DD without reduction
diagnostic assessment instruments. Reliability without limited opening (medians ≥83%), and
assessment data were collected during a 1-day DC/ acceptable for DD with reduction (median 67%).
TMD Examiner Training Course at the University The NA was high (medians ≥87%) for all DC/TMD
of Turku, Finland, in collaboration with the diagnoses, except for myalgia which showed
International DC/TMD Training and Calibration acceptable NA (median 75%). The %A was high for
Center in Malm€ o University. Clinical TMD all assessed diagnoses (medians >85%). The
examinations according to the Finnish pre-final findings of this study showed DC/TMD-FIN Axis I
version of the DC/TMD Axis I assessment protocol to demonstrate sufficiently high reliability for
were performed by four experienced TMD pain-related TMD diagnoses.
specialists on altogether 16 models. Kappa KEYWORDS: DC/TMD, diagnostic criteria, TMD,
coefficient, overall percentage agreement (%A) as reliability, axis I translations
well as positive (PA) and negative (NA)
agreements were used to define the reliability. Accepted for publication 10 April 2017

temporomandibular joints (TMJs) and related


Background
structures (1). One of the most widely used diagnostic
Temporomandibular disorders (TMD) represent protocols for standardised TMD assessment was the
pain-related, functional and intra-articular clinical Research Diagnostic Criteria for Temporomandibular
problems that involve the masticatory muscles, the Disorders (RDC/TMD) (2). Recently, updated diagnostic

© 2017 John Wiley & Sons Ltd doi: 10.1111/joor.12516


494 J . L E S K I N E N et al.

criteria for TMD (DC/TMD) were published by the RDC/


Methods
TMD Consortium Network of the International Associa-
tion of Dental Research (IADR) and the Special Interest
Setting
Group on Oro-facial Pain of the International Associa-
tion for the Study of Pain (IASP) to assess TMD in a stan- The reliability assessment data were collected during a
dardised way in clinical and research settings (1). 1-day DC/TMD-FIN Examiner Training Course at the
Similar to RDC/TMD, the DC/TMD consists cur- University of Turku, Finland, as part of a 3-day DC/
rently of a dual axis system that is based on the TMD training course by the DC/TMD Training and
biopsychosocial model of pain. The Axis I diagnostic Calibration Center in Malm€ o University.
protocol is based on patient self-report and symptom
history and valid diagnostic criteria for the most
Models and examiners
common pain-related TMDs and for intra-articular
disorders. The Axis II assessment protocol is The study sample consisted of 13 cases with TMD (pa-
extended by new biobehavioural instruments that tients of the Department of Oral Diseases of Turku
assess disease-specific physical functioning as well as University Hospital) and three non-cases. The inclu-
psychological status and pain-related disability, suit- sion criteria were age ≥18 years, and for cases,
able for screening and comprehensive assessment included pain in the facial area for at least 5 days in
levels (1). The new evidence-based DC/TMD assess- the previous 30 days and pain that had persisted for
ment protocol will contribute to the development of at least 3 months; and for non-cases, no facial pain
more personalised care for patients with TMD and over the prior 3 months. The exclusion criteria were
for patients with other conditions related to oro- insufficient verbal fluency in the Finnish language
facial pain (3). and inability to tolerate multiple examinations. Mod-
The DC/TMD self-report instruments and clinical els were given oral and written information about the
examination protocol have been translated into Fin- study protocol and they signed an informed consent
nish using specific cultural equivalency procedures form.
developed by the International RDC/TMD Consor-
tium (4). The DC/TMD was published in English in
Methods and Translation procedures
2014 and since then, translations into approximately
30 languages have been in progress worldwide, Before the DC/TMD examination, the models com-
including Finnish as one of the first five lan- pleted the Finnish pre-final version of the DC/TMD
guages. The translation process includes forward Symptom questionnaire [DC/TMD_FIN-SQ (5)] of
translations, synthesis translations, back translations, the Axis I protocol. To ensure the validity, the Fin-
independent external review of back translations, nish translations of the Axis I DC/TMD-FIN SQ and
revision related to discrepancies, consolidation and verbal commands were performed according to the
review activities into a single instrument appropriate Guidelines for Establishing Cultural equivalency of
for expert committee review and cultural validity Instruments; www.rdc-tmdinternational.org (4–6).
revision, construction of a pre-final instrument, Accordingly, the team leaders and an external
administrative independent review of the translation expert review panel, including four oro-facial pain/
process by the International RDC/TMD Consortium TMD experts, reviewed the pre-final translations
and documentation, for example for field testing and the Finnish Axis I examination form and proto-
purposes. Currently, the final administrative review col and made recommendations based on the inde-
of the Finnish version of the DC/TMD (DC/ pendent external back-translation reviews. The
TMD_FIN) has been completed, and it is currently consolidated and corrected translations were
field tested (DC/TMD_FIN pre-final consolidated reviewed by the RDC/TMD Consortium prior to this
translations) (5). study.
The aim of this study was to estimate the interex- Clinical examinations according to the Finnish pre-
aminer reliability of the Axis I clinical diagnoses of final version of the DC/TMD Axis I protocol were per-
the DC/TMD-FIN. formed on altogether 16 models by four experienced

© 2017 John Wiley & Sons Ltd


RELIABILITY OF FINNISH DC/TMD AXIS I 495

TMD specialists (KS, PK, RN and TTO) using a strict Table 1. Computation of agreement
and specific procedure by the RDC/TMD Consortium
Examiner A diagnosis
Network (7). One of the four examiners (KS) who
Yes No Total
had earlier participated in the DC/TMD Examiner Examiner B diagnosis Yes a b f₁
Training Course in Malm€ o University, Sweden, acted No c d f₂
as an accredited Reference Standard Examiner (RSE). Total n₁ n₂ N
Furthermore, an oro-facial and TMD specialist (PA) Percentage agreement = (a+d)/N.
from the DC/TMD Training and Calibration Center Positive agreement = 2a/(f₁+n₁).
in Malm€ o University acted as the clinical protocol Negative agreement = 2d/(f₂+n₂).
supervisor, and the translation team leaders (KS, TS)
of the Finnish pre-final version of DC/TMD-FIN
absent. Statistics were performed using IBM SPSS
acted as the accredited Finnish protocol supervisors.
Statistics 21*.
After clinical examinations, the findings of the three
examiners were compared to those obtained by
the RSE. Results

Translation and cultural equivalency


Reliability assessment
There were no important discrepancies between the
To control rater examination order effects, a Latin square
host (Finnish) and source (English) languages regard-
design was used. Each clinical examination took a maxi-
ing the verbal commands and the clinical examination
mum of 20 min; between each clinical examination, the
protocol. In the DC/TMD-FIN SQ, some minor dis-
participants had an opportunity to rest for 10 min. The
crepancies concerned the translation of the following
Axis I diagnoses were based on the DC/TMD-FIN SQ and
questions:
the clinical Axis I examination protocol. More details,
Question 3: ‘Pain comes and goes’ and ‘Pain is
including the standards and the requirements for the relia-
always present’ were revised to be linguistically iden-
bility training procedures used in this study, are provided
tical to the source. Questions 9,11,12: The expression
in the Guidelines for DC/TMD Training and Calibration:
‘all the way’ was replaced with the linguistically more
www.rdc-tmdinternational.org (7).
appropriate synonym ‘fully’. In addition, some minor
linguistic modifications were required to alter the
Data analysis order of words into more fluent Finnish in SQ ques-
tions 3&5 and 4&7.
In the analysis kappa, overall percentage agreement
Detailed documentation of all the Finnish transla-
(%A), as well as positive (PA) and negative agree-
tion Logs and linguistic and culturally relevant
ments (NA) were used to evaluate the data from mul-
amendments are provided in the translation summary
tiple aspects (8). The reliability of all assessed DC/TMD
logs of the DC/TMD-FIN-SQ and the DC/TMD-FIN-
Axis I diagnoses was defined by computing kappa val-
clinical examination protocol (5,6).
ues for each diagnosis. Kappa coefficients were based
on the following: >075 indicating excellent reliability,
040–075 indicating fair-to-good reliability and <04 Distributions of the DC/TMD Axis I diagnoses in the study
indicating poor reliability (9,10). The reliability was sample
first determined by comparing each of the three exam-
The most common DC/TMD diagnosis in this study
iners to the RSE and then summarised as the medians,
sample was myalgia (n = 12), based on the findings of
lowest and highest values. The %A, PA and NA as well
the RSE (Tables 2,3). Joint-related pain diagnoses,
as prevalence of the diagnoses derived by RSE were
that is arthralgia (n = 6), were found more rarely in
calculated based on a 2 9 2 table (Table 1). %A indi-
comparison to muscle-related pain diagnoses. Among
cates the total number of agreements (10). PA indi-
cates the overall proportion when the RSE and the
other examiner agreed on an existing diagnosis. NA *IBM Corp. Released 2012. IBM SPSS Statistics for Windows, Ver-
indicates the agreement when the diagnosis was sion 21.0. Armonk, NY: IBM Corp.

© 2017 John Wiley & Sons Ltd


496
J . L E S K I N E N et al.

Table 2. Reliability, agreement and distribution of Axis I DC/TMD diagnoses

Overall percentage
Kappa Positive agreement Negative agreement agreement
Distribution
Lowest, Median Lowest, Median Lowest, Median Lowest,
DC/TMD diagnosis Median highest (%) highest (%) highest (%) highest n (%)

Myalgia 067 054,085 092 (917%) 087, 096 075 (750%) 067, 089 088 (875%) 081, 094 12 (75%)
Myofascial pain with referral 087 049,087 092 (923%) 071, 092 095 (947%) 078, 095 094 (938%) 075, 094 7 (438%)
Arthralgia 071 061,084 083 (83%) 077, 089 088 (875%) 084, 095 086 (857%) 081, 093 6 (375%)
Headache attributed to TMD 100 100 100 (1000%) 100 100 (1000%) 100 100 (1000%) 100 6 (375%)
DD** with reduction 064 064, 100 067 (667 %) 067, 100 097 (966%) 097, 100 094 (938%) 094, 100 1 (63%)
DD with reduction with intermittent NC* NC NC NC 100 (1000%) 100 100 (1000%) 100 0 (00%)
locking
DD without reduction with limited NC NC NC NC 100 (1000%) 100 100 (1000%) 100 0 (00%)
opening
DD without reduction without limited 100 100 100 (1000.%) 100 100 (1000%) 100 100 (1000%) 100 5 (313%)
opening
Degenerative joint disease*** 0 0 0 (00 %) 0 100 (1000%) 097, 100 100 (1000%) 093, 100 0 (00%)

*no cases.
**disc displacement.
***no cases but one discrete finding.

© 2017 John Wiley & Sons Ltd


RELIABILITY OF FINNISH DC/TMD AXIS I 497

intra-articular diagnoses, the most prevalent diagnosis diagnoses. High examiner reliability is important to
was disc displacement (DD) without reduction with- avoid misclassification of patients and provide person-
out limited opening (n = 5). Of the 16 participants, alised treatment for patients with TMD (3,11,12).
multiple DC/TMD diagnoses were observed in 10 par- Partly based on this study, the Finnish versions of the
ticipants. There were no cases having diagnoses of DD SQ and pain-related interview and verbal commands
with reduction with intermittent locking or DD with- can be implemented into clinical and research use in
out reduction with limited opening. For degenerative the Axis I clinical diagnostics of TMD (5,6).
joint disease, there was one discrete finding by one The new evidence-based DC/TMD Axis I protocol
examiner. includes additions, deletions and modifications in
comparison to the RDC/TMD (1). To achieve estab-
lished clinical assessment sensitivity and specificity,
Diagnostic reliability
the DC/TMD procedure includes strict commands to
The kappa coefficients showed excellent values for the patient and clinical and diagnostic procedures.
myofascial pain with referral (median k = 087), In the new DC/TMD diagnostics, the concept of ‘fa-
headache attributed to TMD (k = 100) and DD with- miliar pain’ was introduced, indicating pain similar
out reduction without limited opening (k = 100). The to patient’s previous pain within the previous
reliability was fair to good for myalgia (k = 067), 30 days, as a criterion for diagnosing pain-related
arthralgia (k = 071) and DD with reduction TMD in order to minimise false-positive findings. In
(k = 064). The reliability was poor for degenerative addition, for all pain-related diagnoses, the patient
joint disease (k = 0). As there were no cases of DD must have reported pain modified by jaw function
with reduction with intermittent locking and DD or movement in the SQ assessment. The new DC/
without reduction with limited opening, kappa values TMD criteria also include a new diagnosis, that is
were not computed (Table 2). headache attributed to TMD, as there is increasing
The overall %A was high for the assessed Axis I evidence that some forms of headache can be
diagnoses as shown by medians ≥086 (857%). The related to TMD (13,14). This addition to DC/TMD
median of PA was high for the diagnoses of myalgia diagnostics is important and may also contribute to
(917%), myofascial pain with referral (923%), future interdisciplinary research in this field of
arthralgia (830%), headache attributed to TMD study. Furthermore, the concept of ‘referred pain’
(100%) and DD without reduction without limited and the new diagnosis of myofascial pain with
opening (100%). The median PA was acceptable for referral are also included.
DD with reduction (667%). For DD with reduction Kappa estimates, %A as well as PA and NA were
with intermittent locking and DD without reduction computed to assess interrater agreement in order to
with limited opening, PA was not computed due to evaluate the data from multiple aspects (8). The
the low prevalence. For degenerative joint disorder, kappa statistics observes the chance, but is sensitive to
PA was 0. The median NA was high for myofascial prevalence, which is why kappa statistics may not be
pain with referral (947%), arthralgia (875%), head- useful for samples having very high or very low num-
ache attributed to TMD (100%) and intra-articular ber of cases versus non-cases (8). For degenerative
disorders (≥966%). The NA was acceptable for myal- joint disease, the kappa value manifested poor relia-
gia (750%) (Table 2). bility, indicating that only one discrete finding by one
examiner may have a huge impact on kappa values
when there are no findings detected by the other
Discussion
examiners. The reliability study of this type tests the
According to this study, the overall interexaminer operationalised criteria. It should be noted that the
reliability was found to be from acceptable to high for findings by RSE (as presented in Table 3) are simply a
TMD pain-related Axis I diagnoses (based on kappa reference for pair-wise comparisons of each examiner,
estimates, overall %A, PA and NA), whilst more vari- and not ‘the truth’. Therefore, one subject with
ability was found for joint-related diagnoses. Thus, degenerative joint disease is a misclassification, and
the DC/TMD-FIN Axis I seems to demonstrate suffi- the Kappa estimate for the disorder could be com-
ciently high reliability for the pain-related TMD puted. The low kappa values may be due to the low

© 2017 John Wiley & Sons Ltd


498 J . L E S K I N E N et al.

Table 3. Distribution of the DC/TMD Axis I diagnoses between the participants (n = 16), based on the Reference Standard Examiner

DD DD
DD with without without
reduction reduction reduction
DC/TMD Myofascial Headache with with without
diagnosisPatient pain with attributed DD* with intermittent limited limited Degenerative
ID Myalgia referral Arthralgia to TMD reduction locking opening opening joint disease

1 x x x x x
2 x x
3 x
4
5 x x x
6 x x
7 x x x x x
8 x x
9 x x x
10 x x x x
11
12 x x
13
14 x x x
15 x
16 x x x x

*disc displacement.

prevalence and even only one model exhibiting on rare category, also %A, PA and NA were com-
examiner agreement, as was in the diagnosis of DD puted. The %A was reported as it is the most obvi-
with reduction that manifested fair-to-good reliability. ous, straightforward and easiest-to-understand index
This diagnosis was based on TMJ clicking based on for agreement (10). The %A was demonstrated to be
symptom history and examination. As a limitation, high for all assessed diagnoses. As a disadvantage, %
not all the DD with reduction manifest clinically A does not indicate how the agreements and dis-
detected noises, which may be related to false nega- agreements are distributed (10). This is why the PA
tives (1,15). In the present study, there were no cases and NA were also computed. PA was high for the
having diagnosis of DD with reduction with intermit- pain-related TMD diagnoses and more variable for
tent locking or DD without reduction with limited disc-related diagnoses. As there were no cases of DD
opening. This is why kappa values could not be com- with reduction with intermittent locking and DD
puted. The original DC/TMD article (1) describes that without reduction with limited opening, the denomi-
the detection of intra-capsular diagnoses was low for nator in PA was 0, and PA could not be computed.
most reliability estimates. Further, the validity of disc This happens with rarely occurring diagnoses when
displacements (except for DD without reduction with the RSE and the other examiner agree on the
limited opening) was inadequate. absence of the diagnoses. As there was one discrete
The present study sample had non-optimal ratio of finding for degenerative joint disease, PA was 0.
cases (13 subjects) versus non-cases (three subjects), The reliability assessment of the new evidence-
which is a limitation of the study. The optimal size based DC/TMD protocol is highly important in terms
for reliability testing includes a ratio ranging from of future research projects. Thus far, only two studies
1:1 to no more than 2:1 (7). Consequently, further considering the reliability of the new DC/TMD have
studies on DC/TMD Axis I protocol with more opti- been published. Vilanova et al. (12). evaluated the dif-
mal study design are needed. As the present case ferences in diagnostic reliability of the DC/TMD
versus non-case ratio was not optimal for kappa between groups of self-instructed examiners and
statistics, which may underestimate the agreement examiners taught in training and calibration course.

© 2017 John Wiley & Sons Ltd


RELIABILITY OF FINNISH DC/TMD AXIS I 499

The results indicated that diagnostic reliability was and specifications, critique. J Craniomandib Disord.
high after both self-instruction and course participa- 1992;6:301–355.
3. Sessle BJ. Editorial:Two new entities: newly developed
tion. Even though the self-instruction group improved
diagnostic criteria for temporomandibular disorders, and the
their reliability after participating in the course, self- journal of oral & facial pain and headache. J Oral Facial
instruction was demonstrated to be sufficient in order Pain Headache. 2014;28:5.
to diagnose the most common TMD diagnoses. Schiff- 4. Ohrbach R, Bjorner J, Metric Q, Jezewski M, John M,
man et al. (1). reported the reliability of pain-related Lobbezoo F. Guidelines for Establishing Cultural equivalency
TMD to be excellent. Reliability coefficients were of Instruments: Updated May 11, 2013. www.rdc-tmdinte
rnational.org, Accessed on January 2, 2016.
above our estimates for myalgia and arthralgia, similar
5. Sipil€a K, Suvinen T. DC/TMD Symptom Questionnaire (DC/
to our results for myofascial pain with referral and TMD-FIN Oirekysely) and Pain-related interview and Exam-
lower than our findings for DD with reduction and iner Commands (DC/TMD-FIN Kliininen protokolla, osa 5).
DD without reduction without limited opening In: Ohrbach R, ed. Diagnostic Criteria for Temporomandibu-
(k = 084). Other intra-articular diagnoses could not lar Disorders: Assessment Instruments. Version 15May2016.
[Diagnostiset Kriteerit Purentaelimist€ on Kivuille ja Toim-
be computed accurately due to the low examiner
intah€airi€
oille (DC/TMD-FIN): Tutkimusinstrumentit: Finnish
detection rates in the study sample. Version 25May2016] Sipil€a K, Suvinen T, Trans. www.rdc-
The linguistically valid translations of the DC/TMD- tmdinternational.org, Accessed on January 2, 2016.
FIN Axis I assessment instruments were the first step 6. Ohrbach R, Gonzalez Y, List T, Michelotti A, Schiffman E.
in the necessary cultural adaptation process. No Diagnostic Criteria for Temporomandibular Disorders (DC/
important discrepancies were found between the TMD) Clinical Examination Protocol: Version 02June2013.
www.rdc-tmdinternational.org, Accessed on March 18, 2015.
source and the target document prior to this reliability
7. Alstergren P, Gonzalez-Stucker Y, Castrillon E, Peck C, Gou-
study. All the Finnish Axis I assessment instruments let J-C, Koutris M. Guidelines for DC/TMD Training and
have recently been published by the International Calibration; www.rdc-tmdinternational.org, Accessed on
RDC/TMD Consortium on the website. The next step January 2, 2016.
in the cultural adaptation process will be the evalua- 8. Chen G, Faris P, Hemmelgarn B, Walker RL, Quan H. Mea-
suring agreement of administrative data with chart data
tion of the validity of the Finnish versions of DC/TMD
using prevalence unadjusted and adjusted kappa. BMC Med
diagnostics together with the Axis II instruments, Res Methodol. 2009;9:5.
based on the currently ongoing field testing in TMD 9. Fleiss JL, Levin B, Paik MC. Statistical methods for rates and
pain patients. proportions. Hoboken, NJ: Wiley-Interscience; 2003:598–626.
In conclusion, the findings of this study showed 10. Feinstein AR. Principles of medical statistics. Boca Raton,
FL: Chapman & Hall/CRC; 2002:413–419.
DC/TMD-FIN Axis I to demonstrate sufficiently high
11. John MT, Dworkin SF, Mancl LA. Reliability of clinical tem-
reliability for pain-related TMD diagnoses. The DC/
poromandibular disorder diagnoses. Pain. 2005;118:61–69.
TMD-FIN Axis I can be used to assess TMD in a stan- 12. Vilanova LS, Garcia RC, List T, Alstergren P. Diagnostic cri-
dardised way in clinical and research settings. teria for temporomandibular disorders: self-instruction or
formal training and calibration? J Headache Pain.
2015;16:505.
Disclosure 13. Schiffman E, Ohrbach R, List T, Anderson G, Jensen R,
John MT et al. Diagnostic criteria for headache attributed to
Turku University Central Hospital approved the study temporomandibular disorders. Cephalalgia. 2012;32:683–
protocol. There is no conflict of interest and no source 692.
of funding. 14. Headache Classification Subcommittee of the International
Headache Society (IHS). The international classification of
headache disorders 3rd ed. Cephalalgia. 2013;33:629–808.
References 15. Okeson JP. Critical commentary 1: evaluation of the
research diagnostic criteria for temporomandibular disorders
1. Schiffman E, Ohrbach R, Truelove E, Look J, Anderson G, for the recognition of an anterior disc displacement with
Goulet JP et al. Diagnostic criteria for temporomandibular reduction. J Orofac Pain. 2009;23:312–315.
disorders (DC/TMD) for clinical and research applications:
recommendations of the international RDC/TMD consor-
tium network* and orofacial pain special interest group†. J Correspondence: Kirsi Sipil€a, Institute of Dentistry, University of
Oral Facial Pain Headache. 2014;28:6–27. Eastern Finland, Kuopio Campus, Box 1627, FIN-70211 Kuopio,
2. Dworkin SF, LeResche L. Research diagnostic criteria for Finland.
temporomandibular disorders: review criteria, examinations E-mail: kirsi.sipila@uef.fi

© 2017 John Wiley & Sons Ltd

You might also like