Professional Documents
Culture Documents
Validity and Reliability of The Portuguese Version of Mandibular Function Impairment Questionnaire
Validity and Reliability of The Portuguese Version of Mandibular Function Impairment Questionnaire
net/publication/221753167
CITATIONS READS
17 291
3 authors:
João Maroco
ISPA Instituto Universitário
451 PUBLICATIONS 10,052 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
StepUp! Development and Validation of a Motivational Program to Prevent Early School Leaving View project
All content following this page was uploaded by João Maroco on 02 November 2017.
SUMMARY The aim of this study is to evaluate the ‘feeding’ dimension (D2) (ICCD2 = 0Æ825, 95% CI =
validity and reliability of the Mandibular Function 0Æ726 to 0Æ891). Items 1, 2, 6 and 7 of D1 had factor
Impairment Questionnaire (MFIQ) (Portuguese ver- weights below the desired cut-off (0Æ5), and overall
sion). Face and content validity of the Portuguese fit of the original bifactorial structure of the MFIQ
version were performed. To assess reproducibility of was poor [(confirmatory fit index) CFI = 0Æ850,
the data gathered with MFIQ, it was applied to 62 (goodness of fit index) GFI = 0Æ781, (root mean
individuals who completed the questionnaire on square error of approximation) RMSEA = 0Æ118].
two occasions. Validity and reliability of the data Thus, these items were excluded, and the new,
gathered with MFIQ were evaluated in a sample reduced version of the MFIQ showed good fit
of 249 patients. Construct-related validity was (CFI = 0Æ933, GFI = 0Æ879, RMSEA = 0Æ099). The con-
assessed through factorial validity (by means of a vergent validity was adequate (AVE ‡ 0Æ5, CC ‡ 0Æ7)
confirmatory factor analysis), and convergent and for both factors. However, their discriminant vali-
discriminant validities were assessed, respectively, dity was low (AVED1 = 0Æ51 and AVED2 = 0Æ66
by the average variance extracted (AVE), composite < q2D1D2 = 0Æ70). The internal consistency was excel-
reliability (CC) and bivariate correlations between lent (a D1 = 0Æ874; a D2 = 0Æ918). The Portuguese
factors. The internal consistency was estimated by version of the reduced MFIQ produced data with
the standardised Cronbach’s alpha coefficient (a) good validity and reliability.
and reproducibility by the intra-class correlation KEYWORDS: reliability, validity, Mandibular Function
coefficient (ICC). All the items of MFIQ showed Impairment Questionnaire, temporomandibular
content validity. Reproducibility was excellent in joint disorders
both the ‘functional capacity’ dimension (D1)
(ICCD1 = 0Æ895, 95% CI = 0Æ832 to 0Æ935) and the Accepted for publication 29 October 2011
communication). Owing to the need to evaluate the full patients were complaining from pain or discomfort in
impact of TMD on the quality of life, several evaluation the temporomandibular joint and were diagnosed based
methods have been developed. These are especially on RDC ⁄ TMD Axis I classification criteria. The mean
useful in epidemiological and clinical studies, because age of the participants was 36Æ84 8Æ95 years and
they allow the screening of individuals in need of 53Æ73% were women.
treatment.
Among the instruments most used in the Portuguese
Instrument
language to assess TMD are the questionnaire proposed
by the American Academy of Orofacial Pain (1), the Index We used the original version of the MFIQ, developed in
of Anamnesic (8), the Mandibular Function Impairment English by Stegenga et al. (9). This measuring instru-
Questionnaire (MFIQ) (9) and the Research Diagnostic ment consists of 17 Likert-type questions, anchored in
Criteria for Temporomandibular Disorders (10). The five points ranging from ‘0-no difficulty’ to ‘four-very
MFIQ (9) allows the classification of individuals in difficult or impossible without help’. These 17 questions
relation to the severity of the functional limitation, are arranged in two dimensions (D1: Functional Capac-
related to TMD. The MFIQ has been under use (11, 12), ity, D2: Feeding). The average of points assigned to each
and the strong association of its scores with measures of question allows the classification of individuals accord-
pain, restricted jaw movements and psychological ing to the TMD severity.
changes have pointed to a reliable and valid additional To perform the translation into Portuguese, the
tool to assess the limitations of mandibular function in English original instrument was translated by three
patients with TMD (9). However, the MFIQ was origi- bilingual Brazilian translators working in the field of
nally proposed in the English language, and as far as we Dentistry and temporomandibular dysfunction. The
know, no transcultural adaptations to other languages, three versions were compared, and from them, a final
with evaluation of the metric properties of the data version was drawn up by the research team. The final
gathered, have been proposed. Chaves et al. (13) made a Portuguese version was then given to native English
first Portuguese unofficial translation; however, its met- translator who performed the back translation, from
ric qualities were not evaluated. According to Guillemin which the equivalence of forms was evaluated.
et al. (14) and Beaton et al. (15), cultural adaptation is a
process that involves the combination of a component of
Face validity
literal translation of words and phrases from one lan-
guage to another, and a meticulous process of attune- The face validation process involved six dentistry pro-
ment that addresses the cultural context and lifestyle of fessionals (specialists on temporomandibular disorders)
the target population. As noted by Beaton et al. (15), the and three experts of the English language. The idiomatic,
use of instruments without their transcultural upgrade semantic, cultural and conceptual equivalence of the
may jeopardise the validity and reliability of data gath- instrument was analysed to obtain agreement and
ered and conclusions reached from the analysis of that consensus. Thereafter, a preliminary version of the
data. instrument was pretested in a group of 25 subjects,
With this concern, we carried out the transcultural undergoing treatment in the Physiotherapy Clinic, in
adaptation of the ‘MFIQ’ for the Portuguese language the University Center of Araraquara – UNIARA. A
and studied the reliability and validity of the data comprehension index (CI) was obtained for each item.
gathered with this instrument. Further analysis proceeded only after CI reached 80%.
Table 1. Content validity ratio for the 17 items of the Mandibular Function Impairment Questionnaire. Araraquara, Brazil, 2010
Useful but
Items Essential non-essential Non-necessary RVC*
Table 2. Descriptive statistics used to evaluate the psychometric sensitivity of Mandibular Function Impairment Questionnaires items
Item Mean Median Mode Standard deviation Kurtosis Skewness Min Max
most of the items presented values that, according to The standardised factor weights of items 1, 2, 6 and7,
Maroco’s (2010) literature review (17), indicate no of the functional capacity dimension, were below the
sensitivity problems or significant non-normality (23). appropriate standardised factor weights [k ‡ 0Æ5; see,
Fig. 1 gives the confirmatory factor analysis model for e.g. (17)]. The overall model fit was poor according to
the MFIQ. standard indices for the goodness of model fit
0·18 0·65
it1 e1 it3 e3
0·19 0·78
it2 e2 0·81
it4 e4
0·65 0·88 0·33
0·42 it3 e3 it5 e5
0·57
0·43 0·75
0·80 it4 e4 Functional
0·36 capacity
0·86
it5 e5 0·48
0·60
0·15 0·23
Functional 0·39 0·90
it6 e6 it8 e8
capacity 0·36 0·13 0·67 0·82
0·51 it7 e7 it9 e9
0·55
0·90 0·26 0·44
it8 e8 it10 e10
0·67
0·81 0·94 0·30
0·57 e9
it9 it11 e11
0·45
0·59
it10 e10
0·94 0·32 it12 e12
e11 0·63
it11 0·77
it13 e13
0·59 0·79
0·79
it12 e12 0·89 it14 e14
0·63 Feeding 0·70 0·49
0·77
it13 e13 it15 e15
0·79 0·87
0·78 0·76
0·88 e14 0·84 e16
it14 it16
Feeding 0·70 0·50 0·70
Table 3. Average variance extracted and composite reliability and a high RMSEA that, according to the literature,
(CR) of the reduced Mandibular Function Impairment Question- should not be lower than 0Æ9 in the first two (17, 18)
naire
and >0Æ10 in the latter (29).
When items with low factor weights were excluded
Dimension AVE CR q2
(Fig. 2), there was a satisfactory adjustment of the two-
Functional capacity 0Æ507 0Æ872 0Æ705 factor model, indicating that the reduced version of the
Feeding 0Æ660 0Æ921
instrument (MFIQ-r) has better factorial-related valid-
AVE, average variance extracted. ity than the original version. The low discriminant
validity observed (Table 3) was attributable to the high
given to this information because of the poor psycho- correlation (r = 0Æ94) found between the two dimen-
metric properties of data gathered with these measuring sions. However, it should be emphasised that the
instruments. This distrust on the scales’ results can be absence of the model’s discriminant validity must be
attributed to the fact these are usually made and ⁄ or reassessed in another independent sample, with similar
used by health professionals who, by the nature of their characteristics to the one in this study, to assess
training, may not be familiar with statistical methods whether this is a characteristic of the instrument or
(24–27). sample.
It is essential to acknowledge that the measurement A comparison of MFIQ’s validity in the present study
process is, to a greater degree, a process subjected to the and in the published literature is difficult, because only
probabilistic laws of nature so that, even believing that the study by Ohrbach et al. (28) gave information on
a result is accurate, it may not fully coincide with the validity of this instrument. These authors per-
reality. Thus, the estimated level of accuracy of mea- formed an exploratory factorial analysis of MFIQ,
sured data is extremely important for assessing the applied to a sample of the US population, having found
quality of information collected. The quality evaluation two dimensions (functional and social) that differ from
of psychometric properties of the data gathered with the two factors proposed for Portuguese-speaking pop-
measurement scales should be performed prior to its ulation. It is clear that the authors did not perform
use. confirmatory factor analysis to assess the adjustment of
In the process of validation of the MFIQ, the lowest the two-factor model in a different sample from the
content validity was observed in items 1 (social activ- same population. Differences found between our study
ities), 2 (talk), 6 (working and ⁄ or undertaking daily and that from Ohrbach et al. (28) are probably due to
activities) and 7 (drinking) (see Table 1), which were the fact that the psychometric quality of the data
also the items that had the lowest factor weights (Fig. 1). gathered with the same instruments is related to the
For items 1 and 6, this may have occurred owing to the studied population and, therefore, not an absolute
high subjectivity of the terms ‘social activities’ and ‘daily characteristic of each scale (30, 31). It must be noticed
activities’, because each evaluated individual performs also we did not established diagnosis groups, and we
different activities, which can hinder the understanding just identified the patients with some symptom or
of what activities should be considered in each item. signal of TMD as indicated by RDC. The identification of
This interpretation was also reported by Ohrbach et al. diagnosis groups would be very useful for the estab-
(28). For items 2 and 7, the lower validity could be lishment of criterion-related validity in future works
related to the fact that these are the functions that with the MFIQ.
require less effort to be performed, when compared to In this study, in addition to the evaluation of the
the others presented in the questionnaire. psychometric characteristics of the data gathered with
It should be noted that the presentation of descriptive the MFIQ (sensibility, validity and reliability), we hope
statistics in Table 2 is justified by the necessity of to set common grounds for procedural evaluation of
validating the assumptions for performing confirmatory measurement scales in odontology.
factor analysis and the subsequent evaluation of
model’s plausibility (17).
Conclusions
Figure 1 shows that the two-factor structure of the
original MFIQ had poor quality of fit in this sample, The MFIQ-r can be used to produce sensitive, valid and
with indexes below the suggested values for CFI, GFI reliable data for the Portuguese-speaking population.
However, it must be noted that the two dimensions 14. Guillemin F, Bombardier C, Beaton DE. Cross-cultural adap-
proposed did not show discriminant validity. tation of health-related quality of life measures: literature
review and proposed guidelines. J Clin Epidemiol. 1993;46:
1417–1432.
Acknowledgments 15. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guide-
lines for the process of cross-cultural adaptation of self-report
The authors thank FAPESP for financial support (pro- measures. Spine. 2000;25:3186–3191.
cess: 2009 ⁄ 11153-7) and Raquel Oliveira for proof- 16. Laewshe CH. A quantitative approach to content validity. Pers
reading the manuscript. Psychol. 1975;28:563–575.
17. Maroco J. Análise de equações estruturais. Lisboa: Report-
Number; 2010.
References 18. Byrne BM. Structural equation modeling with Amos: Basic
concepts, applications and programming. New Jersey: Law-
1. Okeson JP. Dor orofacial. Guia de avaliação, diagnóstico e rence Erlbaum Associates; 2001.
tratamento. São Paulo: Quintessence; 1998. 19. McDonald RP, Ho MHR. Principles and practice in reporting
2. Drangsholt M, LeResche L. Temporomandibular disorder pain. structural equation analyses. Psychological Methods.
In: IK Crombie, PR Croft, SJ Linton, L LeResche, M VonKorff, 2002;7:64–82.
eds. Epidemiology of pain – a report of task force on 20. Fornell C, Larcker DF. Evaluating structural equation models
epidemiology of the International Association for the study with unobservable variables and measurement error. J Market
of pain. Seattle: IASP Press; 1999:203–233. Res. 1981;18:39–50.
3. Segu M, Lobbia S, Canale C, Collesano V. [Quality of life in 21. Hair JF, Black WC, Babin B, Anderson RE, Tatham RL.
patients with temporomandibular disorders]. Minerva Stoma- Multivariate data analysis. 6th edn, Upper Saddle River, NJ:
tol. 2003;52:279–287. Prentice Hall; 2005.
4. Oliveira AS. Evaluation of quality of life and pain in 22. Cronbach LJ. Coefficient alpha and the internal structure of
Temporomandibular Disorders (TMD). Brazilian J Oral Sci. tests. Psychometrika. 1951;16:297–334.
2005;4:646–650. 23. Kline RB. Principles and practice of structural equation
5. Tjakkes GH, Reinders JJ, Tenvergert EM, Stegenga B. TMD modeling. New York (NY): The Guilford Press; 1998.
pain: the effect on health related quality of life and the influence 24. Emerson JD, Colditz GA. Use of statistical analysis in the
of pain duration. Health Qual Life Outcomes. 2010;2:39–46. New England Journal of Medicine. N Eng J Med. 1983;309:
6. Yap AU, Dworkin SF, Chua EK, List T, Tan KB, Tan HH. 709–713.
Prevalence of temporomandibular disorder subtypes, psycho- 25. Altman DG. The scandal of poor medical research. Br J Surg.
logic distress, and psychosocial dysfunction in Asian patients. 1994;308:283–284.
J Orofac Pain. 2003;17:21–28. 26. Schwartz SJ, Sturr M, Goldberg G. Statistical methods in
7. Leao A, Sheiham A. Relation between clinical dental status rehabilitation literature: a survey of recent publications. Arch
and subjective impacts on daily living. J Dent Res. Phys Med Rehabil. 1996;77:497–500.
1995;74:1408–1413. 27. Kurichi JE, Sonnad SS. Statistical methods in the surgical
8. Fonseca DM, Bonfante G, Valle AL, Freitas SFT. Diagnóstico literature. J Am Coll Surg. 2006;202:476–484.
pela anamnese da disfunção craniomandibular. Revista Gau- 28. Ohrbach R, Granger C, List T, Dworkin S. Preliminary
cha de Odontologia. 1994;4:23–28. development and validation of the jaw functional limita-
9. Stegenga B, de Bont LG, de Leeuw R, Boering G. Assessment tion scale. Community Dent Oral Epidemiol. 2008;36:228–
of mandibular function impairment associated with temporo- 236.
mandibular joint osteoarthrosis and internal derangement. 29. Ullman JB, Bentler PM, Schinka JA, Velicer WF. Structural
J Orofac Pain. 1993;7:183–195. equation modeling. Handbook of psychology: Research meth-
10. Dworkin SF, LeResche L. Research diagnostic criteria for ods in psychology. Vol 2. Hoboken, NJ US: John Wiley & Sons
temporomandibular disorders: review, criteria, examinations Inc; 2003.
and specifications, critique. J Craniomandib Disord. 1992;6: 30. Honaker LM. The equivalency of computerized and conven-
301–355. tional mmpi administration – a critical-review. Clin Psych
11. De Laat A, Stappaerts K, Papy S. Counseling and physical Review. 1988;8:561–577.
therapy as treatment for myofascial pain of the masticatory 31. Suris A, Borman PD, Lind L, Kashner TM. Aggression,
system. J Orofac Pain. 2003;17:42–49. impulsivity, and health functioning in a veteran population:
12. Pereira LJ, Steenks MH, de Wijer A, Speksnijder CM, van der equivalency and test-retest reliability of computerized and
Bilt A. Masticatory function in subacute TMD patients before paper-and-pencil administrations. Comput Hum Behav.
and after treatment. J Oral Rehabil. 2009;36:391–402. 2007;23:97–110.
13. Chaves TC, Oliveira AS, Grossi DB. Principais instrumentos para
avaliação da disfunção temporomandibular, parte I: Índices e
questionários, uma contribuição para a prática clı́nica e de Correspondence: João Maroco, Rua Jardim do Tabaco 34, 1149-041
pesquisa. Fisioterapia e Pesquisa. 2008;15:121–127. Lisboa, Portugal. E-mail: joao.maroco@ispa.pt