Professional Documents
Culture Documents
Clinical Implications of Brief Psychiatric Rating Scale Scores
Clinical Implications of Brief Psychiatric Rating Scale Scores
366
T
Table
able 1 Characteristics of the included studies
Study Antipsychotic drug used Sample size Duration (weeks) Selected patient characteristics Mean BPRS score at baseline
(n)
Mo
Moller
« ller et al (1997) Amisulpride, 191 6 In-patients with paranoid, disorganised or 61
haloperidol undifferentiated schizophrenia (DSM^III^
R), BPRS psychotic sub-score1 512 and at
least two BPRS psychosis items 54
Wetzel et al (1998) Amisulpride, 133 6 Acutely admitted in-patients with paranoid 53
flupentixol or undifferentiated schizophrenia, BPRS
total score 536, but no predominant
negative symptoms defined as SANS
composite score 455
Puech et al (1998) Amisulpride, 319 4 In-patients with acute exacerbations of 61
haloperidol paranoid, disorganised or undifferentiated
schizophrenia (DSM^III^R), BPRS
psychotic sub-score 512 and at least two
BPRS psychosis items 54
Colonna et al (2000) Amisulpride, 487 51 In- or out-patients with acute 56
haloperidol exacerbations of paranoid, disorganised or
undifferentiated schizophrenia (DSM^III^
R), at least two BPRS psychosis items 54
Carrie
Carriere
' re et al (2000) Amisulpride, 202 17 In-patients with paranoid schizophrenia or 65
haloperidol schizophreniform disorder (DSM^IV)
Peuskens et al (1999) Amisulpride, 228 8 In- or out-patients with paranoid, 55
risperidone disorganised or undifferentiated
schizophrenia (DSM^IV), BPRS total score
536, BPRS psychotic sub-score 512 and at
least two BPRS psychosis items 54
Beasley et al (1996) Olanzapine, haloperidol, 419 6 In-patients with acute exacerbations of 60
placebo schizophrenia (DSM^III^R), BPRS total
score 542
BPRS, Brief Psychiatric Rating Scale; SANS, Scale for the Assessment of Negative Symptoms.
1. Sum of conceptual disorganisation, suspiciousness, hallucinatory behaviour and unusual thought content.
improvement or worsening since the start variable measured without error and the then finds for every score of one variable
of the study using the following scores: 1, other as the dependent variable measured a score on the other variable that has the
very much improved; 2, much improved; with error. This is conceptually wrong, be- same percentile rank. The exact formulae
3, minimally improved; 4, no change; 5, cause both variables are measured with ran- are described in Chapter 2 of Kolen &
minimally worse; 6, much worse; 7, very dom error. Within the psychometric Brennan (1995). With regard to our large
much worse. A third item of the CGI, literature the search for corresponding database, no smoothing was applied, either
which tries to relate therapeutic effects points on different, but correlated, mea- to the cumulative distribution functions or
and side-effects – the efficacy index – was surement devices is referred to as ‘linking’ to the resulting linking functions. Only eva-
not used for the analysis. (Linn, 1993) or, in its most strict sense, as luations at baseline and at weeks 1, 2 and 4
‘equating’ (Kolen & Brennan, 1995). For were analysed, because although the dura-
this study we used equipercentile linking, tion of the studies ranged from 4 weeks to
Statistical analysis a technique that identifies those scores on 51 weeks not all studies provided data for
An often-used, but nevertheless inadequate, both measures that have the same percen- other time points, so that trial effects could
method to compare scores would have been tile rank. We used the SAS program EQUI- have biased the results. For each linking
to regress BPRS scores on CGI scores or PERCENTILE (Price et al, al, 2001), a task we included all patients with valid
vice versa. Both measures showed only realisation of the algorithms described by values on both measures, because analysing
median high correlations (see Results) Kolen & Brennan (1995). In the first step, the data only of those who completed the
and, therefore, regression equations would percentile rank functions are calculated studies would have implied a selection.
give different results depending on the for both variables. Using the percentile rank However, approximately 20% of the
direction of the regression equation. Linear function of one variable and the inverse patients withdrew between baseline and
regression treats one scale as the independent percentile rank function of the other, one week 4. In a sensitivity analysis we therefore
3 67
included only patients who were still in the score of 30 at weeks 2 and 4. Being consid- improved’ (CGI–I score 1) corresponded
studies at week 4, so that a rating was avail- ered ‘moderately ill’ (CGI–S score 4) to percentage BPRS reductions of 71, 79
able at each time point. With the exception corresponded to BPRS total scores of 44 and 85% at weeks 1, 2 and 4, respectively.
of a somewhat more notable variation con- at baseline and 40 at weeks 1, 2 and 4. Thus there was a consistent time effect
cerning the association between the CGI–I ‘Markedly ill’ (CGI–S score 5) corre- indicating that a smaller percentage change
ratings much worse/very much worse and sponded to BPRS scores of 55 at baseline, in BPRS total score was necessary for a
percentage BPRS worsening of up to 4– 53 at weeks 1 and 2, and 52 at week 4. patient to be considered improved 1 week
6% BPRS points, the results were so similar ‘Severely ill’ (CGI–S score 6) corresponded after the initiation of treatment than at later
that only those of the primary analysis are to BPRS scores of 70 at baseline and 68, time points. This effect is also seen for
shown. 67 and 65 at weeks 1, 2 and 4, respectively. the ‘no change’ rating according to the
Extremely ill (CGI–S score 7) corresponded CGI–I (score 4), which was linked with a
to BPRS scores of 85 at baseline and 89, 84 5% BPRS score reduction at weeks 1 and
RESULTS
and 88 at weeks 1, 2 and 4, respectively. 2 and an 8% reduction at week 4.
Correlation between CGI Thus, the results were relatively consistent
and BPRS over the four time points examined,
Spearman correlation coefficients between although there was a slight tendency that, DISCUSSION
CGI–S ratings and BPRS total score were for a given BPRS score, CGI ratings were
0.41, 0.60, 0.68 and 0.74 respectively somewhat less severe at baseline and be- Although the BPRS is a frequently used and
for baseline (n
(n¼1905),
1905), week 1 (n(n¼1835),
1835), came more severe during the course of the psychometrically sound assessment device
week 2 (n(n¼1720)
1720) and week 4 (n(n¼1512);
1512); treatment. This effect, however, was collecting explicitly certain aspects of psy-
all P50.001. Spearman correlations neither large nor always consistent. chotic behaviour, the clinical meaning of a
between CGI–I score and percentage given scale value has not been anchored to
improvement of BPRS total score were a global clinical judgement. In our study
Linking of CGI ^ I score the psychometric procedure of equipercen-
70.72, 70.74 and 70.76 for week 1
and percentage BPRS change tile linking was used to link the BPRS to a
(n¼1829),
1829), week 2 (n(n¼1717)
1717) and week 4
from baseline clinically meaningful global rating. Apply-
(n¼1511)
1511) respectively; all P50.001.
Figure 2 shows the linking function ing this procedure in a large sample of
between the CGI–I scale and the percentage acutely ill patients across various multicen-
Linking of CGI ^ S score and BPRS BPRS change from baseline at weeks 1, 2 tre studies did result in a calibration or
total score and 4. Ratings of ‘minimally improved’ anchoring of the rating instrument to the
Figure 1 shows the result of the linking (CGI–I score 3) at weeks 1, 2 and 4 corre- clinical judgement. The linking functions
between CGI–S rating and the BPRS total sponded to percentage BPRS reductions of linking BPRS scores to the CGI can provide
score at baseline and at weeks 1, 2 and 4. 23, 27 and 30%, respectively. Ratings of a better understanding of the BPRS and can
They suggest that being considered ‘mildly ‘much improved’ (CGI–I score 2) corre- help clinicians to interpret the results of
ill’ on the CGI (CGI–S score 3) approxi- sponded to percentage BPRS reductions of clinical trials. For example, the data indi-
mately corresponded to a BPRS total score 44, 53 and 58% at weeks 1, 2 and 4, cate that trials in which the average BPRS
of 32 at baseline and at week 1 and a total respectively. Ratings of ‘very much total score at baseline was 40 are unlikely
Fig. 1 Linking of Clinical Global Impression (CGI) Severity score with Brief Psychiatric Rating Scale (BPRS) total score.
368
Fig. 2 Linking of Clinical Global Impression (CGI) Improvement score with percentage reduction in Brief Psychiatric Rating Scale (BPRS) total score.
to have examined a severely ill population. of drug treatment and would be of ques- and statistical grounds (e.g. relatively low
Furthermore, frequently used cut-off points tionable clinical importance. In contrast to test–retest reliability in a heterogeneous
to define response in treatment trials – a 20 our findings, recent antipsychotic drug sample of patients with ‘schizophrenic,
or 50% reduction of the BPRS baseline trials in patients with acute exacerbations depressive and anxiety disorders’).
scores – seem to mean that on average the often used a 20 or 30% criterion to Although the algorithms for linking and
patients were ‘minimally improved’ and distinguish between responders and non- equating are the same, the terms have dif-
‘much improved’ respectively, according responders (Marder & Meibach,
Meibach, 1994; ferent meanings. For example, equating
to the raters’ clinical impression. In fact, Arvanitis et al,
al, 1997; Small et al,
al, 1997). two forms of a college admission test is
the data suggest that somewhat higher Ironically, the 20% cut-off level was indeed done to assure that both forms can be used
cut-off points than 20% (rather 25–30%) initially used in a study of patients with interchangeably and provide the same deci-
and 50% (rather 55%) might be better indi- refractory disease (Kane et al,
al, 1988), but sion. In our application the meaning is far
cators of ‘minimal improvement’ and was subsequently widely applied in studies less rigorous as the instruments differ,
‘much improvement’. of non-refractory cases. showing correlation coefficients for the
These results are relevant not only for The main strength of our analysis is the CGI–S v. BPRS total score comparison of
the readers of publications on antipsychotic large number of patients, which should 0.60–0.76 in weeks 1 to 4 and of only
drugs, but also for the definition of make the results rather robust. However, 0.40–0.41 at the baseline measurement.
response criteria of future trials: consider- a number of limitations of our analysis Linking is thus best understood here as
ing that a 25% BPRS score reduction means must be considered. Despite the widespread a kind of anchoring that helps in
that the patient is just minimally better use of the CGI in drug trials, there have understanding the clinical meaning of a
compared with baseline, this criterion been only a few studies of its psychometric given scale score. The correlation at base-
might be a useful cut-off for studying characteristics, so the CGI is certainly not line was especially low. This may in part
patients with treatment-refractory disease, an ideal measure for ‘evaluating’ the BPRS. be explained by the minimum of symptoms
but not for the ‘average’ patient. In In 116 patients with panic disorder and required at baseline by most studies, so that
treatment-refractory cases even a small depression, Leon et al (1993) found good variability was reduced, accounting for the
improvement in symptoms might be clini- concurrent validity and sensitivity for relatively low correlation.
cally important. However, in acutely ill change using the CGI. In two trials, Khan From a purely statistical point of view,
patients with non-refractory conditions, et al (2002, 2004) showed that the correlating an implicit difference rating
a 50% criterion (i.e. clinically much sensitivity of the CGI–S and CGI–I was (CGI–I rating) with an explicit, calculated
improved) would seem to be a more appro- similar to that of the Montgomery–Åsberg
Montgomery–Asberg ‘percentage improvement’ score is proble-
priate reflection of clinically meaningful Depression Rating Scale (Montgomery & matic. It was nevertheless reassuring that
improvement, because such patients usually Åsberg,
Asberg, 1979) and the Hamilton Rating these two measures showed higher correla-
respond well to antipsychotic drugs (Cole, Scale for Depression (Hamilton, 1960). tions than the severity scores themselves,
1964). Considering only a 25% reduction However, Beneke & Rasmus (1992) criti- thus demonstrating that clinicians are able
(i.e. only minimally improved) of the cised the CGI on semantic (e.g. asymmetric to give meaningful differential global
overall symptoms as a ‘response’ would scaling), logical (e.g. non-meaningful com- ratings reflecting something like a ‘relative
probably not meet clinicians’ expectations binations of CGI–S and CGI–I ratings) amount of change’. There was a time effect
369
370
results of the American double-blind olanzapine trial. Kane, J. M., Honigfeld, G., Singer, J., et al (1988) Montgomery, S. A. & —sberg, M. (1979) A new
Neuropsychopharmacology,
Neuropsychopharmacology, 14,
14, 111^123. Clozapine for the treatment-resistant schizophrenic. A depression scale designed to be sensitive to change.
double-blind comparison with chlorpromazine. Archives British Journal of Psychiatry,
Psychiatry, 134,
134, 382^389.
Rasmus, W. (1992) ‘Clinical Global
Beneke, M. & Rasmus,W.
of General Psychiatry,
Psychiatry, 45,
45, 789^796.
Impressions’ (ECDEU): some critical comments. Nierenberg, A. A. & DeCecco, L. M. (2002)
Pharmacopsychiatry,
Pharmacopsychiatry, 25,
25, 171^176. Kay, S. R. & Fiszbein, A. (1987) The positive and Definitions of antidepressant treatment response,
' re, P., Bonhomme, D. & Lempe¤ rie're,T. (2000) negative syndrome scale (PANSS) for schizophrenia. remission, nonresponse, partial response, and other
Carrie
Carriere, Lemperiere,T.
Schizophrenia Bulletin,
Bulletin, 13,
13, 261^275. relevant outcomes: a focus on treatment-resistant
Amisulpride has superior benefit/risk profile to
depression. Journal of Clinical Psychiatry,
Psychiatry, 62 (suppl.), 5^9.
haloperidol in schizophrenia: results of a multicentre,
double-blind study (the Amisulpride Study Group). Khan, A., Khan, S. R., Shankles, E. B., et al (2002)
Overall, J. E. & Gorham, D. R. (1962) The Brief
European Psychiatry,
Psychiatry, 15,
15, 321^329. Relative sensitivity of the Montgomery ^Asberg
Psychiatric Rating Scale. Psychological Reports,
Reports, 10,
10,
Depression Rating Scale, the Hamilton Depression
Cole, J. O. (1964) Phenothiazine treatment in acute 790^812.
rating scale and the Clinical Global Impressions rating
schizophrenia. Archives of General Psychiatry,
Psychiatry, 10,
10, 246^261. scale in antidepressant clinical trials. International Clinical Peuskens, J. & Link, C. G. G. (1997) A comparison
Collegium Internationale Psychiatriae Scalarum Psychopharmacology,
Psychopharmacology, 17,17, 281^285. of quetiapine and chlorpromazine in the treatment of
(1996) Internationale Skalen fu
fur
« r Psychiatrie,
Psychiatrie, 4th edn. schizophrenia. Acta Psychiatrica Scandinavica,
Scandinavica, 96,
96,
Khan, A., Brodhead, A. E. & Kolts, R. L. (2004) 265^273.
Go
Gottingen:
« ttingen: Beltz Test.
Relative sensitivity of the Montgomery ^Asberg
Colonna, L., Saleem, P., Dondey-Nouvel, L., et al depression rating scale, the Hamilton depression Peuskens, J., Bech, P., Mo« ller, H. J., et al (1999)
Moller,
(2000) Long-term safety and efficacy of amisulpride in rating scale and the Clinical Global Impressions rating Amisulpride v. risperidone in the treatment of acute
subchronic or chronic schizophrenia. International Clinical scale in antidepressant clinical trials: a replication exacerbations of schizophrenia. Psychiatry Research,
Research, 88,
88,
Psychopharmacology,
Psychopharmacology, 15,
15, 13^22. analysis. International Clinical Psychopharmacology,
Psychopharmacology, 19,
19, 107^117.
Dahlke, F., Lohaus, A. & Gutzmann, H. (1992)
157^160.
Price, L. R., Lurie, A. & Wilkins, C. (2001)
Reliability and clinical concepts underlying global EQUIPERCENT: A SAS program for calculating
Kolen, M. J. & Brennan, R. L. (1995) Test Equating:
judgements in dementia: implications for clinical equivalent scores using the equipercentile method.
Methods and Practices.
Practices. New York:
York: Springer.
research. Psychopharmacology Bulletin,
Bulletin, 28,
28, 425^432. Applied Psychological Measurement,
Measurement, 25,
25, 332.
Guy, W. (1976) Clinical Global Impressions: In ECDEU
Guy,W. Leon, A. C., Shear, M. K., Klerman, G. L., et al (1993)
Puech, A., Fleurot, O. & Rein, W. (1998)
Assessment Manual for Psychopharmacology,
Psychopharmacology, pp. 218^222. A comparison of symptom determinants of patient and Amisulpride, an atypical antipsychotic, in the treatment
Revised DHEW Pub. (ADM). Rockville, MD: National clinician global ratings in patients with panic disorder and of acute episodes of schizophrenia: a dose-ranging
Institute for Mental Health. depression. Journal of Clinical Psychopharmacology,
Psychopharmacology, 13,
13, study v. haloperidol. Acta Psychiatrica Scandinavica,
Scandinavica, 98,
98,
327^331. 65^72.
Hamilton, M. (1960) A rating scale of depression.
Journal of Neurology, Neurosurgery and Psychiatry,
Psychiatry, 23,
23, Linn, R. L. (1993) Linking results of distinct assessments. Small, J. G., Hirsch, S. R., Arvanitis, L. A., et al
56^62. Applied Measurement in Education,
Education, 6, 83^102. (1997) Quetiapine in patients with schizophrenia. A
Haro, J. M., Kamath, S. A., Ochoa, S., et al (2003) high- and low-dose comparison with placebo. Archives of
Marder, S. R. & Meibach, R. C. (1994) Risperidone in General Psychiatry,
Psychiatry, 54,
54, 549^557.
The Clinical Global Impression
Impression^Schizophrenia
^Schizophrenia scale: a
simple instrument to measure the diversity of symptoms the treatment of schizophrenia. American Journal of
Psychiatry,
Psychiatry, 151,
151, 825^835. Wetzel, H., Grunder, G., Hillert, A., et al (1998)
present in schizophrenia. Acta Psychiatrica Scandinavica,
Scandinavica,
Amisulpride versus flupentixol in schizophrenia with
107,
107, 16^23.
« ller, H. J., Boyer, P., Fleurot, O., et al (1997)
Mo
Moller, predominantly positive symptomatology ^ a double-
Hedlund, J. L. & Vieweg, B. W. (1980) The Brief Improvement of acute exacerbations of schizophrenia blind controlled study comparing a selective D-2-like
Psychiatric Rating Scale (BPRS): a comprehensive with amisulpride: a comparison with haloperidol. antagonist to a mixed D-1-/D-2-like antagonist.
review. Journal of Operational Psychiatry,
Psychiatry, 11,
11, 48^65. Psychopharmacology,
Psychopharmacology, 132,
132, 396^401. Psychopharmacology,
Psychopharmacology, 137,
137, 223^232.
3 71