Professional Documents
Culture Documents
Patients Preferences Regarding The Process and Outcomes of Lifesaving Technology
Patients Preferences Regarding The Process and Outcomes of Lifesaving Technology
Patients Preferences Regarding The Process and Outcomes of Lifesaving Technology
PATIENTS PREFERENCES
REGARDING THE PROCESS
AND OUTCOMES OF LIFE-SAVING
TECHNOLOGY
An Application of Conjoint Analysis to Liver
Transplantation
Julie Ratcliffe
Martin Buxton
Brunel University
Abstract
The economic technique of conjoint analysis was used to assess the relative importance of health
outcome versus several process attributes (e.g., waiting time, continuity of contact with the same
medical staff) in determining patients preferences for liver transplantation services. The attributes
were established by reference to the literature and through initial qualitative interviews with liver
transplant recipients (n 5 12). Following a pilot study of 40 patients, a sample of patients (n 5 213)
who have received a liver transplant at the Queen Elizabeth Hospital in Birmingham were surveyed.
The technique of conjoint analysis was used to ascertain the relative importance of the attributes
included in the exercise and to estimate the marginal rates of substitution (MRS) between different
attributes. A useable response rate of 89% was achieved. Although a small proportion of respondents
(15%) exhibited dominant preferences for the chance of success attribute, the majority of respondents
indicated that they would be prepared to exchange a reduction in health outcome for an improvement
in the process characteristics of the liver transplantation service. The results of this study have
potentially important implications for the assessment of the benefits of medical technologies since
they suggest that, even in the extreme case of life-saving interventions, the preferences of respondents
may not be dependent solely upon health outcomes but may also be determined by attributes associ-
ated with the process of care.
The authors would like to thank Dr. James Neuberger from the Queen Elizabeth Hospital in Birmingham
for his help in questionnaire design and administration of the study. We are also grateful to Mandy
Ryan, Martin Cave, Stirling Bryan, and Tony Scott for comments received on questionnaire design and
analysis and to Kathy Johnston for comments received on an earlier version of this paper. This work
was supported by a program grant to the Health Economics Research Group from the U.K. Department
of Health. The views expressed, however, are those of the authors alone.
340
Downloaded from https://www.cambridge.org/core. University of Sheffield Library, on 20 Oct 2017 at 11:45:41, subject to the Cambridge Core terms of use,
available at https://www.cambridge.org/core/terms. https://www.cambridge.org/core/product/04DF42D7088D89C72C58D852C2AAEC22
Patients preferences for liver transplantation services
health) that yield utility or disutility for the consumer and which should be included
in the utility function (14;29;30;37;38). Such characteristics may include factors
relating to the process of care such as continuity of staff, waiting time, location,
etc. It has also been suggested that the relative importance of such factors may
vary according to the technology under consideration (29). This paper reports the
methods and results of a conjoint analysis study that was designed to establish
whether liver transplant recipients derive utility from factors other than the chance
of a successful transplant and if so, the relative weights that are attached to
these factors.
BACKGROUND
In 1980 fewer than 50 liver transplants were performed throughout Europe (31).
However, in 1996 more than 600 liver transplants were performed in England and
Wales alone (22). Within the National Health Service (NHS) liver transplantation is
currently provided by seven Department of Health designated liver transplantation
centers. Although liver transplantation has never been the subject of a randomized
controlled trial, it has become an accepted intervention for the treatment of a
number of end-stage liver diseases. There is a growing body of evidence to suggest
that it is an effective intervention that can significantly improve survival and quality
of life for the individual patient (4;8;21;25). Previous evaluative studies of liver
transplantation have reflected this context, estimating the benefits of the procedure
in terms of the utility derived from an improvement in health outcome for a given
cohort of patients (5;23). Remarkably little research has been undertaken to elicit
patients preferences for factors associated with the process of treatment or their
relative importance in relation to health outcome.
Conjoint Analysis
Stated preference refers to a number of techniques for determining individual prefer-
ences in hypothetical controlled experimental conditions, as contrasted with revealed
preference techniques, which are based on observations of individual behavior in
reality. To date, within the health care sector, stated preference techniques (in-
cluding standard gamble [1], time trade-off [9], rating scale [16;17], magnitude
estimation [34], and equivalence of numbers [32]), have been used mainly to obtain
relative values for health states. More recently, stated preference techniques have
also been used to ascertain the relative importance of non-health outcomes and/
or factors associated with the process of health care through the application of
conjoint analysis and willingness-to-pay methodologies (13;37;38).
Conjoint analysis (CA) is a stated preference technique designed to establish
the impact of individual attributes in the overall utility of a good or service (12).
It involves the presentation to individuals of hypothetical scenarios. Respondents
use ranking, rating, or discrete choice exercises to represent their preferences for
these hypothetical scenarios. Their respective utility functions can then be estimated.
The scenarios are based upon the establishment of experimental design constructs
that represent each alternative in terms of specified levels across a set of attributes.
The CA technique has been widely used in the transport economics literature
and in the environmental economics literature (2;23;26;27;4547). Within health
care, its use has been limited, although an increasing number of studies have been
undertaken in recent years (7;10;33;35;36;37;43;44). Within a U.K. context, the
technique has not previously been applied to medical technologies that are perceived
to be life saving, although several life-enhancing procedures have been the subject
Attributes Levels
of conjoint analysis studies, including magnetic resonance imaging for the investiga-
tion of knee injuries (7) and the provision of assisted reproduction services (35).
METHODS
In order to assess the relative value placed by patients on the process of treatment
vis-a-vis health outcome in the provision of liver transplantation services, a CA
exercise was performed. There are five main stages to a CA exercise (37); a)
identifying the attributes to include in the study; b) assigning levels to each of the
attributes included; c) presenting hypothetical scenarios involving different levels
of the attributes to individuals; d) obtaining preferences for these scenarios; and
e) analyzing the responses.
The Generation of the Attributes
First, it was necessary to identify the relevant attributes of the service to be included
in the exercise. A review of the literature identified a small number of qualitative
studies undertaken in North America and Europe concerning the preferences of
liver transplant patients for transplantation services (20;4042). These studies have
revealed that, in addition to the chance of surviving the operation, patients identified
the length of the waiting period and the amount and type of follow-up support
received as important factors in the provision of the service. Given the absence of
information obtained in a U.K. setting, a number of individual interviews were
undertaken to ascertain the key factors that patients considered to be important
in contributing to their overall satisfaction. A small sample of patients (n 5 12)
recently undergoing transplantation at the Queen Elizabeth Hospital (QEH) in
Birmingham were interviewed about their experience with the transplantation pro-
cess and the factors that they considered to be of importance in determining their
overall satisfaction. As expected, one of the key factors was the chance of a successful
transplant. The other factors mentioned most frequently were the time spent on
the waiting list, continuity of contact with the same medical staff, the amount of
information received about the risks and benefits of the transplantation process,
the amount of follow-up support received, and the distance of the transplantation
center from the individuals home.
Assignment of Levels to Attributes
The literature suggests that the chosen attribute levels should have the characteris-
tics of being realistic and sensible to respondents, and capable of being traded off
(12). The attribute descriptions and the levels that were chosen for the main study
are detailed in Table 1.
For the purposes of the CA exercise, the chance of success attribute was defined
in terms of the probability of surviving the operation and living for a minimum
period of 5 years afterwards (the alternative being a situation in which the recipient
would die as a result of liver failure within the 5-year period). The CA exercise
was administered to a group of patients with the same primary indication for liver
transplantation, primary biliary cirrhosis (PBC). This group was chosen on the
basis that it represents a fairly homogeneous group of patients with, on average, a
relatively high chance of surviving the transplantation process. The levels for the
chance of success attribute were based around the current actual mean 5-year
survival rates for patients with primary biliary cirrhosis at QEH. The levels for the
waiting time attribute were based upon QEH data and reflect the current expected
waiting times for the majority of patients with primary biliary cirrhosis. The levels
for the remaining attributes were developed in consultation with clinical colleagues
at QEH.
service offered at QEH at the time that the study was undertaken. In responding
to the questions presented, individuals were instructed to think back to the time
prior to their transplant when they were first told that liver transplantation was an
option for them. They were asked to imagine that, at this time point, they had been
given a choice of two centers, A or B, at which to receive their liver transplant.
The centers differed according to several key factors or attributes. They were then
told that they had to choose between Center A and Center B for each of the
pairwise comparisons offered to them. The questionnaire was sent by post to the
patients home address and included a cover letter by a physician from the hospital
who had been involved in their care. One reminder was sent to nonrespondents
after approximately 3 weeks.
Respondents Characteristics
Respondents were asked their age, sex, the number of liver transplants they had
ever received, educational background, general state of health, the time they had
spent on the waiting list for their last transplant, how stressful they found the
waiting period, and the distance of the transplantation center from their home.
These questions were included to examine the extent to which preferences were
influenced by these factors. Several prior hypotheses were developed concerning
the possible effects of these characteristics upon individual preferences. These were
based upon a priori expectations about how the characteristics of the respondent
might influence their preferences. It was hypothesized that older people might find
the provision of information to be less important than younger people, since they
might not want to actively participate in making decisions about their treatment.
Similarly, information about the transplantation process might be relatively more
important to the better educated. Evidence exists from the noneconomics literature
to support these hypotheses (3;11). Given that older people are less mobile and
tend to have poorer health in general, it was hypothesized that they might exhibit
preferences for high levels of follow-up support, continuity of contact with the same
medical staff, and a shorter distance between the transplantation center and their
home. The level of follow-up support offered might be less important to those
individuals who report themselves in good health, because these individuals perceive
that they have less need for follow-up support and aftercare relative to those
individuals who report themselves in worse health. Individuals who found the time
spent on the waiting list for transplantation a stressful experience might attach
more importance to shorter waiting periods on the basis that the stressful period
is reduced. Finally, it was hypothesized that those individuals who lived longer
distances from the transplantation center at the time of their last transplant might
have experienced more difficulties and inconveniences in attending the transplanta-
tion center than those who lived nearby, and hence might attach relatively more
importance to the distance of the transplantation center from the patients home.
Analysis of the Data
According to economic theory, a pairwise comparison can be viewed as a comparison
of two indirect utility functions, and hence the data from a discrete choice CA
exercise can be analyzed within the framework of random utility theory (18;28).
For each comparison, the respondent chooses the alternative that leads to the higher
level of utility. Hence, the respondent will choose Center B over Center A (the
base alternative) if:
U(AB, s) . U(AA, s) (1)
Table 2. Interaction Terms to Test for the Effect of Respondents Characteristics on Pref-
erences
Interaction Expected
term sign Hypothesis
RESULTS
A useable response rate of 89% was achieved: 189 usable questionnaires were
returned, plus six additional questionnaires where the CA choice questions were
not completed and hence were excluded from the main data analysis. Respondents
were mostly female (90%) with a mean age of 57 years. 70.5% of respondents were
qualified to OGrade/GCSE or below.
Time spent on the waiting list 134 72.0 44 23.7 8 4.3 0 0.0
Continuity of contact with 150 79.8 36 19.1 2 1.1 0 0.0
same medical staff
Chance of successful liver 171 91.4 15 8.0 1 0.5 0 0.0
transplant
Amount of information re- 144 77.4 42 22.6 0 0.0 0 0.0
ceived about your transplant
Amount of follow-up support 159 85.5 26 14.0 0.5 0 0 0.0
received
Distance of the transplantation 60 32.1 61 32.6 36 19.3 30 16.0
center from your home
The majority of respondents indicated that the six attributes included in the
study were either important or very important to them (Table 3). Respondents
appeared to find the questionnaire not too difficult to complete, with 111 respon-
dents (59%) indicating that the questionnaire was not difficult to complete and 48
(26%) indicating that the questionnaire was slightly difficult to complete. However,
the tests of internal consistency revealed that a small number of respondents (17
[9%]) answered inconsistently. Of the 189 questionnaires, 29 respondents (15%)
exhibited a dominant preference for the chance of success attribute: they consistently
chose the center with the higher chance of success regardless of the levels of the
other attributes. However, none of these individuals exhibited a strict lexicographic
ordering for the attributes presented. The mean time taken to complete the question-
naire was 16 minutes, with an overall range of 1060 minutes.
The results from the random effects probit model are given in Table 4. The
results are presented excluding individuals exhibiting dominant preferences and
those with inconsistent preferences. A further analysis (not reported here) was also
conducted including individuals exhibiting dominant preferences, and the results
were very similar. The results indicate that all of the attributes included in the CA
exercise were highly significant in determining the choice of center. The results
also provide support for the models theoretical validity, since the sign of the
coefficient for each of the attributes is in the expected direction. The marginal rates
of substitution between attributes are calculated by dividing the coefficients of
the attributes of interest. For example, the marginal rate of substitution between
continuity and waiting time (2.59) is estimated by dividing the coefficient of conti-
nuity (0.4150) by the coefficient of waiting time (20.1603). The estimate indicates
that nondominant respondents were prepared to exchange an increase in waiting
time of 2.59 months to achieve a high level of continuity in the care received.
Similarly, the marginal rate of substitution between waiting time and chance of
success (1.26) is estimated by dividing the coefficient of waiting time (20.1603) by
the coefficient of chance of success (0.1273). The estimate indicates that nondomi-
nant respondents were prepared to exchange an increase in waiting time of 1.26
months for an increase in the probability of a successful transplant of 1%.
DISCUSSION
This study used the technique of CA to determine the relative importance of several
key attributes in the provision of a liver transplantation service and to illustrate
how the marginal rates of substitution between different attributes can be estimated.
The response rate achieved in this study is higher than has previously been achieved
in postal CA surveys and may have been facilitated by the cover letter, sent with
the questionnaire, from the consultant who was involved in the care of a large
number of the patients in the sample. It was found that the use of CA produced
meaningful results. Although a small number of respondents exhibited a dominant
preference for the chance of success attribute, the results of the study indicated
that the majority of respondents were prepared to exchange a reduction in health
outcome for an improvement in the process characteristics of the liver transplanta-
tion service.
These results have potentially important implications for the assessment of the
benefits of medical technologies, since they suggest that process attributes are
valued by respondents in addition to health outcomes. This finding is supported
by several previous studies that have used CA in a health care context to ascertain
the value of process characteristics via-a-vis health outcomes (7;35). However, it
can be argued that the results of this study are more striking, given that liver
CONCLUSION
This paper has highlighted an application of the technique of CA to measuring
patients preferences for characteristics of a liver transplantation service. It has
illustrated how the technique can be used to quantitatively examine patients prefer-
ences between health outcomes and process. Evidence for the theoretical validity,
ease of completion, and internal consistency of the CA technique have been pre-
sented. The results of the study suggest that, even in the extreme case of a life-saving
intervention, patients preferences are determined by the process characteristics of
the service provided in addition to health outcomes, and many patients will trade.
If similar results were found in other such studies, it would have major implications
for the evaluation of health care interventions and organizations, and would suggest
that evaluation based only on health outcomes may not adequately reflect pa-
tients preferences.
REFERENCES
1. Bass, E. B., Steinberg, M. D., Pitt, H. A., et al. Comparison of the rating scale and
standard gamble in measuring patient preferences for gallstone disease. Medical Decision
Making, 1994, 14, 30714.
2. Bates, J. Sensitivity to level of service: Evidence from stated preference work. Behavioural
Research for Transport Policy, 1986, 13, 289305.
3. Beisecker, A. E., & Beisecker, T. D. Patient information seeking behaviour when commu-
nicating with doctors. Medical Care, 1990, 28, 1928.
4. Bonsel, G. J., Essink-Bot, M. L., Klompmaker, I. J., & Slooff, M. J. Assessment of the
quality of life before and following liver transplantation. First results. Transplantation,
1992, 53, 796800.
5. Bonsel, G. J., Klompmaker, I. J., Essink-Bot, M. L., Habbema, J. D., & Slooff, M. Cost
effectiveness of the Dutch Liver Transplantation Programme. Transplantation Proceed-
ings, 1987, 19, 38643866.
6. Bradley, M. Users manual for the SPEED version 2.1 stated preference editor and designer.
Hague: Hague Consulting Group, 1991.
7. Bryan, S., Buxton, M., Sheldon, R., & Grant, A. The use of magnetic resonance imaging
for the investigation of knee injuries: A discrete choice conjoint analysis exercise. Health
Economics, 1998, 7, 595604.
8. Bryan, S., Ratcliffe, J., Neuberger, J., et al. An assessment of patients quality of life
following liver transplantation. Quality of Life Research, 1998, 7, 115120.
9. Buxton, M. J., & Ashby, J. The time trade off approach to health state valuation. In G.
Teeling-Smith (ed.), Measuring Health: A practical approach. New York: John Wiley
and Sons, 1988, 6987.
10. Chakraborty, G., Gaeth, G., & Cummingham, M. Understanding consumer preferences
for dental services. Journal of Health Care Marketing, 1993, 21, 4858.
11. Cassileth, B. R., Zupkis, R. V., Sutton-Smith, K., et al. Information and participation
preferences among cancer patients. Annals of Internal Medicine, 1980, 92, 83236.
12. Cave, M., Burningham, D., Buxton, M. J., et al. The valuation of changes in quality in
public services. London: HMSO, 1994.
13. Donaldson, C., Shackley, P., Abdalla, M., & Miedzybrodska, Z. Willingness to pay for
antenatal carrier screening for cystic fibrosis. Health Economics, 1995, 4, 43952.
14. Dowie, J. Process utility can seriously damage your health service evaluation, but the
generic measure of benefit should include service outcomes. Paper presented to the
Health Economics Study Group, University of Glasgow, 1993.
15. Drakopoulos, S. A. Hierarchical choice in economics. Journal of Economic Surveys,
1994, 8, 13353.
16. Euroqol Group. Euroqol: A new facility for the measurement of health related quality
of life. Health Policy, 1990, 16, 199208.
17. Euroqol Group. Euroqol: A reply and reminder. Health Policy, 1992, 20, 32932.
18. Hannemann, W. Welfare evaluations in contingent valuation experiments with discrete
responses: Reply. American Journal of Agricultural Economics, 1984, 69, 33241.
19. Hensher, D. A. The practice of stated preference. Transportation, 1994, 21, 105.
20. Heyink, J., Tymstra, T., & Slooff, M. J. Liver transplantation: Psychosocial problems
following the operation. Transplantation, 1990, 49, 101819.
21. Hicks, F. D., Larson, J. L., & Ferrans, C. E. Quality of life after liver transplant. Research
in Nursing and Health, 1992, 15, 11519.
22. Interim data: Economic evaluation of the Liver Transplantation Programme in England
and Wales. Brunel University, 1997.
23. Kankaanpaa, J. Cost effectiveness of liver transplantation. Transplantation Proceedings,
1990, 22, 386466.
23. Kocur, G., Alder, T., Hyman, W., & Aunet, B. A guide to forecasting travel demand
with direct utility assessment. Washington DC: U.S. Department of Transportation, 1982.
24. Louviere, J., & Woodworth, G. Design and analysis of simulated consumer choice or
allocation experiments: An approach based on aggregate data. Journal of Marketing
Research, 1983, 20, 35067.
25. Lowe, D., OGrady, J. G., McEwen, J., & Williams, R. Quality of life following liver
transplantation: A preliminary report. Journal of the Royal College of Physicians of
London, 1990, 24, 4346.
26. Magat, W. A., Viscusi, W. K., & Huber, J. Paired comparison and contingent valuation
approaches to morbidity risk valuation. Journal of Environmental Economics and Man-
agement, 1988, 15, 395411.
27. McClain, J., & Rao, V. Trade-offs and conflicts in the evaluation of health system
alternatives: Methodology for analysis. Health Services Research, 1974, 9, 3552.
28. McFadden, D. Conditional logit analysis of qualitative choice behavior. Berkeley, CA:
University of California, 1973.
29. Mooney, G. Key issues in health economics, Hemel Hempstead: Harvester Wheat-
sheaf, 1994.
30. Mooney, G., & Lange, M. Ante-natal screening: What constitutes benefit. Social Science
and Medicine, 1993, 37, 87378.
31. Neuberger, J., & Lucey, M. R. Liver transplantation: Practice and management. London:
British Medical Journal Publishing Group, 1994.
32. Nord, E. The person trade off approach to valuing health care programs. Medical Decision
Making, 1995, 15, 20810.
33. Propper, C. The disutility of time spent on the United Kingdoms National Health Service
waiting lists. Journal of Human Resources, 1995, 30, 677700.
34. Rosser, R. M., & Kind, P. A scale of valuation of states of illness: Is there a social
consensus? International Journal of Epidemiology, 1978, 7, 34758.
35. Ryan, M. Using conjoint analysis to take account of patient preferences and go beyond
health outcomes: An application to in-vitro fertilization. Social Science and Medicine,
1999, 48, 535546.
36. Ryan, M., & Farrar, S. A pilot study using conjoint analysis to establish the views of users
in the provision of orthodontic services in Grampian. Health Economics Research Unit
Discussion Paper No. 07/94, Aberdeen, University of Aberdeen, 1994.
37. Ryan, M., & Hughes, J. Using conjoint analysis to assess womens preferences for
miscarriage management. Health Economics, 1997, 6, 26174.
38. Ryan, M., Ratcliffe, J., & Tucker, J. Using willingness to pay to value alternative forms
of antenatal care. Social Science and Medicine, 1997, 44, 37180.
39. Scott, A. Giving things up to have more of others. The implications of limited substitut-
ability for eliciting preferences in health and health care. Paper presented to the Health
Economics Study Group meeting, University of Sheffield, January 1998.
40. Surman, O. S., & Dienstag, J. L. Psychomatic aspects of liver transplantation. Psycho-
therapy and Psychomatics, 1987, 48, 2631.
41. Tymstra, T. Research into quality of life: A qualitative approach in the evaluation of a
liver transplantation programme. Health Policy, 1988, 10, 23140.
42. Tymstra, T. The imperative character of medical technology and the meaning of antici-
pated decision regret. International Journal of Technology Assessment in Health Care,
1989, 5, 20713.
43. Van der Pol, M., & Cairns, J. Establishing patients preferences for blood transfusion
support: An application of conjoint analysis. Journal of Health Services Research and
Policy, 1998, 3, 7077.
44. Vick, S., & Scott, A. What makes a perfect agent? A pilot study of patients preferences
in the doctor-patient relationship. Journal of Health Economics, 1998, 17, 587605.
45. Wardman, M. Route choice and the value of motorists travel time: Empirical findings.
Institute for Transport Studies Working Paper 224, University of Leeds, 1986.
46. Wardman, M. A comparison of revealed preference and stated preference models.
Journal of Transport Economics and Policy, 1988, 22, 7191.
47. Wind, Y., & Spitz, L. Analytical approach to marketing decisions in health care organi-
sations. Operations Research, 1976, 24, 97390.