Professional Documents
Culture Documents
User Library Service Expectations in Health Science vs. Other Settings: A Libqual+® Study
User Library Service Expectations in Health Science vs. Other Settings: A Libqual+® Study
User Library Service Expectations in Health Science vs. Other Settings: A Libqual+® Study
Abstract
Objectives: To explore how the library service expectations and perceptions of
users might differ across health-related libraries as against major research
libraries not operating in a medical context; to determine whether users of
medical libraries demand better library service quality, because the inability of
users to access needed literature promptly may lead to a patient who cannot be
properly diagnosed, or a diagnosis that cannot be properly treated.
Methodology: We compared LibQUAL+® total and subscale scores across
three groups of US, Canadian and British libraries for this purpose.
Results: Anticipated differences in expectations for health as other library
settings did not emerge.
Conclusions: The expectations and perceptions are similar across different
types of health science library settings, hospital and academic, and across other
general research libraries.
to (a) Service Affect, (b) Library as Place, and convenience, ease of navigation, and the availability
(c) Information Control. Each item is rated of modern equipment; and last, library as place
with respect to (a) minimally acceptable service measures the availability of utilitarian space,
expectations, (b) desired service expectations, and symbolic aspects of the library structure and the
(c) perceived level of actual service quality ... notion of library as refuge. The ‘how’ these things
Second, the LibQUAL+® protocol solicits open- are measured has roots in the disconfirmation
ended comments from users regarding library theory that has shaped the development of the
service quality ... These comments are crucial, SERVQUAL instrument, by emphasizing the gap
because here the participants elaborate upon between expectations and perceptions. Expectations
perceived strengths and weaknesses, and sometimes are viewed as existing in a continuum of tolerance,
offer suggestions for specific actions to improve with the lowest point defining minimum expectations,
service. Third, libraries using LibQUAL+® have up to the other end of the zone of tolerance where
the option of selecting five additional items from desired expectations are found. To illustrate this
a supplementary pool of 100+ items to augment the framework, Fig. 1 shows a screenshot of the
22 core items to focus on issues of local interest.’9 LibQUAL+® survey demonstrating that, for
each concept measured, we have three scales
There are two key aspects in understanding (i) minimum, (ii) desired and (iii) perceptions of
LibQUAL+®: (i) what LibQUAL+® measures actual service delivery.
and (ii) how LibQUAL+® measures. Affect of The additional availability of the comments box
service includes elements of empathy, responsiveness, has been a rich source of contextual information.
assurance and reliability; information control In our experience, a strikingly high percentage—
measures the scope of collections, timeliness, about 40%—of participants consistently across
institutions provide open-ended comments using resources on his or her own. The ability to
the LibQUAL+® comments box. Libraries have effectively use information resources in a self-
been able to act immediately on some issues as sufficient manner may make it easier for many
they receive feedback in real time and as users are users to by-pass the library and is an international
providing reasonable and constructive suggestions. phenomenon that may be affected by the global
One unique feature of LibQUAL+® as a service nature of information exchange and dissemination.
quality assessment tool is that LibQUAL+® data The possibility of a link between modernization
can be evaluated using any combination of three and self-sufficiency may also exist and may be felt
interpretation frameworks: (i) location of percep- more acutely in areas with longer history behind
tions within the ‘zones of tolerance’ defined by them, for example European settings. The
minimally acceptable and desired expectations, (ii) desire of researchers to move forward faster and
benchmarking against peer institutions, and (iii) “modernize” may affect their perceptions and
by comparing changes in a given institution’s data expectations in those settings.’11
longitudinally over time.
In the 8 years since its inception in 20005,
Health science libraries
LibQUAL+® is on track to be used to collect data
in 2007 from the one millionth library user from In 2004, the first academic Swedish library
the 1000th institution! LibQUAL+® now has participated in LibQUAL®, and the first group of
been used in the USA, Canada, Australia, New three Swedish hospital libraries also participated
Zealand, the UK (England, Scotland, Wales), that year, in addition to seven hospital libraries
France, Ireland, the Netherlands, Switzerland, from the USA. This was the first group to
Germany, Denmark, Finland, Norway, Sweden, implement LibQUAL+® in the hospital library
Egypt, the United Arab Emirates, and South environment.
Africa. A Chinese version is being implemented Academic health science libraries have par-
in Hong Kong in the autumn of 2007. Currently, ticipated in LibQUAL+® since 2001. They make
the system supports 12 languages: Afrikaans, US up 62 institutions among a total of 1036 primarily
English, UK English, Chinese (traditional), academic and other types of libraries. The
Danish, Dutch, Finnish, French (Canadian), French Association of Research Libraries (ARL) has
(European), German, Norwegian, and Swedish. closely collaborated with the Association of
Library participants believe that LibQUAL+® Academic Health Science Librarians (AAHSL)
data have been useful in improving library service group in North America to modify LibQUAL+®
quality.9,10 But this vast trove of data from across for the academic health science library environment.
continents and library types also is a major In 2006, a group of 10 libraries from the National
resource for understanding the contemporary Health Service (NHS) England also experimented
library users’ perceptions of the modern library. with a pilot implementation. In summarizing the
As library users are exposed to more international benefits of the AAHSL/ARL partnership, Tamera
information delivery systems, their expectations Lee highlights the following:
are shaped by the same forces. They end up having
similarly high expectations, whether they are using ‘The AAHSL/ARL partnership effected numerous
institutional resources in North and South America, qualitative benefits aside from the data results.
Europe, Asia, Africa or Australia. The conclusions For ARL, it assisted in furthering the applicability
from a detailed institutional study in Sweden state that: of LibQUAL+® as a qualitative assessment tool
across different types of institutions. The special
‘Library users in Sweden have indicated that the [AAHSL] cohort assisted ARL with promotion,
information control dimension is an important training, and increased participation. For AAHSL,
one to them and this is the one dimension where the partnership created a heightened awareness
libraries are not faring well.... The “new library of the viability of outcomes assessment and a
user” may be a highly self-sufficient researcher who cost-efficient protocol for listening to users. The
navigates the Internet and identifies information additional five questions allowed AAHSL to
include constructs for issues perceived as unique practices with the ultimate goal of improving
or more significant to health science libraries. It service quality. The NHS pilot was part of the
prompted further interest in testing the instrument’s work programme developing the National Service
feasibility for a new cohort of hospital libraries. Framework that attempts to define what users
And, perhaps most importantly, with a strong should expect from library services.
service orientation already in place, implementing Increased competition for resources has moved
a national survey contributed to the advancement libraries more forcefully towards assessment and
of a culture of assessment and placed the academic the evidence-based movement. Evidence-based
community at the centre of that assessment.’12 librarianship, for example, has influenced a large
part of the health science library field. Performance
Additional information on specific libraries’ measurement, service quality improvement and
implementation activities are summarized in service quality assurance are some other ways
articles describing the implementations at Mercer that information providers are more consciously
University School of Medicine13, at the University examining the impact of their work on their
of Colorado Health Sciences Center14, at Duke communities and the value they bring to their
University15 and at the Galter Health Sciences professional environments.18
Libraries at Northwestern University.16
Purpose of the study
The NHS pilot
The present study was undertaken to use
The NHS pilot with the LibQUAL+® survey LibQUAL+® data to explore how the library
was a natural outgrowth of the successful service expectations and perceptions of users
implementation of LibQUAL+® with the academic might differ across health-related libraries as
libraries in the UK as they have been coordinated against major research libraries not operating in
by Stephen Town through the Society of College, a medical context. We compared LibQUAL+®
National and University Libraries (SCONUL).17 total and subscale scores across three groups of
NHS is the largest organization in Europe, with libraries for this purpose.
1.3 million staff (and the third-largest organization Theoretically, it might be expected that users of
in the world). They have different types of Trusts: medical libraries demand better library service
Acute Trusts which are hospital-based, Primary quality, because the inability of users to access
Care Trusts (PCTs) which are mainly community needed literature promptly may lead to a patient
based, Mental Health Trusts that combine elements who cannot be properly diagnosed, or a diagnosis
from the first two, Ambulance Trusts, and NHS that cannot be properly treated. Such failures may,
Direct which comprises telephone and online indeed, have life-threatening consequences. Such
services. At the local level they are organized under demands might lead to (i) higher minimum service
Strategic Health Authorities (SHA) which may have quality expectations, (ii) higher desired service
multiple service providers under their jurisdiction quality expectations, and (iii) narrower zones of
(for example, in 2003, the Avon Gloucestershire tolerances. Furthermore, if medical libraries obtain
and Wiltshire SHA included 25 different service greater resources in light of these expectations,
providers and more than 20 000 staff). user average perceptions in such settings may also
The quality agenda was one of the major drivers be more favourable than the perceptions of users
in the NHS pilot, as they are focusing on patient- working in other environments.
centred NHS and evidence-based practice. The
focus on the quality agenda clearly has implications
Results
for library staff in delivering high-quality informa-
tion and summarized evidence to library users. The samples consisted of (i) 697 participants from
One of the attractive features of LibQUAL+® for 10 libraries from the NHS operating within the
the NHS group is the ability to benchmark UK, (ii) 4330 participants from US institutions
across sites and the facilitation of sharing of best belonging to the Association of Academic Health
Science Libraries (AAHSL), and (iii) 21 302 Table 1 Cronbach’s α coefficients for total and scale scores
participants from US and Canadian non-health
British American ARL
libraries that are members of the Association of
Score NHS Health Non-health
Research Libraries (ARL). ARL is an organization
of the leading 123 research libraries in the USA Information Control 0.90 0.93 0.90
and Canada. AAHSL is a similar institutional Service Affect 0.95 0.95 0.94
association that encompasses about 130 academic Library as Place 0.88 0.91 0.88
health science libraries as members. NHS is one of Total 0.95 0.96 0.96
Table 2 Means (and standard deviations) for LibQUAL+® total and subscale scores across the three library types
the Table 1 results suggest that LibQUAL+® expectations but relatively the least satisfaction
provides reliable scores, even in specialized health with respect to Information Control.
libraries, such as some of the libraries of NHS These results reflect the inescapable reality that
England. The tabled reliability coefficients are the Web has fundamentally altered the way that
comparable with those obtained in other users think about libraries, and their expectations
psychometric studies.21–25 Thus, the LibQUAL+® regarding ubiquity of access to comprehensive
protocol is at least one reasonable assessment information, in the form they want, with the
candidate for use in the health library context. Of immediacy they demand. This evolution was
course, user-orientated library staff listen to users presaged within the qualitative studies providing
in multiple ways, and triangulate the messages the initial grounding of LibQUAL+® within the
they hear across the ways of listening to users. mindset of library users. As one user commented
So, LibQUAL+® should be viewed as one way in describing how he thinks about library staff:
of measuring service quality available to health ‘Well, first of all, I would turn to the best search
libraries among many other methods that can also engines that are out there. That’s not a person so
be deployed. much as an entity. In this sense, librarians are
Second, anticipated differences in expectations search engines [ just] with a different interface.’27
for health as against other library settings did not Similarly, the qualitative comments published
emerge, as reflected in the Table 2 results. In all from the Swedish Lund Institute of Technology
three groups, the Information Control dimension resonate similar issues from the library users who
had the highest means on the desired ratings (8.03, provided comments to the survey: ‘My requirements
8.26 and 8.24 for the NHS, AAHSL and ARL for library services have changed considerably in
data, respectively). In all three groups, the ‘ade- the last 10 years. Earlier I used to visit [the library]
quacy gap divided by the zone of tolerance width’ at least once a week and got the information on
scores were appreciably lower on the Information paper. During the last 3 or 4 years I haven’t been in
Control scores (i.e. 0.06, 0.15 and 0.13, respectively) the library.’11
than on the other two subscales (i.e. Service Affect In all three groups, participants had the lowest
and Library as Place). Thus, users had highest means on desired ratings of Library as Place (i.e.
17 Lock, S. & Town, S. J. LibQUAL™ in the UK: a brief perceptions of library service quality. Library Trends 2001,
report on the UK pilot. SCONUL Newsletter 2003, 29, 49, 585–604.
8–10. 23 Thompson, B. Cook, C & Thompson, R. L. Reliability and
18 Eldredge, J. Evidence-based librarianship: an overview. structure of LibQUAL+™ scores: measuring perceived
Bulletin of the Medical Library Association 88, 289 –302. library service quality, Portal: Libraries and the Academy
19 Thompson, B. (ed.). Score Reliability. Thousand Oaks, 2002, 2, 3–12.
CA: Sage, 2003. 24 Bruce T. & Colleen, C. Stability of the reliability of
20 Thompson, B., Kyrillidou, M. & Cook, C. How you can LibQUAL+™ scores: a ‘reliability generalization’
evaluate the integrity of your library service quality data: meta-analysis study. Educational and Psychological
intercontinental LibQUAL+® analyses used as concrete Measurement 2002, 62, 735–43.
heuristic examples. In: 2006 Proceedings of the Library 25 Thompson, B., Cook, C. & Kyrillidou, M. Concurrent
Assessment Conference: Building Effective, Sustainable, validity of LibQUAL+™ scores: what do LibQUAL+™
Practical Assessment. Washington DC. Association of scores measure? Journal of Academic Librarianship 2005,
Research Libraries 2007: 15 –31. 31, 517–22.
21 Cook, C., Heath, F., Thompson, R. L. & Thompson, B. 26 Thompson, B. Foundations of Behavioral Research: An
Score reliability in web- or Internet-based surveys: Insight-Based Approach. New York City: Guilford, 2006.
unnumbered graphic rating scales versus Likert-type scales. 27 Cook, C. & Heath, F. Users’ Perceptions of Library Service
Educational and Psychological Measurement 2001, 61, 697– Quality: A ‘LibQUAL+™’ Qualitative Study. Library
706. Trends 2001, 49, 554–5.
22 Cook, C. & Thompson, B. Psychometric properties of
scores from the web-based LibQUAL+™ study of Received 6 June 2007; Accepted 13 September 2007