Professional Documents
Culture Documents
Evaluating The Quality of Recreation Facilities: Development of An Assessment Tool
Evaluating The Quality of Recreation Facilities: Development of An Assessment Tool
net/publication/288846385
CITATIONS READS
35 4,917
7 authors, including:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Marlo M Vernon on 11 February 2016.
ABSTRACT: The purpose of this study was to develop a tool for assessing
the quality of public recreation facilities’ amenities. Knowing the location,
distribution, and quality of recreation facilities can assist administrators in
developing more effective programs for encouraging physical activity
across city, county, and state systems. Based on a literature review, expert
opinions, and professional standards, a tool was developed for assessing the
safety, condition, and maintenance of recreation facilities. A Geographic
Information System (GIS) database was developed to locate public recre-
ation facilities in a southeastern county of the United States. Objective
ratings of recreation facility quality were computed from the tool. Items on
the tool were tested for inter-rater reliability among three independent
raters. The findings demonstrated that overall the items in the tool were
reliable and effective in evaluating objective physical features of the
recreation facilities. Total Quality Management systems would benefit
from the addition of an objective component to the evaluation of facility
quality. The tool also provides a means of evaluating park quality over time,
and can be modified to focus on users of particular ages, or for families
versus individual users. Parks and recreation agencies have an important
role to play in developing environmental supports for physical activity that
may aid in reducing the national epidemic of obesity and related chronic
diseases.
Introduction
Recreation and park professionals evaluate their programs and facilities
in a number of ways. Traditionally the focus has been on assessing the
number of facilities or the number of participants in a program. Ultimately,
professionals want to know whether or not their programs and facilities
have been successful. Assessing the quality of facilities and the outcomes for
those who participate is necessary for the attainment of managerial goals
and objectives, ascertaining the benefits of recreation facilities and pro-
grams, and for evaluation purposes relative to accountability. The primary
purpose of the present study was to develop a tool for assessing the quality
of recreation facility amenities.
A Total Quality Management (TQM) system incorporates numerous
approaches to creating and maintaining a superior quality of service.
According to Jaten and Driver (1998), a Total Quality Management
(TQM) system is made up of three important aspects. One is the need to
develop a customer approach to management, focusing on the needs of the
consumers, which in this case are the recreation facility users. This sort of
approach however, also takes into account the needs and wants of all
potential users. In promoting physical activity through recreation depart-
ments and parks, a TQM approach is feasible and useful. A second aspect
of a TQM system is that “high quality recreation opportunities should be
provided for all types of customers” (Jaten & Driver, 1998). Developing
and measuring clear quality objectives, is a third aspect important for
developing an effective TQM system, according to Jaten and Driver
(1998). Use of the developed tool as part of a system-wide TQM approach
to management enhances the ability of recreation managers and adminis-
trators to reach the needs of all their users, including adults, children,
seniors, and families. The tool encompasses the condition, safety, and
maintenance of the various features of recreation facilities which might be
utilized by participants for physical activity.
The influence of the physical environment on physical activity is an area
of increasing public health interest. A variety of environmental factors such
as the absence of affordable recreational facilities and/or the lack of parks
or sidewalks may be associated with physical inactivity. Sallis, Bauman, and
Pratt proposed the explicit study of the physical environment as a key factor
98
Literature Review
A literature review was conducted to locate evaluation tools and
established industry standards for the evaluation of recreation facilities.
Recreation professionals were also contacted concerning how they evalu-
ated their facilities and whether they had standards for the physical
condition of their facility. Most of the information found utilized evalua-
tion methods based on user perceptions rather than objective data, which
was the goal of this study .
Several resources were identified that provided guidelines for measur-
ing the objective physical environment of recreation facilities. Guidelines
for assessment included evaluating frequency of equipment maintenance,
sports field layout and maintenance, cleanliness, lighting, safety, and
adequacy of playground equipment (National Association for Sport and
Physical Education; National Program for Playground Safety). Several
position papers and general standards provided suggestions for evaluating
the aquatic-related aspects of the recreational facilities such as the availabil-
ity and adequacy of lifeguards and safety equipment. Results from the
literature review suggested three specific categories of recreation facilities
that were incorporated into the evaluation tool: condition, safety, and
maintenance.
Quality of Recreation Facility Tool Items
Based on the literature review, expert opinions, and accepted profes-
sional standards, the main aspects of facilities identified and included in the
tool were Parks, Playgrounds, Sports Fields, Aquatic Facilities/Pools, and
Recreation Centers. Each park and recreation center was rated with respect
to safety, condition, and maintenance of the facility (Table 1). The
evaluation tool was developed for facilities in a medium-sized county
99
100
101
ment. Every public facility in the county (n = 27) was assessed and stored
in a GIS database. Information (e.g., overall scores) collected with the tool
was later added to the GIS database as attributes of each facility.
Data Analyses
Kappas were computed in Statistical Analysis System (SAS) version
8.02 to determine inter-rater reliability of the facility assessment tool by
individual items, items by categories (condition, maintenance, and safety),
and for all items. A kappa value of at least 0.61 was required for substantial
agreement between the three raters. A Spearman correlation was run on the
average condition, maintenance, and safety scores to determine if a
relationship existed among the three categories.
Results
Evaluations of these facilities indicated substantial agreement among
the three raters for condition (kappa=0.77), maintenance (kappa = 0.68),
and safety (kappa = 0.77) categories. An overall kappa computed for the
combined condition, maintenance, and safety categories was high (kappa
= 0.80). For individual items on the tool, kappa values ranged from –0.02
to 1.00 (Table 1). Many facilities did not have sports fields and the lower
kappa values for individual items were from sports fields. No public aquatic
facilities were identified in the county. Maintenance and safety items on the
tool were correlated (r = 0.403, p = 0.02), but overlapping categories were
not correlated. The condition items on the tool measured features indepen-
dent from the maintenance or safety items, as condition items were not
significantly associated with either the maintenance or safety category.
Utilizing the GIS data, geographic distributions of facility quality did
not vary for the county. A map of the city located within the county,
however, revealed geographical regions that varied in the quality of the
recreation facilities with the highest ratings located in the western part of
the city and the lowest ratings located in the eastern part of the city (Fig.
1).
Discussion
The results of this study demonstrate that the evaluation tool is reliable
in assessing the quality of recreation facilities. The items with a significant
inter-rater reliability (kappa > 0.6) included the restroom facilities and
cleanliness, drinking fountains, park equipment and amenities, landscape
maintenance, playground equipment and safety, presence of litter, tennis
and basketball court maintenance, baseball fields, and other features
associated with safety. Most items in the recreation facility evaluation tool
were observed to be easy to use and effective for evaluating the major
physical features in a recreation facility. Some items were correlated, such
as safety and maintenance items. This correlation was to be expected since
the safety of specific features was somewhat dependent on the level of
maintenance. The items related to the condition of the facilities were useful
and evaluated different aspects of the facilities, such as cracks in the concrete
of outdoor sports courts and unevenness of playing fields.
104
Figure 1
Map of city located in southeast United States represents east and west
location of public recreation facilities and overall scores for combined
condition, maintenance, and safety ratings assessed with the evaluation
tool.
105
PARKS
No Yes
Safety
Is the park of adequate size and space for its
intended purpose? ❑ ❑
Is the park free of any detectable safety hazards? ❑ ❑
Attractiveness
Is the park clean and free of litter, debris, graffiti, etc? Poor FairGood
_____________________________________ ❑ ❑ ❑
No Yes
Does the park equipment appear to be well maintained
and in good condition? ❑ ❑
Does the park landscape appear to be well maintained
and in good condition? ❑ ❑
106
No Yes
Does the park have landscape features that make it a
more enjoyable place to be? (Variety of trees,
flowers, plants. Some grassy areas. Some shaded areas.) ❑ ❑
PLAYGROUNDS
No Yes
Safety
Is there adequate fill under the equipment?
• Fill should be 12-inches deep and extend six feet in all directions
• Slides should be no taller than 10-feet.
• For slides taller than 4-feet, fill should extend 4-feet beyond the
height of the slide. ❑ ❑
(Ex. A 7-foot slide should have fill extending out 11-feet in all
directions.)
For swingsets
Are there no more than 2 swings per bay area? ❑ ❑
Are the swings at least 24” apart? ❑ ❑
Are the swings at least 30” from side supports? ❑ ❑
Condition
Is the playground area free of litter or dangerous debris?
(Broken glass, sharp objects, chemicals, etc.) ❑ ❑
Is the equipment free of damage?
(Is not broken or missing any parts) ❑ ❑
Is the playground equipment free of any protruding
bolts, screws, nails, or fixtures? ❑ ❑
SPORTS FIELDS
Football Fields No Yes
Number of football fields at this location: ________
Does the field appear level? ❑ ❑
Is the field adequately maintained (mowed, watered, etc.)? ❑ ❑
The field is free of places where the turf appears thin
or worn? ❑ ❑
There is no evidence of puddles or muddy areas in the
field following a rain? ❑ ❑
107
No Yes
Are the yardage lines and goal lines clearly marked? ❑ ❑
Are there goal posts at each end of the field? ❑ ❑
Is the field lighted? ❑ ❑
Tennis Courts
Number of tennis courts at this location: ________
Is the court surface smooth and free of cracks? Poor Fair Good
❑ ❑ ❑
108
No Yes
If the surface has cracks, are the cracks repaired well? ❑ ❑
The court is free of weeds and grass shoots choking
through the surface? ❑ ❑
The court is free of obvious low spots?
(No evidence of water pooling after a rain?) ❑ ❑
Is the court sufficiently maintained for use? ❑ ❑
Is the court lighted? ❑ ❑
AQUATIC FACILITIES/POOLS
General No Yes
Is the facility clean? ❑ ❑
Is the concrete hosed off and swept? ❑ ❑
Are restrooms available? ❑ ❑
Are drinking fountains available? ❑ ❑
Safety
Are lifeguards present? ❑ ❑
Is safety and first aid equipment in good condition
and easily accessible? ❑ ❑
Are the pool rules posted conspicuously? ❑ ❑
Is an Emergency Action System plan posted and/or
readily available? ❑ ❑
109
No Yes
Is there an accessible and visible phone for calling EMS? ❑ ❑
Is there a fence around the edge of the facility that is
at least 6’ high, continuous, and unobstructed? ❑ ❑
RECREATION CENTERS
No Yes
General
Are restrooms available? ❑ ❑
Is the rec center, including the restrooms, clean? ❑ ❑
Is a drinking fountain available? ❑ ❑
Safety
Are the recreation center staff visible and available? ❑ ❑
Does the rec center have first aid station(s)
and/or supplies? ❑ ❑
Are the rec center staff certified in CPR/First Aid? ❑ ❑
Indoor Facility/Gym
Is the gym floor clean? ❑ ❑
Is the gym well lit? ❑ ❑
Weight Room
Are weight room rules and guidelines conspicuously
posted? ❑ ❑
Is the weight room clean and neat? ❑ ❑
WALKING/BIKING TRAIL
What is the distance of this trail? __________ miles
What is the surface of the trail?
❑ Concrete/Asphalt ❑ Dirt
❑ Crushed granite/rock ❑ Composite
❑ Mulch or Wood Chips ❑ Other
No Yes
Does the trail include interpretive signs? ❑ ❑
110
Not all items were assessed reliably. These included cleanliness of parks,
adequate park size, equipment damage at playgrounds, and evaluation of
swing set safety. For example, items relative to sports fields and cracks in
outdoor basketball courts and tennis courts revealed minimal agreement
among raters. Reasons for the lower reliability in assessing these features
may be due to small sample size surveyed and/or inadequate rater training.
The findings of the tool were not associated with physical activity levels
in a sub-sample of community residents that were surveyed in the larger
ongoing study. The questions asked regarding recreation facility condition,
however, were not designed to assess physical activity specifically in
relationship to recreation facility quality (Kirtland et al., 2003). It may also
be that the geographical area was too small to demonstrate a direct
association between recreation facility quality and physical activity levels. In
addition, residents may be engaging in physical activities that do not involve
recreational facilities. Further research is needed to better understand how
improvements in recreational amenities will specifically impact physical
activity in communities.
Professional Implications
Total Quality Management. The implications of this study are impor-
tant for recreation professionals, public health providers, and community
leaders who are committed to the development of effective programs for
health promotion and disease prevention by increasing the use of recreation
facilities for physical activity. Use of the tool within a total quality
management system (TQM) is an appropriate application of the tool.
The steps to using this tool in a TQM approach begin with the
identification of the recreation facilities in a particular management system,
and the statement of the department’s goals and objectives. In this study,
the objective was to evaluate physical condition of recreation facilities
important to physical activity. Once the features and facilities have been
identified and possibly mapped into a GIS system, the tool could then be
applied and the results compiled. After prioritizing the results to the
management’s goals and objectives, a budget would then be developed to
support the appropriate actions to renovate the facilities or change proce-
dures to better meet those goals and objectives. Once the changes have
taken place, the tool could then be used to monitor, measure, and report
on ongoing facility quality on an individual basis and a system-wide basis.
A system-wide use of this tool allows recreation administrators and
facility managers the opportunity to pinpoint strengths or weaknesses
across the department or on an individual facility basis. If a facility has an
excellent playground, but poor outdoor basketball facilities, managers may
need to examine why the discrepancy remains and discuss ways to improve
the quality of the features and thus the facility. This improvement would
encourage families to use this facility, by having an area for older children
or adults to play basketball while younger children are on the playground.
The tool may also reveal that many of the lower quality facilities are in a
certain region, rather than being evenly distributed. This could be due to
111
poor management or a lack of funds for this region. In either case, to reach
all potential users effectively and consistently across the entire department,
plans to improve the quality of such regions should be undertaken. Should
an area of high quality facilities be located, investigation into management
practices or funding issues within that region would also be appropriate to
use as a model for improving the overall system quality.
Using this tool in tandem with a perception survey of users and non-
users is necessary for a complete evaluation. By surveying both users and
possible users of recreation facilities, a more comprehensive public percep-
tion of recreation facility presence and quality is attained. Wright, Duray,
and Goodale (1992) developed a perception survey that focused on service
quality with a section on “tangibles,” or physical qualities. This section
could be adopted, or the entire survey used to substantiate the objective
evaluations. Knowing the public perception of the invested stakeholders in
the community would be useful in determining a priority of quality issues.
For instance, perhaps most users perceive a poor quality of the recreation
centers in the system, while at the same time the tool reveals changes in the
quality of tennis courts and recreation centers is justified. Since the public
perception focuses more heavily on recreation centers, measures to improve
their quality over that of the tennis courts could then be justifiably
prioritized. Once changes have occurred, continually surveying users
would be a necessary step to ensure that public perception has changed. If
it has not, reasons why should be investigated. Parks and recreation
professionals seek to improve the quality of their facilities for current users
and to attract new users. Thus, surveying all potential users and combining
the objective measures of the tool allows for a prioritizing of actions to
improve quality.
Evaluation of facility quality over time is another application of the tool
within a TQM system. By having a standard evaluation tool, changes to
quality over time can be identified. This evaluation includes documenting
changes before and after the removal or addition of features. If changes
were made to improve the quality, the results should indicate better
features. If no changes were made, but a negative decline in quality is
observed, steps could then be taken to improve the quality to prevent
similar declines.
By using the tool to evaluate the quality of features and facilities, the
current user base satisfaction with facility quality is maintained. Increasing
the user base is likely with adequate promotion and communication.
Recognizing deficiencies in quality data also allows managers and admin-
istrators to adapt the facilities to meet the needs of various user types.
Accountability. Accountability is important to the overall success of
recreation facilities and programs. Various stakeholders deserve to be
informed regarding the quality of the recreation facilities they both fund
and frequent. Presenting the results of this tool to a Parks and Recreation
Board regarding the quality of the physical features within the department
is one way of maintaining that accountability. Another way is to present to
112
References
Aquatic Council (2002a). Professional standards for management of aquatic
facilities: A position paper of the Aquatic Council, American Association for Active
Lifestyles and Fitness, and American Alliance for Health, Physical Education,
Recreation, and Dance (Position Paper). Reston, VA: Aquatic Council, AAALF/
AAHPERD.
Aquatic Council (2002b). Professionalism for the aquatics practitioner: A
position paper of the Aquatic Council, American Association for Active Lifestyles and
Fitness, American Alliance for Health, Physical Education, Recreation, and Dance
(Position Paper). Reston, VA: Aquatic Council, AALF/AAHPERD.
Centers for Disease Control and Prevention (CDC) (1999). Neighborhood
safety and the prevalence of physical activity—selected states, 1996. Morbidity and
Mortality Weekly Report, 47, 143-146.
Cohen, A. (2000, July). Feet first. Retrieved October 15, 2001, from the
World Wide Web: www.athleticbusiness.com.
Fisk, D. M., & United States Department of the Interior (1973). How effective
are your community recreation services? Washington, D.C.: US Government Print-
ing Offices.
Henderson, K., Neff, L., Sharpe, P., Greaney, M., Royce, S., Ainsworth, B.
(2001). "It takes a village" to promote physical activity: The potential for public
park and recreation departments. Journal of Park and Recreation Administration,
19(1), 23-41.
Jaten, A., & Driver, B. L. (1998). Meaningful measures for quality recreation
management. Journal of Park and Recreation Administration, 16(3), 43-57.
Kirtland, K. A, Porter, D. E, Addy, C. L, Neet, M. J, Williams, J. E, Sharpe P.
A, et al. (2003). Environmental measures of physical activity supports, perception
versus reality. American Journal of Preventive Medicine, 24(4), 323-331.
Landis, J., & Koch, G. G. (1977). The measurement of observer agreement
for categorical data. Biometrics, 33, 159-174.
MacDougall, C., Cooke, R., Owen, N., Wilson, K., & Bauman, A. (1997).
Relating physical activity to health status, social connections, and community
facilities. Australian New Zealand Journal of Public Health, 21, 631-637.
National Association for Sport and Physical Education (July 2001). Guidelines
for Facilities, Equipment and Instructional Materials in Elementary Education. A
Position Paper from the National Association for Sport and Physical Education.
National Association for Sport and Physical Education. Retrieved October 15,
2001, from the World Wide Web: www.aapherd.org/NASPE/pdf_files/
pos_papers/instructional_mat.PDF.
National Program for Playground Safety (1999). America's Playgrounds
Safety Report Card: National Program for Playground Safety.
National Program for Playground Safety (2001). Equipment should be safe:
maintenance suggestions for keeping your children safer on public playgrounds
(brochure). Cedar Falls, Iowa: National Program for Playground Safety.
O'Sullivan, E. (1996). The four E's: Changing roles for parks and recreation.
Parks and Recreation, 10, 60-67.
Peterson, J. A., & Tharret, S. J. (1997). American College of Sports Medicine's
Health/Fitness Facility Standards and Guidelines (2 ed.). Champaign, IL: Human
Kinetics.
Sallis, J., Bauman, A., & Pratt, M. (1998). Environmental and policy interven-
tions to promote physical activity. American Journal of Preventive Medicine, 15,
379-397.
114
Sallis, J., Johnson, M., Calfas, K., Caparosa, S., & Nichols, J. (1997). Assessing
perceived physical environment variables that may influence physical activity.
Research Quarterly for Exercise and Sport, 68(4),345(347).
Scott, D., & Munson, W. (1994). Perceived constraints to park usage among
individuals with low incomes. Journal of Park and Recreation Administration,
12(4), 79-96.
Solecki, W. D., & Welch, J. M. (1995). Urban parks: Green spaces or green
walls? Landscape and Urban Planning, 32, 93-106.
South Carolina, State of. (2000). South Carolina code of regulations, chapter
61 Department of Health and Environmental Control, public swimming pools.
(Code of Regulations). Columbia, SC: State of South Carolina, Department of
Health and Environmental Control.
Stephens, T., & Caspersen, C. (1994). The demography of physical activity.
In C. Bouchard, & R.J. Shephard, & T. Stephens (Eds.), Physical activity, fitness,
and health (pp. 204-213). Champaign, IL: Human Kinetics.
United States Consumer Product Safety Commission (2001). Tips for Play-
ground Safety (Publication #324). Washington, DC: United States Consumer
Product Safety Commission.
United States Census Bureau (2000). Summary File 4 (SF 4) - Sample Data.
Census 2000 Retrieved April 15, 2003 from the World Wide Web: http://
factfinder.census.gov/servlet/BasicFactsServlet.
Van der Smissen, B. (1972). Evaluation and self-study of public recreation and
parks agencies. Arlington, VA: National Recreation and Parks Association.
Wright, B., Duray, N, & Goodale, T. (1992). Assessing the perceptions of
recreation center service quality: An application of recent advancements in service
quality research. Journal of Parks and Recreation Administration, 10(3), 33-47.
Yuen, B. (1996). Use and experience of neighborhood parks in Singapore.
Journal of Leisure Research, 28(4), 293-311.
View publication stats