Download as pdf or txt
Download as pdf or txt
You are on page 1of 16

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/242722247

Scriptapedia : a digital commons for documenting and sharing group model


building scripts

Article · January 2010

CITATION READS

1 174

6 authors, including:

Peter S. Hovmand George P Richardson


Washington University in St. Louis University at Albany, The State University of New York
85 PUBLICATIONS   2,585 CITATIONS    81 PUBLICATIONS   5,043 CITATIONS   

SEE PROFILE SEE PROFILE

Etiënne A. J. A. Rouwette
Radboud University
102 PUBLICATIONS   2,013 CITATIONS   

SEE PROFILE

Some of the authors of this publication are also working on these related projects:

Modelling Complexity: An Interactive Approach View project

Evaluation of a Community Based Rehabilitation program for persons with disabilities in Afghanistan View project

All content following this page was uploaded by Etiënne A. J. A. Rouwette on 16 April 2018.

The user has requested enhancement of the downloaded file.


Systems Research and Behavioral Science
Syst. Res. 29, 179–193 (2012)
Published online in Wiley Online Library
(wileyonlinelibrary.com) DOI: 10.1002/sres.2105

■ Research Paper

Group Model-Building ‘Scripts’ as a


Collaborative Planning Tool
Peter S. Hovmand1*, David F. Andersen2, Etiënne Rouwette3,
George P. Richardson2, Krista Rux1 and Annaliese Calhoun1
1
Washington University in St. Louis, Washington, MO, USA
2
University at Albany, State University of New York, USA
3
Radboud University Nijmegen, Nijmegen, The Netherlands

Group model building (GMB) is a participatory method for involving stakeholders in the
process of developing system dynamics models. GMB has historically consisted of undocu-
mented structured small-group exercises. This paper describes an effort to document GMB
scripts called Scriptapedia, and how documented GMB scripts can be used to design more
effective GMB sessions that address cultural and ideological barriers to collaboration. A case
study of a project to develop a coordinated community response to domestic violence is used
to illustrate the use of scripts for planning collaboration. The paper concludes with a discus-
sion of potential limitations of scripts and implications for future research. Copyright © 2012
John Wiley & Sons, Ltd.
Keywords group model building; scripts; participatory system modelling; system dynamics

INTRODUCTION relationships and the interaction of feedback


mechanisms (Dörner, 1997; Sterman, 2000). For-
Developing effective collaborations often entails mal models1 help stakeholders improve their
identifying and aligning the incentives specific mental models by seeing and simulating the
to a given problem (Barrett, 2007). This can be behavior of a system better. This allows stake-
especially challenging in dynamically complex holders to develop collaborations by gaining sys-
systems where the incentives evolve over time. tem insights into a problem through the
People typically invoke a set of mental models development and analysis of a common model.2
(e.g. Johnson-Laird, 1983; Doyle and Ford, 1998) There are a variety of approaches for developing
to solve problems that consistently underestimate and simulating formal models of complex systems
the effects of delays, accumulations, nonlinear (for an overview, see Pidd, 1998; Gilbert and
1
Examples of formal models that allow stakeholders to see and simu-
late a system include discrete event simulation models, agent-based
* Correspondence to: Peter S. Hovmand, Social System Design Lab, models and system dynamics models.
George Warren Brown School of Social Work, Washington University 2
A model is ‘common’ in the sense that it is objectively and indepen-
in St. Louis, Box 1009, 700 Rosedale Ave., St. Louis, MO 63112, USA. dently available to all stakeholders. This does not imply that all stake-
E-mail: phovmand@wustl.edu holders endorse a common model.

Copyright © 2012 John Wiley & Sons, Ltd.


RESEARCH PAPER Syst. Res.

Troitzsch, 2005). However, concerns are sometimes classic statement of the GMB method for system
raised about the use of formal models when seek- dynamics models. Soon thereafter, a special issue
ing to develop effective collaborations including of the System Dynamics Review edited by Vennix
the lack of transparency and inability to evaluate et al. (1997) gave an overview of the then state-of-
the underlying assumptions behind a model, ques- the art of GMB. Eden and Ackermann (1998)
tions about appropriate conceptualization of the have described formal procedures for using soft-
problem and system boundary and the difficulty ware tools such as Decision Explorer and Group
of actually implementing the results from a formal Explorer to structure group processes around
model analysis when collaboration is required to formal model-building activities, and Howick
implement the solutions. One approach to addres- et al. (2006) have documented procedures for for-
sing these is to involve stakeholders in the process mally integrating strategic scenarios into system
of developing and analysing the formal model dynamics models while working in formal
using group model building (GMB).3 GMB sessions with client groups. More recently,
Over the past 15 years, since the development of Andersen et al. (2007) presented a more compre-
icon-oriented software such as i-Think, Vensim and hensive review of current research in GMB using
Powersim, GMB has emerged as one of several system dynamics.
ways to construct policy-oriented system dynam- A number of consistent themes have character-
ics models working directly with client groups. ized recent work on GMB including the impor-
We think of GMB as a form of group decision tance of teamwork (Richardson and Andersen,
support that involves a group of stakeholders 1995), the identification of pre-defined sets of
working with a modelling team to solve a focused behavior in facilitating GMB sessions or ‘scripts’
problem within a complex system. The classic (Andersen and Richardson, 1997), the sequencing
components of GMB include key aspects of the of scripts in the design of GMB interventions
model-building and refinement process in public (Ackermann et al., 2010), evaluation of GMB effect-
view of the client group, developing and testing iveness (Rouwette et al., 2006) and the use of
scenarios and strategic options with the client ‘process maps’ as visual tools for designing colla-
group and facilitated discussion and analysis of borations (Straus, 2002).
results emanating from the system dynamics Scripts have historically remained undocu-
model. These group processes make extensive mented and primarily transmitted verbally or
use of facilitation discussions and analysis with a through direct observation of group activities.
diversified team of group facilitators and model- Although the potential benefits of documenting
lers typically present in the room. GMB scripts has been recognized (Andersen and
Attempts to carefully define how to work with Richardson, 1997), no systematic framework
groups as part of the model-building process existed prior to this work for recording scripts.
have been a key component of the overall GMB Documentation of scripts increases transparency,
effort for a long time. Stenberg (1980) described replication and the transmission of effective prac-
approaches for working with policy reference tice. More important for this paper, documenting
groups before GMB came to be defined as a scripts helps the design of GMB sessions with
formal activity, and Roberts (1977) stressed the im- diverse and frequently marginalized stakeholders
portance of interactions with client teams as a and can thereby be an important tool for effective
means to achieving effective implementation of collaborative planning.
model results. Richmond (1997) has described a In particular, scripts allow community members
strategic forum as a kind of small group whose and other stakeholders participating in the design
purpose is to define and analyse a dynamic and of GMB sessions to visualize, adapt, tailor and
complex problem around a formal system dynam- create small-group exercises to address a variety
ics modelling effort. Vennix (1996) presented a of cultural and political barriers that undermine
collaborations. The result of a better design using
3
In this paper, we focus on the use of GMB to develop system dynam-
scripts is in having more effective GMB sessions
ics models. that can handle a wider range of complex group

Copyright © 2012 John Wiley & Sons, Ltd. Syst. Res. 29, 179–193 (2012)
DOI: 10.1002/sres

180 Peter S. Hovmand et al.


Syst. Res. RESEARCH PAPER

dynamics. Ultimately, we argue that this can lead team. Five distinct roles (not necessarily con-
to better models, analyses, ‘buy in’ and implemen- nected to five distinct persons in the room)
tation of solutions. include the following: (1) the facilitator/elicitor
This paper does the following: (1) describes who leads the group discussion and keeps a con-
a framework for documenting scripts, which stant eye on the group process in the room; (2)
we have organized as an online commons the modeller/reflector, the person or team in the
called Scriptapedia and (2) illustrates how room constantly paying attention to how the
scripts can be used as a collaborative planning formal model is emerging from the group discus-
tool to design and execute GMB sessions. A sion, often providing critical model-based com-
recurring theme throughout this paper is that ments and insights to the client group; (3) a
as formal models are a tool for helping people process coach who is responsible for the creation
visualize and solve problems in the design of of the overall agenda for the day and for design-
complex systems, scripts are a tool for helping ing changes to this agenda ‘on the fly’ (often the
facilitation teams visualize and solve problems role of the process coach is mostly performed
in the design of GMB sessions. GMB sessions before the GMB session begins and then handled
are after all dynamically complex systems, by a person in one of the other roles during the
and understanding how to address the con- meeting); (4) the recorder who makes a real-time
flicts that arise within a GMB session can pro- record of all the discussions and decisions being
vide an important bridge to understanding made by the group; and (5) the gatekeeper, a
how to address the conflicts that arise in the member of the client team who serves as a bridge
larger system. between the modelling team and the client team,
often serving as a voice and support for the
meeting owner, the primary sponsor of the over-
BACKGROUND all activity within the client group.

Group model building has gained increased


attention over the last several years. GMB is a Scripts as a Basic Unit of Behavior for
part of a family of participatory systems model- Designing Group Model Building
ling approaches and has variously been seen as Interventions
a form of grounded theory, action research,
implementation strategy, decision support and A second theme of basing GMB practice on pre-
strategic planning. GMB holds significant prom- defined sets of scripted behavior was first
ise for working with marginalized communities described by Andersen and Richardson (1997).
where the problem focus often has a greater The basic idea motivating scripts as an organiz-
emphasis on conflict, collaboration and em- ing framework for GMB activities was a need to
powerment combined with the system dynamics be organized about interactions with a client
of incentives changing over time. Over the team to make the best use of group time and to
years, a number of important themes have assure that the overall process moved forward
emerged concerning how to design and conduct in an organized fashion, ultimately culminating
GMB sessions. in useful products and insights for the client
team. The group agenda for the full duration of
the planned meetings was to be divided into small
Teamwork in Group Model Building segments of 10 or 15 min each with detailed plans
for what the group would be doing within each
Richardson and Andersen (1995) first defined such scripted time block. Typically, the meeting
their approach to using teams to support GMB. would start with open-ended, problem-finding
That early work concentrated on more clearly activities such as stakeholder mapping or group
defining the various roles that must interact to articulation of their ‘hopes and fears’ for the over-
create a smoothly functioning group modelling all project or the formal introduction of simulation

Copyright © 2012 John Wiley & Sons, Ltd. Syst. Res. 29, 179–193 (2012)
DOI: 10.1002/sres

Scripts as a Collaborative Planning Tool 181


RESEARCH PAPER Syst. Res.

tools via the use of small ‘concept models’ between a single script and a whole intervention.
(Richardson, 2006; Ghaffarzadegen et al., 2011). Should some scripts be performed first, whereas
Subsequent scripted activities included exer- others wait until later? Are some scripts properly
cises designed to draw out reference modes by seen as prerequisites for others? In general, what
drawing graphs of variables over time or various guidance, if any, exists for practitioners who wish
approaches to eliciting system structure from the to assemble a series of scripts into a whole inter-
client group. Scripts for a second or third meeting vention plan that makes sense. Ackermann et al.
of the group would include ways to review (2010) proposed ‘Scripts Map’ as a tool for
progress made at previous meetings as well as addressing just these questions. As a basic defin-
scripts designed to facilitate the client group’s ition, they proposed that ‘the ScriptsMap itself is
experimentation with a formal simulation model a framework for effectively combining particular
to discover policy conclusions constrained within sequences of scripted activities, products, and
the model’s structure. Zagonel et al. (2004; Zagonel deliverables into a formal network to enable facil-
and Rohrbaugh, 2008) provided a detailed ana- itators to construct appropriate combinations for
lysis of the genesis and practice of GMB activities workshops’. Their initial work laid out a map
within this school of work, and Luna-Reyes et al. that combines scripts from traditional GMB prac-
(2006) published a ‘soup-to-nuts’ description tice with Eden and Ackermann’s (1998) approach
of how teamwork and scripted facilitation to strategy development working directly with
actually played out in a specific intervention client groups. Eden et al. (2009) further elaborated
focused on providing homeless shelters in on a number of practical and more theoretical
New York State. dilemmas associated with attempts to integrate
Although the idea of using a script as a basic group modelling projects using diverse analytic
behavioral unit constituting GMB interventions methods whereas Andersen et al. (2006) proposed
had strong intuitive appeal, this same idea pedagogical approaches to teaching such a
left open a number of conceptual and practical blended approach to group-oriented problem
issues, which this current work on the Scriptapedia solving.
is designed to help remedy. Similar efforts, such as
the work by Vreede et al. (2006), to define ‘think-
lets’ as a basic unit of behavior of facilitated group
meetings pay more detailed attention to specific Evaluation of Group Model Building
and contingent behaviors by the facilitator under
different kinds of group response. Should scripts In the last decade, evaluation of GMB has pro-
include only behaviors in public view of the group gressed beyond the systematic review of case
or should they also include activities undertaken studies described by Rouwette et al. (2002) in
by the modelling team more in private? Should several ways. Rouwette et al. used the separation
scripts be thought of as best practices with pre- of context, mechanism and outcome elements
scriptive power or more as descriptions of behav- common to evaluation research for describing
ior waiting to be improved upon by subsequent differences between case studies. The first devel-
practice? These and other questions are gaining opment in the last decade has been to group
greater precision in this project aimed at defining cases according to different contexts: public
an online catalogue of scripts. policy (Cockerill et al., 2009), enterprise resource
planning implementation (Rouwette and Vennix,
2009), criminal justice (Rouwette, 2011) and
‘ScriptsMap’ as a Tool for Sequencing environmental modelling (Beall and Ford, 2010).
Individual Scripts into a Group The second development has been to use
Model-Building Plan controlled settings to assess the impact of the mod-
elling process (Dwyer and Stave, 2008; McCardle-
Another question left open by defining scripts as Keurentjes et al., 2008, 2009; Hoppenbrouwers
a basic unit of analysis is the many relationships et al., 2011).

Copyright © 2012 John Wiley & Sons, Ltd. Syst. Res. 29, 179–193 (2012)
DOI: 10.1002/sres

182 Peter S. Hovmand et al.


Syst. Res. RESEARCH PAPER

Process Diagrams choices a facilitator faces over the course of an


intervention and in a particular session. This is
Another emerging theme is an attempt to visually problematic as the ‘method in use’ can be very
represent the temporal sequence of GMB sessions. different from the ‘espoused method’ featured
For example, Zock (2004) used Luhmann’s in textbooks (Eden and Radford, 1990).
systemic theory of social systems to develop a Dependence on the facilitator combined with a
standard intervention architecture for system- lack of concrete guidelines for facilitation makes
dynamics-based interventions. And, Straus (2002) life especially hard on novices that are trying
used process maps as a way to design effective to learn how to use GMB or other facilitated
collaborations involving multiple stakeholder modelling approaches. Documenting scripts
groups that has been used in the design of GMB may increase the spread of GMB practice and its
sessions. Where process maps can help teams applicability for audiences that cannot enter into
visualize and plan the overall sequence of GMB an apprenticeship with an experience modeller.
sessions across multiple stakeholder groups, Keys (2006) looked into differences between
scripts provide explicit descriptions of what is 'novice and expert users of facilitated modelling
going to happen within any given session. and the support needed to move from one stage
to the other. A central element of such support
is identifying the core tasks that experts carry
USING SCRIPTS TO IMPROVE PRACTICE out in a problem-structuring exercise and codify-
ing these in some way. Codifying experiences in
Modelling sessions are shaped by the inter- the form of scripts allows a greater spread of
action between a group of participants and a modelling practice and encourages its use in
facilitation team. The facilitator has a crucial large-impact problems.
role in the interaction process, as he or she Scripts offer a standard approach to codifying
introduces key steps in the process to partici- experience, allow practitioners to compare facili-
pants, provides guidance with regard to meth- tator approaches and increase our knowledge
ods and techniques, summarizes intermediate on what works best in particular circumstances.
results and proposes when to move on to Scripts may be adapted and tailored to fit local
another activity. This dependence on the facili- circumstances and community contexts and even
tator is recognized in GMB as well as other specific stakeholder groups.
forms of facilitated modelling (Franco and Finally, being able for diverse stakeholders and
Montibeller, 2010). A fundamental reason for those familiar with the local language and polit-
introducing scripts is the fact that much of ical context to engage in design of activities is
facilitation remains an art rather than a science an essential characteristic of using scripts to de-
(Andersen et al., 1997). Some practitioners go velop effective collaborations. In particular,
so far as to suggest that increased transparency scripts allow those involved in the planning
is one of the key challenges for the field of process to understand not just the activities, but
facilitated modelling (Checkland, 2006; Eden how they fit together and where the problems
and Ackermann, 2006; Westcombe et al., 2006). might arise, and negotiate design choices
Scripts are one approach to elicit facilitator about how to convene a meeting that is more
expertise and organize it into explicit and man- effective. Our experience in using the script
ageable chunks. These explicit descriptions can template described here is that it facilitates
then be communicated, discussed and reused. greater understanding and participation in the
This allows practitioners and researchers to design process by non-experts and thereby
document methods and techniques used by increases the diversity of people involved in
different facilitators and across different model- the planning process.
ling disciplines. We feel that scripts have an Importantly, a significant benefit for facilitat-
advantage over existing modelling guidelines in ing collaboration also comes from the process of
handbooks, which rarely discuss the practical more effectively designing GMB sessions. For

Copyright © 2012 John Wiley & Sons, Ltd. Syst. Res. 29, 179–193 (2012)
DOI: 10.1002/sres

Scripts as a Collaborative Planning Tool 183


RESEARCH PAPER Syst. Res.

example, by discussing and planning sessions Learning and Reflection: Research into
explicitly using scripts, members of the plan- Modelling Effectiveness
ning team (which should include representa-
tives or proxies from all stakeholder groups In addition to practical advantages, explicitly
to be effective) become more exact in what capturing the modelling process in the form
should happen during the session, but also of scripts also offers advantages to research as
learn through this process the underlying well. Franco and Rouwette (2011) note that
values and criteria. This type of preparation although the modelling session is central to
process and investment thereby allows those facilitated modelling practice, as this is where
in the planning process to understand where the model is constructed and the benefits of
the flexibility lies during a session and defines directly involving participants are most evi-
what kinds of improvisation are permissible. It dent, there is surprisingly little research on
also allows potential design flaws that would what actually happens in modelling sessions.
exacerbate conflict and undermine collabor- Most research on modelling effectiveness takes
ation to be identified and solved during the the form of single-case studies, but these typic-
design phase and thus result in a session that ally do not penetrate to the level of separate
is more culturally appropriate for participants. sessions. This is regrettable as small differences
For example, culturally inappropriate language in the intervention process may lead to large
and activities can be identified and then differences in outcomes (Jarboe, 1996). Scripts
adapted, tailored or replaced if necessary dur- offer a way to open up the ‘black box’ of mod-
ing the planning stage. Without some explicit elling interventions, as they provide facilitators
definition of what should happen during a with a shared language to describe the inter-
GMB session, it is all too easy to defer to the vention process, which is detailed enough to
experts or most influential stakeholders in the capture essentials. Before we can explain
room and not catch the design flaws until the differences in modelling effectiveness between
actual GMB session is underway. Although cases, we need to be able to adequately
strong and effective facilitation can often describe the context and process of our real-
recover from these kinds of design flaws, the world applications (Rouwette et al., 2002). In
effort expended is a significant lost opportun- some cases, a seemingly identical modelling
ity for building the kind of rapport and group process can lead to different outcomes. Only
cohesion needed to create a formal model. by describing the process in adequate detail
This also places a significant emphasis on can we rule out that a subtle variation in the
members of the team planning the GMB ses- intervention caused the difference in outcomes.
sions recognizing the importance of the process. In doing so, we increase our knowledge on the
For example, if members representing or serv- fidelity and robustness of modelling methods
ing as proxies for a stakeholder group do not and techniques. A central tenet of science is
see their role in the review of scripts as helping the ability to replicate results. In the case of a
the team develop appropriate scripts and complicated intervention such as GMB, any
understand the values and criteria that need to increase in insight as to which elements of
be recognized for the session to be successful, the process are more and less important for
then it is likely that the resulting session will creating results is welcome.
miss their perspective and input. Thus, failing
to acknowledge the use of scripts as a tool for
surfacing the values and criteria can also lead SCRIPTAPEDIA
to an overly rigid GMB session that can create
and reinforce conflict. It is therefore essential Scriptapedia originated as an idea for documenting
that all members of the planning team under- and sharing GMB scripts based on the work of
stand and take the use of scripts as a design Andersen and Richardson (1997). Scriptapedia is
tool seriously. an online handbook that can easily be updated

Copyright © 2012 John Wiley & Sons, Ltd. Syst. Res. 29, 179–193 (2012)
DOI: 10.1002/sres

184 Peter S. Hovmand et al.


Syst. Res. RESEARCH PAPER

and distributed. The cornerstone of standardizing group tasks, it should be defined as a small-
and disseminating GMB practice in Scriptapedia is group exercise that has only one primary group task.
the script template (Table 1). A group exercise that has a significant emphasis
Comprised of 19 separate fields, the script on both convergent and divergent activities, for
template creates a method for thinking about and example, is likely to involve two separate scripts,
documenting the nuts and bolts of GMB. The script one that describes the convergent activity and
template has gone through multiple iterations to another that describes the divergent activity.
improve clarity and functionality. The goal was Scripts are meant to build upon each other so
to create a template that would be easy to under- that the end goal of the GMB project can be
stand and use across different cultures and levels attained. Thus, inputs from other scripts repre-
of GMB expertise. The script template provides sent the outputs of previously executed scripts
what we believe to be the essential elements for or ‘offline’ work by facilitators and modellers
completely defining a script. The script then that are needed before the current script can be
becomes the definitive reference for what should implemented. It should be noted that some
happen during a given activity and how that activ- scripts might not require any inputs, particularly
ity relates to other activities. Scripts can then be if it is very early in the GMB process. Scripts that
used to create other tools including facilitation do not require inputs and can be used to initiate a
guides, training manuals and fidelity measures. project are often called starter scripts. However,
Next, we elaborate on the 19 elements of the all scripts produce outputs. An output may be
template shown in Table 1, focusing only on fields of interest solely to the modeller or it may be
where important distinctions generated the most something that is shared with the entire group.
discussion and need for clarification in the creation In addition to listing the script’s outputs, this
and piloting of the script template. field should also include a description of how
A script’s purpose distils its main goal into a few each output is relevant to the overall project
words. Multiple scripts may have the same and how it will be used in the future. Outputs
purpose, essentially describing different ways to that are of interest to the client group are called
accomplish or build towards the same goal. deliverables, whereas outputs that are of primary
Although a script may have more than one interest to the modeller are products.
purpose, we have found that having too many Although most scripts require all participants
purposes is often an indication that the script to be in the room along with the entire facilitation
needs to be further divided into separate scripts. team, some scripts describe activities that may
Although the purpose defines the main goal in only involve a smaller set of stakeholders or a
a few words, the primary nature of the group subset of the facilitation team. For example, the
task comes from research on group tasks. Group ‘debriefing script’ defines a standard process
tasks fall into one of four categories—divergent, that the facilitation team can use to reflect on a
convergent, evaluative and presentation—with session, and would only involve members of
most tasks being either divergent or convergent the facilitation team.
in nature. Divergent activities produce an array The steps field describes in detail who is doing
of different ideas and interpretations whereas what and is the essence of documenting a script.
convergent activities guide participants through For example, ‘Facilitator sets up task by asking
clustering and categorizing ideas and interpreta- participants to write short descriptions of
tions. Evaluative and presentation are used less resources available within the system.’ Steps
frequently. In evaluative activities, participants should be thorough so that anyone can follow
rank and choose between options and ideas. them without needing additional explanation. If
Lastly, there are times when the modelling team it is important to use specific language during
must explain system dynamics concepts or the facilitation, it should be included in the steps.
update the group on products and deliverables; For example, the specific stem question posed to
such activities fall into the presentation category. participants is often provided in this section.
Although a script may include different types of The planning team typically reviews and revises

Copyright © 2012 John Wiley & Sons, Ltd. Syst. Res. 29, 179–193 (2012)
DOI: 10.1002/sres

Scripts as a Collaborative Planning Tool 185


RESEARCH PAPER Syst. Res.

Table 1 Script template


Field Description

Description One- to two-sentence brief overview


Script status Choose one and delete the bullets below that do not apply:
• Best practice: this script has been used many times and in different settings and has
consistently produced the intended outputs.
• Promising practice: this script has been used a few times with good results but needs
additional refinement and testing.
• Under development: this script still needs to be refined and tested.
Context When should this script be used? The context field specifies where in the GMB process
this particular script fits. Because GMB projects are comprised of multiple scripts, the
context explains whether the script should be used at the very beginning, after a
particular script, to wrap a project up, etc.
Purpose(s) Define the purpose of the script (delete those that do not apply):
• Framing the problem
• Initiating mapping
• Eliciting variables
• Deciding the reference modes for the study
• Eliciting feedback loops
• Eliciting stocks
Primary nature of Identify the primary nature of the group task (delete the bullets below that do not apply
group task and note that a group task should only have one primary purpose):
• Divergent: activity designed to produced an array of different ideas and
interpretations
• Convergent: activity designed to clustering and categorizing ideas and interpretations
• Evaluative: activity designed to rank and choose between options and idea
• Presentation: activity designed to educate or update participants
Time Preparation time:
Time required to complete steps in script:
Follow up time:
Materials needed List the materials needed to successfully complete the script (e.g. markers, overhead
to complete script projector, flip chart):


Inputs from other List the inputs from other scripts needed for this scrip (e.g. behavior-over-time graphs,
scripts concept model) or indicate ‘none’ if this is a starter script:


Outputs from this List specific products such as behavior-over-time graphs and system and how these
script products will be used in the context of the whole project. Distinguish deliverables
from products, where deliverables are physical outputs such as an electronic file or
hardcopy of a system map and products are interim outputs from a script that are of
primary interest to the modeller.


Team roles required List the team roles and minimum level of expertise required to complete the script (e.g.
and expertise needed Facilitator—expert in SD):


Who is in the room? List of people who should be in the room (e.g. ‘gatekeeper’, ‘modeller’, ‘clients’) during
the exercise:


Steps List the detailed ‘how-to’ sequence of actions in the script and who does them:
1.
(Continues)

Copyright © 2012 John Wiley & Sons, Ltd. Syst. Res. 29, 179–193 (2012)
DOI: 10.1002/sres

186 Peter S. Hovmand et al.


Syst. Res. RESEARCH PAPER

Table 1 (Continued)
Field Description
2.
3.
Evaluation criteria Describe the criteria for knowing whether or not the script is successful, that is, how
would someone who had not seen this script used before know whether or not they
did the script correctly?
Author(s) Identify the authors of the script. It is important to note that a script is a unit of
behavior, and the documentation of that behavior is separate. The author of the script
is the person or collective that created the behavior, and this should be acknowledged
by identifying the individual or collective as the author. If the author of a script is not
known, simply write ‘unknown’. For individuals or collectives with an email address,
provide email contact information. Also include the date (if known) that the script
was created.
History and basis for Describe the history and basis for creating this script including both the motivation (e.g.
script a specific need that arose during a project) and prior work that the script is based on (e.
g. other scripts, journal articles, traditions within an organization or community).
Revisions Provide a list of revision changes and who made them. The description of the script
itself should be the most recent version of the script and reflect the best use of this
activity.
References List any publications or references to additional documentation using this script and
cited in the history of the script. For example, if this script is based on another script
that was described in a journal, then mention this under the ‘History’ field with an
author/year citation and provide the full reference here in the references field.

the specific language for introducing an exercise with a name, contact information, etc. Scripts that
and defining terms. This process of reviewing are in common use or without a known author
and revising the language for a script helps the have this field entered as ‘author unknown’.
facilitation team design for collaboration as A script that is being documented can also be
implicit values and criteria surface. part of widespread community tradition. In such
The evaluation criteria field should outline cases, the community should be acknowledged
indicators of a successful script implementation. along with the known status of the script within
That is, how would someone using this script the community’s culture. This is especially
for the first time know if they have done the important because during the creation of a GMB
script correctly? The evaluation criteria are often exercise with a community, it is not uncommon
linked to the intended outputs and can also for community members to nominate activities
include behavioral changes in participants or that are culturally specific and more appropriate
the attainment of certain learning objectives. It for the intended set of participants. However, a
is not uncommon that members of the planning script being documented in this way did not
team for the GMB session have vague or conflict- originate with a project or even the individual
ing expectations about what a successful session nominating the activity but exists as part of a
would look like. Being explicit about the evalu- cultural tradition. Proper acknowledgement of a
ation criteria during the planning process helps community tradition is essential.
the team understand and negotiate what should Along similar lines, scripts often have an intel-
be happening during the session. lectual history as GMB practitioners often draw
The author field refers to the individuals who upon previous scripts, articles, other types of
created the script, not the person filling in the small-group exercises, etc. when developing a
script template. This field gives credit to those new script. This field should capture the motiv-
individuals who came up with the ideas and ation and development process. As a script is
activities captured in the script. Authors can be revised or adapted, it is also important to retain
individual or collectives but should be identified the entire history of origin. For example, if the

Copyright © 2012 John Wiley & Sons, Ltd. Syst. Res. 29, 179–193 (2012)
DOI: 10.1002/sres

Scripts as a Collaborative Planning Tool 187


RESEARCH PAPER Syst. Res.

authors were motivated to create the script from as they did in this study. For example, domestic
a community ritual, this should be clearly stated violence advocates and the judicial system
within the field. have often been in conflict on such issues as
mandatory arrest policies (requiring a police
officer to make an arrest of a batterer), which
CASE EXAMPLE have led to an alarming increase in the number
of women arrested for domestic violence and
To illustrate the use of Scriptapedia and scripts, we controversy (Hovmand and Ford, 2009; Hovmand
provide a case example where scripts were used et al., 2009). In such situations, the goals of various
to design and facilitate a series of GMB sessions. stakeholders may be in conflict. For example, the
The purpose of the GMB sessions was to develop goal of increasing victim safety (what advocates
a community prevention strategy for violence want) may conflict with the goal of increasing
among military, veterans and families affected accountability for batterers (what the criminal
by trauma. It is important to note that the intent justice system is focused on). In some cases, such
of sharing this example is illustrative, not evalu- conflicts can lead to chronic coordination problems.
ative. A thorough empirical evaluation of the Specific to this study was the inherent
use of scripts as a collaborative planning tool is conflict between different perspectives on the
outside the scope of this paper. aetiology of violence among veterans with
The project was initially motivated by a trauma and hence the appropriate institutional
growing concern in the community about the responses to that violence. Of particular im-
number of US soldiers returning from wars in portance was the fact that most criminal justice
Iraq and Afghanistan with trauma, including system responses including court mandated
post-traumatic stress disorders and traumatic that batterer intervention programmes operate
brain injuries, and the perceived risk they from a prevailing assumption that most
posed for their families in terms of violent violence is a consequence of the individual’s
behavior and criminal justice response to choice and not his or her underlying mental
family violence. The project was conceived as health condition. Meanwhile, mental health
part of a research project to apply system professionals working with veterans would
dynamics modelling (Forrester, 1990, 1999; see trauma as a major contributor to anger,
Sterman, 2000) to help develop a coordinated substance abuse and poor impulse control that
community response (CCR), or more precisely, leads to violent behavior. And, although some
a coordinated community prevention strategy families would seek ways to help their veter-
because the goal was primary prevention of ans gain the support they need, others found
violence over the next 20 years instead (as the use of government resources to treat
opposed to responding to current violence). abusers at the expense of supporting victims
Addressing the issue requires involving a objectionable. Adding to the complexity of the
number of different stakeholders with diverse problem was the fact that a number of stake-
perspectives and conflicting goals including holders had a history of adversarial relation-
mental health professionals; soldiers, veterans ships. These types of conflicts extended to
and their families; law enforcement, courts conflicts within some stakeholder groups with
and probation; sexual assault and domestic specific types of ideological and cultural con-
violence service providers and advocates; and flicts that would need to be successfully navi-
victim/survivors of family violence. gated in a GMB session.
Developing CCR to domestic violence has This case serves as a good exemplar for the
historically been very challenging. Not only are kinds of situations where system dynamics mod-
the usual barriers to collaboration present, but els, GMB, and scripts as a collaborative planning
many stakeholders in CCR efforts also have tool can be helpful. The problem is dynamic
strong ideological and political reasons for want- involving an increasing trend of trauma and
ing to protect their perspective of the problem violence over time, can be understood in terms

Copyright © 2012 John Wiley & Sons, Ltd. Syst. Res. 29, 179–193 (2012)
DOI: 10.1002/sres

188 Peter S. Hovmand et al.


Syst. Res. RESEARCH PAPER

of multiple feedback loops interacting over time for each session through an iterative process.
to change the incentives underlying the behavior The CMT then adapted and tailored scripts to
of different stakeholders and involves stake- each GMB session. For example, early discus-
holders with a history of not collaborating. More- sions around the scripts raised questions about
over, the boundaries of the social groups and whether the focus was solely on veterans or
associated meanings (e.g. veterans, victims/ included members of the military and what kind
survivors) are marginalized groups with mem- of specific language would be needed within the
bers using a specific language to create identity, scripts to ensure that members of different
define an agenda and advocate for change. branches would feel included.
In practical terms, a misstep in the design of Scripts were essential to this level of planning.
sessions or facilitation can easily reinforce the In reviewing the scripts from previous projects,
prevailing negative interactions groups experi- the CMT had a better sense of what kinds of
ence in seeking to advocate for change and, as a activities might be used during the actual GMB
consequence, reinforce conflict. So paying atten- session. The level of detail in the scripts provided
tion to language and the cultural appropriateness explicit language that members of the CMT could
of activities is essential for developing rapport critique and modify, and in turn, the discussion
and effective collaboration during the GMB and validation of modification of scripts created
sessions. a sense of the shared values and criteria within
To address the emerging concern of how to the CMT. For example, in discussing what the
respond to the increase in veterans with trauma appropriate language should be when referring
and perceived risk of domestic violence in the to veterans and members of the military, the
St. Louis community, the first author initiated a CMT developed a shared sense of how important
project to develop a community prevention strat- the use of these terms might be for participants
egy using GMB as part of a funded study. The and the potential of inappropriately signalling
core modelling team (CMT) included representa- the exclusion of participants through their
tives from different stakeholder groups including misuse. As a consequence, the CMT was able to
providers from community-based organizations, collaboratively develop not only a set of scripts
the criminal justice system and the Department that were more culturally appropriate to the
of Veterans Affairs. Central to this effort was the stakeholders but also a sense of the required
development of documented scripts and the ‘facilitative attitude’ (Vennix, 1996) needed to
design of a series of GMB sessions with different develop rapport with the participants during
stakeholders. Approximately 70 people partici- the GMB sessions.
pated in the process in one or more sessions Early on, the CMT also realized that there
and represented a diverse set of stakeholders needed to be several additional activities that
from the community including veterans, active helped tie the content of the exercises back to
members of the military, mental health providers, the day-to-day lives of participants. Having
the Department of Veterans Affairs, domestic already worked with existing scripts, the CMT
violence and sexual assault programmes, provi- was then able to design several new scripts that
ders from homeless shelters, federal probations, fit the specific needs of the project. For the CMT,
state police, family members of veterans and creating a new script was relatively easy because
researchers. the script template helped structure the discus-
The CMT used process maps and scripts to sion along a set of specific questions tied to defin-
design the GMB session. This started by having ing a script. This led directly to the inclusion of
the experienced facilitators demonstrate an exercises producing deliverables that were highly
example of a GMB exercise and corresponding valued by participants in terms of both the
script. The CMT then reviewed the collection of process and outcomes.
scripts in Scriptapedia as potential activities for a The resulting GMB sessions consisted of a set
GMB session, identified potential scripts and of three small-group exercises focusing on differ-
then developed the process map and scripts ent stakeholder groups and a large-group

Copyright © 2012 John Wiley & Sons, Ltd. Syst. Res. 29, 179–193 (2012)
DOI: 10.1002/sres

Scripts as a Collaborative Planning Tool 189


RESEARCH PAPER Syst. Res.

meeting where the results were shared and used only examples and (2) they would also need to
to develop a set of prioritized action steps. The engage in a process of critique and revision for
level of collaboration at the end of the final ses- the activities to be an effective means for facilitat-
sion exceeded the CMT’s expectations. We were ing collaboration. This type of issue can easily be
able to have a productive discussion with a addressed, however, by more effectively commu-
diverse stakeholder group with often opposing nicating the purpose of introducing scripts used
views on causes and appropriate responses to from other projects, providing more context and
violence against women including domestic vio- highlighting the different adaptations and uses
lence and military sexual trauma, both of which of scripts from multiple projects. Most recently,
can be highly sensitive topics. For example, some we found it important to stress that although
participants entered sessions with the view that scripts are the definitive reference for a specific
military training and culture was a significant if activity, the instructions for facilitators leading
not a root cause of domestic violence in a patri- the activity and fidelity instruments can take a
archal society, whereas other participants as different format.
members of the military and veterans viewed
such criticism as hostile to veterans. Yet by the
end of the project, participants were having deep CONCLUSION
and nuanced discussions about the nature of
military training and domestic violence and were Group model-building sessions that engage com-
able to begin organizing activities in the commu- munities on complex issues frequently involve
nity that built upon a shared and more holistic diverse stakeholders where there is a significant
view of the issues. risk of coordination issues and conflict, under-
The use of scripts thus enabled the CMT to mining efforts at developing and implementing
effectively adapt, tailor, create and facilitate solutions. Being able to effectively plan and
sessions with diverse stakeholders. Important execute sessions that are culturally appropriate,
elements of success include the CMT being able engage participants and manage conflict pro-
to effectively visualize the GMB activities, iden- ductively is essential for two reasons. First, solu-
tify potential sources of conflict, recognize under- tions based on the insights and analysis of a
lying values that frame the problem, identify model need to be implemented, and implementa-
potential power dynamics that could suppress tion oftentimes requires collaboration in a com-
participation, define an appropriate scope of the munity setting. Without an effective means of
problem and help members of the CMT prepare designing sessions to manage conflict, one may
for the facilitation of GMB exercises. end up with knowing what needs to happen,
It is also important to note some of the limita- but not have a community that is ready to imple-
tions. The process of reviewing, revising and ment the solution. Second, GMB sessions are
developing scripts for this project was time inten- interventions, and interventions that fail to effect-
sive. Scripts alone were insufficient for members ively identify and manage the conflicts are not
of the planning team to acquire a sense of what neutral but actually harmful. The resistance to
GMB is or how the activities would unfold, but change in communities is often there for a good
including a demonstration exercise and sharing reason and based on a history of failed efforts to
the corresponding script helped address this. bring about solutions that ultimately made the
Our experience has also been that the structure situation worse in the long run. GMB sessions
of scripts can convey a certain sense of rigidity that are ineffective therefore contribute to this
in GMB that impedes the very adaption and stock of resistance, making future identification
tailoring that one might seek in using scripts. and implementation of issues even more
In subsequent projects where we shared the challenging.
facilitation manual using the scripts for this pro- We build and use models of complex systems
ject, we found groups reluctant to use the scripts because we believe that it is hard if not impos-
until they realized the following: (1) these were sible to adequately understand systems without

Copyright © 2012 John Wiley & Sons, Ltd. Syst. Res. 29, 179–193 (2012)
DOI: 10.1002/sres

190 Peter S. Hovmand et al.


Syst. Res. RESEARCH PAPER

the aid of a model, and our ability to find and sessions where the goal of the sessions is to
implement solutions is intimately connected to understand and solve a dynamically complex
how well we understand the system. Thus, we problem through the development and analysis
see models as design objects, that is, as things of a system dynamics model. This focus has a
that we can see, interact with and manipulate to specific set of assumptions from the outset about
understand a complex system and find a solu- the nature of the problem and reasons why
tion. We involve stakeholders in the process of collaboration can be difficult, which we illu-
building such models through GMB techniques strated in the case example.
because we believe the process of being involved However, there are other reasons why colla-
leads to a better model and increases stake- borations can be difficult, and hence, other
holders’ understanding of the model and ability methods for solving them that do not involve
to implement necessary changes. What we have the development of a system dynamics models,
come to appreciate through our use of scripts is GMB or the use of scripts to plan GMB sessions
how they too function as design objects for plan- collaboratively. Exploring which methods work
ning effective collaborations. best for which kinds of collaboration problems
The use of documented scripts as we have is an area for future research, but one that
described here with Scriptapedia makes it possible requires unpacking the complexity of the pro-
to more effectively engage a wider and more blems and methods. This paper is a step in that
diverse set of stakeholders where conflict and direction by providing an explicit protocol for
coordination issues may be major barriers to solv- the activities within a GMB session that will
ing some problem in a system. This occurs through allow future research to rigorously test the rela-
both better and more explicit planning of exercises tionship between various intervention elements
by the team planning the sessions and also by hav- on the collaboration as a process and outcome.
ing the facilitators negotiate and internalize the cri-
teria and values underlying scripts.
When documented and used in Scriptapedia, ACKNOWLEDGEMENT
scripts provide a tangible tool that teams can
use to design and plan sessions bridging diverse This work was partially supported by the Cen-
and conflicting stakeholder perspectives. Using ters for Disease Control and Prevention through
scripts in this way allows persons with little or the Brown School Violence and Injury Prevention
no experience in system dynamics or GMB to Center (1R49CE001510) as part of the ‘Veterans,
actively engage in this design process and increases Trauma, and Battering Project’. Dr. Monica
the diversity of the CMT and thereby the ability Matthieu, Research Assistant Professor at the
of a team to design effective collaboration. Brown School of Social Work, Washington Uni-
As participatory methods for developing versity in St. Louis co-led the project. Mr. Timothy
models gain more interest and are applied to a Hower, Associate Director of the Social System
wider array of issues with more diverse stake- Design Lab, Brown School of Social Work,
holders, it will become increasingly important Washington University, co-led the Core Modeling
to recognize and develop more tools that help Team for the project.
the teams design effective collaborations. Such
tools have the potential to not only improve the
quality systems analysis but also increase demo-
cratic participation in the process, likelihood of REFERENCES
having the results implemented, and ultimately
expand the potential capacity of communities to Ackermann F, Andersen DF, Eden C, Richardson GP.
solve a much wider array of complex system 2010. ScriptsMap: a tool for designing multi-method
policy-making workshops. Omega 39(4): 427–434.
problems. Andersen DF, Richardson GP. 1997. Scripts for group
In this paper, we have focused on scripts as a model building. System Dynamics Review 13(2):
collaborative planning tool for designing GMB 107–129.

Copyright © 2012 John Wiley & Sons, Ltd. Syst. Res. 29, 179–193 (2012)
DOI: 10.1002/sres

Scripts as a Collaborative Planning Tool 191


RESEARCH PAPER Syst. Res.

Andersen DF, Bryson JM, Richardson GP, Ackermann Ghaffarzadegen N, Lyneis JM, Richardson GP. 2011. How
F, Eden C, Finn CB. 2006. Integrating modes of small system dynamics models can help the public pol-
systems thinking into strategic planning education icy process. System Dynamics Review 27(1): 22–44.
and practice: the thinking persons’ institute Gilbert N, Troitzsch KG. 2005. Simulation for the Social
approach. Journal of Public Affairs Education 60(1): Scientist (2nd edn.). Open University Press: New York.
265–293. Hoppenbrouwers SJBA, Weigand H, Rouwette
Andersen DF, Richardson GP, Vennix JAM. 1997. EAJA. 2011. Exploring dialogue games for collab-
Group model building: adding more science to the orative modeling. In E-Collaboration Technologies
craft. System Dynamics Review 13(2): 187–203. and Organizational Performance: Current and Future
Andersen DF, Vennix JAM, Richardson GP, Rouwette Trends, Kock N (ed.). IGI Global: Hershey; 292–317.
E. 2007. Group model building: problem structuring, Hovmand PS, Ford DN. 2009. Sequence and timing of
policy simulation and decision support. Journal of the three community interventions to domestic violence.
Operational Research Society 58(5): 691–694. American Journal of Community Psychology 44(3–4):
Barrett S. 2007. Why Cooperate? The Incentive to 261–272.
Supply Global Public Goods. Oxford University Hovmand PS, Ford DN, Flom I, Kyriakakis S. 2009.
Press: New York. Victims arrested for domestic violence: unintended
Beall A, Ford A. 2010. Reports from the field: assessing consequences of arrest policies. System Dynamics
the art and science of participatory environmental Review 25(3): 161–181.
modeling. The International Journal of Information Howick S, Ackermann F, Andersen DF. 2006. Linking
Systems and Social Change 1(2): 72–89. event thinking with structural thinking: methods to
Checkland P. 2006. Reply to Eden and Ackermann: any improve client value in projects. System Dynamics
future for problem structuring methods? Journal of Review 22(2): 113–140.
the Operational Research Society 57(7): 769–771. Jarboe S. 1996. Procedures for enhancing group decision
Cockerill K, Daniel L, Malczynski L, Tidwell V. 2009. A making. In Communication and Group Decision Making
fresh look at a policy sciences methodology: collab- (2nd edn.). Hirokawa RY, Poole MS (eds.). Sage:
orative modeling for more effective policy. Policy London; 345–383.
Sciences 42: 211–225. Johnson-Laird P. 1983. Mental Models: Towards a Cognitive
Dörner D. 1997. The Logic of Failure: Recognizing and Science of Language, Inference and Consciousness.
Avoiding Error in Complex Situations. Basic Books: Harvard University Press: Cambridge.
New York. Keys P. 2006. On becoming expert in the use of problem
Doyle JK, Ford DN. 1998. Mental models concepts for structuring methods. Journal of the Operational Research
system dynamics research. System Dynamics Review Society 57: 822–829.
14: 3–29. Luna-Reyes LF, Martinez-Moyano IJ, Pardo TA,
Dwyer M, Stave K. 2008. Group model building wins: Cresswell AM, Andersen DF, Richardson GP.
the results of a comparative analysis. Paper pre- 2006. Anatomy of a group model-building inter-
sented at the System Dynamics Conference, Athens. vention: Building dynamic theory from case study
Eden C, Ackermann F. 1998. Making Strategy: The Journey research. System Dynamics Review 22(4): 291–320.
of Strategic Management. Sage: London. McCardle-Keurentjes MHF, Rouwette EAJA, Vennix
Eden C, Ackermann F. 2006. Where next for problem JAM. 2008. Effectiveness of group model building
structuring methods. Journal of the Operational Research in discovering hidden profiles in strategic decision-
Society 57(7): 766–768. making. Paper presented at the System Dynamics
Eden C, Radford J. 1990. Tackling Strategic Problems: The Conference, Athens.
Role of Group Decision Support. Sage: London. McCardle-Keurentjes M, Rouwette EAJA, Vennix JAM,
Eden C, Ackermann F, Bryson JM, Richardson GP, Jacobs E. 2009. Is group model building worthwhile?
Andersen DF, Finn CB. 2009. Integrating modes of Considering the effectiveness of GMB. Paper pre-
policy analysis and strategic management practice: sented at the International System Dynamics Conference,
requisite elements and dilemmas. Journal of the Athens, Greece.
Operational Research Society 60(1): 2–13. Pidd M. 1998. Computer Simulation in Management Science
Forrester JW. 1990. Principle of Systems. Pegasus Com- (4th edn.). John Wiley & Sons, Ltd.: West Sussex.
munications, Inc.: Waltham. Richardson GP. 2006. Concept models. Paper presented
Forrester JW. 1999. Industrial Dynamics. Pegasus Com- at the Proceedings of the 24th International Conference of
munications, Inc.: Waltham. the System Dynamics Society.
Franco LA, Montibeller G. 2010. Facilitated modelling in Richardson GP, Andersen DF. 1995. Teamwork in
operational research. European Journal of Operational group model building. System Dynamics Review
Research 205(3): 489–500. 11(2): 113–137.
Franco LA, Rouwette EAJA. 2011. Decision develop- Richmond B. 1997. The strategic forum: aligning object-
ment in facilitated modelling workshops. European ive, strategy, and process. System Dynamics Review
Journal of Operational Research 212: 164–178. 13(2): 131–148.

Copyright © 2012 John Wiley & Sons, Ltd. Syst. Res. 29, 179–193 (2012)
DOI: 10.1002/sres

192 Peter S. Hovmand et al.


Syst. Res. RESEARCH PAPER

Roberts EB. 1977. Strategies for effective implementation Vennix JAM. 1996. Group Model Building. John Wiley &
of complex corporate models. Interfaces 8(1): 26–33. Sons: New York.
Rouwette E. 2011. Facilitated modelling in strategy de- Vennix JAM, Andersen DF, Richardson GP. 1997. For-
velopment: measuring the impact on communication, ward: group model building, art, and science. System
consensus and commitment. Journal of the Operational Dynamics Review 13(2): 103–106.
Research Society 62: 879–887. Vreede G, Briggs RO, Kolfschoten GL. 2006.
Rouwette E, Vennix JAM. 2009. Improving operations Thinklets: a pattern language for facilitated
management by synthesizing participant knowledge practitioner-guided collaboration processes. Inter-
and system data. In Strategisches und operatives national Journal of Computer Applications in Technol-
Produktionsmanagement: Empirie und Simulation, ogy 25: 140–154.
Strohhecker J, Größler A (eds.). Gabler: Wiesbaden; Westcombe M, Franco LA, Shaw D. 2006. Where next
267–282. for PSMs—a grassroots revolution? Journal of the Op-
Rouwette E, Vennix JAM, Mullekom T. 2006. Group erational Research Society 57(7): 776–778.
model building effectiveness: a review of assessment Zagonel A, Rohrbaugh J. 2008. Using group model
studies. System Dynamics Review 18(1): 5–45. building to inform public policy making and imple-
Rouwette E, Vennix JAM, Van Mullekom T. 2002. Group mentation. In Complex Decision Making, Qudart-Ullah
model building effectiveness. A review of assessment H, Spector JM, Davidsen PI (eds.). Springer-Verlag:
studies. System Dynamics Review 18(1): 5–45. New York; 113–138.
Stenberg L. 1980. A modeling procedure for public policy. Zagonel A, Rohrbaugh J, Richardson GP, Andersen DF.
In Elements of the System Dynamics Method, Randers J 2004. Using simulation models to address “what if”
(ed.). MIT Press: Cambridge; 292–312. questions about welfare reform. Journal of Policy Ana-
Sterman JD. 2000. Business Dynamics: Systems Thinking lysis and Management 22(4): 890–901.
and Modeling for a Complex World. Irwin/McGraw- Zock A. 2004. A critical review of the use of system
Hill: Boston. dynamics for organizational consultation projects.
Straus D. 2002. How to Make Collaboration Work. Berrett- Paper presented at the International System Dynamics
Koehler Publishers, Inc.: San Francisco. Conference, Oxford, UK.

Copyright © 2012 John Wiley & Sons, Ltd. Syst. Res. 29, 179–193 (2012)
DOI: 10.1002/sres

Scripts as a Collaborative Planning Tool 193

View publication stats

You might also like