Download as pdf or txt
Download as pdf or txt
You are on page 1of 27

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/247720863

The Application of DICTION to Content Analysis Research in Strategic


Management

Article  in  Organizational Research Methods · November 2007


DOI: 10.1177/1094428107304534

CITATIONS READS

142 2,093

2 authors:

Jeremy C. Short Timothy B. Palmer


University of Oklahoma Western Michigan University
89 PUBLICATIONS   5,292 CITATIONS    26 PUBLICATIONS   1,677 CITATIONS   

SEE PROFILE SEE PROFILE

All content following this page was uploaded by Jeremy C. Short on 01 November 2015.

The user has requested enhancement of the downloaded file.


Organizational
Research Methods
Volume 11 Number 4
October 2008 727-752
The Application of DICTION  2008 Sage Publications
10.1177/1094428107304534

to Content Analysis Research http://orm.sagepub.com


hosted at

in Strategic Management http://online.sagepub.com

Jeremy C. Short
Texas Tech University
Timothy B. Palmer
Western Michigan University

DICTION is a computer-aided content analysis program grounded in a number of theoretical


bases in linguistic research. DICTION has a number of attractive features that could be used
to analyze unique elements of language in narrative texts germane to strategic management
research. The authors apply the DICTION software to a sample of mission statements from
408 Association to Advance Collegiate Schools of Business colleges of business with a focus
on gaining insights concerning how DICTION can be used in strategic management research
utilizing content analysis. They find significant differences in word usage in mission state-
ments based on organizational characteristics, including business school performance. They
conclude with suggestions for future research.

Keywords: narrative; content; semiotic analysis

S trategic management scholars frequently rely on content analysis to collect difficult to


obtain data in a wide range of research streams. The use of content analysis is appeal-
ing to researchers in strategic management because examination of narrative texts such as
press releases, annual report text, mission statements, interview transcripts, or other archi-
val texts allow for the unobtrusive study of a number of statements, beliefs, and cognitions
from top-level executives that are generally difficult to otherwise obtain (Morris, 1994).
Despite its widespread appeal, content analysis is arduous and researchers must go to great
lengths to insure reliability in data coding and subsequent analyses. To ameliorate these
concerns, researchers have advocated the use of computer-aided content analysis for the
coding of organizationally produced texts such as annual reports and mission statements
(Morris, 1994).
In this article, we introduce an advanced computer-aided content analysis program
that could benefit a variety of research streams in strategic management. Specifically,
DICTION (Hart, 2000) was developed to analyze political speech and rhetoric (e.g., Hart
& Jarvis, 1997). Behavioral researchers have noted its potential for the study of leadership
(Bligh, Kohles, & Meindl, 2004a, 2004b), and accounting researchers have begun to apply
DICTION to aid in the study of image management (Rogers, Dillard, & Yuthas, 2005)
and communicative action (Yuthas, Rogers, & Dillard, 2002). Researchers in other fields
are utilizing DICTION to conduct content analysis using data sources commonly used by

Authors’ Note: The authors would like to thank Hans Hansen for his valuable comments on an earlier version
of this article.
727

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


728 Organizational Research Methods

strategy researchers (such as annual report texts); these scholars are also using DICTION
to aid in examining theoretical concepts of interest to strategic management researchers
(such as organizational image and identity). We therefore believe DICTION could be
quite useful in strategic management research by providing a valuable tool for researchers
attempting to examine language usage in organizations, and examine possible linkages
between management’s narratives and organizational performance.
We briefly review the application of content analysis in strategic management and
demonstrate how DICTION could be used to analyze unique elements of language in texts
commonly relied on by strategic management researchers. We then use the DICTION
software to analyze a sample of mission statements from 408 Association to Advance Col-
legiate Schools of Business (AACSB) colleges of business and examine linkages between
DICTION content found in mission statements and organizational characteristics, includ-
ing performance. We also illustrate how DICTION can be used in concert with other con-
tent analysis techniques such as human coding schemes. We conclude by highlighting the
potential for DICTION to answer future research questions utilizing content analysis to
capture important theoretical constructs of interest to strategic management scholars.

Content Analysis in Strategic Management

Content analysis is a qualitative research method that uses a set of procedures to clas-
sify or otherwise categorize communications (Weber, 1990). Typically relying on archival
data to extract criteria of interest to strategic management scholars, content analysis
has aided in analyzing corporate strategies (Bowman, 1978), organizational boundaries
(Fiol, 1989) new product development (Simon & Houghton, 2003), organizational
resources (Mishina, Pollock, & Porac, 2004), strategic groups (Osborne, Stubbart, &
Ramaprasad, 2001), and joint ventures (Merchant, 2004). Content analysis has also been
used to explore elements of cognition such as risk-return relations (Bowman, 1984;
Ramanujam, 2003), causal reasoning (Axelrod, 1976; Bettman & Weitz, 1983), and man-
agerial attributions (Barr, Stimpert, & Huff, 1992; Clapham & Schwenk, 1991).
Any source of communication such as shareholder letters, interview narratives,
speeches, or transcripts from recorded meetings could be used by a strategy researcher as
an effective data source for content analysis so long as it provides a good match theoreti-
cally between the information being assessed (how information is being content analyzed)
and the context from which it is drawn (does the type of text being used as a source of
content analysis data fit the research question?). On balance, however, content analysis in
strategic management has primarily drawn from textual communications of managers,
particularly CEO shareholder letters and annual report texts (Duriau, Reger, & Pfarrer,
2007).
Content analysis of texts offers a number of potential benefits. Content analysis can be
used to identify individual differences among communicators (Weber, 1990), and com-
pared with other techniques such as interviews, content analysis is recognized as a less
obtrusive technique for capturing managerial cognitions (Phillips, 1994). In addition, con-
tent analysis tends to avoid recall biases (Barr et al., 1992) and is a highly utilized means
of obtaining otherwise unavailable information (e.g., Kabanoff, Waldersee, & Cohen,

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


Short, Palmer / Content Analysis Research 729

1995). Finally, gathering data through content analysis of organizationally produced texts
such as shareholder letters has been encouraged because it allows for greater reliability
and replicability (Finkelstein & Hambrick, 1996).
Content analysis of text is especially useful for the study of managerial cognition
(Duriau et al., 2007). One reason is that access to CEOs is fairly limited, resulting in the
need for proxies to assess executives’ mental models. Relying on text to study cognition
assumes that insights about the authors’ mental models can be detected through the pre-
sence of, absence of, and frequency with which certain concepts are used in text (Carley,
1997). Even when authorship of the text is uncertain (e.g., a shareholder letter), there is
widespread agreement that executives are heavily involved in their preparation (Barr
et al., 1992). D’Aveni and MacMillan (1990) assert, ‘‘Content analysis of written commu-
nications is useful for reconstructing perceptions and beliefs of their authors’’ (p. 639).
Therefore, content analysis of text offers considerable potential to gain key insights into
the thinking of top managers and, in following, the choices they make. Examples of strate-
gic management research using content analysis to investigate cognition include Bettman
and Weitz (1983) who relied on annual report text to assess attributions about corporate
performance. Other studies have conducted more elaborate tests of organizational cogni-
tions by using such communications to extract representations of managerial mental
models (using content analysis) and then applying this data to further analytic study
through causal mapping and other analytical techniques for mapping strategic thought
(Huff, 1990).

Conducting Content Analysis

A complete review of content analysis is beyond the scope of this article. However, a
number of excellent sources are available for those seeking greater detail about content
analysis mechanics. These include texts concerning content analysis in general (Krippen-
dorf, 2004; Neuendorf, 2002; Weber, 1990), texts that specifically address computer-aided
techniques (Alexa & Zuell, 1999; Kelle, 1995), and a number of published articles outlin-
ing content analysis procedures, comparing techniques and/or different software packages
for content analysis and/or text analysis (Bashor, 2004; Duriau & Reger, 2004; Hart,
1984a; Insch & Moore, 1997; Lowe, 2003; Weitzman, 1998), and a recent review of con-
tent analysis in organization studies (Duriau et al., 2007).
Generally, three broad types of content methodologies exist (Deffner, 1986; Morris,
1994): Human-scored schema, individual word count systems, and computerized systems
using artificial intelligence. Human scored systems involve training of coders to classify
text according to specific classification categories. In this system, the first step is a deter-
mination of what aspect of text will serve as the unit of analysis (word, phrase, sentence,
paragraph, full text). Then, categories are developed for classification and coding rules are
developed for each category. Coders are then trained to classify text and reliability is
assessed. For example, Short and Palmer (2003) content analyzed CEOs’ letters to share-
holders by sentence clause to code different organizational performance referents such as
use of internal comparators (e.g., previous year’s sales) or external comparators (e.g.,
competitor performance).

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


730 Organizational Research Methods

In contrast to human-scored schemas, individual work count systems classify text into a
number of semantically equivalent categories and then use frequency counts to determine
the relative importance of each category in a text (Weber, 1990). For example, Osborne
and colleagues (2001) used word count software to count themes in shareholder letters.
Finally, artificial intelligence systems incorporate features that consider the syntax and
lexicon of words (Rosenberg, Schnurr, & Oxman, 1990). Thus, there is a mechanism to
resolve words with more than a single meaning. Artificial intelligence systems have been
the least prevalent technique in management research (Morris, 1994).
The DICTION software, described below, is useful for the application of individual-
word-count systems and artificial intelligence systems. Although word count systems can
be performed by human coders, computerized systems such as DICTION are advanta-
geous because of their near perfect reliability, speed, and cost effectiveness (Morris, 1994;
Rosenberg et al., 1990). In the following sections, we describe the DICTION software and
illustrate potential applications of DICTION to strategic management research.

The DICTION Software

There are many choices available for conducting computer-aided content analysis. Most
programs largely rely on word frequency counts (Morris, 1994). To highlight the unique
contribution of DICTION, Table 1 provides a sampling of content analysis techniques and
software programs used in previous management research. In contrast to other techniques,
DICTION was designed by a communications researcher and focuses on the subtle power
of word choice and verbal tone (Hart, 1984b). DICTION also relies on word counts, but
the software package differs from others in a number of ways that may be attractive for
strategic management research. First, the software relies on word counts based on linguis-
tic theory culled from a number of social thinkers. Second, DICTION also utilizes ele-
ments of artificial intelligence that have been underutilized in the management literature.
While providing these unique benefits, DICTION allows the flexibility of other software
programs where users can specify their own ‘‘custom’’ dictionaries. These custom diction-
aries can then be used in conjunction with, or independently of, the predefined diction-
aries. In the following sections, we provide greater detail on DICTION’s many facets.

DICTION Dictionaries
The DICTION software package (Hart, 2000) contains 31 predefined dictionaries, con-
taining more than 10,000 search words that can be used to analyze any given text. Based
in linguistic theory (Bligh et al., 2004b) the dictionaries were developed based on a num-
ber of different types of narrative texts including business texts such as annual reports,
mission statements, and CEO speeches. The dictionaries search for language that tap into
the following characteristics: tenacity, leveling, collectives, numerical terms, ambiva-
lence, self-reference, praise, satisfaction, inspiration, blame, hardship, denial, aggression,
accomplishment, communication, motion, cognitive terms, passivity, familiarity, spatial
awareness, temporal awareness, present concern, human interest, concreteness, past
concern, centrality, cooperation, rapport, diversity, exclusion, and liberation. These 31

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


Table 1
A Comparison of DICTION and Other Content Analysis Techniques Used in Management Research
Technique Advantages of Each Technique Key Limitations Example Using This Technique

DICTION software Content analysis software that uses 31 Limited ability to detect Bligh, Kohles, and Meindl
package dictionaries based on lexical theory in homographs (2004a, 2004b), Journal of
conjunction with calculated variables Applied Psychology,
based on unique characteristics of text Leadership Quarterly
Textpack 4 Allows user to tag certain keywords in User must specify search words Kabanoff, Waldersee, and
context to highlight specific sentences Cohen (1995), Academy of
for later use or analysis Management Journal
NUD∗ IST software Software is useful for examining linkages User must specify search words Schnatterly (2003), Strategic
(now Nvivo7) in the data Management Journal
Atlas.ti Software is useful for examining linkages User must specify search words Barringer, Jones, and Neubaum
in the data (2005), Journal of Business
Venturing
Manual coding Can be adapted to specifically address Time consuming and somewhat Boyd, Gove, and Hitt (2005),
any theoretical research question, subjective; validity checks Strategic Management
coding can be broken down to among coders recommended Journal
any unit (clause, sentence, document)
T.A.C.T. Software Text retrieval and analysis program User must specify content Gephart (1993), Academy of
designed to allow users to ask of interest Management Journal

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


questions about words and patterns
in a given text
Causal mapping This article compares two direct forms Pairwise comparison technique Hodgkinson, Maule, and Bown
of causal mapping techniques in results in more complex maps (2004), Organizational
strategy research–freehand mapping involving more and stronger Research Methods
and pairwise comparisons mapping causal relationships

731
732 Organizational Research Methods

dictionaries, containing no duplication, have been selected to identify frequently encoun-


tered words used in public discourse. For example, the dictionary for ambivalence exam-
ines and codes, ‘‘words expressing hesitation or uncertainty, implying a speaker’s
inability or unwillingness to commit to the verbalization being made’’ (Hart, 2000, p. 33).

DICTION Master Variables


DICTION’s dictionaries are subsequently used for lexical analysis—that is, to study
vocabulary and word choice. This is done through the use of five ‘‘master’’ variables.
DICTION’s master variables were created with the rationale that ‘‘if only five questions
could be asked of a given passage, these five would provide the most robust understand-
ing’’ (Hart, 2001, p. 45). Hart notes that each of the master variables was chosen intention-
ally, and was stimulated by theoretical work of a number of social thinkers. The first
master variable, Certainty, derives from Wendell Johnson’s (1946) work on general
semantics, and the study of how language becomes rigid and what can happen as a result.
The Certainty variable involves language that indicates resoluteness, inflexibility, comple-
teness, and a tendency to speak with authority. Using a sample of Fortune 500 companies,
previous research has found significant differences in Certainty among company’s oral
statements compared to statements found in corporate annual reports (Ober, Zhao, Davis,
& Alexander, 1999). Optimism involves language endorsing some person, group, concept,
or event and this variable was motivated by James David Barber’s (1992) work Presiden-
tial Character, who noted optimism was a key dimension for understanding political per-
sonality. This variable may be useful to strategy scholars who have noted that optimism is
associated with overconfidence and hubris for CEOs (Hayward, Rindova, & Pollock,
2004). Activity is based on the work of Charles Osgood and his colleagues (Osgood, Suci,
& Tannenbaum, 1957), The Measurement of Meaning, and examines language featuring
movement, change, and implementation of ideas and the avoidance of inertia. Elements of
activity and inertia have been germane to a host of strategy concepts related to strategic
behavior (Ansoff, 1987). Realism was developed as an attempt to tap into John Dewey’s
(1954) pragmatism found in the Western experience and examines language describing tan-
gible, immediate, recognizable matters. This variable may be useful to analyze aspects of
pragmatism that have been argued to be an important element of open systems thinking in
certain strategic contexts (Hinthorne, 1996). Commonality, the fifth master variable, is an
approximation of the communitarian concepts found in the work of Etzioni (1993) and
others (e.g., Bellah, Madison, Sullivan, Swindler, & Tipton, 1991). This variable examines
language that highlights agreed-on values of a group and rejects idiosyncratic modes of
engagement. This variable may be useful to validate the assertions of strategy scholars who
have suggested that communitarian characterizations will become increasingly popular in
the strategic discourses of organizations such as joint ventures (Barry & Elmes, 1997).
Assigning scores for the five master variables begins with DICTION comparing word
usage in the analyzed text to words contained in the 31 unique dictionaries. This process
is similar to many other computer-aided content analytic devices that conduct word
searches with the exception of the vastness and predefined theoretical basis of DICTION’s
dictionaries. Results from the word search are used in formulas to assign scores for the
five master variables. It should be noted that any of the unique, specific dictionaries might

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


Short, Palmer / Content Analysis Research 733

also be of use to strategy researchers. For example, denial has been deemed to be an
important element in defining narcissism (Brown, 1997). DICTION’s ability to capture
denial could be used to empirically study relationships associated with elements related to
narcissism such as hubris and CEO celebrity (Hayward et al., 2004).

DICTION Calculated Variables


A second category of variables used by DICTION are calculated variables. More than
word counts, the four calculated variables, based on unique theoretical underpinnings, are
assigned scores based on specific patterns in text detected by the software. DICTION’s
output provides scores for these variables, and also uses them in three of the five master
variable formulas. The first calculated variable is Insistence (use of repeated words),
which is a measure of code restriction and semantic ‘‘contentedness.’’ The assumption is
that repetition of key terms indicates a preference for a limited, ordered world. When cal-
culating the insistence score, DICTION is unique in that it has a self-learning capacity; all
words used three or more times are isolated and the user decides if such words (those that
are not already within the DICTION database) should be used to calculate the insistence
score. These prior decisions are stored in the program’s Elephant (a utility that ‘‘remem-
bers’’ exempts and eligible words), and the Elephant is updated each time the user makes
a new decision (Hart, 2001). The insistence score is subsequently used in the formula for
the master variable certainty. A second calculated variable used to derive certainty is Vari-
ety. Variety conforms to Johnson’s (1946) Type-Token Ratio that divides the number of
different words in a passage by the passage’s total words. A high score indicates a speak-
er’s avoidance of overstatement and a preference for precise statements. The third calcu-
lated variable, used in the calculation for activity, is Embellishment. Embellishment is the
ratio of adjectives to verbs and is based on David Boder’s (1940) conception that heavy
modification ‘‘slows down’’ a verbal passage by de-emphasizing human and material
action. Last, Complexity is a measure of the average number of characters-per-word in a
given input file. The logic for Hart’s (2000) inclusion of complexity is based on Rudolph
Flesch’s (1951) notion that convoluted phrasings make a text’s ideas abstract and its
implications unclear.

Additional Features of DICTION


Beyond the dictionaries, and master and calculated variables, there are a variety of other
noteworthy features associated with DICTION. One that was previously discussed is the
researcher’s ability to create user-defined dictionaries. Second, DICTION is an advanced
lexical approach in that it makes a modest statistical accommodation for confounding
homographs (words spelled the same but having different meanings such as lead the metal
versus lead subordinates). Confounding homographs (approximately 10% of DICTION’s
search words) are weighed differentially based on Easton’s (1940) work. Benign homo-
graphs that imply different ideas but belong to the same domain of meaning are ignored
(e.g., the word judge denotes two distinct legal terms, the act of adjudication and a court
official). This feature of DICTION is an important one because the use of artificial intelli-
gence systems has been limited in management research (Morris, 1994).

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


734 Organizational Research Methods

A third additional feature of DICTION is that it allows researchers to create composite


variables based on DICTION’s dictionaries in conjunction with DICTION’s calculated
variables. For example, Bligh et al. (2004a) create eight composite variables based on
Shamir, Arthur, and House’s (1994) work on the rhetoric of charismatic leadership. For
example, scholars have suggested that charismatic leaders will make more references to
intangible future goals and fewer references to concrete outcomes (Conger, 1991; Shamir
et al., 1994). Thus, the construct of tangibility was created by the inclusion of DICTION’s
dictionary for concreteness (words denoting tangibility and materiality) plus the calculated
variable for insistence (a measure of repetition of key terms in a given text) minus the cal-
culated variable for variety (a ratio of different words divided by total words). The inter-
pretation of this measure is that high scores on this construct would be associated with
lower levels of charisma (Bligh et al., 2004a).

DICTION Summary
The use of 10,000 words in 31 dictionaries to create master and calculated variables is
a testament to the power and complexity of DICTION. Although grounded in consider-
able linguistics and communications theory, DICTION was originally created considering
a number of types of texts including business texts such as annual reports, corporate pub-
lic relations statements, mission statements, CEO speeches, financial news, legal docu-
ments, and magazine and TV advertisements. Published research using DICTION has
continued to examine a number of organizationally produced texts with relevance to stra-
tegic management research such as CEO letters to shareholders, management discussion
and analysis sections from annual reports, and press releases. In addition, research using
DICTION has been published in a number of management-oriented journals such as
Journal of Applied Psychology, Journal of Business Ethics, and Leadership Quarterly.
Finally, DICTION research has been used to examine conceptual ideas in management
such as charismatic leadership, organizational image, and organizational identity. Thus,
DICTION holds promise as a content analysis technique that is well suited to issues ger-
mane to strategic management research. Table 2 provides a review of previous research
using DICTION to examine texts and or conceptual theories common to management
research.
The robustness of DICTION allows it to be applied to a number of research efforts
spanning the public, private, nonprofit, and government sectors of the economy. Research-
ers have detected a high level of agreement between human coders and DICTION
results, and assert that this technique would be useful for research involving the language
of leadership (Bligh et al., 2004a). Toward that end, we highlight one common organiza-
tionally produced text, organizational mission statements, to illustrate the software’s cap-
abilities. In particular, we use DICTION to examine a sample of AACSB business school
mission statements to showcase how DICTION can be applied in strategic management
research. We utilize a two-study approach. The first study highlights the DICTION soft-
ware and how it can be applied to archival texts germane to strategic management
research. The second study illustrates how DICTION can be used in conjunction with a
human coding framework used in previous strategy research on organizational mission
statements.

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


Table 2
Examples of Previous Research Using DICTION
Research Question,
Narrative Document Analyzed Topic, or Goal Use of DICTION Publication Citation

Press releases, e-mails, speeches Examines image DICTION was used to compare statements from Rogers, Dillard, and Yuthas
of officers, testimonies, and management of the the AICPA during time periods using (2005), Journal of
published articles American Institute of DICTION measures of denial, activity, Business Ethics
Certified Public optimism, realism, and commonality
Accountants (AICPA)
Speeches, radio addresses and Examination of President DICTION measures of optimism, collectives, Bligh, Kohles, and Meindl
articles from U.S. newspapers Bush’s rhetoric and the faith, patriotism, ambivalence, and aggression (2004a), Journal of
media coverage before and were compared to human coding and applied Applied Psychology
after the 9/11 crisis to presidential speeches
Speeches, radio addresses and Examination of elements of Authors created eight composite variables based Bligh, Kohles, and Meindl
articles from U.S. newspapers charismatic leadership on DICTION dictionaries to assess elements of (2004b), Leadership
evident in President Bush’s charismatic leadership based on a framework Quarterly
rhetorical language and in developed by Shamir, Arthur, and House
the media before and after (1994)
the 9/11 crisis
Written statements from the Examines communicated The author used DICTION to develop 36 custom Aust (2004), Communication
United Church of God such as values as indicators of dictionaries to examine different values as Studies
belief statements, letters from organizational identity indicators of organizational identity
its president and chairman,
and magazine articles

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


Press releases from 81 firms Examines effects of DICTION dictionaries were used to assess Hunter (2003), Journal of
describing their information information technology differences in spatial awareness, ambivalence, Information Technology
technology related investment press releases rapport, diversity, hardship, blame, exclusion, Theory and Application
investments on firm performance aggression, past concern, and inspiration in
press releases based on articulation of IT
investments

(continued)

735
736
Table 2 (continued)
Research Question,
Narrative Document Analyzed Topic, or Goal Use of DICTION Publication Citation

Management’s discussion and Use of communicative action Authors compared three groups of firms (those Yuthas, Rogers, and Dillard
analysis sections from corp- in corporate annual reports that performed above and below analysts’ (2002), Journal of
orate annual reports earnings expectations and ‘‘average’’ firms) Business Ethics
using DICTION master variables
Chairman’s letters and Applies DICTION and a ‘‘Good’’ and ‘‘poor’’ performers are compared Sydserff and Weetman
management and discussion transitivity index to using DICTION master variables (certainty, (2002), Accounting,
sections of annual reports accounting research optimism, activity, realism, communality) Auditing and
Accountability Journal
CEO letters to shareholders Examines the link between The authors used DICTION to develop two Loomis and Meyer (2000),
corporate culture and custom dictionaries: one for words denoting International Journal of
public journalism concern with profitability and one for words Public Opinion Research
expressing social concern
Management discussion and Examination of the use of Authors used DICTION to find differences in the Ober, Zhao, Davis, and
analysis sections of 10-K certainty in public business use of certainty (a DICTION master variable) Alexander (1999), Journal

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


reports and recorded public discourse between oral and written communications of Business
discourses Communication
Short, Palmer / Content Analysis Research 737

Applying DICTION to Organizational Mission Statements

Mission statements are important narrative documents that allow organizations to define
their overarching purpose or reason for existence. Scholars have argued that identification
of the mission is the starting point in strategic planning (Ireland & Hitt, 1992). The mission
is seen as an enduring statement of purpose and the ‘‘cultural glue’’ that allows internal and
external stakeholders to function as one. Missions encourage stakeholders to embrace com-
pany goals as their own (Ireland & Hitt, 1992) and can provide a basis for a psychological
contract between an organization and its employees (Thompson & Bunderson, 2003).
Furthermore, mission statements allow organizations to provide insights into their philoso-
phies and strategies that constitute their organizational identity (Leuthesser & Kohli, 1997).
Mission statements are highly salient to academic institutions such as universities and
schools of business. The articulation of, and adherence to, a mission is central to business
school accreditation, regardless of the accrediting body. Thus, schools cannot be cavalier
when crafting their mission, but rather must consider their core competencies, stakeholder
groups, and long-term goals in devising their mission. What is included in the mission,
therefore, is not a matter of happenstance but instead is the result of deliberate choices
intended to communicate to, and motivate, key constituents. Top administrators, deans,
and other associated stakeholders would therefore put considerable thought into the lan-
guage content and tone of their mission statements. For this reason, computer-aided soft-
ware such as DICTION can be an important analytical tool to investigate the content of
mission statements.

Method
Our sample was drawn from AACSB-accredited schools of business in the United
States in 2005. At the time of our data collection, 429 U.S. schools of business were accre-
dited by the AACSB. We were able to collect mission statements for 408 schools from the
AACSB Web site, allowing us a sample constituting 95.1% of the U.S. schools of business
accredited by the AACSB at the time of our data collection.
Mission statements were analyzed using the DICTION 5.0 software package (Hart,
2000). For our illustrative analysis, we chose to contrast the missions of public and private
institutions. Previous research has found significant differences in the articulation of key
business school objectives between private and public schools in terms of the ethical con-
tent of mission statements (Buff & Yonkers, 2004). Thus, we had reason to suspect that
DICTION would be able to identify points of distinction.
To measure performance, we relied on graduate and undergraduate performance rank-
ings from U.S. News & World Report. Although the use of rankings is often controversial,
such measures represent an important goal for business schools with considerable institu-
tional norms that make these reputation measures salient for most, if not all, schools or
colleges of business (Gioia & Corley, 2002); Such measures have been noted to be espe-
cially salient to administrators and deans (Gumbus, 2005). Because U.S. News & World
Report notes the first step in their rankings methodology is categorizing schools by mis-
sion (Morse & Flanigan, 2006), we believe these measures are especially attractive for our
illustration of DICTION.

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


738 Organizational Research Methods

We conducted two data analysis procedures to assess the ability of DICTION to detect
(a) differences in mission content between public and private schools, and (b) relation-
ships between mission content and business school performance. We used ANOVA, and
OLS Regression, respectively, to perform each of these analyses.

Results
Correlations for DICTION master and calculated variables are displayed in Table 3. As
shown in Table 4, our analysis revealed significant differences between private and public
schools for one master variable (i.e., optimism) and two calculated variables (embellish-
ment and complexity). In the following paragraphs, we provide mission statement exem-
plars from our sample that provide insight into DICTION’s content analysis capabilities.
With regard to optimism, we found that the language of private business schools was
more likely to include positive entailments or endorsements of specific persons, groups,
concepts, or events associated with the school. For example, the private school scoring
highest on this dimension was Seattle University. Their mission states it is ‘‘inspired by
the Jesuit traditions of academic excellence, education for justice, and service to others.’’
The strong endorsement to positive Jesuit values resulted in the high optimism score.
Second, the missions of private schools could be characterized as incorporating more
embellishment in that they tended to rely more on adjectives than verbs when articulating
their mission. For example, New York University’s mission notes the school is committed
to ‘‘deliver the highest quality management education to the brightest business students in
a dynamic environment of mutual learning, teamwork, and support.’’ Furthermore, their
mission is to foster ‘‘creative, cutting-edge research’’ (italics added).
Last, the mission statements of public schools were considerably more complex in that
they, on average, tended to rely on more complex word usage (i.e., larger average word
size) than mission statements of private business schools. For example, the mission at Cali-
fornia State University, Chico notes it is a ‘‘student-centered, residential learning commu-
nity that fosters innovative, high quality business education emphasizing applied learning,
integration of technology, and understanding of diversity.’’ In contrast, private Rollins
College scored very low in complexity as their mission is to ‘‘prepare students to be both
managers and leaders who will add value to their organizations and communities.’’
As shown in Table 5, one master variable (activity) and two calculated variables (embel-
lishment and complexity) were associated with our performance measures. Across under-
graduate and graduate rankings, activity and embellishment were positively associated with
higher rankings, whereas complexity was negatively associated with higher rankings. An
example of a ranked school with high activity (language featuring movement and change) in
their mission is Texas Christian University. Their mission is ‘‘developing ethical leaders with
a global perspective who help shape the business environment of a rapidly changing future.’’
Arizona State University provides an example of a ranked school with a high score on embel-
lishment (greater use of adjectives than verbs). The mission notes, ‘‘We strive to nurture stu-
dent success through innovation and value-added personalized programs. The following core
competencies are emphasized within our program: knowledge, skills, ethical behavior, posi-
tive attitude, and creativity.’’ There was a negative correlation between complexity (i.e.,
word size) and rankings measures. An example of a ranked school whose mission scored low

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


Short, Palmer / Content Analysis Research 739

Table 3
Correlations Between DICTION Master and Calculated
Variables in U.S. Colleges of Business
1 2 3 4 5 6 7 8 9

Master variables
1. Certainty 1
2. Optimism –.12∗ 1
3. Activity .14∗∗ –.24∗∗ 1
4. Realism .04 –.17∗∗ .16∗∗ 1
5. Commonality .05 –.11∗ –.03 –.10∗ 1
Calculated variables
6. Insistence .79∗∗ –.09 .14∗∗ –.10∗ .05 1
7. Embellishment –.18∗∗ .28∗∗ –.93∗∗ –.14∗∗ –.00 –.17∗∗ 1
8. Variety –.86∗∗ .14∗∗ –.19∗∗ –.04 –.05 –.73∗∗ .23∗∗ 1
9. Complexity –.25∗∗ .06 –.08 –.66∗∗ .05 –.03 .05 .28∗∗ 1

p < .05. ∗ p < .01.
Table 4
ANOVA Differences Between Public and Private
Schools Mission Statement Content
DICTION Scores Public Schools Private Schools F

Master variables
Certainty 44.64 44.64 0.00
Optimism 55.49 56.82 10.29∗∗
Activity 44.72 42.33 3.54
Realism 43.36 43.54 0.19
Commonality 51.71 52.02 0.34
Calculated variables
Insistence 64.73 64.83 0.00
Embellishment 2.10 3.48 5.30∗
Variety 0.69 0.69 0.03
Complexity 6.10 5.96 9.17∗∗

p < .05. ∗∗ p < .01.

on complexity is The University of California at Berkeley. Their mission states, ‘‘Our goal is
to graduate students with the skills to make the most of the economic opportunities available
in our country and our world–and the values to share what they create.’’ Overall, there were
several consistent findings in the use of language between business school mission statements
and organizational characteristics, including performance.

Integrating DICTION With Human-Scored Content Analysis

The value of DICTION can be illustrated further by demonstrating how DICTION ana-
lyses can be used in conjunction with human- scored content analysis. To provide a theo-
retical lens, we relied on a typology developed by Pearce and David (1987). Although

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


740 Organizational Research Methods

Table 5
Regression Relationships Between Mission Statement Content and Performance
U.S. News & World Report U.S. News & World Report
DICTION Scores Undergraduate Rankings Graduate Rankings

Master variables
Certainty –.10 –.17
Optimism –.04 –.02
Activity .30∗ .29∗
Realism –.05 –.12
Commonality –.03 .02
Calculated variables
Insistence .12 .10
Embellishment .33∗ .29∗
Variety .05 –.02
Complexity –.21∗∗ –.30∗∗
F 2.24∗ 3.12∗∗
Adjusted R2 .03 .05

Note: Standardized regression coefficients are shown.



p < .05. ∗∗ p < .01.

there is no profile for the ‘‘ideal’’ mission statement, Pearce and David were the first to
systematically explore mission statement characteristics and their implications for business,
including performance. An important outcome of their research was a typology of eight mis-
sion statement components. Motivated by their work among Fortune 500 firms, more recent
studies have used Pearce and David’s framework to illustrate uses of computer-aided con-
tent analysis (e.g., Morris, 1994), and Pearce and David’s scheme continues to be an estab-
lished framework to analyze the content of organizational missions (e.g., O’Gorman &
Doran, 1999).

Method
Mission statements were analyzed using Pearce and David’s (1987) eight-item typol-
ogy. Table 6 displays the mission elements, coding definitions, and examples from busi-
ness school mission statements.
Both authors independently coded all mission statements. A coding of 1 was assigned
to the statement for each component if it was judged as being present in the mission state-
ment and a coding of 0 was assigned if the component was judged as not present. Initial
intercoder reliability was 95%. After the first round of ratings, mission statements of
schools both coders agreed on were retained. Schools with coding differences were inde-
pendently reevaluated by each author. Subsequent evaluations were discussed until agree-
ment was achieved.

Results
As shown in Table 6, content analysis revealed considerable variance in the presence
of Pearce and David’s (1987) mission statement elements. The specification of target

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


Table 6
Manual Coding Scheme for Mission Statements of Schools of Business
Schools Articulating
Mission Element Coding Definition Mission Statement Example Mission Component

n %
The specification of Who are the school’s customers (e.g., ‘‘To provide a quality, professional 200 48.9
target customers and graduate students, undergraduate business education for the people of
markets students, students defined by the State of Alabama’’ (Auburn
religious orientation, or working University)
professionals)
The identification of What are the school’s primary products ‘‘Dedicated to providing a nationally 385 94.1
principal products or services? (e.g., broad-based accredited professional education’’
or services definitions of educating, teaching, or (Indiana State University)
focused definitions such as online
and executive programs)
The specification of Where does the school compete? (e.g., ‘‘We are Boston’s public business 206 50.4
geographic domain statements that define a geographic school’’ (University of
scope such as a local community, Massachusetts Boston)
city, state, or region)
The identification of Is the use of technology in program ‘‘Bringing new technologies, new 42 10.3
core technologies delivery specified? (e.g., lecture, methods of learning and teaching
distance learning, or wireless. This and new ways of thinking’’
component does not address the (University of Michigan)
content of curricula but the delivery

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


of programs)
The expression of Is the school committed to performance ‘‘Is committed to continuous 134 32.8
commitment to objectives? (e.g., statements that improvement of its historic teaching
survival, growth, express specific growth, ranking, or and service tradition’’ (Clark Atlanta
and profitability enrollment goals or more general University)
goals about continuous
improvement)

(continued)

741
742
Table 6 (continued)
Schools Articulating
Mission Element Coding Definition Mission Statement Example Mission Component

The specification of What are the basic beliefs, values, and ‘‘Through a broad based liberal 151 36.9
key elements in the priorities? (e.g., statements that education in the Catholic tradition’’
school’s philosophy express philosophical ideals, and the (King’s College)
importance of training for social
responsibility)
The identification of What is the organization’s distinctive ‘‘Distinguished by their excellence and 295 72.1
the school’s self- competence or competitive their emphasis on the management
concept advantage? (e.g., specific mention of of technology’’ (North Carolina
strengths, keys to success, or unique State University)
quality)
The identification of Is the school responsive to social, com- ‘‘Engaging in intellectual contributions 252 61.6
the school’s desired munity, and environmental and conveying the results of such
public image concerns? (e.g., express concern or efforts to the wider academic and
outreach toward to the greater business community’’ (Southwest
community, state, region, or ethical Missouri State University)

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


duties to the community at large
including ‘‘partnerships’’ and
training)
Short, Palmer / Content Analysis Research 743

customers and markets was evident in 200 (49%) of the missions analyzed in our sample.
The identification of principal products and/or services was articulated in 385 (94%) of
the missions analyzed in our sample. The identification of geographic domain where the
school competes was presented in 206 (50%) of the missions analyzed in our sample. The
identification of use of technology was articulated in 42 (10%) of the missions analyzed in
our sample. The expression of commitments to growth, survival, and profitability was
noted in 134 (33%) of the missions in our sample. The specification of key elements of
the school philosophy was discussed in 151 (37%) of the missions in our sample. The
identification of the school self-concept was mentioned in 295 (72%) of the missions in
our sample. The identification of the school’s desired public image was highlighted in 252
(62%) of the missions in our sample.
To illustrate the use of human coding in conjunction with DICTION we followed a pro-
cedure used by Hunter (2003). In his study of the influences of IT investments on stock
market performance, he first classified IT investments as exploratory or exploitive based
on human coding of press releases. DICTION was used in an exploratory manner to exam-
ine textual differences between exploratory and exploitive documents (by comparing the
means of each group). To follow this procedure, we first coded for mission elements based
on Pearce and David’s (1987) framework of eight mission elements. Next, we used DIC-
TION master and calculated variables to examine differences in language use in mission
statements that either did or did not articulate each element. Our results for DICTION
master variables are displayed in Table 7 and our results for DICTION calculated vari-
ables are displayed in Table 8.
In regard to DICTION’s master variables, missions that articulated several of Pearce
and David’s mission elements tended to be significantly higher in regard to certainty (lan-
guage that indicates resoluteness, inflexibility, completeness, and a tendency to speak with
authority); significant differences in the means of certainty were evident in six of the eight
Pearce and David elements. However, missions that relied on such elements were gener-
ally lower in terms of realism (language describing tangible, immediate, recognizable
matters). In regard to DICTION’s calculated variables based on the unique characteristics
of mission text, missions that included Pearce and David’s elements were often higher in
terms of insistence (use of repeated words), but they were lower in terms of variety (based
on DICTION’s calculation of a Type-Token Ratio that divides the number of different
words in a passage by the passage’s total words).
Because strategic management researchers are often concerned with examining the
determinants of organization performance, we conducted an additional illustrative analysis
with hierarchical regression; specifically, we examined the influence of mission elements
on business school rankings above any effects captured by the Pearce and David elements.
Our results are displayed in Table 9. The influence of DICTION elements provided
approximately the same change in R2 as the Pearce and David elements. Both the human
scored content analysis (based on the Pearce and David framework) and DICTION analy-
sis significantly increased R2 . Overall, insights from the Pearce and David framework
highlight that the highest performing colleges expressed commitment to growth, survival,
and profitability and eschewed the identification of geographic area where they operate;
In terms of the insights of DICTION, the highest ranked schools exhibited mission

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


744
Table 7
ANOVA Differences in Articulation of Mission Components and DICTION Master Variables
Certainty Optimism Activity Realism Commonality

Mission Component
Articulated Yes No F Yes No F Yes No F Yes No F Yes No F

The specification of 44.60 42.83 14.83 ∗∗


55.12 55.89 3.39 43.29 41.74 1.47 43.11 44.21 6.75 ∗
51.87 52.28 0.58
target customers and
markets
The identification of 45.11 42.32 9.03∗∗ 55.98 55.03 1.29 44.52 40.51 2.43 43.08 44.24 1.86 51.66 52.49 0.58
principal products
and/or services
The identification of 44.15 43.28 3.22 55.15 55.86 2.67 41.34 43.68 3.10 44.16 43.15 5.24∗ 51.70 52.45 1.80
geographic domain
where the school
competes
The identification of 44.05 43.38 0.88 55.32 55.69 0.35 42.97 42.06 0.22 43.27 44.04 1.40 52.51 51.64 1.11
use of technology
The expression of 44.76 42.67 19.26∗∗ 55.42 55.59 0.15 43.49 41.54 2.19 44.03 43.28 2.95 51.93 52.21 0.25
commitments to
growth, survival,
and profitability
The specification of 44.46 42.97 10.91∗∗ 56.32 54.69 16.01∗∗ 40.91 44.12 6.57∗ 43.05 44.27 8.58∗ 52.03 52.11 0.02

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


key elements of the
school philosophy
The identification of 44.24 43.19 4.26∗ 55.58 55.43 0.12 41.76 43.27 1.17 43.39 43.92 1.30 52.48 51.67 1.91
the school
self-concept
The identification of 45.05 42.38 31.79∗∗ 55.40 55.61 0.24 43.86 41.17 4.20∗ 43.80 43.52 0.43 52.93 51.21 9.74∗∗
the school’s desired
public image

p < .05. ∗∗ p < .01.
Table 8
ANOVA Differences in Articulation of Mission Components and DICTION Calculated Variables
Insistence Embellishment Variety Complexity

Mission Component Articulated Yes No F Yes No F Yes No F Yes No F

The specification of target 83.61 48.46 15.85∗∗ 2.84 3.93 3.34 0.70 0.75 25.44∗∗ 6.16 6.07 0.86
customers and markets
The identification of principal 76.82 55.24 1.47 2.18 4.58 3.98∗ 0.69 0.76 9.31∗∗ 6.09 6.10 0.01
products and/or services
The identification of geographic 75.61 56.45 4.34∗ 3.66 3.11 0.78 0.71 0.74 6.96∗∗ 6.08 6.11 0.28
domain where the school
competes
The identification of use of 77.22 54.85 2.17 2.87 3.90 1.26 0.71 0.74 2.86 6.15 6.04 2.01
technology
The expression of commitments 80.26 51.80 9.77∗∗ 2.97 3.80 1.81 0.71 0.74 8.13∗∗ 6.04 6.15 4.32∗
to growth, survival, and
profitability
The specification of key 82.53 49.54 14.52∗∗ 4.32 2.44 10.36∗∗ 0.71 0.74 10.52∗∗ 6.10 6.10 0.01
elements of the school
philosophy

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


The identification of the school 76.36 55.70 4.58∗ 3.45 3.32 0.04 0.70 0.75 15.92∗∗ 6.08 6.11 0.35
self-concept
The identification of the school’s 79.22 52.84 8.47∗∗ 2.79 3.98 3.75 0.69 0.76 38.26∗∗ 6.07 6.12 0.78
desired public image

p < .05. ∗∗ p < .01.

745
746 Organizational Research Methods

statements that used simple, rather than complex, words (i.e., they were significantly
lower in terms of the DICTION calculated variable for complexity).
In the following section, we discuss the implications of our analyses and suggest ideas
for future research.

Discussion

The intent of this study is to illustrate how DICTION can be used to aid content analysis
in strategic management research. Hart (2000) has said that DICTION is a reliable but
‘‘humble device’’ because it ignores how and why words are chosen in texts and instead
focuses only on the kinds of words people use. Our results, therefore, are not replete with
vivid images, but instead reveal patterns of word usage that may be missed with other
forms of content analysis. Unlike a human coder, DICTION is never tempted by biases.
Thus, it allows researchers the freedom to consider theoretical possibilities that explain
patterns of text detected in narratives of interest. Research has found a high degree of
comparability between DICTION measures and human coding (Bligh et al., 2004b), but
DICTION can analyze thousands of words of text in minutes.
Despite the many merits of DICTION, researchers should not be cavalier when using
this tool. The master variables, calculated variables, and specific dictionaries used by DIC-
TION may or may not be theoretically viable for every research question. One of the
strengths of content analysis is that this technique can be used to conduct both inductive
and deductive research (Roberts, 1989). Although previous research has used DICTION
in a largely exploratory manner (e.g., Hunter, 2003), we believe that the value of this tool
for strategic management will be best maximized when DICTION is used to examine pre-
defined elements based on theoretically defined categories and concepts. With that goal in
mind, in the following sections we identify a number of research streams that may fit well
with DICTION’s capabilities.
One master variable assessed by DICTION, certainty, has been noted as an important
element in business discourse (Ober et al., 1999), and future research could examine
topics involving the use of certainty in strategic management. For example, recent
research examining the prospectus statements of IPOs found little relation between pro-
spectus content and performance (Daily, Certo, & Dalton, 2005). Incorporation of DIC-
TION into this research stream would provide a tool to assess the relationship between the
narrative tone of prospectus statements and performance. Because decision makers often
rely more on intuition than hard data when making strategic decisions, it is possible that
investors react more to the verbal tone and syntax of prospectus statements when deciding
whether to invest in such ventures; A relationship between certainty and IPO performance
could suggest that investors (or perhaps underwriters) are positively disposed toward con-
fidence in prospectus writing when it comes to pricing and valuing IPOs.
Scholars have suggested that positive psychological capital of organizational leaders
may lead to performance at the organizational level (Luthans & Yousseff, 2004). In asses-
sing the positive psychological capital of leaders, Luthans (2002) notes that confidence,
hope, resilience, and optimism are four key dimensions of this construct. DICTION’s mas-
ter variable for optimism measures this quality in a manner that may be useful for research

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


Table 9
Hierarchical Regression Results for Manual Coding and DICTION Measures
U.S. News & World Report U.S. News & World Report
Undergraduate Rankings Graduate Rankings

Manual coding
The specification of target customers and markets –.04 –.04 –.07 –.08
The identification of principal products and/or services .01 .02 –.07 –.07
The identification of geographic domain where the school competes –.20∗∗ –.21∗∗ –.18∗∗ –.17∗∗
The identification of use of technology .03 .05 .01 .02
The expression of commitments to growth, survival, and profitability .12∗ .11∗ .14∗∗ .13∗
The specification of key elements of the school philosophy –.04 –.06 –.04 –.07
The identification of the school self–concept –.04 –.04 .01 –.01
The identification of the school’s desired public image .00 .01 .04 .03
DICTION variables
Certainty –.15 –.21
Optimism –.05 –.02
Activity .21 .21
Realism –.03 –.13
Commonality –.05 –.00
Insistence .13 .10
Embellishment .28 .23

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


Variety –.06 –.13
Complexity –.19∗∗ –.28∗∗
Change F 2.84∗∗ 2.18∗ 2.88∗∗ 3.00∗∗
R2 .05 .10 .06 .12
Change R2 .05 .05 .06 .06

p < .05. ∗∗ p < .01.

747
748 Organizational Research Methods

encompassing elements of positive psychological capital. Confidence may be assessed by


DICTION’s tenacity dictionary, which highlights verbs that denote confidence and total-
ity. DICTION users could utilize the software’s ability to create custom dictionaries to
assess terms that capture the other dimensions of positive psychological capital: hope and
resilience.
DICTION may be useful for providing a reliable tool to assess elements of social iden-
tity. Ullrich, Wieseke, and Van Dick (2005) used semistructured interviews to examine
elements of continuity, change, and uncertainty as elements of social identity in a corpo-
rate merger. The DICTION master variable activity (which analyzes language featuring
movement and change and the avoidance of inertia) would allow for assessment of this
element of social identity in interviews or other narrative texts. This analysis could be sup-
plemented with DICTION’s ambivalence dictionary that captures elements of uncertainty.
Recent empirical research has noted the role of organizational culture in responding to
identity threats (Ravasi & Schultz, 2006). These authors argue that ‘‘in organizations, visi-
ble, tangible, and audible manifestations of culture, such as language, stories, visual
images, material artifacts, and established practices, are among the most powerful sym-
bols members rely on for constructing meaning and organizing action’’ (p. 453). They
examined a number of narrative texts that could be analyzed using DICTION including
semistructured interviews, transcripts of company seminars, in house magazines, and
annual reports. The authors sampled from a single organization and found credibility to be
one of the essential components of corporate identity. DICTION’s measure of realism
(which assesses language describing tangible, immediate, and recognizable matters) could
be used to examine credibility in future research efforts that emphasize the language or
organizational culture.
Etzioni’s concept of communitarian thinking suggests that all those involved in a cor-
poration are potentially members of a single community. More recently, Etzioni (1998)
argued that the communitarian concepts have much in common with elements of stake-
holder theory. Because DICTION’s variable commonality was based on Amitai Etzioni’s
(1993) concept of communitarian thinking, future research could examine correlations
between the articulation of elements of stakeholder management (such as mentions of
corporate social responsibility, specific stakeholder groups, or other words that highlight
shareholder engagement) and DICTION’s measure of communality. More than a decade
ago, Barry and Elmes (1997) predicted that strategic discourses would be more likely to
incorporate elements of communitarian characterizations. Using a comparable data source
over time (such as annual report texts), this proposition could be tested using DICTION.
In addition to the value of DICTION’s master variables, the individual dictionaries pro-
vided by DICTION may also be useful in many research streams. For example, previous
research relied on human scored schema to content analyze elements of excuses as mea-
sures of defensive impression management (Arndt & Bigelow, 2000). The DICTION dic-
tionaries for denial and blame may provide useful for future research examining defensive
impression management. Likewise, DICTION could be a valuable tool to examine attribu-
tions of executives in organizational narratives.
Future research could benefit by empirically illustrating the differences provided by
DICTION in comparison to and in concert with other content analysis techniques. Our
illustration of DICTION demonstrated that this technique may provide predictive insights

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


Short, Palmer / Content Analysis Research 749

above and beyond those gleaned from human scored techniques. Examining independent
and interaction effects between human coding and DICTION could provide for a rich
understanding of the nuances of mission content. The incorporation of multiple forms of
content analysis could also benefit substantive research questions. For example, scholars
have suggested that mission statement alignment may be a key source of performance dif-
ferences (Crotts, Dickson, & Ford, 2005), and future tests of alignment between university
and business school mission statements that rely on manual-coded and computer-aided
techniques including DICTION may provide additional insights as to the linkage between
mission content and performance.

Conclusion
Our results suggest that DICTION can be extremely useful in research involving lan-
guage usage because DICTION taps into difficult-to-measure ‘‘unobservables’’ inherent
in strategic management research (Godfrey & Hill, 1995). DICTION allows for the inte-
gration of theoretically rich word count techniques while also providing the benefits of
artificial intelligence techniques that are rare in strategic management research. At the
same time, DICTION has many of the abilities of other computer-aided content analysis
packages such as the ability to create user-defined dictionaries. We are encouraged
by DICTION’s potential and flexibility, and it is our hope that strategic management
researchers will add this powerful technique to their methodological toolkits.

References
Alexa, M., & Zuell, C. (1999). A review of software for text analysis (ZUMA-Nachrichten, Spezial Band 5).
Mannheim, Germany: ZUMA.
Ansoff, H. I. (1987). The emerging paradigm of strategic behavior. Strategic Management Journal, 8, 501-515.
Arndt, M., & Bigelow, B. (2000). Presenting structural innovation in an institutional environment: Hospitals’
use of impression management. Administrative Science Quarterly, 45, 494-522.
Aust, P. J. (2004). Communicated values as indicators of organizational identity: A method for organizational
assessment and its application in a case study. Communication Studies, 55, 515-534.
Axelrod, R. (1976). Structure of decision: The cognitive maps of political elites. Princeton, NJ: Princeton
University Press.
Barber, J. D. (1992). The presidential character: Predicting performance in the White House (4th ed.).
Englewood Cliffs, NJ: Prentice Hall.
Barr, P. S., Stimpert, J. L., & Huff, A. S. (1992). Cognitive change, strategic action, and organizational
renewal. Strategic Management Journal, 13, 15-36.
Barringer, B. R., Jones, F. F., & Neubaum, D. O. (2005). A quantitative content analysis of the characteristics
of rapid-growth firms and their founders. Journal of Business Venturing, 20, 663-687.
Barry, D., & Elmes, M. (1997). Strategy retold: Toward a narrative view of strategic discourse. Academy
of Management Review, 22, 429-452.
Bashor, H. (2004). Content analysis of short, structured texts: The need for multifaceted strategies. Journal
of Diplomatic Language, 1, 1-13.
Bellah, R., Madison, R., Sullivan, W., Swindler, A., & Tipton, S. (1991). The good society. New York: Knopf.
Bettman, J. R., & Weitz, B. A. (1983). Attributions in the board room: Causal reasoning in corporate annual
reports. Administrative Science Quarterly, 28, 165-183.

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


750 Organizational Research Methods

Bligh, M. C., Kohles, J. C., & Meindl, J. R. (2004a). Charisma under crisis: Presidential leadership, rhetoric, and
media responses before and after the September 11th terrorist attacks. Leadership Quarterly, 15, 211-239.
Bligh, M. C., Kohles, J. C., & Meindl, J. R. (2004b). Charting the language of leadership: A methodological
investigation of President Bush and the crisis of 9/11. Journal of Applied Psychology, 89, 562-574.
Boder, D. (1940). The adjective verb quotient: A contribution to the psychology of language. Psychology
Record, 3, 310-343.
Bowman, E. H. (1978). Strategy, annual reports, and alchemy. California Management Review, 20, 64-71.
Bowman, E. H. (1984). Content analysis of annual reports for corporate strategy and risk. Interfaces, 14, 61-71.
Boyd, B. K., Gove, S., & Hitt, M. A. (2005). Consequences of measurement problems in strategy research:
The case of AMIHUD and LEV. Strategic Management Journal, 26, 367-375.
Brown, A. (1997). Narcissism, identity, and legitimacy. Academy of Management Review, 22, 643-686.
Buff, C. L., & Yonkers, V. (2004). How will they know right from wrong? A study of ethics in the mission
statements and curriculum of AACSB undergraduate marketing programs. Marketing Education Review,
14, 71-79.
Carley, K. M. (1997). Extracting team mental models through textual analysis. Journal of Organizational
Behavior, 18, 533-558.
Clapham, S. E., & Schwenk, C. R. (1991). Self-serving attributions, managerial cognition, and company
performance. Strategic Management Journal, 12, 219-229.
Conger, J. (1991). Inspiring others: The language of leadership. Academy of Management Executive, 5, 31-45.
Crotts, J. C., Dickson, D. R., & Ford, R. C. (2005). Aligning organizational processes with mission: The case
of service excellence. Academy of Management Executive, 19, 54-68.
Daily, C. M., Certo, S. T., & Dalton, D. R. (2005). Investment bankers and IPO pricing: Does prospectus
information matter? Journal of Business Venturing, 20, 93-111.
D’Aveni, R. A., & MacMillan, I. C. (1990). Crisis and the content of managerial communications: A study of
the focus of attention of top managers in surviving and failing firms. Administrative Science Quarterly, 35,
634-657.
Deffner, G. (1986). Microcomputers as aids in Gottschalk-Gleser rating. Psychiatry Research, 18, 151-159.
Dewey, J. (1954). The public and its problems. Chicago: Swallow.
Duriau, V. J., & Reger, R. K. (2004). Choice of text analysis software in organization research: Insight from a
multi-dimensional scaling (MDS) analysis. Journées Internationales d’Analyse Statistique des Données
Textuelles, 7, 382-389.
Duriau, V. J., Reger, R. K., & Pfarrer, M. D. (2007). A content analysis of the content analysis literature in
organizational studies—Research themes, data sources, and methodological refinements. Organizational
Research Methods, 10, 5-34.
Easton, H. (1940). Word frequency dictionary. New York: Dover.
Etzioni, A. (1993). The spirit of community: Rights, responsibilities, and the communitarian agenda.
New York: Crown.
Etzioni, A. (1998). A communitarian note on stakeholder theory. Business Ethics Quarterly, 8, 679-691.
Finkelstein, S., & Hambrick, D. C. (1996). Strategic leadership: Top executives and their effects on organiza-
tions. New York: West.
Fiol, C. M. (1989). A semiotic analysis of corporate language: Organizational boundaries and joint venturing.
Administrative Science Quarterly, 34, 277-303.
Flesch, R. (1951). The art of clear thinking. New York: Harper.
Gephart, R. P. (1993). The textual approach: Risk and blame in disaster sense-making. Academy of Manage-
ment Journal, 36, 1465-1514.
Gioia, D. A., & Corley, K. G. (2002). Being good versus looking good: Business school rankings and the
Circean transformation from substance to image. Academy of Management Learning and Education, 1,
107-120.
Godfrey, P. C., & Hill, C. W. L. (1995). The problem of unobservables in strategic management research.
Strategic Management Journal, 16, 519-533.
Gumbus, A. (2005). Introducing the balanced scorecard: Creating metrics to measure performance. Journal
of Management Education, 29, 617-630.

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


Short, Palmer / Content Analysis Research 751

Hart, R. P. (1984a). Systematic analysis of political discourse: The development of DICTION. K. Sanders,
L. Kaid, & D. Nimmo (Eds.), Political communication yearbook (pp. 97-134). Carbondale: Southern
Illinois University Press.
Hart, R. P. (1984b). Verbal style and the presidency: A computer-based analysis. New York: Academic.
Hart, R. P. (2000). DICTION 5.0: The text-analysis program. Thousand Oaks, CA: Sage.
Hart, R. P. (2001). Redeveloping DICTION: Theoretical considerations. In M. D. West (Ed.), Theory, method,
and practice in computer content analysis (pp. 43-60). New York: Springer.
Hart, R. P., & Jarvis, S. E. (1997). Political debate: Forms, styles and media. American Behavioral Sciences,
40, 185-122.
Hayward, M. L. A., Rindova, V. P., & Pollock, T. G. (2004). Believing one’s own press: The causes and
consequences of CEO celebrity. Strategic Management Journal, 25, 637-653.
Hinthorne, T. (1996). Predatory capitalism, pragmatism, and legal positivism in the airlines industry. Strategic
Management Journal, 17, 251-270.
Hodgkinson, G. P., Maule, A. J., & Bown, N. J. (2004). Causal cognitive mapping in the organizational strat-
egy field: A comparison of alternative solicitation procedures. Organizational Research Methods, 7, 3-26.
Huff, A. S. (1990). Mapping strategic thought. Chichester, UK: Wiley.
Hunter, S. D. (2003). Information technology, organizational learning, and the market value of the firm.
Journal of Information Technology Theory and Application, 5, 1-28.
Insch, G. S., & Moore, J. E. (1997). Content analysis in leadership research: Examples, procedures, and
suggestions for future use. Leadership Quarterly, 8, 1-25.
Ireland, R. D., & Hitt, M. A. (1992, May-June). Mission statements: Importance, challenge, and recommenda-
tions for development. Business Horizons, pp. 34-42.
Johnson, W. (1946). People in quandaries: The semantics of personal adjustment. New York: Harper.
Kabanoff, B., Waldersee, R., & Cohen, M. (1995). Espoused values and organizational change themes.
Academy of Management Journal, 38, 1075-1104.
Kelle, U. (Ed.). (1995). Computer-aided qualitative data analysis: Theory, methods and practice. London:
Sage.
Krippendorf, K. (2004). Content analysis: An introduction to its methodology. Thousand Oaks, CA: Sage.
Leuthesser, L., & Kohli, C. (1997, May-June). Corporate identity: The role of mission statements. Business
Horizons, pp. 59-66.
Loomis, D., & Meyer, P. (2000). Opinion without polls: Finding a link between corporate culture and public
journalism. International Journal of Public Opinion Research, 12, 276-284.
Lowe, W. (2003). The statistics of text: New methods for content analysis. Paper presented at the Midwest
Conference, http://people.iq.harvard.edu/∼wlowe/Publications/index.html.
Luthans, F. (2002). Positive organizational behavior: Developing and managing psychological strengths.
Academy of Management Executive, 16, 57-72.
Luthans, F., & Yousseff, C. M. (2004). Human, social, and now positive psychological capital management:
Investing in people for competitive advantage. Organizational Dynamics, 33, 143-160.
Merchant, H. (2004). Revisiting shareholder value creation via international joint ventures: Examining inter-
actions among firm- and context-specific variables. Canadian Journal of Administrative Sciences, 21,
129-145.
Mishina, Y., Pollock, T. G., & Porac, J. F. (2004). Are more resources always better for growth? Resource
stickiness in market and product expansion. Strategic Management Journal, 25, 1179-1197.
Morris, R. (1994). Computerized content analysis in management research: A demonstration of advantages &
limitations. Journal of Management, 20, 903-931.
Morse, R. J., & Flanigan, S. (2006). Using the rankings. U.S. News & World Report: America’s Best Colleges,
78-79.
Neuendorf, K. A. (2002). The content analysis guidebook. Thousand Oaks, CA: Sage.
Ober, S., Zhao, J. J., Davis, R., & Alexander, M. W. (1999). Telling it like it is: The use of certainty in public
business discourse. Journal of Business Communication, 36, 280-300.
O’Gorman, C., & Doran, R. (1999). Mission statements in small and medium-sized businesses. Journal
of Small Business Management, 37, 59-66.

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015


752 Organizational Research Methods

Osborne, J. D., Stubbart, C. I., & Ramaprasad, A. (2001). Strategic groups and competitive enactment:
A study of dynamic relationships between mental models and performance. Strategic Management
Journal, 22, 435-454.
Osgood, C. E., Suci, G. J., & Tannenbaum, P. (1957). The measurement of meaning. Urbana-Champaign:
University of Illinois Press.
Pearce, J. A., & David, F. (1987). Corporate mission statements: The bottom line. Academy of Management
Executive, 1, 109-116.
Phillips, M. E. (1994). Industry mindsets: Exploring the cultures of two macro-organizational settings.
Organizational Science, 5, 384-402.
Ramanujam, R. (2003). The effects of discontinuous change on latent errors in organizations: The moderating
role of risk. Academy of Management Journal, 46, 608-617.
Ravasi, D., & Schultz, M. (2006). Responding to organizational identity threats: Exploring the role of organi-
zational culture. Academy of Management Journal, 49, 433-458.
Roberts, C. W. (1989). Other than counting words: A linguistic approach to content analysis. Social Forces,
68, 147-177.
Rogers, R. K., Dillard, J., & Yuthas, K. (2005). The accounting profession: Substantive change and/or image
management. Journal of Business Ethics, 58, 159-176.
Rosenberg, S. D., Schnurr, P. P., & Oxman, T. E. (1990). Content analysis: A comparison of manual and
computerized systems. Journal of Personality Assessment, 54, 298-310.
Schnatterly, K. (2003). Increasing firm value through detection and prevention of white-collar crime. Strategic
Management Journal, 24, 587-614.
Shamir, B., Arthur, M. B., & House, R. J. (1994). The rhetoric of charismatic leadership: A theoretical
extension, a case study, and implications for research. Leadership Quarterly, 5, 25-42.
Short, J. C., & Palmer, T. B. (2003). Organizational performance referents: An empirical examination of their
content and influences. Organizational Behavior and Human Decision Processes, 90, 209-224.
Simon, M., & Houghton, S. M. (2003). The relationship between overconfidence and the introduction of risky
products: Evidence from a field study. Academy of Management Journal, 46, 139-149.
Sydserff, R., & Weetman, P. (2002). Developments in content analysis: a transivity index and DICTION
scores. Accounting, Auditing, & Accountability Journal, 15, 523-545.
Thompson, J. A., & Bunderson, J. S. (2003). Violations of principle: Ideological currency in the psychological
contract. Academy of Management Review, 28, 571-586.
Ullrich, J., Wieseke, J., & Van Dick, R. (2005). Continuity and change in mergers and acquisitions: A social
identity case study of a German industrial merger. Journal of Management Studies, 42, 1549-1569.
Weber, R. P. (1990). Basic content analysis. Newbury Park, CA: Sage.
Weitzman, E. A. (1998). Analyzing qualitative data with computer software. Health Services Research, 34,
1241-1263.
Yuthas, K., Rogers, R., & Dillard, J. F. 2002. Communicative action and corporate annual reports. Journal
of Business Ethics, 41, 141-157.

Jeremy C. Short is the Jerry S. Rawls Professor of Management at Texas Tech University. His research on
multilevel determinants of performance, decision processes, and research methods has appeared in Strategic
Management Journal, Organizational Research Methods, Organizational Behavior and Human Decision
Processes, Journal of Management, and Personnel Psychology.

Timothy B. Palmer is an associate professor of management at Western Michigan University. His research
focuses on elements of managerial cognition and includes decision making in top management teams. His
research has appeared in Strategic Management Journal, Organization Science, Organizational Behavior and
Human Decision Processes, and Journal of Management.

Downloaded from orm.sagepub.com at UNIV OF OKLAHOMA on April 24, 2015

View publication stats

You might also like