Professional Documents
Culture Documents
Fulltext Stamped
Fulltext Stamped
Fulltext Stamped
2012
Previous Studies
For centuries, prominent figures worldwide have advocated for
plain language — Thomas Jefferson, Sir Edward Coke, and King
Edward VI, to name a few.4 Over 50 years ago, the first American
organization was founded to advance a clear style in the law:
Scribes — The American Society of Writers on Legal Subjects.5 Simi-
larly, over the past 30 years, a number of international organizations
have formed to advocate for plain language.6 And advocates have
3
Peter Butt, Plain Language: Drafting and Property Law, 7 Eur. J. L. Reform 19, 21
(2006).
4
See Joseph Kimble, Lifting the Fog of Legalese app. 1, at 175–80 (Carolina Academic
Press 2006) (collecting quotes from many prominent figures from 1537 to 2005).
5
Thomas M. Steele & Norman Otto Stockmeyer, Scribes After More Than 50 Years —
A History, 12 Scribes J. Legal Writing 1, 1–2 (2008–2009).
6
E.g., Clarity: An International Association Promoting Plain Legal Language, founded
in 1983; and Plain Language Association International (PLAIN), founded in 1993.
2011–2012 The Public Speaks: An Empirical Study 123
7
Butt, supra n. 3, at 20.
8
Plain Writing Act of 2010, H.R. 946, 111th Cong. (Oct. 13, 2010).
9
See Karen Schriver & Frances Gordon, Grounding Plain Language in Research,
Clarity No. 64, at 33 (Nov. 2010) (noting the need for further empirical research to
support plain language).
10
See generally Joseph Kimble, Writing for Dollars, Writing to Please: The Case for
Plain Language in Business, Government, and Law 106–33 (Carolina Academic
Press 2012).
11
Id. at 135–42, 153.
12
Kimble, supra n. 4, at 13; see also Sean Flammer, Persuading Judges: An Empirical
Analysis of Writing Style, Persuasion, and the Use of Plain Language, 16 Legal
Writing 183 (2010) (showing a 66% preference in another study).
124 The Scribes Journal of Legal Writing 2011–2012
13
See Mark Adler, Bamboozling the Public, 9 Scribes J. Legal Writing 167 (2003–2004).
14
Id. at 185.
15
See Michele M. Asprèy, Plain Language for Lawyers 57–58 (4th ed., Fed’n Press
2010) (discussing the study).
16
Clark D. Cunningham, What Do Clients Want from Their Lawyers? (Ga. St. U.
Legal Studies Research Paper Series, No. 2010-04) (2009) (available at http://
ssrn.com/abstract=1505616) (citing and explaining the study conducted by Hilary
Sommerland & David Wall, Legally Aided Clients and Their Solicitors: Qualitative
Perspectives on Quality and Legal Aid, The Law Society, Research Study No. 34, at
2–6 (2000)).
17
Id.
18
Plain Lang. Inst. Rep., Critical Opinions: The Public’s View of Lawyers’ Documents,
vol. 11 (1993).
2011–2012 The Public Speaks: An Empirical Study 125
19
Butt, supra n. 3, at 27–28.
20
Joseph Kimble, Answering the Critics of Plain Language, 5 Scribes J. Legal Writing
51, 69–70, 84 (1994–1995).
21
See Robert M. Lawless, Jennifer K. Robbennolt & Thomas S. Ulen, Empirical Meth-
ods in Law 149 (Aspen 2010) (discussing purposive sampling and other
nonprobability methods).
126 The Scribes Journal of Legal Writing 2011–2012
22
See generally R.M. Weddle, Disclosure of Name, Identity, Address, Occupation, or
Business of Client as Violation of Attorney–Client Privilege, 16 A.L.R.3d 1047 (1967).
2011–2012 The Public Speaks: An Empirical Study 127
23
See Lawless et al., supra n. 21, at 149 (stating that “[i]n general, larger samples will
result in more precise estimates of population characteristics”).
24
Id. at 148–49 (discussing snowball sampling).
25
Id.
128 The Scribes Journal of Legal Writing 2011–2012
drafted this sample message that they could cut and paste into their
own e-mail:
26
See SurveyMonkey, Smart Survey Design 14, http://s3.amazonaws.com/
SurveyMonkeyFiles/SmartSurvey.pdf (last accessed May 9, 2012).
2011–2012 The Public Speaks: An Empirical Study 129
One benefit of using an online survey was that I was able to add
“skip logic” to certain questions so that respondents received only
follow-up questions that were relevant to their own experiences.27
For example, if a respondent had not used an attorney, then the
respondent would not see questions 2 through 4 asking about past
use of attorneys. But if a respondent had used an attorney in the
past five years, I then asked follow-up questions about how many
times and for what types of legal matters.
All these questions were designed to help further categorize the
responses given to later substantive questions.
27
See SurveyMonkey, What Is Skip Logic? http://help.surveymonkey.com/app/
answers/detail/a_id/39/kw/question%20logic (last accessed May 9, 2012).
2011–2012 The Public Speaks: An Empirical Study 131
is, the online surveying program would randomly select which ver-
sion to list first.28
I tested four things: (1) active voice versus passive voice (four
questions); (2) strong verbs versus nominalizations (two questions);
(3) plain words versus complex words (four questions); and (4) ex-
plaining a legal term versus not explaining it (one question). Of
course, there are many more aspects of plain language.29 In my view,
though, the four I tested are hallmarks. And frankly, others are
harder to test. By limiting the survey to those four, I was also able
to include multiple questions on the first three, helping me analyze
the consistency of the results.
Crafting these questions required care. The plain-language ver-
sion had to have the same meaning as the traditional version. And I
had to vary the complexity of the traditional passages — I did not
want every one to be so complex that the respondent was forced to
pick the plain-language passage. So I weighed the number of errors
to include in each question. (I realize that choosing between active
and passive voice is not a matter of “error,” but I’ll use that word
for simplicity.)
In 5 of the 11 choice-of-language questions, I tested only one
error. That is, the only difference between the versions was a word
choice or the type of voice used in the passage. I call these single-
variable questions: they were questions 14, 19, 20, 21, and 22. In
those questions, I could tell for sure the reason for the respondent’s
choice.
28
See SurveyMonkey, How Do I Make Answer Choices Flip, Appear Randomly or
Alphabetically? http://help.surveymonkey.com/app/answers/detail/a_id/104 (last
accessed May 9, 2012) (discussing how the user can randomize answer choices).
29
See, e.g., Joseph Kimble, The Elements of Plain Language, in Writing for Dollars,
Writing to Please, supra n. 10, at 5 (setting out 42 guidelines).
2011–2012 The Public Speaks: An Empirical Study 133
For the other 6 questions, I tested more than one error. I call
these multivariable questions: they were questions 15, 16, 17, 18,
23, and 24. For example, in question 16, I included a passive sen-
tence that also contained a nominalization — “A decision was made
by the Board of Directors to review the file.” I did this to test my
hypothesis that the more errors in the traditional version, the greater
the likelihood of choosing the plain-language version. As you’ll see
in the results, this hypothesis proved to be true.
30
SurveyMonkey, supra n. 26, at 14 (citing G. Iarossi, The Power of Survey Design: A
User’s Guide for Managing Surveys, Interpreting Results, and Influencing Respon-
dents (World Bank 2006)).
134 The Scribes Journal of Legal Writing 2011–2012
31
See U.S. Census Bureau, 2012 Statistical Abstract: Population, at 12, table 9 (avail-
able at http://www.census.gov/prod/2011pubs/12statab/pop.pdf) (specifying the
statistical breakdown of the U.S. population by age).
2011–2012 The Public Speaks: An Empirical Study 135
does include a higher percentage in the 30–39 and 50–59 age ranges
than the population as a whole.32
For educational level, the breakdown was as follows:
The Results
32
Id.
33
See U.S. Census Bureau, Educational Attainment in the United States: 2003, at 3,
table A (June 2004) (available at http://www.census.gov/prod/2004pubs/p20-
550.pdf) (specifying the percentage of the U.S. population with a bachelor’s degree
or more).
136 The Scribes Journal of Legal Writing 2011–2012
to do so. And the numbers are even worse for clients: 79% have
received such a document in their lifetime.
Third, in question 13, I again wanted to follow up on this line
of questioning: “If you read an attorney’s letter or legal document
and you did not understand a term, would you look up that term?”
Overall, 32% said they would “always” look up a term they
didn’t understand; 26% “often”; 25% “sometimes”; 13% “rarely”;
and 4% “never.” And these results were consistent among clients
and nonclients.
So while a majority (58%) would at least “often” look up a term,
17% would “rarely” or “never” do so. That means 1 in 8 people
wouldn’t understand the term — odds that I sure wouldn’t want to
take.
Fourth, I wanted respondents’ reaction to receiving a document
that uses complicated terms or Latin words. So back in question 8,
I asked: “How does it make you feel when an attorney uses Latin
words or complicated legal words in written documents?” The
positioning of this question was critical. I didn’t want it to follow
the questions that I discussed above because the answers might be
biased by previous answers. So I put it before question 10, about
the importance of understanding an attorney.
As you might expect, 41% said they get “annoyed” when they
read complicated terms or Latin words; another 19% are “both-
ered a little”; 30% said that such terms have “no influence” on them;
and — get this — only 0.5% (2 respondents) said they’re “im-
pressed.” That’s not much support for the long-held notion that
using complicated terms and Latin words impresses people.
In total, 60% were at least bothered by complicated terms or
Latin words. And to tilt the scales even more, about half the “other”
responses indicated a preference for simple terms or at least an ex-
planation of any complicated term.
Client respondents were even more likely to be put off: 68%
were “annoyed” or “bothered a little” by complicated terms or
2011–2012 The Public Speaks: An Empirical Study 139
It’s one thing to prefer clear, simple writing when asked, but it’s
another thing to actually select the clear, simple version when given
the choice. To recap, for the 11 questions in this section of the sur-
vey, respondents were presented with two passages: one written in
plain language and the other in a more inflated, indirect style. The
results are striking.
Question & Error Type Overall Less than Bachelor’s Master’s & Juris
Avg. Bachelor’s Doctoral Doctor
Word choice
This point is even clearer when you consider two of the indi-
vidual questions.
First, the Latinism — inter alia. When I created question 21, I
purposely chose a Latin word that did not have a legal meaning. I
avoided legal terms of art like res judicata and res ipsa loquitur. These
are legitimate legal terms that “convey in a word or two a fairly
specific, settled meaning.”35 But inter alia conveys no such legal
meaning — it’s simply Latin for “among other things.” Since most
nonlawyers don’t know what it means, it was ripe for testing. I
wanted to make inter alia the only difference between the two sen-
tences.
34
See Kimble, supra n. 10, at 135–42, 153.
35
Kimble, supra n. 4, at 10.
148 The Scribes Journal of Legal Writing 2011–2012
And 97% preferred among other things to inter alia. All respon-
dents with less than a bachelor’s degree chose it. Even 54 out of 61
respondents with a law degree preferred it — and these are the folks
who would understand Latin terms. There’s no reason for attor-
neys to use Latin words that don’t have a legal meaning, no matter
what the audience.
Next, consider question 19, which includes the multiword
preposition pursuant to. “Although [pursuant to] is used in legal
writing and in the legal community, it is not used in ordinary speech
or writing.”36 Using a multiword preposition where one word would
do is a common affliction of traditional legal writing.37 In fact, it’s a
problem in all writing. In his classic Dictonary of Modern English
Usage, H.W. Fowler said that multiword prepositions (which he
called “compound propositions”) “are almost the worst element in
modern English, stuffing up what is written with a compost of
nouny abstractions.”38 So I wanted to test, specifically, whether re-
spondents preferred the simpler under to the commonly used
pursuant to. Even though I included different multiword preposi-
tions in other questions, I wanted to create a single-variable sentence
where that was the only difference.
No surprise: 81% preferred under. Clients and nonclients pre-
ferred it at exactly the same rate — 81%. And almost every
educational group preferred it at rates higher than 80%: 85% of
respondents with less than a bachelor’s degree, 82% of those with
bachelor’s degrees, 80% of those with a master’s degree, and 100%
36
Canadian Dep’t of Just., Pursuant to, http://www.justice.gc.ca/eng/dept-min/pub/
legis/n31.html (last updated Dec. 1, 2011).
37
See Richard C. Wydick, Plain English for Lawyers 11 (5th ed., Carolina Academic
Press 2005).
38
A Dictionary of Modern English Usage 102 (Ernest Gowers ed., 2d ed, Oxford U.
Press 1965).
2011–2012 The Public Speaks: An Empirical Study 149
of those with doctoral degrees. The only group that lowered the
average was, of course, the lawyers, but 69% still preferred under.
The lower rate for lawyers may be because there is occasionally
a subtle difference between under and pursuant to, a difference that
some lawyers might understand. Occasionally, under won’t work,
and you need to use in accordance with (itself a compound prepo-
sition). But under worked in question 19, it works most of the time,
and pursuant to always reeks of legalese.
Nor is there any reason to think that the result would be any
different if I used another multiword preposition. Questions 15 and
23 included the multiword preposition prior to. Although there were
other errors in those two questions, respondents overwhelmingly
preferred the plain-language versions of those questions too — by
83% for question 15 and 80% for question 23.
39
See Kimble, supra n. 10, at 9.
150 The Scribes Journal of Legal Writing 2011–2012