Professional Documents
Culture Documents
Evidence and Argument: Another Look at Audit Fundamentals: Critical Perspectives On Accounting (2001) 12, 247-267
Evidence and Argument: Another Look at Audit Fundamentals: Critical Perspectives On Accounting (2001) 12, 247-267
doi:10.1006/cpac.2000.0414
Available online at http://www.idealibrary.com on
247
10452354/01/030247+21/$35.00/0
248
A. Arthur
Audit fundamentals
249
250
A. Arthur
Audit fundamentals
251
which are damaging exactly to the extent that they comprise a critique of the discipline
being considered or (b) must show itself to be rational by some other, more reliable,
standard. Approach (a) cannot avoid questioning its own legitimacy, as it investigates
the legitimacy of the discipline about which it theorizes. Approach (b) admits that
there must be other ways of accounting for disciplinary rationality, and that social
theory cannot tell the whole story here.
Despite its successes, social theory can, therefore, only give a certain kind of
account of disciplinary rationality. For the reasons given above, this kind of account
cannot directly address questions about the validity of the arguments used within the
discipline it is describing. It can examine the creation of norms within a discipline,
but cannot normatively evaluate it.
A very similar problem exists for other closely related theoretical approaches.
The various flavours of hermeneutic theory might, for instance, be regarded as
the philosophical versions of sociology of knowledge approaches. It is somewhat
beyond the scope of this paper to explore them in detailPower (1986), who
suggested a hermeneutic response to Lyas (1984), gives a very approachable
account. In summary, however, hermeneutic theory attempts to explicitly recognize
the history embedded within any rational enquiry, pointing out that we can never
achieve a complete ahistorical perspective. In recognizing this, however, we are not
recognizing some limit to rational enquiryjust that it is a matter of pushing back
present horizons, rather than hoping to achieve complete knowledge. Unfortunately,
the hermeneutic approach, while offering a good heuristic model for enquiry, also
fails the self-referential test: either hermeneutic theory can be non-hermeneutically
supported, which is self-contradictory; or it is hermeneutically revisable, which means
that another epistemological model could take its place. In passing, it is worth noting
an important problem for writers such as Francis (1994), who explicitly explores the
possibility that auditing is a hermeneutic practice (in the sense of being constantly
under revision by practitioners acting out their professional understanding). This is
that general hermeneutic theory does not allow for epistemological closure: it cannot
be used to excuse a discipline which cannot support its methods. In other words,
hermeneutical theories of knowledge do not create space for either a lack of rigour
or an absence of normative roots.
A principal aim of this paper is to indicate a way out of these self-referential
dilemmas that does not abandon the considerable insights of the sociology of
knowledge, or the benefits of the hermeneutic heuristic, but avoids the more or less
explicit, and therefore incoherent, relativism which these seem to entail. It attempts
to achieve this aim by reviewing some of the more significant traditional approaches
to theorizing about audit evidence, and about its role in the audit process. It then goes
on to review their deficiencies and comment on the relevance of these deficiencies to
audit theory and practice. Finally, it suggests an alternative approach to audit theory
at this level, and shows how quality of argument, rather than quality of evidential
experience (and of audit judgement), is fundamental to the audit process.
Finally, this paper has an ethical dimension: It is difficult to reconstruct, within
a sociology of knowledge framework, a convincing account of what is involved in
doing an audit properly. A comfort of epistemological empiricism is its appeal to an
external arbiter of true knowledge: the world as experienced through our senses.
252
A. Arthur
Audit fundamentals
253
Gray then goes on to reflect on the various hierarchies of evidential types which
his picture suggests, focusing on Mautz and Sharaf (1961), Hatherly (1980), Keenan
(1979) and Keenan and Anderson (1979). Mautz and Sharaf set out a typology of
natural evidence, created evidence, and rational argumentation5 , with natural
evidence being the most reliable and argumentation being the least. Hatherlys
hierarchy places more emphasis on the source of the evidence. He distinguishes
between evidential processes that are under the auditors control and those which
are under the control of third parties; and both of these from sources that are
under the control of the directors. Keenan makes a distinction between primary
best availableevidence, secondaryother direct, but not bestevidence, and
circumstantial evidencewhich is somewhat like Mautz and Sharafs rational
argumentation. There are some similarities between these accounts (especially
between Keenans and Mautz and Sharafs), although it could be argued that
Gray over-emphasizes these and under-emphasizes the differences. Hatherlys
framework, in particular, seems to reflect social (trust and mistrust), rather than
empirical, concerns, and is different from the others in some other ways as well.
It is much more concrete and more closely related to audit practice, insofar as it
depends on categories familiar to auditors rather than attempting to construct general
categories of evidential reliability. In this respect, it operates at a different level from
the other theories that this paper addresses, and is possibly also out of place in
Grays review for the same reason.
Flint (1988) addresses audit evidence in his postulate no. 4 (p. 31):
The subject matter of audit, for example conduct, performance or achievement or record of
events or state of affairs, or a statement or facts relating to any of these, is susceptible to
verification by evidence.
He explicitly refers to Mautz and Sharaf (1961) in his discussion of the nature of
evidence, and clearly aligns himself with their epistemological framework, giving the
following account:
It is a matter of personal skill for auditors to judge how much, what kind, and what
combination of different types of evidence are necessary to enable an opinion justifiably to
254
A. Arthur
be formed and a report to be made. There must be what Mautz and Sharaf (1961, pp. 43, 68)
describe as sufficient competent evidential matter. Verification, they say, is the vehicle
that carries one to a position of confidence about any given proposition.
His account adds something to Mautz and Sharaf, however, in explicitly referring to
the auditors personal skill. According to Power (1990), this is a weak move, since
it appeals to personal qualities at a point where something more formally robust is
required.
In Flints defence, he at least recognizes that something is needed here to credibly
link theory (per Mautz and Sharaf) with practice. Within the generally psychologistic
framework (where verification is taken to be about achieving confidence rather than
proof ) that he and they adopt, personal qualities might reasonably seem to be a
possible starting point. If psychological conviction is to be taken as fundamental,
then we might wish to be able to distinguish between more and less reliable
psychological dispositions. A good audit would be one carried out by someone who
was psychologically disposed to be convinced by appropriate evidence, and not
by inappropriate evidence. Flints postulate implicitly contains a declaration (which
Power, 1990, also notes) on the possibility of auditing. It can be restated as: If
something cannot be verified by evidence, then it is not auditable.
Schandl (1978, pp. 2324) evidence postulate is very similar to Flints, but replaces
the auditors skill, which is a personal quality, with a system of norms. By this, he
means the criteria that are applied to items of evidence in order to reach a conclusion.
In his further postulate on norms (p. 24), he says:
We have to accept without proof that the norms (criteria) exist in our thinking. We see only
the effect of the norms in the acts, writings, or verbal utterances of other individuals, and we
can arrive at the concept by analyzing our own thinking. The judgementssuch as good,
bad, niceare unthinkable without the assumption of an underlying standard of values
(norms) which are implicit in the quality judgements, just as the unit of measurement is
needed if we want to express an opinion as the result of the measurement process.
Throughout Schandl (1978), this picture of the auditor having experiences and
forming judgements, mediated by norms, re-appears. In a short section explicitly
devoted to audit evidence (pp. 8992) he attempts to construct a theoretical
framework for audit judgement consisting of experiences, normative conceptual
structures, and mental comparisons. Where he gives a more general account of the
concept of a norm (pp. 8186), he relates the learning of norms to infant development
and not, significantly, to any more fundamental framework of justification. The
implication of this seems to be that this is all justification is aboutfollowing a set of
normative rules which have been learned at an early age.
From the above, it can be seen that many writers on the fundamental theory
of audit evidence do not distinguished between: (1) theorizing about why certain
kinds of evidence processes are psychologically convincing and (2) theorizing about
whether they lead to valid and supportable conclusions. Most depend upon their
readers professional understanding to establish the connection (with Flint, as noted,
making this an explicit part of this account). As indicated, the accounts given tend
to incorporate an epistemology of common senseas in this example (Mautz and
Sharaf, 1961):
Evidence provides the means by which we can achieve that state of assurance described
Audit fundamentals
255
as knowing as opposed to merely believing. It is thus the key to truth, which may be
described as conformity to reality.
256
A. Arthur
Audit fundamentals
257
258
A. Arthur
of truth, but the scale of the problem should be apparent. For a more comprehensive
investigation, a good place to start might be with Putnam (1981) and Quine (1969,
and elsewhere), who are concerned with the problem of referencethe putative
relationship between words and, where relevant, objectsbroadly definedin the
world, which, for a correspondence theorist, gives the words their meanings and
allows definite truth conditions for sentences to be spelled out.
Coherence, rather than correspondence, theories of truth avoid these difficulties,
but at the expense of intuitive appeal. These theories give accounts of truth in terms
of coherence between statements. In other words, if statement X is coherent with
all the other statements which we hold (perhaps for the moment) to be true, then
X is also true. It is easier to give a non-circular account of coherence than to give
such an account of correspondence. This is partly because we do not have to step
outside the domain of statements to do itwe do not, in other words, have to try to
elucidate a relationship between things which are statements and things (to which
the statements correspond) which are not. Also, conveniently enough, we have a
set of ready-made relationships between statements which are essentially related to
the concept of truth, since they are used to determine the truths of some statements
from the truths of others. These are the relations of formal logic, used to analyse the
steps in an argument in order to determine whether each properly follows from the
preceding one, so that the truth of one implies the truth of the other.
In passing, those with an interest in legal evidence theory will have noted a recent
trend away from correspondence theories and towards coherence theories of truth.
The traditional picture of neutral evidence collection followed by theory construction
is breaking down here, also, and being replaced by a view of evidence collection as
hypothesis driven. The focus has shifted from picturing reality to telling a coherent
story. (See Jackson and Doran, 1996, for a review of the issues. They refer further,
in this context, to Tillers, 1988 and Jackson, 1998.)
The principal theme of this paper is to develop a fundamental theory of audit
evidence based on a coherence theory of truth, and avoiding psychologistic errors,
which is directly related to the discussions of truth, reality, and proof that are found
in the later Wittgenstein (particularly Wittgenstein, 1972 and 1979; in contrast to
Wittgenstein, 1974). In order to do this, it is necessary to develop some of this
philosophical background.
Philosophical Background
If the statement There is no limit to what can intelligibly be believed about the world
was true, then it would be intelligible to believe that some fact about the world could
make it false. For some, this contradiction would count as a reductio ad absurdum8
proof that there are limits to what can be intelligibly believed, and would possibly
inspire their inquiries into the foundations of true knowledge. For others, the various
paradoxes of justification are just logical puzzles, which sophistically fence with the
plain evidence that we are unable to provide satisfactory foundations for even the
most obvious common sense certainties. These others might feel their scepticism
to be reinforced by the reflection that there is a non-trivial circularity associated
Audit fundamentals
259
260
A. Arthur
what we believe and what we can say about these beliefs, however, a more formal recasting of this argument suggests itself. How can someone be completely ignorant of
what is involved in rule following, and yet still be able to ask a question about how to
do it, since asking questionsusing languageis an example of sophisticated rule
following? This version of the argument does not rely on our instinctive repugnance
for ad infinitum explanations, nor on an unanalysable appeal to a form of life, but,
instead, directly reveals the incoherence of the request.
This kind of argument takes the language game metaphoranother Wittgensteinian themecompletely seriously: the articulated study of any discipline (including philosophy, sociology, and auditing) is undertaken by making moves in a
language game. One kind of move is to ask a question, but certain questions, e.g.
questions about whether the game is playable, can have only a restricted range of
answers. If the game is unplayable, then a question about it fails to be a question at
all, and so would not have an answer (far less a negative one, which is what we might,
initially, expect). It can, therefore, only have the answer yes within the game. For
a special subset of these questions, the reasons for this restriction are synthetic.
They depend upon a kind of incoherence, but not on an incoherence between different moves in the game: they depend, instead, on an incoherence between the
truth of certain statements and the possibility of seriously playing the game at all.
Statements such as language works, for example, are synthetic statements about
the world that cannot be false. They are synthetic, because they are not statements
about the rules of any particular language practice (i.e. they are not logical rules,
meaning rules, or grammatical9 rules), and they cannot be false in the sense that
their falsehood cannot form part of any articulable theory.
This is important, and needs a little amplification. Coherence theories of truth focus
on incoherence between statements, and they also tend to take logical incoherence
as the paradigmatic case. In other words, if some set of statements (S) could be
shown to have, as a strict consequence, that some further statement was both true
and false, then S would be shown to be incoherent. In the case of a coherence theory
of truth: if S was some set of coherent statements which represented our current
beliefs about something, and adding some statement C to S made S incoherent,
then C would be false. Consider, however, the statement It is possible to make
statements(P). It should be clear that it must be possible to add this statement to any
set of statements S without rendering S incoherent. This means that P can never be
false. Which also means that not P (It is not possible to make statements) can never
be true. It is not possible to make statements is not tautologically false, however,
in the way that a logical contradiction is. It would be quite intelligible to describe
someone as believing that it was not possible to make statements (if, for instance,
they never made any)10 . In addition, this statement does not contain or entail a
contradiction in the way that Fred is a married bachelor doesthe contradiction
is between its truth and the possibility of saying it, rather than being a result of the
meanings of the words it contains.
In summary, the search for synthetic a priori beliefs may be hopeless, so that what
Power (1986) refers to as our Cartesian anxietythat we can never be relieved
of personal doubtcannot be satisfactorily addressed. However, there are clearly
statements (typically about the possibility of language) that are both synthetic and
Audit fundamentals
261
irrefutable (in the sense of not being articulably falsifiable). Attempts to approach,
exploit, or find methods of refuting this conclusion lie, arguably, at the heart of what
has been called the linguistic turn in philosophical theory. Wittgensteins (1972)
repeated insistence that questions can only be asked from within an epistemological
framework (what he called a form of life, or, on occasions, a language game) is
possibly the key insight of twentieth century analytical philosophy.
Insofar as epistemological fundamentals are concerned, the Kantian project of
exploring what it is possible to believe has been replaced by the Wittgensteinian
one of exploring what it is possible to say. Since we can only ask questions
about our beliefs, i.e. can only publicly consider them, if we can state them,
this second approach turns out, so far as articulable theorizing is concerned,
to be the equivalent of the first. It is perfectly comprehensible, therefore, to talk
about a linguistic fundamentalist epistemology. The most fundamentally supportable
empirical theories are not those whose contraries deny our experience, but those
whose contraries deny the possibility of articulated theorizing itself.
262
A. Arthur
Audit fundamentals
263
Conclusion
Considerations such as the above lead to a conclusion that the audit argument
(including the elements of the argument that support the evidential statements) is a
more important focus of fundamental audit enquiry than the evidence process itself,
and that a fundamental theory of auditing which does both the practical and the
ethical work of Mautz and Sharafs empiricism can be constructed on this basis.
This paper has attempted to review traditional fundamental accounts of audit
evidence with two purposes: to show their relevance, on the one hand, and their
errors, on the other. Their relevance has been related to questions of honest practice
and normative professional direction. Their errors, it is suggested, have been to do
with their adherence to a psychologistic empiricism and a correspondence theory of
truth. In their place, an alternative account has been suggested, which incorporates
a coherence theory of truth and relates the underpinnings of auditing to the underpinnings of discursive practice in general. This type of theory has the advantages of
avoiding the conceptual difficulties associated with empiricism and correspondence,
and suggests a framework for the normative analysis of audit argumentsomething
which is notably missing from empirical research into auditor judgement.
A possible, and mistaken, interpretation of the argument of this paper would be
that it tries to rationalize present audit practice by constructing a fundamental theory
of auditing whose starting point is that the way we do it must be right because it is
the only way available. The reason this interpretation would be mistaken is that the
paper does not argue that what auditors actually do now is correct, or even that a
coherent concept of an audit can be developed within any particular circumstances.
Flints (1988) warning that we must decide whether an audit is possible remains
central, although it should be re-focused as a warning to clearly negotiate and agree
the audit task with the various participants before agreeing to carry it out.
What the paper suggests is a fundamental framework for reviewing audit practices
and, importantly, for recognizing their limitations. The growth of the audit culture
(Power, 1994, 1997) has been made possible, partly, because of poor understanding
of the limitations of auditability. The frameworks of traditional fundamental audit
theorists (Flint, 1988, possibly excluded) do not reflect on these limitations, and
do not offer any approach to analysing them. If truth is correspondence, and our
best access to it is via natural evidence, then the only limitation on auditing is our
access to appropriate natural evidence for the attestation of the audit outcome. While
a complete audit, under this conception, may be expensive or time-consuming,
there is no reasonin principlewhy it cannot be done. The approach suggested
by this paper explicitly recognizes that such a standard of complete auditability
does not, even in principle, make sense, and that we must negotiate, for each new
type of engagement, what would count as an audit under those circumstances.
This has never, notably, been done by parties to the traditional corporate audit.
This negotiation would not have a concept of possible complete auditability as its
background. It would need, instead, to construct such a background by agreeing what
the limitations of auditability were: this agreement would be based on an argument
of a certain form. It would say, in effect: if this is an appropriate subject for audit,
then the following procedures must count because they are all that is available, and
264
A. Arthur
Audit fundamentals
265
belief, will have a more secure concept of honest auditing than those who regard the
business of justification within auditing as being part of a less than generally credible
game, evenor perhaps especiallyif it is a game which is thought of as being no
worse than that played by members of any other discipline. This paper suggests that
doing auditing properly means being prepared to ultimately justify ones methods,
and that, although the details of this justification may be negotiated, there is an
ultimately non-negotiable discursive framework within which this can be done.
Acknowledgements
I would like to thank Mike Power of the London School of Economics for his comments
on an early draft of this paper, Stefano Zambon of the University of Padua for being a
helpful discussant at the 1997 IPA conference, and Penny Ciancanelli of Strathclyde
University for comments on a late re-draft.
Notes
1. These writers give a thoughtful and committed critique of the errors that this has led critical theory
into, but unfortunately they have some erroneous epistemological convictions of their own
2. Various writerseven some with distinctly positivist prejudiceshave commented on the underdetermination of scientific methodology by empiricist epistemology. Karl Popper is possibly the best
known example of this. Post-positivist writers, such as Kuhn and Feyerabend, have taken, or been
taken to support, more radical positions.
3. Arguably, it is a type of theory which also fits the natural sciences better than positivistic empiricism
does, although this is a claim which would need to be defended elsewhere.
4. Kuhn himself does not explicitly argue this.
5. This is related to, but not equivalent to, Mautzs (1958) division of evidence into real (requiring no
further inference from evidence to conclusion), testimonial (depending on the statements of a third
party), and indirect (everything else).
6. A reviewer of an earlier draft of this paper raised a question about the role of probabilistic inference.
The point of the question was that auditors do not believe that they can get at the world as it actually
is because they can only use statistical and probabilistic tests, which necessarily leave room for
uncertainty. This, however, does not cause any problems for their belief that there is a realityit
only means that it is a bit inaccessible. No matter how, probabilistic statements about the world are
not statements whose truth is uncertainin other words, the statement there is a better than 99%
chance that I will wake up tomorrow may be quite certainly (100%) true. If a correspondence theory
of truth were viable, then there would have to be some probabilistic fact about the world to which this
true statement corresponded. In other words, as far as theories of truth are concerned, probabilistic
statements are no different from any others
7. Empirical studies of audit judgement may throw light on how this is actually done by auditors without
being able to throw any general light on the question of how they should be doing it.
8. A reductio ad absurdum proof of a statement is a proof which shows that the contrary of the statement
entails a contradiction, so that the statement must be true.
9. Arguably this is a question of grammatical rules in the (somewhat idiosyncratic) sense intended by
Wittgenstein in some of his earlier writingfor a neat example, see Stern (1995, pp. 4445)but a
development of this perspective could render an already difficult line of argument completely opaque.
10. The consequences of this are not, in general, taken very seriously by philosophers (or academic
theorists in general?), who are inclined to think that if a belief is intelligible in any sense, then it must
be philosophically addressable. (This may be closely related to a belief that it would not be intelligible
to believe that doing philosophy is impossible.) Part of what I am suggesting is that it is possible that
some beliefs could be perfectly intelligible (at least in the sense of not being logically incoherent, and
266
A. Arthur
possibly according to other standards as well), but just could not form part of any valid philosophical
theory, because they would be inarticulable
References
APB (Auditing Practices Board), Statement of Auditing Standards 400Evidence, Revision of Auditing
Standards and Guidelines (London: Auditing Practices Board, 1993).
Feyerabend, P. K., Against Method: Outline of an Anarchistic Theory of Knowledge (London: New Left
Books, 1975).
Flint, D., Philosophy and Principles of Auditing (London: Macmillan, 1988).
Francis, J. R., Auditing, Hermeneutics, and Subjectivity, Accounting, Organizations and Society, Vol. 19,
No. 3, 1994.
Fuller, S., Toward a Philosophy of Science Accounting: A Critical Rendering of Instrumental Rationality,
in M. Power (ed.), Accounting and ScienceNatural Inquiry and Commercial Reason, pp. 247280
(Cambridge: Cambridge University Press, 1996).
Gray, R., Evidence and Judgement, in M. Sherer & S. Turley (eds), Current Issues in Auditing, pp. 131
143 (London: Paul Chapman, 1991).
Hacking, I., The Social Construction of What? Chapter 3 (Cambridge, Massachusetts: Harvard University
Press, 1999).
Hatherly, D. J., The Audit Evidence Process (London: Anderson Keenan, 1980).
Hawking, S. W., A Brief History of Time: From the Big Bang to Black Holes (London: Bantam, 1988).
Hines, R. D., Financial Accounting: In communicating Reality, We Construct Reality, Accounting,
Organizations and Society, Vol. 13, No. 3, 1988.
Jackson, B. S., Law, Fact and Narrative Coherence (Merseyside: Deborah Charles Publications, 1998).
Jackson, J. & Doran, S., Evidence, A Companion to Philosophy of Law and Legal Theory, Chapter 10
(Oxford: Blackwells, 1996).
Keenan, D., Evidence and the Auditor, Accountancy, August 1979.
Keenan, D. & Anderson, J., Evidence and the Auditor (part 2), Accountancy, September 1979.
Kuhn, T. S., The Structure of Scientific Revolutions (Chicago: University of Chicago Press, 1970).
Lyas, C., Philosophers and Accountants, Philosophy, Vol. 59, 1984.
Lyas, C., Accounting and Language, in M. J. Mumford & K. V. Peasnell (eds), Philosophical Perspectives
on AccountingEssays in Honour of Edward Stamp (London: Routledge, 1993).
Mautz, R. K., The Nature and Reliability of Audit Evidence, Journal of Accountancy, May 1958, pp. 40
47.
Mautz, R. K. & Sharaf, H. A., The Philosophy of Auditing (Sarasota Florida: American Institute of Certified
Public Accounts, 1961).
Pentland, B. T., Getting Comfortable with the Numbers: Auditing and the Micro-production of Macroorder, Accounting, Organizations and Society, Vol. 18, No. 7/8, 1993.
Popper, K. R., Truth, Rationality, and the Growth of Scientific Knowledge, Conjectures and Refutations,
Chapter 10 (London: Routledge, 1963).
Power, M. K., Taking Stock: Philosophy and Accountancy, Philosophy, Vol. 61, 1986.
Power, M. K., Book Review: Philosophy and Principles of Auditing: An Introduction, Accounting, Auditing
and Accountability Journal, Vol. 3, No. 3, 1990.
Power, M. K., From Common Sense to Expertise: Reflections on the Prehistory of Audit Sampling,
Accounting, Organizations and Society, Vol. 17, No. 1, 1992.
Power, M. K., The Audit Explosion (London: Demos, 1994).
Power, M. K., Auditing, Expertise and the Sociology of Technique, Critical Perspectives on Accounting,
Vol. 6, 1995.
Power, M. K., Making Things Auditable, Accounting, Organizations and Society, Vol. 21, No. 2/3, 1996.
Power, M. K., The Audit Society (Oxford: Oxford University Press, 1997).
Putnam, H., Reason Truth and History, A problem about reference, Chapter II (Cambridge: Cambridge
University Press, 1981).
Quine, W. V. O., Ontological Relativity and Other Essays. Columbia University Press, 1969.
Russell, B., Introduction, in L. Wittgenstein (ed.), Tractatus Logico-philosophicus (London: Routledge,
1974).
Audit fundamentals
267