Professional Documents
Culture Documents
AUDIT - Information Audit Theory Vs Practice
AUDIT - Information Audit Theory Vs Practice
AUDIT - Information Audit Theory Vs Practice
Abstract
This paper presents and discusses five information audit (IA) case studies, which tested the application and usability of an IA
methodology. The studies also trialled an IA scope matrix and incorporated process modelling. The main strengths of the IA
methodology were found to be the logical structuring of stages, provision of a comprehensive toolkit, and the flexibility to remove stages
not relevant to the client brief. A limitation of the methodology was found to be its lack of instructional depth. The IA scope matrix was
successfully trialled, and process modelling proved extremely valuable, encouraging participant involvement by focusing on readily
understandable aspects of day-to-day work, and providing an organisational model of information flow.
r 2007 Elsevier Ltd. All rights reserved.
Keywords: Information audit; Information resource management; Information strategy; Information systems; Process modelling
0268-4012/$ - see front matter r 2007 Elsevier Ltd. All rights reserved.
doi:10.1016/j.ijinfomgt.2007.09.003
ARTICLE IN PRESS
S. Buchanan, F. Gibb / International Journal of Information Management 28 (2008) 150–160 151
Process
2.1. Study one
Resource
1.1. Develop
Course
1.4. Manage
1.2. Market 1.3. Validate
Course
Course Course
Resources
1.7. Develop
1.5. Support 1.6. Recruit
Teaching
Students Students
Material
1.8. Manage
1.9. Deliver
Student
Course
Records
1.10. Assess
Students
1.11. Hold
Exam Board
Standards &
routes to 5
registration
EPSRC EPSRC
funding 5 funding 5
Course
Course Course
Co-ordinator
review 5 review 5
report report
Course
approval 5
well documented and defined; and secondly, that after How important an influence it is on the objective
extensive process modelling the working group would not (identifying priority).
have welcomed another modelling exercise. Instead an adap- What action is required (formulating action plans).
tation of force field analysis was adopted for this final work-
shop, as recommended by Buchanan and Gibb (1998), but The output of this step (particularly the action plans)
more commonly associated with a previous stage of the IA. was recorded for incorporation in the final synthesise stage,
Force field analysis (Lewin, 1947) was used to visually conducted by the auditors.
highlight the positive or negative impact each CSF had on its
associated strategic objective. Three steps were as follows:
2.1.4. Synthesise
1. Each objective was positioned on a scale of 0–100% The main output of this IA was the IA report, which
according to approximate group estimates of current included: revised strategic objectives and goals, a detailed
achievement of the objective. process model for undergraduate teaching, a series of
2. Associated CSFs (see Table 1) were identified as either associated information flow diagrams, and the identifica-
strengths or weaknesses based on evaluation of the tion and evaluation of key information resources.
previously identified process and information problems. The key IA recommendations were: to establish an
For example (see Fig. 4), for the ‘‘provide a course information policy, to initiate systems analysis to rationa-
portfolio taking account of the dynamic and diverse lise and manage disparate administrative database and
requirements of stakeholders’’, professional accredita- information systems, and to establish an intranet/content
tion was considered a strength, but market knowledge management system.
was considered a weakness. The IA was completed on schedule within the allocated
3. For each CSF, a shaded bar identified its relative 12-week period. Four members of staff participated in the
strength or weakness. workshops and a further nine in interviews. Twenty-two
attended the post audit meeting. In total, the resource
Finally, each weak CSF was then examined to determine: requirement for the participating organisation was 22
full time equivalent (FTE) days (not including post
Why it is a weakness (referring to the identified audit meeting). Auditor time for this IA amounted to 15
problems). FTEs.
ARTICLE IN PRESS
S. Buchanan, F. Gibb / International Journal of Information Management 28 (2008) 150–160 155
Provide a course portfolio taking account of the dynamic and diverse requirements of
stakeholders.
0% 100%
STRENGTH WEAKNESS
Funding
Graduate Knowledge
Industrial Links
Market Knowledge
Course Relevance
Professional Accreditation
2.1.5. Participant feedback and auditor observation The sponsor wanted the IA to further explore these
Sponsor and participant feedback was extremely posi- problems and produce a series of recommendations which
tive. A post audit meeting was held with the working group could be incorporated into a planned change management
and sponsor, which explored participation and perceived programme. The organisation’s business strategy was to be
value of IA output. The strengths of the IA, as stated by taken as a given, as outlined in their Corporate Strategy
participants, were as follows: document; however, given that two of the four recommen-
dations from the organisational review related to process
Staff benefited from the facilitated workshop approach. issues, it was agreed that major processes should form the
The structured top-down process-based approach (and background to the IA prior to more detailed analysis of
tools/techniques adopted) was simple to follow, greatly information usage and flow. Similar to case study one, the
increased participant understanding of department goals sponsor stated that he did not require costing of informa-
and requirements, and helped illustrate the role of tion resources. The audit was to be completed in eight
effective information management. weeks so as not to delay the planned start date for the
Through the working group, wider interviews and change programme.
regular communications, staff felt involved at all stages. To meet these requirements the IA was scoped to be
The short timeframe facilitated quick results, and limited primarily resource orientated but to include the process
the impact on staff. Focusing on a prioritised process perspective (see Fig. 5).
shortened the project duration, and demonstrated max- The IA methodology was tailored to these requirements
imum value by focusing on the area of greatest perceived by once more removing the account stage. In-depth
impact. Process descriptions for sub-processes substituted interviews followed by a structured survey were the main
for more time-consuming process modelling. data gathering methods.
contacts, and one to hold statistical data for detailed 3. Stage two usability trials
analysis, decision support, and responding to external
mandatory requests Three usability trials were conducted in total. All three
o Create mechanism for completing grant applications auditors had no previous IA experience, but all had
and audit forms online (including website upgraded successfully completed post-graduate level studies in
to an extranet) Information Management and were about to embark on
o Develop a content/document management system careers within the information profession (two were
o Establish a single contacts application accessible employees of the audited organisations). All were volun-
to all tary participants invited to participate through an online
Technology University forum, which described the proposed research.
o Create a central intranet, accessible to all, based on For the usability trials, volunteering organisations were
clear ownership and accountability for documents invited to participate through a letter and/or email to the
o Technologies should be implemented which facilitate appropriate head of business, explaining the proposed
browser-based intranet access to extract information research and outlining the IA process. Similar to the stage
from underlying systems one studies, IA scope and approach was dictated by the
o Establish an extranet brief provided by each organisation. Scope was set by
o Create an electronic log form on the intranet auditor and client utilising the IA scope matrix.
The author adopted an observational, non-participatory
The IA was completed on schedule within the allocated role throughout each trial. Once each trial was completed,
8-week period. Fifteen members of staff participated in semi-structured interviews were held with each auditor to
interviews and a further 38 completed the questionnaire. discuss the general IA experience and usability of the IA
Eighteen attended the post audit seminar. In total, this methodology.
IA required approximately 12 FTEs from the auditor, For the first of the usability trials, the participating
and 5.75 FTEs from the participating organisation organisation was a public body in the education sector. The
(not including the post audit meeting). A notable observa- organisation had recently completed a small, high-level
tion was the significantly reduced resource requirement knowledge audit, as a precursor to the development of a
(from 22 FTEs to 5.75 FTEs) for the participating knowledge strategy, which had highlighted several general
organisation where interviews replaced workshops information management problems and shortcomings. In
(and strategic analysis was out of scope). However, the parallel to the knowledge audit, the organisation was also
time saving for the auditor was less dramatic (from 15 to initiating a process-reengineering project to look at new
12) as some workshop savings were offset by the need to ways of developing new products and services, with the
prepare for and conduct multiple interviews. dual goals of promoting greater reuse of existing products/
services, and reaching markets faster with new products/
2.2.5. Participant feedback and auditor observation services. The findings of the knowledge audit had serious
The overall IA experience could once again be described implications for the success of this new process, so more
as positive. Interviewees appeared comfortable with the IA detailed investigation of information flow and require-
process, and welcomed the opportunity to consider ways in ments was called for.
which to improve organisational processes and information In the initial scoping session, the sponsor confirmed that
management. In the post-report seminar, which was the IA should focus on the product and service develop-
provided for the senior management team (the majority ment process, and identify and evaluate associated
of which had participated in the interviews), there were two information resources (a process oriented IA). The sponsor
notable points of feedback: viewed the IA as a follow on activity from the knowledge
audit, which had included strategic analysis; consequently,
Staff expressed confidence in the methodological process the sponsor felt there was no need for this activity as part
undertaken to conduct the IA, considering it to be both of the IA identify stage. The sponsor also did not require
understandable and comprehensive. the account stage. The primary means of investigation
Staff appreciated the two levels of recommendations, established by the auditor was in-depth interviews,
and the use of Earl’s taxonomy to structure and simplify supplemented with a follow-up questionnaire, and includ-
the information strategy. ing analysis of key documents provided by the sponsor.
The final output was the information report for the
The shift from in-depth process modelling to capturing prioritised process, which included: the product and service
process descriptions for all organisational processes development process model and sub-process descriptions,
worked well and is recommended. The only exception process-based information flow models, key information
would be where participating organisations include re- resources, issues and requirements, and recommendations.
quirements in their brief which call for process modelling; For the second usability trial, the participating Uni-
for example, resolving specific process-related problems, versity department was only 12 months old and had been
automating manual processes, etc. formed from the merger of five existing non-academic
ARTICLE IN PRESS
S. Buchanan, F. Gibb / International Journal of Information Management 28 (2008) 150–160 159
service departments (the merger had arisen from the techniques for data gathering in all cases were interviews
recommendations of an organisation wide review which and questionnaires, which aligns with the findings from
had called for increased synergy and coordinated effort previous published case studies (Buchanan & Gibb, 2008).
across the five departments). The sponsor was primarily The IA scope matrix proved to be extremely useful when
focused on issues of integration, most notably to create tailoring the methodology as it helped the auditors to
synergy across individual units and to improve organisa- understand and focus the scope of the audit; and secondly,
tional communication and information flow. In the initial to identify appropriate tools and techniques to select for
walkthrough session between auditor and sponsor, a each of the stages (e.g. strategic analysis tools and/or
process-oriented approach was agreed as most appropriate, process modelling tools).
including mapping of information flow for core processes. However, while methodological flexibility was proven,
The sponsor felt this should take priority over detailed problems were noted by all three auditors regarding the
information resource inventory and analysis, and did not tools and techniques provided to support each of the
feel the need for the account stage. The sponsor acknowl- stages. The first auditor commented (Kassenova, 2005):
edged the importance of the promote stage and wished to
involve staff as much as possible in the IA processes. The author would recommend Buchanan & Gibb to
Again, the primary means of investigation was in-depth expand the level of details, as currently it is a
interviews, supplemented with follow-up questionnaire, summarised version and not easy to use, especially for
and including analysis of key documents provided by the people new to the information audit. All key stages
the sponsor. The final output was the IA report, which would benefit from templates, examples and case studies
included: organisation process model and process descrip- to support and explain how to use them y
tions; process-based information flow models; key asso- The second auditor commented (Roussakis, 2005):
ciated information resources; and recommendations.
For the third and final usability trial, the participating The significance of the (Buchanan & Gibb, 1998)
organisation was a private sector legal firm. The sponsor methodology is the initiation of tools and techniques
confirmed that the IA should focus on a single department to be followed during the stages of the IA process. The
within the organisation (the corporate library), and identify author feels the need to remark that it would have been
and evaluate information services and associated informa- more useful during the whole process if there were
tion resources. In contrast to the previous organisations, information concerning the use of the tools and the
which had all recently undergone either change or review, benefits of using them, in the IA process. y It is
this organisation was experiencing neither. The organisa- strongly believed that y for the benefit of the IA
tion simply wished to review its core information service. process (there is) publication of further research,
The sponsor felt there was no need for strategic analysis including analytic descriptions of tools and techniques.
as part of the IA identify stage, or for costing of If this occurs, then the author believes that the
information resources and/or associated services, which methodology can provide a standard approach to
consequently removed the need for the account stage. The information auditing.
sponsor indicated a preference for selected individual
interviews over workshops, as this was considered easier The third auditor commented (Martin, 2005):
to manage from a resource and cost management Were Buchanan & Gibb able to outline each of these
perspective. It was also agreed that an online structured external models within the text of their own methodol-
questionnaire would be developed for wider participation ogy, and how best to tailor it for the information audit
and feedback. There was no requirement for an informa- rather than for the more specific situations for which
tion strategy. The final output was the IA report, which they were designed, this would result in a more self-
included: service model, key information resources, service contained methodology. This would, in turn, make the
evaluation, and recommendations. extra reading an option rather than a requirement, and
In all three trials, selection of the Buchanan and Gibb permit the more time-constrained auditor the option of
(1998) methodology by the auditors was based on a more comprehensive audit.
perceived flexibility of approach and incorporation of
comprehensive tools and techniques to support each of the The main limitation of the methodology, from a user
IA stages. Tailoring of the methodology proved to be a perspective, was its lack of instructional depth, particularly
straightforward task with none of the auditors conducting with regard to tools and techniques; ironically considered a
the usability trials noting any problems. The methodology strength by each auditor during initial selection of the
proved extremely flexible in this respect, allowing the methodology. The auditors highlighted a particular need
auditors to tailor to individual requirements, with all three for further guidance regarding: strategic analysis; interview
trials adopting a similar tailored approach: promote preparation; process modelling; and qualitative data
completed in full, identify streamlined, analyse completed analysis. It is also highly likely that the account stage
in full, account omitted, and an IA report produced but would have presented similar challenges had it been
no information strategy produced. The dominant tools/ required by any of the participating organisations.
ARTICLE IN PRESS
160 S. Buchanan, F. Gibb / International Journal of Information Management 28 (2008) 150–160
4. Conclusions Checkland, P., & Scholes, J. (1990). Soft systems methodology in action.
Chichester: Wiley.
Earl, M. J. (2000). In D. A. Marchand, T. H. Davenport, & T. Dickson
The main strengths of the Buchanan and Gibb (1998)
(Eds.), Mastering information management (pp. 16–22). London:
methodology are the logical structuring of stages, provision Financial Times Prentice-Hall.
of the toolkit, and the flexibility to tailor the methodology Gibb, F., Buchanan, S., & Shah, S. (2006). An integrated approach to
to the brief. A weakness of the methodology is its limited process and service management. International Journal of Information
instructional depth; however, aside from process model- Management, 26, 44–58.
ling, direction is provided to appropriate tools and Henczel, S. (2001). The information audit: A practical guide. London:
K.G. Saur.
techniques for each of the stages/steps. Kassenova, A. (2005). Information audit at the British Council. Unpub-
The Buchanan and Gibb (2007) IA scope matrix has lished MSc dissertaion, University of Strathclyde.
proven extremely useful. Process modelling has also proven Lewin, K. (1947). Frontiers in group dynamics: Concepts, method, and
extremely valuable, encouraging user involvement by reality in social science; social equilibria and social change. Human
focusing on readily understandable aspects of day-to-day Relations, 1(1), 23–32.
Martin, E. (2005). Information audit at MacFarlanes Law Firm.
work, and providing an organisational model of informa- Unpublished MSc dissertation, University of Strathclyde.
tion flow. Earl’s (2000) IS taxonomy can also be used to Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis (2nd
structure recommendations and provide traceability back ed.). Newbury Park, CA: Sage.
to the IA scope matrix. Orna, E. (1990). Practical information policies: How to manage information
flow in organisations. Aldershot: Gower.
A notable observation was that none of the participating
Orna, E. (1999). Practical information policies (2nd ed.). Aldershot:
organisations felt the need for the account stage. As a Gower.
consequence this stage remains untested, but it also raises Ould, M. A. (1995). Business processes: Modelling and analysis for
the question as to whether or not formal accounting is re-engineering and improvement. Chichester: Wiley.
required for the purposes of information auditing. While Pellow, A., & Wilson, T. D. (1993). The management information
this research has not been extensive enough to be requirements of heads of university departments: A critical success
factors approach. Journal of Information Science, 19(6), 425–437.
conclusive on this matter, the evidence gathered thus far Porter, M. E. (1980). Competitive strategy: Techniques for analysing
does suggest that a formal account stage is not always industries and competitors. New York: Free Press.
necessary, and that simple value tables can substitute in Roussakis, C. (2005). Information audit at the Office of Marketing
those instances (aligning with the methodological ap- and Communication. Unpublished MSc dissertation, University of
Strathclyde.
proaches of both Orna (1999) and Henczel (2001)).