Professional Documents
Culture Documents
Teaching in Higher Education: To Cite This Article: Polycarp Ikuenobe (2001) Teaching and Assessing Critical Thinking
Teaching in Higher Education: To Cite This Article: Polycarp Ikuenobe (2001) Teaching and Assessing Critical Thinking
Teaching in Higher Education: To Cite This Article: Polycarp Ikuenobe (2001) Teaching and Assessing Critical Thinking
To cite this article: Polycarp Ikuenobe (2001) Teaching and Assessing Critical Thinking
Abilities as Outcomes in an Informal Logic Course, Teaching in Higher Education, 6:1,
19-32, DOI: 10.1080/13562510020029572
Taylor & Francis makes every effort to ensure the accuracy of all the
information (the “Content”) contained in the publications on our platform.
However, Taylor & Francis, our agents, and our licensors make no
representations or warranties whatsoever as to the accuracy, completeness,
or suitability for any purpose of the Content. Any opinions and views
expressed in this publication are the opinions and views of the authors, and
are not the views of or endorsed by Taylor & Francis. The accuracy of the
Content should not be relied upon and should be independently verified with
primary sources of information. Taylor and Francis shall not be liable for any
losses, actions, claims, proceedings, demands, costs, expenses, damages,
and other liabilities whatsoever or howsoever caused arising directly or
indirectly in connection with, in relation to or arising out of the use of the
Content.
This article may be used for research, teaching, and private study purposes.
Any substantial or systematic reproduction, redistribution, reselling, loan,
sub-licensing, systematic supply, or distribution in any form to anyone is
expressly forbidden. Terms & Conditions of access and use can be found at
http://www.tandfonline.com/page/terms-and-conditions
Downloaded by [Monash University Library] at 19:57 06 March 2015
Teaching in Higher Education, Vol. 6, No. 1, 2001
ABSTRACT I provide a theoretical framework to show that courses in informal logic can be
taught developmentally to focus on a critical thinking practical component. However, efforts
must be made to state clear outcomes, such that the content and processes of the course are
tailored to achieve the outcomes, and clear criteria are provided for students’ learning and
assessment of their performance. This framework is an attempt to respond indirectly to the
distinction between informal logic and critical thinking, and the concern that informal logic
courses only teach abstract principles of reasoning and do not focus on requisite critical thinking
abilities, which are contextualised to subject matter. I suggest a plausible connection between
critical thinking and informal logic: that learning logical principles of reasoning is necessary, but
not suf cient to think critically; there is an extra element which involves learning to apply the
principles to various contexts.
Introduction
I describe a theoretical framework for teaching and assessing critical thinking
abilities as outcomes in an informal logic course, with emphasis on helping students
to acquire, develop, demonstrate and apply the requisite abilities. This is an attempt
to respond to the concern that critical thinking abilities are not suf ciently taught
and acquired in an informal logic course. As a framework, it is general, exible and
adaptable to suit different pedagogical needs. How the requisite outcomes are
achieved depends on the instructor’s approach and assessment tools. This frame-
work neither describes an actual course nor reports how a course has actually
achieved certain outcomes. It has the following features:
1. The ‘traditional’ way of teaching informal logic usually does not focus on
outcomes, in terms of abilities that students need to acquire, develop, demon-
strate and apply. So, students usually cannot consistently apply the course content
to real life and substantive subject matter. If they are able to achieve the requisite
outcomes at all, it is mostly fortuitous, in the sense that they are not conscious
of their abilities and have not made a conscious effort to apply them to achieve
the requisite outcomes.
ISSN 1356-2517 (print)/ISSN 1470-1294 (online)/01/010019-14 Ó 2001 Taylor & Francis Ltd
DOI: 10.1080/13562510020029572
20 P. Ikuenobe
required.
ments in substantive discourse. Those who distinguish between logic and critical
thinking argue that critical thinking is a set of integrative, complex, and applicable
abilities in the context of a subject matter. According to Paul (1982), critical
thinking in the ‘strong sense’ involves the ability to see, and critically engage issues
and problems as a network. He argues that critical thinking requires that we reason,
and see issues from a global, contextual, historical world views of multi-cultural,
ethnic, racial, gender and class perspectives. This will help people to understand
substantive discourses, points of view, issues and beliefs, as shaped by race, culture,
gender, religion, class and the context of the world we live in. This stance about the
factors that shape reasoning is plausible; hence, I see the need to teach informal logic
as a set of abstract principles, which is applicable as critical thinking abilities.
This requires a framework which calls for a new approach and new thinking in
the pedagogy of informal logic, and creativity on the part of a teacher to articulate
Downloaded by [Monash University Library] at 19:57 06 March 2015
this general idea a bit more substantive, critical thinking may be broken down into
the following abilities that students must acquire, demonstrate and apply as critical
thinkers:
(1) analyse ideas and issues;
(2) evaluate and question knowledge and information;
(3) identify problems and nd creative approaches to solving them;
(4) articulate, organize and express ideas;
(5) arrive at informed and reasoned judgement about issues expressed in various
works and texts.
Ennis (1962) also articulates the idea of these abilities into 12 substantive aspects of
critical thinking:
Downloaded by [Monash University Library] at 19:57 06 March 2015
1. Students are able to understand, articulate, and explain the concepts, notions,
ideas, beliefs, conceptual scheme, world views, principles and elements involved
in reasoning in general.
2. Students are able to use these ideas, concepts and principles, to understand and
identify different kinds and elements of reasoning in texts, their own actual
reasoning and that of others.
3. Students are able to understand, articulate, and explain the fundamental
principles underlying inductive and deductive forms of reasoning.
4. Students are able to understand, articulate, and explain the concepts and
principles underlying adequate and inadequate reasoning.
5. Students are able to use the principles they have learned to organise their own
reasoning in speaking, writing, actions, judgments and decision making;
6. Students are able to use the principles they have learned to identify errors and
strengths in reasoning in general.
Teaching and Assessing Critical Thinking Abilities 23
8. Students are able to use the principles to evaluate and judge their own reason-
ing, as well as that of others in writing, speaking, texts, actions, judgments and
decision-making.
9. Students are able to use the principles to avoid bad reasoning and generate good
reasoning;
10. Students are able to use the principles in a broad context: to engage themselves
and others dialogically, and to re ect on and critically examine their conceptual
schemes, background beliefs, and world views in terms of how they affect their
perspectives and reasoning.
informal logic course, to achieve as outcomes the requisite critical thinking abilities.
I suggest that it be taught at ve different developmental levels, with different
outcomes at each of the ve levels. However, the outcomes at each level are
systematically incremental with a succeeding level building on a preceding level. The
outcomes in level one involve the ability to observe, recognise; and understand
simpler facts and concepts. To achieve this set of outcomes, the student learns how
to observe, perceive, recognise and understand accurately, facts, ideas and concepts
in the context of various subject matter. A plausible way to teach this aspect of
critical thinking is for students to learn how to understand and de ne concepts, and
adequately place things or ideas in conceptual categories. They do this by learning
to identify main ideas and statements (declarative sentences as opposed to questions,
commands and exclamations, which do not state anything). They would also learn
the nature of propositions as components of argument, premises (facts and data),
conclusion, inference, issues, assumptions, implications and ideas. This involves
learning how to identify an author’s arguments and ideas, and that of other people
that an author refers to or criticises; how to identify the distinct and simpler ideas,
complex statements, ideas and arguments, arguments in favour and against.
This complex process of empirical observation is usually construed to be funda-
mentally inductive, rather than deductive. However observation could also be
construed otherwise and taught as a deductive process. Observation, identi cation,
recognition, perception, comprehension and understanding are ‘theory laden’. An
observation is a deductive inference from our conceptual scheme, background and
meta-beliefs. The analysis of our experience or statement and determination of
whether we observe correctly are done by analysing conceptual schemes or world view
that we bring to bear on observations (Paul, 1982). The process of critical thinking
involves making critical connections among conceptual schemes, observed physical
objects, statements and the beliefs we hold. It also involves critically examining the
nature of conceptual schemes, world views, biases, presuppositions, prejudices, and
meta and background beliefs, and how they shape observations and understanding.
For instance, one’s ability to identify a physical object as a chair and make
statements about it suggests that one has the concept of a chair. Then one is able to
make the judgment that the physical object perceived ‘falls into the conceptual
24 P. Ikuenobe
category’ of chair. If one’s concept of ‘chair’ is ‘correct’, and one’s statement about
the essential features of the physical object is correct, then as a conclusion, one’s
statement identifying the object as a chair, which involves placing it into a concep-
tual category, cannot be false. It follows necessarily from one’s premises—concept
and perceived features. The deductive reasoning underlying observing and identify-
ing a chair is as follows: anything with features X, Y, Z is a chair—X, Y, Z represent
its de ning features. I see that the object S has X, Y, Z. Therefore, S is a chair.
This complex deductive reasoning process may be taught in an informal logic
course. The ability to observe correctly, recognise and identify arguments, state-
ments, ideas or objects involves the ability to grasp concepts and apply them.
Students need to learn the concept of an argument or reasoning as a systematic set
of propositions or ideas in which at least a proposition or idea acts as a support for
another. One is reasoning if one thinks of a plausible counter-argument against one’s
Downloaded by [Monash University Library] at 19:57 06 March 2015
own view or idea in a dialogical form (Paul, 1982). The process of engaging in a
critical dialogue with oneself or another person is a process of critical thinking by
which one arrives at a well reasoned position. This can be informed by teaching the
nature and application of argument analysis and evaluation in an informal logic
course. By learning that the observation process could be deductive, students are
able to critically re ect on their conceptual scheme, and how it affects their
observations, perspectives and judgements. Understanding the nature of concepts
and arguments in informal logic with respect to the ability to observe, identify and
recognise is important for critical thinking (Carey, 1999). They would learn to
distinguish among concepts, argument, explanation, illustration, description, exposi-
tion, report, opinion, warning and conditional statement (Hurley, 1999, pp. 14–25).
This will facilitate their reading, analysis and understanding of texts or discourse
because they will be able to isolate the different ‘logical aspects’ of the piece
(Loacker et al., 1984; Stratton, 1999).
At level 2 students should learn how to move inferentially from simple facts,
concepts and observations to a set of complex ideas, facts and concepts, which may
involve simple inductive generalizations and deductive inferences. They learn how to
draw inferences and understand their reasonableness by careful observations, recogni-
tion, and understanding of facts, ideas and concepts. They learn how to distinguish
between facts and inference, the evidence provided in support for statements, the
implications of a proposition and the assumptions underlying a belief. At this level
students learn how to make reasonable inferences by unpacking the notions of
‘reasonable’ and ‘inference’ in logical terms. Some who argue for a context depen-
dent view of critical thinking indicate that reasonable inference is context and
subject matter dependent, and it should not be taught in abstract logical terms. This
is unsatisfactory because it is necessary to have an objective set of rational standards
that can be rationally agreed on to unpack the notion of ‘reasonable inference’
(Hurley, 1999; Salmon, 1989). If what constitutes a ‘reasonable’ inference is not
couched in objective logical principles of reasoning, it would be dif cult for students
to learn the appropriate criteria that they can rely on. What constitutes a reasonable
inference is not context dependent because two people in the same discipline could
be at odds regarding the notion of a ‘reasonable’ inference.
Teaching and Assessing Critical Thinking Abilities 25
Two researchers may not agree on a ‘reasonable inference’ that could be drawn
from a given set of data. If each person’s understanding of what constitutes a
reasonable inference is at odds with the other, the data will ‘pull them’ towards a
different conclusion. There are inferences which cut across disciplines, whose
reasonableness will need to be settled objectively on the basis of certain logical
canons of reasonableness (Carey, 1999; Hurley, 1999). The principles of reasoning
would be helpful in illuminating what constitutes reasonable inference with respect
to deductive and inductive reasoning, which can then be applied to substantive
issues and disciplines. Understanding the notion of ‘reasonable inference’ would
help students to begin to make meaning of signi cant connections among various
ideas, views, issues, points, and their proofs, as discourses, thus avoiding the weak
sense of critical thinking and errors in identifying inferential links (Paul, 1982).
Students sometimes see inferential links and meaningful connections—and what
Downloaded by [Monash University Library] at 19:57 06 March 2015
they think are reasonable ones for that matter—among ideas and statements where
none exists. When asked to provide evidence for a statement, they provide another
statement which has no evidential link or connection.
Students need to properly grasp the concepts of ‘evidence’, ‘inference’, ‘eviden-
tial link’, ‘meaningful connections’ and ‘reasonableness’. We may teach critical
thinking skills at level 2 by assisting students to understand the elements that could
vitiate the reasonableness of an inference. They are systematically introduced to the
concepts of ‘validity’, ‘truth of statements’ and ‘soundness’ regarding deductive
reasoning, ‘strength of evidence’ and ‘cogency’ regarding inductive reasoning, the
nature of fallacies, both informal and formal (Carey, 1999; Hurley, 1999; Stratton,
1999). The notion of soundness would require students to think critically about
arguments and perspectives in the context of subject matter and reality, with respect
to determining what is true. In doing so, students learn how to avoid certain pitfalls
and fallacies in order to make a ‘reasonable inference’. They learn the principles for
evaluating and thinking critically about other people’s reasoning, in order to arrive
at well-informed conclusions. They learn to avoid unwarranted idiosyncratic or
subjective intuitions, and views which are beclouded by personal sentiments and
emotions. They learn how their world views and emotions could becloud their
ability to think critically about issues (Paul, 1982; Hurley, 1999).
At level 3, students learn to make complex and intricate connections among
various simpler facts and complex deductive and inductive inferences. This involves
the ability to perceive and make complex relationships among issues, ideas, assump-
tions, world views, conceptual scheme, facts and contexts (Paul, 1982; Loacker et
al., 1984; Cromwell, 1986). At this level, students learn to recognise how inferences
are related to observed facts in broader and complex contexts. They learn to see
relationships in and among features, objects and ideas, and to distinguish among
patterns, trends, causal and functional relationships, and comparisons and contrasts.
Students learn various kinds of inferences and relationships, and how to evaluate
them. They study syllogisms of different types (hypothetical, categorical and dis-
junctive), enthymemes and sorites, and how to evaluate them. They also learn
different argument structures: the nature of dependent and independent reasons,
simple and compound statements and arguments, chain arguments and divergent
26 P. Ikuenobe
conclusions. They learn various types of and connection between inductive and
deductive argument, and how in conjunction they are used in real life reasoning and
knowledge acquisition. With respect to inductive arguments, they learn the nature of
causal, probabilistic, statistical and hypothetico-deductive inferences, analogical
arguments and simple generalisations (Salmon, 1989). They learn ‘informally’
deductive argument forms, such as modus ponens, modus tollens, dilemmas,
simpli cation, addition, conjunction and DeMorgan’s rule among others, and their
use in discourse. These argument forms represent ways of making relationships
among statements, beliefs, perspectives, views, phenomena and ideas in various
contexts.
At level 4, students learn how to use models to understand, make sense of, and
extrapolate from patterns and structures, how to make complex inferential reasoning
from one experiential or theoretical context to another, and how to see ideas and
Downloaded by [Monash University Library] at 19:57 06 March 2015
contexts. For instance, they learn informal fallacies, formal fallacies, rules of infer-
ence, such as modus ponens, modus tollens, hypothetical syllogism, disjunctive
syllogism, etc., how inferences are made and how fallacies are avoided in various
contexts. When they read texts in disciplines, they see in a hands-on way how
professionals use and apply objective principles, as well as other ‘idiosyncratic’
principles that are peculiar to disciplines and other contexts. In philosophy, one
focuses on teaching critical thinking at level 5 by teaching the application of the
principles of reasoning to the different philosophical traditions, such as history of
philosophy, analytic philosophy, existentialism and phenomenology, to show how
the principles learned in levels 1–4 actually apply to and illuminate issues in
epistemology, ethics, metaphysics, aesthetics, philosophy of mind and philosophy
of language.
Students learn how philosophers use the principles of logic to argue for
positions and articulate theories. They learn to use issues in metalogic and modal
logic to analyse and resolve philosophical problems. Critical thinking outcomes
deriving from the conceptualised process and content of an informal logic course
above can help to prepare students in nursing, business, the physical and social
sciences for methodological and research issues raised by inductive generalisation,
statistical inferences and deductive reasoning. This helps them to develop models
and how to apply them to solve problems or simulate situations to which models
could be applied which they extend to other contexts. It will also provide them with
fundamental principles of collecting data, interpreting them in terms of drawing
reasonable inferences so that conclusions or results are not skewed. Knowledge of
the informal fallacies of biased sampling, hasty generalisation, begging the question
(self-ful lling prophecy), gambler’s fallacy, genetic fallacy, incomplete evidence,
and ignoring common cause and the attempts to avoid them in research, becomes
relevant (Hurley, 1999; Carey, 1999). With these, students learn how to apply
principles underlying inductive reasoning (statistical, probabilistic and causal),
which are fundamental to different disciplines. They learn to avoid errors, biases
and fallacies that can be engendered in different modes of reasoning, world views
and perspectives, as well as how to evaluate reasoning and held views, results and
conclusions in a research work.
28 P. Ikuenobe
can articulate criteria based on the materials used in class and the activities that the
students engaged in. With these criteria, an instructor can evaluate a student’s work
to determine whether she has achieved the requisite outcomes. The integrative mode
of assessment involves a combination of papers, activities, simulations, projects,
prepared speeches and short answer tests. In the ‘traditional’ way of teaching
informal logic, the only way we can nd out whether students have ‘learned’ the
material is to give them tests, quizzes or examinations. They may not have learned
the material in terms of being able to apply the knowledge. This, a test may not be
able to determine. Sometimes, they only show familiarity with the material, or they
simply memorize and regurgitate it in tests. This framework suggests that the only
way we can prove that students have achieved the requisite outcomes, and acquired
the abilities is to develop a good assessment tool that is able to specify criteria that
would connect the assessment to the outcome and abilities. The following represent
Downloaded by [Monash University Library] at 19:57 06 March 2015
a general set of criteria which re ects the different developmental levels of critical
thinking ability.
Level 1
1. Students understand the concepts of argument, premise, conclusion, statement
(proposition), and sentence, and she is able to articulate and explain what these
concepts mean.
2. They are able to identify statements, other kinds of sentences, arguments and
with the help of indicators, identify premises and conclusions in different texts.
3. They understand the notions of illustration, exposition, report and explanation
among others.
4. They are able to distinguish between argument on one hand and, on the other,
illustration, report, exposition, explanation, opinion, warning, etc.
5. They are able to construct a discourse which they can categorise into the above
concepts.
Level 2
1. Students understand, and are able to articulate or explain the concepts of
inference and evidence in relation to premises and conclusion.
2. They understand and articulate the basic principles of reasoning (in terms of
justi cation), the notion of inferential or evidential link, and differences between
inductive and deductive inferences.
3. They understand the concepts of validity, strength, soundness and fallacy.
4. They are able to identify in different texts, particular fallacies in inferences and
articulate or explain why they are fallacious or unreasonable, in terms of the
principles underlying them.
5. They are able to construct valid and fallacious arguments, evaluate them and
explain why they are valid or fallacious. They are able to re ect on their
arguments with the aim of avoiding fallacies.
30 P. Ikuenobe
Level 3
1. Students are able to articulate or explain different kinds of inferential and
evidential relationships.
2. They are able to identify in different texts these different relations when they see
them in different argument forms and structures.
3. They are able to construct arguments in which they make relationships based on
the forms that they have studied—in decisions, actions, writing and speaking.
4. They are able to construct and identify different argument structures or patterns,
such as modus ponens, disjunctive syllogism, hypothetical syllogism, statistical
and inductive generalisations.
5. They are able to evaluate arguments in different texts and contexts, their own
arguments and that of others, in terms of the nature of relationships between
Downloaded by [Monash University Library] at 19:57 06 March 2015
Level 4
1. Students are able to identify the different argument structures and their basic
forms.
2. They are able to articulate or explain the principles underlying each of the types
of argument structures that they have studied.
3. They are able to use each principle to analyse the associated argument struc-
ture—for instance, they are able to use the method of truth tables or Venn
diagrams to analyse argument structures.
4. They are able to construct different types of argument structures and are able to
analyse them.
For level 5, I cannot specify a set of general criteria because the assessment becomes
contextual, in that it involves applying general logical principles to the context of a
subject matter. The subject matter in this case will largely determine the criteria and,
since my framework does not make speci c reference to a speci c subject matter,
this is where the speci c instructor of a subject matter comes into the picture. So,
from the above general criteria, the assessment modes may differ from one instructor
to another and perhaps from one group of students to another, and from one
circumstance to another. The instructor has to be able to develop assessment tools
to suit the needs of students, materials and situations. The following sample
represents an assessment assignment depending on the level: students should look at
magazines or newspapers, or listen to a speech. They should identity argument(s) in
the piece; they should identify premises and conclusion, and inferential links. They
may be asked to ‘ gure out’ an explanation, exposition or report from a text. They
could also be asked to evaluate the validity of an argument in two different contexts:
one will be an argument involving emotionally charged issues such as abortion, and
the same argument that is symbolised to increase the emotional opacity of the issue,
so that students can focus on the relationship between premises and conclusion.
This would help them to see the relevance of symbolic logic and the use of Venn
diagrams, truth tables, and other logical techniques as means for evaluating and
Teaching and Assessing Critical Thinking Abilities 31
analysing arguments, in order to make judgments about their value and signi cance
in different contexts. They could be asked to determine how the argument can be
supplemented, modi ed, changed to make it better, or a plausible alternative or
counter argument. They would demonstrate their understanding of the in uence
that contexts, emotions and world views could have on reasoning.
I will not dare to specify anything concrete! The instructor who is in touch with
the students and circumstance and understands them can make the best judgement
regarding an assessment tool. This process involves a kind of learning process for
instructors because they have to be willing to devise techniques, re ect on their
methodologies and modes of assessment, to determine which fares better, and which
will better achieve the outcomes in a given circumstance. Any mode which does not
fare well can be modi ed. It may be helpful to nd out from students the modes of
assessment which they feel have helped (or could help) them to demonstrate the
Downloaded by [Monash University Library] at 19:57 06 March 2015
requisite ability and assess their performance. Their suggestions and input may be
illuminating. Finding out from students how an informal logic course has helped
them to demonstrate critical thinking abilities in the context of the articulated
outcomes should be an integral part of the assessment. Students also have to be
aware of what their abilities were prior to taking informal logic, what they have
learned, how they can or have applied what they have learned, and how, in general
they have developed. This is a reasonable way to prove that using this framework to
teach informal logic can achieve the stated outcomes of acquiring, demonstrating
and applying critical thinking abilities.
REFERENCES
ALVERNO COLLEGE (1992) Liberal Learning at Alverno College (Milwaukee, WI, Alverno
Production).
ALVERNO COLLEGE FACULTY (1994) Student Assessment-as-Learning at Alverno College (Milwaukee,
WI, Alverno College Institute).
CAREY, S.S. (1999) The Uses and Abuses of Argument: critical thinking and fallacious reasoning
(Mountain View, CA May eld Publishing Company).
COPI, I.M. (1986) Introduction to Logic (New York, Macmillan).
CROMWELL, L. (Ed.) (1986) Teaching Critical Thinking in the Arts and Humanities (Milwaukee, WI,
Alverno Productions).
ENNIS , R.H. (1962) A conception of critical thinking, Harvard Educational Review, 32,
pp. 83–111.
HURLEY, P.J. (1999) A Concise Introduction to Logic, 7th edn (Belmont, CA, Wadsworth Publishing
Company).
LOACKER, G., CROMWELL, L., FEY, J. & RUTHERFORD, D. (Eds) (1984) Analysis and Communi-
cation at Alverno: an approach to critical thinking (Milwaukee, WI, Alverno Productions).
MCPECK, J.E. (1981) Critical Thinking and Education (New York, St Martins Press).
MORGAN, W.R. (1995) Critical thinking—what does that mean? Journal of College Science
Teaching, March/April, pp. 336–340.
ORSMOND, P., MERRY, S. & REILING , K. (1997) A study of self-assessment: tutor and students’
perceptions of performance criteria, Assessment & Evaluation in Higher Education, 22(4),
pp. 357–370.
PAUL, R.W. (1982) Teaching critical thinking in the strong sense: a focus on self-deception, world
view, and a dialectical mode of analysis, Informal Logic Newsletter, 4(2), pp. 2–7.
32 P. Ikuenobe