Professional Documents
Culture Documents
Second - Language - Research - Methods Chap3 4 Seliger Shohamy
Second - Language - Research - Methods Chap3 4 Seliger Shohamy
Phase 1 : Formulating the general question questioning and perhaps t o the development of original research
Sources from this questioning.
Experience Other research in Sources outsld you may come to the field o f second language acquisition with
and interests language and second languag questions from other areas in which you have an interest and which
second language can be related to research in this field. For example, the theories a n d
methodologies of the field o f reading may hold implications f o r
General question in second language acquisition. T o w h a t degree is learning
to read in a second language the same a s learning t o read a first
Phase 2: Focusing the question language? Does the ability t o read in the first language facilitate
Is the general question: learning to read in a second? DO the metalinguistic abilities related
1 Important and feasible? to reading in a first language help o r hinder learning to read in a
2 Synthetic or analytic? second? H o w does the ability t o read in a language with a different
3 List the possible factors comprising the general question. orthographic system affect learning to read the target language?
V With the development o f research in metacognitive processes,
&ere has been renewed interest in language learners keeping diaries
If synthetic documenting their experiences and conscious thought processes
What are the phenomena What are the specific while in the language class o r other second language learning
encompassed by the question? constructs to be contexts. Such diaries might include the author's feelings during the
I
Heuristic
Phase 3: Deciding on an objective
Description of research
procedures, observations etc.
Conceptual definrtio
of construct
Formulation o
research questions.
Operational definitrons
actual language lesson but recorded after class, attitudes t o
language learning, attitudes toward the teacher, self-analysis of the
methods used for practising the language and s o on. While these
diary reports are subjective in terms of what is reported a n d
recalled, they can raise interesting questions for further controlled
research. In other words, they may be a place t o begin.
Bailey (1983) recorded in a diary her o w n experiences o f
learning French as a foreign language. She noticed evidence of
of variables. competitiveness and anxiety in her writing, which raised questions
in her mind about whether such feelings were facilitative o r not. She
(Poss~blecombrnations: synthetic-heuristrc. analytic-heuristic,
synthetic-deductive, anaiytrc-deductive) then related these experiences to other literature dealing with
competitiveness and anxiety in second language learning. Teachers,
1
Phase 4: Formulating the research plan or hypothesis
similarly, may wish t o keep diaries of things observed in a language
lesson o r of any student behaviors that seem t o have some effect o n
Descrlptlve or Research hypothesi language learning.
qualitative research
(Process may end here or . . .) / Null hypothesi
Confirrnatio
In the examples above, which are drawn from everyday
experience, there is n o preconceived o r deductive notion of w h a t we
should observe o r record. Instead, a diary of experiences is kept,
Figure 3.1 Prepclratory phases o f research without focusing o n any particular aspect o r question. By sifting
1 Experience and interests through diary entries o r informal observations, it may be found
that a number of factors are of interest for further research. The
Questions for research can derive from everyday experience with evaluation o r description of these factors can become a later stage
language learning. Curiosity can be aroused by something observed of the research o r a single factor may be isolated for more
in a personal language learning experience which leads t o further controlled study.
48 Second Language Research Methods The preparatory stages of research 49
!
2 Reading other research in language and is the case, the theory will have important implications f o r
second language the order of acquisition of g r a m m a r rules in the second
language, defining w h a t rules will likely be transferred from the first
Involvement in a professional field requires researchers t o read
language, a n d w h a t rules a r e l ~ k e l yt o be learned independently o f
research conducted by others in order to keep up with developments,
the first language. M a n y researchers have already begun exploring
innovations, a n d new insights. However, reading research in a field
this theory with these questions in mind (Flynn 1 9 8 7 , Mazurkewich
such a s second language learning a n d teaching can itself become a
1984, White 1 9 8 5 ) .
source for further questioning a n d curiosity a b o u t claims made by a
While reading research in second language acquisition a n d other
theory o r the way a study w a s conducted.
fields, readers should ask themselves a number of questions t o
A theory which claims t h a t learners monitor o u t p u t in terms of
their o w n t h ~ n k i n ga b o u t possible original research, such
grammatical rules learned in t h e classroom (Krashen 1 9 7 8 ) can
as:
lead t o research o n h o w grammatical rules are learned and used by
1 Does this research test o r generate hypotheses?
learners, a n d whether such rules can m a k e a difference in the
2 If the research is descriptive, where d o the d a t a come f r o m ?
learners' performance (Seliger 1 9 7 9 ) .
3 If the d a t a are gathered from other studies o r sources, h o w
Research useful for stimulating ideas for further investigation can
reliable d o the d a t a seem t o be?
be f o u n d in t w o categories:
4 W h a t is the hypothesis o r theory being tested?
a ) Research of a theoretical nature, which presents a theory, a 5 Is the design o r n ~ e t h o d o l o g yappropriate for the kind of
synthesis of other theories, o r the discussion of implications for research?
second language research of a theory outside of second language. In 6 Does the research really test the hypothesis o r theory?
this category, w e find research in theoretical linguistics, research
7 H o w a r e the conclusions reached by the research supported by
discussing the relevance of theoretical linguistics for second the research and the d a t a ?
language research, research which reviews o r surveys other research 8 Are theoretical claims m a d e by t h e research s u p p o r t e d ? H o w ?
a r o u n d a central issue but which contains n o original empirical 9 Does the research m a k e a clear distinction between the results
research itself, a n d s o on. of the study based o n data a n d extrapolations which may g o
As a n example of this, linguistics in recent years has been beyond the d a t a ?
concerned with the theory of universal g r a m m a r and h o w it 10 Are hypotheses which still remain t o be tested presented as
pertains t o language acquisition (Chomsky 1 9 8 1).Some have seen conclusions o r results?
this theory as having potential for explicating issues in second 11 Are there good alternative explanations t o those given by the
language acquisition a n d h a v e explored this ( C o o k 1985). Some author?
journals, such as Applied Linguistics, specialize in articles which These a n d similar questions will be discussed more extensively in
contain discussions of theoretical issues. This book will not be Chapter 4 , which deals with reviewing literature o n i c thc research
concerned with h o w t o conduct this kind of research which is, in a topic h a s been selected. T h e questions above a r e primarily t o
sense, research a b o u t research. F o r o u r purposes, it is sufficient t o stimulate thinking while reading research. N o t only is it m o r e
observe t h a t theoretical research may be considered hypothesis- productive for comprehension t o read research with a questioning
generating because of the questions which it intentionally raises. mind, b u t it can also lead the reader t o the eventual development of
b) Empirical research, which may be heuristic o r deductive a n d researchable questions.
m a y o r may n o t be based o n a particular theory o r hypothesis, but
is assumed t o be based o n data collected from second language
learners. To continue with the previous example above, if the 3 Sources outside second language acquisition
theory of government a n d binding, p a r t of universal grammar, is While the examples above a r e taken from linguistics, similar
taken as a potential explanation for second language acquisition, it research of J theoretical a n d empirical nature is found in
should be able t o predict the kinds of errors learners will make. If psychology, sociology, a n d education. Herc too, questions a n d
50 Second Language Research Methods The preparatory stages of research 51
hypotheses for research in secorrd language can be found. Ir, fact, i t L curiosity
appears that most of the more interesting theories about second ?
Are diffcrrllt rates of acquisition due to characteristics of learners or
language acquisition have derived from these other fields a n d have
become tools f o r investigation within second language research. Are different rates of acq~pisitiondue to some aspect of method or material?
General questions which may be developed into research can As we consider this observation, we arrive a t a general question
come from a field not normally associated with language o r about the phenomenon of different rates of acquisition.
language acquisition. For example, the concept of anomie is ~ e n e r a question:
l Why d o learners o f a second language progress at
concerned with the social psychological orientation of the individual different rates?
in society. T h e concept is concerned with relative feelings of social T h e problem with this general question is that i t is too broad and
rootlessness and w a s first proposed by Durkheim in 1897. Six too inclusive. In its current f o r ~ n u l a t i o nwe d o not know whether
decades passed before researchers used this concept to describe the we are speaking o f children o r adults, learning in a classroom o r in
psychological trauma experienced by bilinguals as they become nature, learning all skills o r a specific skill such as reading, learning
more integrated into the second language social group and begin to a foreign language, o r a second language, and s o on. In other
feel alienation toward their L1 group. T h e application of this words, before we can decide whether t o approach this question o n
concept gave rise to instruments for measuring anomie among a synthetic o r analytic basis, there are many other questions which
second language learners. T h e relative degrees of anomie measured must first be asked. This brings us to Phase 2.
by these instruments became a correlate of the instrumental o r
integrative orientation of the language learner (Lambert a n d
Gardner 1 9 5 9 ) . T h e type of orientation was then used to predict Phase 2: Focusing the question
success in various aspects of second language acquisition. IS the general question feasible? Should i t be approached synthetically
Exposure to sources o f knowledge such as everyday experience, o r analytically? If synthetically, what are the phenomena encom-
reading other research in linguistics a n d second language in related passed by the question? If analytically, what are the specific factors
fields such as psychology, social psychology, a n d education arouses to be investigated?
curiosity and questioning. As Pasteur noted long ago, 'Le hasard ne Having arrived a t a general question, it is n o w necessary to
favorise q u e les esprits pripares.' T h a t is, research questions are n o t consider whether it is possible o r feasible to d o research o n such a
the result o f chance o r wild guesses but develop naturally in question. If it is feasible, the next step is to decide what basic
'prepared minds', that is, minds occupied with ideas and concepts approach (in terms of Parameter I ) , synthetic o r a7zalytic (Chapter
and sensitized to observation. 2), would be best for this kind o f research. Sometimes the decision
Once questions have been raised in the mind of the researcher as about the basic approach to the research question can only be made
a result o f curiosity, observation, and reading, these questions must at a later stage after more consideration is given to the factors o r
be formulated in a general sense. Referring back to Figure 3.1, we variables which make up the question.
can see that before entering into Phase 2 o r Phase 3, the question
must be stated in a form which will allow it to be further narrowed.
For the researcher, this is often a difficult stage because i t requires Feasibility
the careful analysis of the general question in order t o reduce it to a While i t may be fairly easy to agree that the general question is
level where it may be considered researchable. important, it is more difficult to decide if it is feasible. Another way
Let us take an observation discussed above as an example to see of asking whether there is an answer t o the general question is to
h o w we might move through the steps in Phase 1: ask whethcr the question can be invest~gatedgiven the researcher's
Observation
- -
or the world's state of knowledge, the intellectual, academic, and
Learners acquire language a t different rates.
52 Second Language Research Methods T h e preparatory stages of research 53
researc!~would have tc; be conducted. It: brief, we are a s k i ~ g ,'1s learn to ask qliestions about feasibility a n d to predict possible areas
finding a n answer to the general question feasible?' of d i f f i c ~ ~ l t yIt. is n o t ~ l n u s u a lto abandon research ideas a t the
T h e question of feasibility may be divided into several subparts general question stage because of infeasibility.
which we shall n o w discuss. T h e question must be formulated s o Let us n o w apply these questions of feasibility to the general
that a n y investigation may be carricd o u t within the limitations of question, W h y d o learners o f a second language progress at
the resources available for the research. different rates?
If the researcher is able to test the general question for feasibility
before progressing to more advanced phases of developing the 1 How?
research, much waste of time a n d energy can be avoided. Below are In the case of this general question, there are several possibilities.
some of the questions relating to feasibility which should be raised The research could be conducted in a school setting o r in a natural
a t this stage in the development of the research project. It is best t o setting by studying individuals in the process of second language
ask these questions a t this stage in order to avoid aborting a study acquisition. It could be studied synthetically, by observing groups
a t a later stage because of some unforeseen problems. o f learners a n d describing their activities, o r analytically, by
1 H o w can the answer to the general question be found? W h a t focusing o n some specific aspect of language acquisition such as the
does it entail? Will finding the.answer necessitate setting up a n acquisition o f a syntactic form o r a discourse strategy associated
experiment? Will it require the development of a test o r a survey with acquisition. It might be possible t o select learners w h o have
questionnaire? already been identified as learning a t different rates a n d test them
2 Does the researcher have the prerequisite background knowledge for various characteristics that have been related t o successful
t o investigate the question? Is a knowledge of linguistics o r language learning. In other words, there are many possible ways t o
sociolinguistics necessary? H o w much statistical analysis appears investigate this question a n d it would be wise, before beginning, to
to be involved? Will someone with more expertise be required? If explore them for possible advantages and disadvantages.
the study is to be related to other peripheral areas, h o w much
research should be d o n e before proceeding to the next phase?
2 Prerequisite knowledge
3 Are the terms a n d concepts used in the formulation of the general
question defined clearly a n d consistently? Are the concepts a n d Investigating this general question would require different kinds of
terms used in a way that is consistent with how other researchers knowledge depending o n the direction which the researcher decides
have used t h e m ? to take. If the goal is t o observe the social processes involved in
4 W h a t logistical a n d practical problems can be anticipated? I f the second language acquisition, then it is necessary t o acquire
general question asks a b o u t :he language acquisition of children background knowledge in areas such as group behavior, language
o r adults, will the researcher have access to the number of interaction patterns in groups, a n d theories relating to the role of
subjects required t o investigate the question? W h o will collect the social environment in language acquisition.
the d a t a ? Is i t necessary to train assistants? If computer analysis If, however, the focus of the research is o n the linguistic factors
of d a t a is necessary, will there be access to computer time a n d involved in the development of language competence by good a n d
assistance? Will the researcher need to be trained in the use of poor language learners, then the research will require familiarity
computer statistical analysis such as SPSS o r SAS? with linguistic theories pertaining to second language acquisition,
Researchers should try to avoid proceeding directly to the stage methods for analyzing linguistic data, and methods for collecting
of the research itself without considering the theoretical a n d such data.
practical implications o f the general question, because this inevitably
leads to false starts o r problems with the design a n d methodology 3 T h e consistent definition o f concepts iznd terms
of the research. Even experienced researchers sometimes have to In the case o f the general question under consideration, the
discontinue efforts because of unforeseen o r unavoidable obstacles. definition of terms such as lizngziuye leizrner, Lz~zguage leizrning,
However, the more experienced researchers become, the more they rate o f learwing, will have to be narrowed considerably in order t o
54 Second Language Research Methods T h e preparatory stages of research 55
i
As discussed in Chapter 2, taking a n analytic approach means that Description of research proce- Operational defintion of terms or
the second language phenomenon is analyzed into its constituent dures, observat~ons;some factors; formulation of research
parts and one o r a cluster of these constituent parts is examined in operational defin~tionof terms questlon or hypothesis
greater detail t o the exclusion of other factors. When a n analytic - - - - -
approach is taken, it usually means that the investigation will Tuble 3.1 Phase 3: Decidirzg o n an objective or purpose
benefit from looking a t some aspect o f the second language
problem in isolation; that a constituent approach to the phenomenon Heuristic research
is possible and will not distort the nature of the phenomenon itself;
and that enough is known about the constituent factor chosen for it It will be recalled from Chapter 2 that heuristic research was
to be studied in isolation. characterized by its inductive and descriptive nature. The researcher
Returning t o the particular factor of practice, let us suppose that may begin with a general notion about some aspect of second
we h a d grounds for believing that some aspect of individual language learning and gather data in various ways t o learn more
practice was responsible for differing rates of acquisition. In an about the phenomenon under study. Descriptions o r hypotheses
analytic approach, a single factor o r cluster of factors relating t o may then be developed from these data. Other forms of heuristic
individual practice in the language classroon~would be isolated for research may describe specific aspects of second language acquisition
further study. For example, we might decide t o study individual in order to see if they correlate with other factors. If the decision is
practice in formal settings, such as drills, o r combine a study of made t o pursue the research question through heuristic research
individual practice in formal and communicative settings. methods, this last phase will consist of developing the plans o r
For an nnulytic approach, it is necessary t o define the terms used procedures which the research will follow.
in the general question more precisely. At this stage, we are Research might have a heuristic purpose o r goal but be combined
concerned with arriving at a conceptual rather than an operational with either a synthetic o r a n analytic approach to the research
definition. T h a t is, in addition to defining what is meant by terms problem so that we might have synthetic-heuristic o r analytic-
such as 'rate', 'learning', and 'different rates', we must also define heuristic research depending on the approach t o the second
conceptually what we mean by 'practice', 'formal practice', language phenomenon and the goals of the research. For example,
'communicative practice', and other related terms. An important in the case of analytic-heuristic research, if we suspected that a
problem that arises in much research is the lack of clear and specific factor involved in classroom language learning played
consistent definitions of the terms which later become the focus of a part, but were not certain what that part was, o r had n o theory o r
the research. Note that the process we are describing consists of a hypothesis, we might conduct a heuristic study focused on that
gradual narrowing of the focus of the study. Having a clear and particular constituent of classroom language learning. The case of
agreed conceptual definition of the terms will facilitate operation- synthetic-heuristic research is perhaps the more common. This
alizing them in Phase 3. combination might be decided upon if it was felt that the research
should be as inclusive as possible without any predispositions for
assigning Inore importance t o one factor o r another.
58 Second Language Research Methods
y T h e preparatory stages o f research 59
As was noted in Chapter 2, heuristic research does not neces- The process we have followed is analytic because we have broken
sarily begin with preconceived hypotheses. However, some aware- down the synthesis of factors into constituent factors, and
ness of the factors involved in the phenomenon may help decide deductive because we have analyzed one of these as being most
what research strategies t o follow. If the purpose o f our research on likely to be related to rate of acquisition. This kind of research can
the question o f rates of acquisition is to discover what factors most be &aracterized as analytic-deductive. We now try to reformulate
affect it, we d o not begin with a hypothesis t o be confirmed or this isolated factor in the form of a focused question about the
rejected. Rather we might begin with only a vague idea about what relationship between practice and rates of acquisition:
factors affect different rates of acquisition or with a suspicion that - 6 Does the amount o f practice affect the learner's rate o f
some factors, such as those listed on page 55, may be more acquisition?
important than others. The focused question allows us to look a t specific factors that
intuitively relate practice and rate of acquisition. In this case, within
the focused question, there are terms which, for the purposes of
Deductive research will have t o be defined more precisely. The degree of
Any of the nine factors listed under Phasc 2 could serve as the basis definition will later facilitate the design and methodology of the
for more focused research questions. In Chapter 2, we noted that research whether it be experimental, observational, or descriptive.
research. with a deductive objective or purpose begins with a The description and definition of these factors subsumed under the
preconceived notion about what may bc found. This preconceived focused question may best be arrived at through a questioning
notion is then formulated as a prediction or hypothesis t o be process as before:
confirmed or rtjected. The hypothesis is usually grounded in a - 6A H o w is 'language practice' to be defined? How will it be
theory which attempts to explain the behavior in question. measured?
As in the previous discussion of heuristic research, deductive - 6B H o w is 'acquisition' to be defined? Will it be defined in terms
research can be combined with either a synthetic or an analytic of grammatical competence, communicative competence, o r
approach. An example of synthetic-dedzictiue research would be an a combination of the two? H o w will it be measured?
investigation in which a relationship is predicted between a large - 6C What kind(s) of practice are thought to affect rate o f
number of related variables or factors on the one hand and a acquisition?
language ability o n the other. However, because the group of - 6D H o w is the amount o f practice thought to affect rate o f
factors is seen as interdependent in some way, they are first treated acquisition ?
synthetically as a composite whole to see whether in combination - 6E H o w will measures of language practice be related to
they correlate with language ability. In a study of factors which measures of language acquisition?
predict a second language learner's ability t o acquire accurate It is at this point, in answering these questions, that the researcher is
pronunciation, Purcell and Suter (1980) first examined a battery of forced t o confront the crucial problem of translating conceptual
twenty variables which they hypothesized woulJ predict 2ccuracy definitions into operutional definitions, defining the terms o r
in pronunciation. Gradually, through statistical procedures, the constructs which will be studied. Methodological issues are also
authors limited the size of the group of factors, first t o a set of addressed a t this stage, such as whether the research can be carried
twelve and finally to a set of two factors which best predict out with a small number of subjects by conducting in-depth case
pronunciation accuracy. studies of a few learners, or whether the research requires many
In our discussion of deductive research, we will limit ourselves to subjects in order to test the hypothesis.
a single t ~ ~ c t onru, n ~ h c r6, from the set of nine which we previously Let us continue our hypothetical example for the purposes o f
listed. What we have done is to break down or analyze the cluster demonstration. It may be that after our review of the literature, we
of factors which we associate with rate of acquisition and attempt will find two competing definitions o f 'language practice', one
to study a single factor because we have some dedirctive basis or relating to the frequency of repetitions of a sentence pattern (6A)
theory for believing that this factor can predict rLlte of acquisition. and another relating to the meaningful use of language In a
60 Second Language Rese~rrchMethods The preparatory stages of research 61
communicative context (6A'). Let ,IS also assume that we will define designing methods f o r collecting data reiating t o a single factor or a
language acquisition as the learner's ability t o function with synthesis o f factors which may affect the rate of acquisition. In
language in meaningful o r real-life situations ( 6 B ) . That is, Chapter 6 , we will discuss in detail the procedures for conducting
successful communication will be considered a measure of language kinds o f heuristic research.
acquisition. At this point, we will not discuss the more c o n ~ p l e x If the study is t o be deductive, the procedures are more complex.
questions o f h o w we could measure successful communication. This is because deductive research requires the demonstration of a
Chapter 8 will discuss the development o f instruments t o measure clear relationship between the factor o r variable which is thought t o
various constructs. be closely related t o o r responsible for the rate of acquisition. In
Exploring the implications of the questions raised under 6 A and Chapter 1, i t was stated that the requirements for a scientific
6 B leaves us with more focused questions about the relationships hypothesis are that it be testable o r falsifiable. A hypothesis,
between practice a n d acquisition. (See Figure 3.2.) contrary to popular belief, is not supposed t o lead to conclusions
which cannot be tested further. Confirming o r rejecting a research
hypothesis is always conditional o r qualified since it must always be
Definition of ~ r a c t i c e6A Definition of practice 6A' open t o falsification, rejection, o r revision. N e w evidence may
\ / present itself o r other relevant research may cast new light on the
Measure of language acquisition object o f research. It is part of the 'game' of science to view research
as the best possible 'guess' a t a particular point in o u r state of
Figure 3.2 The relationship between practice a n d acquisition knowledge. As new insights and knowledge are gathered and new
theories present different ways of viewing the same phenomenon,
Questions 6D and 6 E put the theoretical construct language hypotheses will necessarily be revised o r rejected.
practice into more concrete o r operational form. They require us to
consider h o w the behavior we are researching can be quantified and Qualitative o r descriptive research Research hypothesis
what quantification might mean for the underlying research (The process may end here o r . . .) i
l
question. What, for example, can be considered a unit of 'practice'? -1
What will be considered 'acquisition'? H o w will these units be Null hypothesis
measured and interpreted?
However, it should be emphasized that constructs cannot be
translated into concrete o r operational form in an actual study o r [Confirmation o r rejection]
experiment until there are clear answers t o the questions 6 A and
6B. If the construct 'practice' is not clearly defined, it would be The research hypothesis and the null hypothesis
foolish t o design and carry out research measuring this ill-defined
idea. W e might define 'practice' as the number of tlmes a subject Question 6 above asked: Does the amount of practice affect the
repeats a sentence from a language laboratory tape o r as the learner's rate of acquisition? Let us assume that we have arrived a t
number o f self-generated sentences that a subject produces in a satisfactory conceptual and operational definitions of all of the
face-to-face communicative context. Each definition will produce terms which are found in the question. The next step is t o convert
different outcomes and different interpretations about the role of this question into a research hypothesis.
practice. The research hypotheses in this example might take one of the
following forms:
- H I Learners w h o exhibit high levels of practice will acquire a t a
Phase 4: Formulating the research plan or the hypothesis
faster rate than those w h o d o not.
I f the study is to be some form of heuristic research, this last - HZ Learners w h o exhibit high levels of practice will acquire a t a
phase will consist of dec~dingon appropriate procedures and slower rate than learners who d o not.
62 Second Language Research h/lethods T h e preparutory stages o f research 63
commonly used source for obtaining references t o the literature. oare published. - W.tshnngrr,n. DC.
Rrporr No. -
CU-208 1-5
I'uh Date - M a y 8.3
T h e references are listed according to author's name and subject. Cuntrlcr -
NIE-C-8.3-OOOI Oescriptwe Noce lpagrnauon ffrsi)
,des,gnaled.
,,., enureiv 8"
-
Engilsh are nor / an as(erlsk. are ~ i l n l e din Ihr suhlrc:
include abstracts o r other types of descriptions which summarize aich~ughE n g i l s h 8s carrled
, ~ o m ~ u r e r u erecords
d
C.orccrs. 'Dcm,tnd
W6,rncn. 'trnplc,yrncnr
O~cup;trvc,ns. 'I:mpl<,ved
Opp,rruu~r!c\, Crm.,lcr,
the content of the material a n d are therefore useful for indicating to Type - Sroad calegorles
f . ~ h o r k o r w . l . ~ h ' m Mdrker. .l.dh,,r
0 c c u p ~ r a o n . l lAspir.lr,',n. Ocrup~rll,n,
Needs,
/ l d e n f ~ f i e r s - addll#onsI Idenlllv~ng
,ern15 nor found ~n rhe Thesaurus
mdZallng the form or organ8zauon 01
the researchers the relevance of the material to their research topic. ,he document as conlrasred ro lrs
U
I Le
l(l; ma,!er The category name ,s
Idcnrtfier\ - Cc,n\<,rrium o f Sr.~rc%. ' N ~ c l c s n ~ l
O c c u p ~ n . , n ~ C,,mpcrcncy
l Tr\tang lnrr8rurc
Only rhe malor Nerms. Drecsdrd by an
aslerlsk are pranced n rhe subiecl
Different indices are published quarterly, monthly, bi-annually, o r by rhe category code W o r n m ' r c,pportunincs l o r rrnpllrvmrnr ~ 0 1 1he
d ~ r e ~ r r~1.11~d
ly KO r h e r level <I/ > k d l and crpcricllcc
index
words o r descriptors, to assist them in finding references related to I 2 0 prrcrnr). mandgrrr .rid . ~ d m n n ~ ~ r r ~ r (cI,S
c m r ) . ~ n opcrlrmvrr
d ( I I pcrccnrl T h u pllhilcarll,n
r sper-
for locating references co the literature as well as for obtaining boundaries. These can be determined by the relevance o f the
actual literarure material. Thcsc different sources are listed in Table : material t o the study.
4.1. Once the literature material is obtained the researcher needs to - The initial decision is to determine whether o r not the content of
review a n d organize it. Ways of doing it will be discussed in the the report which the researcher reads is relevant t o the research
next section. problem under study. If it is n o t relevant, it can be deleted; if it is
relevant, the information it contains must be summarized o r
Sources somehow p u t into a usable f o r m s o it will be retrievable again when
the researcher needs it later.
1 Indices The most useful way for researchers to determine whether certain
2 Computer searches material is relevant o r not, is through reading the abstracts which
3 Bibliographies
appear in most indices and which accompany articles in most
4 Professional conferences
5 'Underground' press
journals. The descriptions in the abstracts provide useful information
6 Journal articles on various aspects of the material.,
7 Edited collections, reviews, books .One criterion for determining relevance is the degree t o which the
content of the article is directly related to the topic of the research.
Table 4.1 Sources for locating the literature material noth her criterion is the source of the report. Material taken from
journals aimed at researchers is likely t o be more relevant than
material from sources aimed at practitioners; well known a n d
Reading the literature highly valued sources are preferable for most material, and material
Once researchers have located the material, they need to sift which comes from primary sources, such as the research article
through it t o determine its relevance to their specific research topic. itself, as reported by the researcher, is usually more relevant than
It is important to decide a t this point h o w much reviewing should material which comes from secondary sources such as the report of
be done, which references should get more emphasis, and which another a u t h o r o n the research. Secondary sources are often less
aspects the researcher should focus o n s o that the material becomes reliable a n d should only be used to obtain access t o primary
meaningful for the contextualizntion of the research. Once the sources. Another criterion of relevance is the recency of the
researchers have read the material they must decide how the material ~ u b l i c a t i o no f the material; the more recent research is usually
should be organized, presented, and reported in the literature more relevant.
review section of the research.
Compiling and summarizing the information
Determining the relevance of the material Once the researcher has selected the relevant materials and deleted
M a n y of the sources which researchers find elmerge during the the irrelevant ones, each report needs to be compiled and
process o t enquiry. It thus becomes difficult to define the scope o f organized. This phase includes a ) compiling a bibliography list and
the literature review before reading. One fairly common situation is b) writing an abstract which contains the most important information
t h a t the literature review becomes an unending ~ a t hand the of the report.
researchers find it difficult to decide when t o stop. Ifthe scope of T h e bibliography list should be arranged alphabetically a n d each
the readings is t o o broad, the researchers may be discouraged and entry should contain the name(s) o f the author(s), the title of the
may lose the right perspective o n the research; if it is too narrow, on report, facts a b o u t publication, page numbers, and so on. I f it is a
the other hand, they may overlook studies which contain important journal article it should include the name of the journal, volume,
a n d relevant information. However, while the literature review and inclusive page numbers. If it is a book, it should include
never really ends, since the researchers will go o n reading before, information a b o u t the publisher, a n d place a n ~ date
l of publication.
during, and even after the study is finished, it is important to set T h e abstract of each report s h o i ~ l dinclude the most important
80 Second Language Research M e t h o d s C o n t e x t u a l i z a t i o n of research 81
7 What is the main research area? Organizing and reporting the review of the literature
2 What is the research problem?
3 What are the major research questions or hypotheses? Once the material f o r the review has been collected, reviewed, a n d
summarized, the researchers need to synthesize it and write the
B About t h e research context
review of the literature, to decide how to orgnnize the infornmation,
1 What other research studies were conducted in the same area?
and to compile the abstracts in the literature report.
2 What w e r e their main findings?
Often the nature of the research problem will determine the
3 What is the rationale of the research?
organization o f the literature review. T h e review can be organized
4 Why was it important t o conduct the research?
according t o the a m o u n t of irlformation bearing directly o n the
C About t h e research m e t h o d research problenl, that is, each question or hypothesis of the
1 What are the main variables of the study? research is substantiated by the relevant literature. For example, in
2 W h ~ c hresearch deslgn was used? (experimental, correlational, des the study on the relationship between age and second language
cript~ve,multivariate, ethnographic?) learning which includes hypotheses about age and the sex of the
3 Description of the population, sample, and selection procedures learner, age a n d the language learning context, and age and
4 The data collection procedures - information about thelr development. learning style, each of these hypotheses could be preceded by a
reliability, validity, pilot study
review o l the relevant literature.
5 Description of the data collected
84 Seconcf Lungtiuge Research Methotis Corztextualization of research 85
p e r s p c ~ ~ i vuf
t . the research, to acquaint the researcher with existing
Exawzple 2
A researcher (Dunkel 1988) conducted research o n the r e l a t ~ o n s h ~ p literature on the topic, t o create a rationale for the study, a n d to
betwcen thc content o f 11 a n d LZ students' lecture notes and test help the researcher narrow down the research question in preparation
She contextualizes the research by describing the facil~tative for conducting the research.
effects of taking notes in learning, the numerous programs t o teach these We then described the different sources for locating the literature:
skills, t h e limited empirical knowledge a s t o the relationship between the references to existing material, such as indices, computer searches,
content of t h e subjects' notes a n d their test perfurnlance, and the lack o f and bibliographies, and the actual material such as journal articles
information a s t o w h a t constitute 'good notes'. and reviews. We ended the chapter with a description of criteria for
She then continues with the l i t e r a t ~ ~ rreview e where she reports o n a determining the relevance o f the material to the research topic,
r~urnberof studies which investigated s o m e of these issues. p i d a n c e on procedures for reading the literature in preparation for
T h e literature review is organized according to different topics: studies conducting the research, a n d suggestions on ways of organizing and
which examined the relationship between the content of notes a n d test
reporting the literature review.
studies which attempted t o determine h o w 'quality of notes'
relates t o the p o s t - l e c t ~ ~ rrecognition
e o r recall ~ e r f o r m a n c e ,those which
examined notes taken by college students and their grades in certain
courses, and those studies which investigated student variables related to Activities
lecture notes.
T h e literature report, a n d espei-ially the finding regarding gender 1 Locate six references from indices on [he t o p ~ of
c the role and use
differences between note-takers, leads the researcher t o the rationale for of strategies in reading con~prehension.T w o of the references
hcr o w n s t u d y : ' I f gender Jiffcrences between note-takers exist, it is should be from language indices, two from educational indices,
possible that there may be other differences attributable t o ethno-cultural and two from psychological and/or sociological indices. Which
background o r language proficiency a m o n g note-takers from d ~ f f e r e n t descriptors did you find t o be most helpful in locating the
regions.' 'Such differences nlight provide important information concerning references ?
the note-taking strategies employed by these students as well as the
relationship between the content of L 1 a n d L 2 students' notes a n d their 2 Choose a hypothetical research topic in your field of interest.
comprehension ~ n dretention of English language lecture material. . . . Locate ten articles on that topic through a survey of the different
T h u s In light o f the dearth of research cor~cerningcross-cultural diffcrcnccs sources (indices, annotated bibliographies). Try to obtain items
in students' notes, the complete lack o f research o n the content of L2 from a variety of sources (journals, books, edited collections,
students' notes, and thc increased ped.lgogical focus placed o n training L2 reviews, papers presented a t meetings of professional bodies).
students t o develop listening and note-taking skill in English, a study was 3 N o w determine which items are most relevant to thc research
conductsd t o . . .' (p. 7 6 3 ) . Herc $he continues with a description of the topic. What criteria did you use t o make that decision?
purpose a n d plan of her o w n study.
4 Summarize the relevant items in a way that will lead to a research
Thus, t h e resc3rchzr began by contextualizing her research question o r 3 hypothesis.
problem. She then reviewed and reported on the relevant literature,
organized according to different topics, a n d this led her to the
rationale and purpose of her own study. More specific research
questions followed, leading in t u r n to a description of the design of References
her research and the procedure used in conducting i t . Aiken, E. G., T h o m a s , G. S., and Shennurn, W. A. 1975. 'hlemory for a
These aspects o f d e s i g n a n d procedure will be discussed in the lecture: Etfects o f notes. lecture r:lte, a n d information dens~ty.'/ocir~z,zI
following chapters of the book. / ' s y c h o l o g v67:439-444.
of E d u c ~ t i o n a ~
Baker, K . 1987. 'Comments o n Willig's "A rneta-analysis o t selected
studies o n the effectiveness of bilingual e d u c n t i o ~ ~ . " 'R e z ~ i e t c ~of
Summary Erjur-~itiunizlRrsc7drch 57/3 :35 1 -.3 6 2 .
In this cl13prer we first discussed thc functions o t contextualizing Baker, L. and Lombardi, 8. R. 19S.5. 'Students' lecture notes and their
t h e research: to help select -1 rrsenrch problem, to broaden the
relation to test perf0rrn;lnce.' T r i l i / ~ z n gr~f.['svc-hokc~gy
1?:28-32.
86 S e c o n d L u ~ z g u a g eR e s e a r c h M e t h o d s
Y
.3,".
A.