Download as pdf or txt
Download as pdf or txt
You are on page 1of 13

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/348382728

Comprehensive Exploration of Digital Literacy: Embedded with Self-


Regulation and Epistemological Beliefs

Article  in  Journal of Science Education and Technology · June 2021


DOI: 10.1007/s10956-020-09887-9

CITATIONS READS

3 224

2 authors:

Mehmet Demirbağ Eralp Bahçivan


Uludag University Bolu Abant Izzet Baysal University
19 PUBLICATIONS   102 CITATIONS    47 PUBLICATIONS   275 CITATIONS   

SEE PROFILE SEE PROFILE

Some of the authors of this publication are also working on these related projects:

E-Öğrenme Ortamlarında Kampüs Tabanlı Uzaktan Eğitim Yoluyla Ders Alan Öğrencilerin Sosyal Buradalık ve Öğrenme Odaklı İnanç Sistemleri Arasındaki İlişki View
project

TÜBİTAK (1001) 219K028 - E-Argümantasyon: Fen Eğitimine Yönelik Yenilikçi Bir Yazılımın Geliştirilmesi, Uygulanması ve Değerlendirilmesi View project

All content following this page was uploaded by Mehmet Demirbağ on 11 January 2021.

The user has requested enhancement of the downloaded file.


Journal of Science Education and Technology
https://doi.org/10.1007/s10956-020-09887-9

Comprehensive Exploration of Digital Literacy: Embedded


with Self‑Regulation and Epistemological Beliefs
Mehmet Demirbag1   · Eralp Bahcivan2

Accepted: 24 November 2020


© The Author(s), under exclusive licence to Springer Nature B.V. part of Springer Nature 2021

Abstract
Today, science educators accept that digital literacy has been one of the key concepts for science teachers in terms of creating
meaningful science learning environments. Although there are many research attempts investigating digital literacy in science
teacher education literature, the interrelations of this concept to cognitive and metacognitive aspects are still blurred. In this
regard, this study was conducted to investigate the structural relations among preservice science teachers’ epistemological
beliefs, self-regulated learning skills, and digital literacy as well as the reasons for these relations. A sequential explanatory
research design guided this two-step study. The first step involved structural equation modeling analysis of data from 612
preservice science teachers. The second step focused on the reasons for the structural relations observed in the first step. Six
participants were selected as the cases in the latter. Overall, the results showed that participants’ epistemological beliefs,
self-regulation skills, and digital literacy are closely related to each other. Epistemological and self-regulational filters as well
as epistemic bias and the context in which the filters exist directly affect these relationships. Considering the results, it was
suggested that preservice science teachers should be involved in inquiry-based and argumentation-based learning mediums
since these types of mediums contribute positively to the development of epistemological beliefs and self-regulation skills.

Keywords  Digital literacy · Self-regulation · Epistemological beliefs · Preservice science teachers

Introduction assist their awareness regarding the conscious use of ICTs.


In this respect, digital literacy (DL), defined differently
Information and communication technologies (ICTs) ensure among researchers, is accepted as a key concept (Greene
learning environments in which individuals can access infor- et al. 2014).
mation sources rapidly through online systems. Today, stu- Examining definitions of digital literacy, it is clear that
dents often utilize internet-based mediums for any type of the term has been related to other concepts, such as com-
research related to daily life and/or science (Mason et al. puter literacy, information literacy, and media literacy (Mar-
2018). The internet provides an unlimited amount of infor- tin 2008). Green et al. (2014) criticize these DL definitions
mation together with verbal and visual representations that because of the omission of cognitive and meta-cognitive
actually support computer-assisted learning processes. processes. At this point, Green et al. (2014) tackle DL as
Querying the reliability and justification of these informa- an integrative part of developing meaningful cognitive pro-
tion sources in a way that is conscious of their evidentiary cesses and combining the information obtained through
basis is vital for today’s science learners (Mason et al. 2010; online systems. According to this definition, the DL of sci-
Walraven et al. 2009). Therefore, science learners should be ence learners is closely related to their epistemic cognition
supported in developing the cognitive processes that will and information-organizing processes, which are related
to their self-regulated learning skills. Certain researchers
* Mehmet Demirbag have already claimed that online science learning environ-
mtdemirbag@uludag.edu.tr ments should include processes of justification, querying the
reliability of information sources, selection, organization,
1
Department of Science Education, Bursa Uludağ University, meaning-making, and reflection (Greene et al. 2010; Mason
Bursa, Turkey
et al. 2011; Tsai et al. 2011).
2
Department of Science Education, Abant İzzet Baysal
University, Bolu, Turkey

13
Vol.:(0123456789)
Journal of Science Education and Technology

Current literature has presented scientific evidences that extreme characteristics will be invited to solve a scientific
DL is affected by students’ beliefs about literacy develop- conflict; then, stimulated recall interviews will be conducted
ment (List 2019). Also, in another research with a sample of to understand the reasons for in/coherences between their
Philippine university students, Atoy et al. (2020) has found behaviors and the statistical model generated in the first step.
that DL is effective on their online information searching
strategies. In addition, Blau et al. (2020) reported self-regu- Theoretical Framework
lation skills as an essential part of DL. In this regard, it can
be mentioned that research studies conducted for conceptu- Epistemological Beliefs
alization of DL has still been continuous.
Considering the scientific literature, we also believe In their prominent review, Hofer and Pintrich (1997)
that DL intertwines with epistemological beliefs and self- define epistemological beliefs as people’s beliefs related
regulation skills that promote cognitive and meta-cognitive to knowledge and knowing. Beliefs about the structure of
processes. In this regard, a digitally literate science learner knowledge comprise certainty and simplicity dimensions,
can be defined as an individual who benefits from multiple whereas beliefs about knowing involve justification and
information sources, queries the reliability of information source dimensions. There are three different approaches in
sources, and organizes these informational bits for their own this area: the developmental perspective, the belief system
learning during the utilization of any type of ICT. Therefore, approach, and the domain/context-based epistemological
DL is an umbrella term relating to epistemological beliefs perspective. The first began with Perry’s (1970) longitudinal
and self-regulation; however, the literature still requires studies, which were then supported by certain researchers
empirical studies supporting these claims. Indeed, many (e.g.Baxter and Magolda 1992; King and Kitchener 1994).
research studies have already shown that certain concepts According to this approach, people’s epistemological stance
(such as online search strategies, search outcomes, and has a univariate characteristic involving the beliefs stated
source evaluation) related to epistemological beliefs, self- above and develops through alignment among these dimen-
regulated learning, and DL are closely aligned (Greene et al. sions. To illustrate, an individual in the dualistic phase
2010, 2014; Mason et al. 2018; Muis 2007; Strømsø and most likely believes that any type of knowledge is right
Bråten 2010; Tsai et al. 2011). There is a lack of empirical or wrong and that authorities determine which one is cor-
evidence supporting the alignment of these variables with rect, whereas individuals in the commitment within relativ-
a sample of preservice science teachers through a mixed ism phase may believe that each individual is responsible
design research method using structural equation mod- for their own meaning-making processes, but any type of
eling, and this study aims to fill that gap. Structural mod- knowledge should be justified by evidence. According to this
eling studies focusing on the relationship between preser- perspective, developmental shifts are triggered by biological
vice science teachers’ DL and self-regulated learning skills progress and social interactions, as stated previously by the
should be conducted to close the gap in scientific literature. Piagetian framework (Perry 1970).
Such studies empower science educators to capture a more The second approach, the belief system approach, has
comprehensive picture of umbrella concepts (in this study, been proposed by Schommer (1990), who states that per-
DL) comprising key variables. Preservice science teachers sonal epistemology encompasses people’s epistemological
were selected as the participants of this research because of beliefs, which are more or less independent. That is, people’s
their future potential effects on their science learners. Fur- epistemological beliefs can be aligned as a belief system
thermore, studying a sample of preservice science teachers holding multidimensional (instead of univariate) character-
provides science educators with two types of perspectives. istics. Individuals’ weak epistemological beliefs are labeled
The first perspective is that preservice teachers are actually as naïve, whereas their strong epistemological beliefs are
undergraduate students. Therefore, studying such a sam- labeled as sophisticated. Therefore, to illustrate multidimen-
ple provides researchers with evidence related to learners. sionality, an individual may hold sophisticated epistemo-
The second perspective is that preservice teachers will be logical beliefs in the simplicity and justification dimensions,
teachers in the near future. Therefore, verifications coming whereas the same individual may hold naïve epistemological
from such a sample allow researchers to deal with issues of beliefs in the source and certainty dimensions. Such an indi-
teacher education realistically. vidual believes that any type of knowledge has a complex
The study is based on a two-step guideline. The first structure (sophisticated in simplicity) is verified by different
step will focus on examining the structural relations among types of evidence (sophisticated in justification), comes from
preservice science teachers’ self-regulated learning skills, authorities (naïve in source), and is unchangeable (naïve in
DL, and epistemological beliefs. The second step will focus certainty).
on the verification of these relationships within a natural The last approach, called the domain/context-based
setting. In this step, the participants observed as holding epistemological perspective, defends the idea that people’s

13
Journal of Science Education and Technology

epistemological beliefs are affected by the characteristics learning processes. Furthermore, Muis (2007) defines four
of domains (e.g., natural science vs. social studies) and tenets of self-regulated learning processes: (1) task defini-
contextual situations (Buehl and Alexander 2006; Hammer tion, (2) planning and goal setting, (3) enactment, and (4)
and Elby 2002; Palmer and Marra 2008). For example, stu- evaluation. In the first step, science learners construct a
dents may believe that knowledge in natural science is more task perception based on internal (prior knowledge and
certain than that in psychology (Palmer and Marra 2008). epistemic cognition) and external (contextual) factors. In
Furthermore, a student holding sophisticated epistemologi- the second step, these learners make plans and determine
cal beliefs may behave as if she/he has naïve epistemologi- goals and learning strategies to realize meaningful learn-
cal beliefs to score higher on the exam (Elby and Hammer ing. Then, they apply predetermined plans and strategies
2001). and construct their own knowledge. At the final step, they
The value of epistemological beliefs for science education evaluate the achievements and failures of task products for
comes from their centralized position in accordance with each of the previous steps. This step actually corresponds
the many variables related to teaching and learning science to reflecting on previous decisions and actions.
(Hofer and Pintrich 1997). A plethora of researchers have In addition to the necessity of self-regulation if sci-
continuously verified that science learners’ and/or preser- ence learners are to achieve meaningful comprehension in
vice science teachers’ epistemological beliefs are significant regular classes, this concept has gained prominence in the
predictors for certain cognitive and affective characteristics, digital era. Science learners are expected to apply the four
such as teaching/learning beliefs (Bahcivan 2014), academic tenets explained above in ICT-embedded learning medi-
achievement (Stathopoulou and Vosniadou 2007), achieve- ums (Strømsø and Bråten 2010). To illustrate, self-regu-
ment goals (Lin and Tsai 2017), self-efficacy in learning sci- lated science learners present better performances in terms
ence (Yilmaz-Tuzun and Topcu 2008), self-regulation (Muis of examining the validity and reliability of information
and Franco 2009), and argumentativeness (Nussbaum and sources in internet mediums (Mason et al. 2018). Addi-
Bendixen 2003). Additionally, research studies have shown tionally, considering the empirical and theoretical results,
that preservice science teachers’ epistemological beliefs are the scientific literature has shown that science learners’
effective on their DL (Greene et al. 2014; Güneş and Bahçi- epistemological beliefs and self-regulation skills are inter-
van 2018). Considering the scientific evidence, a researcher twined (Barzilai and Zohar 2012; Muis 2008). For exam-
may expect that a preservice science teacher holding sophis- ple, Muis (2007) has theorized that epistemological beliefs
ticated epistemological beliefs may query the certainty and play a vital role in determining the cognitive and affective
reliability of information sources when she/he is involved conditions of tasks and that such beliefs affect learning
in online learning environments. Such a preservice science standards. Additionally, she has claimed that self-regula-
teacher may attempt to justify knowledge by utilizing mul- tion skills may affect epistemological beliefs because these
tiple information sources and evidence. In other respects, skills involve evaluation (reflection) processes. Moreover,
preservice science teachers’ epistemological beliefs may Greene et al. (2010) have conducted theoretical research
be related to their self-regulation skills, which are critically focusing on why individuals’ epistemological beliefs are
important for DL. Self-regulation skills involve organizing, effective on their cognitive and metacognitive processes
criticizing, and evaluating information. during learning periods in computer-supported learning
mediums; then, they presented micro and macro evalua-
Self‑Regulation tions related to the interwoven structure of epistemologi-
cal beliefs and self-regulation skills. According to their
Self-regulation is a key concept comprising cognitive and evaluations, being exposed to higher-order learning tasks
metacognitive skills that are essential for the effective in computer-supported learning mediums may contribute
learning of science students (Yerdelen and Sungur 2019). positively to science learners’ epistemological develop-
Although there are many definitions of self-regulation, ment. Additionally, they have claimed that interventions
Pintrich and Groot (1990) underline three basic character- in self-regulation processes may deactivate sophisticated
istics of a self-regulated learner. The first is that self-regu- epistemological beliefs in these learning mediums. Empir-
lated learners apply metacognitive strategies such as modi- ical evidence supports these claims. For example, learn-
fying, planning, and tracing to check their own learning ers holding sophisticated epistemological beliefs tend to
processes. Second, such a learner is conscious enough of adopt more deep-processing learning strategies, such as
his/her learning efforts to direct and take control of them. processing more nodes (e.g., Pieschl et al. 2008). Consid-
For example, a self-regulated science learner is persistent ering these empirical and theoretical findings, we believe
when she/he encounters a difficult task. Finally, self-reg- that this interwoven structure of epistemological beliefs
ulated science learners adopt higher-order metacognitive and self-regulation skills should play a significant role in
strategies such as rehearsal and elaboration during their preservice science teachers’ DL.

13
Journal of Science Education and Technology

Digital Literacy understanding the theoretical baseline of and teaching–learn-


ing DL. In addition, there are indirect findings clarifying the
DL is one of the most important key concepts for this era close relationships among DL, evaluating organizing and
because it has become a survival skill (Eshet-Alkalai 2012). monitoring web pages (Barzilai and Zohar 2012; Greene
DL means having not only basic skills related to the uti- et al. 2014; Mason et al. 2018; Strømsø and Bråten 2010).
lization of digital devices but also complex skills such as Additionally, even though recent research does not involve
cognitive, motor, social, and emotional skills that assist structural equation modeling, recent findings do present
learners by empowering their learning outcomes in digital theoretical and empirical evidence regarding close relation-
environments (Eshet-Alkalai 2012). DL has been paired with ships among DL, self-regulation skills, and epistemological
similar concepts, such as media and visual literacy, ICT lit- beliefs (Greene et al. 2010; Greene et al. 2014).
eracy, and information literacy (Martin 2008). In addition
to developing essential knowledge, skills, and attitudes in The Proposed Model
internet/computer supported learning mediums, DL stud-
ies have also focused on science learners’ critical evalua- The research abstracted above presents empirical and
tions regarding their learning processes. Learners have to theoretical evidence regarding the relationship between
access multiple knowledge sources, evaluate evidence, and preservice science teachers’ epistemological beliefs and
query the validation and reliability of information sources self-regulation skills (Greene and Azevedo 2009; Muis
while they attempt to construct knowledge in ICT-supported and Franco 2009; Pieschl et al. 2008; Strømsø and Bråten
mediums (Strømsø and Bråten 2010; Ferguson et al. 2012; 2010). Furthermore, previous findings have shown that
Walraven et al. 2009). This point actually corresponds to the individuals’ epistemological beliefs and self-regulation
differentiation between DL and ICT skills, because DL does skills are intertwined with DL-related structures such as
not only comprise of gaining knowledge and skills but also computer-supported learning environments and sources of
comprises of reflections about learning processes. evaluation (Barzilai and Zohar 2012; Mason et al. 2018;
Digitally literate science learners in computer-supported Tsai et al. 2011). Considering these findings, the structural
learning mediums should follow valid and reliable paths to model in Fig. 1 was constructed as the proposed model of
reach true knowledge in their daily lives and educational the research.
mediums  (Güneş and Bahçivan 2018). For this reason, sci- Considering the recent research discussed above (e.g.,
ence learners should be able to conduct research on multi- Barzilai and Zohar 2012; Pieschl et  al. 2008), we first
ple documents, focus on procedural knowledge instead of hypothesize that preservice science teachers holding
descriptive knowledge, construct their own arguments, and sophisticated epistemological beliefs will utilize higher-
possess higher order learning strategies (which are support- order learning strategies such as evaluation of knowledge in
ing, organizing and evaluating) to support these arguments digital mediums, accessing sources of evidence, identifying
(Strømsø and Bråten 2010; Ferguson et al. 2012; Walraven bases for evaluation, and adopting multiple documents. In
et  al. 2009). These higher-order learning strategies are other words, the first hypothesis ­(H1) of the proposed model
closely related to epistemological beliefs and self-regula- is that preservice science teachers’ epistemological beliefs
tion skills (Barzilai and Zohar 2012; Greene et al. 2010; affect their self-regulation skills. Second, current findings
Muis et al. 2015). Hence, there are also specific definitions stress that sophisticated epistemological beliefs may trig-
supporting this idea in the scientific literature. For exam- ger utilization of higher order strategies such as evalua-
ple, Greene et al. (2014) define DL as a special blend of tion, organization, and monitoring during online search and
epistemological beliefs and self-regulation skills. Therefore, knowledge construction (e.g. Pieschl et al. 2008; Tsai et al.
revealing close relationships among DL, self-regulation 2011). Therefore, we hypothesize that preservice science
skills, and epistemological beliefs will be helpful in terms of teachers’ epistemological beliefs contribute to their DL

Fig. 1   The proposed model

13
Journal of Science Education and Technology

positively ­(H2). Finally, a limited number of research stud- and DL as well as the reasons for these relations. Therefore,
ies (e.g., Mason et al. 2018) show that science learners’ self- we have two research questions:
regulation skills make them query the validity and reliability
of information sources in digital platforms. Therefore, we (1) What are the relationships among preservice science
hypothesize that preservice science teachers’ self-regulation teachers’ epistemological beliefs, self-regulation skills
skills are positively related to their DL ­(H3). and DL?
The first part of this research study will examine the (2) How are preservice science teachers’ epistemological
statistical results related to the proposed model in Fig. 1. beliefs, self-regulation skills, and DL related when they
However, we may obtain unexpected results due to the cul- are confronted with an online conflict text?
tural differentiations between western and eastern samples.
Additionally, even if we do not have contrasting results, we
must determine the reasons for the proposed relations in Method
the model. Considering these issues, the second part of the
study will be conducted to verify the observed relations in The first research question of the study is constructed to
natural settings. In this part of the study, conflict texts will determine the relationships among preservice science teach-
be presented to the selected participants to make visible the ers’ epistemological beliefs, self-regulation skills and DL.
hypothesized relations among their self-regulation skills, To respond to the question, associational research (Fraen-
epistemological beliefs and DL. We take this approach kel and Wallen 2009) will be conducted. Additionally, the
because in many studies (e.g. Muis et al. 2015.), conflict second question queries the reasons for these relationships,
texts have been used as effective tools to reveal the episte- and the second part of the research will be a case study.
mological beliefs and self-regulation skills of individuals. Therefore, a quantitative research design will be followed by
a qualitative one. Creswell (2008) labels such mixed design
Significance of the Study studies as explanatory sequential research designs.

This study has several significant aspects. Pairs of the three Study I
variables of this study have been studied previously; how-
ever, this study is, as far as we know, the first attempt to Participants
simultaneously examine the possible relations among all of
these variables mentioned above. Second, these relation- Convenience sampling was adopted to maximize the number
ships will be investigated with advanced statistical methods, of participants (Creswell 2008). A total of 612 Turkish pre-
which will be followed by qualitative queries; therefore, the service science teachers (503 female, 106 male, 3 unmarked)
study will contribute positively to the comprehension of DL. from 6 different state universities participated in the study.
Hence, within this study DL will be related to cognitive vari- All the participants are undergraduate students of science
ables called as self-regulation and epistemological beliefs. education departments of education faculties. They will be
In this regard, results of this study will clarify whether these working as elementary (middle) school science teachers
variables are integrated parts of DL. Because, this study will after graduation. Their ages ranged from 19 to 25 (M = 20.81
not only present a theoretical/proposed model for follow- and Sd = 1.21). A total of 122 were 2nd year undergraduate
ing research, but also examine whether there are significant students, 300 were 3rd year undergraduate students, and 188
relations. Third, the research data in this area mostly come were final-year undergraduate students (2 students left the
from Western countries. Thus, samples from Turkey, as a year box unmarked).
transitional country between western and eastern cultures,
may shed light on DL comprehension more extensively. The Instrument
Finally, Turkey has provided ample budgets in the educa-
tional arena to foster the DL development of science learn- The instrument contained 4 parts. The first was arranged to
ers. All state schools have been equipped with touchable collect certain demographic information. Each part involved
boards connected to the internet for approximately ten years. one of the scales explained below.
Therefore, the results of this research are also vital in terms
of educational policy implications. Scientific Epistemological Belief Scale

Research Questions The scale was developed by Conley et al. (2004) to measure
elementary students’ epistemological beliefs. There are 26
This study examined the relationships among preservice sci- 5-point Likert items (1 = strongly disagree to 5 = strongly
ence teachers’ epistemological beliefs, self-regulation skills agree) distributed among 4 dimensions: certainty (6 items;

13
Journal of Science Education and Technology

e.g., scientific knowledge is always true), source (5 items; questionnaire originally developed by Pintrich et al. (1993)
e.g., everybody has to believe what scientists say), develop- involved 81 7-point Likert items. Utilizing only the meta-
ment (6 items; e.g., ideas in science sometimes change), and cognitive self-regulated subdimension of this questionnaire
justification (9 items; e.g., ideas about science experiments was preferable because one of the related variables was self-
come from being curious and thinking about how things regulation. The metacognitive self-regulation dimension
work). After implementation, item scores in the source and comprised 12 items that were used in this study to meas-
certainty dimensions were recoded so that higher scores cor- ure preservice science teachers’ self-regulation skills. This
responded to sophisticated epistemological beliefs. The scale dimension was previously utilized (Akyol et al. 2010), and
was adapted into Turkish by Bahcivan (2014) with a sample the researchers reported acceptable fit indices (CFI = 0.90,
of Turkish preservice science teachers. He reported accept- GFI = 0.92, RMSEA = 0.06). Before the analyses, 2 items
able fit indices (χ2/df = 1.44, CFI = 0.95, TLI = 0.93, and were recoded to provide coherence among items. Then, a
RMSEA = 0.04) and alpha reliability scores for each dimen- confirmatory factor analysis (n = 612) was conducted for
sion in the range of 0.66–0.82. A confirmatory factor analy- validation. Accordingly, 2 items were eliminated because
sis (n = 612) was also conducted for construct-related evi- of factor loading values lower than 0.4 (Shevlin and
dence for validation because it had been previously adapted Miles 1998). The analysis yielded acceptable fit indices (χ2/
with a similar sample (Tabachnick and Fidell 2013). One df = 2.18, CFI = 0.98, TLI = 0.97, and RMSEA = 0.04), fac-
item from the certainty dimension was extracted because tor loading scores between 0.43 and 0.73 and an alpha reli-
of a factor loading score lower than 0.40 (Shevlin and ability score of 0.85.
Miles 1998). The analyses resulted in acceptable fit indices
(χ2/df = 1.89, CFI = 0.95, TLI = 0.94, and RMSEA = 0.03) as The Procedure
well as factor-loading values between 0.44 and 0.74. Alpha
reliability scores were observed as 0.78, 0.75, 0.69, and The authors first informed the participants about the pur-
0.84 for the source, certainty, development, and justifica- poses of the study, and then the instruments were distrib-
tion dimensions, respectively. uted during regular class times. A total of 651 forms were
returned; however, 39 of them were not included in the
Digital Literacy Scale dataset because of highly missing data. Responding the
instrument took approximately 25 min. Participants were
This scale was originally developed by Ng (2012) to meas- also assured of the confidentality of their personal data and
ure undergraduate students’ DL. It involves 17 5-point Lik- were asked to write their names (or to use and write nick-
ert items distributed among 4 dimensions: attitudes towards names) for Study II. All the data were entered into SPSS 21,
ICT for learning (7 items), technical (6 items), cognitive (2 which was then utilized for reliability analyses. AMOS 24
items), and social-emotional (2 items). Güneş and Bahçi- was utilized for confirmatory factor analyses and structural
van (2018) previously adapted the scale into Turkish with a equation modeling.
sample of preservice science teachers by utilizing explora-
tory factor analysis. The analysis resulted in a one-factor Results and Discussions for Study I
solution explaining 40% of the variance. The resulting factor
comprised all the items of technical, cognitive, and social- The first research question was answered with a structural
emotional dimensions with an alpha reliability score of 0.86. equation modeling analysis (n = 612) on the proposed
This one-factor scale involving 10 items was implemented model, as shown in Fig. 1. The analysis yielded accept-
in the study. A confirmatory factor analysis (n = 612) was able fit indices (χ2/df = 1.95, CFI = 0.91, TLI = 0.90, and
conducted since the participants had the same characteris- RMSEA = 0.04). Significant regression weights in the sta-
tics for whom the scale was adopted (Tabachnick and Fidell tistical model are represented in Fig. 2.
2013). Two items were eliminated because of factor loading According to Fig. 2, participants’ epistemological beliefs
values lower than 0.4 (Shevlin and Miles 1998). The results in the certainty and justification dimensions were positively
presented acceptable fit indices (χ2/df = 2.42, CFI = 0.97, related to their self-regulation skills. That is, participants’
TLI = 0.96, and RMSEA = 0.04) as well as factor loading sophisticated epistemological beliefs in these epistemic
values between 0.44 and 0.72. The alpha reliability score dimensions positively triggered their self-regulation skills.
was 0.81. Additionally, it seemed that epistemological beliefs in cer-
tainty and development dimensions positively predicted
Self‑Regulation Scale their DL. In other words, when a preservice science teacher
believed that knowledge was changeable and developed over
Motivated strategies for learning questionnaire were uti- time, she/he presented digitally literate skills. These find-
lized for the development of the self-regulation items. The ings are coherent with the scientific literature stating that

13
Journal of Science Education and Technology

Fig. 2  Statistical model
(*p < 0.05, **p < 0.001)

epistemological beliefs have a centralized position in teach- Data Collection


ing–learning belief systems (Hofer and Pintrich 1997). Fur-
thermore, analysis showed that participants’ self-regulation Semi‑structured Interviews
skills positively predicted their DL. That is, qualifications
in self-regulation skills are positively effective on preser- Participants were queried before the observation process
vice science teachers’ DL. This result is also consistent with with semi-structured interviews. In this part, they were pre-
previous research studies (Greene et al. 2014; Mason et al. sented with their own responses to the scales. Then, they
2018). Moreover, some epistemological beliefs were not sig- were asked to explain their reasons for item responses.
nificantly related to self-regulation skills and DL. The rea- The aim of these interviews was to confirm their status in
sons for these observations will be investigated in Study II. the three variables of Study I. Each interview, which took
approximately 40 min, was audio recorded and transcribed
verbatim before the analyses.
Study II
Observation
This step of the study was conducted to investigate how
preservice science teachers’ epistemological beliefs, self- Each participant was individually invited to read the con-
regulation skills, and DL were related when they were flict text on a digital medium connected to the internet. The
encountered with an online conflict text. Considering the authors prepared conflicting texts about the utilization of
literature evidencing that DL is a specific blend of self-regu- agricultural pesticides. The text was poorly structured since
lation skills and epistemological beliefs (Greene et al. 2014), the scientists defend different sides based on scientific data.
participants with the highest and lowest scores on the scales One side was rejecting the usage of agricultural pesticides,
measuring degrees on these two variables were involved in whereas the other side claimed that the utilization of pesti-
this step. Since there was more than one case in Study II, a cides was definitely necessary. Participants were allowed
multiple case study design guided the research for this step to read and search on this issue individually on the internet
(Creswell 2007). without any time limitations. The individual searches took
approximately 1 h for each participant. All their actions in
digital media were recorded, and their screencasts were also
Participants captured through the OBS Studio program.

Study I partly evidenced that preservice science teachers’ Stimulated Recall


epistemological beliefs and self-regulation skills affected
their DL; therefore, participants for extreme cases were Following the observation processes, participants were
selected by purposive sampling considering their episte- invited to conduct semi-structured interviews for stimulated
mological status and self-regulation-skills scores (Creswell recall. Each participant watched their own screencasts and
2008). First, participants’ total scores were calculated, and was asked about the reasons for their actions. The semi-
then, 3 participants for each of the higher-order and lower- structured interview protocol involved several questions,
order cases were selected. A higher-order preservice science such as “Why did you choose to conduct research on this
teacher has the highest scores in both epistemological beliefs website?” and “How did the ideas of authorities affect your
and self-regulation-skills scales, whereas the reverse is valid sources of information? Why?” Stimulated recall interviews
for lower-order cases. took approximately 1 h for each participant. Interviews were

13
Journal of Science Education and Technology

audio recorded and then transcribed verbatim before the


analyses.

Data Analysis

Content analysis was implemented on the transcribed data-


set, as the purpose of the analysis was to explain language in
detail (Krippendorff 2004). Content analysis produced cod-
ing units such as epistemological beliefs and self-regulation
skills, and coding categories such as sophisticated-naïve and
regulated highly-regulated lowly. The first author coded all
the datasets, and then, the second author distributed pre-
determined coding categories to the selected discourses to
examine intercoder reliability. Then, Krippendorff’s α was
estimated as 0.86, which indicates high reliability of cod-
ing. Data triangulation was ensured by utilization of inter-
view data, observation data, and stimulated recalls as well
as participants’ instrument scores for validation purposes.
Furthermore, because stimulated recall interviews were
conducted after the observation processes, these interviews
served as the source of member checking, which contributes
positively to validation processes (Creswell 2007). Moreo-
ver, data collection periods ensured trustworthiness because
of the follow-up nature between observation and interview
sessions (Lincoln and Guba 1985).

Results and Discussions for Study II

This step of the study was conducted to deeply investi-


gate the reasons for the effectiveness of preservice science
teachers’ self-regulation skills and epistemological beliefs Fig. 3  The comprehensive model
on their DL as represented in the second research question.
Participants were asked to utilize digital media and to con-
struct their own arguments after reading the arguments pre- justification of personal experience, and justification of
sented in the conflict text. In this way, we aimed to unveil multiple documents. Interestingly, all the cases that hold
participants’ research and learning strategies together with sophisticated or naïve epistemological beliefs seemed to
reasons. Table 1 presents coding units and examples of cod- activate the epistemological filter coded as reliability and
ing categories detected in the semi-structured interviews, credibility of digital sources. However, the degree of utiliz-
observations, and stimulated recall interview transcripts. ing the ‘reliability and credibility of digital sources’ filter
The logical paths among these coding units and categories seemed to be affected by their self-regulation skills. All the
are also represented in Fig. 3. participants made use of certain popular research applica-
Table 1 shows that preservice science teachers’ epistemo- tions, such as Google Scholar and Wikipedia; however,
logical beliefs filter their online research strategies, which highly self-regulated participants were skeptical about the
were coded as reliability and credibility of digital sources, reliability of information provided by these digital sources.
looking for evidence, multimodal representation, justifica- For example, one of the lower-order participants stated that
tion of personal experience, and justification of multiple “I preferred to enter Google Scholar, because the knowl-
documents. This result is consistent with the literature stress- edge provided by this source is constructed by evidenced
ing the centralized position of epistemological beliefs in information.” On the other hand, one of the higher order
teaching–learning belief systems (Hofer and Pintrich 1997). participants expressed that “I reached the information pack-
Analyses showed that preservice science teachers holding age provided by National Ministry of Agriculture by using
sophisticated epistemological beliefs and presenting high Google Scholar; however, I could not claim that all infor-
self-regulation skills tended to utilize research strategies mation provided by this source was definitely right. …but
coded as looking for evidence, multimodal representation, I believe that this is more reliable…” This result actually

13
Journal of Science Education and Technology

Table 1  Coding list
Coding unit Coding categories Example of quotation Data ­source*

Epistemological beliefs Sophisticated Any type of knowledge can be falsified in time…I can SS
behave like a scientist in my daily life to reach truth…
Naïve Scientists are unique regarding reaching the truth…my SS
inferences are always weak in comparison to scientists
even if I reach the same truth as them…
Epistemological filter Reliability and credibility of digital sources I entered directly into Google Scholar because of its reli- O, SR
ability
Looking for evidence I tried to search on the internet related to both of the argu- O, SR
ments in the text
Multimodal representation I utilized tables and graphics to support my claim O, SR
Justification of personal experience I tried to write my own argument considering my previous O, SR
knowledge from chemistry courses
Justification of multiple documents I utilized not only scientific articles but also used news O, SR
portals
Self-regulation skills Regulated highly I first plan where I can find more valid information during SS
my research
Regulated lowly I did not often prefer to construct my own queries during SS
my studies
Self-regulational filter Detecting counter arguments The text involved not only advantages but also disadvan- SR
tages of utilizing agricultural pesticides
Questioning I ask myself why people still use the pesticides; although, O, SR
they know they are dangerous
Constructing own argument I don’t directly use others’ ideas, but try to first compare, O, SR
and then adapt them to my own ideas
Underlying text I underlined the important points and complex terms in the O, SR
text…
Abstracting I wrote a few sentences to abstract all the information I O, SR
searched
Revising I revised the text to provide wholeness among knowledge O, SR
parts
Epistemic bias Prejudice My previous knowledge, most likely, let me focus on just SR
disadvantages
Digital literacy Qualified I utilize digital mediums for any type of research to find SS
multiple information sources…
Unqualified I have limited knowledge related to utilization of vari- SS
ous types of digital technologies… My ICT skills are
restricted…

* SS for semi-structured interview, O for observation, SR for stimulated recall

shows that by positively triggering self-regulation skills, thinking. Therefore, it is clear that preservice science teach-
epistemological beliefs have not only directed effects but ers’ self-regulation skills directly affect their DL since a
also indirect effects on participants’ DL. digitally literate individual requires certain strategies, such
Moreover, analyses indicated that higher-order partici- as questioning in online systems and critical thinking.
pants used more effective self-regulational filtering strat- Epistemic bias was an unexpected coding unit at the
egies coded as detecting counter arguments, questioning, beginning of this research. The results showed that partici-
constructing their own argument, underlying text, abstract- pants’ learning and/or searching processes were affected
ing, and revising. In other words, it can be mentioned that by epistemic biases. This result was especially clear
preservice teachers presenting higher order self-regulation among the higher-order participants. These participants
skills adopted the filtering strategies more effectively in seemed that they had already made their decisions related
comparison to lower order participants. Duncan and McK- to their own arguments just after reading the conflict text
eachie (2005) state that questioning and constructing one’s but before the searching processes. Such a prejudgment
own argument, utilized during decision making or learning seemed to prevent them from utilizing higher order learn-
processes, are closely related to metacognition and critical ing strategies. For example, a higher-order participant

13
Journal of Science Education and Technology

ignored the scientific information related to the advan- however, research questions of this study have solely
tages of agricultural pesticides, although she had an article focused on preservice science teachers. In this regard,
on this issue. When this situation was recalled during the results of this study cannot be generalized to all parts of a
stimulated recall interview, she stated that “My previous society in this form. The second, DL, as mentioned above,
knowledge, most likely, let me focus on just disadvan- has technical and socio-emotional dimensions in addition
tages.” It is obvious that these prejudgments blocked par- to cognitive aspects. However, within this study its cogni-
ticipants from activating their epistemic metacognition or tive aspects have been studied in detail. Therefore, results
epistemic thinking processes. Coherent results were also of this research have been limited in terms of technical and
observed among lower-order participants. For example, socio-emotional aspects of the concept. Finally, the data of
one of the lower-order participants stated that “I don’t this research completely comes from Turkish participants.
require justification of the knowledge provided by the text This situation seems as obstacle in terms of generalizing
because I have already known the effect of chemical mate- the results to other societies.
rials on human health as a preservice science teacher.” When it comes to the implications, the results of the
Similar findings were presented by previous researchers study presented evidence that preservice science teach-
who mostly called these prejudgments heuristics (Finu- ers’ DL is affected by their epistemological beliefs and
cane et al. 2000; Kahneman 2011). Therefore, individu- self-regulation skills. Therefore, DL-related theoretical
als seemed to examine their decision-making or learning frameworks should directly consider these additional vari-
processes by considering their prejudgments even if they ables. Digitally literate individuals are not only expected
held sophisticated epistemological beliefs. to hold technology-based information and skills but also
To sum up it seemed that participants’ previous beliefs should utilize digital technologies effectively in their
and experiences in both groups made them to hold into epis- learning processes when encountering socio-scientific
temic bias. This epistemic bias, then, caused them to take issues important to the era. Current literature has already
their decisions automatically and prevented them to benefit given clues about interrelationships between DL and cer-
from justification processes. This result is consistent with tain other variables related to cognition. These clues were
Kahneman’s (2011) thinking fast and slow processes. taken into consideration and evidenced with a scientific
perspective in the current study. In this regard, results have
shown that development of preservice science teachers’
Conclusions, Limitations and Implications DL can be ensured considering their self-regulation skills
and epistemological beliefs. That is, science teacher edu-
There were two research questions of this study. The first cators should consider that DL development of preservice
was related to investigating relationships among preser- science teachers cannot be realized independent from their
vice science teachers’ self-regulation skills, epistemologi- epistemological beliefs and self-regulation skills. There-
cal beliefs, and DL. The results and discussions presented fore, learning context of preservice teachers should be
above showed that these variables were interrelated. The updated in this direction. Therefore, it can be suggested
second research question was constructed to explicate the that individuals should be involved in inquiry-based and
reasons of these relationships. Analyses and discussions pre- argumentation-based learning mediums since these types
sented above showed that epistemological beliefs and self- of mediums contribute positively to the development
regulation skills filter preservice science teachers’ learning of epistemological beliefs and self-regulation skills. In
strategies. Also, their decision-making processes related inquiry-based and argumentation-based mediums, learn-
to conflict texts were affected by epistemic bias. As briefly ers construct their own claims, search on the knowledge
presented in theoretical framework of the paper, previous sources, and regulate their learning processes. Also, they
research findings have already shown micro relationships get a chance to develop their justification processes so
among preservice science teachers’ epistemological beliefs, their epistemological beliefs. These positive sides of such
self-regulation skills, and DL. However, this study modeled learning mediums can make also positive contributions
the relationships among these variables empirically and sup- to their DL. Additionally, individuals might be directed
ported its findings with qualitative research. In this regard, to reflect on their computer-supported learning processes
findings of this study contribute into scientific literature by because these reflections may provide them with strate-
clarification of DL with intimate relationships with these gies, such as monitoring and evaluating, which trigger the
variables. Briefly stated, this study examined relationships development of self-regulation skills. Finally, epistemic
of DL with self-regulation skills and epistemological beliefs bias should be studied in detail by following researchers.
comprehensively by quantitative and qualitative evidences. Such studies may contribute positively to future research
The research has three main limitations. The first is that conducted to protect people from the negative effects of
DL is a concept that is related to all citizens in a society; epistemic bias.

13
Journal of Science Education and Technology

Eshet Alkalai, Y. (2012). Thinking in the digital era: A revised model


for digital literacy. Issues in Informing Science & Information
Technology, 9, 267–276. Retrieved from http://conne​c tion​.
Compliance with Ethical Standards  ebsco ​ h ost.com/c/artic ​ l es/91273 ​ 7 10/think ​ i ng-digit ​ a l-era-
revis​ed-model​-digit​al-liter​acy
Conflict of Interests  The authors declare that they have no competing Ferguson, L. E., Bråten, I., & Strømsø, H. I. (2012). Epistemic cog-
interests. nition when students read multiple documents containing con-
flicting scientific evidence: A think-aloud study. Learning and
Ethical Statement  All procedures performed in studies involving Instruction, 22, 103–120.
human participants were in accordance with the ethical standards of Finucane, M. L., Alhakami, A., Slovic, P., & Johnson, S. M. (2000).
the institutional and/or national research committee and with the 1964 The affect heuristic in judgments of risks and benefits. Journal
Helsinki declaration and its later amendments or comparable ethical of Behavioral Decision Making, 13(1), 1–17.
standards. Fraenkel, J. R., & Wallen, N. E. (2009). How to design and evaluate
research in education. Boston: McGraw-Hill.
Consent Statement  Informed consent was obtained from all individual Greene, J. A., & Azevedo, R. (2009). A macro-level analysis of SRL
participants included in the study. processes and their relations to the acquisition of a sophisticated
mental model of a complex system. Contemporary Educational
Psychology, 34(1), 18–29.
Greene, J. A., Muis, K. R., & Pieschl, S. (2010). The role of epis-
temic beliefs in students’ self-regulated learning with computer-
References based learning environments: Conceptual and methodological
issues. Educational Psychologist, 45(4), 245–257.
Akyol, G., Sungur, S., & Tekkaya, C. (2010). The contribution of cog- Greene, J. A., Yu, S., & Copeland, D. Z. (2014). Measuring criti-
nitive and metacognitive strategy use to students’ science achieve- cal components of digital literacy and their relationships with
ment. Educational Research and Evaluation, 16(1), 1–21. learning. Computers & Education, 76, 55–69.
Atoy Jr, M. B., Garcia, F. R. O., Cadungog, R. R., Cua, J. D. O., Mangunay, Hammer, D., & Elby, A. (2002). On the form of personal epistemol-
S. C., & de Guzman, A. B. (2020). Linking digital literacy and ogy. In B. K. Hofer, & P. R. Pintrich (Eds.). Personal epistemol-
online information searching strategies of Philippine university ogy: The psychology of beliefs about knowledge and knowing
students: The moderating role of mindfulness. Journal of Librari- (pp. 169–190). Mahwah, NJ: Lawrence Erlbaum Associates.
anship and Information Science, 52(4) 1015-1027. Hofer, B. K., & Pintrich, P. R. (1997). The development of epis-
Güneş, E., & Bahçivan, E. (2018). A mixed research-based model for temological theories: Beliefs about knowledge and knowing
pre-service science teachers’ digital literacy: Responses to “which and their relation to learning. Review of Educational Research,
beliefs” and “how and why they interact” questions. Computers & 67(1), 88–140.
Education, 118, 96-106. Kahneman, D. (2011). Thinking, fast and slow. Macmillan.
Bahcivan, E. (2014). Examining relationships among Turkish pre- King, P. M., & Kitchener, K. S. (1994). Developing reflective judg-
service science teachers’ conceptions of teaching and learning, ment: Understanding and promoting intellectual growth and
scientific epistemological beliefs and science teaching efficacy critical thinking in adolescents and adults. Jossey-Bass Higher
beliefs. Journal of Baltic Science Education, 13(6), 870-882. and Adult Education Series and Jossey-Bass Social and Behav-
Barzilai, S., & Zohar, A. (2012). Epistemic thinking in action: Evalu- ioral Science Series. Jossey-Bass, 350 Sansome Street, San
ating and integrating online sources. Cognition and Instruc- Francisco, CA 94104–1310.
tion, 30(1), 39–85. Krippendorff, K. (2004). Content analysis: An introduction to its
Baxter Magolda, M. (1992). Knowing and reasoning in college: Gen- methodology (2nd ed.). Thousand Oaks, CA: Sage.
der-related patterns in students’ intellectual development. San Lin, T. J., & Tsai, C. C. (2017). Developing instruments concerning
Francisco: Jossey Bass. scientific epistemic beliefs and goal orientations in learning
Blau, I., Shamir-Inbal, T., & Avdiel, O. (2020). How does the pedagogi- science: A validation study. International Journal of Science
cal design of a technology-enhanced collaborative academic course Education, 39(17), 2382–2401.
promote digital literacies, self-regulation, and perceived learn- Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic Inquiry London.
ing of students? The Internet and Higher Education, 45, https​:// England: Sage Publications.
doi.org/10.1016/j.ihedu​c.2019.10072​2 List, A. (2019). Defining digital literacy development: An examina-
Buehl, M. M., & Alexander, P. A. (2006). Examining the dual nature tion of pre-service teachers’ beliefs. Computers & Education,
of epistemological beliefs. International Journal of Educational 138, 146–158.
Research, 45(1–2), 28–42. Martin, A. (2008). Digital Literacy and the “Digital Society”. In C.
Conley, A. M., Pintrich, P. R., Vekiri, I., & Harrison, D. (2004). Lankshear, & M. Knobel (Eds.). Digital Literacies: Concepts,
Changes in epistemological beliefs in elementary science students. Policies, and Practices (pp. 151-176). New York: Peter Lang.
Contemporary Educational Psychology, 29(2), 186–204. Mason, L., Boldrin, A., & Ariasi, N. (2010). Epistemic metacog-
Creswell, J. W. (2007). Qualitative inquiry and research design: nition in context: Evaluating and learning online informa-
Choosing among five approaches (2nd ed.). Thousand Oaks, CA: tion. Metacognition and Learning, 5(1), 67–90.
Sage. Mason, L., Ariasi, N., & Boldrin, A. (2011). Epistemic beliefs in
Creswell, J. W. (2008). Educational research: Planning, conducting action: Spontaneous reflections about knowledge and knowing
and evaluating quantitative and qualitative research. New Jersey: during online information searching and their influences on
Pearson. learning. Learning and Instruction, 21, 137–151.
Duncan, T. G., & McKeachie, W. J. (2005). The making of the moti- Mason, L., Scrimin, S., Tornatora, M. C., Suitner, C., & Moè, A.
vated strategies for learning questionnaire. Educational Psycholo- (2018). Internet source evaluation: The role of implicit asso-
gist, 40(2), 117–128. ciations and psychophysiological self-regulation. Computers &
Elby, A., & Hammer, D. (2001). On the substance of a sophisticated Education, 119, 59–75.
epistemology. Science Education, 85(5), 554–567.

13
Journal of Science Education and Technology

Muis, K. R. (2007). The role of epistemic beliefs in self-regulated Shevlin, M., & Miles, J. N. (1998). Effects of sample size, model speci-
learning. Educational Psychologist, 42, 173–190. fication and factor loadings on the GFI in confirmatory factor
Muis, K. R. (2008). Epistemic profiles and self-regulated learning: analysis. Personality and Individual Differences, 25(1), 85–90.
Examining relations in the context of mathematics problem solv- Stathopoulou, C., & Vosniadou, S. (2007). Conceptual change in phys-
ing. Contemporary Educational Psychology, 33(2), 177–208. ics and physics-related epistemological beliefs: A relationship
Muis, K. R., & Franco, G. M. (2009). Epistemic beliefs: Setting the under scrutiny. In S. Vosniadou, A. Baltas, & X. Vamvakoussi
standards for self-regulated learning. Contemporary Educational (Eds.), Reframing the conceptual change approach in learning
Psychology, 34(4), 306–318. and instruction (pp. 145–163). New York: Elsevier.
Muis, K. R., Pekrun, R., Sinatra, G. M., Azevedo, R., Trevors, G., S
​ trømsø, H. I., & Bråten, I. (2010). The role of personal epistemology
Meier, E., & Heddy, B. C. (2015). The curious case of climate in the self-regulation of internet-based learning. Metacognition
change: Testing a theoretical model of epistemic beliefs, epistemic and Learning, 5(1), 91–111.
emotions, and complex learning. Learning and Instruction, 39, Tabachnick, B. G., & Fidell, L. S. (2013). Using Multivariate Statistics,
168–183. Ed. 6th Pearson Education. Inc, Boston.
Ng, W. (2012). Can we teach digital natives digital literacy? Computers Tsai, P. S., Tsai, C. C., & Hwang, G. J. (2011). The correlates of Tai-
& Education, 59(3), 1065–1078. wan teachers’ epistemological beliefs concerning internet environ-
Nussbaum, E. M., & Bendixen, L. D. (2003). Approaching and avoid- ments, online search strategies, and search outcomes. The Internet
ing arguments: The role of epistemological beliefs, need for cogni- and Higher Education, 14(1), 54–63.
tion, and extraverted personality traits. Contemporary Educational Walraven, A., Brand-Gruwel, S., & Boshuizen, H. P. (2009). How
Psychology, 28(4), 573–595. students evaluate information and sources when searching the
Palmer, B., & Marra, R. M. (2008). Individual Domain-Specific Epis- World Wide Web for information. Computers & Education, 52(1),
temologies: Implications for Educational Practice. In M. S. Khine 234–246.
(Ed.). Knowing, Knowledge and Beliefs: Epistemological Studies Yerdelen, S., & Sungur, S. (2019). Multilevel investigation of students’
across Diverse Cultures (pp. 325-350). Dordrecht: Springer. https​:// self-regulation processes in learning science: Classroom learning
doi.org/10.1007/978-1-4020-6596-5_16 environment and teacher effectiveness. International Journal of
Perry, W. G. (1970). Forms of intellectual and ethical development Science and Mathematics Education, 17(1), 89–110.
in the college years: A scheme. New York: Holt, Rinehart & Yilmaz-Tuzun, O., & Topcu, M. S. (2008). Relationships among pre-
Winston. service science teachers’ epistemological beliefs, epistemological
Pieschl, S., Stahl, E., & Bromme, R. (2008). Epistemological beliefs world views, and self-efficacy beliefs. International Journal of
and self-regulated learning with hypertext. Metacognition and Science Education, 30(1), 65–85.
Learning, 3(1), 17–37.
Pintrich, P. R., & De Groot, E. V. (1990). Motivational and self- Publisher’s Note Springer Nature remains neutral with regard to
regulated learning components of classroom academic perfor- jurisdictional claims in published maps and institutional affiliations.
mance. Journal of Educational Psychology, 82(1), 33–40.
Pintrich, P. R., Smith, D. A. F., García, T., & McKeachie, W. J. (1993).
Reliability and predictive validity of the Motivated Strategies for
Learning Questionnaire (MSLQ). Educational and Psychological
Measurement, 53, 801–813.
Schommer, M. (1990). Effects of beliefs about the nature of knowledge
on comprehension. Journal of Educational Psychology, 82(3),
498.

13

View publication stats

You might also like