Professional Documents
Culture Documents
A Blended Learning Exercise Physiology Theory Module That Supports Studentautonomy and Improves Academic Performance
A Blended Learning Exercise Physiology Theory Module That Supports Studentautonomy and Improves Academic Performance
A Blended Learning Exercise Physiology Theory Module That Supports Studentautonomy and Improves Academic Performance
TEACHING INNOVATIONS
Abstract
A limited number of studies have explored the impact of blended exercise physiology theory curricula on student learning and
experience. This study aimed to investigate the impact of an exercise physiology blended learning theory module on student
performance, engagement, and perceptions. The module, which comprised a range of elements (student guide, lecturer-
recorded videos, supplementary videos, formative quizzes, workshops, and discussion forum), was implemented in a third-year
subject taken by students in nonspecialist undergraduate science, technology, engineering, and mathematics (STEM) degrees.
Students chose which elements to engage with to support their learning. Exam performance was assessed by comparing exam
marks from fully face-to-face delivery to the blended delivery with an independent t test. Student perceptions were determined
via an end-of-module questionnaire comprised of Likert-scale questions and open-ended questions. Descriptive statistical analy-
sis was conducted on the Likert-scale responses, and qualitative content analysis was conducted on the open-ended responses.
Student engagement with online resources was determined through analysis of access statistics from the learning management
system. Student exam marks in the blended learning student group were significantly higher (P < 0.0001) than in the face-to-
face group, even though the questions were of a higher Bloom’s level in the blended learning group. Students preferred
blended delivery over fully face-to-face delivery. Most students accessed the student guide, lecturer-recorded videos, and
quizzes, with supplementary videos, workshops, and discussion forums accessed by fewer students. In conclusion, a blended
exercise physiology theory module improved student exam performance and was positively perceived by students, and engage-
ment with the elements of the module was varied.
NEW & NOTEWORTHY Few studies have explored the impact of blended delivery of exercise physiology theory curricula on
student learning and experience. This study investigated the impact of a novel blended model on student learning and experi-
ence. The module comprised a range of elements (student guide, lecturer-recorded videos, supplementary videos, formative
quizzes, workshops, and discussion forum), where students were able to choose which elements to engage with to support their
learning.
and Daniels (7) found that lecture attendance was only 1 of recent years, there have been limited studies on student
16 significant predictors of academic performance among learning and perceptions of blended exercise physiology
nursing students. With little correlation, and generally fall- theory curricula. McFarlin (22) replaced a traditional exer-
ing lecture attendance in the digital age, where lectures are cise physiology theory course comprised of face-to-face
recorded and can be accessed anytime, it is little surprise lectures with a blended course format (combination of
that other teaching options have emerged. recorded online and face-to-face lectures) and found that
Blended learning is becoming a standard delivery option students’ final grades were higher in the blended format
and, for many, is a “best of both worlds” model that com- compared with traditional delivery. The traditional format
bines the most effective aspects of face-to-face and online comprised two 1.5-h weekly face-to-face lectures, whereas
teaching (8). Blended learning refers to methods that com- the blended format comprised a weekly 1.5-h recorded
bine different learning theories and media types (9) and online lecture providing basic information and incorpo-
practices with varying proportions and sequences of face-to- rating an assessable quiz, followed by an in-class lecture
face and online activities (10). The purported benefits of (1.5 h) providing more advanced material and using audi-
blended learning include that it is an effective pedagogy (11– ence-response technology. Informal student feedback
13), requires active learning and is more student centered from course evaluations showed that students studying in
than traditional lectures (14, 15), is cost effective (13), pro- blended format preferred the self-paced nature and the
vides flexibility for learners (13, 16) and control over the ability to review content as frequently as they wanted (22).
time, place, path, or pace of learning (17), allows interaction To our knowledge, no studies have been published on
between staff and students (18), ensures student interaction blended exercise physiology curricula that have been pur-
and learner engagement (19), and is valuable for different posefully designed to include a range of elements where
types of learners (20). The incorporation of online technol- students have the autonomy to choose which elements to
ogy into physiology subjects has been found to enhance the engage with to support their learning.
student experience and produce student learning outcomes Therefore, we developed and implemented an exercise
at least equal to those attained in traditionally delivered physiology blended theory module comprised of a range of
physiology courses (21–25). Blended learning allows instruc- elements (student guide, lecturer-recorded videos, supple-
tors to incorporate a range of online tools to support learn- mentary videos, formative quizzes, workshops, and discus-
ing, including quizzes, chat sessions, and forums, which sion forum) for third-year undergraduate students in
may better suit the needs of a diverse student population (12) nonspecialist health-related science, technology, engineer-
and this generation of students. ing, and mathematics (STEM) degrees.
The increased control over their own learning that stu- The objectives for this study were to determine
dents report as a benefit of blended learning results from the 1) The impact of teaching exercise physiology theory in
increased student autonomy associated with this approach. blended mode compared with fully face-to-face on stu-
A model that requires students to be less dependent on dent exam performance
teachers is more likely to foster self-management and self- 2) Student perceptions of an exercise physiology blended
reliance skills that will be valuable in the world of work and theory module
for life-long learning (26). If students are not given opportu- 3) Student engagement with the online resources in an
nities to make decisions about their own learning, including exercise physiology blended theory module.
about their learning needs and activities, they are less likely
to develop skills in planning and organizing (26). A range of
terms are used to describe approaches designed to have stu-
METHODS
dents take greater responsibility for their own learning, Participants and Context
including self-directed learning, learner-controlled instruc-
tion, and participatory learning (27). According to self-deter- The exercise physiology theory module was embedded
mination theory (SDT), autonomy is one of the three innate into a final-year Human Physiology core subject in the
psychological needs proposed to enhance intrinsic motiva- Human Physiology and Anatomy major. Human physiology
tion, self-regulation, and well-being (28). Students who feel refers to the study of how the human body works and is
autonomous are more likely to see the value in learning tasks focused on the chemistry and physics underpinning basic
and therefore be more engaged in the activity (29, 30). For body functions, from how molecules behave in cells to how
students to successfully engage in blended learning, they organs and body systems function. Exercise physiology is
require several self-regulation skills including organization, the study of the body’s responses to physical activity, and
discipline, time management, skill in using technologies to this can include acute responses to exercise such as
support their learning, and self-efficacy to control their increased energy use, heart rate, and breathing rate or adap-
learning (31). In their systematic review, Rasheed and col- tations to chronic exercise such as increased muscle mass
leagues (32) identified self-regulation as one of the most and improved cardiorespiratory fitness. Human and exercise
common challenges identified by students undertaking physiology are topics relevant to students in a range of
blended/online learning. Therefore, as educators work to- degrees. The topics covered in the modules are shown in
ward contemporary teaching practices, it is important to Table 1, along with relevant chapters from the prescribed
consider the extent to which the resulting environments pro- text (33). Between 2010 and 2019, 968 students were enrolled
mote autonomous learning. in the subject, comprising 67% enrolled in the Bachelor of
Although blended learning in higher education has Health Sciences, 20% in Biomedical Science, 9% in Human
received a great deal of attention in the literature over Nutrition, and 4% in other science degrees. Students in
Table 1. Exercise physiology topics covered in traditional the subject learning management system (LMS) site. LMS
and blended modules, relevant textbook chapters from also housed the subject guide, which included intended
Exercise Physiology: Theory and Application to Fitness learning outcomes for each topic, copies of the PowerPoint
and Performance (33), and lecturer-recorded video slides used in lectures, and a forum for discussion and ques-
duration tions. The lecture notes and forum were available to students
on the LMS 2 wk before semester beginning, and lecture
Topic Video Duration
recordings were made available shortly after the live lecture
Introduction to Exercise and Health 4 min 56 s concluded.
Bioenergetics (Chapter 3)
Overview 27 min 56 s
Overview of anaerobic and aerobic metabolism 4 min 23 s
Blended module (2014–2019).
Anaerobic metabolism 9 min 56 s Using a constructivist approach (34), we transformed the tra-
Aerobic metabolism 19 min 49 s ditional delivery into a contemporary curriculum comprised
Glucose and energy 8 min 52 s of a 5-wk blended theory module delivered over weeks 1–5
Lipids, protein, and energy 12 min 10 s during a 12-wk semester. With the curriculum redesign we
Sporting events and aerobic/anaerobic energy
contributions 3 min 6 s attempted to provide a more flexible curriculum for stu-
Exercise Metabolism (Chapters 4 and 13) dents, one that developed important skills (such as self-man-
Skeletal muscle fiber types 4 min 14 s agement) expected of science graduates to help prepare
Oxygen consumption and excess postexercise them to solve challenges of the twenty-first century and for
oxygen consumption (EPOC) 18 min 23 s
life-long learning.
Maximal oxygen consumption (V_ O2max) 9 min 4 s
Lactic acid 12 min 43 s The module incorporated a comprehensive range of ele-
Estimation of fuel use during exercise 2 min 57 s ments (see below) to support learning and give students flex-
Exercise intensity and fuel selection 10 min 16 s ibility and choice/autonomy regarding how and when they
Skeletal Muscle: Endurance Exercise Adaptations learn. The module was made available on the LMS before the
(Chapters 8 and 13)
Homeostasis, endurance training, and skeletal 10 min 30 s start of semester and introduced in the week 1 face-to-face in-
muscle fiber types in athletes troductory lecture (recorded and available for viewing on the
Endurance training-induced adaptations 18 min 10 s LMS). Students were told how the module worked, including
Significance and molecular basis of adaptations 7 min 32 s that workshop attendance, quiz completion, and forum posts
Thermoregulation (Chapter 12)
were not mandatory. The student guide, lecturer recordings,
Temperature homeostasis and heat loss during
exercise 13 min 59 s supplementary videos, quizzes, and forum were available to
Heat acclimatization 6 min 45 s students on the subject LMS site 2 wk before semester begin-
Circulatory Adaptations to Exercise (Chapter 9) ning, workshops were held in weeks 1–4, and the exam was
Cardiovascular control during exercise 5 min 9 s held in week 5.
Regulation of muscle blood flow during exercise 12 min 44 s
Comparison of trained and untrained individuals 6 min 52 s Student guide. A comprehensive guide was provided to
Double product 3 min 6 s students, which set out the module requirements, topics cov-
Arm versus leg and prolonged exercise 4 min 32 s ered and intended learning outcomes for each, suggested
Respiration and Exercise (Chapter 10) schedule for completing the module, available resources,
Respiratory control during submaximal exercise 3 min 34 s
Ventilatory responses to incremental exercise 10 min
assessment details, and copies of PowerPoint slides used in
Training-induced changes to the ventilatory lecturer-recorded videos.
response 1 min 24 s Lecturer-recorded videos. Recordings of narrated Pow-
Links Between Skeletal Muscle and Systemic erPoint slides were created by one of the authors (L.L.), an
Physiology (Chapter 13) 9 min 48 s experienced lecturer in exercise physiology, with Camtasia
(Camtasia Studio 8, Camtasia 9, and Camtasia 2018;
TechSmith, Okemos, MI) software. The videos incorporated
2010–2013 cohorts experienced traditional delivery via face-
images from the prescribed textbook. All 28 videos had the
to-face lectures, and students in 2014–2019 cohorts experi-
same PowerPoint template and style, to provide a sense of
enced the blended curriculum. To determine the impact of
the blended delivery on student learning, exam performance
was compared between groups as described below.
In 2019, 99 students were enrolled in the subject, with 95% Table 2. Details of exercise physiology questions in end-
enrolled in the Bachelor of Health Sciences and 5% in of-semester exam (2010–2013) and end-of-module exam
Biomedical Sciences, and were provided a questionnaire to (2014–2019)
assess their perceptions of the blended design as described Traditional Module Blended Module
below. 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019
cohesion. Each video ended with a direction to an associated We used a mixed-methods concurrent triangulation
formative and optional quiz (except for the first and last vid- design to determine student perceptions of the module and
eos) and reference to the next video or topic. Students were student engagement. In this design, a researcher collects and
referred to supplementary videos at appropriate points analyses quantitative (numeric) and qualitative (text) data
within the recordings. There was a total of 4 h and 20 min of concurrently (40). The rationale for this approach is to
videos, and consistent with recommendations of Kaya (35) attempt to confirm, cross-validate, or corroborate findings
and Mason and colleagues (36) all but one video were under within a single study, resulting in well-validated and sub-
20 min, with an average length of 9.5 min (range 1.4 to 27.9 stantiated findings (40).
min). To address the aims of the study, a range of data sources
Supplementary videos. Eighteen non-teacher-recorded were analyzed. Student performance was determined from
videos were available via links on the LMS site to supplement exam marks (2010–2019). Student perceptions of the blended
the teacher-recorded videos. These videos were freely avail- model were determined from analysis of completed student
able through YouTube and included animations describing questionnaires by the 2019 cohort. Student engagement with
physiological processes such as glycolysis and gas diffusion, module resources by the 2019 cohort was determined from
recordings of maximal oxygen consumption tests, and foot- the LMS access data. The study was conducted with approval
age of athletes competing in extreme temperatures. These of the institution’s Human Research Ethics Committee (HEC
did not include links to videos or channels that provided in- 18/107). A waiver of consent was provided for retrospective
depth physiological explanations. analysis of data.
Quizzes. Twenty-six optional formative quizzes for im-
mediate feedback on learning were available on the LMS. Exam performance.
The questions were a range of multiple-choice, true/false, Student performance was determined by evaluating exam
and matching questions and were designed to test content marks. Performance on end-of-semester exams following
knowledge and its application. There was a total of 166 quiz the traditional module (2010–2013) was compared to per-
questions, with an average of 6.4 questions (range 1 to 19 formance on end-of-module exams following the blended
questions) per quiz. Quiz answers were available once the module (2014–2019) with independent t tests. v2 tests of
quiz was completed by an individual student. Students could independence were used to examine the relationship
attempt each quiz an unlimited number of times, and between module mode (traditional or blended) and exam
attempts were not time limited. pass rates and the spread of grades.
Workshops. One 2-h workshop was held per week for the
first 4 wk of the module. The workshops were designed to Exam questions.
consolidate learning of concepts delivered in the videos. No For determination of the level of difficulty, all exam questions
new concepts were introduced, and no assessment was com- from 2010 to 2019 were mapped by two physiology academics
pleted in the workshops. In the first hour multiple-choice from another university (authors K.T., A.H.) against Bloom’s
questions were discussed, with students answering ques- taxonomy (41) levels (knowledge, comprehension, applica-
tions anonymously via an audience-response system, and in tion, analysis, synthesis, evaluation). Each academic mapped
the second hour open-ended case study scenarios were dis- individually and then met to discuss and reach consensus on
cussed. Incorporating audience-response systems allows questions mapped to different Bloom’s levels. There was
instructors to gauge student understanding and identify mapper variability for 30% of the questions. For each exam,
areas that are confusing or difficult for students (22, 37). the overall percent contribution from each Bloom’s level was
Questions covered in the workshop (but not answers) were determined and comparisons made between groups (tradi-
posted to the LMS after the workshops. tional vs. blended mode) with an independent t test.
Exam. Student learning was assessed in an invigilated
multiple-choice exam held upon completion of the module, Questionnaire.
in week 5 of the semester. Practice questions were provided At the end of the blended module in 2019, 99 students were
to students. invited to complete a paper-based questionnaire comprised
The formats of the exams between 2010 and 2019 are of 29 questions, including 5-point Likert-scale and open-
explained in Table 2. Two types of multiple-choice questions ended questions (see Supplemental Material, available at
were used: type A and type K (38). Type A questions consist of https://doi.org/10.26181/17134238). Three Likert scales were
the stem and five options, one of which is correct or the best used to assess students’ level of agreement (strongly dis-
answer. Type K questions consist of the stem and four options, agree, disagree, neutral, agree, strongly agree), ratings of
one or more of which is correct. Examinees are required to confidence (very low, low, medium/adequate, high, very
respond using the following code: select A if options 1, 2, and 3, high), and ratings of importance (not at all important, not
are correct; B if 1 and 3 are correct; C if 2 and 4 are correct; D if too important, neutral, somewhat important, very impor-
only 4 is correct; and E if all four options are correct. tant). The questionnaire was administered after the end-of-
module exam, and students were assured that this was a vol-
Study Design and Data Analysis
untary activity, with no incentives offered, and had no bear-
We used a longitudinal time series design (39) to determine ing on their marks. The questionnaire was completed by 67
the impact of the blended module on student learning. The students, which is a response rate of 68%. Descriptive statis-
time series design involves a series of measurements at periodic tical analysis was conducted on the quantitative data, and
intervals, usually to measure the impact of a specific change qualitative content analysis (42) was conducted on the
that occurs at some point during those measurements (39). responses to the open-ended questions.
Figure 1 presents the average percentage of exam questions Module curriculum scaffold.
categorized as knowledge, comprehension, and application for Students were asked to rate the relative importance of each of
the end-of-semester exams (traditional format, 2010–2013) the elements of the curriculum scaffold for supporting their
and the end-of-module exams (blended format, 2014–2019). learning (Fig. 2). Most students perceived that the student
There were no questions categorized as analysis, synthesis, or notes, lecturer-recorded videos, and formative quizzes were
evaluation. There were significantly more (P = 0.05) knowl- “very important” to their learning. Students most rated the
edge questions in 2010–2013 (69.5%) compared with 2014– learning objectives, supplementary videos, and workshops as
2019 (59.9%). There were no significant differences between “somewhat important.” Over half of students rated the LMS
traditional and blended formats for percentage of comprehen- forums as “not too important.” At least 10% of students rated
sion and application questions, although if these were grouped each element of the curriculum scaffold as “very important.”
Table 3. Student performance on traditional module (end of semester) and blended module (end of module) multi-
ple-choice exams
Traditional Module Blended Module
2010 2011 2012 2013 2010–2013 2014 2015 2016 2017 2018 2019 2014–2019
Enrollment 63 115 97 82 337 77 120 113 108 92 98 608
Mean mark 72.3 67.8 70.7 58.1 67.2 73.5 76.8 79.5 76.6 73.0 70.6 75.3
SD 16.5 14.8 13.4 15.0 15.6 14.8 15.2 15.1 13.5 13.5 17.0 15.2
Median mark 72.7 69.2 70.0 55.0 69.2 72.7 78.3 83.3 78.0 72.0 72.0 77.3
Minimum 18.2 23.1 40.0 30.0 18.2 36.4 30.0 30.6 34.0 44.0 26.0 26.0
Maximum 100.0 92.3 95.0 90.0 100.0 100.0 96.7 100 100.0 98.0 96.0 100.0
A (>79.49%), % 45.9 24.8 29.5 9.3 26.4 39.0 50.0 58.4 48.1 39.1 38.8 53.9
B (>69.49%), % 21.3 16.8 35.2 20.0 23.1 23.4 20.8 16.8 25.9 21.7 17.3 17.9
C (>59.49%), % 11.5 33.6 20.5 20.0 23.1 18.2 15.8 12.4 14.8 25.0 20.4 15.1
D (>49.49%), % 14.8 15.9 8.0 25.3 15.7 13.0 8.3 8.8 6.5 8.7 11.2 7.6
N (<49.90%), % 6.6 8.8 6.8 25.3 11.6 6.5 5.0 3.5 4.6 5.4 12.2 5.4
Pass rate, % 93.4 91.2 93.2 74.7 88.1 93.5 95.0 96.5 95.4 94.6 87.9 93.8
Significantly higher than 2010–2013 (P < 0.0001).
Table 4. Themes that emerged from student responses (49 students) to the open-ended question “What was the
main reason for your preference for content delivery mode?”
Students Who Preferred Combined Face-to-Face and Online Theory Delivery (39 respondents, 44 reasons)
Can ask questions in workshops (36.4%) Having face to face is helpful for revision and to ask any questions.
Able to get feedback from face-to-face workshop. Can get the answers for my queries immediately.
Can learn at own pace (15.9%) Allows you to work at your own pace.
I like to go at my own pace at home with the online content
Best of both worlds (13.6%) I like the way this subject was designed to have the online content and then clicker questions as a
workshop to check your knowledge and ask questions.
Good balance.
Fits into schedule better (13.6%) Good to have the videos so you can work it around life etc. & rewatch, pause, etc.
I liked watching lectures online as it made it easier for me to work & then study in my own time.
Students Who Preferred Online Theory Delivery (8 respondents, 11 reasons)
Can learn at own pace (54.5%) I can learn the content at my own pace.
Study, prepare at my pace.
More accessible (18.2%) Can access anywhere.
Can pause and replay recordings (18.2%) I find it useful to be able to rewatch videos and lectures & then write notes.
Students Who Preferred Face-to-Face Theory Delivery (2 respondents, 2 reasons)
Immediate feedback (50%) Question can be answered on the spot.
Time management (50%) I leave online until 2 days before assessment.
Students could list >1 reason. Exemplar quotes are provided for each theme. Percentage indicates frequency of comments on this
theme.
Table 5. Themes that emerged from student responses (58 students) to the open-ended question “What was the
main reason for your preference of exam timing?”
Students Who Preferred In-Semester Exam (50 respondents, 78 reasons)
Less stressful (23.1%) Less stress at the end of semester
Places a lot of pressure at the end of semester–becomes overwhelming
Less content to learn (14.1%) Module exams allow me to focus on remembering and understanding smaller
chunks of knowledge.
Chance to learn & memories [sic] one particular topic at a time
Promotes learning (12.8%) Can learn and process sufficient information
Better opportunities to consolidate information
Students Who Preferred End-of-Semester Exam (6 respondents, 10 reasons)
Need more time to study (40%) Exams during the semester do not provide much time to revise.
The middle of the semester is very soon to learn and then be tested.
Clashes with other deadlines (30%) We had a lot of things due in week 5.
There are also a lot more assessments.
Students could list >1 reason. Exemplar quotes are provided for each theme. Percentage indicates frequency of comments on this
theme.
score (Fig. 7), suggesting that their engagement level mod- Student Performance
erately contributed to their performance.
Student exam performance was significantly higher with
Quizzes. the blended module compared with traditional delivery via
Most (66–92%) students attempted the quizzes, with attempts face-to-face lectures. Similarly, McFarlin (22) reported a sig-
decreasing over the course of the module (Fig. 5). Forty-four nificant increase in students’ exercise physiology grades
percent (44.4%) of students attempted all 26 quizzes at least when studying in blended format compared with tradi-
once, and 5.1% of students attempted no quizzes. Six students tional delivery. Our findings are further supported by a
had >80 quiz attempts, with one student having 134 quiz meta-analysis that found that blended learning better facil-
attempts. Analysis of final scores on the formative quizzes itates student learning, compared with traditional delivery,
shows that 66% of quiz attempts resulted in a score of 100%. in STEM disciplines (43). Analysis of the exam questions in
Seven percent (7.1%) of students received a score of 100% for the present study revealed a significantly higher proportion
all quizzes. of questions in the traditional module exams that assessed
Most engagement with quizzes occurred in week 5 (61.2%), knowledge, the lowest Bloom’s level, indicating that the
followed by week 2 (11.4%; Fig. 4). exams for the traditional module were somewhat easier
There was a weak, statistically significant (r = 0.21, P = 0.04) than the exams for blended delivery. Therefore, the nature
correlation between the number of times students attempted of the assessment questions cannot explain the improve-
quizzes and their exam score (Fig. 8), suggesting that their ment in student performance. In the present study, stu-
level of engagement with quizzes weakly contributed to their dents overwhelmingly preferred an exam taken upon
performance. completion of the module (as in our model) that assesses
only that module’s content over a final exam completed at
Workshops. the end of semester. Students who preferred module exams
Workshop attendance declined over the 4 wk: 90, 31, 24, and reported experiencing less stress and thought module
11 students attended in weeks 1, 2, 3, and 4, respectively. exams were better for learning. A negative correlation has
been observed between anxiety and academic achieve-
Discussion forum. ment, that is, low anxiety appears to be related to high
There was a total of six forum threads and 13 posts made, grades and vice versa (44). Students with high anxiety find
seven by students and six by staff. Five of the threads studying difficult, have impaired thought processes and
were initiated by students, and the nature of the posts problem-solving, spend less time on tasks, and are more
were physiology questions (2 posts), request for addi- easily distracted than students with low anxiety (44).
tional resources (2 posts), staff announcements (1 post), Therefore, holding the exam during the semester rather
and technical issues (1 post). The forum was viewed 239 than at the end may contribute to improved student per-
times by 45.5% of students. formance through reduction in stress.
Learning objectives
Student notes
Lecturer-recorded videos
Supplementary videos
Figue 2. Student ratings of importance of
elements of the curriculum.
Quizzes
Workshops
Forums
0 10 20 30 40 50 60 70 80 90 100
Not at all important Not too important Somewhat important Very important
studies, students in the present study who preferred online that inclusion of a range of elements would result in a model
theory delivery appreciated learning at their own pace (17, that catered for a student population with diverse learning
22, 45–47) and the independence and control (48) this mode styles and preferences (48). That students did not rate all ele-
allows. Students preferred face-to-face workshops because ments of the module as being important or did not engage
they provided an opportunity to ask questions. This is con- with each was not cause for concern. It is possible that our
sistent with Boelens and colleagues’ (10) identification of approach did not fully model and guide students into effec-
workshops as an instructional activity important for adjust- tively using the full range of module elements to engage
ing the learning process through provision of feedback and actively or highlight the way past students had used the ele-
clarification (see below for further discussion of workshops). ments successfully (50). The natural outcome of purpose-
A minority of students preferred face-to-face theory delivery fully designing a module that has optional support elements
because they felt that regular, timetabled classes better scaf- attractive to a diverse cohort is that students exercise their
folded their learning. This is consistent with the findings of autonomy and make use of the resources that they feel are of
Rasheed and colleagues (32), who found that self-regulation benefit to their learning and disregard others. Shifting to-
is one of the bigger challenges facing students learning in ward more flexible blended models may require academics
blended mode, with students struggling to organize and to reconceptualize their notions of their role in student
manage their studies independent of their instructor. learning and what student engagement looks like.
Blended learning provides students with freedom to learn at
Our Model—Instructional Activities to Assist Regulation
their own pace and more flexibly, but the risk is that this
of Learning
freedom can result in students adopting poor self-regulation
behavior (32). Our model could be improved by incorpora- Our blended learning model was designed to provide stu-
tion of activities and discussions that discuss self-regulation dents with more flexibility and autonomy than was possible
behavior and stimulate students to focus on improving these with the previous traditionally delivered model. More student
skills (32). This has benefits beyond greater success with a autonomy means that students’ ability to self-regulate their
blended module, as self-regulation is an essential skill for learning becomes essential for success (10). Vermunt and
STEM graduates (45, 49). Verloop (51) developed a framework of instructional activities
Results indicate that all aspects of our model were deemed to assist students in regulating their learning, with activities
very important by segments of the student cohort. This find- falling into four categories: orienting and planning, monitor-
ing is consistent with those of Scagnoli and colleagues (48) ing, adjusting, and evaluating. Below we discuss the elements
and Shang and Liu (45), who found that undergraduate stu- of our model with reference to this framework. Our model
dents found that a range of instructional activities, including incorporated instructional activities from each category,
quizzes, video lectures, and interactive activities, influenced which we believe contributed to its success in terms of stu-
their learning in online and blended subjects. We believed dent learning and perceptions.
Table 6. Themes that emerged from student feedback the student guide at the beginning of a subject and subject
regarding the reasons for not attending workshops achievement. Reading the guide provided students with
knowledge of important events in advance, which allows
Workshop Information/Resources Were Available Online (21.6%) them to regulate their studies and participate in learning
Content was online.
Clicker sessions were online. activities. We did not include instructional activities to mea-
Other Commitments (21.6%) sure prior knowledge or familiarize learners with technology,
Focusing on other assessments although these could be incorporated in the future. The
Work commitments module in its 2019 format made use of technology that stu-
Class clashes
dents in our cohort had extensive experience with before our
Workshops Not Needed (13.5%)
Full understanding of topic module, that is, the LMS, YouTube, and an audience-
Info was included on the videos. response system. Familiarization could benefit students in
earlier year levels or could be developed and added to the
Exemplar quotes are provided for each theme. Percentage indi-
cates frequency of comments on this theme. Thirty-one students scaffold as a refresher.
responded, and 37 total reasons were provided.
Lecturer-recorded and supplementary videos.
Introductory lecture and student guide. Students perceived that the lecturer-recorded videos were
Through the face-to-face introductory lecture in the first the equal most important elements of the module along with
week of the module and provision of a comprehensive stu- formative quizzes. Most students accessed the lecturer-
dent guide, our model incorporates two of the four instruc- recorded videos, with most engagement in weeks 1, 2, and 5
tional activities relating to the orientation and planning (exam week) of the module. Past research has found that stu-
phase identified by Boelens and colleagues (10) in their dents were highly satisfied with video lectures (48, 54–56)
review, communicating organizational information and and perceived that videos enhance their engagement and
communicating expectations. The lecture provided stu- provide additional learning opportunities while increasing
dents with an overview of the structure of the module, motivation (57). The presence of the instructor, via video
topics to be covered, resources available, timing of work- and/or audio, has consistently been found to be important
shops and assessment, and expectations of students; such for perceived learning and satisfaction (58). Students feel a
a session is commonly used in blended modules (10). teaching and social presence through lecturer-recorded vid-
Consistent with other blended modules (52), our student eos, and feeling a connection with the instructor increases
guide included this introductory and summary informa- their engagement (59) and learning (60). Scagnoli and col-
tion in written format and included learning objectives, a leagues (48) found that graduate students had a slightly
suggested weekly schedule for navigating the module, and higher perception of learning impact of video lectures than
printouts of the PowerPoint lecture notes. You (53) found a undergraduates, suggesting that differences may exist based
weak but statistically significant relation between reading on education level and our findings may not be replicated in,
700
Access/attemt number
600
500
Workshop 1
Workshop 2
Workshop 3
Workshop 4
400
300
200
Exam
100
0
01-Apr-19
02-Apr-19
03-Apr-19
04-Apr-19
05-Apr-19
18-Feb-19
19-Feb-19
20-Feb-19
21-Feb-19
22-Feb-19
23-Feb-19
24-Feb-19
25-Feb-19
26-Feb-19
27-Feb-19
28-Feb-19
01-Mar-19
02-Mar-19
03-Mar-19
04-Mar-19
05-Mar-19
06-Mar-19
07-Mar-19
08-Mar-19
09-Mar-19
10-Mar-19
11-Mar-19
12-Mar-19
13-Mar-19
14-Mar-19
15-Mar-19
16-Mar-19
17-Mar-19
18-Mar-19
19-Mar-19
20-Mar-19
21-Mar-19
22-Mar-19
23-Mar-19
24-Mar-19
25-Mar-19
26-Mar-19
27-Mar-19
28-Mar-19
29-Mar-19
30-Mar-19
31-Mar-19
Guides L-R Video accesses Supp video accesses Quiz attempts Forums
Figure 4. Engagement with module elements over 7 wk of the blended module. Gray lines indicate start of weeks starting on Monday; gray shading indi-
cates workshop day (weeks 1–4) or exam (week 5).
100
80
70
60
50
20
10
0
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
Video/quiz number
for example, first-year university students. Not all students repeat information or contain information they could read in
in the present study appear to have accessed all lecturer- a textbook. For some students in the present study, the sup-
recorded videos. A positive relation has been observed plementary videos may have provided a refresher on a topic
between satisfaction with video lectures and the number of (e.g., mechanics of breathing) or a further illustration of a
videos viewed (48), and it is possible that students in the point (e.g., a recording of an athlete experiencing heat exhaus-
present study who were not satisfied with video lectures (i.e., tion), whereas others who remembered the background or
the minority who reported a preference for face-to-face understood the point while watching the lecturer-recorded
theory delivery) may have watched fewer videos. video may have seen these as repetitive and made the practi-
The supplementary videos were valued by some students cal choice to not engage with them (48).
who appear to have appreciated the animations, background,
and additional examples provided, and engagement with Quizzes.
these videos did significantly correlate with performance. The inclusion of optional, online formative quizzes that
Scagnoli and colleagues (48) found that students valued vid- accompanied teacher-recorded videos supports both the moni-
eos that introduced and reinforced knowledge and connected toring phase, through formative teacher assessment, and the
with class content and activities but not those thought to adjusting phase, through provision of feedback (10). Quizzes
100 100
90 90
80 80
70 70
Exam score (%)
Exam score (%)
60 60
50 50
40 40
30 30
20 20
10 10
0 0
0 20 40 60 80 100 120 140 0 5 10 15 20 25 30 35 40
Number of times lecturer-recorded videos accessed Number of times supplementary videos accessed
Figure 6. Weak correlation between number of times students accessed Figure 7. Moderate correlation between number of times students
lecturer-recorded videos and their exam score. Statistically significant, r = accessed supplementary videos and their exam score. Statistically signifi-
0.37, P < 0.001. cant, r = 0.46, P < 0.001.
60
ceed, and one of the reasons students gave for not attending
50 was that they did not need to. The workshops were designed
to cater to students who required the reassurance of face-to-
40 face engagement. We succeeded in creating an opportunity
for this cohort of students (20%), so it is worthwhile to keep
30
this as part of the module design. During the COVID-19 pan-
20 demic, workshops were held online and provided students
with the added option of asking/answering questions with the
10 chat function. Investigation of the possibilities of hybrid
workshops where students can attend the same classes either
0 face to face or online would enhance the flexibility and may
0 20 40 60 80 100 120 140
appeal to more students.
Number quiz attempts
Figure 8. Weak correlation between number of times students attempted Discussion forums.
quizzes and their exam score. Statistically significant, r = 0.21, P = 0.04. Our model used online discussion forums to support both
the monitoring phase of learning, through organizing peer
are commonly included in blended modules (e.g., Refs. 45, 61, assessment, and the adjustment phase, through the provi-
62). The self-assessment quizzes were one of the top-rated ele- sion of feedback and clarifications (10). Consistent with the
ments of the module, and we observed a high level of engage- findings of other studies (45, 67), students in the present
ment with quizzes by students. Quizzes are an element of study made little use of discussion forums and only 28%
blended learning models that are used to motivate students; rated the forums as somewhat or very important. Casotti and
they enhance motivation through increased autonomy, that is, colleagues (68) found that discussion forums were one of the
they provide more responsibility to learners (10). Unlike in most important elements of their model; however, in con-
some blended models (e.g., Refs. 45, 63), students were not trast to the present study, they required students to post to
required to complete our quizzes and they did not contribute the forums and to respond to posts of others. The lack of
to their final mark. Voluntary engagement with nonmandatory posts to the forums may be because students are reluctant to
learning activities is an effective indicator of a self-regulated post questions publicly (32) or because students feel they
learner (64). Although students reported the quizzes to be a must write out their questions and do so carefully (69).
very important element of the module, not all students Forums have been found to be valuable for students who do
engaged with the quizzes, and there was only a weak, albeit sig- not post but view the forum discussions (69). This is consist-
nificant, correlation of quiz completion and their final grade. ent with the findings of the present study, in which almost
Consistent with Jones and Korula (65), we found that engage- half of the students viewed the forums but only 13 posts were
ment with the quizzes decreased steadily over the course of the made. There may be other ways to provide students with
module. Our quizzes only provided correct answers, without opportunities to ask questions asynchronously or for using
feedback statements explaining correct and incorrect answers. forums for higher-order detailing of explanations (32), partic-
Inclusion of this additional feedback may be beneficial in help- ularly for students who appreciate engaging with instructors
ing students to identify the deficits in their knowledge and online.
may encourage greater use by students (66).
Exam.
Workshops. Like most studies reviewed by Boelens and colleagues (10)
The weekly face-to-face workshops were the main place that included a final examination, we held this assessment
where students asked questions of the instructors and sought during a face-to-face session. Unlike most of these studies,
feedback or clarifications. An audience-response system was the final examination was the only assessment for the mod-
used to gauge student learning and identify areas students ule; in other models, students received marks for the exami-
were struggling with, which allowed the instructor to decide nation as well as for online formative quizzes, contribution
which topics to devote time to explaining (22, 37). However, to forum discussions, and papers (10).
workshops were not perceived as important by many stu-
Student Engagement with LMS
dents, and only a small percentage of students attended work-
shops, with attendees declining in number over the course of Student engagement with resources on LMS aligned with
the module. Kauffman and colleagues (61) found that stu- student feedback on elements of the model that were most
dents who attended the workshops in their cohort had lower important for their learning. This is consistent with findings
self-efficacy and effort regulation, which reflects that they of Murray and colleagues (70) that students report a tend-
were weaker at self-management and maintaining effort in ency to only access resources they believe necessary to
complete assessment tasks, mainly because of time con- comparable student experience and engagement data
straints. Lecturer-recorded videos and quizzes were accessed from students who completed the traditional face-to-face
most in weeks 1, 2, and 5 of the module, suggesting that stu- module; however, student comments on course evalua-
dents strongly engaged with the module early and again in tions during this period indicated that the students were
the final week in preparation for the exam. Mogus and col- satisfied. We do not conclude that students had a more
leagues (67) found a positive correlation between student positive experience of the module in blended compared to
access to LMS activities (e.g., assignments, forums, resour- traditional mode.
ces) and their final mark and concluded that student learn-
Recommendations/Future Directions
ing outcomes and learning effectiveness are influenced by
engagement with the online space. In 2020, in response to the COVID-19 pandemic, this mod-
The data were also analyzed to gain an understanding of ule was taught fully online for the first time, with the face-to-
how students use the resources for learning when they are face workshops replaced with synchronous online work-
given more autonomy. Below, we discuss some observations shops held via Zoom and an online exam. These workshops
that may be important to consider when designing blended were well attended, and we will consider incorporating these
modules. sessions in future iterations of this module.
Although our model provides more flexibility than the tra-
Timing of resource availability. ditional model of face-to-face scheduled theory delivery via
In the present study, all module materials were available on lectures and workshops, there is scope to increase the
the LMS 2 wk before the module started. Some have also amount of choice students can exercise in their learning.
made all resources available before the module starting (68), Boelens and colleagues’ review (10) found that in most
whereas others released materials sequentially during the se- blended learning models the instructors determined the pro-
mester (3, 45). Making all materials available before the mod- portion of online and face-to-face activities and what was
ule starts allows students to access information and resources delivered in these modes, limiting student control to time-
early and to progress at a faster pace if they wish to do so (68). and place-independent activities. How blended learning
LMS access data showed that half of the students in the pres- models can be designed to enhance student control is an
ent study made use of the early availability of resources and area for future investigation.
accessed student guides and lecturer-recorded videos and In addition, assessment should include questions that
attempted quizzes before the semester started. Early access of assess the higher-order Bloom’s levels, including analysis,
resources may be related to students’ prior knowledge of the synthesis, and evaluation, to challenge and differentiate
subject matter, which influences their perceived “need” to between the higher-achieving students but also build skills
access the resources (71). This requires high levels of organiza- required for work readiness (76).
tion by the instructors, but the benefit is that once the module
starts efforts can be focused on discussions with students and Conclusions
not development of materials (68).
The COVID-19 pandemic has forced a rethink of how we
Access to resources and performance. approach many areas of our lives, including the provision of
We found weak to moderate positive correlations between higher education. Discussions of what delivery modes work
access to lecturer-recorded and supplementary videos and best to support student learning have been ongoing for deca-
quiz attempts and exam performance, suggesting that each des, and the remote learning approaches rapidly adopted
contributed in a small way to the exam score. Murray and col- during the pandemic may have shifted some long-held per-
leagues (70) found that high access rates to the entire suite of ceptions among academic staff and students. We have pre-
their resources were moderately correlated with high grades. sented an example of a blended model that has an emphasis
Studies have found that analytic data can explain individual on learner autonomy and flexibility and resulted in
differences in online learning (72) and that active participation improved student learning compared with a fully face-to-
in online courses through the LMS is significantly related to face module. Students positively perceived the format of the
academic performance (72–75). The present study was not module, with segments of the cohort finding all elements of
designed to specifically investigate what data analytics can tell the model to be important. Student perception data were
us about student learning styles or the relation with academic consistent with basic data analytics. The pace at which the
performance; this is a possible avenue for future research. landscape of higher education is changing has increased as
we enter the third decade of this century. At a time when
Limitations competition for students among higher education institu-
Our study focuses on an exercise physiology module for tions intensifies, the degree to which institutions provide
health and biomedical science students; the results may students with flexibility and supportive learning environ-
not be generalizable to other disciplines. LMS analytics ments may impact their enrollments. Educators from a
data only indicate that students have accessed items such range of science disciplines are encouraged not only to trial
as lecturer-recorded and supplementary videos, forums, the model presented in this report but also to build on this
and student guides, and we do not know how long they work, by embedding additional flexibility, such as providing
spent engaging with the resources (if at all). Therefore, the a fully online option that includes synchronous and interac-
significance of the data is limited to confirming student tive workshops. How much longer will it be before the sector
perception data and providing an overview of student embraces the way of the future, and we can say “ding-dong,
engagement with resources in our model. We do not have the traditional lecture is dead”?
SUPPLEMENTAL INFORMATION 15. Kaleta R, Skibba K, Joosten T. Discovering, designing, and deliver-
ing hybrid courses. In: Blended Learning: Research Perspectives,
Supplemental Material: https://doi.org/10.26181/17134238. edited by Picciano AG, Dzuiban CD. New York: Routledge, 2007, p.
111–143.
16. Bonk CJ, Kim KJ, Zeng T. Future directions of blended learning in
DISCLOSURES higher education and workplace learning settings. In: EdMedia þ
No conflicts of interest, financial or otherwise, are declared by Innovate Learning. Waynesville, NC: Association for the Advancement
of Computing in Education (AACE), 2005, p. 3644–3649.
the authors.
17. Horn MB, Staker H. Blended: Using Disruptive Innovation to
Improve Schools. Hoboken, NJ: John Wiley & Sons, 2017.
AUTHOR CONTRIBUTIONS 18. Jusoff K, Khodabandelou R. Preliminary study on the role of social
presence in blended learning environment in higher education. Int
B.L.J. and L.L. conceived and designed research; B.L.J., K.T., Educ Stud 2: 79–83, 2009. doi:10.5539/ies.v2n4p79.
and A.H. analyzed data; B.L.J., K.T., A.H., and L.L. interpreted 19. Dziuban C, Graham CR, Moskal PD, Norberg A, Sicilia N. Blended
results of experiments; B.L.J. prepared figures; B.L.J. and L.L. learning: the new normal and emerging technologies. Int J Educ
drafted manuscript; B.L.J., K.T., A.H., and L.L. edited and revised Technol High Educ 15: 1–16, 2018. doi:10.1186/s41239-017-0083-9.
manuscript; B.L.J., K.T., A.H., and L.L. approved final version of 20. Heinze A, Procter C. Reflections on the use of blended learning. In:
manuscript. Education in a Changing Environment. Salford, UK: University of
Salford, 2004.
21. Felder E, Fauler M, Geiler S. Introducing e-learning/teaching in a
REFERENCES physiology course for medical students: acceptance by students
1. O’Flaherty J, Phillips C. The use of flipped classrooms in higher and subjective effect on learning. Adv Physiol Educ 37: 337–342,
education: a scoping review. Internet High Educ 25: 85–95, 2015. 2013. doi:10.1152/advan.00158.2012.
doi:10.1016/j.iheduc.2015.02.002. 22. McFarlin BK. Hybrid lecture-online format increases student grades in
2. MacManaway LA. Teaching methods in higher education–innova- an undergraduate exercise physiology course at a large urban univer-
sity. Adv Physiol Educ 32: 86–91, 2008. doi:10.1152/advan.00066.
tion and research. High Educ Q 24: 321–329, 1970. doi:10.1111/j.1468-
2007.
2273.1970.tb00346.x.
23. Raupach T, M€ unscher C, Pukrop T, Anders S, Harendza S.
3. Horton DM, Wiederman SD, Saint DA. Assessment outcome is
Significant increase in factual knowledge with web-assisted prob-
weakly correlated with lecture attendance: influence of learning
lem-based learning as part of an undergraduate cardio-respiratory
style and use of alternative materials. Adv Physiol Educ 36: 108–115,
curriculum. Adv Health Sci Educ Theory Pract 15: 349–356, 2010.
2012. doi:10.1152/advan.00111.2011.
doi:10.1007/s10459-009-9201-3.
4. Gough LA, Duffell T, Eustace SJ. The impact of student attendance on
24. Salamonson Y, Lantz J. Factors influencing nursing students’ prefer-
assessment specific performance in sport degree programs. J Hosp
ence for a hybrid format delivery in a pathophysiology course. Nurse
Leis Sport Tour Educ 29: 100323, 2021. doi:10.1016/j.jhlste.2021.
Educ Today 25: 9–16, 2005. doi:10.1016/j.nedt.2004.09.006.
100323.
25. Taradi SK, Taradi M, Radić K, Pokrajac N. Blending problem-based
5. Doggrell SA. Quantitative study of lecture attendance and the asso- learning with Web technology positively impacts student learning
ciation between this attendance and academic outcomes for nursing outcomes in acid-base physiology. Adv Physiol Educ 29: 35–39,
and nonnursing students in an introductory pathophysiology course. 2005. doi:10.1152/advan.00026.2004.
Adv Physiol Educ 45: 651–660, 2021. doi:10.1152/advan.00037.2021. 26. Boud D. Developing Student Autonomy in Learning. New York:
6. Davis EA, Hodgson Y, Macaulay JO. Engagement of students with Routledge, 2012.
lectures in biochemistry and pharmacology. Biochem Mol Biol Educ 27. Candy PC. Reframing Research into 'Self-Direction' in Adult
40: 300–309, 2012. doi:10.1002/bmb.20627. Education: A Constructivist Perspective (EdD thesis). Vancouver:
7. Mthimunye K, Daniels FM. Predictors of academic performance, suc- University of British Columbia, 1987.
cess and retention amongst undergraduate nursing students: a sys- 28. Ryan RM, Deci EL. Self-determination theory and the facilitation of
tematic review. S Afr J High Educ 33: 200–220, 2019. doi:10.20853/ intrinsic motivation, social development, and well-being. Am Psychol
33-1-2631. 55: 68–78, 2000. doi:10.1037//0003-066x.55.1.68.
8. Snart JA. Hybrid Learning: The Perils and Promise of Blending 29. Deci EL, Ryan RM, Williams GC. Need satisfaction and the self-regu-
Online and Face-to-Face Instruction in Higher Education. Santa lation of learning. Learn Individ Differ 8: 165–183, 1996. doi:10.1016/
Barbara, CA: ABC-CLIO, 2010. S1041-6080(96)90013-8.
9. Oliver M, Trigwell K. Can ‘blended learning’ be redeemed? E-learn- 30. Grolnick WS, Ryan RM, Deci EL. Inner resources for school achieve-
ing 2: 17–26, 2005. doi:10.2304/elea.2005.2.1.17. ment: motivational mediators of children's perceptions of their parents.
10. Boelens R, De Wever B, Voet M. Four key challenges to the design J Educ Psychol 83: 508–517, 1991. doi:10.1037/0022-0663.83.4.508.
of blended learning: a systematic literature review. Educ Res Rev 31. McDonald PL. Variation in adult learners’ experiences of blended
22: 1–18, 2017. doi:10.1016/j.edurev.2017.06.001. learning in higher education. In: Blended Learning: Research
11. Joosten TM, Barth D, Harness L, Weber NL. The impact of instruc- Perspectives, edited by Picciano AG, Dzuiban CD, Graham CR. New
tional development and training for blended teaching on course York: Routledge, 2014, vol. 2, p. 215–234.
effectiveness. In: Blended Learning: Research Perspectives, edited 32. Rasheed RA, Kamsin A, Abdullah NA. Challenges in the online
by Picciano AG, Dzuiban CD, Graham CR. New York: Routledge, component of blended learning: a systematic review. Comput Educ
2013, vol. 2, p. 173–189. 144: 103701, 2020. doi:10.1016/j.compedu.2019.103701.
12. Spanjers IA, Ko € nings KD, Leppink J, Verstegen DM, de Jong N, 33. Powers SK, Howley ET. Exercise Physiology: Theory and
Czabanowska K, van Merriënboer JJ. The promised land of Application to Fitness and Performance. New York: McGraw-Hill
blended learning: quizzes as a moderator. Educ Res Rev 15: 59–74, Education, 2018.
2015. doi:10.1016/j.edurev.2015.05.001. 34. Biggs JB, Tang C. Teaching for Quality Learning at University: What
13. Graham CR. Blended learning systems: definition, current trends, the Student Does. Maidenhead, UK: McGraw-Hill Education (UK),
and future directions. In: Handbook of Blended Learning: Global 2011.
Perspectives, Local Designs, edited by Bonk CJ, Graham CR. San 35. Battaglia DM, Kaya T. How flipping your first-year digital circuits
Francisco, CA: Pfeiffer, 2006, vol. 2, p. 3–18. course positively affects student perceptions and learning. Int J Eng
14. Graham CR, Robison R. Realizing the transformational potential of Educ 31: 1126–1138, 2015.
blended learning: comparing cases of transforming blends and 36. Mason GS, Shuman TR, Cook KE. Comparing the effectiveness of
enhancing blends in higher education. In: Blended Learning: an inverted classroom to a traditional classroom in an upper-division
Research Perspectives, edited by Picciano AG, Dzuiban CD. New engineering course. IEEE Trans Educ 56: 430–435, 2013.
York: Routledge, 2007, p. 83–110. doi:10.1109/TE.2013.2249066.
37. Barbour C, Schuessler JB. A preliminary framework to guide imple- 57. Evans HK, Cordova V. Lecture videos in online courses: a follow-up.
mentation of the flipped classroom method in nursing education. J Pol Sci Educ 11: 472–482, 2015.
Nurse Educ Pract 34: 36–42, 2019. doi:10.1016/j.nepr.2018.11.001. 58. Garrison DR. E-Learning in the 21st Century: A Community of Inquiry
38. Skakun E, Nanson E, Kling S, Taylor W. A preliminary investigation Framework for Research and Practice. New York: Taylor & Francis,
of three types of multiple choice questions. Med Educ 13: 91–96, 2016.
1979. doi:10.1111/j.1365-2923.1979.tb00928.x. 59. Scagnoli N, Packard C. Improving a blended delivery model in a
39. Deschenes EP. Longitudinal research designs. In: Measurement large enrollment business course. In: Proceedings of the Academy
Issues in Criminology, edited by Kempf KL. New York: Springer, of Human Resource Development. St. Paul, MN: AHRD, 2011.
1990, p. 152–166. 60. Daspit JJ, D’Souza DE. Using the community of inquiry framework
40. Creswell JW, Plano Clark V, Gutmann ML, Hanson WE. An to introduce wiki environments in blended-learning pedagogies: evi-
expanded typology for classifying mixed methods research into dence from a business capstone course. Acad Manage Learn Educ
designs. In: Handbook of Mixed Methods in Social and Behavioral 11: 666–683, 2012. doi:10.5465/amle.2010.0154.
Research, edited by Tashakkori A, Teddlie C. Thousand Oaks, CA: 61. Kauffman CA, Derazin M, Asmar A, Kibble JD. Relationship
SAGE Publications, 2003, p. 209–240. between classroom attendance and examination performance in a
41. Bloom BS. Taxonomy of Educational Objectives: The Classification second-year medical pathophysiology class. Adv Physiol Educ 42:
of Educational Goals: Cognitive Domain. New York: Longmans,
593–598, 2018. doi:10.1152/advan.00123.2018.
Green, 1956.
62. Witchel HJ, Guppy JH, Smith CF. The self-assessment dilemma: an
42. Vaismoradi M, Turunen H, Bondas T. Content analysis and the-
open-source, ethical method using Matlab to formulate multiple-
matic analysis: Implications for conducting a qualitative descriptive
study. Nurs Health Sci 15: 398–405, 2013. doi:10.1111/nhs.12048. choice quiz questions for online reinforcement. Adv Physiol Educ
43. Vo HM, Zhu C, Diep NA. The effect of blended learning on student 42: 697–703, 2018. doi:10.1152/advan.00081.2018.
performance at course-level in higher education: a meta-analysis. 63. Dobson JL. The use of formative online quizzes to enhance class
Stud Educ Eval 53: 17–28, 2017. doi:10.1016/j.stueduc.2017.01.002. preparation and scores on summative exams. Adv Physiol Educ 32:
44. Zoller U, Ben-Chaim D. Interaction between examination type, anxi- 297–302, 2008. doi:10.1152/advan.90162.2008.
ety state, and academic achievement in college science; an action- 64. Stegers-Jager KM, Cohen-Schotanus J, Themmen AP. Motivation,
oriented research. J Res Sci Teach 26: 65–77, 1989. doi:10.1002/ learning strategies, participation and medical school performance.
tea.3660260107. Med Educ 46: 678–688, 2012. doi:10.1111/j.1365-2923.2012.04284.x.
45. Shang F, Liu CY. Blended learning in medical physiology improves 65. Jones JM, Korula R. A mixed methods exploration of factors that
nursing students’ study efficiency. Adv Physiol Educ 42: 711–717, influence student participation in optional formative review quizzes.
2018. doi:10.1152/advan.00021.2018. Med Sci Educ 31: 1401–1410, 2021. doi:10.1007/s40670-021-01321-y.
46. Fisher R, Pere nyi Á, Birdthistle N. The positive relationship 66. Abney AJ, Amin S, Kibble JD. Understanding factors affecting par-
between flipped and blended learning and student engagement, ticipation in online formative quizzes: an interview study. Adv Physiol
performance and satisfaction. Active Learn High Educ 22: 97–113, Educ 41: 457–463, 2017. doi:10.1152/advan.00074.2017.
2021. doi:10.1177/1469787418801702. 67. Mogus AM, Djurdjevic I, Suvak N. The impact of student activity in a
47. Van Laer S, Elen J. In search of attributes that support self-regula- virtual learning environment on their final mark. Active Learn High
tion in blended learning environments. Educ Inf Technol 22: 1395– Educ 13: 177–189, 2012. doi:10.1177/1469787412452985.
1454, 2017. doi:10.1007/s10639-016-9505-x. 68. Casotti G, Beneski JT, Knabb MT. Teaching physiology online: suc-
48. Scagnoli NI, Choo J, Tian J. Students’ insights on the use of video cessful use of case studies in a graduate course. Adv Physiol Educ
lectures in online classes. Br J Educ Technol 50: 399–414, 2019. 37: 65–69, 2013. doi:10.1152/advan.00159.2012.
doi:10.1111/bjet.12572. 69. Kay D, Pasarica M. Using technology to increase student (and fac-
49. Demiro € ren M, Turan S, Tas delen Teker GT. Determinants of self- ulty satisfaction with) engagement in medical education. Adv Physiol
regulated learning skills: the roles of tutors and students. Adv Educ 43: 408–413, 2019. doi:10.1152/advan.00033.2019.
Physiol Educ 44: 93–98, 2020. doi:10.1152/advan.00121.2019. 70. Murray MC, Pe rez J, Geist D, Hedrick A. Student interaction with
50. Ellis RA, Bliuc AM. Exploring new elements of the student online course content: build it and they might come. J Inform
approaches to learning framework: The role of online learning tech- Technol Educ Res 11: 125–140, 2012. doi:10.28945/1592.
nologies in student learning. Active Learn High Educ 20: 11–24, 71. Guy R, Byrne B, Dobos M. Optional anatomy and physiology e-
2019. doi:10.1177/1469787417721384.
learning resources: student access, learning approaches, and aca-
51. Vermunt JD, Verloop N. Congruence and friction between learning
demic outcomes. Adv Physiol Educ 42: 43–49, 2018. doi:10.1152/
and teaching. Learn Instruct 9: 257–280, 1999. doi:10.1016/S0959-
advan.00007.2017.
4752(98)00028-0.
pez G, Manrique D, Vin~ es JM. An instructional model 72. Morris LV, Finnegan C, Wu SS. Tracking student behavior, persist-
52. Alonso F, Lo
for web-based e-learning education with a blended learning process ence, and achievement in online courses. Internet High Educ 8:
approach. Br J Educ Technol 36: 217–235, 2005. doi:10.1111/j.1467- 221–231, 2005. doi:10.1016/j.iheduc.2005.06.009.
8535.2005.00454.x. 73. Campbell J, Finnegan C, Collins B. Academic analytics: using the
53. You JW. Identifying significant indicators using LMS data to predict CMS as an early warning system. WebCT Impact Conference, 2006.
course achievement in online learning. Internet High Educ 29: 23– 74. Johnson GM. Student alienation, academic achievement, and
30, 2016. doi:10.1016/j.iheduc.2015.11.003. WebCT use. J Educ Technol Soc 8: 179–189, 2005.
54. Chen CM, Wu CH. Effects of different video lecture types on sus- 75. Wang AY, Newlin MH. Predictors of web-student performance: the
tained attention, emotion, cognitive load, and learning performance. role of self-efficacy and reasons for taking an on-line class. Comput
Comput Educ 80: 108–121, 2015. doi:10.1016/j.compedu.2014.08.015. Human Behav 18: 151–163, 2002. doi:10.1016/S0747-5632(01)00042-5.
55. Hsin WJ, Cigas J. Short videos improve student learning in online 76. MacKinnon PJ, Osborne KC, Hayes A, Lexis L, Hryciw DH,
education. J Comput Sci Coll 28: 253–259, 2013. Towstoless M, Tangalakis K. Back to the future: facilitating assess-
56. Sadik A. Students’ preferences for types of video lectures: lecture ment design, collaboration, and outcomes alignment with an assess-
capture vs. screencasting recordings. J Educ Multimed Hypermedia ment framework. Proceedings of The Australian Conference on
25: 189–208, 2016. Science and Mathematics Education, 2021, p. 71–77.