Development, Implementation, and Assessment of General Chemistry Lab Experiments Performed in The Virtual World of Second Life

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 10

Article

pubs.acs.org/jchemeduc

Development, Implementation, and Assessment of General


Chemistry Lab Experiments Performed in the Virtual World of
Second Life
Kurt Winkelmann,*,† Wendy Keeney-Kennicutt,‡ Debra Fowler,§ and Maria Macik§

Department of Chemistry, Florida Institute of Technology, Melbourne, Florida 32901, United States

Department of Chemistry, Texas A&M University, College Station, Texas 77843-3255, United States
§
Center for Teaching Excellence, Texas A&M University, College Station, Texas 77843-4246, United States
*
S Supporting Information
See https://pubs.acs.org/sharingguidelines for options on how to legitimately share published articles.

ABSTRACT: Virtual worlds are a potential medium for


teaching college-level chemistry laboratory courses. To
determine the feasibility of conducting chemistry experiments
Downloaded via 114.5.108.253 on June 1, 2020 at 03:14:55 (UTC).

in such an environment, undergraduate students performed


two experiments in the immersive virtual world of Second Life
(SL) as part of their regular General Chemistry 2 laboratory
course. The experiments’ development and implementation
are presented with feedback from students and graduate
teaching assistants. Students successfully completed the
experiments and showed learning gains similar to students
performing real world experiments, as shown by pre/postlab quizzes and a laboratory practicum. Student participants held
positive views of their experience in the SL chemistry laboratory. Teaching assistants provided an important perspective about
using the virtual world for laboratory instruction. Overall, results of this pilot study suggest that virtual worlds can be effective for
teaching chemistry experiments. This is the first account of student learning and attitudes after performing college-level chemistry
experiments in the immersive virtual world of SL.
KEYWORDS: First-Year Undergraduate/General, Laboratory Instruction, Computer-Based Learning, Internet/Web-Based Learning,
Laboratory Computing/Interfacing

■ INTRODUCTION
Chemistry faculty wishing to offer online chemistry classes1 are
in SL. A user begins by selecting a basic human avatar then
customizes the appearance as desired, including clothing and
challenged to design a laboratory component.2−4 Many options hairstyle. The user sees and hears what the avatar would be
are available. Students can purchase laboratory kits for expected to see and hear by viewing from either a first-person
experiments to be performed in the home,4,5 attend a hybrid or nearby third-person perspective. Avatars and all virtual
course with distance learning lectures and on-campus lab objects obey the physical laws that have been programmed for
sessions,6 or they can perform computer-based lab simu- the virtual environment. By default, these are generally in
lations.7,8 Virtual worldsvisually rich, three-dimensional, agreement with those in the real world, but the physical laws
highly interactive online environmentsoffer another potential can be modified to allow extraordinary behavior such as flying
means for students to learn chemistry laboratory skills.9 Virtual and teleportation. Users interact with each other in real time
worlds have several positive features. They provide a realistic using a microphone headset, mouse, and keyboard.
laboratory environment for students to conduct experiments on Educators use SL for teaching many subjects. Developers
and off campus. An instructor can join students in the virtual have created authentic replicas of historical sites in which
world laboratory, or students can conduct experiments students learn about the past and present through their own
independently and repeatedly at any time. Virtual world exploration and role playing.11 Students are learning health-
experiments could involve expensive instrumentation, excep-
care,12 computer science,13,14 cybersecurity,15,16 physics,17
tionally dangerous chemicals, or unusual working conditions
without the added risk or cost, which can make the experiment veterinary medicine,18 and engineering19 in SL. Few SL science
potentially more educational and interesting to students. laboratory experiments are available: students can perform a
Second Life (SL), created and operated by Linden Lab, is a polymerase chain reaction (PCR) experiment,20 and students at
popular virtual world used for education and the most
commonly studied virtual world in education research.10 With Received: October 20, 2016
a free account, a user can create an avatar which serves as the Revised: April 25, 2017
user’s virtual representation or the character that the user plays Published: May 19, 2017
© 2017 American Chemical Society and
Division of Chemical Education, Inc. 849 DOI: 10.1021/acs.jchemed.6b00733
J. Chem. Educ. 2017, 94, 849−858
Journal of Chemical Education Article

Figure 1. Screenshot of benchtop 1 used for the SL AgCl titration experiment.

Figure 2. Two avatars work with oversized lab equipment to determine the molar mass of butane. An onscreen menu shows possible actions for the
students to perform.

Prince William Sound College can perform biology experiments research methods in 127 studies of virtual worlds found that
in SL.21 most researchers evaluated users’ performance in controlled
Students also learn chemistry in SL. Viewing 3D models of experimental settings, not in authentic classroom conditions.10
atomic orbital and molecular shapes in SL improved students’ Therefore, additional studies conducted in a real classroom
satisfaction, self-efficacy, and academic performance.22−24 Lang environment are needed.
and Bradley25 describe the visualization of complex biomole- Educational benefits of virtual worlds justify an investigation
cules and reaction mechanisms in SL. Second Life provides a of their use in the chemistry teaching laboratory. The authors
collaborative environment for students to view and share data. developed two laboratory experiments for SL that mimic
However, chemistry experiments are rare in SL,26 perhaps due
experiments taught in a General Chemistry 2 course at Texas
to the extensive programming required to realistically depict
chemical phenomena. A&M University.29 Effects of the laboratory environment (real
Several studies indicate that students learn as much17,20,27 in and virtual) on student learning and attitudes about their lab
virtual worlds compared to an analogous real world activity. A experience were assessed over a two-year period and will be
meta-analysis of 69 studies of computer-based simulations, reported in future publications. Here, the authors describe
games, and virtual worlds found that virtual worlds are effective experiment development, implementation, and initial feedback
at improving K-12 and college students’ knowledge-, ability-, from students and teaching assistants (TAs) during the pilot
and skill-based learning outcomes.28 However, a 2014 review of testing of this project.
850 DOI: 10.1021/acs.jchemed.6b00733
J. Chem. Educ. 2017, 94, 849−858
Journal of Chemical Education Article

Figure 3. A view of the solution volume within a buret as seen by a student.

■ VIRTUAL LABORATORY DESIGN


Both experiments selected for development in SL were
An initial design challenge was to provide a means for
viewing small details such as markings on graduated glassware.
verification experiments currently taught in the lab course, The zoom feature within SL is inadequate for this task. The
and each could be completed in one 3 h session with students programmers overcame this limitation by enlarging objects in
working in pairs. Although the authors recognize the the laboratory environment so that the student’s avatar was
shortcomings of verification experiments, they are the easiest standing on the virtual lab bench surrounded by enormous
to design and implement in SL. Most other experiments in the versions of the lab equipment. Because users perform tasks
school’s general chemistry laboratory curriculum were using onscreen menus or clicking with a mouse cursor, avatars
verification style as well. do not actually handle the comically large virtual laboratory
In the first selected experiment, students perform three trials items. Figure 2 shows an example of two avatars determining
collecting volumes of butane gas released from a lighter over the molar mass of butane and the use of an onscreen menu. In
water to determine its molar mass. This experiment was fact, when users view the virtual world from a first-person
selected for the project because it involves the assembly and perspective, the lab equipment looks normal, as demonstrated
handling of several pieces of equipment. The second experi- in Figure 1. The oversized lab equipment enabled students to
ment involved a series of argentometric titrations to determine easily view markings on measurement glassware, as illustrated
the salinity of a solution. A silver nitrate solution of known in Figure 3.
concentration is added to an analyte solution containing an Several features of the SL experiments ensure that students
unknown amount of sodium chloride and indicator. This have a realistic laboratory experience: (1) Experimental results
titration experiment is more challenging than the typical acid− depend on the students’ actions, so skipping a procedural step
base titration both conceptually and experimentally. In the will change the experiment’s outcome for the worse. For
authors’ experience, a titration is a common procedure in instance, forgetting to close the door of the analytical balance
general chemistry, so it is important to determine if students when measuring the mass of the butane lighter would result in
can perform it in SL. The student’s view of the SL titration an inaccurate mass value. This affects students’ calculation of
experiment benchtop is shown in Figure 1. Handouts for both the molar mass of butane. The SL experiment does not stop or
experiments are included in Supporting Information. fail, but the students’ results are less accurate. (2) Although the
Professional programmers with experience working on experimental data is determined algorithmically, the computer
educational projects were hired to translate the experiments code intentionally adds a small random error. This gives more
into SL and help conduct student training. The KW research realistic-looking data. (3) Avatars within the vicinity of the lab
group practiced the experiments and then recorded video and bench can participate in the experiment, so students work
images while performing the two experiments in a real world together in SL just as they do in the real lab room. (4) Students
laboratory. The programmers used these videos and images to in the SL group must make observations, record data in lab
design realistic looking chemicals, chemical and physical handouts, perform calculations, and analyze results in the same
phenomena, and labware. Programmers then coded exper- manner as students in the real world lab. The computer
imental outcomes such as the color change of the titration program does not perform any calculations for the student.
indicator, which depended on students’ actions. Content was Additional design features of the virtual environment were
created using the Linden Scripting Language. added to improve students’ learning experience. A reset button
851 DOI: 10.1021/acs.jchemed.6b00733
J. Chem. Educ. 2017, 94, 849−858
Journal of Chemical Education Article

Figure 4. A student views the prelab briefing by the TA in SL along with other avatars.

Figure 5. Real world and SL laboratory facilities.

at every lab station allows students to restart an experiment if briefing rooms and laboratory bench space for each lab group.
they make a mistake. All equipment is automatically cleaned, They also created areas for students to explore, such as a large
solution dispensers are refilled, and equipment is returned to its lab building with natural and landscaped areas around it.
original position. Avatars at a lab station or in a room can only Although these features were unnecessary for the students’
see and communicate with other avatars also located at that assignments, they added to the sense of immersion that users
same location. They can talk to each other using an in-world feel when they are controlling their avatars within SL.30 This
text chat feature or through a microphone headset. Figure 4 feeling of presence is an important component to a successful
shows a student wearing a headset while viewing the prelab and enjoyable virtual learning environment.30,31
presentation by the TA with other avatars sitting in front of his Several aspects of the SL experiments were not realistic due
avatar. A chat dialogue box appears in the lower right corner of to technical or practical limitations. Use of SL is free, but
the screen. This isolation eliminates many distractions. Linden Lab charges users who wish to create a permanent
Students can click on a call button located on the virtual lab location. Because this fee is based on the area of virtual land
bench to ask the TA for help. used, the authors chose to create floating, oversized lab
Programmers designed the virtual laboratory to duplicate the benchtops positioned above the laboratory building. Lab groups
real world setting so that it would be familiar to students. teleported there from the meeting room. The back wall of the
Images recorded in the real and virtual lab rooms are shown in lab bench is transparent in one direction so that instructors can
Figure 5. Programmers designed common laboratory and monitor students from behind the wall without being noticed.
852 DOI: 10.1021/acs.jchemed.6b00733
J. Chem. Educ. 2017, 94, 849−858
Journal of Chemical Education Article

Figure 6. An instructor’s avatar in the foreground views two avatars performing an experiment from behind the one-way transparent back wall of the
lab bench. The lab bench is the same as the one pictured in Figure 2.

This is illustrated in Figure 6. The oversized lab bench limited During the training session, students attired their avatars with
the avatars’ field of view so that they could not see other lab goggles and a lab coat, viewed the meniscus in a buret and
benches. Incorporating the limitless choices students could graduated cylinder, and located the SL laboratory and briefing
make during an experiment into the computer programming rooms. Students were not allowed to perform the experiment
was impossible. Students accomplished some tasks, such as until they completed the training, so an additional training
dispensing reagents, using onscreen menus. One such menu session was provided after the briefing for the first experiment
appears in Figure 2. Readers are invited to join SL and request for any students who missed the earlier training sessions.
access from author K.W. or W.K.K. to view or use the
laboratory experiments themselves.32
Costs to build and maintain the SL laboratory spaces and
■ IMPLEMENTATION
Two technical issues arose during the SL laboratory experi-
activities were about $25,000. Although this is a high cost for ments. First, some computers in the campus computer lab often
just two experiments for four lab sections, the cost does not failed to recognize the headsets that were provided to students.
necessarily scale proportionally if more experiments are added This meant that lab partners could not communicate online
because some expenses were due to developing the lab building with each other or with the TA. To resolve this problem, lab
and its aesthetics. There would be no additional development partners sat next to each other in the computer lab when
costs associated with more lab classes conducting these two necessary while their avatars interacted in SL. The TA walked
experiments at other times in SL. While developing new SL lab around the computer classroom to speak with students who
experiments is more expensive than creating new real world had questions. While this diminished the “virtual” aspect of the
experiments, the virtual world provides an entire environment laboratory experiment, the authors did not consider the
for conducting those experiments, including rooms within the particular method of audio communication used to be
lab building and its surroundings. Ongoing costs for the SL important for this pilot study.
experiments are about $1800 each year for renting server space The SL viewer software requires periodic updates and will
with Linden Lab. It is anticipated that costs of computer not allow a user to log in until a computer administrator
hardware will decline with time. Developing and testing the performs the update. In instances when this would delay class,
complete virtual laboratory spanned about nine months, author W.K.K. gave each student a flash drive with the updated
although this duration could have been shortened if necessary. SL viewer program on it. The school’s IT office updated the
Training for new users of SL is essential.33 Students in lab software on the computers later.
sections which performed the virtual world experiments viewed Students in four laboratory sections (∼24 students each)
an introductory video about the project and tutorials which performed the two SL experiments and eight other experiments
showed them how to create a SL account and an avatar. Each in the real world laboratory, while the control group, consisting
student in the SL group created an avatar before leaving the of four lab sections with similar enrollment taught by the same
first lab session. Students learned the keyboard and mouse TAs, performed all ten experiments in the real world lab. The
commands for moving within SL and completed a mandatory SL group met in a reserved computer lab at their regularly
SL training session within SL prior to the first SL lab scheduled lab time for these two weeks of SL experiments,
experiment (collecting butane gas over water). This training while the control group performed the same experiments in the
session was conducted synchronously, but students could chemistry lab. Graduate student TAs led all lab sessions, and
perform it at their own computers. Attendance was recorded. author W.K.K. was also present for the two SL lab sessions. All
853 DOI: 10.1021/acs.jchemed.6b00733
J. Chem. Educ. 2017, 94, 849−858
Journal of Chemical Education Article

other aspects of the lab curriculum and lab policies for the two students who completed all assessments were included in the
groups were the same. All students performed the butane gas statistical analysis. All students could access computers, and
and silver nitrate titration experiments during weeks three and some students even had experience with virtual worlds, possibly
four of the semester, respectively. due to other SL education activities conducted by Texas A&M
Each laboratory session began with a five-question multiple faculty.12,18,24
choice quiz that evaluated students’ understanding and Student Learning
familiarity with the experimental procedure. All students
Students in the SL and control groups showed similar
completed the quizzes on paper. Following the quiz, the TA
achievements in the pre- and postexperiment quizzes, as
showed a brief slideshow presentation that summarizes the
shown in Table 1. The chi-square test for homogeneity was
procedure, safety issues, and calculations. For the laboratory
sessions conducted in SL, the slideshow was displayed within
SL. The content of the slideshow was the same as the one given Table 1. Comparison of Pre- and Post-Experiment Quiz
to students in the real world laboratory. The avatar of the TA Scores (Mean ± SD) for SL and Control Groups
was in SL with all of the students’ avatars. At the end of the lab Control
session, students answered the same five-question multiple Assessment SL Group Group
Item Scored (n = 55) (n = 67) Likelihood Ratio
choice quizzes on paper. Each student turned in a lab report
one week after completing each experiment. Lab sections Butane 3.0 ± 1.3 3.4 ± 1.2 2
X (5) = 5.098, p = 0.404
experiment
involved in this study were chosen randomly. Students were prequiz
required to complete the two experiments in their assigned Butane 3.7 ± 1.1 3.8 ± 0.8 X2 (4) = 8.418, p = 0.077
virtual or real world lab environment. Students could, if they experiment
postquiz
requested, switch from the SL group to the control group. The
Gain in butane 0.7 ± 1.3 0.4 ± 1.1 X2 (7) = 14.103, p = 0.049
authors are aware of two students who dropped the lab class quiz score
belonging to the SL group during the first week of the semester Titration 2.0 ± 1.0 2.2 ± 0.9 X2 (5) = 6.639, p = 0.249
and then enrolled in another lab section. experiment
During the week five lab session, two weeks after they prequiz
performed the butane gas experiment, students in sections Titration 3.3 ± 1.0 2.8 ± 0.9 X2 (4) = 8.568, p = 0.073
experiment
taught by the four participating TAs (four sections of the postquiz
control group and the four sections of the SL group) completed Gain in titration 1.3 ± 1.1 0.7 ± 0.9 X2 (5) = 15.747, p = 0.008
a laboratory practicum in which they were presented with real quiz score
tubing, a lighter, a tub of water, and a graduated cylinder.
Students were instructed to assemble the apparatus to collect
gas over water and accurately measure the volume of water in used to test for differences. Likelihood ratios were reported
the graduated cylinder. Students completed the practicum because, in all cases, more than 20% of the cells had expected
individually and received no extra credit for this assignment. values less than 5. Both the control group and SL group showed
All members of the SL group completed surveys to measure significant improvements in their quiz scores after completing
their attitudes with respect to the real and virtual laboratory each experiment with the SL group showing small but
experiments in week eight. This was a semantic differential statistically significantly greater gains for both experiments.
survey based on the format used in the Inquiry Laboratory Similar quiz score gains among the SL and control groups are
Attitude Survey.34 A copy of the survey is included in the consistent with previous findings showing that students learn as
Supporting Information. After analyzing the results of the much in a virtual environment as they do in a real world setting.
survey and lab grades, the authors asked students in the SL For instance, students attending the virtual lectures of an
group follow-up questions based on the project results. aerospace design class scored as well on the course exam as
Students received a small amount of extra credit for providing students in the physical classroom.27 High school students also
these responses (students in the control group were given a learn equally well through interactive chemistry lab simulations7
different, unrelated assignment of equal value). and SL experiments.26 Learning gains made by physics students
Following the completion of the two SL experiments, the investigating the properties of light in SL matched those of
four TAs instructing SL and control group lab sections students performing the same lesson in a real classroom.17
participated in a focus group discussion. Focus groups provided Students in the SL group and the control group performed a
an opportunity for TAs to share their perceptions of the two lab practicum to determine how well they can manipulate the lab
environments. This occurred during each of the four semesters equipment needed to collect butane gas. This occurred two
of the SL experiment implementation. The focus group was led weeks after students performed the butane gas experiment. This
by author M.M. with none of the other authors present.


activity was chosen as the practicum because it was new to the
students; they had performed a titration in the previous
RESULTS AND DISCUSSION semester. One at a time, students assembled the lighter, tubing,
Because this pilot study was conducted in the fall semester, the tub of water, and graduated cylinder. Each student collected gas
General Chemistry 2 Lab course was off-sequence. Participating in the cylinder then reported the volume of gas. Author W.K.K.
students represented many majors and academic years. A evaluated students’ correct assembly and accuracy of the gas
demographic survey of participating students revealed no volume measurement. The SL group and control group
statistically significant differences (p > 0.05) between the performed equally well: average practicum scores of the two
control and SL groups with regard to academic college, age, respective groups were 4.2 ± 1.0 and 4.1 ± 0.7 on a 5-point
year in school, and gender. The ethnic diversity of the two scale with t(98.455) = 0.072, p = 0.943. Some students in the
groups was statistically different. Survey results and the control group noted that they learned to assemble the
statistical analysis appear in the Supporting Information. Only apparatus only by watching their lab partner, demonstrating
854 DOI: 10.1021/acs.jchemed.6b00733
J. Chem. Educ. 2017, 94, 849−858
Journal of Chemical Education Article

Table 2. Result Distribution of Survey Responses for the SL Group Comparing the Real World and SL Experiments
Agreement with Agreement with
Left Statement Neutral Right Statement
Left Statement n, % n, % n, % Right Statement
I like using computers instead of actually handling 18 13 24 I actually like handling chemicals instead of using
chemicals to perform lab experiments. 32.7% 23.6% 43.7% computers to perform lab experiments.
Lab experiments in “Second Life” take less time to 39 9 7 Lab experiments in “Second Life” take more time to
complete compared to experiments in the “real 70.9% 16.4% 12.7% complete compared to experiments in the “real
world.” world.”
I get better grades on “Second Life” lab experiments. 25 24 6 I get better grades on “real world” lab experiments.
45.4% 43.6% 10.9%
I would choose to do “Second Life” experiments 20 15 20 I would choose to do “real world” experiments instead
instead of ″real world″ lab experiments. 36.4% 27.3% 36.4% of “Second Life” lab experiments.
I learn more by performing “Second Life” lab 9 25 21 I learn more by performing “real world” lab
experiments. 16.4% 45.5% 38.1% experiments.

that not all students take advantage of the available opportunity experiments. The perception that some students felt that they
to gain hands-on experience using real laboratory equipment. learned less in the virtual world is troubling, but without more
Students can learn kinesthetic skills in a virtual world if the information about the group’s grades, it is difficult to draw any
real and virtual environments settings are similar.35 Using a conclusions. These issues are being examined in more detail
mouse and keyboard does not truly replicate manipulating lab now using data gathered during subsequent implementations of
equipment. Therefore, it is somewhat surprising that students the SL experiments.
learned the techniques of assembling pieces of laboratory Written feedback provided by 15 students in the SL group
equipment and measuring a volume of gas in the virtual SL cited the SL experiments as being less stressful and better
environment so well. The immersive, virtual world may be an organized (all necessary materials were readily available on the
effective means for learning kinesthetic skills, but it is possible lab bench) than their real world lab experiments. Most students
that these techniques are so simple that seeing them occur on a felt that the virtual environment was novel, fun, and “user
computer screen or in person is sufficient for learning. Given friendly.” A representative response from a student was “The
that many educators feel that learning hands-on laboratory second life labs were also exciting because they were new and
skills is an important aspect of a student’s chemistry used technology which is more stimulating.” When asked about
education,36−38 these preliminary results of kinesthetic skills their equal preference for the virtual and real world lab
development should be investigated in more detail. environments, students most frequently responded that they
Student Attitudes enjoyed taking a break from their normal real world
Students in the SL group completed a semantic differential experiments so that they can do something different. Several
survey to compare the two types of lab environments (Table noted that the virtual lab experiments helped them appreciate
2). Results are reported as frequencies of students agreeing with their real world lab sessions. As one student wrote, “In the end,
the statement on the left (response values = 1 or 2), remaining after having done several Second Life labs, it was nice to be able
neutral (response value = 3), or agreeing with the statement on to return to a real lab and be able to see the minor color
the right (response values = 4 or 5). A chi-square goodness-of- changes as a titration goes through, or be able to feel especially
fit test was conducted to determine whether an equal number “Sciencey” as one goes through a lab.” While this was not a view
of participants (n = 18) agreed with the statement on the left, expressed by many students, it is an unexpected and interesting
middle, or right. Three of the five statements showed outcome, suggesting that real and virtual laboratory experi-
statistically significant differences between frequencies of ments can complement each other rather than compete for
students’ choices and the expected responses. They over- inclusion in a laboratory curriculum.
whelmingly reported that the SL experiments took less time to Like the students participating in this study, undergraduate
complete (X2 (2) = 35.055; p = 2.4 × 10−8). Their judgment of students performing a virtual PCR experiment in SL viewed
the SL experiment duration is in disagreement with the views of their virtual world experience positively, saying that it was easy
the TAs instructing the lab sessions, who noted that the real to perform and educational. In that study, the SL experiment
world and SL experiments took about the same amount of time helped them prepare for a similar real world lab experiment.20
for students to complete. A large portion of the SL group felt In that study, students performed either an SL-based activity or
that they received higher grades when completing the SL viewed a live demonstration of the PCR procedure as a prelab
experiments (X2 (2) = 12.473; p = 0.002). Despite their exercise. Author K.W. observed similar results when high
opinion that they received higher grades for the SL experiment school students performed an SL kinetics experiment.26 In the
assignments, students felt that they learned more from the real present study, equal numbers of students liked the SL and real
world experiments (X2 (2) = 7.564; p = 0.023). Students were world experiments. Most believed that the SL experiment
statistically evenly split in their opinion of choosing to perform required less time to complete, even if that was not necessarily
experiments in the virtual world (X2 (2) = 0.909; p = 0.635) or the case. In a study of using chemistry lab simulations as
whether they preferred doing computer laboratories or replacements for two real world experiments, high school
handling chemicals (X2 (2) = 3.309; p = 0.191). students felt that the virtual lab experiments were easier to
The authors did not have access to this group’s grades for perform than their real world versions.7 Those students had no
any of the lab experiments except for quiz scores of the two SL strong preference for either lab environment, showing equally
experiments. It is possible that they did receive lower grades for favorable attitudes about real experiments and the computer-
their other real world experiments than they did for the SL based simulations. Overall, these results suggest that student
855 DOI: 10.1021/acs.jchemed.6b00733
J. Chem. Educ. 2017, 94, 849−858
Journal of Chemical Education Article

attitudes may not be a barrier for introducing virtual world The TAs believed that they were more effective at
experiments into the curriculum. monitoring student progress in the real world laboratory
Observations by TAs because they could easily see how all students were doing and
assess the students’ nonverbal cues. In the virtual world lab,
In a focus group occurring near the end of the semester, TAs TAs could not see which menu options the students selected
related that students performing SL experiments appeared and, therefore, could not easily notice students’ mistakes.
comfortable and relaxed, perhaps because they are more The TAs felt that they could communicate and teach more
familiar with a computer lab than a chemistry lab and due to the effectively in the real world lab. The TAs explained that when a
lack of lab safety concerns and clothing restrictions. Other student in the control group asked a question, they were able to
reasons include a lesser pressure for accurate results, which was provide the answer to the entire class. This was not possible in
felt more in the real world lab, as well as the lack of familiarity the SL laboratory when students communicated with headsets
with using real lab equipment. The virtual world was a less so the TAs communicated to each student. The TAs suggested
challenging learning atmosphere for students, which may that they initially felt isolated in the computer lab. To alleviate
contribute to the more relaxed environment. Rather than this feeling, the TAs altered their behavior by walking around
students making decisions with many possible outcomes in the the computer lab to monitor students and answer questions.
real world lab, the act of choosing from a list of options with a The TAs provided suggestions for making the virtual learning
SL menu, “limited their ability to make mistakes,” according to environment more realistic such as providing more oppor-
one TA. tunities for students to make mistakes, providing a better means
The TAs stated that real world experiments had problems as for TAs to communicate with the entire class in the virtual
well, including limited equipment and space. Specifically for the world, and creating a database of the actions taken by each
butane gas experiment, students in the real lab were required to student’s avatars. TAs could review the list of actions to find the
share a hood, which resulted in a crowded environment. step which students performed incorrectly. They also suggested
Furthermore, limited equipment in the real world lab resulted that they conclude each SL session with a group discussion on
in more wait time for the students. Some TAs felt that waiting how the experiment would have operated differently in a real
gave students time to conduct their calculations and correct world lab, emphasizing possible sources of error. All of these
mistakes. Other TAs suggested that because the students had suggestions are technically feasible and will be considered when
their own computers in the virtual lab, there was no wait time, the virtual world experiments are updated.
which the students appreciated. According to most of the TAs, It is important for faculty to seek out the TAs’ views of
the virtual environment is helpful when real world space and laboratory innovations. As the primary instructor in the
equipment are limited. laboratory, TAs offer feedback about student behavior and
general attitudes which faculty can use to improve the quality of
When discussing students’ learning, the TAs emphasized the
the curriculum. Teaching assistants have a vested interest in the
importance of accuracy. TAs were present when students were
laboratory sessions running smoothly, and many care about
collecting their data and they could give feedback about the
their students’ education. The authors observed this based on
quality of students’ results. They also graded the lab reports,
the number of comments and thoughtfulness of TA feedback.
with grades based in part on accuracy of results. With the zoom Soliciting their views minimized their anxiety and negative
capability in SL, students were able to obtain a closer view of attitudes about the virtual world experiments. Program
the glassware. In the real world lab, students struggled with coordinators wishing to introduce SL-type experiments into
getting their lighters wet, working in crowded spaces, and the curriculum should be aware that TAs’ expectations of their
handling the glassware, all of which limited the accuracy of their role as instructors are based on their prior experiences.40 New
results. Overall, the TAs felt that students collected more lab environments can cause frustration because TAs are not
accurate results by performing the experiment in the virtual performing the role they anticipated. Training also influences
world as compared to the real world. their self-image as educators, and therefore it is important to
The TAs thought that the virtual environment limited highlight the potential differences in the TAs’ role in the real
students’ ability to identify sources of error. Often, students world and virtual world environments.39,40


attributed sources of error to the technology being used rather
than to laboratory sources. Students tended to make mistakes CONCLUSIONS
as they perform these procedures in the real world lab, which This pilot study demonstrates that experiments conducted in a
provides more opportunities to practice and refine these skills. virtual world have the potential to be a valid substitution for
Overall, to the TAs, the virtual world lab appeared more real world experiments in general chemistry. An analysis of
orderly with fewer students talking than in the real world lab. available, albeit minimal grade and survey data collected during
Students mainly spoke with their lab partners in the virtual lab, the first semester of this project shows that students performing
as opposed to more broadly communicating to other peers in experiments in a virtual world make reasonable learning gains.
the real world lab. Students asked more questions and there Of particular note is that students in the control group and SL
was a higher level of interaction in the real world lab. A virtual group performed equally well on a laboratory practicum.
world allows for the creation of the lab environment from Students performing the virtual world experiments held positive
scratch, without the common limitations of space and resources attitudes about virtual experiments. Future implementations of
in the real world. While providing individual sets of equipment these experiments will include the collection and analysis of
and materials makes the students’ work easier to perform, it more data, including more feedback from students to
diminishes the interactions that the student has with his or her understand which aspects of the virtual world experiments
peers as they manage the shared resources of the laboratory. were challenging and beneficial.
These trade-offs should be considered when designing the Additional studies are needed to support and expand upon
virtual world laboratory. these results. The ability of students to learn kinesthetic skills
856 DOI: 10.1021/acs.jchemed.6b00733
J. Chem. Educ. 2017, 94, 849−858
Journal of Chemical Education Article

via virtual experiments would make the SL learning environ- (5) Phipps, L. R. Creating and teaching a web-based, university-level
ment particularly beneficial for laboratory courses. The introductory chemistry course that incorporates laboratory exercises
optimum number of virtual experiments in a general chemistry and active learning pedagogies. J. Chem. Educ. 2013, 90, 568−573.
curriculum is unknown but worth determining. Of concern is (6) Dalgarno, B.; Bishop, A. G.; Adlong, W.; Bedgood, D. R., Jr.
that students in this pilot study felt that they learn less in the Effectiveness of a virtual laboratory as a preparatory resource for
distance education chemistry students. Comput. Educ. 2009, 53, 853−
virtual world. Finally, students participating in this study
865.
attended a large, public state university and performed their (7) Pyatt, K.; Sims, R. Virtual and physical experimentation in
virtual world experiments on campus under the supervision of a inquiry-based science labs: attitudes, performance and access. J. Sci.
lab instructor. Students conducting these experiments in an Educ. Technol. 2012, 21, 133−147.
asynchronous online course or at a different type of school may (8) Tatli, Z.; Ayas, A. Effect of a virtual chemistry laboratory on
experience different outcomes with regard to their learning and students’ achievement. J. Educ. Technol. Soc. 2013, 16, 159−170.
attitudes, so this is also worth investigating. As technology (9) Winkelmann, K. Virtual Worlds and Their Uses in Chemical
related to immersive virtual worlds improves, educators and Education. In Pedagogic Roles of Animations and Simulations in
programmers can design more realistic and complex laboratory Chemistry Courses, ACS Symposium Series 1142; Suits, J., Sanger,
activities, which education researchers can use to build upon M., Eds.; American Chemical Society: Washington, DC, 2013; pp
the results presented here. 161−179.
Readers interested in touring the SL laboratory or using the (10) Beck, D.; Perkins, R. A. Review of educational research methods
experiments in their classes are welcome to contact author in desktop virtual world environments: Framing the past to provide
K.W. or W.K.K. future direction. J. Virtual Worlds Res. [Online] 2014, 7. https://


journals.tdl.org/jvwr/index.php/jvwr/article/view/7077 (accessed
April 14, 2017)
ASSOCIATED CONTENT (11) Linden Lab Historical role playing communities in Second Life.
*
S Supporting Information http://secondlife.com/destinations/roleplay/historical (accessed April
Handouts for both SL experiments, lab quizzes, the 14, 2017).
(12) Holland, B.; Landry, K.; Mountain, A.; Middlebrooks, M. A.;
demographic survey and its analysis, and the laboratory
Heim, D.; Missildine, K. Weaving the tapestry of learning simulation,
attitudes survey are included in Supporting Information. The standardized patients, and virtual communities. Nurse Education 2013,
Supporting Information is available on the ACS Publications 38, 269−272.
website at DOI: 10.1021/acs.jchemed.6b00733. (13) Esteves, M.; Fonseca, B.; Morgado, L.; Martins, P. Improving
Introduction handout for gas law experiment (PDF) teaching and learning of computer programming through the use of
Introduction handout for precipitation titration experi- the Second Life virtual world. Br. J. Educ. Technol. 2011, 42, 624−637.
(14) Wang, Y.; Braman, J. Extending the classroom through Second
ment (PDF) Life. J. Info. Sys. Educ. 2009, 20, 235−247.
Lab quizzes (PDF; DOCX) (15) Nestler, V.; Moore, E. L.; Huang, K.-Y. C.; Bose, D. In the use of
Laboratory preference survey (PDF; DOC) Second Life® to teach physical security across different teaching
Demographic survey and analysis (PDF; DOCX) modes. In Information Assurance and Security Education and Training;


Dodge, Jr., R. C., Futcher, L., Eds.; Springer: Berlin, 2013; pp 188−
195.
AUTHOR INFORMATION (16) Ryoo, J.; Techatassanasoontorn, A. A.; Lee, D. Security
Corresponding Author education using Second Life. IEEE Security Privacy 2009, 7, 71−74.
*E-mail: kwinkel@fit.edu. (17) Vrellis, I.; Avouris, N.; Mikropoulos, T. A. Learning outcome,
presence and satisfaction from a science activity in Second Life.
ORCID Australasian Journal of Educational Technology 2016, 32 (1), 59−77.
Kurt Winkelmann: 0000-0002-2016-602X (18) Texas A&M University College of Veterinary Medicine and
Biological Sciences. TAMU Veterinary Medicine Class in Second Life.
Notes https://www.youtube.com/watch?v=I5VXf5Ky5ms (accessed April
The authors declare no competing financial interest. 14, 2017).

■ ACKNOWLEDGMENTS
The authors acknowledge Xandi Mars and Random Cole for
(19) August, S. E.; Hammers, M. L.; Murphy, D. B.; Neyer, A.;
Gueye, P.; Thames, R. Q. Virtual engineering sciences learning lab:
giving stem education a Second Life. IEEE Trans. Learn. Technol.
[Online] 2016, 9, 18−30.
their work in designing the SL experiments and laboratory (20) Cobb, S.; Heaney, R.; Corcoran, O.; Henderson-Begg, S. The
environment. The National Science Foundation TUES learning gains and student perceptions of a Second Life virtual lab.
program (Award #1140841) provided funding for this research.


Biosci. Educ. 2009, 13, 1−9.
(21) Prince William Sound College. Strategic Goals 2015−2016.
REFERENCES http://pwsc.alaska.edu/download/StrategicGoalsPWSC2015-2016_
(1) Leontyev, A.; Baranov, D. Massive open online courses in SinglePageView.pdf (accessed April 14, 2017).
chemistry: A comparative overview of platforms and features. J. Chem. (22) Keeney-Kennicutt, W. L.; Merchant, Z. H. Using Virtual Worlds
Educ. 2013, 90, 1533−1539. in the General Chemistry Classroom. In Pedagogic Roles of Animations
(2) Patterson, M. J. Developing an internet-based chemistry class. J. and Simulations in Chemistry Courses, ACS Symposium Series 1142;
Chem. Educ. 2000, 77, 554−555. Suits, J., Sanger, M., Eds.; American Chemical Society: Washington,
(3) Boschmann, E. Teaching chemistry via distance education. J. DC, 2013; pp 181−204.
Chem. Educ. 2003, 80, 704−708. (23) Merchant, Z.; Goetz, E.; Keeney-Kennicutt, W.; Kwok, O.;
(4) Casanova, R. S.; Civelli, J. L.; Kimbrough, D. R.; Heath, B. P.; Cifuentes, L.; Davis, T. J. The learner characteristics, features of
Reeves, J. H. Distance learning: a viable alternative to the conventional desktop 3-D virtual reality environments, and college chemistry
lecture-lab format in general chemistry. J. Chem. Educ. 2006, 83, 501− instruction: A structural equation modeling analysis. Comput. Educ.
507. 2012, 59, 551−568.

857 DOI: 10.1021/acs.jchemed.6b00733


J. Chem. Educ. 2017, 94, 849−858
Journal of Chemical Education Article

(24) Merchant, Z.; Goetz, E.; Keeney-Kennicutt, W.; Kwok, O.;


Cifuentes, L.; Davis, T. J. Exploring 3-D virtual reality technology for
spatial ability and chemistry achievement. J. Comput. Assist. Learning
2013, 29, 579−590.
(25) Lang, A. S.; Bradley, J.-C. Chemistry in Second Life. Chem. Cent.
J. 2009, 3, 14. http://ccj.springeropen.com/articles/10.1186/1752-
153X-3-14 (accessed April 14, 2017).
(26) Winkelmann, K.; Scott, M.; Wong, D. A study of high school
students’ performance of virtual chemistry laboratory in Second Life. J.
Chem. Educ. 2014, 91, 1432−1438.
(27) Okutsu, M.; DeLaurentis, D.; Brophy, S.; Lambert, J. Teaching
an aerospace engineering design course via virtual worlds: A
comparative assessment of learning outcomes. Comput. Educ. 2013,
60, 288−298.
(28) Merchant, Z.; Goetz, E. T.; Cifuentes, L.; Keeney-Kennicutt, W.;
Davis, T. J. Effectiveness of virtual reality-based instruction on
students’ learning outcomes in K-12 and higher education: A meta-
analysis. Comput. Educ. 2014, 70, 29−40.
(29) CHEM 111/112 Laboratory Manual, General Chemistry of the
Texas Environment, 6th ed.; Hayden McNeil Publishing: Plymouth,
MI, 2016.
(30) Salmon, G. The future for (second) life and learning. Br. J. Educ.
Technol. 2009, 40, 526−538.
(31) Edirisingha, P.; Nie, M.; Pluciennik, M.; Young, R. Socialization
of learning at a distance in a 3-D multi-user virtual environment. Br. J.
Educ. Technol. 2009, 40, 458−479.
(32) Winkelmann, K.; Keeney-Kennicutt, W. Chemistry World.
http://maps.secondlife.com/secondlife/Chemistry%20World/183/
48/26 (accessed April 14, 2017).
(33) Oh, K.; Nussli, N. Teacher training in the use of a three-
dimensional immersive virtual world: building understanding through
first-hand experiences. J. Teach. Learn. Technol. 2014, 3, 33−58.
(34) Chatterjee, S.; Williamson, V. M.; McCann, K.; Peck, L. M.
Surveying students, attitudes and perceptions toward guided-inquiry
and open-inquiry laboratories. J. Chem. Educ. 2009, 86, 1427−1432.
(35) Miles, H. C.; Serban, R. P.; Watt, S. J.; Lawrence, G. P.; John, N.
W. A review of virtual environments for training in ball sports. Comput.
Graph. 2012, 36, 714−726.
(36) Abraham, M. R.; Craolice, M. S.; Graves, A. P.; Aldhamash, A.
H.; Kihega, J. G.; Gal, J. G. P.; Varghese, V. The nature and state of
general chemistry laboratory courses offered by colleges and
universities in the United States. J. Chem. Educ. 1997, 74, 591−594.
(37) American Chemical Society. Importance of Hands-on
Laboratory Science. https://www.acs.org/content/acs/en/policy/
publicpolicies/education/computersimulations.html (accessed April
10, 2017).
(38) American Chemical Society Committee on Professional
Training. ACS Guidelines for Bachelor’s Degree Programs; Office of
Professional Training: Washington, DC, 2015.
(39) Sandi-Urena, S.; Gatlin, T. Factors contributing to the
development of graduate student assistant self-image. J. Chem. Educ.
2013, 90, 1303−1309.
(40) Gormally, C. Developing a teacher identity: TAs’ perspectives
about learning to teach inquiry-based biology labs. Int. J. Teach. Learn.
Higher Educ. 2016, 28, 176−192.

858 DOI: 10.1021/acs.jchemed.6b00733


J. Chem. Educ. 2017, 94, 849−858

You might also like