Professional Documents
Culture Documents
Ohio Distance Learning Initiative - COSI Youth Engagement and Learning Initiative - Mid-Year Library Report
Ohio Distance Learning Initiative - COSI Youth Engagement and Learning Initiative - Mid-Year Library Report
OHIO DISTANCE
LEARNING INITIATIVE PHASE 2
OHIO YOUTH ENGAGEMENT AND
LEARNING INITIATIVE
1
executive summary
For the start of its second year, the unprecedented
collaboration between the State of Ohio and the
Center of Science and Industry’s (COSI) provided
approximately 25,000 STEM education kits across
Ohio to 203 library districts within the Ohio Library
Counsel (OLC) network. Libraries were pinpointed
as a key location for supplemental local education opportunities for Ohioans from all walks of life.
By partnering with the Ohio Library Counsel, COSI and the State of Ohio have focused educational
resources, such as Learning Lunchboxes, to promote STEM in all areas of Ohio, great and small.
From after school activities to locations for homeschooling efforts, local libraries offer an important
social service for our state’s youth. In light of this, COSI’s partnership with the State of Ohio takes
direct aim at literacy rates by meeting students where they are to deliver engaging, hands-on STEM
education Learning Lunchboxes. This year, COSI explored the impacts of Learning Lunchboxes on
kit user’s reading, writing, communication, and language skills, which encompass the Ohio English
Language Arts (ELA) standards 1.
Nearly every student in the state had a disruption of some sort in their formal education as a result of
the COVID-19 pandemic 2 and numerous studies have shown negative impacts are especially true in
STEM education (Science, Technology, Engineering, and Mathematics) 3.
Our partner network has helped us deliver Learning Lunchboxes throughout the state of Ohio – a
fun, hands-on kit that provides five days’ worth of learning content around various topics, like our
Dinosaur themed box (Figure 1). Kit activities span a wide range of ages, aimed at K-8 but applicable to
anyone, and thus they can be done independently and/or with families, and are linked to Ohio Learning
Standards and Next Generation science standards. Learning Lunchboxes were once only distributed
at food banks during and directly after COVID-19 but with the reopening of schools and community
centers, Learning Lunchboxes are now available to any COSI partner.
To extend STEM learning and bring awareness to Ohio-based career options as well local STEM
related content, Learning Lunchboxes also include a STEM career connection resources, developed
in partnership with the Lt. Governor’s Office of Workforce Transformation, as well as links to COSI
Connects. COSI Connects is a digital resource focused on providing at-home, on-demand learning
opportunities that engage, inspire, and transform a student’s orientation toward STEM and acts as a
supplement to Learning Lunchbox activities. In addition, kits include a reading enrollment resource
through the Ohio Governor’s Imagination Library.
Since the beginning of this collaboration in 2021, COSI has distributed over 125,000 Learning
Lunchboxes throughout the state, with unprecedented engagement with local, state and federal
elected officials. Furthermore, COSI has engaged with approximately 150 other non-profit
organizations throughout Ohio in order to act as a connective tissue with more local organizations.
COSI’s mission is to be the best partner in science, technology, and industry learning and this project
fulfills this mission right in our own backyard.
1
See Ohio’s ELA Standards: https://education.ohio.gov/getattachment/Topics/Learning-in-Ohio/English-Language-Art/English-Language-Arts-Standards/ELA-Learning-Standards-2017.pdf.
aspx?lang=en-US
2
Kogan & Lavertu, 2021. How the COVID-19 Pandemic Affected Student Learning in Ohio: Analysis of Spring 2021 Ohio State Tests. Ohio State University.
3
Kogan & Lavertu, 2021. How the COVID-19 Pandemic Affected Student Learning in Ohio: Analysis of Spring 2021 Ohio State Tests. Ohio State University; Betthäuser, Bach-Mortensen &
Per Engzell. (2022) A systematic review and meta-analysis of the impact of the COVID-19 pandemic on learning.
2
table of contents
1. Cover
2. Executive Summary
3. Table of Contents
4. At a Glance
5. Report Snapshot
6. Methods
6.1 Learning Lunchbox Distribution Methods
6.2 Research and Evaluation Methods
8. Appendices
Thank you so much for the kits! Our families were so excited to receive them. We love that you thought of
public libraries as a good way to get them out in the community. We appreciate you.
– Maggie Bollar
New Carlisle Public Library
3
at a glance
Fig.1
The Center of Science and Industry (COSI), the #1 science center in the nation
by USA Today, has successfully executed an unprecedented model of
interactive community learning at the local, state, and federal levels,
called the COSI Connects Learning Lunchbox. Working in collaboration
with our executive partner network, COSI has developed and delivered
thousands of FREE Learning Lunchboxes – fun, hands-on STEM kits
that provide upwards of five days’ and 10 hours’ worth of learning
content around various topics, like Space, Energy, Dinosaurs, and
others (Figure 1).
These STEM kits are geared toward grade K-8 and have been used in
various ways from homeschools and classrooms, as an independent
learning activity or for family bonding, and in local Ohio libraries as value-
added content to currently running program and curricula (Figures 2-3).
To bridge the educational gap in underserved communities across the state of Ohio, educational gaps
that have been exacerbated by the COVID-19 pandemic 4 (Kogan and Lavertu, 2022), we partner with
local museums, meal providers, cultural institutions, libraries, and more – exposing youth to science,
technology, engineering, and math where they live, learn, and lounge. We distribute these kits to
underserved youth alongside meal providers, food banks, homeless, shelters, schools, and libraries to
“feed hungry minds and fulfill human services.” The kits feature community learning extension tools
(Figure 4), including:
• A digital welcome packet including activity guides and learning standards (Figure 4);
• COSI Connects digital learning assets to amplify learning with kit extension activities;
• Digital resources in partnership with PBS, with QED with Dr. B;
• Supplemental literacy and cultural resources including The Color of Science
passport: Dinosaurs as well as information from the Ohio Department of Fig.2
4
Kogan & Lavertu, 2021. How the COVID-19 Pandemic Affected Student Learning in Ohio: Analysis of Spring 2021 Ohio State Tests. Ohio State University.
4
library distribution
m ilyhoamct
report snapshot
a ardnerful d enjoy
ed
e
n
excited
kidwle
y
o
opportunit
inosaur
y fr
by the numbers
commun
mer
sum s
ent
library
d
r
u
la
ity
st
pu
en
o
s
p
g
pp rea t k
dr
re t han
hil le
25,000 86 150
ciac d
pro te l un
vide earners f ols
parents scho
of Dinosaur Learning Lunchbox
Counties non-profit partners
kits were distributed helped in this project
Word Cloud of the top 30 words used to describe the ODLI
Library Learning Lunchbox distribution program
distribution
50,000+ 203 of 251 map
people in Ohio were Library Districts Impacted
impacted
77% 78%
very much satisfied very much satisfied
10%
18% little 12% 9% 9%
huge moderate somewhat somewhat
satisfied satisfied
39%
huge
26% 46% 50% 91% 91%
a lot moderate a lot
very much satisfied very much satisfied
5
methods
Learning Lunchbox Distribution Methods
Distributing over 25,000 Learning Lunchboxes across Ohio’s 251 public library systems required partnering
and planning with the Ohio Library Counsel (OLC). The Ohio Library Counsel is a statewide professional
association with represents the interest of Ohio’s public libraries, their trustees, Friends, and staff 5. Their
network represents 8.4 million library cardholders 6 across these 251 library districts in Ohio.
Once the COSI-OLC partnership established a distribution plan, COSI distributed over 25,000 Learning
Lunchboxes to OLC in early summer 2022 for further distribution to their library districts. During the week
of July 11, 2022 7, OLC then distributed approximately 100 kits each to 203 of their 251 library districts (81% of
districts represented in the OLC network) that of which then distributed a portion of their kits to individual
library branches within their district (Figure 5; flowchart). Once in the hands of librarians themselves, COSI
Learning Lunchboxes were used in a multitude of different ways, including but not limited to:
• distribution of 1-2 kits per family on a first-come first serve basis (Figures 6-7);
• to children K-12 who participated in in-library programming (Figures 8-10);
• from a mobile bookmobile that visited communities further away from the library (Figure 11);
• to homeschools and their learners (Figure 12);
• to local schools and classes (Figures 13-15);
• local politicians helped hand out kits and encourage STEM learning (Figures 16-17); and
• Learning Lunchboxes were used to encourage summer reading adventures for learners of all
ages (Figure 18).
Fig.5
COSI OLC
rary Distric r
Br
ary anch
b b
ts
Li
es
Li
r Re
ading Pr Library Prog tical Outreac
all oli
og
me r er
ra
m
P
m
h
am
Ov
Su
s
s
6
Fig.6 Fig.7
Fig.11
Fig.10
Fig.8 Fig.9
Figure 6: Libraries, such as Salem Township Public Library, Granville Public Library, and Figure 13: Schools received Learning Lunchboxes from libraries such as Belle Center Free
Marietta Branch Library, distributed Dinosaur Learning Lunchboxes to their patrons using Public Library.
fliers and offering kits on a first-come first-serve basis. Figure 14: Local students received Learning Lunchboxes from the St. Clairesville Public
Figure 7: Families, such as those at Brown County Public Library, came to pick up a Library.
Learning Lunchbox. Figure 15: Coshocton County Public Library System distributed kits to local schools and
Figure 8: Young students excited to receive Learning Lunchboxes at Ritter Public Library. classes.
Figure 9: Young learners at Granville Public Library were excited to receive their Dinosaur Figure 16: Senator Tim Young helped distribute kits at Washington-Centerville Public
Learning Lunchbox. Library.
Figure 10: Families worked on Learning Lunchbox activities in libraries such as Euclid Figure 17: Senator Jay Hottinger helped distribute Learning Lunchboxes at Perry County
Public Library. District Library.
Figure 11: Madison Public Library distributed Learning Lunchboxes from their mobile Figure 18: New Carlisle Library distributed Learning Lunchboxes at a local park during a
bookmobile. summer reading adventure program.
Figure 12: Learners in a homeschool group received Dinosaur Learning Lunchboxes from
Henderson Memorial Public Library.
5
Information retrieved from: https://olc.org/about-us/
6
Information retrieved from: https://olc.org/wp-content/uploads/2022/05/COSI-and-OLC-Press-Release-06.22-1.pdf
7
Information retrieved from: https://olc.org/blog/2022/05/16/recording-available-of-cosi-learning-lunchbox-webinar/
7
Research and Evaluation Methods
Of the 203 library districts who received Learning Lunchbox
STEM learning kits from COSI through the OLC distribution
under the Ohio Distance Learning Initiative, 147 responses
(72.4%) were recorded to the online questionnaire deployed
by COSI researchers (Appendix 1; libraries listed in bold).
Responses were collected over a 3-week period using the
Qualtrics online platform. Questions included in the survey
included demographic information (e.g., rural, urban, or
suburban location; zip code-based data), access to reliable
internet for patrons, the use and distribution of Learning
Lunchboxes for each library, and if there were any populations
of interest when distributing STEM learning kits (see Results section 7.11).
In addition, questions in the survey instrument included inquiries to if the Dinosaur kit helped increase
reading, writing, communication, and/or language skills in learners (i.e., impacts on Ohio English Language
Arts (ELA) standards 8 ), if engagement with Dinosaur themed library resources increased after distribution,
if learners became more aware of STEM careers on the topic of Dinosaurs, if the kit was accessible/teachable
for adults interacting with kit recipients, and if the Learning Lunchbox is an effective tool to increase
engagement with STEM (see Results section 7.12 and Appendix C for survey instrument). The survey
instrument built upon previous year’s research and evaluation questions and was broadened to include
questions assessing the potential impacts on ELA Standards. Research and evaluation conducted by COSI
follows the logic model in Appendix D.
Due to the long distribution chain for Learning Lunchboxes (Figure 5), kit users were not available for
research purposes; however, COSI research and evaluation team members are working with our partners to
create an appropriate feedback model to gather and analyze this information.
At the close of the survey instrument, data were downloaded and analyzed using Microsoft software (i.e.,
Excel). Qualitative data (testimonials from the survey comments section) were checked for spelling and then
imported into wordart.com for cleaning. The top 30 words were used to create the word cloud (see page 13).
Results of the quantitative analyses are outlined in report section 7.1 and the qualitative results are outlined
in section 7.2. Results and interpretation are given below for each of these questions in the survey.
8
See Ohio’s ELA Standards: https://education.ohio.gov/getattachment/Topics/Learning-in-Ohio/English-Language-Art/English-Language-Arts-Standards/ELA-Learning-Standards-2017.pdf.
aspx?lang=en-US
8
results and outcomes:
Quantitative Outcomes
Recipients of Learning Lunchboxes
Receipt communities of Dinosaur learning Lunchboxes were largely rural (67%), with 27% identifying as
suburban and 6% as urban locations (Figure 19). According to librarians who responded to the survey, 67-
77% of their library patrons have reliable internet where they sleep at night. Connectivity to the internet is an
important aspect of distance learning and thus important to note when distributing digital learning materials
to learners across a wide geographic scale. These estimates are based on conjecture and are somewhat
lower than assessed by the 2018 American Community Survey 9 which found that one in six Ohio households
(83%) have a broadband connection.
70 65%
these Demographics
60
50 47%
40
30 24%
20
10%
10 7%
2%
0
9
Data accessible at https://www.census.gov/programs-surveys/acs/data.html
9
Overall Educational Impacts
COSI Learning Lunchboxes aim to promote learning through engaging STEM activities, including fun
and hands-on learning opportunities. To this end, the kits seek to achieve the following goals:
1). offer a tool to effectively increase engagement with science;
2). promote extended interest in STEM learning;
3). educate learners on career opportunities across each theme of Learning
Lunchbox (e.g., Space, Energy, and Dinosaurs); and
4). provide parents, caregivers, educators, and other learning facilitators the tools they need to
make learning fun and engaging.
The following data show results of inquiries into each of these facets.
Four questions in the survey assessed these outcomes with respondents asked to score their response on a
5-tiered impact scale, listed below from most to least impactful.
• Huge
“
• A lot The kits generated a lot of excitement among
• Morderate our patrons and brought a lot of people into the
• Little library, both regulars and new visitors.”
• Not at all
— Betsy Wernert
Granville Public Library
Due to the distribution model for Learning Lunchboxes, not all librarians surveyed were able to assess these
impact outcomes thus respondents were also given the option of selecting “Unknown”. Unknown responses
are given for each question, below.
1). When asked if Learning Lunchboxes 2). When asked if Dinosaur themed
were an effective tool to increase Learning Lunchboxes increased
engagement with science, 55% of engagement with science content in
librarians responded with 66% of the library, 38% of librarians responded
respondents stating the kits increased with 16% of respondents stating the
engagement with science “a huge kits increased engagement with
amount”. 30% responded the kit library materials by a “huge” amount.
increased engagement “a lot” and 5% 48% responded the kit increased
reported engagement increased “a engagement “a lot”, 11% reported
moderate amount”. No respondents engagement increased “a little”, and 0%
reported “little” to “no” engagement. responded “not at all”.
3). When asked if Dinosaur themed 4). When asked if adults felt
Learning Lunchboxes increased comfortable with the STEM content
awareness of careers related to the presented in the Dinosaur Learning
topic of the kit, 27% of librarians Lunchbox, 42% of librarians responded
responded with 18% of respondents with 39% of respondents stating adults
stating the kits increased awareness felt a “huge” amount of comfort with the
a “huge” amount. 26% responded the STEM content. 50% responded adult
kit increased awareness “a lot”, 10% comfort to be “a lot”, and 12% adults felt
reported awareness increased “a little”, moderately comfortable with the STEM
and 0% responded “not at all”. content. No respondents selected “A
little” or “not at all”.
10
Ohio ELA Standards Outcomes
According to the State Board of Education, Ohio’s Learning Standards for English Language Arts (ELA)
encompasses four overarching skills: reading, writing, communication (speaking and listening) and
language 10. In the questionnaire to libraries who received the Learning Lunchbox Dinosaur STEM learning
kits, eight questions were asked, two for each skillset. Each question was given as a 4-tiered satisfaction
scale, listed here from most-to-least satisfaction of Ohio ELA Standards. The response scale is given below.
• Very much satisfied
• Somewhat satisfied
• Somewhat dissatisfied
• Not at all satisfied
In addition, each question allowed for respondents to choose “Unknown” if they did not witness recipients
interact with the kits or could not say if they saw outcomes from kit interactions.
In the following section, each skill section will be contextualized and results are interpreted therein. Due to
the distribution model (Figure 5), not all librarians were able to assess ELA standards for recipients of the
Learning Lunchboxes thus these results have varied response rates for each question under evaluation,
outlined below.
“
Thank you so much for making
these kits available to libraries.
We have had a lot of parents that
love the kits and the activities
included. The kids learn so much
from the activities in the kits.
— Carrie Radman
Columbiana Public Library
10
Information retrieved from: https://education.ohio.gov/getattachment/Topics/Learning-in-Ohio/English-Language-Art/English-Language-Arts-Standards/ELA-Learning-Standards-2017.
pdf.aspx?lang=en-US
11
Reading
Impacts on reading were evaluated with The second question asked if kits
two questions. When asked if recipients helped increase overall reading (e.g.,
of Learning Lunchboxes resulted in an 1% recipients read more about themes 3%
increased the sophistication of what 22% related to the kit), 43% of librarians 27%
they read (e.g., specific dinosaurs vs. somewhat responded with 70% of respondents somewhat
satisfied satisfied
dinosaurs in general), 40% of librarians stating the kits very much satisfied this
responded with 77% of respondents 77% learning standard. 27% responded the 70%
very much satisfied very much satisfied
stating the kits very much satisfied this kit somewhat satisfied this standard
learning standard. 22% responded the and 3% responded negatively (i.e.,
kit somewhat satisfied this standard somewhat dissatisfied).
and 1% responded negatively (i.e.,
somewhat dissatisfied).
Writing
Impacts on writing were evaluated with The second question asked if kits
two questions. When asked if recipients helped recipients draw on information
of Learning Lunchboxes promoted 1% they gathered (e.g., used references 3%
writing (e.g., in the activity book), 36% in activity/library books to draw
19%
of librarians responded with 66% of 32% conclusions), 39% of librarians somewhat
satisfied
respondents stating the kits very much somewhat responded with 78% of respondents
satisfied this learning standard. 32% 66% satisfied
stating the kits very much satisfied this 78%
very much satisfied very much satisfied
responded the kit somewhat satisfied learning standard. 19% responded the
this standard and 1% responded kit somewhat satisfied this standard
negatively (i.e., somewhat dissatisfied). and 3% responded negatively (i.e.,
somewhat dissatisfied).
Language
Impacts on language were evaluated The second question asked if kits
with two questions. When asked if aided in understanding English (e.g.,
recipients of Learning Lunchboxes 9% pronunciation or word use), 31% of
broadened vocabulary (e.g., learned somewhat librarians responded with 77% of
or used at least one new word), 43%
satisfied
respondents stating the kits very much
33%
somewhat
of librarians responded with 91% of satisfied this learning standard. 33% satisfied
respondents stating the kits very much 91% responded the kit somewhat satisfied 77%
very much satisfied very much satisfied
satisfied this learning standard. 9% this standard and 0% responded
responded the kit somewhat satisfied negatively (i.e., somewhat dissatisfied).
this standard and 0% responded
negatively (i.e., somewhat dissatisfied).
12
qualitative outcomes
Testimonials
Librarians who responded to the online survey were given the opportunity to comment on their experiences
with the the Learning Lunchbox program through COSI. The results of these comments have been compiled
below in a word cloud. Large text denotes a word that has been used more frequency in comments. Small
words are less frequent. Below the top 30 words are illustrated. Other testimonials and comments can be
found throughout this report with a full list available in Appendix B.
m il y a c
hom t
a ardnerful d enjoy
ed
n e l osaur t
excited
id le
y
o
wo
opportunit
in
v
y fr commun
mer
sum s
k
ent
te
library
d
r
lar
es
u
ity
st
pu
n
po
gr s
e
k
dr
pp ea t
re t han il le
cia ch d
tpro e l fun
vide earners ols
parents sc ho
We held a program at the library specifically to distribute the Learning Lunchbox Kits. We had several families
attend because the children remembered and enjoyed the kits last year and were excited to receive this year’s
kit”.
– Amee Sword
Wornstaff Memorial Public Library
All students enjoyed the activities in these I’m so grateful that COSI is helping to put
lunchboxes and my staff of educators science into the hands of young learners.
especially appreciated that the content within Thank you!
the lunchboxes could be easily adapted to – Samantha Nicholson
meet the needs of various learners. Willoughby-Eastlake Public Library (Eastlake Branch)
– Dani Weiser-Cline
Kingsville Public Library
Our patrons are really excited about using the kit. We are a lower income, rural community and our patrons were
so grateful to have fun inexpensive activities to do at home. Many are now planning trips to COSI in the future.
Thank you for giving us the opportunity to participate in a wonderful program”.
– Dianne Piper
Kinsman Free Public Library
We love the learning lunchboxes! Our library hosts a monthly homeschool STEAM program and we had already
planned to use a dinosaur theme. The learning lunchboxes went home with families to encourage further
exploration. We also offered them to other interested families and also sent some to our local school for use
with the intervention classrooms.
– Christine Mills
Greenwich Branch, Huron County Community Library
We distributed them at an event that drew These are really well loved by community
over 100 children so we could have used more members, but the demand is higher than the
kits. They were popular. amount of kits received.
– Pam Saganich – Annamarie Carlson
Girard Free Library Upper Arlington Public Library
While we distributed boxes intended for home use, a few of our young independent patrons chose to open and
get started right in the library. One young child working with an older sibling came to the desk with questions
about the origin of dinosaurs. Thinking outside the box!
– Mary Bird
Akron Summit County Public Library (Norton Branch)
14
Appendix A
All Libraries and Library Districts in OLC Distribution
The following includes all libraries in the OLC library distribution occurring in summer 2022. Those listed
in BOLD responded to the COSI research and evaluation questionnaire regarding their experiences with
the impacts of the Learning Lunchbox Dinosaur kit. Libraries listed with n=2 reflect two unique survey
responses.
Library Name OH County
15
Library Name OH County
16
Library Name OH County
17
Library Name OH County
18
Library Name OH County
19
Library Name OH County
20
Library Name OH County
21
Library Name OH County
22
Library Name OH County
23
Library Name OH County
24
Library Name OH County
Willoughby-Eastlake Lake
25
Appendix B
Testimonials
Participant Library
Name Statement
Bucyrus
All of the families were simply blown away that COSI offered
Barbara Scott Public
something like this for FREE!
Library
I administrated a six week afterschool program that utilized the
learning lunchbox kits with three separate groups of 25 K-5 grade
children. I can say that these kits were extremely popular. Each
of our groups included children identified by the school district as
Kingsville gifted, children who self-identified as being diagnosed with ADD/
Dani Weiser-Cline Public ADHD, and students identified by their teachers as being below
Library grade level, along with a fair amount of typical and on-track
learners. All students enjoyed the activities in these lunchboxes
and my staff of educators especially appreciated that the content
within the lunchboxes could be easily adapted to meet the needs
of various learners.
Willoughby-
I've actually seen quite a few kids get super excited when they
Eastlake
do an activity and it works out the way it should. Everything from
Public
Samantha Nicholson squeals to "Mom! Mom! Watch this!" I'm so grateful that COSI is
Library
helping to put science into the hands of young learners. Thank
(Eastlake
you!
branch)
North Just thank you! The patron interest level has been amazing.
Canton Last year our registration for 50 kits filled up within probably
Jamie Macris
Public 20 minutes. This year with 100 kits, we were filled up within 12
Library minutes!
New Our families love the COSI kits so much that a donor has
Madison sponsored for us to give them out. We have ordered & dispensed
Brenda Miller
Public 2 other kits. Our 3rd kit will be handed out next month. Our
Library homeschool families also love them for additional fun science.
Bucyrus
All of the families were simply blown away that COSI offered
Barbara Scott Public
something like this for FREE!
Library
I administrated a six week afterschool program that utilized the
learning lunchbox kits with three separate groups of 25 K-5 grade
children. I can say that these kits were extremely popular. Each
of our groups included children identified by the school district as
Kingsville gifted, children who self-identified as being diagnosed with ADD/
Dani Weiser-Cline Public ADHD, and students identified by their teachers as being below
Library grade level, along with a fair amount of typical and on-track
learners. All students enjoyed the activities in these lunchboxes
and my staff of educators especially appreciated that the content
within the lunchboxes could be easily adapted to meet the needs
of various learners.
26
Participant Library
Name Statement
Willoughby-
I've actually seen quite a few kids get super excited when they
Eastlake
do an activity and it works out the way it should. Everything from
Public
Samantha Nicholson squeals to "Mom! Mom! Watch this!" I'm so grateful that COSI is
Library
helping to put science into the hands of young learners. Thank
(Eastlake
you!
branch)
North Just thank you! The patron interest level has been amazing.
Canton Last year our registration for 50 kits filled up within probably
Jamie Macris
Public 20 minutes. This year with 100 kits, we were filled up within 12
Library minutes!
New Our families love the COSI kits so much that a donor has
Madison sponsored for us to give them out. We have ordered & dispensed
Brenda Miller
Public 2 other kits. Our 3rd kit will be handed out next month. Our
Library homeschool families also love them for additional fun science.
Our patrons are really excited about using the kit. We are a lower
Kinsman income, rural community and our patrons were so grateful to
Dianne Piper Free Public have fun inexpensive activities to do at home. Many are now
Library planning trips to COSI in the future. Thank you for giving us the
opportunity to participate in a wonderful program.
Our patrons were very, very excited for these kits. Our only issue
was how few we received for the overall demand. We distributed
Upper
all of the kits in a day, and we had families calling us for weeks
Arlington
Annamarie Carlson after, some angrily, that we didn't have any additional kits to
Public
distribute or a place for families to call to get one from another
Library
source. These are really well loved by community members, but
the demand is higher than the amount of kits received.
Columbiana Thank you so much for making these kits available to libraries.
Carrie Radman Public We have had a lot of parents that love the kits and the activities
Library included. The kids learn so much from the activities in the kits.
New
Thank you so much for the kits! Our families were so excited to
Carlisle
Maggie Bollar receive them. We love that you thought of public libraries as a
Public
good way to get them out in the community. We appreciate you.
Library
Rock Creek The community was very happy to have these. Because we are
Edward Worso Public a tiny, rural library, other libraries in neighboring counties sent
Library people to us and it raised the awareness of our little library.
Holmes
County
The dinosaur theme was a big hit with our patrons, and parents
Paula Cicconetti District
asked when we would be hosting future programs.
Public
Library
27
Participant Library
Name Statement
The experience was great and drew a lot of patrons to our fairly
small library. I had "Paleontologist" nametags created so the kids
Defiance could wear them and act as paleontologists for the duration of
Victoria Schmersal Public the program. During our activity, we used the Events in Earth's
Library History and Tooth or Toe cards as interactive games, which
the kids loved! Thank you so much to all the individuals who
researched and put together these boxes.
Greene
The kits are great and provide an awareness of STEM and how
County
Kim Bautz important it is in our world today. Thank you for offering these
Public
kits.
Library
Champaign The kits are very well done. Our patrons have been very
Pam Sanders County impressed with the quality and the content. They were especially
Library excited about the free admission into COSI.
Granville The kits generated a lot of excitement among our patrons and
Betsy Wernert Public brought a lot of people into the library, both regulars and new
Library visitors.
The Learning Lunchbox Kits are a big hit with our young patrons
Wagnalls and families! We run out of them every year! It is a wonderful
Amy Hesterman
Memorial statement from COSI who is willing to partner with libraries to
create amazing opportunities for further learning and discovery!
The local school had a fog day, so many ended up here at the
library. They kept telling us how bored they were. I asked if they
would like to do some science experiments. Everyone wrinkled
Montpelier
their noses. I finally got one to participate. As we started opening
Angela Humphrey Public
the kit, more kids started hovering to see what was going on. We
Library
ended up with 7 kids who spent almost 2 hours with me using
the Learning Lunchbox kits. They couldn't stop telling me and
anyone who would listen how much fun they had!
Coshocton The students were very excited about the admission ticket to
Corazon Britton Public COSI. My area is lower income and many do not leave the county
Library so this provides a reason for children and families to visit COSI.
Fairfield These are wonderful kits! Our kids were so excited to see them--
County and for free! We did have several families tell us how much they
Shannon Keese
District enjoyed the activities. We passed them out to school age kids for
Library "Dinovember."
These kits were HUGELY popular and I hope we will be able to
distribute them again. My impression is that COSI has a great
Cuyahoga
Amy Galluch reputation in our community as an educational institution that is
Falls Library
also fun for families. Distribution of the kits benefited both the
families and the library...win-win!!
These learning lunch boxes are great and we are so thankful to
Ashland the folks that work so hard to make it possible for us to distribute
Lindsay Brandon-Smith Public them each summer. Even my 15 year old daughter was engaged
Library and learned something new from this Dinosaur kit. They are
superb.
28
Participant Library
Name Statement
These were given out on 10/12/22 for National Fossil Day and were
on a first-come, first-served basis. We allocated some to each of
Clark
our 5 branches based on their circulation stats/population. They
County
Sonya Knisley went VERY QUICKLY! Our staff was sad they could not get one
Public
themselves and some patrons wished they could get multiple.
Library
Additional info from questionnaire--we have a system that has a
few urban, a rural, and a suburban branch.
They are extremely popular. Our only challenge has been how
to distribute them so that children and families at each of our 7
branches benefit. The model we landed on was dividing them
Athens proportionally to the population size served by each branch,
County and smaller branches who received fewer kits were asked not
Taryn Lentes
Public to advertise them but rather hand them out to specific targeted
Libraries children who we knew would benefit and might not have access
to many other resources. We've heard nothing but positive
feedback from those who are able to get the kits and we're very
grateful for them.
This was a wonderful experience for our kids. We are very rural
and were able to provide kits to the "Stars" program at the school
Wayne
which is a summer program to help student with learning and
Teresa Barnhart Public
provide day care for parents at a reasonable or reduced rate
Library
depending upon income. Homeschoolers also appreciated the
kits.
We are loving these and they are always a huge hit. We had one
Delphos
family come in to show us how they used the kit! It was so fun to
Rachel Strahm Public
see their excitement over what they had learned. They were so
Library
proud of themselves.
Girard Free We distributed them at an event that drew over 100 children so
Pam Saganich
Library we could have used more kits. They were popular.
Muskingum We had a great amount of interest in the Learning Lunchboxes.
County We made a pickup event for the boxes and in addition to the 100
Haley Shaw
Library people who got boxes we had a waitlist of over 100 people long.
System Our community loves these boxes!
Wornstaff We held a program at the library specifically to distribute the
Memorial Learning Lunchbox Kits. We had several families attend because
Amee Sword
Public the children remembered and enjoyed the kits last year and were
Library excited to receive this year's kit.
Greenwich We love the learning lunchboxes! Our library hosts a monthly
Branch, homeschool STEAM program and we had already planned to
Huron use a dinosaur theme. The learning lunchboxes went home
Christine Mills
County with families to encourage further exploration. We also offered
Community them to other interested families and also sent some to our local
Library school for use with the intervention classrooms.
29
Participant Library
Name Statement
We passed these kits out in connection with International
Dinosaur month (October). Our children's area was decorated
to be a dino dig site. The kids had a blast searching for the
Delta Public
Jenn Griewahn dinosaurs. When they were leaving we would offer the kit. So
Library
many, were excited to continue their dino adventure at home.
We have a lot of home school families and they too were very
grateful for the additional activities.
Perry
We, along with our families, truly appreciate the kits and feel they
County
Melissa Marolt are a wonderful opportunity for not only learning, but also family
District
engagement. Thank you so much!
Library
Norton
Branch While we distributed boxes intended for home use, a few of our
- Akron young independent patrons chose to open and get started right
Mary Bird Summit in the library. One young child working with an older sibling came
County to the desk with questions about the origin of dinosaurs. Thinking
Public outside the box!
Library
30
Appendix C
Survey Instrument for Research and Evaluation
The following is a copy of the online questionnaire used to solicit responses from libraries who received
Dinosaur Learning Lunchbox kits from COSI and the Ohio Library Council through the ODLI program in
2023.
31
7). If you did not distribute or use all of the Learning Lunchbox kits yet or distributed or used them in a way
not listed above, can you please elaborate? If this question is not applicable, please type “NA” in the
field.
8). Did you, or will you, focus on distributing/using the Learning Lunchbox science kits to/with any
populations in particular? Please choose all that apply.
8a). No specific population(s) were pinpointed
8b). K-5 learners (elementary school)
8c). 6-8 learners (middle school)
8d). 9-12 learners (high school)
8e). Low-income families, specifically
8f). Local minority population(s), specifically
8g). Any family who showed interest (no specification on population)
8h). Other
9). As a tool to increase a learner’s English Language Arts skills, what is your perceptions of how
satisfactorily the Learning Lunchbox program impacted the following skills in patrons who interacted with
the kits? Please choose each answer following this scale for each question: Not at all satisfied, Somewhat
dissatisfied, Somewhat satisfied, Very much satisfied. The examples given are possible outcomes - there
could be others! If you did not witness any learners interacting with the science kits, please choose
“Unknown”.
9a). Increased sophistication of what patrons read (e.g., specific dinosaurs vs. dinosaurs in general)
9b). Increased overall reading (e.g., patrons read more about themes related to the kit)
9c). Promoted writing (e.g., in the activity book)
9d). Drew on information they gathered (e.g., used references in activity/library books to draw conclusions)
9e). Encouraged communication with others (e.g., worked together on activities; asked questions)
9f). Increased listening skills (e.g., held attention while directed by adult; watched activity videos linked in kit)
9g). A broadened vocabulary (e.g., learned or used at least one new word)
9h). Aided in understanding English (e.g., pronunciation or word use)
10). If you witnessed learners exploring activities from the Learning Lunchbox kit, please respond to the
following statements according to how much you agree. Please choose each answer following this scale
for each question: Not at all, A little, A moderate amount, A lot, A huge amount. If you did not witness
interactions, please choose “Unknown”.
10a). Learners who interacted with the Learning Lunchbox increased their engagement with science content in the library
(e.g., checked out a book or movie about science/dinosaurs)
10b). The learners became aware of a career related to the topic of the kit
10c). Adults and caregivers who used the kits with learners, felt comfortable with the STEM related content
10d). The Learning Lunchbox is an effective tool to increase engagement with science
11). Final Question; Optional: Do you have any additional thoughts or comments about your experience
with the COSI Learning Lunchbox Kits? In addition, if you have a personal anecdote of a learner’s
interaction with the Learning Lunchbox kit, we would love to hear it!
32
Appendix D
Research and Evaluation Logic Model
This is the logic model created and utilized to evaluate the ODLI distribution flow and learning outcomes stemming from the
Learning Lunchbox program.
Mid-Term Long-Term
Inputs Audiences Activities Outcomes
Outcomes Outcomes
Improve distribution to focal
Determine distribution range of Utilize survey information to assess
demographic groups for the LL
State of Ohio 25,000 Dinosaur LL to assess if librarians distributed LL kits to
program, specifically under-resourced Create a best practices for the
State of Ohio certain demographic populations method of distribution/use of LL to
investment demographic representation of (e.g., age or grade ranges, rural or
families with K-8 learners across all
races and ethnicities within urban and libraries across the state of Ohio
distribution urban, low income)
rural areas.
33
About COSI
The Center of Science and Industry (COSI), located in Columbus, Ohio, is a dynamic, hands-on science
center with more than 56 years of award-winning expertise in providing engaging, inspiring, and
transforming learning experiences. COSI cultivates a vibrant learning ecosystem for all people,
helping ensure we are scientifically literate, critically aware and thoughtfully engaged. From hands-
on interactive exhibits in themed exhibition areas, and a state-of-the-art planetarium, to traveling and
education outreach programs, COSI delivers science and science educational experiences both in its
building and far beyond its walls. With unprecedented partnerships, COSI has positioned itself as a
national powerhouse museum with content and experiences for people of all ages. Located on Central
Ohio’s burgeoning Scioto Peninsula, the epicenter of Columbus’ downtown redevelopment, COSI stands
as a leading cultural institution and destination attraction for regional, national, and international
audiences. COSI was named #1 Science Museum in the Nation by - USA TODAY 10Best Readers’ Choice
2020, 2021, and 2022. For more information, visit cosi.org.
34
333 West Broad Street
Columbus, OH 43215
614.228.2674 | cosi.org
35