Download as pdf or txt
Download as pdf or txt
You are on page 1of 12

RESEARCH

Original Research

A Randomized Controlled Trial of Three School


Meals and Weekend Food Backpacks on Food
Security in Virginia
Michael Burke, PhD, MPH; Charlotte Cabili, MS, MPH; Danielle Berman, PhD; Sarah Forrestal, PhD; Philip Gleason, PhD

ARTICLE INFORMATION ABSTRACT


Article history: Background Food insecurity is a concern for the health and well-being of low-income
Submitted 13 January 2020 children in the United States. School-based nutrition assistance programs aim to reduce
Accepted 27 October 2020 food insecurity; however, there is limited evidence of their combined impact on food
insecurity among children (FI-C).
Keywords: Objective This study tested the impact of the Virginia 365 demonstration project on
Food security the food security status of children attending low-income schools.
National School Lunch Program
School Breakfast Program
Design A cluster-randomized trial was conducted from 2016 to 2017 with baseline and
Child and Adult Care Food Program follow-up surveys.
Food backpacks Participants/setting Households with children who attended a treatment (n ¼ 19) or
control (n ¼ 19) school in rural and urban Virginia were included.
2212-2672/Published by Elsevier Inc. on behalf of Intervention Treatment schools became food hubs where children had access to free
the Academy of Nutrition and Dietetics. This is an breakfast, lunch, and supper on school days, and a food backpack on weekends and
open access article under the CC BY-NC-ND license school breaks. Control schools implemented a similar, but less robust set of benefits.
(http://creativecommons.org/licenses/by-nc-nd/
4.0/).
Main outcome measures The primary outcome was the percentage of children clas-
https://doi.org/10.1016/j.jand.2020.10.026 sified as FI-C as measured by the US Department of Agriculture Household Food Security
Survey Module. Secondary outcomes included very low food security among children
and food security among households and adults.
Statistical analysis performed Logistic regression models tested the impact of the
demonstration on FI-C and secondary outcomes adjusting for baseline household and
individual characteristics.
Results At follow-up, 1,393 treatment households and 1,243 control households
completed a survey sufficiently to be included in the analysis. The rate of FI-C in
treatment households was higher at 25.9% compared with 23.9% in control households,
a difference of 2 percentage points (95% CI 0.1 to 3.9). The rate of very low food security
among children in treatment households was lower at 3.2% compared with 3.9% in
control households, a difference of 0.7 percentage points (95% CI 1.3 to 0.10).
Conclusions Although the distinction in nutrition assistance benefits between treat-
ment and control schools was less than planned, providing a suite of school-based
nutrition assistance programs targeted broadly to low-income households with chil-
dren has both positive and negative impacts on child and household food insecurity.
J Acad Nutr Diet. 2021;121(1 Suppl 1):S34-S45.

H
OUSEHOLD FOOD INSECURITY IS A CONCERN FOR food insecurity among children and its associations with
the health and well-being of low-income children negative health and social outcomes, numerous nutrition
in the United States.1 Food insecurity occurs when assistance programs seek to reduce and prevent it through
household members experience disruptions to the increased access to healthy food.
quality and quantity of the household food supply due to a School meals are a cornerstone of nutrition and food se-
lack of money or other resources.2 In 2018, 16.5% of low- curity among low-income children. The National School
income households had food insecure children, meaning Lunch Program (NSLP) provides students access to a healthy
children were directly exposed to food insecurity.2 This is a school lunch and is offered to low-income students either
nutrition and public health concern because food insecurity free of charge or at a reduced price. In an average month in
is associated with lower fruit consumption, iron-deficient fiscal year 2018, 29.7 million children participated in NSLP, of
anemia, learning and social development, and mental which 74% received free or reduced-price (FRP) meals.7 The
health disorders among children.3-6 Given the prevalence of School Breakfast Program (SBP) provides access to a healthy

Published by Elsevier Inc. on behalf of the Academy of Nutrition and Di-


etetics. This is an open access article under the CC BY-NC-ND license
S34 JOURNAL OF THE ACADEMY OF NUTRITION AND DIETETICS (http://creativecommons.org/licenses/by-nc-nd/4.0/).
RESEARCH

school breakfast and is offered before the school day and is


either free of charge or at a reduced price for low-income RESEARCH SNAPSHOT
students. In an average month in fiscal year 2018, 2.4
Research Question: Does providing low-income children
million children participated in SBP, of which 85% received
access to free school breakfast, lunch, and supper during the
FRP meals.7 To increase access and participation in SBP,
alternative delivery models offer “grab ‘n’ go” breakfast and
school day, and a food backpack on weekends and school
breakfast in the classroom rather than in a cafeteria. Both breaks reduce food insecurity among children?
NSLP and SBP participation are associated with lower rates of Key Findings: Although the distinction in nutrition assistance
child and household food insecurity.8,9 benefits between treatment and control schools was less
Schools also have access to other federal and community than planned, a school-based demonstration project aimed
programs to provide students with meals outside of the at reducing food insecurity in children in low-income
school day. The Child and Adult Care Food Program (CACFP)
households through increased participation in school meal
provides at-risk children in afterschool programs a nutritious
programs and food backpacks decreased the most severe
meal or snack (commonly referred to as a supper). In an
form of food insecurity in children but increased less severe
average month in fiscal year 2018, 1.9 million meals were
served to children through CACFP.7 When CACFP suppers are
forms in children, adults and households.
offered along with NSLP and SBP, children have access to a
breakfast, lunch, and a supper meal or snack on school days. Virginia. Schools were the experimental unit and were
Some schools in low-income areas also offer food for week- recruited to participate by the Virginia Department of Edu-
ends and school breaks through food backpack programs. cation. School participation in the study was voluntary. The
Schools typically partner with local food banks and faith- sample included 30 elementary, 6 middle, and 2 high schools
based organizations to offer food packs to low-income stu- located in the urban city of Richmond or in the rural south-
dents and are not part of any federal or state programs. CACFP west. All schools had at least 50% of households eligible for
is associated with lower rates of household food insecurity,10 FRP lunches and low academic performance, defined by the
but fewer researchers have examined the association be- Virginia Department of Education as “accredited with warn-
tween food backpacks and food insecurity. ing” based on low scores on student assessments. This study
The Commonwealth of Virginia was awarded a grant from was approved by the New England Institutional Review
the Food and Nutrition Service of the US Department of Board.
Agriculture to test the impact of providing low-income stu-
dents free breakfast, lunch, and CACFP suppers during the
school day, and food backpacks on weekends and school Random Assignment
breaks on food insecurity among children (FI-C). It was 1 of 5 Random assignment of schools occurred across several steps.
demonstration projects that resulted from direction in the First, schools were stratified based on their location in a rural
2010 Child Nutrition Act11 and the only one to heavily involve or urban area. Next, schools were matched based on several
school-based nutrition assistance programs. The purpose of characteristics including county and city (if possible), per-
this study was to test whether the project was successful in centage of FRP-eligible students when available, grades
reducing FI-C. A secondary purpose was to test whether the served, and enrollment of students eligible for school meal
project improved other measures of food insecurity, programs. Finally, schools in each pair were either arbitrarily
including very low food security among children (VLFS-C) or randomly assigned into a treatment or control group. In
and household and adult food insecurity. To achieve these the case of arbitrary assignment, within each matched pair,
purposes, the Virginia 365 (VA 365) demonstration project the school that was listed first alphabetically was assigned to
was implemented in 19 rural and urban schools in Virginia. the treatment group and the other to the control group.
The project was evaluated using a cluster-randomized trial Sixteen schools were assigned in this way. Although not
design to test the impact of providing the free meals and food technically random, it was not based on self-selection or
backpacks in schools. We hypothesized that households with other meaningful observable characteristics that could bias
students in schools receiving the project benefits would have estimates. The arbitrary assignment of schools was
lower rates of FI-C, as well as lower rates of VLFS-C and completed prior to the grant award.
household and adult food insecurity. To test these hypothe- The Consolidated Standards of Reporting Trials Flow Dia-
ses, we used logistic regression models to examine differ- gram shows the derivation of the sample, from the initial
ences in rates of food insecurity within households that did sample frame, random sample of eligible households,
and did not receive the project benefits. through random assignment, and follow-up (Figure). Within
the 19 treatment and 19 control schools, a stratified random
sample of households with FRP students or students who
METHODS attended a Community Eligibility Provision (CEP) school were
Overview selected to participate in the evaluation. Schools in low-
The VA 365 demonstration project took place between 2016 income areas can participate in CEP, which allows all chil-
and 2018, with the primary evaluation period during the dren access to free meals through NSLP and SBP regardless of
2016-2017 school year (ClinicalTrials.gov number, NCT household income. Households were stratified by region of
04218747). A detailed description of the project, methods, Virginia (schools in urban Richmond or the rural southwest).
and additional results can be found elsewhere,12 but will be Selection of households occurred over several steps. Within
summarized here. The evaluation used a cluster-randomized the 38 schools, 10,705 households met selection criteria and
trial design with a convenience sample of 38 schools in were eligible for sampling. A random sample of 6,333

January 2021 Volume 121 Number 1 Suppl 1 JOURNAL OF THE ACADEMY OF NUTRITION AND DIETETICS S35
RESEARCH

Household sample
Enrollment and consent
(n=4,750)

Prior to
randomization,
schools matched on
school and student
characteristics

Treatment Control

n=19 schools n=19 schools


Allocation n=2,487 households n=2,263 households
n=209 ineligibles n=183 ineligibles

Households with Households with


Baseline analysis baseline data baseline data
(n=1,380) (n=1,216)

Households with Households with


follow-up data follow-up data
(n=1,393) (n=1,243)
Follow-up analysis
Households missing Households missing
child food security child food security
measures (n=13 ) measures (n=10)
Figure. Flow diagram for the randomized controlled trial evaluation of the VA 365 Demonstration Project.

households were selected for participation in the evaluation. 19 treatment schools were already implementing universal
Of these 6,333 households, a random sample of 4,750 were free breakfast and lunch and some Richmond schools were
selected for data collection. This second random sample was implementing free snacks and/or suppers through CACFP, the
taken as a reserve sample (ie, the difference of 1,583 house- intervention expanded these benefits to all children in all
holds) in case of low response rates or other issues. Of the treatment schools. Note that data on the number of Rich-
4,750 households selected for data collection, 392 were mond treatment schools and afterschool program sites that
ineligible at baseline and an additional 3 were ineligible at were already participating in the CACFP At-Risk Afterschool
follow-up; therefore, 4,355 households comprised the eval- Meals component were unavailable. Only 3 schools in
uation sample and were contacted for data collection. At Southwest VA implemented CACFP and only for 2 months as
follow-up, 1,393 treatment households and 1,243 control a test run for the intervention. In regard to the second set,
households completed a survey sufficiently to be included in treatment schools received a waiver from Food and Nutrition
the analysis. The weighted follow-up response rate was 63% Service that allowed them to serve CACFP suppers during the
in the treatment group and 62% in the control group. school day rather than after school, as federally required. This
is a considerable benefit because it ensured that many more
The VA 365 Demonstration Project students would have access to the supper. The supper was
Treatment schools received 2 sets of benefits, and control usually provided in the last class periods before the end of
schools implemented a similar, but less robust set of benefits. the school day (ranging from 2:15 PM to 4:15 PM). In addition,
The first set of benefits expanded free school-based nutrition all children in treatment schools were offered a food back-
assistance programs to all children in all treatment schools. pack each weekend and on school breaks. Typically, children
The second set of benefits loosened restrictions in CACFP and took food backpacks home on Fridays and each backpack
strengthened school backpack programs. In regard to the first included foods that would comprise 2 breakfasts, lunches,
set, all children in treatment schools were eligible to receive a and suppers. When children needed additional food to cover
free breakfast, lunch, and supper each school day and a food long weekends and extended school breaks, schools would
backpack on weekends and school breaks. Although 11 of the distribute the additional food packs together with the regular

S36 JOURNAL OF THE ACADEMY OF NUTRITION AND DIETETICS January 2021 Volume 121 Number 1 Suppl 1
RESEARCH

Table 1. Treatment and control child nutrition programs and operations during the Virginia 365 Project school year (n ¼ 38
schools)

No. of treatment schools (n [ 19) No. of control schools (n [ 19)

Virginia 365 demonstration benefitsa


Participated in SBPb 19 19
Offered free breakfast to all children 19 12
Participated in NSLPc 19 19
Offered free lunch to all children 19 12
Participated in the CACFPd at-risk afterschool meals 19 11
Offered the meal during the school daye 19 0
f
Participated in a backpack program 19 10
Offered the backpack to all children 19 0
g
Other school-based nutrition assistance programs
Participated in the FFVPh 2 11
Participated in the NSLP afterschool snack program 1 1
Used alternative school breakfast modeli 16 17
a
Virginia 365 benefits were a set that included universal free breakfast and lunch; universal free CACFP meal during the school day; and a universal free food backpack each weekend and
school break. As indicated, all 19 treatment schools participated in these programs. Because of unintended overlap, some control schools implemented exactly the same benefits (ie,
universal free breakfast and lunch) or similar, but less robust versions of benefits (ie, CACFP meals after the school day to participating students and a limited backpack program).
b
SBP ¼ School Breakfast Program.
c
NSLP ¼ National School Lunch Program.
d
CACFP ¼ Child and Adult Care Food Program.
e
Treatment schools received a waiver from the US Department of Agriculture, Food and Nutrition Service to serve the meal during the school day to all children rather than after the end of
the school day to participating children.
f
All children in treatment schools were offered a food backpack on weekends and school breaks. In control schools, the backpacks were only provided to selected children.
g
Benefits not part of the Virginia 365 demonstration but offered to students.
h
FFVP ¼ Fresh Fruit and Vegetable Program. Operated at least 2 days per week but often fewer than 5 days per week. Most treatment schools decided to stop participating in FFVP to avoid
too many eating occasions during the school day.
i
Includes models such as “grab ‘n’ go” and breakfast in the classroom.

delivery at the end of the school week or, to account for the with what treatment schools received. For example, 11 con-
additional weight and volume, distribute the additional packs trol schools implemented CACFP At-Risk Afterschool Meals,
on earlier school days leading up to the break. The backpack but could only deliver it to eligible children after the end of
program was made possible by a strong partnership with the school day (ie, control schools did not receive a CACFP
local food banks and nonprofit groups. Treatment households waiver from Food and Nutrition Service). Ten control schools
also received some other benefits, however, they were not also implemented a backpack program. Both CACFP and
evaluated as part of this demonstration project, but are noted backpack program benefits were targeted toward selected
here for completeness. During the summer months before children and were not universally available to all students.
school started, students eligible for FRP school meals also Backpack programs did not have the same packing and de-
received an electronic benefits transfer card that could be livery infrastructure or depth of partnerships compared with
used on eligible foods at Supplemental Nutrition Assistance treatment schools. Twelve of the 19 control schools served
Program authorized retailers. These benefits were provided school meals at no cost through the CEP and this was iden-
after baseline data collection and therefore could not influ- tical to what treatment schools received. Finally, treatment
ence responses to the baseline survey. They ended 5 to 9 schools were encouraged to participate in alternative break-
months before follow-up data collection, making it unlikely fast models—16 treatment schools participated in such a
to influence responses to the food security measure, which model but 17 control schools did too. It is critical to note,
had a 30-day recall period. The summer electronic benefits however, that project benefits in treatment schools were
transfer benefits were not part of the evaluation because available to all students and in control schools they were
similar projects had already been evaluated.13 Treatment available only to eligible students or in the case of NSLP and
households also had access to free nutrition education clas- SBP, those in CEP schools.
ses, however, <1% of treatment households attended a class; It was known from the beginning that there would be some
therefore, whether or not a household received nutrition overlap between treatment and control schools in terms of
education is not included as part of this analysis. nutrition benefits, but the extent of the overlap was unin-
Control schools implemented a similar set of benefits tended and not known until after it was too late to change the
(Table 1); however, these benefits were less robust compared research design. It was not possible to prevent the control

January 2021 Volume 121 Number 1 Suppl 1 JOURNAL OF THE ACADEMY OF NUTRITION AND DIETETICS S37
RESEARCH

schools from offering some of the same benefits that treat- Supplemental Nutrition Program for Women, Infants, and
ment schools offered, primarily because control schools were Children, or school-based meal programs; baseline use of
legally allowed to participate in nutrition assistance pro- food pantries, emergency kitchens, and community pro-
grams available to them, and ethical concerns related to grams; locality of household; and month of follow-up survey.
denying control schools resources to feed children who were Households were excluded from the sample if they had
in immediate need. Ultimately, although there was an overlap missing food security data. When possible, missing data on
in some benefits between treatment and control schools, we the follow-up survey were replaced with information from
believe considerable differences remained that the research administrative data from participating schools (eg, race and
design was capable of detecting—primarily with universal ethnicity and language preference). For these covariates, an
CACFP and backpack program benefits in treatment schools. approach known as “dummy variable adjustment” was used
Indeed, even considering the overlap issue, not a single to address missing covariate data. In this approach, binary
school in the control group received the robust set of benefits indicators of the missing-value status of covariates were
that all treatment schools received. included in the regression model.14 Aside from households
that did not respond to the baseline survey (about 20% of
Participants and Data Collection those with valid outcome data), only a small share of
households had missing data on variables included in this
Data were collected from participating households via base-
analysis, with income being imputed for 6.2% of households
line and follow-up telephone surveys. Survey respondents
and <3.0% for other covariates.
received a $30 gift card. The baseline survey was conducted
before the start of the intervention and the follow-up survey
was conducted approximately 9 months after the start of the STATISTICAL ANALYSIS
demonstration. A knowledgeable adult in the household
Analyses were conducted using Stata software (version 15)
completed the survey. A random subset of households that
(Stata Corp, College Station, TX).15 All statistics incorporate
did not respond to the telephone survey were selected for in-
survey weights to be representative of all eligible households
field locating. For these households, a member of the study
in the demonstration. The sample weights also help ensure
team physically went to the person’s last known address and
that differential patterns of survey response do not lead to
attempted to conduct the survey in-person.
systematic differences between the households included in
the treatment and control groups of the evaluation. An intent
Measurement to treat approach was used when analyzing the data. Stata
The primary outcome of interest was FI-C. Secondary out- survey procedures were used to account for the complex
comes of interest were VLFS-C and food insecurity and very survey design and weights.
low food security among households and adults. Both the Descriptive statistics were used to examine socioeconomic
primary and secondary outcomes were measured using the differences at baseline between treatment and control groups
US Department of Agriculture’s Household Food Security and to infer whether the randomization was successful. To
Survey Module (HFSSM) with a 30-day recall period.2 The test for statistically significant differences between treatment
module consists of 18 Likert-type items: 10 at the adult level and control groups, c2 tests were used for categorical vari-
and 8 at the child level. Items are first scored then summed ables and t tests were used for continuous variables. Logistic
together. Based on the number of affirmations, children, regression was used to estimate the impact of the project on
adults, and households are classified as food secure or 1 of 2 food security status at the child, adult, and household levels.
sequentially more severe categories: food insecure or very Logistic regression was also used to estimate the impact of
low food secure. The HFSSM is the reference standard for the project on participation in SBP, SBP FRP meals NSLP, NSLP
measuring food insecurity in the United States. FRP meals, supper program, backpack program, after school
The primary independent variable of interest was the snack program, receiving food at other centers (eg, Head
treatment or control status of the school that children Start), or did not participate in any school-based nutrition
attended. Treatment or control status captures the overall programs. Specifically, we estimated 2 sets of models for food
effect of the demonstration on food insecurity. To understand security outcomes at the child, adult, and household levels.
how the intervention might have impacted food security, we One set tested the impact of the intervention on the odds of
measured a number of other variables that were targeted by being either food secure vs food insecure; the second tested
the intervention. Specifically, we measured participation in the impact on the odds of being food secure or food insecure
child nutrition programs, which included SBP, NSLP, and vs being very low food secure. For the nutrition assistance
CACFP suppers, as well as food backpack programs. programs, we estimated the odds of participation in the
We measured variables that could confound the relation- program vs no participation in the program.
ship between food security status and the effects of the Results are presented as predicted probabilities calculated
intervention and were included as covariates in the regres- from the log-odds of the logistic regressions and are pre-
sion models. Specifically, we included baseline measures of sented in the results tables. The predicted probability for the
child and adult food insecurity and very low food security; control group is the weighted probability of food security in
the number of adults in the household; mean age of children the control group. This represents the counterfactual condi-
in the household; presence of teenager in household; tion; that is, what level of food security we would expect if
respondent age in years; total household income; respondent the project had not occurred. The impact of the project,
employment status; respondent health status; respondent which we present as the difference between treatment and
race and ethnicity; language preference; baseline participa- control conditions in the tables below, is calculated as the
tion in Supplemental Nutrition Assistance Program, Special average marginal effect (also known as the average partial

S38 JOURNAL OF THE ACADEMY OF NUTRITION AND DIETETICS January 2021 Volume 121 Number 1 Suppl 1
RESEARCH

Table 2. Characteristics of households that responded to the baseline survey for the evaluation of the Virginia 365 Project (n ¼
2,596)

Total sample Treatment Control P


Characteristic (n [ 2,596) (n [ 1,380)a (n [ 1,216)b valuec

ƒƒƒƒƒƒ
ƒ mean (standard error)ƒƒƒƒƒƒ
ƒ!
d
HH size
No. of HH members who share food 4.1 (0.03) 4.1 (0.03) 4.0 (0.05) 0.429
No. of children in household 2.3 (0.03) 2.3 (0.06) 2.3 (0.06) 0.510
Reported monthly HH out-of-pocket food expenditures ($)e 378 (5) 378 (22) 378 (25) 0.993
ƒƒƒƒƒmedian (standard error)ƒƒƒƒƒ!
HH income last month ($)f 1,582 (22) 1,562 (50) 1,600 (67) 0.844
e
Reported monthly HH out-of-pocket food expenditures ($) 308 (6) 310 (8) 300 (11) 0.459
ƒƒƒƒƒƒƒƒ% (standard error)ƒƒƒƒƒƒƒƒ!
Respondent age 0.895
Respondent is under 40 y 61.5 (1.27) 61.0 (4.68) 62.1 (4.63)
Respondent is 40 y or older 38.5 (1.27) 39.1 (4.68) 37.9 (4.63)
Age of children
Younger than 5 y 30.2 (1.13) 31.0 (3.35) 29.4 (2.95) 0.791
5 to 11 y 79.6 (0.86) 79.1 (7.30) 80.2 (6.76) 0.938
12 to 17 y 48.8 (0.96) 49.6 (6.89) 47.9 (7.41) 0.907
18 y (or older if still in school) 5.7 (0.55) 6.2 (1.62) 5.2 (1.31) 0.711
Single adult HH 37.6 (1.06) 37.0 (4.21) 38.2 (3.57) 0.881
Any HH adult employed in last 30 d 69.2 (1.20) 68.3 (1.64) 70.0 (2.64) 0.664
Race/ethnicity 0.957
Hispanic, all races 7.8 (1.35) 7.8 (1.64) 7.8 (2.79)
Black, non-Hispanic 46.1 (1.45) 45.7 (9.06) 46.6 (9.20)
White, non-Hispanic 41.9 (1.55) 41.9 (9.67) 41.8 (9.87)
Other, non-Hispanic 4.2 (0.42) 4.6 (0.75) 3.8 (0.56)
g
HH nutrition benefit program participation
Reported currently receiving SNAPh 47.2 (1.15) 48.3 (3.17) 46.1 (3.83) 0.743
i
Reported receiving WIC 13.2 (0.63) 13.1 (1.63) 13.3 (1.65) 0.954
Reported receiving food from pantry, emergency kitchen, or 11.2 (0.82) 12.7 (1.14) 9.7 (1.07) 0.089
community program
Reported receiving FRPj lunch 83.6 (0.74) 83.4 (3.78) 83.9 (4.22) 0.947
Reported receiving FRP breakfast 73.8 (1.17) 73.8 (73.78) 73.9 (73.78) 0.993
Reported receiving school suppers 13.6 (1.1) 13.2 (2.53) 14.0 (2.44) 0.862
Reported receiving food backpacks 16.9 (2.04) 18.4 (3.96) 15.3 (2.65) 0.560
Reported receiving any out of school services 44.7 (2.28) 46.1 (4.58) 43.2 (3.81) 0.685
HH food-security status
Insecure 34.7 (1.23) 33.4 (1.92) 36.0 (1.90) 0.401
Very low food security 15.6 (0.78) 15.9 (1.12) 15.3 (1.27) 0.739
Adult food-security status
Insecure 31.7 (1.14) 31.0 (2.09) 32.4 (1.79) 0.675
Very low food security 15.1 (0.79) 15.8 (1.15) 14.5 (1.19) 0.494
Child food-security status
(continued on next page)

January 2021 Volume 121 Number 1 Suppl 1 JOURNAL OF THE ACADEMY OF NUTRITION AND DIETETICS S39
RESEARCH

Table 2. Characteristics of households that responded to the baseline survey for the evaluation of the Virginia 365 Project (n ¼
2,596) (continued)

Total sample Treatment Control P


Characteristic (n [ 2,596) (n [ 1,380)a (n [ 1,216)b valuec

Insecure 21.8 (0.90) 20.7 (1.50) 23.0 (1.53) 0.374


Very low food security 2.5 (0.27) 2.3 (0.40) 2.6 (0.52) 0.699
Health status 0.218
Good or excellent 72.1 (1.18) 70.6 (1.81) 73.6 (1.42)
Fair or poor 27.9 (1.18) 29.4 (1.81) 26.4 (1.42)
Primary language 0.639
English 94.5 (1.34) 95.4 (1.72) 93.6 (2.78)
Spanish 5.5 (1.34) 4.6 (1.72) 6.4 (2.78)
School location 0.889
Nonurban 32.4 (5.43) 33.7 (11.39) 31.0 (10.47)
Urban 67.6 (5.43) 66.3 (11.39) 69.0 (10.47)
a
As described in the Methods section, treatment group predicted probabilities are calculated as the sum of the control group weighted, observed probability, and the average marginal
effect.
b
Control group values are the weighted average of observed values in the sample control group.
c
P values are obtained from 2-tailed t tests of statistically significant differences for continuous measures and from c2 tests of independence for binary measures.
d
HH ¼ household.
e
Reported out-of-pocket food expenditures at stores and restaurants in the last 30 days. Excludes purchases made with SNAP and WIC.
f
Includes all earnings, Social Security, pensions, veteran benefits, unemployment insurance, workers compensation benefits, child support, payments from roomers and borders, Temporary
Assistance for Needy Families, and Supplemental Security Income for all household members.
g
Calculations include eligible and ineligible households for a specific program listed.
h
SNAP ¼ Supplemental Nutrition Assistance Program.
i
WIC ¼ Special Supplemental Nutrition Program for Women, Infants, and Children.
j
FRP ¼ free or reduced-price.

effect) using the margins command in Stata. Specifically, we households that completed the baseline survey (Table 2).
use the margins command to estimate the difference, for Overall, the mean household size was 4.1 with 2.3 children in
each observation in the full sample, between the predicted each household. The median household income in the pre-
probability of an outcome with the treatment variable set as vious month was $1,582 and 69% of households had at least 1
one and the predicted probability with the treatment variable employed adult. The plurality of respondents were Black,
set to zero, and then calculate a weighted average of these non-Hispanic (46%), followed by White, non-Hispanic (42%).
observation-level differences. This has the advantage of At baseline, 20.7% of treatment households had FI-C
making use of all sample members’ observable characteristics compared with 23.0% of control households (P ¼ 0.374);
when translating the estimated coefficient of the treatment 2.3% of treatment households were VLFS-C compared with
variable into a difference in predicted probabilities. The 2.6% of control households (P ¼ 0.699). In addition, there
predicted probability for the treatment group is the sum of were no significant differences in socioeconomic variables
the control group probability and the average marginal effect between treatment and control households among house-
of the project (treatment), which is based on the calculations holds that had follow-up survey data sufficient for inclusion
described above. One sided z tests were used to test for sig- in the analysis (results not shown).
nificance for food security outcomes because there was a The demonstration project was unsuccessful in reducing FI-
strong prior belief that the intervention would improve food C, and counter to our hypothesis, actually increased it. The
security status among treatment households and was part of predicted probability of FI-C in treatment households was
the original research and analysis plan. Given the results of 25.9% compared with 23.9% in control households, a differ-
the study, however, we were incorrect to assume that the ence of 2 percentage points (95% CI 0.1 to 3.9) (Table 3). Using
intervention could only improve food security and we note our a priori hypothesis and a 1-tailed test, this difference is
when impacts on food insecurity are significant with 2-tailed not statistically significant (P ¼ 0.98). Using a 2-tailed test,
tests. All other statistical tests other than food insecurity however, this difference is statistically significant (P ¼ 0.04).
outcomes used 2-sided tests exclusively. Results were The demonstration project was successful in reducing VLFS-C.
considered significant at an a of .05. The predicted probability of VLFS-C in treatment households
was 3.2% compared with 3.9% in control households, an ab-
solute difference of 0.7 percentage points (95% CI 1.3
RESULTS to 0.1) or a relative difference of 18% (P < 0.05, 1-tailed test).
There were no significant differences in socioeconomic vari- Although individual items from the HFSSM are not typically
ables between treatment and control households among considered, given the nature of the results, we examined

S40 JOURNAL OF THE ACADEMY OF NUTRITION AND DIETETICS January 2021 Volume 121 Number 1 Suppl 1
RESEARCH

Table 3. Impact of the Virginia 365 Project on food insecurity among children, adults, and households (n ¼ 2,634)

Variable Treatment (n [ 1,392)a Control (n [ 1,242)b Differencec 95% CI P valued

Children
Secure 74.1 76.1 e2.0e e3.9 to e0.1 0.982
e
Insecure 25.9 23.9 2.0 0.1 to 3.9 0.982
Very low food security 3.2 3.9 e0.7 e1.3 to e0.1 0.011
Adults
Secure 64.0 68.4 e4.4e e6.7 to e2.0 >0.999
Insecure 36.0 31.6 4.4 e
2.0 to 6.7 >0.999
Very low food security 17.6 14.7 3.0e 1.3 to 4.6 >0.999
Households
Secure 61.0 65.8 e4.9e e7.4 to e2.3 >0.999
Insecure 39.0 34.2 4.9 e
2.3 to 7.4 >0.999
Very low food security 18.0 15.3 2.7e 1.0 to 4.5 0.999
a
As described in the Methods section, treatment group predicted probabilities are calculated as the sum of the control group weighted probability and the average marginal effect.
b
Control group values are the predicted weighted probability of the food security outcome among observations in the control group.
c
Differences are the average marginal effect, calculated as described in the Methods section of this article. The average marginal effect is calculated using estimates from logistic regressions
that adjusted for baseline measures of household income and employment status; the survey respondent’s age, race/ethnicity, health status, and preferred language; household size and
presence of a teenager; household participation in the program being analyzed at follow-up; and indicator variables for the month of follow-up survey response. Values may not reflect
exact differences due to rounding.
d
P values associated with each impact estimate are from a 1-tailed test of statistical significance.
e
Estimate would have been significant with a 2-tailed test.

responses to the 8 child-level items. Treatment households low food security was 18.0% in treatment households
were 3.8 percentage points more likely (P < 0.05) to report compared with 15.3% in control households, a difference of
relying on a few kinds of low-cost foods to feed their children 2.7 percentage points (95% CI 1.0 to 4.5). Using our a priori
and 1.1 percentage points less likely (P ¼ 0.05) to report that hypothesis and a 1-tailed test, this difference is not statisti-
their children skipped meals. When treatment households cally significant (P > 0.99). Using a 2-tailed test, however, this
did report their children skipped a meal, they were 0.8 per- difference is statistically significant (P < 0.01).
centage points less likely (P < 0.05) to report it happened We examined responses to the 10 adult and household-
more than 2 of the last 30 days. There were no other signif- level items to understand these results. Compared with
icant differences between treatment and control households control households, treatment households were significantly
on the other child-level items. more likely to affirm 7 of the 10 items. More specifically, they
The demonstration project increased both adult and were more likely to affirm (1) worry that food would run out
household food insecurity. Among treatment households, the (P < 0.05); (2) food bought but did not last (P < 0.05); (3)
predicted probability of adult food insecurity was 36.0% could not afford to eat balanced meals (P < 0.05); (4) adults
compared with 31.6% in the control group, a difference of 4.4 cut the size of meals or skipped meals (P < 0.05); (5) cut or
percentage points (95% CI 2.0 to 6.7). Using our a priori hy- skipped meals in more than 2 of the last 30 days (P < 0.001);
pothesis and a 1-tailed test, this difference is not statistically (6) ate less than felt they should (P < 0.05); and (7) lost
significant (P > 0.99). Using a 2-tailed test, however, this weight because there was not enough money for food (P <
difference is statistically significant (P < 0.01). The predicted 0.05).
probability of very low food security among adults was 17.6% There were significant differences in reported participation
in treatment households compared with 14.7% in control rates in child nutrition programs targeted by the demon-
households, a difference of 3 percentage points (95% CI 1.3 to stration (Table 4). Treatmentecontrol differences in school
4.6). Using our a priori hypothesis and a 1-tailed test, this supper program and food backpack program participation
difference is not statistically significant (P > 0.99). Using a 2- were notably larger than differences in NSLP and SBP
tailed test, however, this difference is statistically significant participation. Treatment households were 19.9 percentage
(P < 0.01). points more likely to report participation in a school supper
Among treatment households, the predicted probability of program compared with control households (predicted
household food insecurity was 39.0% compared with 34.2% in probability of 45.9% vs 26.0%; P < 0.001). Similarly, treatment
the control group, a difference of 4.9 percentage points (95% households were 35.6 percentage points more likely to report
CI 2.3 to 7.4). Using our a priori hypothesis and a 1-tailed test, participation in a food backpack program compared with
this difference is not statistically significant (P > 0.99). Using control households (predicted probability of 58.1% vs 22.5%; P
a 2-tailed test, however, this difference is statistically signif- < 0.001). Treatment households were 2.0 percentage points
icant (P < 0.00). The predicted probability of household very more likely to report participation in the NSLP compared

January 2021 Volume 121 Number 1 Suppl 1 JOURNAL OF THE ACADEMY OF NUTRITION AND DIETETICS S41
RESEARCH

Table 4. Treatment and control predicted probabilities in child nutrition programs targeted by the Virginia 365 project (n ¼
2,636)

Child Nutrition Program (% of households that Treatment (n [ Control (n [ P


reported receipt) 1,393)a 1,243)b Differencec 95% CI valued

VA 365 Demonstration Benefitse


School Breakfast Program 81.9 79.6 2.4 0.0 to 4.7 0.042
Free or reduced-price breakfastf 78.8 73.6 5.2 2.3 to 8.1 <0.001
National School Lunch Program 91.3 89.3 2.0 0.4 to 3.5 0.007
Free or reduced-price lunchf 86.4 80.2 6.2 2.7 to 9.7 <0.001
Supper programg 45.9 26.0 19.9 15.5 to <0.001
24.3
Backpack program 58.1 22.5 35.6 30.6 to <0.001
40.7
Other School-Based Nutrition Assistance Programs
Food at after school program where snacks are 32.8 28.1 4.7 1.1 to 8.3 0.013
received
Food at another center, (eg, Head Start or daycare) 9.5 10.1 e0.6 e2.1 to 0.451
e0.9
None of the above 5.0 6.8 e1.8 e3.1 to 0.007
e0.5
a
As described in the Methods section, treatment group predicted probabilities are calculated as the sum of the control group weighted probability and the average marginal effect.
b
Control group values are the predicted weighted probability of program participation among observations in the control group.
c
Differences are the average marginal effect, calculated as described in the Methods section of this article. The average marginal effect is calculated using estimates from logistic regressions
that adjusted for baseline measures of household income and employment status; the survey respondent’s age, race/ethnicity, health status, and preferred language; household size and
presence of a teenager; household participation in the program being analyzed at follow-up; and indicator variables for the month of follow-up survey response. Values may not reflect
exact differences due to rounding.
d
P values are based on two-tailed tests of statistical significance.
e
VA 365 Benefits were a set that included universal free breakfast and lunch; universal free CACFP meal during the school day; and a universal free food backpack each weekend and school
break.
f
Parents were asked about their child’s participation in the School Breakfast Program and/or the National School Lunch Program. Within control schools, this includes children eligible for
free, reduced-price, and paid meals. In treatment schools, all children received free meals.
g
Includes CACFP meals served at school during the school day for treatment schools or after the end of the school day for control schools.

with control households (predicted probability of 91.3% vs important questions about the assumption that providing
89.3%; P ¼ 0.007). Similarly, treatment households were 2.4 food to households that are at risk or are experiencing food
percentage points more likely to report participation in the insecurity can do no harm.
SBP compared with control households (predicted probabil- The demonstration was unsuccessful in reducing FI-C in
ity of 81.9% vs 79.6%; P ¼ 0.042). These results suggest that treatment households, and actually increased it by 2.0 per-
the school supper and food backpack programs were driving centage points compared with control households. This result
the results of the evaluation, given the much higher partici- was unexpected and it is not clear why it occurred. It is often
pation rates in treatment households compared with control assumed that providing food directly to households will
households. reduce food insecurity.16 Although this might be true in some
circumstances, it is possible that the nature of the treatment
benefits engendered unexpected responses to items in the
DISCUSSION HFSSM. For example, we found that treatment households
Although there are important limitations to consider, such as were more likely to affirm the item related to relying on low-
some control schools offering similar, but less robust benefits cost foods to feed their children, making it more likely that
as treatment schools, the VA 365 demonstration evaluation they would be classified as FI-C. This result is understandable
provides rigorous evidence on the effect of a suite of school- if we assume that the extra food treatment households
based child nutrition programs on food insecurity. Although received through the demonstration was viewed as low cost.
the demonstration did not meet its primary goal of reducing That is, the additional food treatment households received
FI-C, it nonetheless provides important information for could have worsened food insecurity by creating a perception
policy-makers, nutrition practitioners, and others to consider that the food was low cost and they were unable to afford
when using schools as food hubs to address food insecurity in more. There were no significant differences between treat-
low-income households with children. It also raises ment and control households on other child-level items

S42 JOURNAL OF THE ACADEMY OF NUTRITION AND DIETETICS January 2021 Volume 121 Number 1 Suppl 1
RESEARCH

related to ability to afford balanced meals; children not eating treatment households reduced their own food consumption
enough; cutting the size of meals; children being hungry; and in response to their children being better fed and this nega-
children not eating all day. These items are more severe than tively affected their own food security. Treatment households
the items about relying on low-cost meals, so it is possible had median out-of-pocket food expenditures that were $11
that the intervention benefits were insufficient to affect these less compared with control households (analysis not shown),
domains. Finally, based on assumptions made by the Rasch and it is possible that this translated to less food consumed
model, which is a statistical model that underlies food se- for adults in treatment households. Ultimately, this impact
curity status classification,17 it should be theoretically analysis cannot answer why food insecurity increased in
impossible for an intervention to positively affect FI-C but treatment households, but it does raise important questions
negatively affect VLFS-C, like our study found. Although we that could be answered through future research.
discuss possible reasons for this unexpected finding, it raises Finally, although the demonstration successfully increased
important questions about the suitability of the HFSSM as participation in NSLP, SBP, CACFP, and food backpacks in
measurement tool in certain evaluation settings. Future treatment schools relative to control schools, the results
research should consider how targeted nutrition assistance should be interpreted with caution and within the context of
interventions might change the likelihood of affirming items a control-group that offered a similar, but less robust set of
on the HFSSM and the implications this could have for benefits. This weakened the originally planned contrast be-
measuring changes in food security status and the underlying tween treatment and control schools and complicates inter-
assumptions of the Rash model. pretation of the findings because the contrast between the
The demonstration was successful in reducing VLFS-C by treatment and control group is lessened and inconsistent.
0.7 percentage points in treatment households compared Although the contrast is less than ideal, we believe that there
with control households. This is a considerable reduction is still sufficient distinction between the treatment and
given that VLFS-C is severe condition and reducing its prev- control groups. Not a single control school received the
alence is of policy and public health importance.18 Children robust set of benefits that all treatment schools received nor
who are very low food secure experience considerable dis- did a single control school make the benefits available to all
ruptions in the quality and quantity of the foods they students, which all treatment schools did. The other con-
consume. Treatment households were significantly less likely cerning issue is that there was variation in the type of ben-
to affirm the 2 child-level items related to skipping meals efits made available to students in the control group, such
compared with control households, but not the more severe that not all control schools uniformly delivered the same set
items related to children going hungry and not eating for a of benefits. This complicates the interpretation of the findings
whole day. This result can be explained by the treatment because it makes it less clear what the treatment group is
group receiving an extra meal each day through CACFP and a being compared with and therefore difficult to have complete
food backpack that was meant to cover breakfast and lunch faith in the counterfactual. We view this as a considerable
on weekends and school breaks. It is unclear why these extra issue, however, because we consider average differences in
meals would not affect the rate at which children were food security and other outcomes between treatment and
hungry or did not eat for a whole day, but it is possible that control groups, we believe that the comparison is worthwhile
although children in treatment households were less likely to as it represents a policy-relevant and real-world scenario.
skip meals, that did not translate to complete removal of That is, where some schools offer a robust set of nutrition
hunger or not eating for whole day, especially the latter, assistance compared with other schools that offer a limited
which is a rare occurrence (<1% in the treatment and control set. Furthermore, our original research and analysis plan held
groups) and could represent extreme circumstances that the us accountable to this analysis approach and reporting.
intervention could not address. For these households, sub-
stantially reducing food insecurity might require solutions in
addition to providing more food. Future research should Strengths and Limitations
consider how schools can best identify and then target This study had several strengths. First, it used a randomized
nutrition assistance to the households in most need, and the controlled trial design to test the causal impact of the VA 365
most effective method of assistance to prevent and reduce FI- demonstration on food security status. The use of randomi-
C and VLFS-C as the solutions can differ. zation largely eliminates sources of confounding and bias.
The demonstration was unsuccessful in reducing adult or Furthermore, there were no outliers in measured variables or
household food insecurity, and actually increased it. Similar schools that were driving the results; the data were well
to the results for FI-C, this was unexpected and it is unclear balanced. Second, food security status was assessed using the
why it occurred. One possibility is that the extra food pro- reliable and valid HFSSM, which is the reference standard
vided to households in the treatment condition—particularly measure. Third, intensive project management, technical
the CACFP suppers and food backpacks—altered perceptions assistance, and local partners resulted in the demonstration
of household food insecurity. Both programs might have been being delivered as intended. Finally, the use of baseline and
viewed as “extra” benefits by participants because they are follow-up surveys allowed adjustment of baseline variables,
much less commonly used than NSLP and SBP. These extra strengthening our inferences.
benefits might have created a sense of relative deprivation19 This study also had several limitations. First and foremost,
in adults responding to the HFSSM. That is, the extra benefits and as discussed previously, the study design was moderately
created a situation where increased access to food for their compromised because the control group delivered a similar,
children actually made adults feel worse about their own but less robust set of benefits than what the treatment group
food security because it highlighted that the food was needed delivered. This likely weakened the planned for counterfac-
in the first place. Another possibility is that adults in tual that is ideally achieved through randomization. We

January 2021 Volume 121 Number 1 Suppl 1 JOURNAL OF THE ACADEMY OF NUTRITION AND DIETETICS S43
RESEARCH

believe in this case, however, that there were still sufficient complex manner in which food security status is perceived
differences between the treatment and control groups to and reported by respondents when receiving additional
justify and support the analysis, results, and conclusions. nutrition assistance.
Second, there was attrition between randomization, the
baseline survey, and the follow-up survey. Although we used References
statistical weights that account for this attrition, it is possible 1. Gundersen C, Ziliak JP. Food insecurity and health outcomes. Health
that residual differences could affect our inferences in un- Aff. 2015;34(11):1830-1839.
known ways. Although, the nonresponse rate was similar 2. Coleman-Jensen A, Rabbitt MP, Gregory C, Singh A. Household Food
Security in the United States in 2018. Washington, DC: US Department
between treatment and control households, there were no of Agriculture, Economic Research Service; 2019.
significant difference in demographic variables or other 3. Hanson KL, Connor LM. Food insecurity and dietary quality in US
measured characteristics at follow-up, and results did not adults and children: A systematic review. Am J Cilnical Nutr.
change if covariates were excluded from modeling (analyses 2014;100(2):684-692.
not shown), which strengthens our confidence in the internal 4. Eicher-Miller HA, Mason AC, Weaver CM, McCabe GP, Boushey CJ.
validity of the evaluation. Third, the demonstration took Food insecurity is associated with iron deficiency anemia in US ad-
olescents. Am J Clin Nutr. 2009;90(5):1358-1371.
place in low-income rural and urban areas of Virginia. Our
5. Jyoti DF, Frongillo EA, Jones SJ. Food insecurity affects school chil-
findings might not generalize to other geographic areas or dren’s academic performance, weight gain, and social skills. J Nutr.
schools with different student body characteristics. Fourth, 2005;135(12):2831-2839.
although all treatment schools delivered all demonstration 6. Burke MP, Martini LH, Çayır E, Hartline-Grafton HL, Meade RL.
services as intended, there was variation in certain aspects of Severity of household food insecurity is positively associated with
mental disorders among children and adolescents in the United
the delivery. For example, the timing of CACFP suppers varied States. J Nutr. 2016;146(10):2019-2026.
and so did methods of backpack distribution (eg, some placed 7. USDA Child Nutrition Data Tables. US Department of Agriculture,
food directly into student backpacks and others let children Food and Nutrition Service. Accessed September 12, 2019. https://
choose to pick food backpacks up from a distribution table). www.fns.usda.gov/pd/child-nutrition-tables.
Fifth, because schools operating under CEP were included in 8. Arteaga I, Heflin C. Participation in the National School Lunch Pro-
the sample, some higher-income households at low-risk of gram and food security: An analysis of transitions into kindergarten.
Child Youth Serv Rev. 2014;47(P3):224-230.
food insecurity were included in the analysis. Although likely
9. Bartfeld JS, Ahn H. The School Breakfast Program strengthens
a relatively small share of households, their inclusion was household food security among low-income households with
unavoidable because income verification before randomiza- elementary school children. J Nutr. 2011;141(3):470-475.
tion was not possible through school administrative records 10. Heflin C, Arteaga I, Gable S. The Child and Adult Care Food Program
as schools operating under CEP do not collect household- and food insecurity. Soc Serv Rev. 2015;89(1):77-98.
level income. Finally, the HFSSM might not be the best 11. Healthy, Hunger-Free Kids Act of 2010. Pub L. No. 111-296, 124 Stat
measurement of interventions that target individual children 3183 (2010).
away from home, as it was designed to capture overall food 12. Cabili C, Caronongan P, Gleason P, et al. Evaluation of Demonstration
Projects to End Childhood Hunger (EDECH): The Virginia 365 Project.
experiences at the household level. A more focused measure Alexandria, VA: US Department of Agriculture, Food and Nutrition
sensitive to children’s experiences might have better Service; 2019.
captured the interventions impacts on FI-C. 13. Klerman JA, Wolf A, Collins A, Bell S, Briefel R. The effects the sum-
mer electronic benefits transfer for children demonstration has on
children’s food security. Appl Econ Perspect Policy. 2017;39(3):516-
CONCLUSIONS 532.
A demonstration aimed at reducing food insecurity through 14. Puma MJ, Olsen RB, Bell SH, Price C. What to Do When Data Are
increased participation in a suite of school-based nutrition Missing in Group Randomized Controlled Trials (NCEE 2009-0049).
assistance programs decreased the most severe form of Washington, DC: US Department of Education; 2009.
food insecurity in children but also increased less severe 15. STATA Statistical Software [computer program]. Release 15. College
Station, TX: StataCorp LLC; 2017.
forms in children, adults, and households. Although the
16. Fram MS, Frongillo EA. Backpack programs and the crisis narrative of
distinction in nutrition assistance benefits between treat- child hunger-A critical review of the rationale, targeting, and po-
ment and control schools was less than planned, these tential benefits and harms of an expanding but untested model of
results suggest that providing a suite of nutrition assistance practice. Adv Nutr. 2018;9(1):1-8.
programs targeted broadly to low-income households with 17. Wilde PE. Differential response patterns affect food-security preva-
lence estimates for households with and without children. J Nutr.
children can both positively and negatively affect food
2004;134(8):1910-1915.
insecurity compared with schools that provide a similar but
18. Healthy People 2020 Topics and Objectives. US Department of
less robust suite of nutrition assistance programs. Future Health and Human Services. Accessed on October 25, 2020. http://
work should address how to best target food insecure www.healthypeople.gov/2020/topics-objectives.
households with resources to produce the best outcomes 19. Runciman WG. Relative Deprivation and Social Justice. London:
for with FI-C vs VLFS-C in school-based settings, and the Routledge & Kegan Paul; 1966.

S44 JOURNAL OF THE ACADEMY OF NUTRITION AND DIETETICS January 2021 Volume 121 Number 1 Suppl 1
RESEARCH

AUTHOR INFORMATION
M. Burke is a social science research analyst, US Department of Agriculture, Food and Nutrition Service, Alexandria, VA. C. Cabili is a researcher,
Mathematica, Washington, DC. D. Berman is a special nutrition evaluation branch chief, US Department of Agriculture, Food and Nutrition
Service, Alexandria, VA. S. G. Forrestal is a senior survey researcher, Mathematica, Chicago, IL. P. M. Gleason is an associate director, Human
Services Research and Senior Fellow, Mathematica, Washington, DC.
Address correspondence to: Michael Burke, PhD, MPH, US Department of Agriculture, Food and Nutrition Service, 1320 Braddock Pl, 5th Floor,
Alexandria, VA 22314. E-mail: Michael.Burke@usda.gov
STATEMENT OF POTENTIAL CONFLICT OF INTEREST
No potential conflict of interest was reported by the authors.
FUNDING/SUPPORT
This article is published as part of a supplement supported by the U.S. Department of Agriculture, Food and Nutrition Service. This work was
funded by the US Department of Agriculture, Food and Nutrition Service under contract no. AG-3198-C-14-0019. The findings and conclusions in
this publication are those of the authors and should not be construed to represent any US Department of Agriculture office or US Government
determination or policy.
ACKNOWLEDGEMENTS
The authors thank Ronette Briefel, DrPH, RD, who directed the Virginia demonstration project and all other demonstration projects in the
Evaluation of Demonstrations to End Childhood Hunger. We thank study team members who contributed to the data collection and analyses,
including the coauthors of the Virginia 365 final evaluation report (Pia Caronongan, PhD Gregory Chojnacki, MPP, MA, Nicholas Redel, MA, and
Breanna Wakar, MA) and programmers who helped prepare the data tables (Natalie Larkin, BA Kelley Monzella, BA, and Liz Potamites, PhD). The
authors thank the US Department of Agriculture Food and Nutrition Service for review of a previous version of the manuscript. Everyone named
provided permission to be acknowledged. The findings and conclusions in this publication are those of the authors and should not be construed
to represent any office US Department of Agriculture or US Government determination or policy.
AUTHOR CONTRIBUTIONS
The Virginia Department of Education designed the intervention. M. Burke provided oversight for all aspects of the evaluation. M. Burke wrote
the manuscript and had primary responsibility for final content. C. Cabili served as the evaluation liaison to the Virginia Department of Education,
conducted the implementation analysis, and led the impact evaluation report. D. Berman provided oversight for the evaluation. S. Forrestal
directed the survey operations. P. Gleason designed the evaluation and had oversight of the analysis. All coauthors contributed to analyses,
reviewed the draft manuscript, and approved the final manuscript.

January 2021 Volume 121 Number 1 Suppl 1 JOURNAL OF THE ACADEMY OF NUTRITION AND DIETETICS S45

You might also like