Professional Documents
Culture Documents
Adapting Marketing Mix Models To Major Shifts: June 2020
Adapting Marketing Mix Models To Major Shifts: June 2020
Adapting Marketing
Mix Models to
Major Shifts
LE AR N AC TI ONA BLE WAYS TO UPDATE MO D E LS W H E N UN E X PEC TE D
E V E N TS AFFEC T CONSUM ER BE H AV I O R, AN D H OW I N D US TRY
LE ADE RS A RE PI VOTI NG I N RE S PO N S E TO TH E C OV I D -1 9 O UTBRE A K .
Adapting Marketing Mix Models to Major Shifts 2
Contents
01 . I NTROD UC TI ON
01. Introduction
BU I LDIN G MORE FUTURE-FOCUS E D MO D E LS
Marketing mix models have long been an By updating their models, advertisers can use
important tool for advertisers to understand them to help answer the marketing questions
how their marketing impacts performance prompted by unplanned scenarios, including:
across channels. MMMs rely on historical
data, events, and circumstances to generate • How should I market in these times?
insights that can be used to make more Should I continue to spend my marketing
informed decisions around ad spend. As the budget or cut my losses?
COVID-19 pandemic continues to influence
• How can I understand the short-term
consumer behavior—changing demand for
and long-term impact of the COVID-19
products and services, media time spent,
outbreak on my business?
and consumption patterns—advertisers are
faced with the challenge of adjusting their • Are there things I can do right now to
models to understand changing business prevent my business from suffering any
environments. long-term brand impact?
As advertisers adjust to today’s conditions and plan for the future, it’s important
to evaluate if methodologies like MMM can be used to measure the impact of
the COVID-19 outbreak and inform strategies. Marketing mix modeling can take
time to create, and require sufficient data to be able to measure accurately.
There’s few challenges advertisers typically face when evaluating marketing mix
models for scenario planning that need to be addressed so MMMs can be used in
current conditions.
The good news is there are many things advertisers can do now and in the future
to build useful models that account for the impact of unexpected global events or
sudden shifts.
Significant changes in consumer behavior Capture evolving changes with more granular
has implications on the types and length of and high-grade data
models as well as on variables. To capture In order to better capture the impact of
the dynamic changes in underlying variables, evolving conditions and consumer behaviors,
advertisers can use recency variables, run we recommend using the most granular-
models over shorter time frames, use custom level data available through the Facebook
ad stocks for all digital variables (such as MMM pipeline, such as daily, campaign-level,
Weibull’s adstock) or build time- varying geo-region, direct marketing area (DMA)
parameter models. level data. The choice of variable will depend
on the demand elasticity of each product
If MMMs are run during these uncertain (essential versus non-essential) as well as
times, modelers and business decision the availability of each product in stores.
makers will need to account for this Examples of more granular data types
uncertainty in their scenario planning by advertisers can use are trends for specific
making appropriate assumptions. In some keywords, volume of COVID-19 cases by
areas, modelers will also need to account for location, global and local market level stock
any restrictions on consumer purchasing: index, or flight statistics in the travel industry.
For example, the Spanish1 and Italian2
governments provided specific guidance on In markets where it makes sense, we
how and what to buy to limit panic buying, recommend modelling by geographical areas,
and restrictions on the pricing of essential particularly in countries like Spain, Italy,
products were issued in India3. If MMMs were UK and elsewhere where the de-escalation
built during periods of the pandemic that had process is following different patterns by
greater impact on people’s behavior—e.g., regions. Data for regions that are on a faster
during a shelter in place order—advertisers track with loosening restrictions can help
may want to repeat them as regional predict what will happen in regions that have
economies stabilize to understand what not progressed as far, and can be helpful in
dynamics may be permanently different. informing media investment decision making.
It’s also important to note that the definition
for “getting back to normal” will vary by
geography.
Source: 1 “El Gobierno recomienda planificar las compras en Semana Santa y elegir el comercio de proximidad para evitar contagios,”
Europa Press, April 6, 2020.
2 “Coronavirus: Esselunga, Carrefour, Eurospin vietano l’acquisto di penne e quaderni. È polemica. Federdistribuzione non è
d’accordo”, Il Fatto Alimentare, March 17 2020.
3 MINISTRY OF CONSUMER AFFAIRS, FOOD AND PUBLIC DISTRIBUTION (Department of Consumer Affairs) Notification
New Delhi, March 21, 2020
Increase the impact of media variables with models are as accurate as possible, resulting
best practices. in more confident marketing decision-making.
While advertisers should always strive Ecommerce company ThirdLove did so by
to categorize impressions based on how building 3 models, with each using slightly
they adhere to best practices, it’s even different assumptions. Each model found
more important now to have a handle on a different marketing channel to have the
creative/media execution performance when lowest cost per acquisition. By calibrating
separating the various factors in marketing their models with experiments, ThirdLove
mix modeling. Advertisers can segment determined which model was the most
campaigns based on their compliance to accurate, and got better insight into how
media/creative best practices, then use to best allocate their marketing budget,
these buckets to contextualize and possibly according to their business goals. Conversion
inform splitting impressions and variables lift results can be used as either Bayesian
into several categories (e.g., low, medium and priors (if Bayesian models are built) or as
high). As we’ve noted in previous studies, coefficient constraints.
campaigns that follow media and creative
best practices tend to be more effective in Adjust optimization and scenario planning
achieving objectives, so those impressions Optimization and scenario planning are
carry more influence. based on the assumption that historical
trends predict future performance. Currently
Calibrate and validate MMMs using behavior patterns resulting from the
experiments COVID-19 pandemic may not indicate long-
Running experiments is useful for advertisers term trends, so advertisers should be mindful
in order to check assumptions, choose of whether their MMM findings from this
between models, test against known period should be used during planning.
outcomes and tweak models to make them
more accurate. With increased scrutiny of
marketing budgets or less relevant historical
Calibrating marketing mix models
data to reference becoming more common
challenges for marketing teams, calibrating with experiments is an effective way
marketing mix models with experiments is for advertisers to ensure models are
an effective way for advertisers to ensure as accurate as possible.
• Extrapolate any underlying data forward carefully. When extrapolating the data forward for
the inclusion in scenario plans, consider creating low/mid/high or optimistic/pessimistic
scenarios and varying sensitivity. Run simulations and optimizations frequently to capture
latest CPMs and study uncertainty intervals for interpretation and actions. Study synergies
between baseline and other factors.
• Assess changes in channel reach and penetration. Examine media response curves with
marketing mix model partners to incorporate changing reach and penetration of different
channels, especially digital.
• Reevaluate existing MMMs with providers to determine the best way forward.
Most existing MMMs are built without specific consideration for dealing with crises and may
not be able to control and accurately account for many of these changes.
John Puhl, VP Global Marketing Analytics For example, do not shift budgets long-term
Programs, Nielsen from digital to TV because TV consumption
“Sensitivity analyses will be a good way to may be at a high right now for markets
understand the impact of COVID-19 and also that are staying indoors. Also, don’t apply
to make decisions for channels right now. your current optimal spend for when things
We are recommending that clients change stabilize; the findings may no longer apply.”
the factors and run scenarios to find the
minimums and maximums from different Marc Vermut, VP Marketing Solutions,
optimizations and simulations. Nielsen Neustar
will use data from our norms database to “We are recommending advertisers run
help identify factors like percentiles of different scenarios by adjusting the forward-
marketing effectiveness or slow and fast looking assumptions in our tool. Our planner
recovery to help clients run these scenarios. allows marketers to create different scenarios
It is important to remember that marketing using different media and control variables
effectiveness is changing right now—even assumptions. We have enabled clients to
if people are watching more TV or spending make changes to adjust the intercept on a
time on digital, it doesn’t necessarily mean weekly basis to reflect the changing impact of
higher effectiveness.” COVID-19 over time, constraining the media
that is not available, adjusting the CPMs of
Susan Lahey, Principal, Marketing the ones that are available, and so on. We
Effectiveness/Strategic Analytics, IRI are working with our clients to develop the
“Running typical optimization scenarios intercept adjustment assumptions based on
will not account for the more intangible the difference between model estimation
circumstance. Specific to individual versus actual sales.”
campaigns, this is the best time to optimize
using actual recent purchase data (100%
deterministic) because optimizing for pre-
It’s important to remember that
pandemic online and offline behaviors is less
valid. They can deliver more impressions to marketing effectiveness is changing
campaign tactics that are resulting in more right now - even if people are
dollar sales and/or suppress impressions watching more TV or spending time
to those buyers who just bought, thereby on digital, it doesn’t necessarily mean
minimizing waste. We do caution that
higher effectiveness.
advertisers do not make massive changes
from one medium to another.
Davide Fabrizio, Insight Analytics Director, Lower advertising competition in the media
Deloitte Analytics Unit market favors brands with innovative and/or
“Think of 20-30% in the short term and emotional campaigns, combining advertising
70-80% in the long term. Now more than with aid actions (such as buying masks or
ever it’s important to have measured the helping health and the safety of workers or
long-term impact of advertising in past people in need). It’s an opportunity to think of
historical data and to know the baseline campaign ads combining brand and product,
of the business and the possible erosion and taking advantage of their interaction.
that can occur by stopping advertising. It Multiplicative and viralization effects are
is a great time to generate awareness and more likely to be deployed in this period,
consideration with marketing that transmits boosting ROI in the short and long term.”
the brand values along with concrete actions.
20-30%
SHORT TERM IMPAC T
70-80%
LONG TERM IMPAC T
John Puhl, VP Global Marketing Analytics distinct peak variable (such as COVID-19) is
Programs, Nielsen to account for the uniqueness of marketing
“It will depend on the advertisers’ context: response when marketing spend has gone
if advertisers have specifically executed down in correlation with broader category
content in response to the pandemic, the spend and other exogenous factors.
results will be relevant. If clients are looking Ultimately the key is to put ROIs in context of
for long term, the results will need to be the current situation and help our clients plan
looked at more carefully. Increased ROI for marketing spend. Evaluate each campaign
because of low CPMs may not provide an to understand media activation periods.
accurate picture. For CPG, manufacturing is
the most important factor—getting products Marc Vermut, VP Marketing Solutions,
to the shelf. Currently, our estimates are Neustar
that CPG companies are getting a 3-5% “Changes in overall and channel-level ROI
increase in total company sales (with varying are primarily due to base demand erosion,
results by category and manufacturer) so it’s critical to balance the increase in ROI
during the COVID-19 pandemic. What will from lower spend if you’re cutting against
be interesting to see is if companies will be the reduced effectiveness of marketing
able to maintain their shares after things in the face of reduced demand. And don’t
get to normal. For example, will shelf-stable reduce investments to maintain an ROI if that
foods continue to see an increase in sales will lead to reduced brand equity and sales
when restaurants reopen? For this reason, we performance as we return to a new normal.”
believe that continuing to advertise during
this time to build a resilient brand and the Adam Rodgers, Managing Director/GM,
need to advertise after this time will continue North America, Ekimetrics
to be important to maintain this increased “ROI potential will directly be linked to the
consumption.” size of the market, don’t expect high levels
in the short term. But changes in media
Susan Lahey, Principal, Marketing consumption, chaos, and uncertainty may
Effectiveness/Strategic Analytics, IRI potentially provide opportunities and a better
“Under normal conditions reducing price for media. It’s easy to have a strong
advertising spend would often increase ROIs ROI with limited spend, but you may be
by moving further back on response curves leaving money on the table. As in all times,
(e.g., reducing saturation). However, there the key is to maximize your overall ROI: so as
are typically breakthrough levels that must budgets are going down, you need to balance
be considered based on an advertisers’ share sufficiency levels and the more effective
of voice. Part of the reason for having a channels for your overall mix.